A regular backup of your Salesforce data is critical and the Salesforce Weekly Export process will create a bundle of zip files containing a .CSV file for each of your standard and custom objects, as advertised, on a weekly basis.
While downloading those files can be cumbersome, the real challenge is in restoring that data and relationships.