Over time the backup strategies for my personal laptop are changing in the search for the most cost-effective, robust and secure solution. And it must be able to back up both my Windows host and Linux virtual machine.
- I tried a backup to an AWS EC2 instance for a while but this was expensive.
- I then changed to Acronis Cloud backup because I’m very satisfied with their local hard disk backups. But their online cloud backup was an unpleasant experience. The cloud backup failed without indication in the taskbar; when I clicked for more info, the cryptic “error(0x49052524) in lib; please contact support” was displayed; I contacted support to no avail — but they wanted me to reinstall; it fixed itself after a dozen of days; this has happened two times in a few months; last but not least, when I wanted to browse my online backup the web interface was really slow. Sorry Acronis, but you really disappointed me.
Now I’ve come to an open-source solution for my backup needs — the Encrypted S3 Backup written in Bash based on the official Amazon Command-Line Interface (CLI). This simple backup system leaves control and visibility in your hands. Additionally, the backup scripts are very small and you can easily audit them. The README provides all information about the design, security, usage, disaster recovery, etc. More or less, it’s a solution for Linux technical guys, and not really suited for end-uses who should try Duplicati instead. And it doesn’t back up an “image” of your system but it is file-based. Only the file data is archived, so you can’t restore the file owners, permissions and other meta info.
Let’s review the pricing side. In my case I’m doing a daily backup for 125 GB data in 320,000 files.
- The incremental daily backup costs me $2.73 per month. 89% is the cost for S3 (mainly the GB-storage cost) and the rest is for bandwidth.
- The initial one-time upload of 70 GB costed me $3.43. Expect about double for 125 GB.
- The projected cost for a full restore is $11.59 where 96% is the price of the used bandwidth from S3 to Internet.
- All prices are without taxes.
As far as performance is concerned, S3 is great!
- Browsing my backup versions in the online S3 explorer is lightning fast.
- The daily sync for 125 GB data in 320,000 files takes 23 minutes. I don’t change a lot of files on my laptop during my daily activities.
- My initial upload performed with a speed of 10 MBytes/s, and it could have been faster if I had more than 80 Mbit/s Internet at my disposal.
Note that in the end you need to trust AWS S3 to encrypt your data server-side, and then to completely forget your original data.
October 26, 2016 at 7:29 am
I found this post because I have been researching a way to backup my NAS to the cloud for past few days. I have zeroed in on S3 and Backblaze B2. Although I thought Duplicati is answer to all my needs, unfortunately it does not allow browsing files using the S3/B2 web interface because it uploads an archive/volume. This also misses out on server-side versioning. Will give your scripts a try.
October 26, 2016 at 9:07 am
Right. The “encrypted-s3-backup” scripts sync files one by one and therefore they take advantage of the S3 versioning. This also allows for a more efficient space usage at S3.
March 10, 2019 at 7:12 am
Are you planning to support SSE-C encryption as you cant restore any files without the key
March 14, 2019 at 9:59 pm
Everything is based on SSE-C encryption now. I don’t understand the question.