R2 - S3 Sync doesn't work?
I need help. Im trying to sync a R2 bucket with S3 using the new sync tool. In almost 12 hs no files are synced. Any ideas?
13 Replies
What "new sync tool" are you talking about, cloudflare's super slurper or incremental migraiton? Is it giving you any errors?
Incremental Migration
No error. I dont find a log
Incremental migration only does anything when you request files, it pulls it from your source over to R2. Are you requesting files?
When an object is requested, it is served from your R2 bucket if it is found. If the object is not found in R2, the object will simultaneously be returned from your source storage bucket and copied to R2. All other operations, including put and delete, continue to work as usual.https://developers.cloudflare.com/r2/data-migration/sippy/ If you wanted it to do all files at once, you'd want Super Slurper
Mmm ok! And what can i use for sync?
Ok!!
what do you mean "for sync"?
Thanks!
I mean. I add a file in S3 and apear in R2
constantly, or just a one time migration?
Constantly
Sippy would only do it once and then R2 would be your "source of truth", it's meant to be a one time gradual migration
Super Slurper would only run once as well
Ohhh
I need other solution then
Thanks!!
yea idk what would offer exactly that, what's your use case? Would you need instant syncing or could you just sync once a night or so?
I have a S3/Cloudlare solution but I need a backup
So, my idea was create a R2/Cloudflare Cdn as backup
But all changes in S3 must be changed in r2 also
After a while I Will change cloudflare as main
And Cloudfront as backup
But now the software storage in s3, I cannot change it now
May be Run a migration using the API?
Or a 3rd party tool
yea looks like there's quite a few enterprise third party tools that claim to be able to do something like that but not much nice and open source
basically you need active replication with s3 being the primary and then r2 being the primary after