Cloudflare Developers

CD

Cloudflare Developers

Welcome to the official Cloudflare Developers server. Here you can ask for help and stay updated with the latest news

Join

Hello R2, I am trying to track a hang/

Hello R2, I am trying to track a hang/slow down when I download a lot of files very fast. I use R2 to hold data/artifacts for ML training, and before training download a few hundred GB per worker from 16-64 workers. What I see if things seem to work fine downloading on one worker, but when I ramp it up some files hang or download very slowly (O(kbps)). I use S5cmd with parallelism, so total download can be ~300 Gbit/s and 300+ class b requests per second. Is that something that's likely to get throttled?...

I recently used slurper tool to move

I recently used slurper tool to move data from S3 to R2. AWS shows me 2.73 TB but cloudflare shows me 7 TB for the bucket. I am using a script to get all the files and the size and it is showing 2.73 TB which is matching what I expected. The dashboard seems to be way off and I am worried this will impact billing. The initial move had some errors (10% files could not be moved) and so I ran it again 2-3 times with skip files turned on and it only attempted the error files in future migrations. I also set it to remove failed multi-part uploads within 1 day. Anyone else facing this?...

Local dev does not support the S3 API,

Local dev does not support the S3 API, including Pre-signed URLs

hmm it still isn't doing anything. found

hmm it still isn't doing anything. found 1.9k files (there's ~150k) and this is the log (last activity 10 mins ago)
No description

I'm getting a ClientError exception when

I'm getting a ClientError exception when attempting to upload files bigger than 500MB to R2 via the s3api put-object command. Only instructions I found online was to use the CRC32 checksum algorithm, but I'm getting the error anyways. For smaller files it works without a problem. Uploading to S3 also works. The error simply says: ...

Internal error when uploading

I tried to upload a file to an R2 bucket using AWS CLI in GitHub Actions (GitHub-owned runner), but it fails with internal error. The same command runs fine in my local environment with the same access key. Details. The command is like this:
aws s3 cp "$filename" "s3://$BUCKET_NAME/$filename" --endpoint-url "$ENDPOINT" --acl private
aws s3 cp "$filename" "s3://$BUCKET_NAME/$filename" --endpoint-url "$ENDPOINT" --acl private
I tried the command with and without --acl private, and it did not make a difference. ...

Hi! I tried to migrate a dataset but it

Hi! I tried to migrate a dataset but it failed for all the files. Anyone know what went wrong?
No description

hi. Im trying to create api token for r2

hi. Im trying to create api token for r2 on free account but its not working?

Hi!

Hi! I'm trying to migrate a bucket from Scaleway to R2 and I keep hitting the "The connection cannot be verified. Check the following and try again." message. As far as I can see I've set all the parameters correctly (endpoint, bucket name, API keys) and the source bucket is set to Public. Does anyone have any prior successful experience with Scaleway -> R2 migration and if so, is there anything special that needs to be done?...

Hi everyone!

Hi everyone! We’re running into a weird issue with our video uploads on Cloudflare R2, and we could use some help figuring it out. We’re using Vue.js v3 on the frontend with the Uppy library for uploading files, and Django v4 on the backend with Boto3 (v1.34) to handle all the R2-related API stuff. We’re creating presigned PUT URLs on the backend to upload files directly to the R2 bucket from the client side (browser), including multipart uploads....

we also tried using an access key/secret

we also tried using an access key/secret with full access to our S3 buckets, that we currently use in our workflow, but even with that working key the setup fails

Hi, i have a question about the rules

Hi, i have a question about the rules and R2, I have a rule that redirects all traffic on my domain. But i want to setup a custom domain for R2 storage and i want that the traffic on this domain is not redirecting, but showing the content. Will this custom domain thing overwrite the CloudFlare Rule?

ChatGPT - R2 Lifecycle Deletion Behavior

Funny, cause Chatgpt was the first I asked 🤣, the answer wasn't that reliable as you can see in our conversation. That's why I asked here which I almost never do. https://chatgpt.com/share/67b7f4a7-e994-800a-8728-938ba08f5dcc But thanks for trying...

Remove R2 compatibility notes on sdk cli...

It appears that the recent incompatibilities between the S3 libraries and R2 were resolved but that doesn't seem to be the case for me. I've posted a note here: https://github.com/cloudflare/cloudflare-docs/pull/19890#issuecomment-2655205092 but am wondering if anyone here knows more?

Hello everyone. I am new to Cloudflare

Hello everyone. I am new to Cloudflare and my first experience failed. I've decided to create R2 bucket in Cloudflare and store my blog's images there. I have created the storage, changed Nameservers and Connected Domain. Now my website looks like this https://schulmatheapp.de. I don't know what to do, even after reading https://developers.cloudflare.com/r2/buckets/public-buckets. Please help me, thanks in advance.
No description

Hi there, is currently any issues with

Hi there, is currently any issues with cloudflare r2 in EU Germany? suddenly we get 403 Forbidden on all links. we didn't change something on Cloudflare or DNS Records. CORS are disabled. Here is a link -> https://assets.gforgadget.gr/wp-content/uploads/2020/08/GforGadget_Logo-1.webp the website page is:https://gforgadget.gr/. with the R2.dev subdomain is working Any help appreciated!...

Hello, I want to upload pg data backup

Hello, I want to upload pg data backup to r2 at k8s, and I wrote manifest, but r2 status return InternalError. This is manifest: ```yaml ...

S3 to R2 Migration

Hello @Tanmay Kapoor I am trying to migrate AWS CloudFront S3 Bucket data to CloudFlare R2 Bucket. While migrating process I am using AWS bucket name, Access Key and Secret Key...

hey guys i’m really struggling with

hey guys i’m really struggling with setting up r2 for my nextjs project and the documentation isn’t helping pls guide me
Next