Started getting errors connecting to google cloud storage
Hello, approximately on jan 31, 0:00 AM we started getting error while uploading files to google cloud storage from serverless workers.
For background; we have been using the same endpoint for months and have ~5k daily request with very low fail rate and did not do any changes recently. Not all workers seems affected and repro rate is not 100% for the affected ones
Error; We're sorry, but this service is not available in your location
Example request id: aeb40bea-99b9-427d-95af-757d3d481d40-u1
Worker id; azlu9ylswr53kh
Is this google cloud related or has anything changed on runpods end recently?
5 Replies
all affected workers seem to be in IE location, tried to disable that location i'll see if problem gets fixed
Yes
for anyone having the same problem: disabling eur-is-1 fixed the problem
As an update:
The issue was an IP blacklisted by Google Cloud.
The affected machines were moved to another outgoing IP, so feel free to re-enable.
We fixed today. Let me know if you still experience issue