Accept new task when continues to process the old one
Anyone know can i accept new task in worker continuing to process the old one (for example uploading to s3)?
I discovered that my gpu task processes by 0.04 seconds but uploading to s3 spends more than 1 second
And it's very unprofitable
1 Reply
You could processes the uploading outside of the handler function with something like multi-threading. However just make sure your worker sticks around long enough to complete the upload before it is removed.