RunPod Header Timing is Off
These responses from the stream endpoint are coming in every second, yet the header date is saying, at points, that each response is 10 seconds apart. When this happens, nothing is shown in the stream despite the fact that I yield something every second. Is there a way to force the timing or another way I can get around this?
1 Reply
I think if those times aren't that reliable, then you can maybe wrap your response around json, then everytime you return a stream, also send your timestamp inside