R
RunPod4mo ago
minu

Captured handler exception

while using runpod sdxl api i usually get this in between running code, when i call the output, and it gets fixed after some time , p.s there is no chnage in code (because sometimes for the same payload it works sometimes it shows this) { "error": "'NoneType' object has no attribute 'split'" } In the logs i see this "Captured Handler Exception"
No description
50 Replies
ashleyk
ashleyk4mo ago
@CodeBroker is also reporting issues with this API, seems its broken. @Merrell @flash-singh
Okan Demirel
Okan Demirel4mo ago
Interesting part is, when I try to test on your website with the same parameters, it does work. But when it comes to a POST it does not
ashleyk
ashleyk4mo ago
Are you using the RunPod one or did you use quick deploy?
Okan Demirel
Okan Demirel4mo ago
I used quick deploy
Okan Demirel
Okan Demirel4mo ago
But as API reference I use this page https://doc.runpod.io/reference/stable-diffusion-xl
RunPod
Stable Diffusion XL
A text-to-image model from StabilityAI
ashleyk
ashleyk4mo ago
Do you see any errors in your logs?
Okan Demirel
Okan Demirel4mo ago
No only "COMPLETED"
ashleyk
ashleyk4mo ago
I assume @minu is also using quick deploy otherwise they would have no access to the logs. There should be something in the logs
Okan Demirel
Okan Demirel4mo ago
I will make a new request give me couple seconds
ashleyk
ashleyk4mo ago
You can filter by error log level like this
No description
Okan Demirel
Okan Demirel4mo ago
okay yes I have one
Okan Demirel
Okan Demirel4mo ago
No description
ashleyk
ashleyk4mo ago
Any others?
Okan Demirel
Okan Demirel4mo ago
Only this
Okan Demirel
Okan Demirel4mo ago
others are info logs
No description
ashleyk
ashleyk4mo ago
GitHub
worker-sdxl/src/rp_handler.py at main · runpod-workers/worker-sdxl
RunPod worker for Stable Diffusion XL. Contribute to runpod-workers/worker-sdxl development by creating an account on GitHub.
ashleyk
ashleyk4mo ago
Its sending a list instead of a string which is not supported. Should only affect validation of input though.
minu
minu4mo ago
yes am using quick deploy
Okan Demirel
Okan Demirel4mo ago
In the end shouldn't I supposed to send a Json file? I will send the same request on your page with the same format
ashleyk
ashleyk4mo ago
Not my page, I don't work for RunPod, I am just a community member 😁
Okan Demirel
Okan Demirel4mo ago
Alright now I get the same error, but in order to understand the request type could you give an example for me. This was my request; { "input": { "init_image": null, "mask": null, "prompt": "Positive Prompt: Magician, clash of clans style", "negative_prompt": "", "height": 512, "width": 512, "num_inference_steps": 50, "guidance_scale": 7.5, "num_outputs": 1, "seed": 963652645 } } Oh really Sorry man
ashleyk
ashleyk4mo ago
That height and width are not suitable for SDXL, SDXL should be 1024x1024. SD 1.5 is 512x512.
minu
minu4mo ago
2024-03-19T05:33:15Z error starting: Error response from daemon: No such container: 77tt3raewfey9h-1
ashleyk
ashleyk4mo ago
This looks like a different kind of issue
minu
minu4mo ago
thios was i guess also the error on the worker, at that time i cant understand properly, when i got the error i noted the time, and i am showing errors i got for that time
Okan Demirel
Okan Demirel4mo ago
it does support 512 too Alright found the problem { "input": { "prompt": "Positive Prompt: Magician, clash of clans style", "negative_prompt": "", "height": 1024, "width": 1024, "num_inference_steps": 50, "guidance_scale": 7.5, "num_images": 1, "seed": 963652645 } } This needs to be the parameter. It has couple differences But to keep the issue up, output is reaallyy bad, it is not possible to get the images it does need an update and if possible input parameters should be same as the previous ones
ashleyk
ashleyk4mo ago
What do you mean the input parameters should be the same as the previous ones? I think you need to specify s3Config for an S3 compatible bucket for it to store your images.
Okan Demirel
Okan Demirel4mo ago
compared to Stable Diffusion 1.5 and 2 parameters and their naming changed, which couses conditional access for every model What do you mean by this?
Okan Demirel
Okan Demirel4mo ago
I was trying to say this part, the output is really bad, you can not get any information from here
No description
ashleyk
ashleyk4mo ago
You need to base64 decode those images.
Okan Demirel
Okan Demirel4mo ago
I have one that is not the problem problem here is, taking the right json array in order to download these images
ashleyk
ashleyk4mo ago
I would just use image_url
Okan Demirel
Okan Demirel4mo ago
for example why do we have "image_url" It is not array, "images" is but they conflict each order I suppose
ashleyk
ashleyk4mo ago
But makes no difference, since you are only generating 1 image
Okan Demirel
Okan Demirel4mo ago
I am making multiple 2 for sdxl
ashleyk
ashleyk4mo ago
Oh I see, yeah then image_url is just cluttering the output, you're right.
Okan Demirel
Okan Demirel4mo ago
yep
rafael21@
rafael21@3mo ago
Bro, do you know if I can attach more than one AWS bucket to the same runpod template? Because I will need to use the same runpod template for more than one app... and each app has its own S3 bucket...
nerdylive
nerdylive3mo ago
Mmmm, I dont think you can use it like this way from the rp's handler :https://docs.runpod.io/serverless/workers/development/environment-variables#python-code-for-s3-uploads
Use environment variables | RunPod Documentation
Incorporating environment variables into your Handler Functions is a key aspect of managing external resources like S3 buckets.
nerdylive
nerdylive3mo ago
but i think you can make your own custom code and use S3 on your code using libraries to upload them to your preconfigured buckets ( custom code )
digigoblin
digigoblin3mo ago
Yeah, I also told him the same thing
nerdylive
nerdylive3mo ago
hahaha okok i think thats the only simple way then
digigoblin
digigoblin3mo ago
Maybe simple, maybe not depending on your coding proficiency, but there is always ChatGPT etc to help out 🤣 But its basically the only way, simple or not.
nerdylive
nerdylive3mo ago
ah yes that made my life waay simpler
digigoblin
digigoblin3mo ago
Yeah me too, I can do it myself, but why waste hours, when AI can help get it done in minutes
nerdylive
nerdylive3mo ago
yea i actually got another idea: adding that custom code and integrating it into custom runpod's library
digigoblin
digigoblin3mo ago
By the way @rafael21@ I don't recommend using S3. AWS egress costs are ridiculously expensive. Rather use something like Cloudflare R2 which is S3 compatible but has zero egress costs.
nerdylive
nerdylive3mo ago
Lets move this chat to #AWS S3 about that i just noticed 😄
digigoblin
digigoblin3mo ago
yeah not sure why @rafael21@ brought it here, this is a different topic