Error whilst using Official A1111 Runpod Worker - CUDA error: an illegal instruction was encountered
https://github.com/runpod-workers/worker-a1111
I am using the official A1111 Runpod Worker. It's not actively maintained and I ran into 2 issues whilst building the Docker image but those were easily resolved.
After successfully building the docker image and loading it onto an API endpoint, I'm getting an error which I'm struggling to solve.
It's a RunTime error and here's the full error message:
CUDA error: an illegal instruction was encountered\nCUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.\nFor debugging consider passing CUDA_LAUNCH_BLOCKING=1.\nCompile with TORCH_USE_CUDA_DSA to enable device-side assertions.\n
I don't really know how to start debugging this issue. Any pointers?GitHub
GitHub - runpod-workers/worker-a1111: Automatic1111 serverless worker.
Automatic1111 serverless worker. . Contribute to runpod-workers/worker-a1111 development by creating an account on GitHub.
3 Replies
Bro, are you using stable diffusion? can you please tell about response time to generate images ? 🙂
@rafael21@ Sure. It depends on what kind of images you're looking to generate. But basic images, just a single one, takes only about 2 seconds (not counting cold start times) with serverless GPU endpoints
I will chat in private bro 🙂