lawtj
RRunPod
•Created by lawtj on 9/16/2024 in #⚡｜serverless
Error requiring "flash_attn"
thanks for the tip - is this the requirements.txt file in the root directory of the
runpod/worker-v1-vllm:v1.3.1stable-cuda12.1.0 image? I don't see a commented out line there.
i can add flash_attn to the file but wondering if i'm using the wrong image.5 replies