captainskippah
captainskippah
Explore posts from servers
RRunPod
Created by captainskippah on 1/18/2025 in #⚡|serverless
llvmpipe is being used instead of GPU
my setup.sh contains the following:
#!/bin/bash
set -e

apt-get update
apt-get install -y libvulkan1 nvidia-driver-560
apt-get autoremove -y && apt-get clean -y && rm -rf /var/lib/apt/lists/*
#!/bin/bash
set -e

apt-get update
apt-get install -y libvulkan1 nvidia-driver-560
apt-get autoremove -y && apt-get clean -y && rm -rf /var/lib/apt/lists/*
and it still uses llvmpipe according to logs and local testing
[info][0 llvmpipe (LLVM 15.0.7, 256 bits)] subgroup=8 basic=1 vote=1 ballot=1 shuffle=1\n
[info][0 llvmpipe (LLVM 15.0.7, 256 bits)] fp16-p/s/a=1/1/1 int8-p/s/a=1/1/1\n
[info][0 llvmpipe (LLVM 15.0.7, 256 bits)] bugsbn1=0 bugbilz=0 bugcopc=0 bugihfa=0\n
[info][0 llvmpipe (LLVM 15.0.7, 256 bits)] queueC=0[1] queueG=0[1] queueT=0[1]\n
[info]_client.py :1025 2025-02-01 15:07:58,073 HTTP Request: GET
[info][0 llvmpipe (LLVM 15.0.7, 256 bits)] subgroup=8 basic=1 vote=1 ballot=1 shuffle=1\n
[info][0 llvmpipe (LLVM 15.0.7, 256 bits)] fp16-p/s/a=1/1/1 int8-p/s/a=1/1/1\n
[info][0 llvmpipe (LLVM 15.0.7, 256 bits)] bugsbn1=0 bugbilz=0 bugcopc=0 bugihfa=0\n
[info][0 llvmpipe (LLVM 15.0.7, 256 bits)] queueC=0[1] queueG=0[1] queueT=0[1]\n
[info]_client.py :1025 2025-02-01 15:07:58,073 HTTP Request: GET
3 replies