Dhruv Mullick
TensorRT-LLM setup
Thanks a lot!! I think the apt-get command along with the exports you shared together worked out for me
I'm on the runpod/pytorch:2.2.0-py3.10-cuda12.1.1-devel-ubuntu22.04 template. Will have to see if it works with others too
53 replies
TensorRT-LLM setup
But if I don't, then I get a different set of errors like:
/usr/bin/ld: cannot find -lvt.mpi: No such file or directory
/usr/bin/ld: cannot find -lvt-hyb: No such file or directory
/usr/bin/ld: cannot find -lvt.ompi: No such file or directory
_configtest.c:2:10: fatal error: mpi.h: No such file or directory
53 replies
TensorRT-LLM setup
@Papa Madiator , are we doing anything MPI related while spawning the container on RunPod?
https://github.com/mpi4py/mpi4py/issues/483
Per this, on a clean container from the image I shared, the mpi issue isn't there
53 replies
TensorRT-LLM setup
Same error:
root@afabf97a0d57:/workspace# mpicc --version
Cannot open configuration file /build-result/hpcx-v2.16-gcc-inbox-ubuntu22.04-cuda12-gdrcopy2-nccl2.18-x86_64/ompi/share/openmpi/mpicc-wrapper-data.txt
Error parsing data file mpicc: Not found
53 replies