looking for spec recommendations for provisioning MAX on RHEL8 using an 8GB VRAM A100 #MAX
This project will run whisper and LLAMA 3.1
FLASK and MySQL
Speed is #1 objective. Transcribing wave audio and summarizing with LLM.
CPU and MEM plenty available, but haven’t seen much need for it in the past when running a GPU.
#max
#max
0 Replies