NL
NL
MModular
Created by Jack Clayton on 6/7/2024 in #community-showcase
MAX ⚡ with quantization and macOS support thread
Max installation on Mac M2 and running llama3 in (q6_k and q4_k) was a breeze! Thank you Modular team! (p.s: can't wait for Max inference to extend to all cores on Apple Silicon and not just perf cores. 🏎️)
6 replies