NL
MModular
•Created by Jack Clayton on 6/7/2024 in #community-showcase
MAX ⚡ with quantization and macOS support thread
Max installation on Mac M2 and running llama3 in (
q6_k and q4_k) was a breeze! Thank you Modular team!
(p.s: can't wait for Max inference to extend to all cores on Apple Silicon and not just perf cores. 🏎️)6 replies