Sai Saurab Scorelabs
MModular
•Created by Sai Saurab Scorelabs on 12/21/2024 in #questions
Are there benchmarks available for llama 3.1 8b running on max?
@ModularBot I am trying to benchmark performance of max on cpu. Are there any available benchmarks? Or is there code which I can use to run the benchmarks myself. I want to run inference on llama 3.1 8b model.
14 replies