Sia
Explore posts from serversMModular
•Created by Sia on 8/23/2024 in #questions
Energy usage benchmarks?
Ah, you meant the models performance - gotcha, and agreed.
32 replies
MModular
•Created by Sia on 8/23/2024 in #questions
Energy usage benchmarks?
Doesn't that indicate less efficiency if Llama 3-8b is competitive with 70b Llama 2? Or am I misunderstanding?
32 replies
MModular
•Created by Sia on 8/23/2024 in #questions
Energy usage benchmarks?
I mean advocating for mojo based on energy consumption.
It might look stupid now but from where I stand, analysing the energy required to keep all AI-workloads a float, 1-2 years from now it might actually be the better argument...
32 replies
MModular
•Created by Sia on 8/23/2024 in #questions
Energy usage benchmarks?
That is exactly what I intend to do... 😉
32 replies
MModular
•Created by Sia on 8/23/2024 in #questions
Energy usage benchmarks?
@Owen Hilyard Can I make a wish? That next benchmark article also, if possible, looks into the energy savings?
Actually, if you'd be interested, I could collaborate to profile that...
32 replies
MModular
•Created by Sia on 8/23/2024 in #questions
Energy usage benchmarks?
@Owen Hilyard How does one get involved? 😛
32 replies
MModular
•Created by Sia on 8/23/2024 in #questions
Energy usage benchmarks?
a) The energy used in the end should be an absolute number, or am I wrong?
b) Not thinking servers or network io here - just pure algorithmic, based on utilising more efficient instruction sets.
---
Let's step back. I expect a piece of Python, ported to Mojo, to run more efficiently, thereby not just faster but also lower energy consumption.
Essentially, I expect Mojo to do to normal Python code, what simdjson does to json-parsing: https://github.com/simdjson/simdjson
So, my question is, are there any benchmarks out there? I do understand it will vary depending on the task at hand, and factors such as where the bottle-necks will be (network io, etc).
But still, reading some benchmarks would help me form an understanding.
32 replies
MModular
•Created by Sia on 8/23/2024 in #questions
Energy usage benchmarks?
For example doing a very large matrix multiplication..
32 replies
MModular
•Created by Sia on 8/23/2024 in #questions
Energy usage benchmarks?
@Owen Hilyard Sorry, let me clarify with an example.
Let's say you got a piece of Python code, and port it to Mojo, is there an understanding of the energy savings?
32 replies