Sia
Explore posts from serversMModular
•Created by Sia on 8/23/2024 in #questions
Energy usage benchmarks?
Ah, you meant the models performance - gotcha, and agreed.
32 replies
MModular
•Created by Sia on 8/23/2024 in #questions
Energy usage benchmarks?
Doesn't that indicate less efficiency if Llama 3-8b is competitive with 70b Llama 2? Or am I misunderstanding?
32 replies
MModular
•Created by Sia on 8/23/2024 in #questions
Energy usage benchmarks?
I mean advocating for mojo based on energy consumption.
It might look stupid now but from where I stand, analysing the energy required to keep all AI-workloads a float, 1-2 years from now it might actually be the better argument...
32 replies
MModular
•Created by Sia on 8/23/2024 in #questions
Energy usage benchmarks?
That is exactly what I intend to do... 😉
32 replies
MModular
•Created by Sia on 8/23/2024 in #questions
Energy usage benchmarks?
@Owen Hilyard Can I make a wish? That next benchmark article also, if possible, looks into the energy savings?
Actually, if you'd be interested, I could collaborate to profile that...
32 replies
MModular
•Created by Sia on 8/23/2024 in #questions
Energy usage benchmarks?
@Owen Hilyard How does one get involved? 😛
32 replies
MModular
•Created by Sia on 8/23/2024 in #questions
Energy usage benchmarks?
a) The energy used in the end should be an absolute number, or am I wrong?
b) Not thinking servers or network io here - just pure algorithmic, based on utilising more efficient instruction sets.
---
Let's step back. I expect a piece of Python, ported to Mojo, to run more efficiently, thereby not just faster but also lower energy consumption.
Essentially, I expect Mojo to do to normal Python code, what simdjson does to json-parsing: https://github.com/simdjson/simdjson
So, my question is, are there any benchmarks out there? I do understand it will vary depending on the task at hand, and factors such as where the bottle-necks will be (network io, etc).
But still, reading some benchmarks would help me form an understanding.
32 replies
MModular
•Created by Sia on 8/23/2024 in #questions
Energy usage benchmarks?
For example doing a very large matrix multiplication..
32 replies
MModular
•Created by Sia on 8/23/2024 in #questions
Energy usage benchmarks?
@Owen Hilyard Sorry, let me clarify with an example.
Let's say you got a piece of Python code, and port it to Mojo, is there an understanding of the energy savings?
32 replies
CDCloudflare Developers
•Created by Sia on 3/13/2024 in #workers-help
Why isn't Cloudflare Pages / Hosting throwing 404s?
Workes like a charm, solved 🙂
7 replies
CDCloudflare Developers
•Created by Sia on 3/13/2024 in #workers-help
Why isn't Cloudflare Pages / Hosting throwing 404s?
Thank you!
7 replies
CDCloudflare Developers
•Created by Sia on 3/13/2024 in #workers-help
Why isn't Cloudflare Pages / Hosting throwing 404s?
Thank you! So, all I need is a top level 404.html?
7 replies
CDCloudflare Developers
•Created by Sia on 3/12/2024 in #workers-help
URGNET: Github -> Cloudflare link broken? Commits to main do not lead to new deployments...
3 replies
CDCloudflare Developers
•Created by Sia on 3/12/2024 in #workers-help
URGNET: Github -> Cloudflare link broken? Commits to main do not lead to new deployments...
I solved this with a deploy hook. Also, Cloudflare detected instantly when I removed access to the repo, so the issue is likely on Github's side.
3 replies
CDCloudflare Developers
•Created by Sia on 3/2/2024 in #workers-help
Python Worker with Pages - do I need separate repos?
This is now solved - I first set it up with AWS Lambdas and then I was approached on Twitter by a few nice people from Cloudflare who showed me what is about to be released from CF 🙂 https://twitter.com/siiiaaaaaaa/status/1763904558105809375
2 replies