Ian Taylor
CDCloudflare Developers
•Created by Ian Taylor on 9/29/2023 in #cloudflare-ai
Llama Token Counter - a Hugging Face Spa...
I haven't really been able to wrap my head fully around it yet 😀 I think a lot depends on how many llm tokens = 1 neuron and how much someone really needs the "Fast Twitch Neurons" vs the regular ones, because the fast ones are 12x the price, (assuming that you're able to control if you use fast twitch or not???)
12 replies
CDCloudflare Developers
•Created by Ian Taylor on 9/29/2023 in #cloudflare-ai
Llama Token Counter - a Hugging Face Spa...
Thanks for your help!
12 replies
CDCloudflare Developers
•Created by Ian Taylor on 9/29/2023 in #cloudflare-ai
Llama Token Counter - a Hugging Face Spa...
Yeah, I read the top part of the limits doc before I started playing around with this, but I didn't get down to the bottom of it. My bad.
12 replies
CDCloudflare Developers
•Created by Ian Taylor on 9/29/2023 in #cloudflare-ai
Llama Token Counter - a Hugging Face Spa...
I see... 256 output tokens is not going to be enough for many use-cases.
12 replies
CDCloudflare Developers
•Created by Ian Taylor on 9/29/2023 in #cloudflare-ai
Llama Token Counter - a Hugging Face Spa...
Realized this should probably have been posted in workers-ai-beta, sorry
12 replies