Ahz / Grimlor Comments - Answer Overflow

Yeah, any prompt I send it above some large number of characters, and I get nothing from gemma via the service binding. All with your recommended params 0.1 etc.

28 replies

CDCloudflare Developers

•Created by Ahz / Grimlor on 11/20/2024 in #workers-ai

Just a heads up, but **@cf/google/gemma-

I just sent gemma a long prompt with more structure than that and it also responded with nothing, the same prompt on the CF playground worked, so it's something to do with the API/binding

28 replies

CDCloudflare Developers

•Created by Ahz / Grimlor on 11/20/2024 in #workers-ai

Just a heads up, but **@cf/google/gemma-

I hijacked my own prompt for "how are you today?" for multiple requests and it responded I removed the hijack, no change in parameters, and i get no response from gemma I think it's related to the prompt length, I just tried a repeat of 'how are you today' 200 times in a single prompt and nothing from gemma, but other models did respond fine

28 replies

CDCloudflare Developers

•Created by Ahz / Grimlor on 11/20/2024 in #workers-ai

Just a heads up, but **@cf/google/gemma-

maybe it just doesnt like my prompt since the update, i'll try the same prompt in your CF playground

28 replies

CDCloudflare Developers

•Created by Ahz / Grimlor on 11/20/2024 in #workers-ai

Just a heads up, but **@cf/google/gemma-

only params stream: true, temperature: .1

28 replies

CDCloudflare Developers

•Created by Ahz / Grimlor on 11/20/2024 in #workers-ai

Just a heads up, but **@cf/google/gemma-

i just tried streaming, and not even getting a response from the binding when i pick gemma

28 replies

CDCloudflare Developers

•Created by Ahz / Grimlor on 11/20/2024 in #workers-ai

Just a heads up, but **@cf/google/gemma-

trying again, only param is stream false now, let's see still blank

28 replies

CDCloudflare Developers

•Created by Ahz / Grimlor on 11/20/2024 in #workers-ai

Just a heads up, but **@cf/google/gemma-

i'm looking for highly structured uncreative responses in some cases

28 replies

CDCloudflare Developers

•Created by Ahz / Grimlor on 11/20/2024 in #workers-ai

Just a heads up, but **@cf/google/gemma-

yeah i have 5 models in use for text gen across a couple dozen prompts with the same params, but if i can get gemma working with separate params thats fine, but it doesn't seem to

28 replies

CDCloudflare Developers

•Created by Ahz / Grimlor on 11/20/2024 in #workers-ai

Just a heads up, but **@cf/google/gemma-

but i liked the responses out of gemma lore better when i tested these prompts initially

28 replies

CDCloudflare Developers

•Created by Ahz / Grimlor on 11/20/2024 in #workers-ai

Just a heads up, but **@cf/google/gemma-

other models are working fine, swapped out that one for @cf/meta/llama-3-8b-instruct on the same prompts and they work w same original params/topk etc.

28 replies

CDCloudflare Developers

•Created by Ahz / Grimlor on 11/20/2024 in #workers-ai

Just a heads up, but **@cf/google/gemma-

this model was responding fine w these params for weeks til today, tried removing those top params, 0.1 temp, still blank responses with several prompts

28 replies

CDCloudflare Developers

•Created by Ahz / Grimlor on 11/20/2024 in #workers-ai

Just a heads up, but **@cf/google/gemma-

btw, did something change recently for local dev wrangler needing approval more often? it used be maybe a few hours / a day, now it seems like its minutes and i need to re-allow wrangler to use AI

28 replies

CDCloudflare Developers

•Created by Ahz / Grimlor on 11/20/2024 in #workers-ai

Just a heads up, but **@cf/google/gemma-

temperature: 2, stream: false, top_k: 20, top_p: .1, trying again, no response i'll try that temp now

28 replies

Gaming

Programming