How to increase output tokens length for workers AI ?

I'm trying to increase output tokens length of cloudflare AI llama2 7b model. The documentation is not very helpful.

1 Reply

cccrypto_9OP•6mo ago

Got it.. you have to add max_tokens = <limit> param

Welcome to the official Cloudflare Developers server. Here you can ask for help and stay updated with the latest news

59KMembers

Want results from more Discord servers?