How to pass parameters to deepseek r1
I have deployed deepseek r1 on serveless and then I don't know how I am going to pass parameters to it and what is the structure of its parameters. For example how do I tell the model max_tokens, what to write for the messages parameter.
1 Reply
Use vllm setup in the serverless page, there's configuration page for that
Then you can preview what env variable is your config like