worker-vllm not working with beam search
Hi, I found another bug in your worker-vllm. Beam search is not supported even though your README says it is. This time around it's
length_penalty not being accepted. Can you please work on a fix for beam search? Thanks!2 Replies
GitHub
MAJOR BUG: Beam search does not work according to README · Issue #1...
use_beam_search or length_penalty or best_of just triggers an error. Please fix this! {"requestId": "...", "message": "Unexpected keyword argument 'use_beam_s...
@wiki Please have a look!