[Serve.llm] feat: add missing `repetition_penalty` vLLM sampling param#53222

Merged

kouroshHakha merged 2 commits intoray-project:masterfrom

ArthurBook:arthurbook/add-repetition-penalty-param

May 23, 2025

Commits on May 21, 2025

[Serve, LLM] feat: add missing `repetition_penalty` vLLM sampling param
ArthurBook
committed
[Serve, LLM] tests: updated tests with new `repetition_penalty` param
ArthurBook
committed