vh 52d5f66216 litellm(gen/qwen3.5-122-a10b): presence_penalty=1.0 anti-repetition default ...

The abliterated/NVFP4 Qwopus 122B "gen" model (+ qwen-large / summarizer-large
aliases) had no repetition control in its sampling defaults, causing degenerate
repetition loops. Add presence_penalty: 1.0 (Qwen-documented anti-repetition
lever, range 0-2) to all 7 qwen3.5-122-a10b gateway records. Overrideable
default; bake into the vLLM serving def once the value is validated.

2026-06-27 08:09:53 -07:00

..

config.yaml

litellm(gen/qwen3.5-122-a10b): presence_penalty=1.0 anti-repetition default

2026-06-27 08:09:53 -07:00

strip_empty_tools.py

fix(litellm): strip empty tools:[] before forwarding to vLLM

2026-06-16 00:43:57 -07:00