vh/esh-pfi-infrastructure
1
0
Fork 0
Code Issues 7 Pull Requests Actions Packages Projects Releases Wiki Activity

litellm(granite): revert temperature 0.1 -> 0 (research-dictated)

Browse Source 
dvalin evidence pass: IBM canonical is temp 0; greedy-loop risk is an
open-ended-generation phenomenon, not summ/classify; temp 0.1 reduces
classification reproducibility without fixing loops (use repetition/presence
penalty if loops appear). image-judge stays 0 (Qwen judge card + W&B judge
practice = temp 0 for reproducibility; NVFP4-needs-0.1 unsupported). Both
gateway temps now 0, vendor-canonical.
This commit is contained in:
Vuong Hoang
2026-06-27 09:40:47 -07:00
parent 9a772ec1ae
commit b9dcbc199f
1 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files
stacks/litellm/conf/config.yaml
+3 -3
View File
@@ -27,7 +27,7 @@ model_list:
model: hosted_vllm/granite-4.1-8b
api_base: http://10.250.50.54:8004/v1
api_key: os.environ/VLLM_API_KEY
temperature: 0.1
temperature: 0
model_info:
mode: chat
@@ -39,7 +39,7 @@ model_list:
model: hosted_vllm/granite-4.1-8b
api_base: http://10.250.50.54:8004/v1
api_key: os.environ/VLLM_API_KEY
temperature: 0.1
temperature: 0
model_info:
mode: chat
@@ -50,7 +50,7 @@ model_list:
model: hosted_vllm/granite-4.1-8b
api_base: http://10.250.50.54:8004/v1
api_key: os.environ/VLLM_API_KEY
temperature: 0.1
temperature: 0
model_info:
mode: chat