vh/esh-pfi-infrastructure
1
0
Fork 0
Code Issues 7 Pull Requests Actions Packages Projects Releases Wiki Activity

litellm(granite): temperature 0 -> 0.1 (near-greedy floor)

Browse Source 
Operator call: avoid pure-greedy rigidity/loop-risk on granite summ/classify
while staying near-deterministic; matches the house nonzero-temp-floor lean.
image-judge held at temp 0 (scoring reproducibility) pending operator review.
This commit is contained in:
vh
2026-06-27 09:31:15 -07:00
parent 95d0b38d0a
commit 9a772ec1ae
1 changed files with 3 additions and 3 deletions
Download Patch File Download Diff File Expand all files Collapse all files
stacks/litellm/conf/config.yaml
+3 -3
View File
@@ -27,7 +27,7 @@ model_list:
model: hosted_vllm/granite-4.1-8b
api_base: http://10.250.50.54:8004/v1
api_key: os.environ/VLLM_API_KEY
temperature: 0
temperature: 0.1
model_info:
mode: chat
@@ -39,7 +39,7 @@ model_list:
model: hosted_vllm/granite-4.1-8b
api_base: http://10.250.50.54:8004/v1
api_key: os.environ/VLLM_API_KEY
temperature: 0
temperature: 0.1
model_info:
mode: chat
@@ -50,7 +50,7 @@ model_list:
model: hosted_vllm/granite-4.1-8b
api_base: http://10.250.50.54:8004/v1
api_key: os.environ/VLLM_API_KEY
temperature: 0
temperature: 0.1
model_info:
mode: chat