news-digest/README: granite-4-small is the current default (was qwen3.5-35-a3b)

The original default model in .env.example was changed to
granite-4-small months ago when qwen3.5-35-a3b's GGUF file started
exiting on launch, but the README still named the old one as
"current". Also bumped the summarization-style description from
"one sentence" to "2-3 sentences" to match the post-trafilatura
prompt rewrite. Found via /tend-docs.
This commit is contained in:
vh
2026-04-29 17:02:37 -07:00
parent 1ff276d67d
commit 4ee2f9c2ee
+9 -4
View File
@@ -16,10 +16,12 @@ noisy. This stack:
to drop flame-bait and low-effort posts.
3. Pulls non-Reddit recent items from Miniflux's Tech aggregators
category (HN, Lobste.rs).
4. Sends each source through `qwen3.5-35-a3b` on llama-swap (one
batched call per source — efficient) for a one-sentence tl;dr +
4. Sends each source through `granite-4-small` on llama-swap (one
batched call per source — efficient) for a 2-3 sentence summary +
single-word tag (news / tutorial / release / discussion / question
/ showcase / drama / meme / other).
/ showcase / drama / meme / other). World + Local headlines also
get summarized in one batch call per category. (Original default
was `qwen3.5-35-a3b` but its model file is broken on launch.)
5. Renders an HTML page styled with Australis tokens + Fraunces
serif headlines.
6. The page is served by a tiny FastAPI app on uvicorn that also
@@ -124,7 +126,10 @@ ssh ana-docker '
The model must be loaded in llama-swap's `config.yaml`. Check
`http://10.250.50.54:9292/v1/models` for what's available. Models
with tool/JSON-mode support give better summarization quality;
`qwen3.5-35-a3b` is the current default.
`granite-4-small` is the current default (small ~4B, fast ~1s/call,
no extended-thinking phase eating the token budget). Avoid
`qwen3.5-35-a3b` (model file broken — process exits on launch) and
`qwen3.6-35-a3b` (defaults to thinking mode, eats budget without output).
## Forcing a fresh digest now