news-digest/README: granite-4-small is the current default (was qwen3.5-35-a3b)
The original default model in .env.example was changed to granite-4-small months ago when qwen3.5-35-a3b's GGUF file started exiting on launch, but the README still named the old one as "current". Also bumped the summarization-style description from "one sentence" to "2-3 sentences" to match the post-trafilatura prompt rewrite. Found via /tend-docs.
This commit is contained in:
@@ -16,10 +16,12 @@ noisy. This stack:
|
||||
to drop flame-bait and low-effort posts.
|
||||
3. Pulls non-Reddit recent items from Miniflux's Tech aggregators
|
||||
category (HN, Lobste.rs).
|
||||
4. Sends each source through `qwen3.5-35-a3b` on llama-swap (one
|
||||
batched call per source — efficient) for a one-sentence tl;dr +
|
||||
4. Sends each source through `granite-4-small` on llama-swap (one
|
||||
batched call per source — efficient) for a 2-3 sentence summary +
|
||||
single-word tag (news / tutorial / release / discussion / question
|
||||
/ showcase / drama / meme / other).
|
||||
/ showcase / drama / meme / other). World + Local headlines also
|
||||
get summarized in one batch call per category. (Original default
|
||||
was `qwen3.5-35-a3b` but its model file is broken on launch.)
|
||||
5. Renders an HTML page styled with Australis tokens + Fraunces
|
||||
serif headlines.
|
||||
6. The page is served by a tiny FastAPI app on uvicorn that also
|
||||
@@ -124,7 +126,10 @@ ssh ana-docker '
|
||||
The model must be loaded in llama-swap's `config.yaml`. Check
|
||||
`http://10.250.50.54:9292/v1/models` for what's available. Models
|
||||
with tool/JSON-mode support give better summarization quality;
|
||||
`qwen3.5-35-a3b` is the current default.
|
||||
`granite-4-small` is the current default (small ~4B, fast ~1s/call,
|
||||
no extended-thinking phase eating the token budget). Avoid
|
||||
`qwen3.5-35-a3b` (model file broken — process exits on launch) and
|
||||
`qwen3.6-35-a3b` (defaults to thinking mode, eats budget without output).
|
||||
|
||||
## Forcing a fresh digest now
|
||||
|
||||
|
||||
Reference in New Issue
Block a user