VuongKB/AI Information.md

created, id, keywords, links, modified, summary, tags, title

created	id	keywords	links	modified	summary	tags	title
2026-04-05T05:39:16+00:00	c3851d78-9aa2-4a1f-b72b-4bd6c1221111	llama.cpp ai information good vllm cpu gpu inferencing tensor parallelism ollama sits top shares advantages		2026-04-05T05:39:16+00:00	Here's a concise summary: llama.cpp offers efficient CPU/GPU inference, vllm excels at tensor parallelism, and ollama builds on llama.cpp, inheriting its advantages and limitations.		AI Information

llama.cpp is good for cpu/gpu inferencing vllm is good for tensor parallelism ollama sits on top of llama.cpp and shares most of its advantages and shortcomings

#ai #llama #vllm