本地大模型运行时、AI 编程助手、推理引擎与前沿 RAG 架构。
Get up and running with large language models locally
“We wanted local LLMs to feel as effortless as running a Docker container.”
Llama2 Embeddings FastAPI Server
An AI "Be My Eyes"-like web app with a llama.cpp backend
I trained a 125M model to autocomplete piano on-device
feel how fast a local LLM runs before you buy the hardware