Janus

Go binary that runs GGUF models via Vulkan on AMD/Intel/Nvidia

Janus was launched on Hacker News as "Show HN: Janus – Go binary that runs GGUF models via Vulkan on AMD/Intel/Nvidia". It received 106 points and active community acclaim.