AI & Machine Learning

Snips#1

AI & Machine Learning/Local LLM Runners

93.1Score

Snips is a AI Voice Assistant platform 100% on-device and private

Ollama#2

AI & Machine Learning/Local LLM Runners

92Score

Get up and running with large language models locally

Ollama#3

AI & Machine Learning/Local LLM Runners

84.9Score

Run LLMs on your Mac

llama_embeddings_fastapi_service#4

AI & Machine Learning/Local LLM Runners

83.6Score

Llama2 Embeddings FastAPI Server

LLaVaVision#5

AI & Machine Learning/Local LLM Runners

83.3Score

An AI "Be My Eyes"-like web app with a llama.cpp backend

Rlama#6

AI & Machine Learning/Local LLM Runners

79Score

Open-Source DocumentAI with Ollama

OWhisper#7

AI & Machine Learning/Local LLM Runners

78.9Score

Ollama for realtime speech-to-text

Cactus#8

AI & Machine Learning/Local LLM Runners

78.4Score

Ollama for Smartphones

2mb#9

AI & Machine Learning/Local LLM Runners

78.1Score

Some blind hackers are bridging IRC to LMMs running locally

felafax#10

AI & Machine Learning/Local LLM Runners

77.9Score

Tune LLaMa3.1 on Google Cloud TPUs

june#11

AI & Machine Learning/Local LLM Runners

77.6Score

Local voice assistant using Ollama, transformers and Coqui TTS toolkit

NotesOllama#12

AI & Machine Learning/Local LLM Runners

77.4Score

I added local LLM support to Apple Notes (through Ollama)

Lumos#13

AI & Machine Learning/Local LLM Runners

77.3Score

local LLM Chrome extension

llama2_aided_tesseract#14

AI & Machine Learning/Local LLM Runners

77.3Score

Using LLama2 to Correct OCR Errors

paddler#15

AI & Machine Learning/Local LLM Runners

77.2Score

Open-source load balancer for llama.cpp

LocalScore#16

AI & Machine Learning/Local LLM Runners

76.9Score

Local LLM Benchmark

Simedw#17

AI & Machine Learning/Local LLM Runners

73.4Score

I trained a 125M model to autocomplete piano on-device

Llmspeed#18

AI & Machine Learning/Local LLM Runners

71.8Score

feel how fast a local LLM runs before you buy the hardware

whichllm#19

AI & Machine Learning/Local LLM Runners

71.4Score

Find the best local LLM for your hardware, ranked by benchmarks

Timber#20

AI & Machine Learning/Local LLM Runners

70.6Score

Ollama for classical ML models, 336x faster than Python

Tiny-vLLM#21

AI & Machine Learning/Local LLM Runners

70.6Score

high performance LLM inference engine in C++ and CUDA

Janus#22

AI & Machine Learning/Local LLM Runners

68.9Score

Go binary that runs GGUF models via Vulkan on AMD/Intel/Nvidia

Yap#23

AI & Machine Learning/Local LLM Runners

68.8Score

OSS on-device voice dictation for macOS with no model to download

Shoehorn#24

AI & Machine Learning/Local LLM Runners

68.7Score

Quantize any model down to run on your machine

Vocal Slice#25

AI & Machine Learning/Local LLM Runners

67.1Score

Cut audio by selecting text, fully on-device

GPUWorks#26

AI & Machine Learning/Local LLM Runners

52.1Score

A 40 MB GPU cluster manager for vLLM/SGLang, no K8s needed