Open Source LLMs - Directory w/ AI Reviews

Open-source LLMs have democratized access to capable language models that can run on private infrastructure without API fees or data sharing. Llama 3 and Gemma 2 from Meta and Google have set new benchmarks for open-weight capability. Ollama makes running these models locally as simple as a single command, while Together AI and Groq provide cloud inference for teams that need open models at scale. Hugging Face hosts the open-source model ecosystem, and vLLM provides the high-throughput serving engine that powers many deployments.

Hugging Face 1 4.9 Hugging Face Freemium Free Plan API Open Source Enterprise 3 reviews Hugging Face is the primary distribution platform for open-source large language models, hosting models from Meta (LLaMA), Mistral, Google, Microsoft, and thousands of community contributors. Its Transformers library provides a unified interface for loading, running, and fine-tuning open-source LLMs Ollama 2 4.8 Ollama Free Free Plan Open Source 2 reviews Ollama is the most popular tool for running open-source LLMs locally, providing easy access to models like LLaMA, Mistral, Gemma, DeepSeek, and dozens of others. It handles model downloading, quantization, and hardware optimization, making open-source language models accessible to anyone with a pers Together AI 3 4.8 Together AI Paid API Enterprise 2 reviews Together AI specializes in hosting and serving open-source language models, providing fast and affordable API access to models from Meta, Mistral, DeepSeek, and other open-source providers. Its platform makes it easy to run, compare, and integrate open-source LLMs without managing GPU infrastructure vLLM 4 4.8 vLLM Free Free Plan API Open Source 1 review vLLM is a high-throughput, memory-efficient inference engine for serving large language models. Developed at UC Berkeley, it uses PagedAttention to dramatically reduce memory waste and increase serving speed, making it one of the fastest open-source LLM serving frameworks available. vLLM supports a Text Generation Web UI 5 4.7 Text Generation Web UI Free Free Plan API Open Source 1 review Text Generation Web UI (commonly called oobabooga) is a popular open-source Gradio-based interface for running large language models locally. It supports a wide range of model loaders including GPTQ, GGUF, AWQ, and ExLlamaV2, and provides features like chat mode, notebook mode, extensions, and LoRA LocalAI 6 4.7 LocalAI Free Free Plan API Open Source 2 reviews LocalAI is a free, open-source alternative to OpenAI's API that runs entirely on consumer hardware without requiring a GPU. It provides an OpenAI-compatible REST API for running LLMs, image generation, audio transcription, and embeddings locally. LocalAI supports dozens of model families and is desi Jan 7 4.6 Jan Free Free Plan API Open Source 2 reviews Jan is an open-source desktop application for running large language models locally on Mac, Windows, and Linux. It provides a clean ChatGPT-like interface for offline AI conversations, supports popular model formats like GGUF, and includes a built-in model hub for downloading models. Jan emphasizes Groq 8 4.5 Groq Freemium Free Plan API Enterprise 3 reviews Groq serves popular open-source language models including LLaMA, Mistral, Mixtral, and Gemma through its ultra-fast inference platform. Its LPU hardware enables these open-source models to run at dramatically faster speeds than traditional GPU infrastructure, making them more practical for real-time Replicate 9 4.5 Replicate Paid API Enterprise 2 reviews Replicate hosts and serves many popular open-source language models, enabling developers to run models like LLaMA, Mistral, and other community models through a simple API without managing GPU infrastructure. Its platform makes open-source LLMs accessible to developers who lack their own GPU resourc Meta Llama 10 4.4 Meta Llama Free Free Plan Open Source 1 review Meta Llama is Meta's family of open-source large language models that have become foundational to the open AI ecosystem. Available in multiple sizes and configurations, Llama models can be freely downloaded, fine-tuned, and deployed for commercial use. The Llama family powers thousands of applicatio Whisper 11 4.3 Whisper Free Free Plan API Open Source 2 reviews While technically a speech model rather than a language model, Whisper is one of OpenAI's most significant open-source AI releases under the MIT license. Its open availability has enabled an entire ecosystem of derivative tools and optimized implementations, making it a cornerstone of the open-sourc Mistral AI 12 4.0 Mistral AI Freemium Free Plan API Open Source Enterprise 1 review Mistral AI is a French AI company building open and commercial large language models that emphasize efficiency, performance, and European AI sovereignty. Their models range from compact open-source options to powerful proprietary offerings, with strong multilingual capabilities and competitive bench