All Repos HereSaved (0)

Open-source repos for LLM apps

60 repos tagged LLM apps, sorted by GitHub stars. Add filters from the other category types to narrow the list.

60repos tagged LLM apps
Instead of ChatGPT PlusKit: Local LLMs, 20 compared
60 repos
Sort
Data from GitHub, checked

  1. microsoft/markitdown

    Python tool that converts Office documents, PDFs and other files into Markdown for LLMs.

    RAG and search, Engineering

    194k starsMITUpdated 28 Oct 2026

  2. ollama/ollama

    Runs open models like Llama, Qwen and Gemma locally with one command and an OpenAI-style API.

    Ollama, Engineering, IT and security, Self hosters

    186k starsMITUpdated 3 Nov 2026

  3. langgenius/dify

    Platform for building LLM apps, chatbots and agent workflows with a visual editor and knowledge base.

    AI agents, RAG and search, Chatbots, Docker, OpenAI, Operations, Engineering, SaaS, Agencies, No-code

    160k starsOtherUpdated 3 Nov 2026

  4. open-webui/open-webui

    Self-hosted chat UI for Ollama and OpenAI-compatible models with RAG, tools and user management.

    Chatbots, RAG and search, Ollama, OpenAI, Operations, IT and security, Self hosters

    158k starsOtherUpdated 3 Nov 2026

  5. langflow-ai/langflow

    Visual builder for agent and RAG flows that exports to APIs and MCP servers, with Python components.

    AI agents, RAG and search, Docker, Engineering, No-code

    156k starsMITUpdated 3 Nov 2026

  6. langchain-ai/langchain

    Framework for chaining LLM calls, tools and retrievers into applications across many model providers.

    AI agents, RAG and search, OpenAI, Anthropic, Engineering, SaaS

    149k starsMITUpdated 3 Nov 2026

  7. Shubhamsaboo/awesome-llm-apps

    Runnable collection of LLM app and agent templates for RAG, voice, MCP and multi-agent teams.

    AI agents, RAG and search, OpenAI, Anthropic, Engineering, Indie hackers

    144k starsApache-2.0Updated 23 Oct 2026

  8. ggml-org/llama.cpp

    C/C++ engine for running quantised LLMs on CPUs and GPUs, the base of many local AI apps.

    Engineering, Self hosters

    133k starsMITUpdated 2 Nov 2026

  9. vllm-project/vllm

    High-throughput inference server for hosting open LLMs on your own GPUs.

    Hosting and deploy, Kubernetes, Engineering

    96.2k starsApache-2.0Updated 3 Nov 2026

  10. ChatGPTNextWeb/NextChat

    Web and desktop chat front end for many model providers that you can deploy yourself with your own API keys.

    Chatbots, OpenAI, Anthropic, Operations

    88.9k starsMITUpdated 20 Oct 2026

  11. lobehub/lobehub

    Chat workspace for multiple AI providers with agents, plugins, knowledge base and team sharing.

    Chatbots, AI agents, OpenAI, Anthropic, Operations, Self hosters

    83.7k starsOtherUpdated 3 Nov 2026

  12. unslothai/unsloth

    Fine-tune and run open models with lower memory use, through a local web UI or Python notebooks.

    Engineering, Data and analytics, Self hosters

    79k starsApache-2.0Updated 4 Nov 2026

  13. nomic-ai/gpt4all

    Desktop chat app for running open models on an ordinary laptop, with chat over your local documents.

    RAG and search, Operations, Engineering, Self hosters

    77.3k starsMITUpdated 28 May 2025

  14. hiyouga/LlamaFactory

    Fine-tuning toolkit with a web UI and CLI for training over a hundred open text and vision models on your own data.

    Engineering, Data and analytics, Self hosters

    75.8k starsApache-2.0Updated 31 Oct 2026

  15. docling-project/docling

    Converts PDFs, Office files and images into clean Markdown or JSON ready for RAG and AI pipelines.

    RAG and search, Engineering, Data and analytics

    70k starsMITUpdated 3 Nov 2026

  16. mem0ai/mem0

    Memory layer that lets AI assistants and agents remember users and facts across sessions.

    AI agents, Engineering, SaaS

    68.3k starsApache-2.0Updated 31 Oct 2026

  17. Mintplex-Labs/anything-llm

    Desktop and Docker app for chatting with your documents, with agents and a no-code agent builder.

    RAG and search, AI agents, Docker, Ollama, Operations, Self hosters

    67.9k starsMITUpdated 31 Oct 2026

  18. BerriAI/litellm

    Gateway that puts 100+ LLM providers behind one OpenAI-style API with spend tracking and limits.

    Monitoring, OpenAI, Anthropic, Engineering, Finance

    62.6k starsOtherUpdated 3 Nov 2026

  19. zylon-ai/private-gpt

    API layer for building private AI apps on local models, with document Q&A, tools and text-to-SQL.

    RAG and search, Ollama, OpenAI, Engineering, IT and security, Legal, Healthcare, Self hosters

    57.6k starsApache-2.0Updated 29 Oct 2026

  20. CherryHQ/cherry-studio

    Desktop workspace for chatting with many cloud and local models, with assistants, knowledge bases and MCP tools.

    RAG and search, Ollama, OpenAI, Operations

    53.2k starsAGPL-3.0Updated 3 Nov 2026

  21. run-llama/llama_index

    Python and TypeScript framework for connecting language models to your documents and building retrieval agents.

    RAG and search, AI agents, OpenAI, Engineering, SaaS

    52.8k starsMITUpdated 27 Oct 2026

  22. mudler/LocalAI

    Drop-in local replacement for the OpenAI API that serves text, image and audio models.

    Docker, OpenAI, Engineering, Self hosters

    50.1k starsMITUpdated 3 Nov 2026

  23. exo-explore/exo

    Spreads a large model across several home devices, such as Macs and PCs, so they act as one inference cluster.

    Engineering, Self hosters

    48.2k starsApache-2.0Updated 4 Nov 2026

  24. oobabooga/textgen

    Desktop and web app for running local language models with chat, vision, tool calls and an OpenAI-style API.

    Chatbots, Ollama, Engineering, Self hosters

    47.7k starsAGPL-3.0Updated 17 Aug 2026

  25. LibreChat-AI/LibreChat

    Self-hosted ChatGPT-style interface for many AI providers with agents, file search and multi-user login.

    Chatbots, OpenAI, Anthropic, IT and security, Operations, Self hosters

    46.6k starsMITUpdated 2 Nov 2026

  26. janhq/jan

    Offline desktop app for chatting with local models, an open-source LM Studio alternative.

    Chatbots, Operations, Self hosters

    45.4k starsOtherUpdated 3 Nov 2026

  27. langchain-ai/langgraph

    Library for building stateful, multi-step AI agents as graphs with memory and human review steps.

    AI agents, Engineering, SaaS

    44.4k starsMITUpdated 3 Nov 2026

  28. chatboxai/chatbox

    Desktop and mobile client for chatting with cloud and local models, including Ollama, from one interface.

    Chatbots, Ollama, OpenAI, Operations

    42.2k starsGPL-3.0Updated 29 Oct 2026

  29. stanfordnlp/dspy

    Write LLM pipelines as Python modules and let DSPy tune prompts and weights against your metrics.

    AI agents, OpenAI, Engineering, Data and analytics, SaaS

    38.9k starsMITUpdated 3 Nov 2026

  30. sgl-project/sglang

    Fast serving engine for text and multimodal models on GPUs, used to run open models behind an API at scale.

    Hosting and deploy, Docker, Engineering, SaaS, Self hosters

    38.4k starsApache-2.0Updated 3 Nov 2026

  31. langfuse/langfuse

    Tracing, prompt management and evals for LLM apps so teams can debug and measure quality.

    Monitoring, Docker, Engineering, Product, SaaS

    36.9k starsOtherUpdated 3 Nov 2026

  32. TabbyML/tabby

    Self-hosted coding assistant that gives code completion and chat inside your editor using models on your own GPU.

    Docker, Engineering, SaaS, Self hosters

    33.9k starsOtherUpdated 1 Jul 2026

  33. stanford-oval/storm

    LLM system that researches a topic on the web and writes a long, cited, Wikipedia-style article.

    Content writing, RAG and search, OpenAI, Marketing, Media and publishing, Education

    31.8k starsMITUpdated 30 Sept 2025

  34. karakeep-app/karakeep

    Read-later and bookmark app for links, notes and images that tags items with an LLM and offers full-text search.

    Knowledge base, Docker, Web, Operations, Self hosters

    30.3k starsAGPL-3.0Updated 2 Nov 2026

  35. labring/FastGPT

    Knowledge-base Q&A platform with visual workflow orchestration for building support bots.

    RAG and search, Chatbots, Knowledge base, Docker, OpenAI, Customer support, Operations, SaaS, No-code, Self hosters

    30k starsOtherUpdated 3 Nov 2026

  36. simstudioai/sim

    Canvas for building and deploying AI agent workflows that connect LLMs to tools and business apps.

    AI agents, Workflow automation, Docker, OpenAI, Operations, Engineering, SaaS, No-code

    30k starsApache-2.0Updated 3 Nov 2026

  37. mastra-ai/mastra

    TypeScript framework for AI agents, workflows, RAG and evals, aimed at web developers.

    AI agents, RAG and search, Vercel, Engineering, SaaS

    29.3k starsOtherUpdated 3 Nov 2026

  38. srbhr/Resume-Matcher

    Compares resumes against job descriptions and scores keyword match to improve shortlisting.

    Hiring (ATS), Web, Ollama, HR, Recruiting

    29.1k starsApache-2.0Updated 2 Nov 2026

  39. microsoft/semantic-kernel

    Microsoft SDK for adding AI models, plugins and agents to C#, Python and Java applications.

    AI agents, OpenAI, Engineering, SaaS

    28.7k starsMITUpdated 3 Nov 2026

  40. deepset-ai/haystack

    Framework for production RAG pipelines, search and agents with pluggable retrievers and models.

    RAG and search, AI agents, Engineering

    26.9k starsApache-2.0Updated 2 Nov 2026

  41. mozilla-ai/llamafile

    Packs a model and its runtime into one executable file that runs on most operating systems without installation.

    Engineering, Self hosters

    26.5k starsOtherUpdated 12 Oct 2026

  42. letta-ai/letta

    Platform for building agents that keep long-term memory across sessions, formerly known as MemGPT.

    AI agents, OpenAI, Anthropic, Engineering, SaaS

    25.3k starsApache-2.0Updated 19 Oct 2026

  43. sinaptik-ai/pandas-ai

    Lets you ask questions of CSVs, spreadsheets and databases in plain language and get answers and charts.

    Analytics dashboards, Data and analytics

    23.9k starsOtherUpdated 28 Oct 2025

  44. mlc-ai/mlc-llm

    Compiles language models to run natively on phones, browsers and GPUs from several vendors.

    Android, iOS, Engineering, Self hosters

    23.3k starsApache-2.0Updated 30 Oct 2026

  45. PromtEngineer/localGPT

    Ask questions about your own files using models that run on your machine, so documents never leave it.

    RAG and search, Ollama, Engineering, Legal, Self hosters

    22.2k starsMITUpdated 26 Aug 2026

  46. livekit/livekit

    WebRTC media server for building real-time video, audio and AI voice features into apps.

    Hosting and deploy, Web, Docker, Engineering, SaaS

    22k starsApache-2.0Updated 2 Nov 2026

  47. coze-dev/coze-studio

    Open-source edition of Coze for visually building agents, plugins and chat workflows.

    AI agents, Chatbots, Docker, Engineering, Operations, No-code

    21.8k starsApache-2.0Updated 29 Jul 2026

  48. pydantic/pydantic-ai

    Type-safe Python agent framework from the Pydantic team with structured outputs and model-agnostic calls.

    AI agents, Engineering

    21k starsMITUpdated 3 Nov 2026

  49. emcie-co/parlant

    Framework for customer-facing LLM agents that follow explicit behaviour guidelines with traceable decisions.

    Chatbots, AI agents, OpenAI, Anthropic, Customer support, SaaS, Finance and fintech

    18.3k starsApache-2.0Updated 3 Nov 2026

  50. Canner/WrenAI

    Text-to-SQL agent that lets business users ask data questions and get charts from their warehouse.

    Analytics dashboards, Data and analytics

    18k starsOtherUpdated 2 Nov 2026

  51. microsoft/agent-framework

    Microsoft's successor to AutoGen and Semantic Kernel for building agents in Python and .NET.

    AI agents, Engineering

    14.5k starsMITUpdated 3 Nov 2026

  52. LostRuins/koboldcpp

    Single-file program that runs GGUF models locally with a web UI for chat and story writing plus compatible APIs.

    Content writing, Engineering, Self hosters

    12.1k starsAGPL-3.0Updated 2 Nov 2026

  53. xorbitsai/inference

    Serving platform (Xinference) for open language, speech and image models with an OpenAI-compatible API.

    Hosting and deploy, Docker, OpenAI, Engineering, SaaS, Self hosters

    9.6k starsApache-2.0Updated 3 Nov 2026

  54. mishushakov/llm-scraper

    TypeScript library that uses an LLM and a schema to pull structured data out of any web page.

    Web scraping, OpenAI, Web, Engineering, Data and analytics

    7k starsMITUpdated 26 Oct 2026

  55. vas3k/TaxHacker

    Self-hosted AI app that reads receipts and invoices and sorts them for tax bookkeeping.

    Accounting, Web, OpenAI, Finance, B2B services, Self hosters, Solo founders

    6.8k starsMITUpdated 31 Oct 2026

  56. gpustack/gpustack

    Manages a cluster of GPUs and schedules model servers like vLLM and SGLang across them for internal AI use.

    Hosting and deploy, Docker, Kubernetes, Engineering, Operations, SaaS, Self hosters

    6k starsApache-2.0Updated 3 Nov 2026

  57. hexabot-ai/Hexabot

    AI chatbot builder with a visual editor, multichannel support and multilingual flows.

    Chatbots, Web, Facebook, Customer support, SaaS, Self hosters, No-code

    1.2k starsOtherUpdated 3 Nov 2026

  58. lawglance/lawglance

    RAG legal assistant that answers law questions from curated jurisdiction knowledge bases.

    RAG and search, Chatbots, OpenAI, Legal and compliance, Legal

    334 starsApache-2.0Updated 22 Sept 2026

  59. Tiledesk/tiledesk

    Platform for building LLM support chatbots with a visual flow builder and human handoff.

    Chatbots, Helpdesk, Web, WhatsApp, Customer support, SaaS, E-commerce, Self hosters, No-code

    326 starsMITUpdated 28 Oct 2026

  60. harvard-lil/olaw

    Harvard LIL workbench for experimenting with retrieval-augmented legal AI over court data.

    RAG and search, OpenAI, Ollama, Legal and compliance, Legal, Education

    166 starsMITUpdated 30 Oct 2024