Offline PDF chat with RAG using local LLMs and vector search
A production-oriented Retrieval-Augmented Generation (RAG) system for chatting with PDFs. It uses local LLMs via Ollama, ChromaDB for vector search, and LangChain to provide grounded answers from uploaded documents, fully offline. Aimed at users needing private, local document Q&A.
Visit project ↗Entities
Related
Founder runs full multi-agent content pipeline offline on local laptop
A founder demonstrates a multi-agent pipeline for content research, drafting, and editing that runs entirely on a local laptop with no internet connection, using models stored on the hard drive. This showcases the growing capability of local AI to replace cloud-dependent workflows, eliminating API costs and data privacy concerns.
Billy Bassistant AI Fish: AI assistant with local file knowledge and status LED
Billy Bassistant AI Fish is a voice-enabled AI assistant that can be fed custom PDF, Excel, or text files organized into topic-specific folders. It uses LLMs to process these local files and answer questions based on them, and optionally shows a status LED indicator. It solves the problem of having a physical AI assistant that can access and reason over personal documents.
Relm brings local LLMs to R with native interpretability
Relm is a new R package that allows users to run large language models locally as native R objects, with built-in interpretability tools. It integrates with the R ecosystem, enabling developers and data scientists to leverage LLMs directly in their R workflows without external APIs.
LLM-based intelligent chatbot with session history
A full-stack chatbot project that uses an LLM (Anthropic Claude by default) to answer user messages while maintaining per-session conversation history. It provides a simple, self-contained setup with a Node.js backend and a plain HTML/CSS/JS frontend, suitable for developers who want to quickly deploy an LLM-powered chat interface.
Interactive app teaching LLM pipeline from pattern matching to transformer training
An interactive web app that walks through every stage of the LLM pipeline, from basic pattern matching to training a transformer from scratch. It includes working code that users can run locally, making it an educational tool for developers and learners.