Launch HN: LlamaFarm (YC W22) – Open-source framework for distributed AI

Summary

🦙 LlamaFarm Build powerful AI locally, extend anywhere. LlamaFarm is an open-source framework for building retrieval-augmented and agentic AI applications. It ships with opinionated defaults (Ollama for local models, Chroma for vector storage) while staying 100% extendable—swap in vLLM, remote OpenAI-compatible hosts, new parsers, or custom stores without rewriting your app. Local-first developer experience with a single CLI ( lf ) that manages projects, datasets, and chat sessions. with a single CLI ( ) that manages projects, datasets, and chat sessions. Production-ready architecture that mirrors server endpoints and enforces schema-based configuration. that mirrors server endpoints and enforces schema-based configuration. Composable RAG pipelines you can tailor through YAML, not bespoke code. you can tailor through YAML, not bespoke code. Extendable everything: runtimes, embedders, databases, extractors, and CLI tooling. 📺 Video demo (90 seconds): https://youtu.be/W7MHGyN0MdQ 🚀 Quickstart (TL;DR) Prerequisites: Docker Ollama (local runtime; additional options coming soon) Install the CLI macOS / Linux curl -fsSL https://raw.githubusercontent.com/llama-farm/llamafarm/main/install.sh | bash Windows (via winget) winget install LlamaFarm.CLI Adjust Ollama context window Open the Ollama app, go to Settings → Advanced , and set the context window to match production (e.g., 100K tokens). , and set the context window to match production (e.g., 100K tokens). Larger context windows improve RAG answers when long documents are ingested. Create and run a project lf init my-project # Generates llamafarm.yaml using the server template lf start # Spins up Docker services & opens the dev chat UI Start an interactive project chat or send a one-off message # Interactive project chat (auto-detects namespace/project from llamafarm.yaml) lf chat # One-off message lf chat " Hello, LlamaFarm! " Need the full walkthrough with dataset ingestion and troubleshooting tips? Jump to the Quickst...