Running a language model on your own hardware takes two decisions, and most guides blur them together. The first is which model to run — we covered that in our guide to the best self-hosted LLMs of 2026. The second is which app you actually chat in: the window where you type, attach documents, manage models, and (if you want) expose a local API. That second decision is this guide. We compare the four apps people actually install in 2026: LM Studio, GPT4All, AnythingLLM, and Open WebUI.
The case for a local app is unchanged: your prompts stay on your machine, everything works offline once the model files are downloaded, and there is no monthly subscription attached to your chat history. What changed on the way to 2026 is the field itself. LM Studio dropped its commercial-use restriction in July 2025 and is now free at work. Open WebUI passed 146,000 GitHub stars and ships monthly. AnythingLLM kept a monthly-or-faster cadence through the first half of 2026. And GPT4All — once the default beginner recommendation — has not shipped a release since February 2025.
This comparison is for anyone choosing their first local LLM app, and for anyone who picked one in 2024 and wants to know whether the choice still holds. Three of the four are desktop apps; Open WebUI is a self-hosted web app you run in Docker, usually paired with an engine like Ollama — the engine we walked through in our Ollama on Mac tutorial.
LM Studio: the polished desktop, with a closed core
LM Studio, from Element Labs, Inc., is the most finished-feeling desktop app of the four — and the only one whose core is proprietary. Its Terms of Use (effective 1 July 2025) grant a license for personal and internal business use with no modification, redistribution, or reverse engineering. The practical news is that since 8 July 2025 that license costs nothing at work: "LM Studio is free to use both at home and at work." Before that date, workplace use required contacting the company. Paid Teams and Enterprise tiers (SSO, model and MCP gating) sit on top for organisations that want them, and only the small lms command-line tool is open source under MIT.
The current build is 0.4.19 (as of 20 Jul 2026), and the platform story is specific: on macOS it is Apple Silicon only — the official system requirements state plainly that "Intel-based Macs are currently not supported" — while Windows gets x64 and ARM64 builds and Linux gets an x64/ARM64 AppImage. Its standout technical feature is dual engines: GGUF models via llama.cpp everywhere, plus Apple's MLX format on M-series Macs, with the MLX engine still actively developed (v1.8.5 shipped in June 2026). You can attach documents to chats for fully offline RAG, and it has been an MCP host since v0.3.17, so agent tools plug in via mcp.json.
For developers, LM Studio runs a local API server on port 1234 with OpenAI-compatible endpoints plus an Anthropic-compatible Messages API — most existing client code points at it unchanged. On privacy, the pricing page says of the free tier: "No data ever leaves your device," and the app can operate entirely offline. The trade is transparency: you cannot audit the closed core, and there is no public repository for the core app to watch.
GPT4All: the FOSS classic that went quiet
GPT4All, from Nomic, Inc. (the team behind the nomic-embed models), is MIT-licensed, free for commercial use, and still the simplest fully open-source desktop chat app. It runs GGUF models via llama.cpp on Windows (x64 and ARM installers), macOS 12.6+ (M1 minimum on the Apple side), and x86-64 Linux. LocalDocs gives it private, on-device chat with your own files using Nomic's embedding models, and an OpenAI-compatible API server exists on port 4891 — off by default, localhost only, enabled from the settings screen.
Here is the part you need to weigh honestly: development has stalled. The latest release is v3.10.0, published 25 February 2025 — roughly seventeen months before this guide — and the last commit to the main branch was 27 May 2025. The repository is not archived, and Nomic has published no pause or end-of-life statement, but open issues on the official repo ask outright whether development has stopped (#3558, #3605). The cadence before the stop was rapid — four releases in the two months prior — which makes the silence more conspicuous, not less.
None of that means the app stops working. v3.10.0 installs and runs today, the MIT license means it can never be taken away, and its telemetry posture is the strictest of the four: sharing chats with the community datalake is anonymous, optional, and off by default. But choosing it in mid-2026 means accepting no MCP support (nothing in the official docs), no multi-user mode, and no clear path for fixes until Nomic says otherwise. If FOSS desktop simplicity is the goal, GPT4All still delivers it — with a caveat the other three do not carry.
AnythingLLM: the active MIT all-rounder with built-in RAG
AnythingLLM, from Mintplex Labs Inc., is the app to look at if "chat with my own documents" is the actual job. It is MIT-licensed and unambiguously active: v1.15.0 shipped on 25 June 2026, on the back of a monthly-or-faster release cadence all year. It is also the only app here with an Intel Mac desktop build — separate DMGs for Apple Silicon and Intel — alongside Windows 10+ (x64 and ARM64) and Linux desktop, plus a Docker server mode with one-click deploy templates for the major clouds.
RAG is not an add-on but the core design: workspaces ingest PDFs, TXT, and DOCX files with citations, backed by LanceDB as the default vector database and AnythingLLM's own native embedder by default — so document chat works out of the box with zero configuration. It runs any llama.cpp-compatible model locally and can equally sit in front of Ollama, LM Studio, OpenAI, Anthropic, and a long list of other providers, which makes it a reasonable front-end even if your inference happens elsewhere. MCP tools are supported for its AI agents on both desktop and Docker. One structural limit: multi-user mode with per-user permissions is Docker-only — the desktop build is strictly single-user.
The disclosure you should know going in: anonymous telemetry is on by default. Mintplex documents exactly what is tracked (install type, event-level document adds with no content, vector-DB and model tags, chat-sent events), states that "No IP or other identifying information is collected," and provides a documented opt-out — DISABLE_TELEMETRY=true or the in-app Privacy panel. That is a defensible posture, but it is opt-out where GPT4All is opt-in, and worth flipping on day one if it bothers you.
Open WebUI: the self-hosted power option
Open WebUI is a different shape of thing: not a desktop app but a web UI you self-host, Docker-first (-p 3000:8080, UI at localhost:3000), with pip and Kubernetes installs as alternatives. It does not run chat models itself in the core image — you pair it with Ollama (there is a bundled :ollama image) or point it at any OpenAI-compatible endpoint, including LM Studio and vLLM. If you followed our Ollama tutorial, Open WebUI is the natural next layer on top.
It is the clear power option and the clear traction leader: 146,064 stars and 21,174 forks (GitHub API, accessed 20 Jul 2026), with v0.10.2 released 1 July 2026 and commits landing as recently as the day we checked. It is also the only one of the four with genuine team infrastructure in the free core: granular RBAC with user groups, LDAP/Active Directory, SSO, and SCIM 2.0 provisioning for Okta, Azure AD, and Google Workspace. RAG runs against a choice of nine vector databases with hybrid BM25-plus-vector search and reranking, and external tools connect via MCP, MCPO, and OpenAPI tool servers. On privacy, the official FAQ states: "Open WebUI does not send your data to external services by default."
The fine print is the license. Through v0.6.5, Open WebUI was plain BSD-3-Clause. From v0.6.6 (released 5 May 2025 per the changelog; the docs page says April 2025) it moved to a custom "Open WebUI License": BSD-3 base plus a branding-retention clause that prohibits removing or replacing Open WebUI branding — with an exception for deployments of 50 or fewer users in any rolling 30-day period, and an Enterprise license for those who want white-labelling above that. The project is open about the motivation (companies rebadging and reselling the work) and notes anyone can still fork v0.6.5 under pure BSD-3. For a homelab or a small team this changes nothing in practice; for a larger rollout it is a clause your legal review should actually read.
Side by side
| Feature | LM Studio | GPT4All | AnythingLLM | Open WebUI |
|---|---|---|---|---|
| License | Proprietary (closed core) | MIT | MIT | BSD-3 + branding clause |
| Price | Free (incl. work, since 8 Jul 2025); paid Teams/Enterprise | Free | Free; optional paid hosting | Free; paid Enterprise (branding, SLA) |
| Platforms | macOS (Apple Silicon only), Windows x64/ARM64, Linux x64/ARM64 | Windows x64/ARM, macOS 12.6+ (M1 min), Linux x86-64 | macOS (Intel + Apple Silicon), Windows x64/ARM64, Linux | Any (browser UI; server via Docker/pip/K8s) |
| Docker | No (desktop; llmster headless daemon) | No | Yes (server mode) | Yes (primary install) |
| Model formats | GGUF + MLX | GGUF | Any llama.cpp-compatible | n/a (UI layer, not the engine) |
| Backends | Built-in (llama.cpp, MLX) | Built-in (llama.cpp) | Built-in + Ollama, LM Studio, cloud providers | Ollama, vLLM, any OpenAI-compatible API |
| Local API server | Yes — port 1234 (OpenAI + Anthropic compatible) | Yes — port 4891, off by default | Yes — developer API at /api/docs + OpenAI-compatible endpoints | Yes — is itself an OpenAI-compatible front (UI on 3000/8080) |
| RAG / docs chat | Yes — attach docs, offline | Yes — LocalDocs | Core feature (LanceDB + native embedder) | Yes — 9 vector DBs, hybrid search |
| Multi-user | Cloud plans only (free public Hub; paid Teams/Enterprise) | No | Docker version only | RBAC, LDAP, SSO, SCIM |
| MCP | Yes (host since v0.3.17) | Not documented | Yes (desktop + Docker) | Yes (MCP, MCPO, OpenAPI) |
| Telemetry default | "No data ever leaves your device" (pricing page) | Opt-in only | On by default (documented opt-out) | No external sends by default (FAQ) |
| Activity (last release) | Active — 0.4.19, blog through Jul 2026 | Stalled — v3.10.0, Feb 2025 | Active — v1.15.0, 25 Jun 2026 | Very active — v0.10.2, 1 Jul 2026 |
Which one should you run?
There is no single best app here — the four are built for different users, and the honest move is to match the shape of the tool to the shape of your problem.
- You want the simplest polished desktop app, and you are on Apple Silicon: LM Studio. The MLX engine is unique among these four, the dual OpenAI/Anthropic-compatible server is the most developer-friendly local API of the group, and it now costs nothing at work. The price is a closed core you cannot audit — accept that consciously.
- You want strictly FOSS desktop simplicity: GPT4All still fits, with the staleness caveat stated above weighed before you commit — or AnythingLLM, which gives you MIT licensing with active development and an Intel Mac build GPT4All and LM Studio both lack.
- Your real job is asking questions of your own documents in one app: AnythingLLM. RAG with citations, a default vector DB and embedder that need no setup, and MCP agents — just flip the telemetry toggle if opt-out defaults bother you.
- You are setting this up for a team, or want a server you reach from any browser: Open WebUI paired with Ollama. Nothing else here has RBAC, LDAP, or SCIM in a free tier. Read the branding clause if your deployment will exceed 50 users.
The ASEAN angle
For readers in Singapore, Malaysia, and the wider region, the appeal of all four is the same: they run fully on-device or on-prem, and each vendor states that prompt data does not leave your machine by default — LM Studio's "no data ever leaves your device," GPT4All's opt-in-only datalake, AnythingLLM's "never collects any of your personal data," and Open WebUI's "does not send your data to external services by default." That posture maps cleanly onto PDPA obligations when the documents you chat with contain personal data, and AnythingLLM's documented erasure flow (deleting a document removes the parsed file and cached embeddings from every workspace) is a practical fit for right-to-erasure requests. There is no regional pricing to navigate — every core offering is free, and the paid tiers are quote-based or US-dollar checkouts. One region-specific footnote from AnythingLLM's own docs: its cdn.anythingllm.com model mirror "is actually useful for those in VPN restricted regions."
FAQ
Do I need a GPU, and how much RAM?
A GPU helps but is not required for any of these. Published guidance clusters around 16 GB of RAM: LM Studio recommends 16 GB+ (8 GB Macs "may work with smaller models"), GPT4All lists 16 GB minimum (8 GB for 3B-parameter models), and AnythingLLM recommends 16 GB and an 8-core CPU — though it runs on very small machines, even a Raspberry Pi, when pointed at external LLM and embedder APIs. Open WebUI's needs depend on the backend you pair it with, since the core image does not run the chat model itself.
Are my chats private?
Chat content stays local in all four by default, but telemetry postures differ. GPT4All is strictest: sharing anything is opt-in, off by default. LM Studio's pricing page says "No data ever leaves your device" on the free tier, though the closed core means you take that on trust. AnythingLLM sends anonymous usage events by default (never document or chat content, no IPs, per its docs), with a documented opt-out. Open WebUI "does not send your data to external services by default." In every case, connecting a cloud model provider sends your prompts to that provider — local privacy only holds while the model is local.
Can these replace ChatGPT?
The app is not the limit — the model is. All four give you a capable chat interface, document Q&A, and (in most) agent tooling; what you get back depends on which open-weights model you run and your hardware, which is exactly what our self-hosted LLMs guide covers. What you gain for certain: offline operation, no subscription, and prompts that stay on your machine.
GGUF vs MLX — what is the difference?
GGUF is the model file format used by llama.cpp and runs everywhere — all three apps that do their own inference support it. MLX is Apple's framework for Apple Silicon; only LM Studio ships an MLX engine here (v1.8.5, June 2026) alongside GGUF. On an M-series Mac wanting MLX, LM Studio is the only pick; on other hardware the question does not arise.
- Terms of Use — LM Studio (Element Labs) (accessed 20 Jul 2026)
- LM Studio is free for work — LM Studio blog, 8 Jul 2025 (accessed 20 Jul 2026)
- Pricing — LM Studio (accessed 20 Jul 2026)
- System requirements — LM Studio docs (accessed 20 Jul 2026)
- Local API server — LM Studio docs (accessed 20 Jul 2026)
- MCP in LM Studio — LM Studio docs (accessed 20 Jul 2026)
- GPT4All repository and README — Nomic (accessed 20 Jul 2026)
- GPT4All releases — GitHub API (v3.10.0, 25 Feb 2025) (accessed 20 Jul 2026)
- GPT4All documentation (LocalDocs, API server, settings) — Nomic (accessed 20 Jul 2026)
- AnythingLLM repository and README — Mintplex Labs (accessed 20 Jul 2026)
- AnythingLLM releases — GitHub API (v1.15.0, 25 Jun 2026) (accessed 20 Jul 2026)
- AnythingLLM system requirements and desktop installs — Mintplex Labs docs (accessed 20 Jul 2026)
- Privacy & data handling — AnythingLLM docs (accessed 20 Jul 2026)
- Open WebUI repository and README (accessed 20 Jul 2026)
- Open WebUI License (BSD-3 + branding clause) (accessed 20 Jul 2026)
- License & rationale — Open WebUI docs (accessed 20 Jul 2026)
- FAQ (data handling, branding) — Open WebUI docs (accessed 20 Jul 2026)
- Open WebUI repo stats — GitHub API (146,064 stars / 21,174 forks) (accessed 20 Jul 2026)