macrostack
Best of · 5 tools ranked

The best RAG & Retrieval Platforms

Every option ranked — open-source, self-hostable, and commercial — by our transparent Sovereignty Score, with honest trade-offs so you choose what fits you, not us.

Retrieval-augmented generation — the plumbing that finds the right documents and hands them to a model. The decision is whether retrieval is a managed API you call or a pipeline you own end to end.

L4Models & tooling — layer 4 of the AI stack
  1. 1

    LlamaIndex

    Top pickOpen source

    The most complete open RAG framework. Every stage, under your control.

    Free and MIT licensed. A paid managed parsing/ingest service exists separately. · in our Vectara comparison →

    93
    sovereignty
    What is LlamaIndex? →
  2. 2

    Haystack

    Open source

    Explicit, testable RAG pipelines from deepset. The production-minded one.

    Free and Apache-2.0; deepset sells a managed enterprise platform on top. · in our Vectara comparison →

    92
    sovereignty
    What is Haystack? →
  3. 3

    R2R

    Open source

    RAG as a deployable server with an API, not a library to assemble.

    Free, MIT. Optional hosted tier from the maintainers. · in our Vectara comparison →

    92
    sovereignty
    What is R2R? →
  4. 4

    RAGFlow

    Open source

    Deep document understanding — the one for messy PDFs and real-world files.

    Free to self-host, Apache-2.0. A managed cloud tier is offered separately. · in our Vectara comparison →

    91
    sovereignty
    What is RAGFlow? →
  5. 5

    Dify

    Commercial

    A self-hostable AI application platform — the closest product-shaped replacement.

    Free to self-host under its modified licence; paid cloud tiers available. · in our Vectara comparison →

    74
    sovereignty
    What is Dify? →

Is it free?

The free tier, its real limits and where you start paying — read from each vendor's own pricing page and dated.

Run these yourself

What each one actually needs — real RAM, honest running cost, and the setup time nobody quotes.

  • Self-hosting LlamaIndex 4 GB for the app; your vector store is the real cost
  • Self-hosting Haystack 4 GB
  • Self-hosting RAGFlow 16 GB
  • Self-hosting Dify 8 GB. The default compose file starts 16 containers — api, api_websocket, worker, worker_beat, web, plugin_daemon, agent_backend, Weaviate, PostgreSQL, Redis, nginx, two SSRF proxies, two sandboxes and a one-shot init job — and Dify's own macOS instructions ask for a Docker VM with 8 GiB. More if a local model shares the box.

Replacing a specific tool?

Head-to-head comparisons for each popular rag & retrieval platforms product.

Straight head-to-heads

Two rag & retrieval platforms tools, side by side — verified facts and a plain verdict.

The Macrostack brief

New swaps, worth your inbox.

A short, occasional email when we add a high-intent alternative or ship a new head-to-head. No spam, no selling your address — unsubscribe in one click.