macrostack
Browse

The AI stack

Categories

Local & Sovereign AINotes & KnowledgeObservability & MonitoringPassword ManagersWeb AnalyticsTeam ChatSmart HomeNetworking & RoutersVideo ConferencingCloud Storage & SyncPhotos & MediaAPI DevelopmentImage EditingWorkflow Automation & iPaaSDeveloper Tools & ContainersOffice & Productivity SuitesNo-Code DatabasesCode Hosting & Git ForgesProject ManagementEmail Marketing & NewslettersScheduling & BookingError Tracking & Exception MonitoringLog Management & SIEMVPN & PrivacyEmail & Secure MailVector Databases & AI SearchLLM & Agent FrameworksDomains & Web HostingData Removal & PrivacyAuthentication & IdentityHelp Desk & Customer SupportCloud & VPSKubernetes & Container PlatformsEmbedding ModelsPDF & DocumentsAI Coding AssistantsAI Voice & SpeechLLM Observability & EvaluationLLM Gateways & RoutingCloud GPU & AI ComputeCI/CD & build automationData & pipeline orchestrationModel serving & inferenceAI agent frameworksBackend as a serviceSecrets managementFeature flags & experimentationProduct analyticsSearch infrastructureUptime & status monitoringAffiliate & partner platformsVisitor identification & personalisationWikis & internal docsIdentity & access managementData warehouses & analytics enginesCustomer data platformsCRMObject storageBI & dashboardsE-signatureWhiteboards & diagrammingIn-memory data stores & cachingPlatform as a serviceTransactional & bulk emailHeadless CMSDesign & prototypingE-commerce platformsInternal tools & admin panelsManaged databasesForms & surveysFine-Tuning & Model TrainingRAG & Retrieval PlatformsLLM Evaluation & TestingAI Guardrails & Content SafetySpeech Recognition & TranscriptionExperiment Tracking & ML OpsDocument AI & OCR

About

How we rank & score

Layer 3 · self-hosting reality check

What it actually takes to self-host Dagster

The docs say 2 GB. In practice you want 8 GB. Here is the honest version — real requirements, real monthly cost, what you will be maintaining, and the one thing that catches people out.

Usually reached from Astronomer (Astro) alternatives, where Dagster is one of the picks.

RAM — documented minimum2 GB
RAM — what it really needs8 GB
CPU4 vCPU
DiskModest for Dagster itself; run logs accumulate
Monthly cost$50–90/mo self-hosted, against Dagster Cloud or managed Airflow pricing
Setup timeA day
How you install itdocker compose or Helm — webserver, daemon, PostgreSQL
Ongoing maintenanceModerate. Lighter than Airflow, heavier than a cron job.
Where it stops scalingLarge pipelines with rich lineage. The asset graph is what keeps big estates comprehensible.

The thing that catches people out

Dagster models assets rather than tasks, which is both the reason to choose it and the reason Airflow migrations stall. Porting a DAG one-to-one produces something that runs and gains you nothing — the value comes from re-expressing pipelines as the data they produce. Budget for rethinking rather than translating, or you carry Airflow's model into a tool built around a different one.

When not to self-host Dagster

Your pipelines are simple schedules. The asset model earns its keep on complex lineage and pays nothing on "run this at 3am".

Every guide here carries this section. A site that only ever tells you to self-host is selling something — the useful answer is sometimes no.

Other Layer 3 self-hosting guides

Common questions

How much RAM does Dagster actually need?
8 GB in practice. The documented minimum is 2 GB, which is the figure at which the process starts rather than the figure at which it works under real use. 4 vCPU alongside it.
What does self-hosting Dagster cost per month?
$50–90/mo self-hosted, against Dagster Cloud or managed Airflow pricing This is commodity VPS pricing and excludes your time, which is the larger cost for most people — budget for moderate. Lighter than Airflow, heavier than a cron job.
How long does it take to set up Dagster?
A day, via docker compose or Helm — webserver, daemon, PostgreSQL.
When should I NOT self-host Dagster?
Your pipelines are simple schedules. The asset model earns its keep on complex lineage and pays nothing on "run this at 3am".
What is the most common mistake when self-hosting Dagster?
Dagster models assets rather than tasks, which is both the reason to choose it and the reason Airflow migrations stall. Porting a DAG one-to-one produces something that runs and gains you nothing — the value comes from re-expressing pipelines as the data they produce. Budget for rethinking rather than translating, or you carry Airflow's model into a tool built around a different one.
The Macrostack brief

New swaps, worth your inbox.

A short, occasional email when we add a high-intent alternative or ship a new head-to-head. No spam, no selling your address — unsubscribe in one click.