Building a Managed AI Hosting Platform with Rails 8, Docker, and Traefik

Platform Architecture and Stack

A developer built a managed hosting platform for AI applications from scratch in two weeks using Rails 8. The platform currently serves 50 paying customers. The technical stack includes a Rails 8 monolith, PostgreSQL database, Sidekiq for background processing (configured with 5 processes and 50 threads), Clockwork for scheduling tasks, and Hetzner Cloud API for spinning up customer VPS instances.

Technical Challenges and Solutions

The developer specifically mentions addressing "ugly parts" including Docker configuration headaches, implementing Server-Sent Events (SSE) streaming through Traefik reverse proxy, and handling customer instances that crash during off-hours (specifically at 2 AM).

For context: Rails 8 includes Hotwire by default for real-time features, which may relate to the SSE streaming implementation. Traefik is a modern reverse proxy that can handle WebSocket and SSE connections natively, though configuration can be complex. Hetzner Cloud provides affordable VPS instances popular for self-hosted deployments. Sidekiq with 5 processes and 50 threads suggests significant background job processing capacity for handling customer workloads.

The platform appears to be a case study in building infrastructure-as-a-service specifically for AI applications, with the developer sharing practical experience around deployment, monitoring, and incident response.