Own AILab with Self-Hosted AI Server Stack

After experimenting with various AI and DevOps tools, I found the following architecture to be a reliable, scalable, and easy-to-manage setup for running AI applications at home or in a small office.

Server Architecture

Ubuntu 24.04 LTS
│
├── Docker Engine
├── Coolify
├── Portainer
├── Watchtower
├── Duplicati (Backups)
├── Uptime Kuma
│
├── AI Services
│   ├── Ollama
│   ├── Open WebUI
│   ├── ComfyUI
│   ├── n8n
│   ├── Qdrant
│   ├── PostgreSQL
│   ├── Redis
│   └── MinIO
│
├── Reverse Proxy
│   └── Caddy (or Traefik)
│
└── Cloudflare Tunnel (Optional)

Recommended Components

• ✅ Coolify
• ✅ Portainer
• ✅ Watchtower
• ✅ Caddy (or Nginx Proxy Manager)
• ✅ Uptime Kuma
• ✅ Duplicati

What Each Component Does

Component	Purpose
Coolify	Deploy and manage applications using Docker Compose or Git repositories.
Portainer	Provides an intuitive web interface for managing Docker containers, volumes, networks, and logs.
Watchtower	Automatically updates Docker containers that use published images.
Caddy / Nginx Proxy Manager	Handles reverse proxying, HTTPS certificates, and custom domains.
Uptime Kuma	Monitors the health and availability of all running services.
Duplicati	Creates scheduled backups of application data and configuration.

---

1. Coolify ⭐⭐⭐⭐⭐

Best for: Self-hosting AI applications, Docker Compose stacks, and web applications.

Advantages

• GitHub & GitLab integration
• One-click deployments
• Automatic HTTPS (Let's Encrypt)
• Built-in reverse proxy
• Environment variable management
• Docker Compose support
• Scheduled backups
• Supports multiple servers
• Team collaboration
• Easy application updates

Ideal Applications

• Ollama
• Open WebUI
• ComfyUI
• n8n
• PostgreSQL
• Redis
• MinIO
• Supabase

Limitations

• Uses slightly more system resources than Portainer.
• May be more feature-rich than necessary if you only need Docker management.

---

2. Portainer ⭐⭐⭐⭐☆

Best for: Managing Docker containers and troubleshooting running services.

Advantages

• Very stable and lightweight
• Container logs
• Built-in terminal access
• Volume management
• Network management
• Docker Stack support
• Resource monitoring

Limitations

• No built-in automatic HTTPS
• No Git-based deployments
• No built-in CI/CD pipelines
• Less convenient for application deployment compared to Coolify

---

3. Dockge ⭐⭐⭐⭐☆

Dockge is developed by the creator of Uptime Kuma and focuses on Docker Compose management.

Advantages

• Very lightweight
• Browser-based Docker Compose editor
• Easy updates
• Minimal resource usage

Limitations

• Fewer deployment and automation features than Coolify or Portainer.

---

4. CasaOS ⭐⭐⭐☆☆

CasaOS is designed primarily for home servers and media servers.

Best For

• Plex
• Jellyfin
• Immich
• Home NAS
• Personal cloud storage

Limitations

While CasaOS is excellent for home media servers, it is less suitable for AI development and production workloads compared to Coolify or Portainer.

---

My Recommendation