Katakate: Dozens of VMs per node for safe code exec: K8s+Kata+Firecracker

Summary

KATAKATE Self-hosted secure VM sandboxes for AI compute at scale Katakate aims to make it easy to create, manage and orchestrate lightweight safe VM sandboxes for executing untrusted code, at scale. It is built on battle-tested VM isolation with Kata, Firecracker and Kubernetes. It is orignally motivated by AI agents that need to run arbitrary code at scale but it is also great for: Custom serverless (like AWS Fargate, but yours) Hardened CI/CD runners (no Docker-in-Docker risks) Blockchain execution layers for AI dApps 100% open‑source (Apache‑2.0). For technical support, write us at: hi@katakate.org The Tech Stack Katakate is built on: Kubernetes for orchestration, with K3s which is prod-ready and a great choice for edge nodes, for orchestration, with K3s which is prod-ready and a great choice for edge nodes, Kata to encapsulate containers into light-weight virtual-machines, to encapsulate containers into light-weight virtual-machines, Firecracker as the chosen VM, for super-fast boots, light footprints and minimal attack surface, as the chosen VM, for super-fast boots, light footprints and minimal attack surface, Devmapper Snapshotter with thin-pool provisioning of logical volumes for efficient use of disk space shared by dozens of VMs per node. Coming Soon 🛠️ Docker build / run / compose support inside the VM sandbox / / support 🌐 Multi-node cluster capabilities for distributed workloads 🔍 Cilium FQDN-based DNS resolution to safely whitelist domains, not just IP blocks ⚙️ Support other VMM such as Qemu for GPU workloads Note: Katakate is currently in beta and under security review. Use with caution for highly sensitive workloads. Usage For usage you need: Node(s) that will host the VM sandboxes that will host the VM sandboxes Client from where to send requests We provide a: CLI : to use on the node(s) directly --> apt install k7 : to use on the node(s) directly --> API : deployed on the (master) node(s) --> k7 start-api : deployed on the (master) node(s) --> Pyt...