This repository is a fork of OpenHands, with the remote runtime server implementation used in SkyRL-v0. We provide:
- An efficient remote server implementation for OpenHands: We leverage aidocker and use the crun container runtime, which offers lightweight and high-performance container execution. Our setup supports easily running 80–100 containers per replica on nodes with just 16 CPUs.
- Deployment files for a scalable deployment on Kubernetes: We leverage storage-optimized instances to cache container images and enable fast startup times. Further, we use a simple API gateway to spread the image cache across multiple replicas.
While there remains significant room for optimization, our current implementation is simple, effective, and publicly available.
The remote runtime server implementation is provided in openhands/runtime/remote_runtime_server.
For deployment instructions, please refer to the k8s_deploy directory.
