Installing the AdaptDL Scheduler
This page shows how to install the AdaptDL scheduler on an existing Kubernetes instance. If you do not have a running Kubernetes instance, you may refer to other pages to deploy a single-node MicroK8s instance, or to provision an auto-scaling cluster on EKS.
The following instructions assume
kubectl (installation instructions) and
helm (installation instructions) are installed
locally and configured with administrator access to an existing Kubernetes
Install the AdaptDL Helm Chart
The AdaptDL scheduler can be installed in just one command using Helm:
$ helm install adaptdl adaptdl-sched --repo https://github.com/petuum/adaptdl/raw/helm-repo \ --namespace adaptdl --create-namespace --set docker-registry.enabled=true
The above command installs Kubernetes deployments for the AdaptDL scheduler service, as well as a Docker registry. The Docker registry is used to store intermediate Docker images when submitting jobs with the AdaptDL CLI.
The Docker registry installed with the AdaptDL scheduler is insecure.
Please install an alternative secure registry for serious use!
The included Docker registry may be disabled by omitting the
--set docker-registry.enabled=true option, and then the AdaptDL CLI may
be configured to use the alternative secure registry.
If installing AdaptDL together with the insecure registry, you may need to
first install the Helm stable repository with the
helm repo add stable
Check that the AdaptDL scheduler and Docker registry are running:
$ kubectl get pods -n adaptdl
adaptdl-adaptdl-sched-7d8b689f45-9ds8h 3/3 Running 0 2m37s adaptdl-registry-7f45598964-t8df6 1/1 Running 0 2m37s
Once the AdaptDL scheduler is installed and running, you may run AdaptDL jobs using the AdaptDL CLI.