Problem
- Load-average on the master node goes high causing Kubernetes related services to fail
- Node may become unstable in terms of Kubernetes workloads and customer may decide to evict the node.
Environment
- Platform9 Managed Kubernetes
Resolution
- Run the command to drain the node:
$ kubectl drain <node_name>
- The above command may fail if the pods are using local storage or if daemonsets are running on the node. In that case, be aware that local storage associated with the pods will be deleted and then use the above command with switches --delete-local-data=false and --ignore-daemonsets=false.
$ kubectl drain <node_name> --delete-local-data=false --ignore-daemonsets=false
Additional Information
Kubernetes Docs - Safely Drain Node
