Pod Allocation Failed Due to Failed to Write Deviceplugin Checkpoint File Error.

Problem

• Pods Failed to spin up with the no space left on device error.

Status: Failed

Reason: UnexpectedAdmissionError

Message: Pod Allocate failed due to failed to write checkpoint file "kubelet_internal_checkpoint": open /var/lib/kubelet/device-plugins/.374770390: no space left on device, which is unexpected

Environment

• Platform9 Managed Kubernetes

Cause

• Lack of adequate amount of disk space for the /var filesystem can cause this issue.

Resolution

• Check disk space usage on the node for /var filesystem.

# df -TH | grep var

• Make sure that there is enough space in the var directory and if it's not there then add more space to it.