Docker Image Pull Failed with "Error response from daemon"

Problem

Docker image pull fails during PMK stack startup with the below error messages:

[2023-10-31 04:36:16] docker: Error response from daemon: open /var/lib/docker/overlay2/d39acd549d8883feef19a6464c0e1dfe48da0bd1bc83a54aee6e585ba06db8b8/committed: no such file or directory.

Environment

• Platform9 Edge Cloud - v-5.3.0-2075501
• Docker client/server - Version: 19.03.11

Cause

Docker container runtime upstream issue - Ref - Bug

Resolution

Error indicates that /var/lib/docker/overlay2 is referencing to some older files which might be cached. So we follow below procedure to fix the issue.

1. Stop the dockerd service using below command

# systemctl stop dockerd

2. Move the /var/lib/docker directory to /tmp and then start the dockerd service.

# systemctl start dockerd

Additional Information

This step will recreated a new /var/lib/docker directory and PMK stack should start properly.