Management Plane Upgrade Fails From Airctl Version 5.0.0-1468184 to 5.1.0-1488368 as Host was Tainted due to Previous Upgrade Failure
Problem
Management Plane Upgrade Fails From Airctl Version 5.0.0-1468184 to 5.1.0-1488368.
2021-04-13T12:57:40.728-0500 INFO waiting for container pf9deploy to finish2021-04-13T13:08:36.951-0500 ERROR fatal error:failed to prepare for restore operation: configure command returned status 1, log file: /home/centos/airctl-logs/pf9deploy-prepare-restore.log INFO:pf9deploy.server.util.ssh:check_ssh: SSH Connection failed. Reason: [Errno None] Unable to connect to port 22 on 192.168.120.254, retrying...DEBUG:pf9deploy.server.util.ssh:<retry> Task is still not ready after 0 secondsINFO:pf9deploy.server.util.ssh:check_ssh: SSH Connection failed. Reason: [Errno None] Unable to connect to port 22 on 192.168.120.254, retrying...DEBUG:pf9deploy.server.util.ssh:<retry> Task is still not ready after 15 seconds...INFO:pf9deploy.server.util.ssh:check_ssh: SSH Connection failed. Reason: [Errno None] Unable to connect to port 22 on 192.168.120.254, retrying...Traceback (most recent call last):File "/airctl/scripts/run_playbook.py", line 77, in <module> op.commit()File "/app/pf9deploy/server/operation/__init__.py", line 212, in commit ret_value = self.cleanse_data(self._commit())File "/airctl/scripts/run_playbook.py", line 51, in _commit check_ssh(du.fqdn, key_file=private_key)File "/app/pf9deploy/server/util/retry.py", line 40, in newfun raise RuntimeError("Task timed out after %d seconds" % max_wait)RuntimeError: Task timed out after 600 secondsEnvironment
- Platform9 Edge Cloud - v5.1
- Airctl
Cause
Deployment Unit image du-v-5.1.0-1488368.qcow2 under the directory /opt/pf9/airctl on the deployment host was tainted when a previous upgrade attempt had failed.
Resolution
In this case, the user will need to perform an airctl restore using a pristine image (freshly copied from S3 download), instead of using the tainted Deployment Unit image. Once that is done, re-upgrade using the pristine image.
- Remove the tainted DU image from /opt/pf9/airctl.
- Download DU image.
- Rollback/Restore to the previous state.
- Upgrade to the desired version 5.1.0-1488368.
Note: Connect with Platform9 support to get secret user agent value.
Was this page helpful?