Upgrading a VCF Operations Orchestrator v9.x Deployment

mount /dev/sr0 /mnt/cdrom

mount /dev/sr0 /mnt/cdrom

vracli upgrade exec -y --repo cdrom://

vracli upgrade exec -y --repo cdrom://

Loading update bootstrap.
Update bootstrap loaded successfully.
Saving configuration parameters
Running procedures in background...
.......................................
Upgrade procedure started in background.
During upgrade, downtime of the services and restarts of the VAs are expected.
Use 'vracli upgrade status --follow' to monitor the progress.
... Preparing for upgrade .....................................
...............................................................
Running health check before upgrade for nodes and pods.
Health check before upgrade for nodes and pods passed successfully.
...............................................................
Configuring SSH channels.
SSH channels configured successfully.
...............................................................
Checking version of current platform and services.
Version check of current platform and services passed successfully.
...............................................................
Running infrastructure health check before upgrade.
Infrastructure health check before upgrade passed successfully.
prep-vami-config-waiting
...............................................................
Saving restore point for artifacts. This might take more than an hour.
Saving restore point for artifacts failed.
... Upgrade preparation failed. The system is unaffected. ...


Upgrade Report


Summary
-------------------------------------------------------------------------------------

Date:                   Tue May 12 10:29:59 AM UTC 2026
Duration:               1 minutes
Result:                 Preparation Error
Description:            Preparation for upgrade has discovered problems. Review to error report below to correct the problems and try again. The services remained in working order.


Reference
-------------------------------------------------------------------------------------

Logs:                   /var/log/vmware/prelude
Backup:                 /data/restorepoint
Runtime:                /var/vmware/prelude/upgrade

Some directories might not exist.


Errors
-------------------------------------------------------------------------------------
[ERROR][2026-05-12 10:29:46][vro9.cloudbuildtools.com] Fewer docker images selected than expected. Potentially broken filter. Aborting to avoid services corruption.
[ERROR][2026-05-12 10:29:46][vro9.cloudbuildtools.com] Saving at least one restore points for tag artifacts-lastworking failed. Cleaning up tag directory.
[ERROR][2026-05-12 10:29:46][vro9.cloudbuildtools.com][Exit Code: 1] Attempt failed to run command: /opt/scripts/upgrade/rstp-save.sh 'local' immutable-artifact artifacts-lastworking.
[ERROR][2026-05-12 10:29:46][vro9.cloudbuildtools.com] Remote command failed: /opt/scripts/upgrade/rstp-save.sh 'local' immutable-artifact artifacts-lastworking at one or more nodes
[ERROR][2026-05-12 10:29:46][vro9.cloudbuildtools.com][Exit Code: 1] Saving restore points on all nodes failed.

Loading update bootstrap.
Update bootstrap loaded successfully.
Saving configuration parameters
Running procedures in background...
.......................................
Upgrade procedure started in background.
During upgrade, downtime of the services and restarts of the VAs are expected.
Use 'vracli upgrade status --follow' to monitor the progress.
... Preparing for upgrade .....................................
...............................................................
Running health check before upgrade for nodes and pods.
Health check before upgrade for nodes and pods passed successfully.
...............................................................
Configuring SSH channels.
SSH channels configured successfully.
...............................................................
Checking version of current platform and services.
Version check of current platform and services passed successfully.
...............................................................
Running infrastructure health check before upgrade.
Infrastructure health check before upgrade passed successfully.
prep-vami-config-waiting
...............................................................
Saving restore point for artifacts. This might take more than an hour.
Saving restore point for artifacts failed.
... Upgrade preparation failed. The system is unaffected. ...


Upgrade Report


Summary
-------------------------------------------------------------------------------------

Date:                   Tue May 12 10:29:59 AM UTC 2026
Duration:               1 minutes
Result:                 Preparation Error
Description:            Preparation for upgrade has discovered problems. Review to error report below to correct the problems and try again. The services remained in working order.


Reference
-------------------------------------------------------------------------------------

Logs:                   /var/log/vmware/prelude
Backup:                 /data/restorepoint
Runtime:                /var/vmware/prelude/upgrade

Some directories might not exist.


Errors
-------------------------------------------------------------------------------------
[ERROR][2026-05-12 10:29:46][vro9.cloudbuildtools.com] Fewer docker images selected than expected. Potentially broken filter. Aborting to avoid services corruption.
[ERROR][2026-05-12 10:29:46][vro9.cloudbuildtools.com] Saving at least one restore points for tag artifacts-lastworking failed. Cleaning up tag directory.
[ERROR][2026-05-12 10:29:46][vro9.cloudbuildtools.com][Exit Code: 1] Attempt failed to run command: /opt/scripts/upgrade/rstp-save.sh 'local' immutable-artifact artifacts-lastworking.
[ERROR][2026-05-12 10:29:46][vro9.cloudbuildtools.com] Remote command failed: /opt/scripts/upgrade/rstp-save.sh 'local' immutable-artifact artifacts-lastworking at one or more nodes
[ERROR][2026-05-12 10:29:46][vro9.cloudbuildtools.com][Exit Code: 1] Saving restore points on all nodes failed.

vracli upgrade exec --prepare --profile lcm --repo cdrom://

vracli upgrade exec --prepare --profile lcm --repo cdrom://

Loading update bootstrap.
Update bootstrap loaded successfully.
Loading configuration profile.
Saving configuration parameters
The services will be shut down while upgrade is in progress. Confirm you want to continue with the upgrade operation.[Y/n]y
Type one of the available answers.
The services will be shut down while upgrade is in progress. Confirm you want to continue with the upgrade operation.[Y/n]Y
Running procedures in background...
.......................................
Upgrade procedure started in background.
During upgrade, downtime of the services and restarts of the VAs are expected.
Use 'vracli upgrade status --follow' to monitor the progress.
... Preparing for upgrade .....................................
...............................................................
Running health check before upgrade for nodes and pods.
Health check before upgrade for nodes and pods passed successfully.
...............................................................
Configuring SSH channels.
SSH channels configured successfully.
...............................................................
Checking version of current platform and services.
Version check of current platform and services passed successfully.
...............................................................
Running infrastructure health check before upgrade.
Infrastructure health check before upgrade passed successfully.
prep-vami-config-waiting
...............................................................
Saving restore point for artifacts. This might take more than an hour.
Saving restore points for artifacts skipped.
...............................................................
Shutting down services.
Services shut down successfully.
...............................................................
Saving system configurations.
System configuration saved successfully.
...............................................................
Saving restore point for data. This might take more than an hour.
Saving restore point for data skipped.
... Upgrade preparation completed successfully. ...


Upgrade Report


Summary
-------------------------------------------------------------------------------------

Date:                   Tue May 12 10:50:39 AM UTC 2026
Duration:               6 minutes
Result:                 Prepared
Description:            Preparation for upgrade has been complete successfully. All services are stopped. It is safe to shut down all nodes and take VM level snapshots. Then power on all nodes and run 'vracli upgrade exec' to finish the upgrade or 'vracli upgrade --cancel' to restart the services without upgrading.


Reference
-------------------------------------------------------------------------------------

Logs:                   /var/log/vmware/prelude
Backup:                 /data/restorepoint
Runtime:                /var/vmware/prelude/upgrade

Some directories might not exist.

Loading update bootstrap.
Update bootstrap loaded successfully.
Loading configuration profile.
Saving configuration parameters
The services will be shut down while upgrade is in progress. Confirm you want to continue with the upgrade operation.[Y/n]y
Type one of the available answers.
The services will be shut down while upgrade is in progress. Confirm you want to continue with the upgrade operation.[Y/n]Y
Running procedures in background...
.......................................
Upgrade procedure started in background.
During upgrade, downtime of the services and restarts of the VAs are expected.
Use 'vracli upgrade status --follow' to monitor the progress.
... Preparing for upgrade .....................................
...............................................................
Running health check before upgrade for nodes and pods.
Health check before upgrade for nodes and pods passed successfully.
...............................................................
Configuring SSH channels.
SSH channels configured successfully.
...............................................................
Checking version of current platform and services.
Version check of current platform and services passed successfully.
...............................................................
Running infrastructure health check before upgrade.
Infrastructure health check before upgrade passed successfully.
prep-vami-config-waiting
...............................................................
Saving restore point for artifacts. This might take more than an hour.
Saving restore points for artifacts skipped.
...............................................................
Shutting down services.
Services shut down successfully.
...............................................................
Saving system configurations.
System configuration saved successfully.
...............................................................
Saving restore point for data. This might take more than an hour.
Saving restore point for data skipped.
... Upgrade preparation completed successfully. ...


Upgrade Report


Summary
-------------------------------------------------------------------------------------

Date:                   Tue May 12 10:50:39 AM UTC 2026
Duration:               6 minutes
Result:                 Prepared
Description:            Preparation for upgrade has been complete successfully. All services are stopped. It is safe to shut down all nodes and take VM level snapshots. Then power on all nodes and run 'vracli upgrade exec' to finish the upgrade or 'vracli upgrade --cancel' to restart the services without upgrading.


Reference
-------------------------------------------------------------------------------------

Logs:                   /var/log/vmware/prelude
Backup:                 /data/restorepoint
Runtime:                /var/vmware/prelude/upgrade

Some directories might not exist.

vracli upgrade exec

vracli upgrade exec

Upgrade is in progress.
Preparation for upgrade has been complete.
Saving configuration parameters
Running procedures in background...
.......................................
Upgrade procedure started in background.
During upgrade, downtime of the services and restarts of the VAs are expected.
Use 'vracli upgrade status --follow' to monitor the progress.
... Preparing for upgrade .....................................
...............................................................
Running health check before upgrade for nodes and pods.
Health check before upgrade for nodes and pods passed successfully.
...............................................................
Configuring SSH channels.
SSH channels configured successfully.
...............................................................
Checking version of current platform and services.
Version check of current platform and services passed successfully.
...............................................................
Running infrastructure health check before upgrade.
Infrastructure health check before upgrade passed successfully.
prep-vami-config-waiting
...............................................................
Saving restore point for artifacts. This might take more than an hour.
Saving restore points for artifacts skipped.
...............................................................
Shutting down services.
Services shut down successfully.
...............................................................
Saving system configurations.
System configuration saved successfully.
...............................................................
Saving restore point for data. This might take more than an hour.
Saving restore point for data skipped.
... Upgrade preparation completed successfully. ...
... Executing upgrade .........................................
...............................................................
Running additional health check before upgrade for nodes.
Health check before upgrade for nodes passed successfully.
...............................................................
Starting upgrade monitor.
Upgrade monitor started successfully.
...............................................................
Deactivating cluster of appliance nodes. This might take several minutes.
Cluster deactivation of appliance nodes skipped.
...............................................................
Configuring upgrade.
Upgrade is in progress. This might take more than an hour to complete and the system might be rebooted several times.

Upgrade is in progress.
Preparation for upgrade has been complete.
Saving configuration parameters
Running procedures in background...
.......................................
Upgrade procedure started in background.
During upgrade, downtime of the services and restarts of the VAs are expected.
Use 'vracli upgrade status --follow' to monitor the progress.
... Preparing for upgrade .....................................
...............................................................
Running health check before upgrade for nodes and pods.
Health check before upgrade for nodes and pods passed successfully.
...............................................................
Configuring SSH channels.
SSH channels configured successfully.
...............................................................
Checking version of current platform and services.
Version check of current platform and services passed successfully.
...............................................................
Running infrastructure health check before upgrade.
Infrastructure health check before upgrade passed successfully.
prep-vami-config-waiting
...............................................................
Saving restore point for artifacts. This might take more than an hour.
Saving restore points for artifacts skipped.
...............................................................
Shutting down services.
Services shut down successfully.
...............................................................
Saving system configurations.
System configuration saved successfully.
...............................................................
Saving restore point for data. This might take more than an hour.
Saving restore point for data skipped.
... Upgrade preparation completed successfully. ...
... Executing upgrade .........................................
...............................................................
Running additional health check before upgrade for nodes.
Health check before upgrade for nodes passed successfully.
...............................................................
Starting upgrade monitor.
Upgrade monitor started successfully.
...............................................................
Deactivating cluster of appliance nodes. This might take several minutes.
Cluster deactivation of appliance nodes skipped.
...............................................................
Configuring upgrade.
Upgrade is in progress. This might take more than an hour to complete and the system might be rebooted several times.

vracli upgrade status --follow

vracli upgrade status --follow

Upgrade is complete. Continuing with post upgrade operations.
...............................................................
Analysing the result of the node that executes post upgrade operations.
The node running post upgrade operations is upgraded successfully.
...............................................................
Rebuilding cluster of appliance nodes.
Cluster of appliance nodes rebuilt successfully.
...............................................................
Synchronizing cluster of appliance nodes.
Synchronizing cluster of appliance nodes skipped.
...............................................................
Loading system configurations.
System configurations loaded successfully.
...............................................................
Deploying services. This might take a few minutes.
Services deployed successfully.
...............................................................
Running health check after upgrade for nodes and pods.
Health check after upgrade for nodes and pods passed successfully.
...............................................................
Deleting restore points.
Restore points deleted successfully.
...............................................................
Reverting SSH configuration to its state before the upgrade.
SSH configuration reverted to its state before the upgrade successfully.
... Upgrade completed successfully ............................


Upgrade Report


Summary
-------------------------------------------------------------------------------------

Date:                   Tue May 12 10:50:39 AM UTC 2026
Duration:               6 minutes
Result:                 Prepared
Description:            Preparation for upgrade has been complete successfully. All services are stopped. It is safe to shut down all nodes and take VM level snapshots. Then power on all nodes and run 'vracli upgrade exec' to finish the upgrade or 'vracli upgrade --cancel' to restart the services without upgrading.


Reference
-------------------------------------------------------------------------------------

Logs:                   /var/log/vmware/prelude
Backup:                 /data/restorepoint
Runtime:                /var/vmware/prelude/upgrade

Some directories might not exist.

Upgrade is complete. Continuing with post upgrade operations.
...............................................................
Analysing the result of the node that executes post upgrade operations.
The node running post upgrade operations is upgraded successfully.
...............................................................
Rebuilding cluster of appliance nodes.
Cluster of appliance nodes rebuilt successfully.
...............................................................
Synchronizing cluster of appliance nodes.
Synchronizing cluster of appliance nodes skipped.
...............................................................
Loading system configurations.
System configurations loaded successfully.
...............................................................
Deploying services. This might take a few minutes.
Services deployed successfully.
...............................................................
Running health check after upgrade for nodes and pods.
Health check after upgrade for nodes and pods passed successfully.
...............................................................
Deleting restore points.
Restore points deleted successfully.
...............................................................
Reverting SSH configuration to its state before the upgrade.
SSH configuration reverted to its state before the upgrade successfully.
... Upgrade completed successfully ............................


Upgrade Report


Summary
-------------------------------------------------------------------------------------

Date:                   Tue May 12 10:50:39 AM UTC 2026
Duration:               6 minutes
Result:                 Prepared
Description:            Preparation for upgrade has been complete successfully. All services are stopped. It is safe to shut down all nodes and take VM level snapshots. Then power on all nodes and run 'vracli upgrade exec' to finish the upgrade or 'vracli upgrade --cancel' to restart the services without upgrading.


Reference
-------------------------------------------------------------------------------------

Logs:                   /var/log/vmware/prelude
Backup:                 /data/restorepoint
Runtime:                /var/vmware/prelude/upgrade

Some directories might not exist.