Altaro Agent on Host server is not upgrading / going to retry upgrade / getting stuck in a loop of upgrade

If you have upgraded the backup server for Altaro and are trying to roll up the upgraded agent too the hosts.  You may find your self stuck in a loop of upgrading or retrying.

Go to "C:\ProgramData\Altaro\AltaroBackupProfile" on both the host and the backup server and delete the folder called "Installer"

Then try to roll the upgrade out again.