I recently worked on a project to upgrade a SimpliVity environment from version 5.2 to 5.3.1. I downloaded all the necessary files from the HPE Support Portal and followed the official upgrade procedure.
As you know, the upgrade process consists of six main steps. The first two—Arbiter and vCenter upgrades—went smoothly, exactly as expected. However, during the OVC (OmniStack Virtual Controller) upgrade, the process stuck at 95% with the message:
Restarting the Virtual Controller
It’s worth noting that when the svtfs service is not operational, you cannot log in to the OVC using vCenter credentials—which explained the symptoms I was seeing.
Below are the relevant update logs from the upgrade attempt:
root@omnicube-ip1-53:/home/svtcli# cat /var/logsvt-upgrade.log
2025-08-04 06:39:38Z [323722] ########################### Starting Upgrade Launcher ###########################
2025-08-04 06:39:38Z [323722] INFO: Ground Control to Major Tom: Take your protein pills and put your helmet on
2025-08-04 06:39:38Z [323722] INFO: Commencing countdown, skip fd=0 : lr-x------ 1 root root 64 Aug 4 06:39 /proc/323722/fd/0 -> pipe :[88534818]
2025-08-04 06:39:38Z [323722] INFO: Commencing countdown, skip fd=1 : l-wx------ 1 root root 64 Aug 4 06:39 /proc/323722/fd/1 -> pipe :[88534819]
2025-08-04 06:39:38Z [323722] INFO: Commencing countdown, skip fd=2 : l-wx------ 1 root root 64 Aug 4 06:39 /proc/323722/fd/2 -> pipe :[88534820]
2025-08-04 06:39:38Z [323722] INFO: Commencing countdown, close fd=255 : lr-x------ 1 root root 64 Aug 4 06:39 /proc/323722/fd/255 -> /scratch/upgrade/pre_launch_bay/preflight.pl
2025-08-04 06:39:38Z [323722] INFO: Commencing countdown, close fd=3 : lr-x------ 1 root root 64 Aug 4 06:39 /proc/323722/fd/3 -> pip e:[88538382]
2025/08/04 06:39:38 Starting for 10.100.1.53 as omnicube-ip1-53.hasanaltin.local
2025/08/04 06:39:38 Failed to get host name for 10.100.1.53, no answers
2025/08/04 06:39:39 10.100.1.53 already in /etc/hosts
2025/08/04 06:39:39 No error for 10.100.1.53 as omnicube-ip1-53.hasanaltin.local
2025-08-04 06:39:39Z [323722] INFO: Waiting on the road for the launch bay
2025-08-04 06:39:39Z [323722] INFO: Moving into the launch bay after 0 seconds
2025-08-04 06:39:39Z [323722] INFO: Starting with JAVA_ARGS= -Xms256M -Xmx256M -Duser.language=en -Duser.country=US -Dfile.encoding=UT F-8
2025-08-04 06:39:39Z [323722] INFO: Starting with SPACEPROBE_EXTRA_ARGS=
2025-08-04 06:39:39Z [323722] INFO: Starting with args:
2025-08-04 06:39:39Z [323722] INFO: Checking if a spaceprobe is already in orbit ...
2025-08-04 06:39:39Z [323722] INFO: Checking the space probe fuel level
2025-08-04 06:39:39Z [323722] INFO: Space probe full ready to launch
2025-08-04 06:39:39Z [323722] INFO: Launching the space probe... Further logs in /var/svtfs/0/log/svt-upgrade-spaceprobe.log
2025-08-04 06:39:39Z [323722] INFO: Waiting at the launch bay to confirm launch
2025-08-04 06:39:40Z [323722] INFO: Checking if a spaceprobe is already in orbit ...
2025-08-04 06:39:41Z [323722] INFO: Checking if a spaceprobe is already in orbit ...
2025-08-04 06:39:42Z [323722] INFO: Checking if a spaceprobe is already in orbit ...
2025-08-04 06:39:43Z [323722] INFO: Checking if a spaceprobe is already in orbit ...
2025-08-04 06:39:43Z [323722] INFO: Spaceprobe claims it has launched in 4 seconds! Checking space port 46139
2025-08-04 06:39:43Z [323722] INFO: Confirmed! You've really made the grade, and the papers want to know whose shirts you wear
2025-08-04 06:39:43Z [323722] INFO: Success! The space probe is floating in a most peculiar way; And the stars look very different to day.
2025/08/04 08:41:48 INFO> validate_pkg.pl:58 main:: - Validate script starts.
2025/08/04 08:41:48 INFO> validate_pkg.pl:218 main::find_archive - Validating given package location.
2025/08/04 08:41:48 INFO> StateMachine.pm:29 Util::StateMachine::Factory - Returning Partition-based state machine instance
2025/08/04 08:41:48 INFO> Partition.pm:73 Util::StateMachine::Partition::init - At init, the current state is Committed
2025/08/04 08:41:48 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /
2025/08/04 08:41:48 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/" UUID="0208a1c0-b09a-4a93-a42a-6 5601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:41:48 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /dormant
2025/08/04 08:41:48 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/dormant" UUID="cef841ad-ef40-4fa6 -9eec-7fcf756b4327" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:41:48 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:41:48 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:41:48 INFO> validate_pkg.pl:134 main:: - Cleaning out /scratch/upgrade
2025/08/04 08:41:48 INFO> validate_pkg.pl:161 main:: - Extract and validate /mnt/svtfs/0/8e8670dc-557a-4f52-8150-1e23a987302f/.svtupgrade/ SimpliVity-OmniCube-Software-revA-5.3.1.8.tar
2025/08/04 08:41:48 INFO> validate_pkg.pl:174 main:: - Current SVA version: 5.2.0.159
2025/08/04 08:41:48 INFO> validate_pkg.pl:180 main:: - Current SVA version has support for Digital signature verification
2025/08/04 08:41:48 INFO> copyvalidate.pl:300 CopyValidate::main - Copy /mnt/svtfs/0/8e8670dc-557a-4f52-8150-1e23a987302f/.svtupgrade/Simp liVity-OmniCube-Software-revA-5.3.1.8.tar via 'tar xif {FIFO} -C /scratch/upgrade'
2025/08/04 08:41:48 INFO> copyvalidate.pl:324 CopyValidate::main - Setting up FIFO /tmp/copyvalidate-364011//dsv.fifo
2025/08/04 08:41:48 INFO> copyvalidate.pl:324 CopyValidate::main - Setting up FIFO /tmp/copyvalidate-364011//tar.fifo
2025/08/04 08:41:48 INFO> copyvalidate.pl:347 CopyValidate::main - Started dsv with PID 364022 (gpg --no-default-keyring --keyring /var/tm p/build/os/hpe-keyring.gpg --verify /mnt/svtfs/0/8e8670dc-557a-4f52-8150-1e23a987302f/.svtupgrade/SimpliVity-OmniCube-Software-revA-5.3.1. 8.tar.sig /tmp/copyvalidate-364011//dsv.fifo >/tmp/copyvalidate-364011//dsv.stdout 2>/tmp/copyvalidate-364011//dsv.stderr)
2025/08/04 08:41:48 INFO> copyvalidate.pl:347 CopyValidate::main - Started tar with PID 364023 (tar xif /tmp/copyvalidate-364011//tar.fifo -C /scratch/upgrade >/tmp/copyvalidate-364011//tar.stdout 2>/tmp/copyvalidate-364011//tar.stderr)
2025/08/04 08:41:48 INFO> copyvalidate.pl:398 CopyValidate::main - Waiting to retry the open for tar, dsv
2025/08/04 08:41:49 INFO> copyvalidate.pl:377 CopyValidate::main - Opened FIFO /tmp/copyvalidate-364011//tar.fifo
2025/08/04 08:41:49 INFO> copyvalidate.pl:377 CopyValidate::main - Opened FIFO /tmp/copyvalidate-364011//dsv.fifo
2025/08/04 08:41:49 INFO> copyvalidate.pl:413 CopyValidate::main - Reading /mnt/svtfs/0/8e8670dc-557a-4f52-8150-1e23a987302f/.svtupgrade/S impliVity-OmniCube-Software-revA-5.3.1.8.tar from disk
2025/08/04 08:41:49 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 0% processed (0/1738024960) after 1s
2025/08/04 08:41:51 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 3% processed (52166656/1738024960) after 3s
2025/08/04 08:41:53 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 7% processed (121667584/1738024960) after 5s
2025/08/04 08:41:55 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 13% processed (225968128/1738024960) after 7s
2025/08/04 08:41:57 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 19% processed (330235904/1738024960) after 9s
2025/08/04 08:41:59 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 24% processed (417136640/1738024960) after 11s
2025/08/04 08:42:01 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 27% processed (469270528/1738024960) after 13s
2025/08/04 08:42:03 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 31% processed (538804224/1738024960) after 15s
2025/08/04 08:42:05 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 36% processed (625704960/1738024960) after 17s
2025/08/04 08:42:07 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 41% processed (712605696/1738024960) after 19s
2025/08/04 08:42:09 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 45% processed (782139392/1738024960) after 21s
2025/08/04 08:42:11 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 49% processed (851640320/1738024960) after 23s
2025/08/04 08:42:13 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 53% processed (921174016/1738024960) after 25s
2025/08/04 08:42:15 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 58% processed (1008074752/1738024960) after 27s
2025/08/04 08:42:17 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 63% processed (1094975488/1738024960) after 29s
2025/08/04 08:42:19 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 68% processed (1181876224/1738024960) after 31s
2025/08/04 08:42:21 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 74% processed (1286144000/1738024960) after 33s
2025/08/04 08:42:23 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 79% processed (1373044736/1738024960) after 35s
2025/08/04 08:42:25 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 84% processed (1459945472/1738024960) after 37s
2025/08/04 08:42:27 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 87% processed (1512112128/1738024960) after 39s
2025/08/04 08:42:29 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 91% processed (1581613056/1738024960) after 41s
2025/08/04 08:42:31 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 95% processed (1651146752/1738024960) after 43s
2025/08/04 08:42:33 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 99% processed (1720647680/1738024960) after 45s
2025/08/04 08:42:33 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 100% processed (1738024960/1738024960) after 45s
2025/08/04 08:42:33 INFO> copyvalidate.pl:461 CopyValidate::main - Read from disk completed in 45s
2025/08/04 08:42:33 INFO> copyvalidate.pl:479 CopyValidate::main - dsv (364022) returned 0
2025/08/04 08:42:33 INFO> copyvalidate.pl:479 CopyValidate::main - tar (364023) returned 0
2025/08/04 08:42:33 INFO> copyvalidate.pl:540 CopyValidate::main - /mnt/svtfs/0/8e8670dc-557a-4f52-8150-1e23a987302f/.svtupgrade/SimpliVit y-OmniCube-Software-revA-5.3.1.8.tar is copied successfully
2025/08/04 08:42:33 INFO> Statusfile.pm:176 Util::Statusfile::complete - Successfully validated and extracted the HPE OmniStack bundle
2025/08/04 08:42:33 INFO> Common.pm:166 Util::Common::Exit - /var/tmp/build/os/copyvalidate.pl exiting, requested exit code is 0
2025/08/04 08:42:33 INFO> Common.pm:166 Util::Common::Exit - /var/tmp/build/os/validate_pkg.pl exiting, requested exit code is 0
2025/08/04 08:42:35 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 0% through step 1 (Preparing HPE OmniStack for pre-validation check s): 0% of total
2025/08/04 08:42:35 INFO> preflight.pl:165 Preflight::run - Fetching our cluster's federation data
2025/08/04 08:42:35 INFO> SvtControl.pm:80 Util::SvtControl::init_client - Connecting to SVTFS Control interface 10.100.1.53:9190
2025/08/04 08:42:35 INFO> SvtControl.pm:88 Util::SvtControl::disconnect - Disconnecting from SVTFS Control interface 10.100.1.53:9190
2025/08/04 08:42:36 INFO> ClusterFedData.pm:49 Util::ClusterFedData::getActviteUpgradeTaskHash - dsv-task-get-active output:: <CommandResu lt>
<task>
<state>0</state>
<monitoredSubTasks></monitoredSubTasks>
<taskType>com.simplivity.task.software.upgrade</taskType>
<startTime>1754296884</startTime>
<parentId>2c0aecf7-90d3-40cd-b486-1bc066a995a4</parentId>
<taskId>b7dc8495-f638-45e9-b151-4dc50941e245</taskId>
<errorCode>0</errorCode>
<destId>42343f04-c7ca-52e6-c769-0cb7c2c160be</destId>
<percent>40</percent>
<taskReturnInfo></taskReturnInfo>
<endTime>0</endTime>
<ownerId>4234e0be-1ca9-20ca-1706-020271a4083e</ownerId>
<destName>OmniStackVC-10-100-1-53</destName>
<taskName></taskName>
</task>
</CommandResult>
2025/08/04 08:42:36 INFO> ClusterFedData.pm:93 Util::ClusterFedData::getClusterNodeToMgmtIpMap - Obtain upgrade one task details for task b7dc8495-f638-45e9-b151-4dc50941e245
2025/08/04 08:42:37 INFO> ClusterFedData.pm:101 Util::ClusterFedData::getClusterNodeToMgmtIpMap - dsv-task-details output :: <CommandResul t>
<parent>
<taskReturnInfo></taskReturnInfo>
<destId>42343f04-c7ca-52e6-c769-0cb7c2c160be</destId>
<parentId>2c0aecf7-90d3-40cd-b486-1bc066a995a4</parentId>
<destName>OmniStackVC-10-100-1-53</destName>
<percent>40</percent>
<taskId>4234e0be-1ca9-20ca-1706-020271a4083e:42343f04-c7ca-52e6-c769-0cb7c2c160be:b7dc8495-f638-45e9-b151-4dc50941e245</taskId>
<taskName></taskName>
<monitoredSubTasks></monitoredSubTasks>
<errorCode>0</errorCode>
<endTime>0</endTime>
<startTime>1754296884</startTime>
<taskType>com.simplivity.task.software.upgrade</taskType>
<ownerId>4234e0be-1ca9-20ca-1706-020271a4083e</ownerId>
<state>0</state>
</parent>
<arguments>creation_time = 1754296884, follows_span_id = , id = b7dc8495-f638-45e9-b151-4dc50941e245, modified_time = 1754296884, owne r = 4234e0be-1ca9-20ca-1706-020271a4083e, parent_span_id = 8ad732ef81e9f944, seq_num = 0, span_id = ff0f19717c259e77, task_async_parent = 00000000-0000-0000-0000-000000000000, task_cancel_restart = 0, task_destination = 42343f04-c7ca-52e6-c769-0cb7c2c160be, task_feature_level = 1600, task_invisible = 0, task_parent = 2c0aecf7-90d3-40cd-b486-1bc066a995a4, task_priority = 2000, task_receive_time = 1754296884, tas k_stunned = 0, task_type = com.simplivity.task.software.upgrade, trace_id = d0651337079527468d2ca89107f1c9b9, node_preflight_complete = '1 ', session_map = '1|12:10.100.1.150:40:baceb8535ff737928017faad3736c36eb75a0757|', task_invisible = '0', task_platform_tag = '32277902-789 8-4a12-8818-f6224c1b6f75:Task:task-9009', task_priority = '2000', task_target = '42343f04-c7ca-52e6-c769-0cb7c2c160be', task_target_type = 'vm', upgrade_disregard_ha = '0', upgrade_filename = 'SimpliVity-OmniCube-Software-revA-5.3.1.8.tar', upgrade_package_validated = '1', up grade_pkg_name = '/mnt/svtfs/0/8e8670dc-557a-4f52-8150-1e23a987302f/.svtupgrade/SimpliVity-OmniCube-Software-revA-5.3.1.8.tar', upgrade_pr eflight_ha_check = '1', upgrade_preflight_ha_fence = '1', upgrade_version = '5.3.1.8'</arguments>
<subtasks>
</subtasks>
</CommandResult>
2025/08/04 08:42:37 INFO> ClusterFedData.pm:117 Util::ClusterFedData::getClusterNodeToMgmtIpMap - pkgpath=/mnt/svtfs/0/8e8670dc-557a-4f52- 8150-1e23a987302f/.svtupgrade
2025/08/04 08:42:37 INFO> ClusterFedData.pm:133 Util::ClusterFedData::getClusterNodeToMgmtIpMap - ESXiPath=/vmfs/volumes/Datastore01-SO/.s vtupgrade
2025/08/04 08:42:37 INFO> preflight.pl:171 Preflight::run - Checking for upgrade metadata file; attempt 1
2025/08/04 08:42:37 INFO> preflight.pl:176 Preflight::run - Caching upgrade metadata from /mnt/svtfs/0/8e8670dc-557a-4f52-8150-1e23a987302 f/.svtupgrade/cluster-4c2c249a-e0ef-4c63-9629-a3fe5ff44e0b.component-selections.json
2025/08/04 08:42:37 INFO> preflight.pl:198 Preflight::run - Cached our cluster's federation data to /scratch/upgrade/fed_info_map
2025/08/04 08:42:37 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 100% through step 1 (Preparing HPE OmniStack for pre-validation che cks): 25% of total
2025/08/04 08:42:37 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 0% through step 2 (Initializing HPE OmniStack for pre-validation ch ecks): 25% of total
2025/08/04 08:42:37 INFO> Base.pm:72 Command::Base::initLogger - Initializing an appender for svt-hal logging
2025/08/04 08:42:37 INFO> Hal.pm:188 Hal::build - Building HAL
2025/08/04 08:42:37 INFO> Hal.pm:161 Hal::readManifestFile - YAML::Syck read file /var/svtfs/svt-hal/0/manifest/svt-hal-manifest.yaml
2025/08/04 08:42:37 INFO> Base.pm:202 Platform::Base::createPlatform - Use Platform::VMware
2025/08/04 08:42:37 INFO> Base.pm:211 Platform::Base::createPlatform - Build Platform::VMware Platform
2025/08/04 08:42:37 INFO> VMware.pm:58 Platform::VMware::init - Platform::VMware::init
2025/08/04 08:42:37 INFO> Base.pm:148 Platform::Factory::Base::buildPlatform - Attempt to build chassis using manifest
2025/08/04 08:42:37 INFO> Base.pm:219 Platform::Factory::Base::_buildChassisFromManifest - Created chassis from manifest [SerialNumber: CZ 2D2B09YN], [Model: ProLiant DL325 Gen11], [Manufacturer: HPE], [CustomerModel: HPE SimpliVity 325 Gen11]
2025/08/04 08:42:37 INFO> Base.pm:403 System::Base::createSystem - Build system using package System::HP
2025/08/04 08:42:37 INFO> Base.pm:412 System::Base::createSystem - Create System::HP System
2025/08/04 08:42:37 INFO> HP.pm:58 System::HP::init - System::HP::init
2025/08/04 08:42:37 INFO> HP.pm:84 Controller::HP::init - Controller::HP::init
2025/08/04 08:42:38 INFO> Enclosure.pm:316 Enclosure::loadController - Controller initialized successfully type: Controller::HP
2025/08/04 08:42:38 INFO> Enclosure.pm:505 Enclosure::assignControllerNumber - Setting controller number: 1 for controller type: 2
2025/08/04 08:42:38 INFO> SSACLI.pm:363 Controller::Factory::HP::SSACLI::checkCacheState - Cache Status: OK
2025/08/04 08:42:38 INFO> Base.pm:367 Controller::Factory::Base::_convertBBUState - Convert BBU state from OK to 0
2025/08/04 08:42:38 INFO> Base.pm:404 Controller::Factory::Base::_setBBUHealthStateCommon - Set BBU state to 0
2025/08/04 08:42:39 INFO> LogicalDrive.pm:189 LogicalDrive::resetDriveStats - Logical drive 1 has 0 drives rebuilding (total)
2025/08/04 08:42:39 INFO> SSACLI.pm:752 Controller::Factory::HP::SSACLI::buildPhysicalDrives - Found 4 physical drive(s)
2025/08/04 08:42:39 INFO> SSACLI.pm:1697 Controller::Factory::HP::SSACLI::_addMirrorGrouping - No mirror groups found
2025/08/04 08:42:39 INFO> LogicalDrive.pm:189 LogicalDrive::resetDriveStats - Logical drive 2 has 0 drives rebuilding (total)
2025/08/04 08:42:39 INFO> SSACLI.pm:752 Controller::Factory::HP::SSACLI::buildPhysicalDrives - Found 4 physical drive(s)
2025/08/04 08:42:39 INFO> SSACLI.pm:1697 Controller::Factory::HP::SSACLI::_addMirrorGrouping - No mirror groups found
2025/08/04 08:42:39 INFO> LogicalDrive.pm:189 LogicalDrive::resetDriveStats - Logical drive 3 has 0 drives rebuilding (total)
2025/08/04 08:42:39 INFO> SSACLI.pm:752 Controller::Factory::HP::SSACLI::buildPhysicalDrives - Found 4 physical drive(s)
2025/08/04 08:42:39 INFO> SSACLI.pm:1528 Controller::Factory::HP::SSACLI::buildLogicalDrives - Found 3 logical drive(s)
2025/08/04 08:42:39 INFO> DriveConfig.pm:1206 DriveConfig::_mapLDTypes - Logical device /dev/sdb (#1) will be mapped to type io
2025/08/04 08:42:39 INFO> DriveConfig.pm:1206 DriveConfig::_mapLDTypes - Logical device /dev/sdc (#2) will be mapped to type cfg
2025/08/04 08:42:39 INFO> DriveConfig.pm:1206 DriveConfig::_mapLDTypes - Logical device /dev/sdd (#3) will be mapped to type io
2025/08/04 08:42:39 INFO> Enclosure.pm:455 Enclosure::buildAllControllers - Controller built successfully, type: 2 name: HPE SR932i-p Gen1 1 and number: 1
2025/08/04 08:42:40 INFO> Enclosure.pm:189 Enclosure::processController - Controller selection failed (Boot controller)
2025/08/04 08:42:41 INFO> Enclosure.pm:253 Enclosure::selectDataController - Data Controller selected : HPE SR932i-p Gen11
2025/08/04 08:42:41 INFO> SSACLI.pm:752 Controller::Factory::HP::SSACLI::buildPhysicalDrives - Found 4 physical drive(s)
2025/08/04 08:42:41 INFO> HP.pm:117 System::HP::overrideCustomerVisibleModelString - System Model: ProLiant DL325 Gen11; Customer Visible Model: HPE SimpliVity 325 Gen11
2025/08/04 08:42:41 INFO> Base.pm:181 System::Base::_setCustomerVisibleModelStrings - Model strings [customerVisibleModel: HPE SimpliVity 325 Gen11] [model: ProLiant DL325 Gen11]
2025/08/04 08:42:41 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 100% through step 2 (Initializing HPE OmniStack for pre-validation checks): 50% of total
2025/08/04 08:42:41 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 0% through step 3 (Running the pre-validation checks): 50% of total
2025/08/04 08:42:41 INFO> CheckVersions.pm:285 PreFlight::CheckVersions::componentsToUpgrade - sva component will be upgraded
2025/08/04 08:42:41 INFO> CheckVersions.pm:285 PreFlight::CheckVersions::componentsToUpgrade - svt component will be upgraded
2025/08/04 08:42:41 INFO> PreflightPostflight.pm:44 Common::PreflightPostflight::printSuccess - +Passed+ Checks to make sure versions are correct for upgrade
2025/08/04 08:42:41 INFO> Common.pm:458 Util::Common::getESXiVersion - get vmware versions using session: baceb8535ff737928017faad3736c36e b75a0757
2025/08/04 08:42:41 INFO> Common.pm:464 Util::Common::getESXiVersion - SVA GUID: 42343f04-c7ca-52e6-c769-0cb7c2c160be
2025/08/04 08:42:41 INFO> Common.pm:470 Util::Common::getESXiVersion - host name: svt01.hasanaltin.local
2025/08/04 08:42:41 INFO> Common.pm:475 Util::Common::getESXiVersion - ESXi version: 8.0.3:24280767
2025/08/04 08:42:41 INFO> PreflightPostflight.pm:44 Common::PreflightPostflight::printSuccess - +Passed+ Checks to make sure VMware versi ons are correct for upgrade
2025/08/04 08:42:41 INFO> PreflightPostflight.pm:44 Common::PreflightPostflight::printSuccess - +Passed+ Check to make sure firmware upgr ade is possible
2025/08/04 08:42:41 INFO> PreflightPostflight.pm:44 Common::PreflightPostflight::printSuccess - +Passed+ Check whether its a no-op for Fi rmware OVC and ESXi Upgrade
2025/08/04 08:42:41 INFO> PreflightPostflight.pm:44 Common::PreflightPostflight::printSuccess - +Passed+ Check if there is enough disk sp ace for upgrade operation
2025/08/04 08:42:41 INFO> PreflightPostflight.pm:44 Common::PreflightPostflight::printSuccess - +Passed+ Checks to make sure svtfs.xml is compatible with svtconfigupgrader
2025/08/04 08:42:41 INFO> PreflightPostflight.pm:44 Common::PreflightPostflight::printSuccess - +Passed+ Check state of all network inter faces
2025/08/04 08:42:41 INFO> PreflightPostflight.pm:44 Common::PreflightPostflight::printSuccess - +Passed+ Are logical drives optimal
2025/08/04 08:42:42 INFO> PreflightPostflight.pm:44 Common::PreflightPostflight::printSuccess - +Passed+ Check if svtfs mountpoints are i n use
2025/08/04 08:42:42 INFO> PreflightPostflight.pm:44 Common::PreflightPostflight::printSuccess - +Passed+ Check if RO-root mode is active
2025/08/04 08:42:42 INFO> RunPVCs.pm:234 PreFlight::RunPVCs::makeRestRequest - curl command is 'curl' '--silent' '--show-error' '--fail' ' --insecure' '--request' 'GET' '--url' 'http://localhost:46139/upgrade-orchestrator/local' '--header' 'Accept: application/vnd.simplivity.v 1+json' '--header' 'X-SSO-Auth 10.100.1.150:baceb8535ff737928017faad3736c36eb75a0757'
2025/08/04 08:42:42 INFO> RunPVCs.pm:268 PreFlight::RunPVCs::startSpaceprobe - Spaceprobe of required version:5.3.1.8 is orbiting successu lly
2025/08/04 08:42:42 INFO> RunPVCs.pm:234 PreFlight::RunPVCs::makeRestRequest - curl command is 'curl' '--silent' '--show-error' '--fail' ' --insecure' '--request' 'POST' '--url' 'http://localhost:46139/upgrade-orchestrator/local/validation' '--header' 'Accept: application/vnd. simplivity.v1+json' '--header' 'X-SSO-Auth 10.100.1.150:baceb8535ff737928017faad3736c36eb75a0757' '--header' 'Content-Type: application/js on' '--data' '[{"description":"OmniStack 5.3.1.8","userData":null,"type":"OMNISTACK","files":[{"name":"SimpliVity-OmniCube-Software-revA-5 .3.1.8.tar","sha1":"c2b1ee11144c796c94c5c4c0501d26e8b6c66c97","sha256":null,"size":1738024960},{"sha1":"b2bec08326fe6370ee6e13e4650b0ab664 987baa","sha256":null,"size":40,"name":"SimpliVity-OmniCube-Software-revA-5.3.1.8.sha1"},{"sha1":"66bf9780b888f7b7022c12efffa0109272588823 ","size":310,"sha256":null,"name":"SimpliVity-OmniCube-Software-revA-5.3.1.8.tar.sig"},{"sha1":null,"sha256":"343f36b0f5b98701d4aeac961949 5ad0ef1e3f07102ebea9e8b0824640688dc2","size":10240,"name":"certificate-4c2c249a-e0ef-4c63-9629-a3fe5ff44e0b.tar"},{"sha1":"2c9fc1dc6b47bf4 507c19633519980ed60e3c191","sha256":null,"size":1623162880,"name":"SimpliVity-MVA-Software-revA-5.3.1.8.tar"},{"name":"SimpliVity-MVA-Soft ware-revA-5.3.1.8.sha1","sha256":null,"size":40,"sha1":"5ad4af9be137ab32e4acf3da4dfdb7d1c05c63c9"},{"sha1":"df16b676c8a4eba17f2fa6e7dd9213 397a01b49c","sha256":null,"size":310,"name":"SimpliVity-MVA-Software-revA-5.3.1.8.tar.sig"}],"vendor":null,"hostVersionFileMap":null,"vers ion":"5.3.1.8","platformGeneration":null}]'
2025/08/04 08:42:42 INFO> RunPVCs.pm:83 PreFlight::RunPVCs::run - Response from curl = '{"rootId":"dcfbc706-9794-44a2-8caa-8b45c69adb27"," validations":[{"id":"f377bf27-a23e-4180-a81b-0f3f966f493b","duration_expected":3,"summary":"HPE OmniStack Compatibility with HMS Tests","t ime_start":"","name":"HPE OmniStack Compatibility with HMS Tests","children":null,"details":null,"state":"NOT_RUN","duration_actual":-1},{ "children":null,"summary":"FIPS Compliance Test","time_start":"","name":"FIPS Compliance Test","duration_actual":-1,"state":"NOT_RUN","det ails":null,"id":"791f4331-e3d4-4923-9cb3-2285b7b3c41a","duration_expected":0},{"duration_actual":-1,"state":"NOT_RUN","details":null,"chil dren":null,"time_start":"","summary":"Platform Supportability Test","name":"Platform Supportability Test","id":"727cf6c9-0e08-4867-9160-3f 93950cea36","duration_expected":1},{"duration_expected":1,"id":"150f575b-63db-48a9-946e-d2bcbb5b5d8f","time_start":"","name":"SSH connecti on Check","summary":"SSH connection Check","children":null,"duration_actual":-1,"details":null,"state":"NOT_RUN"},{"state":"NOT_RUN","deta ils":null,"duration_actual":-1,"children":null,"time_start":"","summary":"Arbiter Connection Status Check","name":"Arbiter Connection Stat us Check","id":"7d26f65e-3a66-4666-b2a2-a96d875bb818","duration_expected":3},{"duration_expected":23,"id":"dcfbc706-9794-44a2-8caa-8b45c69 adb27","state":"RUNNING","details":null,"duration_actual":0,"children":["789e2770-74df-4246-a274-169e78d0a597","c3d7bea9-8253-4e27-b229-68 7b0bc8c2b0","330d2eef-80a0-4e2b-857d-27dcb8f50af2","150f575b-63db-48a9-946e-d2bcbb5b5d8f","727cf6c9-0e08-4867-9160-3f93950cea36","9afab0f0 -bec1-40e3-98c3-e890189a9ea2","7d26f65e-3a66-4666-b2a2-a96d875bb818","c5285c18-a385-4c61-bcfa-189bc33199a9"],"name":"Pre-Upgrade Host svt0 1.hasanaltin.local Validation Tests","time_start":"2025-08-04T08:42:42.658Z","summary":"Pre-Upgrade Host svt01.hasanaltin.local Validation Tests"},{"summary":"HPE OmniStack Upgrade Compatibility","time_start":"","name":"HPE OmniStack Upgrade Compatibility","children":null,"du ration_actual":-1,"details":null,"state":"NOT_RUN","duration_expected":3,"id":"19d476c8-3344-4e7f-8cc3-237ae574c187"},{"id":"af0511d3-396a -4e16-832c-a1991980e133","duration_expected":3,"duration_actual":0,"state":"PASSED","details":null,"children":null,"time_start":"2025-08-0 4T08:42:42.658Z","summary":"HPE OmniStack version 5.3.1.8 confirmed for upgrade.","name":"HPE OmniStack Upgrade Available"},{"duration_exp ected":1,"id":"8496dd1b-28c5-4528-a63c-48a05d82d7b5","details":null,"state":"NOT_RUN","duration_actual":-1,"time_start":"","summary":"HPE OmniStack /cfgdb Partition Validation Test","name":"HPE OmniStack /cfgdb Partition Validation Test","children":null},{"id":"9afab0f0-bec1- 40e3-98c3-e890189a9ea2","duration_expected":3,"summary":"Test to Verify the Presence of Compute Nodes","time_start":"","name":"Test to Ver ify the Presence of Compute Nodes","children":null,"details":null,"state":"NOT_RUN","duration_actual":-1},{"details":null,"state":"RUNNING ","duration_actual":-1,"time_start":"2025-08-04T08:42:42.658Z","name":"HPE OmniStack Compatibility with Hypervisor Tests","summary":"HPE O mniStack Compatibility with Hypervisor Tests","children":null,"duration_expected":3,"id":"a23a9cdc-0444-4e1c-b0a4-133a09f4d206"},{"duratio n_expected":1,"id":"330d2eef-80a0-4e2b-857d-27dcb8f50af2","children":null,"name":"Single-Replica Datastores Check","time_start":"","summar y":"Single-Replica Datastores Check","state":"NOT_RUN","details":null,"duration_actual":-1},{"id":"789e2770-74df-4246-a274-169e78d0a597"," duration_expected":13,"details":null,"state":"RUNNING","duration_actual":0,"summary":"HPE OmniStack Pre-Upgrade Validation Tests","time_st art":"2025-08-04T08:42:42.658Z","name":"HPE OmniStack Pre-Upgrade Validation Tests","children":["af0511d3-396a-4e16-832c-a1991980e133","a2 3a9cdc-0444-4e1c-b0a4-133a09f4d206","f377bf27-a23e-4180-a81b-0f3f966f493b","19d476c8-3344-4e7f-8cc3-237ae574c187","791f4331-e3d4-4923-9cb3 -2285b7b3c41a","8496dd1b-28c5-4528-a63c-48a05d82d7b5"]},{"duration_expected":1,"id":"c3d7bea9-8253-4e27-b229-687b0bc8c2b0","duration_actua l":-1,"state":"NOT_RUN","details":null,"children":null,"summary":"Storage Network Status Check","time_start":"","name":"Storage Network St atus Check"},{"duration_expected":0,"id":"c5285c18-a385-4c61-bcfa-189bc33199a9","summary":"HPE SimpliVity Datastores Duplicate Name Check" ,"time_start":"","name":"HPE SimpliVity Datastores Duplicate Name Check","children":null,"duration_actual":-1,"details":null,"state":"NOT_ RUN"}]}'
2025/08/04 08:42:43 INFO> RunPVCs.pm:234 PreFlight::RunPVCs::makeRestRequest - curl command is 'curl' '--silent' '--show-error' '--fail' ' --insecure' '--request' 'GET' '--url' 'http://localhost:46139/upgrade-orchestrator/local/validation' '--header' 'Accept: application/vnd.s implivity.v1+json' '--header' 'X-SSO-Auth 10.100.1.150:baceb8535ff737928017faad3736c36eb75a0757'
2025/08/04 08:42:43 INFO> RunPVCs.pm:83 PreFlight::RunPVCs::run - Response from curl = '{"rootId":"dcfbc706-9794-44a2-8caa-8b45c69adb27"," validations":[{"id":"f377bf27-a23e-4180-a81b-0f3f966f493b","duration_expected":3,"children":null,"summary":"The HPE OmniStack selection is compatible with the HMS.","time_start":"2025-08-04T08:42:42.660Z","name":"HPE OmniStack Compatibility with HMS Tests","state":"PASSED","d etails":null,"duration_actual":21},{"id":"791f4331-e3d4-4923-9cb3-2285b7b3c41a","duration_expected":0,"duration_actual":0,"details":[],"st ate":"SKIPPED","summary":"FIPS is not enabled.","time_start":"2025-08-04T08:42:42.682Z","name":"FIPS Compliance Test","children":null},{"i d":"727cf6c9-0e08-4867-9160-3f93950cea36","duration_expected":1,"children":null,"summary":"The upgrade selection is compatible with the HP E:ProLiant DL325 Gen11 hardware platform.","time_start":"2025-08-04T08:42:43.091Z","name":"Platform Supportability Test","duration_actual" :0,"state":"PASSED","details":null},{"name":"SSH connection Check","time_start":"2025-08-04T08:42:43.030Z","summary":"SSH is enabled for t he host.","children":null,"duration_actual":61,"details":null,"state":"PASSED","id":"150f575b-63db-48a9-946e-d2bcbb5b5d8f","duration_expec ted":1},{"state":"PASSED","details":null,"duration_actual":93,"children":null,"time_start":"2025-08-04T08:42:43.234Z","summary":"Arbiter i s in Connected state, upgrade can proceed.","name":"Arbiter Connection Status Check","duration_expected":3,"id":"7d26f65e-3a66-4666-b2a2-a 96d875bb818"},{"id":"dcfbc706-9794-44a2-8caa-8b45c69adb27","duration_expected":23,"state":"PASSED","details":null,"duration_actual":822,"c hildren":["789e2770-74df-4246-a274-169e78d0a597","c3d7bea9-8253-4e27-b229-687b0bc8c2b0","330d2eef-80a0-4e2b-857d-27dcb8f50af2","150f575b-6 3db-48a9-946e-d2bcbb5b5d8f","727cf6c9-0e08-4867-9160-3f93950cea36","9afab0f0-bec1-40e3-98c3-e890189a9ea2","7d26f65e-3a66-4666-b2a2-a96d875 bb818","c5285c18-a385-4c61-bcfa-189bc33199a9"],"time_start":"2025-08-04T08:42:42.658Z","name":"Pre-Upgrade Host svt01.hasanaltin.local Val idation Tests","summary":"Pre-Upgrade validation tests succeeded."},{"children":null,"name":"HPE OmniStack Upgrade Compatibility","time_st art":"2025-08-04T08:42:42.681Z","summary":"The HPE OmniStack selection 5.3.1.8 is compatible with the current running version 5.2.0.159.", "duration_actual":1,"state":"PASSED","details":null,"id":"19d476c8-3344-4e7f-8cc3-237ae574c187","duration_expected":3},{"duration_expected ":3,"id":"af0511d3-396a-4e16-832c-a1991980e133","state":"PASSED","details":null,"duration_actual":0,"children":null,"summary":"HPE OmniSta ck version 5.3.1.8 confirmed for upgrade.","time_start":"2025-08-04T08:42:42.658Z","name":"HPE OmniStack Upgrade Available"},{"duration_ex pected":1,"id":"8496dd1b-28c5-4528-a63c-48a05d82d7b5","children":null,"name":"HPE OmniStack /cfgdb Partition Validation Test","time_start" :"2025-08-04T08:42:42.682Z","summary":"Usage of /cfgdb partition is under acceptable limits, the upgrade can proceed.","duration_actual":4 ,"state":"PASSED","details":null},{"id":"9afab0f0-bec1-40e3-98c3-e890189a9ea2","duration_expected":3,"state":"PASSED","details":null,"dura tion_actual":143,"children":null,"summary":"No Compute Nodes detected, HPE SimpliVity upgrades can proceed.","time_start":"2025-08-04T08:4 2:43.091Z","name":"Test to Verify the Presence of Compute Nodes"},{"id":"a23a9cdc-0444-4e1c-b0a4-133a09f4d206","duration_expected":3,"dura tion_actual":2,"state":"PASSED","details":null,"children":null,"summary":"The HPE OmniStack selection is compatible with the hypervisor.", "time_start":"2025-08-04T08:42:42.658Z","name":"HPE OmniStack Compatibility with Hypervisor Tests"},{"children":null,"summary":"There are no single-replica datastores to interfere with this upgrade.","time_start":"2025-08-04T08:42:42.868Z","name":"Single-Replica Datastores Ch eck","state":"PASSED","details":["There are no single-replica datastores to interfere with this upgrade."],"duration_actual":162,"id":"330 d2eef-80a0-4e2b-857d-27dcb8f50af2","duration_expected":1},{"children":["af0511d3-396a-4e16-832c-a1991980e133","a23a9cdc-0444-4e1c-b0a4-133 a09f4d206","f377bf27-a23e-4180-a81b-0f3f966f493b","19d476c8-3344-4e7f-8cc3-237ae574c187","791f4331-e3d4-4923-9cb3-2285b7b3c41a","8496dd1b- 28c5-4528-a63c-48a05d82d7b5"],"time_start":"2025-08-04T08:42:42.658Z","summary":"The HPE OmniStack upgrade can proceed.","name":"HPE OmniS tack Pre-Upgrade Validation Tests","duration_actual":28,"state":"PASSED","details":null,"duration_expected":13,"id":"789e2770-74df-4246-a2 74-169e78d0a597"},{"id":"c3d7bea9-8253-4e27-b229-687b0bc8c2b0","duration_expected":1,"time_start":"2025-08-04T08:42:42.686Z","summary":"Th e current node is able to communicate with all storage IPs in the cluster.","name":"Storage Network Status Check","children":null,"details ":null,"state":"PASSED","duration_actual":182},{"id":"c5285c18-a385-4c61-bcfa-189bc33199a9","duration_expected":0,"children":null,"time_st art":"2025-08-04T08:42:43.327Z","name":"HPE SimpliVity Datastores Duplicate Name Check","summary":"No duplicate HPE SimpliVity datastore n ames found.","duration_actual":153,"state":"PASSED","details":null}]}'
2025/08/04 08:42:43 INFO> RunPVCs.pm:111 PreFlight::RunPVCs::run - All PVC tests passed:
{
"ALL" : "PASSED",
"PASSED" : [
"HPE OmniStack Compatibility with HMS Tests",
"Platform Supportability Test",
"SSH connection Check",
"Arbiter Connection Status Check",
"HPE OmniStack Upgrade Compatibility",
"HPE OmniStack Upgrade Available",
"HPE OmniStack /cfgdb Partition Validation Test",
"Test to Verify the Presence of Compute Nodes",
"HPE OmniStack Compatibility with Hypervisor Tests",
"Single-Replica Datastores Check",
"HPE OmniStack Pre-Upgrade Validation Tests",
"Storage Network Status Check",
"HPE SimpliVity Datastores Duplicate Name Check"
],
"SKIPPED" : [
"FIPS Compliance Test"
]
}
2025/08/04 08:42:43 INFO> PreflightPostflight.pm:44 Common::PreflightPostflight::printSuccess - +Passed+ Run all PreValidation Checks (PV Cs)
2025/08/04 08:42:43 INFO> SvtControl.pm:80 Util::SvtControl::init_client - Connecting to SVTFS Control interface 10.100.1.53:9190
2025/08/04 08:42:43 INFO> SvtControl.pm:88 Util::SvtControl::disconnect - Disconnecting from SVTFS Control interface 10.100.1.53:9190
2025/08/04 08:42:43 INFO> CheckClusterUpgrade.pm:290 PreFlight::CheckClusterUpgrade::applyClusterStatusToNodeMap - Found cluster for OmniS tackVC-10-100-1-54: $VAR1 = bless( {
'drsVmotionRate' => 0,
'hostInfoList' => undef,
'drsEnabled' => '',
'hmsId' => '32277902-7898-4a12-8818-f6224c1b6f75:ClusterComputeResource:domain-c9',
'dpmEnabled' => '',
'configStatus' => undef,
'name' => 'SVT-Cluster'
}, 'hyperproxy::RPC::ClusterSettings' );
2025/08/04 08:42:43 INFO> CheckClusterUpgrade.pm:290 PreFlight::CheckClusterUpgrade::applyClusterStatusToNodeMap - Found cluster for OmniS tackVC-10-100-1-53: $VAR1 = bless( {
'hostInfoList' => undef,
'drsEnabled' => '',
'hmsId' => '32277902-7898-4a12-8818-f6224c1b6f75:ClusterComputeResource:domain-c9',
'drsVmotionRate' => 0,
'configStatus' => undef,
'name' => 'SVT-Cluster',
'dpmEnabled' => ''
}, 'hyperproxy::RPC::ClusterSettings' );
2025/08/04 08:42:43 INFO> CheckClusterUpgrade.pm:332 PreFlight::CheckClusterUpgrade::printNodeToClusterMapStatusToInfoLog -
.------------------------------------------------------------------------------------------------------------------------.
| State of DC -> Cluster -> FD mapping for upgrade |
+-------------------------+------------------------+--------------------------------------+----------------+-------------+
| OmniCube VC Name | Host Name | FD ID | DC Name | CL Name |
+-------------------------+------------------------+--------------------------------------+----------------+-------------+
| OmniStackVC-10-100-1-54 | svt02.hasanaltin.local | 4c2c249a-e0ef-4c63-9629-a3fe5ff44e0b | SVT-Datacenter | SVT-Cluster |
| OmniStackVC-10-100-1-53 | svt01.hasanaltin.local | 4c2c249a-e0ef-4c63-9629-a3fe5ff44e0b | SVT-Datacenter | SVT-Cluster |
'-------------------------+------------------------+--------------------------------------+----------------+-------------'
2025/08/04 08:42:43 INFO> CheckClusterUpgrade.pm:163 PreFlight::CheckClusterUpgrade::run - FD to Cluster ratio 1:1. Passed
2025/08/04 08:42:43 INFO> PreflightPostflight.pm:44 Common::PreflightPostflight::printSuccess - +Passed+ Verify Node Compute Cluster Depl oyment
2025/08/04 08:42:43 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 100% through step 3 (Running the pre-validation checks): 100% of to tal
2025/08/04 08:42:43 INFO> Statusfile.pm:176 Util::Statusfile::complete - Pre upgrade validations successful
2025/08/04 08:42:43 INFO> Common.pm:166 Util::Common::Exit - /scratch/upgrade/preflight.pl exiting, requested exit code is 0
2025/08/04 08:42:45 WARN> upgrade.pl:139 Upgrade::clean_fds - skip 0 : lr-x------ 1 root root 64 Aug 4 08:42 /proc/364294/fd/0 -> pipe: [88606735]
2025/08/04 08:42:45 WARN> upgrade.pl:139 Upgrade::clean_fds - skip 1 : lrwx------ 1 root root 64 Aug 4 08:42 /proc/364294/fd/1 -> /tmp/ PerlIO_EkvlJK (deleted)
2025/08/04 08:42:45 WARN> upgrade.pl:139 Upgrade::clean_fds - skip 2 : lrwx------ 1 root root 64 Aug 4 08:42 /proc/364294/fd/2 -> /tmp/ PerlIO_5zfhW7 (deleted)
2025/08/04 08:42:45 INFO> upgrade.pl:148 Upgrade::main - Staring upgrade.pl with --install
2025/08/04 08:42:45 INFO> upgrade.pl:276 Upgrade::logUpgradePhase - Calling install with 4c2c249a-e0ef-4c63-9629-a3fe5ff44e0b /mnt/svtfs/0 /8e8670dc-557a-4f52-8150-1e23a987302f/.svtupgrade
2025/08/04 08:42:46 INFO> ClusterFedData.pm:49 Util::ClusterFedData::getActviteUpgradeTaskHash - dsv-task-get-active output:: <CommandResu lt>
<task>
<taskReturnInfo></taskReturnInfo>
<percent>55</percent>
<taskType>com.simplivity.task.software.upgrade</taskType>
<taskName></taskName>
<monitoredSubTasks></monitoredSubTasks>
<ownerId>4234e0be-1ca9-20ca-1706-020271a4083e</ownerId>
<destId>42343f04-c7ca-52e6-c769-0cb7c2c160be</destId>
<parentId>2c0aecf7-90d3-40cd-b486-1bc066a995a4</parentId>
<state>0</state>
<startTime>1754296884</startTime>
<errorCode>0</errorCode>
<destName>OmniStackVC-10-100-1-53</destName>
<endTime>0</endTime>
<taskId>b7dc8495-f638-45e9-b151-4dc50941e245</taskId>
</task>
</CommandResult>
2025/08/04 08:42:46 INFO> StateMachine.pm:29 Util::StateMachine::Factory - Returning Partition-based state machine instance
2025/08/04 08:42:46 INFO> Partition.pm:73 Util::StateMachine::Partition::init - At init, the current state is Committed
2025/08/04 08:42:46 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /
2025/08/04 08:42:47 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/" UUID="0208a1c0-b09a-4a93-a42a-6 5601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:42:47 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /dormant
2025/08/04 08:42:47 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/dormant" UUID="cef841ad-ef40-4fa6 -9eec-7fcf756b4327" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:42:47 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:42:47 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:42:47 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 0% through step 1 (Preparing HPE OmniStack for upgrade): 0% of tota l
2025/08/04 08:42:47 INFO> Software.pm:264 UpgradeTypes::Software::install - Installing upgrade
2025/08/04 08:42:47 DEBUG> StateMachine.pm:112 Util::StateMachine::do - Current state is Committed, attempting transition Install
2025/08/04 08:42:47 DEBUG> StateMachine.pm:123 Util::StateMachine::do - Going to state Staged
2025/08/04 08:42:47 INFO> Partition.pm:121 Util::StateMachine::Partition::formatByLabel - Formatting /dormant with new label /upgrade
2025/08/04 08:42:47 DEBUG> Partition.pm:187 Util::StateMachine::Partition::triggerUdevRefresh - Triggering udev refresh of sda4
2025/08/04 08:42:47 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /
2025/08/04 08:42:47 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/" UUID="0208a1c0-b09a-4a93-a42a-6 5601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:42:47 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:42:47 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /upgrade
2025/08/04 08:42:47 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/upgrade" UUID="47e83690-e17b-46ce -ba1e-c6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:42:47 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:42:47 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 0% through step 2 (Unpacking HPE OmniStack software): 5% of total
2025/08/04 08:42:47 INFO> Software.pm:2573 UpgradeTypes::Software::mountByLabel - Mounting /upgrade (ext4) to /tmp/Bk6Q7GoGQM
2025/08/04 08:42:47 INFO> Software.pm:167 UpgradeTypes::Software::installToPartition - Unpacking new software image to /upgrade partition (/tmp/Bk6Q7GoGQM)
2025/08/04 08:42:55 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 5% through step 2 (Unpacking HPE OmniStack software): 9% of total
2025/08/04 08:43:00 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 11% through step 2 (Unpacking HPE OmniStack software): 14% of total
2025/08/04 08:43:05 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 18% through step 2 (Unpacking HPE OmniStack software): 20% of total
2025/08/04 08:43:10 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 24% through step 2 (Unpacking HPE OmniStack software): 25% of total
2025/08/04 08:43:15 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 31% through step 2 (Unpacking HPE OmniStack software): 32% of total
2025/08/04 08:43:20 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 38% through step 2 (Unpacking HPE OmniStack software): 38% of total
2025/08/04 08:43:25 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 45% through step 2 (Unpacking HPE OmniStack software): 43% of total
2025/08/04 08:43:30 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 52% through step 2 (Unpacking HPE OmniStack software): 49% of total
2025/08/04 08:43:35 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 59% through step 2 (Unpacking HPE OmniStack software): 56% of total
2025/08/04 08:43:40 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 66% through step 2 (Unpacking HPE OmniStack software): 61% of total
2025/08/04 08:43:45 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 72% through step 2 (Unpacking HPE OmniStack software): 67% of total
2025/08/04 08:43:50 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 79% through step 2 (Unpacking HPE OmniStack software): 72% of total
2025/08/04 08:43:55 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 82% through step 2 (Unpacking HPE OmniStack software): 74% of total
2025/08/04 08:44:00 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 84% through step 2 (Unpacking HPE OmniStack software): 76% of total
2025/08/04 08:44:05 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 86% through step 2 (Unpacking HPE OmniStack software): 78% of total
2025/08/04 08:44:10 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 89% through step 2 (Unpacking HPE OmniStack software): 80% of total
2025/08/04 08:44:15 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 91% through step 2 (Unpacking HPE OmniStack software): 83% of total
2025/08/04 08:44:20 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 94% through step 2 (Unpacking HPE OmniStack software): 85% of total
2025/08/04 08:44:25 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 96% through step 2 (Unpacking HPE OmniStack software): 87% of total
2025/08/04 08:44:30 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 100% through step 2 (Unpacking HPE OmniStack software): 90% of tota l
2025/08/04 08:44:35 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/DwV27pXMU8
2025/08/04 08:44:36 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 0% through step 3 (Configuring HPE OmniStack software): 90% of tota l
2025/08/04 08:44:36 INFO> Software.pm:2729 UpgradeTypes::Software::setupChroot - Setting up chroot for /tmp/Bk6Q7GoGQM
2025/08/04 08:44:36 INFO> Software.pm:2841 UpgradeTypes::Software::getChrootKernelVersion - Detected next kernel version: 6.8.0-51-generic
2025/08/04 08:44:36 DEBUG> Software.pm:2965 UpgradeTypes::Software::_chmod - [chmod] 493 /tmp/Bk6Q7GoGQM/bin/uname
2025/08/04 08:44:36 DEBUG> Software.pm:2965 UpgradeTypes::Software::_chmod - [chmod] 493 /tmp/Bk6Q7GoGQM/sbin/depmod
2025/08/04 08:44:36 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 10% through step 3 (Configuring HPE OmniStack software): 91% of tot al
2025/08/04 08:44:36 INFO> Software.pm:295 UpgradeTypes::Software::install -
2025/08/04 08:44:36 INFO> Software.pm:301 UpgradeTypes::Software::install - Copying existing postgresql 14 configuration to the new image
2025/08/04 08:44:36 INFO> Software.pm:310 UpgradeTypes::Software::install - Initializing postgresql cluster
2025/08/04 08:44:36 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 20% through step 3 (Configuring HPE OmniStack software): 92% of tot al
2025/08/04 08:44:36 INFO> Software.pm:317 UpgradeTypes::Software::install - [Info] PostgreSQL: Removing unrelated cluster main (10)
[Info] PostgreSQL: Removing unrelated cluster main (14)
[Info] PostgreSQL: Found down svtfs 14 cluster
[Info] PostgreSQL: Configuring options for svtfs cluster
Cluster svtfs configuration done.
2025/08/04 08:44:36 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 30% through step 3 (Configuring HPE OmniStack software): 93% of tot al
2025/08/04 08:44:36 INFO> Software.pm:323 UpgradeTypes::Software::install - Linking to correct objectstore library
2025/08/04 08:44:36 DEBUG> Base.pm:296 UpgradeTypes::Base::_symlink - symlink target: objectstore/libobjectstore-small-index.so name: libo bjectstore.so
2025/08/04 08:44:36 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 40% through step 3 (Configuring HPE OmniStack software): 94% of tot al
2025/08/04 08:44:36 INFO> Software.pm:366 UpgradeTypes::Software::install - Preserving password for svtcli
2025/08/04 08:44:36 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 50% through step 3 (Configuring HPE OmniStack software): 95% of tot al
2025/08/04 08:44:36 INFO> Base.pm:326 UpgradeTypes::Base::preserveFile - Preserving file /etc/udev/rules.d/70-persistent-net.rules to /tmp /Bk6Q7GoGQM//etc/udev/rules.d/70-persistent-net.rules
2025/08/04 08:44:36 INFO> Base.pm:326 UpgradeTypes::Base::preserveFile - Preserving file /etc/hosts to /tmp/Bk6Q7GoGQM//etc/hosts
2025/08/04 08:44:36 DEBUG> Base.pm:296 UpgradeTypes::Base::_symlink - symlink target: /mnt/etc/hosts name: hosts
2025/08/04 08:44:36 INFO> Base.pm:326 UpgradeTypes::Base::preserveFile - Preserving file /etc/nsswitch.conf to /tmp/Bk6Q7GoGQM//etc/nsswit ch.conf
2025/08/04 08:44:36 DEBUG> Base.pm:296 UpgradeTypes::Base::_symlink - symlink target: /mnt/etc/nsswitch.conf name: nsswitch.conf
2025/08/04 08:44:36 INFO> Base.pm:326 UpgradeTypes::Base::preserveFile - Preserving file /etc/machine-id to /tmp/Bk6Q7GoGQM//etc/machine-i d
2025/08/04 08:44:36 INFO> Base.pm:326 UpgradeTypes::Base::preserveFile - Preserving file /roroot/etc/fstab to /tmp/Bk6Q7GoGQM/etc/fstab
2025/08/04 08:44:36 DEBUG> Software.pm:647 UpgradeTypes::Software::__ANON__ - Resetting /tmp/Bk6Q7GoGQM/etc/fstab line: LABEL=/cfgdb /c fgdb ext4 defaults,nofail,x-systemd.device-timeout=190,x-systemd.requires=svt-mount.service 0 0
2025/08/04 08:44:36 DEBUG> Software.pm:647 UpgradeTypes::Software::__ANON__ - Resetting /tmp/Bk6Q7GoGQM/etc/fstab line: LABEL=/ctrdb /c trdb ext4 defaults,nofail,x-systemd.device-timeout=190,x-systemd.requires=svt-mount.service 0 0
2025/08/04 08:44:36 DEBUG> Software.pm:647 UpgradeTypes::Software::__ANON__ - Resetting /tmp/Bk6Q7GoGQM/etc/fstab line: LABEL=/pico /p ico ext4 defaults,nofail,x-systemd.device-timeout=190,x-systemd.requires=svt-mount.service 0 0
2025/08/04 08:44:36 INFO> Base.pm:326 UpgradeTypes::Base::preserveFile - Preserving file /var/tmp/build/etc/version.yaml to /scratch/upgra de
2025/08/04 08:44:36 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 60% through step 3 (Configuring HPE OmniStack software): 96% of tot al
2025/08/04 08:44:36 INFO> Base.pm:326 UpgradeTypes::Base::preserveFile - Preserving file /roroot/etc/ssh/ssh_host_dsa_key to /tmp/Bk6Q7GoG QM/etc/ssh/ssh_host_dsa_key
2025/08/04 08:44:36 INFO> Base.pm:326 UpgradeTypes::Base::preserveFile - Preserving file /roroot/etc/ssh/ssh_host_dsa_key.pub to /tmp/Bk6Q 7GoGQM/etc/ssh/ssh_host_dsa_key.pub
2025/08/04 08:44:36 INFO> Base.pm:326 UpgradeTypes::Base::preserveFile - Preserving file /roroot/etc/ssh/ssh_host_ecdsa_key to /tmp/Bk6Q7G oGQM/etc/ssh/ssh_host_ecdsa_key
2025/08/04 08:44:36 INFO> Base.pm:326 UpgradeTypes::Base::preserveFile - Preserving file /roroot/etc/ssh/ssh_host_ecdsa_key.pub to /tmp/Bk 6Q7GoGQM/etc/ssh/ssh_host_ecdsa_key.pub
2025/08/04 08:44:36 INFO> Base.pm:326 UpgradeTypes::Base::preserveFile - Preserving file /roroot/etc/ssh/ssh_host_ed25519_key to /tmp/Bk6Q 7GoGQM/etc/ssh/ssh_host_ed25519_key
2025/08/04 08:44:36 INFO> Base.pm:326 UpgradeTypes::Base::preserveFile - Preserving file /roroot/etc/ssh/ssh_host_ed25519_key.pub to /tmp/ Bk6Q7GoGQM/etc/ssh/ssh_host_ed25519_key.pub
2025/08/04 08:44:36 INFO> Base.pm:326 UpgradeTypes::Base::preserveFile - Preserving file /roroot/etc/ssh/ssh_host_rsa_key to /tmp/Bk6Q7GoG QM/etc/ssh/ssh_host_rsa_key
2025/08/04 08:44:36 INFO> Base.pm:326 UpgradeTypes::Base::preserveFile - Preserving file /roroot/etc/ssh/ssh_host_rsa_key.pub to /tmp/Bk6Q 7GoGQM/etc/ssh/ssh_host_rsa_key.pub
2025/08/04 08:44:36 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 65% through step 3 (Configuring HPE OmniStack software): 97% of tot al
2025/08/04 08:44:36 INFO> Software.pm:2984 UpgradeTypes::Software::copyNewPersistentFiles - /mnt/.ssh/known_hosts is already persistent in /mnt
2025/08/04 08:44:36 INFO> Software.pm:2984 UpgradeTypes::Software::copyNewPersistentFiles - /mnt/etc/hostname is already persistent in /mn t
2025/08/04 08:44:36 INFO> Software.pm:2984 UpgradeTypes::Software::copyNewPersistentFiles - /mnt/etc/resolv.conf is already persistent in /mnt
2025/08/04 08:44:36 INFO> Software.pm:2984 UpgradeTypes::Software::copyNewPersistentFiles - /mnt/etc/hosts is already persistent in /mnt
2025/08/04 08:44:36 INFO> Software.pm:2984 UpgradeTypes::Software::copyNewPersistentFiles - /mnt/etc/nsswitch.conf is already persistent i n /mnt
2025/08/04 08:44:36 INFO> Software.pm:2984 UpgradeTypes::Software::copyNewPersistentFiles - /mnt/etc/ntp.conf is already persistent in /mn t
2025/08/04 08:44:36 INFO> Software.pm:2984 UpgradeTypes::Software::copyNewPersistentFiles - /mnt/etc/rsyslog.d/50-default.conf is already persistent in /mnt
2025/08/04 08:44:36 INFO> Software.pm:2984 UpgradeTypes::Software::copyNewPersistentFiles - /mnt/etc/network/interfaces is already persist ent in /mnt
2025/08/04 08:44:36 INFO> Software.pm:2984 UpgradeTypes::Software::copyNewPersistentFiles - /mnt/etc/ssh/sshd_config is already persistent in /mnt
2025/08/04 08:44:36 INFO> Software.pm:2984 UpgradeTypes::Software::copyNewPersistentFiles - /mnt/etc/default/locale is already persistent in /mnt
2025/08/04 08:44:36 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 70% through step 3 (Configuring HPE OmniStack software): 97% of tot al
2025/08/04 08:44:36 INFO> Software.pm:472 UpgradeTypes::Software::install - Backing up deploy log /root/firstboot.log to /var/log/svt-depl oy/
2025/08/04 08:44:36 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 80% through step 3 (Configuring HPE OmniStack software): 98% of tot al
2025/08/04 08:44:36 INFO> Software.pm:482 UpgradeTypes::Software::install - Updating nginx config file
2025/08/04 08:44:36 INFO> Software.pm:1964 UpgradeTypes::Software::versionSpecificInstall - Running install for version-specific plugin Ve rsionSpecific::ConfigureRda
2025/08/04 08:44:36 INFO> ConfigureRda.pm:70 VersionSpecific::ConfigureRda::install - Running VersionSpecific ConfigureRda
2025/08/04 08:44:36 INFO> Software.pm:1964 UpgradeTypes::Software::versionSpecificInstall - Running install for version-specific plugin Ve rsionSpecific::Mva
2025/08/04 08:44:36 INFO> Mva.pm:126 VersionSpecific::Mva::install - Extract and Validate /mnt/svtfs/0/8e8670dc-557a-4f52-8150-1e23a987302 f/.svtupgrade/SimpliVity-MVA-Software-revA-5.3.1.8.tar into /mva/next folder
2025/08/04 08:44:37 INFO> copyvalidate.pl:300 CopyValidate::main - Copy and validate /mnt/svtfs/0/8e8670dc-557a-4f52-8150-1e23a987302f/.sv tupgrade/SimpliVity-MVA-Software-revA-5.3.1.8.tar via 'tar xif {FIFO} -C /mva/next'
2025/08/04 08:44:37 INFO> copyvalidate.pl:324 CopyValidate::main - Setting up FIFO /tmp/copyvalidate-364714//sha1sum.fifo
2025/08/04 08:44:37 INFO> copyvalidate.pl:324 CopyValidate::main - Setting up FIFO /tmp/copyvalidate-364714//tar.fifo
2025/08/04 08:44:37 INFO> copyvalidate.pl:347 CopyValidate::main - Started sha1sum with PID 364717 (sha1sum /tmp/copyvalidate-364714//sha1 sum.fifo >/tmp/copyvalidate-364714//sha1sum.stdout 2>/tmp/copyvalidate-364714//sha1sum.stderr)
2025/08/04 08:44:37 INFO> copyvalidate.pl:347 CopyValidate::main - Started tar with PID 364718 (tar xif /tmp/copyvalidate-364714//tar.fifo -C /mva/next >/tmp/copyvalidate-364714//tar.stdout 2>/tmp/copyvalidate-364714//tar.stderr)
2025/08/04 08:44:37 INFO> copyvalidate.pl:398 CopyValidate::main - Waiting to retry the open for tar, sha1sum
2025/08/04 08:44:38 INFO> copyvalidate.pl:377 CopyValidate::main - Opened FIFO /tmp/copyvalidate-364714//tar.fifo
2025/08/04 08:44:38 INFO> copyvalidate.pl:377 CopyValidate::main - Opened FIFO /tmp/copyvalidate-364714//sha1sum.fifo
2025/08/04 08:44:38 INFO> copyvalidate.pl:413 CopyValidate::main - Reading /mnt/svtfs/0/8e8670dc-557a-4f52-8150-1e23a987302f/.svtupgrade/S impliVity-MVA-Software-revA-5.3.1.8.tar from disk
2025/08/04 08:44:38 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 0% processed (0/1623162880) after 1s
2025/08/04 08:44:39 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 2% processed (32473088/1623162880) after 2s
2025/08/04 08:44:39 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 3% processed (48726016/1623162880) after 2s
2025/08/04 08:44:40 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 4% processed (64946176/1623162880) after 3s
2025/08/04 08:44:40 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 5% processed (81166336/1623162880) after 3s
2025/08/04 08:44:40 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 6% processed (97419264/1623162880) after 3s
2025/08/04 08:44:41 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 7% processed (113639424/1623162880) after 4s
2025/08/04 08:44:42 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 8% processed (129859584/1623162880) after 5s
2025/08/04 08:44:42 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 9% processed (146112512/1623162880) after 5s
2025/08/04 08:44:42 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 10% processed (162332672/1623162880) after 5s
2025/08/04 08:44:43 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 11% processed (178552832/1623162880) after 6s
2025/08/04 08:44:43 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 12% processed (194805760/1623162880) after 6s
2025/08/04 08:44:44 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 13% processed (211025920/1623162880) after 7s
2025/08/04 08:44:44 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 14% processed (227246080/1623162880) after 7s
2025/08/04 08:44:44 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 15% processed (243499008/1623162880) after 7s
2025/08/04 08:44:45 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 16% processed (259719168/1623162880) after 8s
2025/08/04 08:44:45 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 17% processed (275939328/1623162880) after 8s
2025/08/04 08:44:45 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 18% processed (292192256/1623162880) after 8s
2025/08/04 08:44:46 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 19% processed (308412416/1623162880) after 9s
2025/08/04 08:44:46 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 20% processed (324632576/1623162880) after 9s
2025/08/04 08:44:47 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 21% processed (340885504/1623162880) after 10s
2025/08/04 08:44:47 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 22% processed (357105664/1623162880) after 10s
2025/08/04 08:44:48 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 23% processed (373358592/1623162880) after 11s
2025/08/04 08:44:48 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 24% processed (389578752/1623162880) after 11s
2025/08/04 08:44:48 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 25% processed (405798912/1623162880) after 11s
2025/08/04 08:44:49 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 26% processed (422051840/1623162880) after 12s
2025/08/04 08:44:49 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 27% processed (438272000/1623162880) after 12s
2025/08/04 08:44:50 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 28% processed (454492160/1623162880) after 13s
2025/08/04 08:44:50 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 29% processed (470745088/1623162880) after 13s
2025/08/04 08:44:50 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 30% processed (486965248/1623162880) after 13s
2025/08/04 08:44:51 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 31% processed (503185408/1623162880) after 14s
2025/08/04 08:44:51 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 32% processed (519438336/1623162880) after 14s
2025/08/04 08:44:52 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 33% processed (535658496/1623162880) after 15s
2025/08/04 08:44:52 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 34% processed (551878656/1623162880) after 15s
2025/08/04 08:44:52 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 35% processed (568131584/1623162880) after 15s
2025/08/04 08:44:53 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 36% processed (584351744/1623162880) after 16s
2025/08/04 08:44:53 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 37% processed (600571904/1623162880) after 16s
2025/08/04 08:44:53 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 38% processed (616824832/1623162880) after 16s
2025/08/04 08:44:54 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 39% processed (633044992/1623162880) after 17s
2025/08/04 08:44:54 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 40% processed (649265152/1623162880) after 17s
2025/08/04 08:44:55 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 41% processed (665518080/1623162880) after 18s
2025/08/04 08:44:55 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 42% processed (681738240/1623162880) after 18s
2025/08/04 08:44:56 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 43% processed (697991168/1623162880) after 19s
2025/08/04 08:44:56 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 44% processed (714211328/1623162880) after 19s
2025/08/04 08:44:57 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 45% processed (730431488/1623162880) after 20s
2025/08/04 08:44:57 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 46% processed (746684416/1623162880) after 20s
2025/08/04 08:44:58 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 47% processed (762904576/1623162880) after 21s
2025/08/04 08:44:58 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 48% processed (779124736/1623162880) after 21s
2025/08/04 08:44:59 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 49% processed (795377664/1623162880) after 22s
2025/08/04 08:44:59 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 50% processed (811597824/1623162880) after 22s
2025/08/04 08:45:00 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 51% processed (827817984/1623162880) after 23s
2025/08/04 08:45:01 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 52% processed (844070912/1623162880) after 24s
2025/08/04 08:45:02 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 53% processed (860291072/1623162880) after 25s
2025/08/04 08:45:02 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 54% processed (876511232/1623162880) after 25s
2025/08/04 08:45:03 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 55% processed (892764160/1623162880) after 26s
2025/08/04 08:45:03 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 56% processed (908984320/1623162880) after 26s
2025/08/04 08:45:04 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 57% processed (925204480/1623162880) after 27s
2025/08/04 08:45:05 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 58% processed (941457408/1623162880) after 28s
2025/08/04 08:45:06 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 59% processed (957677568/1623162880) after 29s
2025/08/04 08:45:07 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 60% processed (973897728/1623162880) after 30s
2025/08/04 08:45:07 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 61% processed (990150656/1623162880) after 30s
2025/08/04 08:45:08 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 62% processed (1006370816/1623162880) after 31s
2025/08/04 08:45:08 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 63% processed (1022623744/1623162880) after 31s
2025/08/04 08:45:09 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 64% processed (1038843904/1623162880) after 32s
2025/08/04 08:45:10 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 65% processed (1055064064/1623162880) after 33s
2025/08/04 08:45:10 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 66% processed (1071316992/1623162880) after 33s
2025/08/04 08:45:11 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 67% processed (1087537152/1623162880) after 34s
2025/08/04 08:45:12 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 68% processed (1103757312/1623162880) after 35s
2025/08/04 08:45:12 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 69% processed (1120010240/1623162880) after 35s
2025/08/04 08:45:13 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 70% processed (1136230400/1623162880) after 36s
2025/08/04 08:45:13 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 71% processed (1152450560/1623162880) after 36s
2025/08/04 08:45:14 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 72% processed (1168703488/1623162880) after 37s
2025/08/04 08:45:14 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 73% processed (1184923648/1623162880) after 37s
2025/08/04 08:45:15 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 74% processed (1201143808/1623162880) after 38s
2025/08/04 08:45:15 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 75% processed (1217396736/1623162880) after 38s
2025/08/04 08:45:16 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 76% processed (1233616896/1623162880) after 39s
2025/08/04 08:45:16 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 77% processed (1249837056/1623162880) after 39s
2025/08/04 08:45:17 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 78% processed (1266089984/1623162880) after 40s
2025/08/04 08:45:17 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 79% processed (1282310144/1623162880) after 40s
2025/08/04 08:45:18 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 80% processed (1298530304/1623162880) after 41s
2025/08/04 08:45:18 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 81% processed (1314783232/1623162880) after 41s
2025/08/04 08:45:18 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 82% processed (1331003392/1623162880) after 41s
2025/08/04 08:45:19 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 83% processed (1347256320/1623162880) after 42s
2025/08/04 08:45:19 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 84% processed (1363476480/1623162880) after 42s
2025/08/04 08:45:20 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 85% processed (1379696640/1623162880) after 43s
2025/08/04 08:45:20 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 86% processed (1395949568/1623162880) after 43s
2025/08/04 08:45:21 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 87% processed (1412169728/1623162880) after 44s
2025/08/04 08:45:21 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 88% processed (1428389888/1623162880) after 44s
2025/08/04 08:45:21 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 89% processed (1444642816/1623162880) after 44s
2025/08/04 08:45:22 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 90% processed (1460862976/1623162880) after 45s
2025/08/04 08:45:22 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 91% processed (1477083136/1623162880) after 45s
2025/08/04 08:45:23 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 92% processed (1493336064/1623162880) after 46s
2025/08/04 08:45:23 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 93% processed (1509556224/1623162880) after 46s
2025/08/04 08:45:23 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 94% processed (1525776384/1623162880) after 46s
2025/08/04 08:45:24 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 95% processed (1542029312/1623162880) after 47s
2025/08/04 08:45:24 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 96% processed (1558249472/1623162880) after 47s
2025/08/04 08:45:25 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 97% processed (1574469632/1623162880) after 48s
2025/08/04 08:45:25 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 98% processed (1590722560/1623162880) after 48s
2025/08/04 08:45:26 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 99% processed (1606942720/1623162880) after 49s
2025/08/04 08:45:26 INFO> Statusfile.pm:209 Util::Statusfile::reportPercentage - 100% processed (1623162880/1623162880) after 49s
2025/08/04 08:45:26 INFO> copyvalidate.pl:461 CopyValidate::main - Read from disk completed in s
2025/08/04 08:45:26 INFO> copyvalidate.pl:479 CopyValidate::main - sha1sum (364717) returned 0
2025/08/04 08:45:26 INFO> copyvalidate.pl:479 CopyValidate::main - tar (364718) returned 0
2025/08/04 08:45:26 INFO> copyvalidate.pl:540 CopyValidate::main - /mnt/svtfs/0/8e8670dc-557a-4f52-8150-1e23a987302f/.svtupgrade/SimpliVit y-MVA-Software-revA-5.3.1.8.tar is copied and validated successfully
2025/08/04 08:45:26 INFO> Statusfile.pm:176 Util::Statusfile::complete - Successfully validated and extracted the HPE OmniStack bundle
2025/08/04 08:45:26 INFO> Common.pm:166 Util::Common::Exit - /var/tmp/build/os/copyvalidate.pl exiting, requested exit code is 0
2025/08/04 08:45:26 INFO> Mva.pm:135 VersionSpecific::Mva::install - Validate the Extracted MVA ISO file /mva/next/mva-2204-base-5.3.1.8-r elease.iso
2025/08/04 08:45:29 INFO> Mva.pm:204 VersionSpecific::Mva::validateExtractedPackage - Computed digest from sha1 file: 2c3f13053b10a193011a 981dab09b6c221ad115d
2025/08/04 08:45:29 INFO> Mva.pm:205 VersionSpecific::Mva::validateExtractedPackage - Generated digest from ISO file: 2c3f13053b10a193011a 981dab09b6c221ad115d
2025/08/04 08:45:29 INFO> Mva.pm:210 VersionSpecific::Mva::validateExtractedPackage - MVA ISO file /mva/next/mva-2204-base-5.3.1.8-release .iso Validated Successfully
2025/08/04 08:45:29 INFO> Software.pm:492 UpgradeTypes::Software::install - Creating file /scratch/upgrade/rdaoptin
2025/08/04 08:45:29 INFO> Software.pm:518 UpgradeTypes::Software::install - Value of /PhoneHome/RDA/Enabled : 1, archive for rollback.
2025/08/04 08:45:29 INFO> Software.pm:536 UpgradeTypes::Software::install - Value of /PhoneHome/RDA/HBEnabled : 1, archive for rollback.
2025/08/04 08:45:29 INFO> Software.pm:555 UpgradeTypes::Software::install - Value of /PhoneHome/RDA/AhsFile : 1, archive for rollback.
2025/08/04 08:45:29 INFO> InitService.pm:71 Utils::InitService::init - Service amqp-broker is start/running (PID 1432)
2025/08/04 08:45:29 INFO> InitService.pm:396 Utils::InitService::stop - Stopping amqp-broker
2025/08/04 08:45:29 DEBUG> InitService.pm:231 Utils::InitService::startBackground - Spawned command '/bin/systemctl stop amqp-broker' with PID 364852
2025/08/04 08:45:34 DEBUG> InitService.pm:265 Utils::InitService::waitForBackground - Background command '/bin/systemctl stop amqp-broker' has completed (0)
2025/08/04 08:45:34 INFO> InitService.pm:430 Utils::InitService::waitForShutdown - Service amqp-broker is stop/waiting
2025/08/04 08:45:34 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 90% through step 3 (Configuring HPE OmniStack software): 99% of tot al
2025/08/04 08:45:35 INFO> Software.pm:2938 UpgradeTypes::Software::cleanAllChroots - Cleaning chroot for /tmp/Bk6Q7GoGQM
2025/08/04 08:45:35 INFO> Software.pm:2912 UpgradeTypes::Software::restoreChrootWrappers - Restoring chroot wrapper for /sbin/depmod in /t mp/Bk6Q7GoGQM
2025/08/04 08:45:35 INFO> Software.pm:2912 UpgradeTypes::Software::restoreChrootWrappers - Restoring chroot wrapper for /bin/uname in /tmp /Bk6Q7GoGQM
2025/08/04 08:45:35 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/Bk6Q7GoGQM/dev/pts
2025/08/04 08:45:35 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/Bk6Q7GoGQM/sys
2025/08/04 08:45:35 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/Bk6Q7GoGQM/proc
2025/08/04 08:45:35 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/Bk6Q7GoGQM/dev
2025/08/04 08:45:35 DEBUG> Software.pm:2651 UpgradeTypes::Software::umount - Mountpoint /tmp/DwV27pXMU8 is not mounted
2025/08/04 08:45:35 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/Bk6Q7GoGQM
2025/08/04 08:45:36 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 100% through step 3 (Configuring HPE OmniStack software): 100% of t otal
2025/08/04 08:45:36 INFO> upgrade.pl:196 Upgrade::main - Ending upgrade.pl with SUCCESS
2025/08/04 08:45:36 INFO> Common.pm:166 Util::Common::Exit - /scratch/upgrade/upgrade.pl exiting, requested exit code is 0
2025/08/04 08:45:39 WARN> upgrade.pl:139 Upgrade::clean_fds - skip 0 : lr-x------ 1 root root 64 Aug 4 08:45 /proc/364907/fd/0 -> pipe: [88614407]
2025/08/04 08:45:39 WARN> upgrade.pl:139 Upgrade::clean_fds - skip 1 : lrwx------ 1 root root 64 Aug 4 08:45 /proc/364907/fd/1 -> /tmp/ PerlIO_NueCfE (deleted)
2025/08/04 08:45:39 WARN> upgrade.pl:139 Upgrade::clean_fds - skip 2 : lrwx------ 1 root root 64 Aug 4 08:45 /proc/364907/fd/2 -> /tmp/ PerlIO_Q2mSzC (deleted)
2025/08/04 08:45:39 INFO> upgrade.pl:148 Upgrade::main - Staring upgrade.pl with --reconfigure VMConfigSpec.json
2025/08/04 08:45:39 INFO> Common.pm:166 Util::Common::Exit - /scratch/upgrade/upgrade.pl exiting, requested exit code is 3
2025/08/04 08:45:41 WARN> upgrade.pl:139 Upgrade::clean_fds - skip 0 : lr-x------ 1 root root 64 Aug 4 08:45 /proc/364919/fd/0 -> pipe: [88614465]
2025/08/04 08:45:41 WARN> upgrade.pl:139 Upgrade::clean_fds - skip 1 : lrwx------ 1 root root 64 Aug 4 08:45 /proc/364919/fd/1 -> /tmp/ PerlIO_NW6sJt (deleted)
2025/08/04 08:45:41 WARN> upgrade.pl:139 Upgrade::clean_fds - skip 2 : lrwx------ 1 root root 64 Aug 4 08:45 /proc/364919/fd/2 -> /tmp/ PerlIO_uDEtQz (deleted)
2025/08/04 08:45:41 INFO> upgrade.pl:148 Upgrade::main - Staring upgrade.pl with --switchover --session baceb8535ff737928017faad3736c36eb7 5a0757
2025/08/04 08:45:41 INFO> upgrade.pl:276 Upgrade::logUpgradePhase - Calling switchover with 4c2c249a-e0ef-4c63-9629-a3fe5ff44e0b /mnt/svtf s/0/8e8670dc-557a-4f52-8150-1e23a987302f/.svtupgrade
2025/08/04 08:45:41 INFO> StateMachine.pm:29 Util::StateMachine::Factory - Returning Partition-based state machine instance
2025/08/04 08:45:41 INFO> Partition.pm:73 Util::StateMachine::Partition::init - At init, the current state is Staged
2025/08/04 08:45:41 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /
2025/08/04 08:45:41 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/" UUID="0208a1c0-b09a-4a93-a42a-6 5601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:45:41 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:45:41 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /upgrade
2025/08/04 08:45:41 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/upgrade" UUID="47e83690-e17b-46ce -ba1e-c6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:45:42 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:45:42 INFO> upgrade.pl:356 Upgrade::executeSwitchover - executeSwitchover with isSelfHostUpgrade: 0
2025/08/04 08:45:42 INFO> Software.pm:1056 UpgradeTypes::Software::switchover - Switching to new version
2025/08/04 08:45:42 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 0% through step 1 (Preparing for installation): 0% of total
2025/08/04 08:45:42 INFO> Software.pm:2573 UpgradeTypes::Software::mountByLabel - Mounting /upgrade (ext4) to /tmp/tSC7kvYEfx
2025/08/04 08:45:42 INFO> Software.pm:2729 UpgradeTypes::Software::setupChroot - Setting up chroot for /tmp/tSC7kvYEfx
2025/08/04 08:45:42 INFO> Software.pm:2841 UpgradeTypes::Software::getChrootKernelVersion - Detected next kernel version: 6.8.0-51-generic
2025/08/04 08:45:42 DEBUG> Software.pm:2965 UpgradeTypes::Software::_chmod - [chmod] 493 /tmp/tSC7kvYEfx/bin/uname
2025/08/04 08:45:42 DEBUG> Software.pm:2965 UpgradeTypes::Software::_chmod - [chmod] 493 /tmp/tSC7kvYEfx/sbin/depmod
2025/08/04 08:45:42 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 0% through step 2 (Setting up initial configuration): 5% of total
2025/08/04 08:45:42 INFO> Base.pm:326 UpgradeTypes::Base::preserveFile - Preserving file /scratch/upgrade/upgrade-list.yaml to /tmp/tSC7kv YEfx/root/firstboot/src/os/upgrade/install/upgrade-list.yaml
2025/08/04 08:45:42 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 10% through step 2 (Setting up initial configuration): 6% of total
2025/08/04 08:45:42 INFO> Software.pm:1988 UpgradeTypes::Software::versionSpecificSwitchover - Running switchover for version-specific plu gin VersionSpecific::CopyAndValidateCertificates
2025/08/04 08:45:42 INFO> CopyAndValidateCertificates.pm:75 VersionSpecific::CopyAndValidateCertificates::switchover - Certificates will b e extracted to the dir : /mnt/etc/hms/trustedcerts
2025/08/04 08:45:42 INFO> CopyAndValidateCertificates.pm:143 VersionSpecific::CopyAndValidateCertificates::checkExtractDirectoryAndPermiss ions - UID and GID of caservice:caservice user and group is 989 , 1011
2025/08/04 08:45:42 INFO> CopyAndValidateCertificates.pm:155 VersionSpecific::CopyAndValidateCertificates::checkExtractDirectoryAndPermiss ions - Changing ownership of /mnt/etc/hms/trustedcerts to 989:1011
2025/08/04 08:45:42 INFO> CopyAndValidateCertificates.pm:158 VersionSpecific::CopyAndValidateCertificates::checkExtractDirectoryAndPermiss ions - Changing permissions of /mnt/etc/hms/trustedcerts to rwx/rwx/r__
2025/08/04 08:45:42 INFO> CopyAndValidateCertificates.pm:81 VersionSpecific::CopyAndValidateCertificates::switchover - Fetching our cluste r's federation data
2025/08/04 08:45:42 INFO> CopyAndValidateCertificates.pm:91 VersionSpecific::CopyAndValidateCertificates::switchover - Validating given pa ckage and package location: /mnt/svtfs/0/8e8670dc-557a-4f52-8150-1e23a987302f/.svtupgrade/certificate-4c2c249a-e0ef-4c63-9629-a3fe5ff44e0b .tar
2025/08/04 08:45:42 INFO> CopyAndValidateCertificates.pm:101 VersionSpecific::CopyAndValidateCertificates::switchover - Extract and valida te /mnt/svtfs/0/8e8670dc-557a-4f52-8150-1e23a987302f/.svtupgrade/certificate-4c2c249a-e0ef-4c63-9629-a3fe5ff44e0b.tar
2025/08/04 08:45:43 INFO> CopyAndValidateCertificates.pm:186 VersionSpecific::CopyAndValidateCertificates::validateExtractedCerts - Changi ng ownership of /mnt/etc/hms/trustedcerts/2b4defc3626ceb4be709cebf10a4c10e8481b980.pem to 989:1011
2025/08/04 08:45:43 INFO> CopyAndValidateCertificates.pm:189 VersionSpecific::CopyAndValidateCertificates::validateExtractedCerts - Changi ng permissions of /mnt/etc/hms/trustedcerts/2b4defc3626ceb4be709cebf10a4c10e8481b980.pem to rwx/rwx/r__
2025/08/04 08:45:43 INFO> Software.pm:1988 UpgradeTypes::Software::versionSpecificSwitchover - Running switchover for version-specific plu gin VersionSpecific::MigrateToDigitalVault
2025/08/04 08:45:43 INFO> MigrateToDigitalVault.pm:78 VersionSpecific::MigrateToDigitalVault::switchover - Version is PSI 17, Initiating b ackup of Vaultfile
2025/08/04 08:45:43 INFO> Software.pm:1988 UpgradeTypes::Software::versionSpecificSwitchover - Running switchover for version-specific plu gin VersionSpecific::Mva
2025/08/04 08:45:43 INFO> Mva.pm:256 VersionSpecific::Mva::switchover - MVA Upgrade Version 5.3.1.8 is Newer than the Current MVA Version 5.2.0.164
2025/08/04 08:45:43 INFO> Mva.pm:258 VersionSpecific::Mva::switchover - Rename the /mva/deploy into /mva/rollback
2025/08/04 08:45:43 INFO> Mva.pm:262 VersionSpecific::Mva::switchover - Rename the /mva/next into /mva/deploy
2025/08/04 08:45:43 INFO> Software.pm:1988 UpgradeTypes::Software::versionSpecificSwitchover - Running switchover for version-specific plu gin VersionSpecific::PrepareOVCForUpgrade
2025-08-04 08:45:43,845Z INFO main [c.s.u.PrepareOVCForUpgrade] main(PrepareOVCForUpgrade.java:108) - Starting com.simplivity.upgrade.Pre pareOVCForUpgrade
2025-08-04 08:45:43,848Z INFO main [c.s.u.u.Hval] autodetectHmsHost(Hval.java:200) - autodetectHmsHost=10.100.1.150
2025-08-04 08:45:43,862Z INFO main [c.s.u.PrepareOVCForUpgrade] <init>(PrepareOVCForUpgrade.java:56) - getSystemType for 10.100.1.150: vS phere
2025-08-04 08:45:43,864Z DEBUG main [c.s.u.u.Hval] establishSessionWithSSO(Hval.java:145) - getSessionByTicket invoked with token 'baceb85 35ff737928017faad3736c36eb75a0757' rather than a ticket for HMS or UPN '10.100.1.150'
2025-08-04 08:45:43,876Z DEBUG main [c.s.h.h.v.VMWareSessionImpl] connectOnce(VMWareSessionImpl.java:463) - Connecting to 'https://10.100. 1.150/sdk' using 'credentialSessionId' credentials ...
2025-08-04 08:45:43,896Z DEBUG main [c.s.h.h.v.VMWareSessionImpl] getSSLSocketFactory(VMWareSessionImpl.java:1131) - Creating SSL Socket f actory using trust store
2025-08-04 08:45:43,897Z INFO main [c.s.h.h.v.n.s.TrustStoreSSLSocketFactory] getSSLSocketFactory(TrustStoreSSLSocketFactory.java:46) - C reating a new SSLSocket factory using trust store
2025-08-04 08:45:43,897Z DEBUG main [c.s.h.u.n.SSLSocketFactoryUtils] createSSLSocketFactory(SSLSocketFactoryUtils.java:69) - Creating SSL SocketFactory using truststore file /var/svtfs/0/security/cacerts/external.jks
2025-08-04 08:45:43,938Z DEBUG main [c.s.h.h.v.n.s.TrustStoreSSLSocketFactory] getSSLSocketFactory(TrustStoreSSLSocketFactory.java:51) - T ruststore last modified time 1744115933388 updated after SSLSocketFactory creation
2025-08-04 08:45:44,143Z DEBUG main [c.s.h.h.v.n.s.VMwareHostnameVerifier] verify(VMwareHostnameVerifier.java:84) - Verifying host '10.100 .1.150'
2025-08-04 08:45:44,143Z DEBUG main [c.s.h.h.v.n.s.VMwareHostnameVerifier] verify(VMwareHostnameVerifier.java:102) - Verifying host '10.10 0.1.150' - peer cert Subject DN 'C=US, CN=svtvcenter.hasanaltin.local'
2025-08-04 08:45:44,144Z DEBUG main [c.s.h.h.v.n.s.VMwareHostnameVerifier] verify(VMwareHostnameVerifier.java:106) - Retrieved cert Subjec tAltNames: [svtvcenter.hasanaltin.local]
2025-08-04 08:45:44,146Z DEBUG main [c.s.h.h.v.n.s.VMwareHostnameVerifier] matchIpAddressByDnsName(VMwareHostnameVerifier.java:223) - Foun d address '10.100.1.150' via DNS lookup of subjectAltName 'svtvcenter.hasanaltin.local/10.100.1.150'
2025-08-04 08:45:44,146Z DEBUG main [c.s.h.h.v.n.s.VMwareHostnameVerifier] matchIpAddressByDnsName(VMwareHostnameVerifier.java:227) - Subj ectAltName 'svtvcenter.hasanaltin.local' matches host '10.100.1.150'
2025-08-04 08:45:44,195Z INFO main [c.s.h.h.v.VMWareSessionImpl] connectOnce(VMWareSessionImpl.java:477) - Logged in with SessionId: 'bac eb8535ff737928017faad3736c36eb75a0757'
2025-08-04 08:45:44,195Z INFO main [c.s.h.h.v.VMWareSessionImpl] connect(VMWareSessionImpl.java:362) - Connected to HMS server https://10 .100.1.150/sdk with type credentialSessionId after 1 attempt(s).
2025-08-04 08:45:44,259Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6926) - found supported hardware version: vmx-03
2025-08-04 08:45:44,260Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6938) - versio n diff=3 for vmx-03 vs
2025-08-04 08:45:44,260Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6926) - found supported hardware version: vmx-04
2025-08-04 08:45:44,260Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6938) - versio n diff=1 for vmx-04 vs vmx-03
2025-08-04 08:45:44,260Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6926) - found supported hardware version: vmx-07
2025-08-04 08:45:44,261Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6938) - versio n diff=1 for vmx-07 vs vmx-04
2025-08-04 08:45:44,261Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6926) - found supported hardware version: vmx-08
2025-08-04 08:45:44,261Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6938) - versio n diff=1 for vmx-08 vs vmx-07
2025-08-04 08:45:44,261Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6926) - found supported hardware version: vmx-09
2025-08-04 08:45:44,261Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6938) - versio n diff=1 for vmx-09 vs vmx-08
2025-08-04 08:45:44,261Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6926) - found supported hardware version: vmx-10
2025-08-04 08:45:44,261Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6938) - versio n diff=1 for vmx-10 vs vmx-09
2025-08-04 08:45:44,261Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6926) - found supported hardware version: vmx-11
2025-08-04 08:45:44,261Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6938) - versio n diff=1 for vmx-11 vs vmx-10
2025-08-04 08:45:44,262Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6926) - found supported hardware version: vmx-12
2025-08-04 08:45:44,262Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6938) - versio n diff=1 for vmx-12 vs vmx-11
2025-08-04 08:45:44,262Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6926) - found supported hardware version: vmx-13
2025-08-04 08:45:44,262Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6938) - versio n diff=1 for vmx-13 vs vmx-12
2025-08-04 08:45:44,262Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6926) - found supported hardware version: vmx-14
2025-08-04 08:45:44,262Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6938) - versio n diff=1 for vmx-14 vs vmx-13
2025-08-04 08:45:44,262Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6926) - found supported hardware version: vmx-15
2025-08-04 08:45:44,262Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6938) - versio n diff=1 for vmx-15 vs vmx-14
2025-08-04 08:45:44,263Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6926) - found supported hardware version: vmx-16
2025-08-04 08:45:44,263Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6938) - versio n diff=1 for vmx-16 vs vmx-15
2025-08-04 08:45:44,263Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6926) - found supported hardware version: vmx-17
2025-08-04 08:45:44,263Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6938) - versio n diff=1 for vmx-17 vs vmx-16
2025-08-04 08:45:44,263Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6926) - found supported hardware version: vmx-18
2025-08-04 08:45:44,263Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6938) - versio n diff=1 for vmx-18 vs vmx-17
2025-08-04 08:45:44,263Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6926) - found supported hardware version: vmx-19
2025-08-04 08:45:44,264Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6938) - versio n diff=1 for vmx-19 vs vmx-18
2025-08-04 08:45:44,264Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6926) - found supported hardware version: vmx-20
2025-08-04 08:45:44,264Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6938) - versio n diff=1 for vmx-20 vs vmx-19
2025-08-04 08:45:44,264Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6926) - found supported hardware version: vmx-21
2025-08-04 08:45:44,264Z DEBUG main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6931) - found recommended hardware rev: vmx-21
2025-08-04 08:45:44,264Z INFO main [c.s.h.h.v.VMWareVirtualMachineImpl] getLatestHardwareRev(VMWareVirtualMachineImpl.java:6950) - Select ed hardware version: vmx-21
2025-08-04 08:45:44,264Z INFO main [c.s.h.h.v.VMWareVirtualMachineImpl] scheduleHardwareUpgrade(VMWareVirtualMachineImpl.java:6855) - Lim iting VM hardware rev upgrade to: vmx-11
2025-08-04 08:45:44,308Z INFO main [c.s.h.h.v.VMWareVirtualMachineImpl] scheduleHardwareUpgrade(VMWareVirtualMachineImpl.java:6863) - VM hardware rev is already: vmx-11
2025-08-04 08:45:44,308Z INFO main [c.s.u.PrepareOVCForUpgrade] main(PrepareOVCForUpgrade.java:125) - Exiting (0)
2025/08/04 08:45:44 INFO> Software.pm:1988 UpgradeTypes::Software::versionSpecificSwitchover - Running switchover for version-specific plu gin VersionSpecific::SshdConfig
2025/08/04 08:45:44 INFO> SshdConfig.pm:70 VersionSpecific::SshdConfig::switchover - Executing the command to update sshd config
2025/08/04 08:45:44 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 30% through step 2 (Setting up initial configuration): 7% of total
2025/08/04 08:45:44 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 50% through step 2 (Setting up initial configuration): 8% of total
2025/08/04 08:46:02 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 70% through step 2 (Setting up initial configuration): 9% of total
2025/08/04 08:46:06 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 90% through step 2 (Setting up initial configuration): 10% of total
2025/08/04 08:46:06 INFO> Software.pm:2938 UpgradeTypes::Software::cleanAllChroots - Cleaning chroot for /tmp/tSC7kvYEfx
2025/08/04 08:46:06 INFO> Software.pm:2912 UpgradeTypes::Software::restoreChrootWrappers - Restoring chroot wrapper for /sbin/depmod in /t mp/tSC7kvYEfx
2025/08/04 08:46:06 INFO> Software.pm:2912 UpgradeTypes::Software::restoreChrootWrappers - Restoring chroot wrapper for /bin/uname in /tmp /tSC7kvYEfx
2025/08/04 08:46:06 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/tSC7kvYEfx/sys/firmware/efi/efivars
2025/08/04 08:46:06 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/tSC7kvYEfx/scratch
2025/08/04 08:46:06 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/tSC7kvYEfx/core
2025/08/04 08:46:06 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/tSC7kvYEfx/mnt
2025/08/04 08:46:06 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/tSC7kvYEfx/var/log
2025/08/04 08:46:06 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/tSC7kvYEfx/var/svtfs
2025/08/04 08:46:06 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/tSC7kvYEfx/dev/pts
2025/08/04 08:46:06 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/tSC7kvYEfx/sys
2025/08/04 08:46:06 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/tSC7kvYEfx/proc
2025/08/04 08:46:06 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/tSC7kvYEfx/dev
2025/08/04 08:46:06 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/tSC7kvYEfx
2025/08/04 08:46:07 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 100% through step 2 (Setting up initial configuration): 10% of tota l
2025/08/04 08:46:07 INFO> Base.pm:245 UpgradeTypes::Base::asyncFinishSwitchover - Asynchronously updating the firmware/FPGA
2025/08/04 08:46:07 DEBUG> Base.pm:177 UpgradeTypes::Base::asyncSystem - Running asynchronous operation: /scratch/upgrade//upgrade.pl --fi nishSwitchover
2025/08/04 08:46:07 INFO> upgrade.pl:196 Upgrade::main - Ending upgrade.pl with SUCCESS
2025/08/04 08:46:07 INFO> Common.pm:166 Util::Common::Exit - /scratch/upgrade/upgrade.pl exiting, requested exit code is 0
2025/08/04 08:46:12 WARN> upgrade.pl:139 Upgrade::clean_fds - skip 0 : lr-x------ 1 root root 64 Aug 4 08:46 /proc/365205/fd/0 -> pipe: [88614465]
2025/08/04 08:46:13 WARN> upgrade.pl:139 Upgrade::clean_fds - skip 1 : lrwx------ 1 root root 64 Aug 4 08:46 /proc/365205/fd/1 -> /tmp/ PerlIO_NW6sJt (deleted)
2025/08/04 08:46:13 WARN> upgrade.pl:139 Upgrade::clean_fds - skip 2 : lrwx------ 1 root root 64 Aug 4 08:46 /proc/365205/fd/2 -> /tmp/ PerlIO_uDEtQz (deleted)
2025/08/04 08:46:13 INFO> upgrade.pl:148 Upgrade::main - Staring upgrade.pl with --finishSwitchover
2025/08/04 08:46:13 INFO> upgrade.pl:276 Upgrade::logUpgradePhase - Calling finish switchover with 4c2c249a-e0ef-4c63-9629-a3fe5ff44e0b /m nt/svtfs/0/8e8670dc-557a-4f52-8150-1e23a987302f/.svtupgrade
2025/08/04 08:46:13 INFO> StateMachine.pm:29 Util::StateMachine::Factory - Returning Partition-based state machine instance
2025/08/04 08:46:13 INFO> Partition.pm:73 Util::StateMachine::Partition::init - At init, the current state is Staged
2025/08/04 08:46:13 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /
2025/08/04 08:46:13 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/" UUID="0208a1c0-b09a-4a93-a42a-6 5601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:46:13 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:46:13 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /upgrade
2025/08/04 08:46:13 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/upgrade" UUID="47e83690-e17b-46ce -ba1e-c6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:46:13 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:46:13 INFO> upgrade.pl:383 Upgrade::executeFinishSwitchover - executeFinishSwitchover with isSelfHostUpgrade: 0
2025/08/04 08:46:13 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 0% through step 3 (Shutting down services before rebooting): 10% of total
2025/08/04 08:46:13 INFO> InitService.pm:71 Utils::InitService::init - Service svtfs is start/running (PID 2818)
2025/08/04 08:46:13 DEBUG> SvtfsService.pm:65 Utils::SvtfsService::refreshServices - Fetching service list: state is start/running, pid is 2818
2025/08/04 08:46:14 DEBUG> SvtfsService.pm:65 Utils::SvtfsService::refreshServices - Fetching service list: state is start/running, pid is 2818
2025/08/04 08:46:15 INFO> InitService.pm:396 Utils::InitService::stop - Stopping svtfs
2025/08/04 08:46:15 DEBUG> InitService.pm:231 Utils::InitService::startBackground - Spawned command '/bin/systemctl stop svtfs@0' with PID 365242
2025/08/04 08:46:20 DEBUG> SvtfsService.pm:65 Utils::SvtfsService::refreshServices - Fetching service list: state is start/running, pid is 2818
2025/08/04 08:46:21 DEBUG> SvtfsService.pm:171 Utils::SvtfsService::pollForShutdown - Waiting for LastRunLevel for 6 s
2025/08/04 08:46:21 INFO> SvtfsService.pm:182 Utils::SvtfsService::pollForShutdown - Waiting for 64 services to terminate
2025/08/04 08:46:26 DEBUG> SvtfsService.pm:65 Utils::SvtfsService::refreshServices - Fetching service list: state is start/running, pid is 2818
2025/08/04 08:46:27 DEBUG> SvtfsService.pm:171 Utils::SvtfsService::pollForShutdown - Waiting for LastRunLevel for 12 s
2025/08/04 08:46:27 INFO> SvtfsService.pm:182 Utils::SvtfsService::pollForShutdown - Waiting for 64 services to terminate
2025/08/04 08:46:31 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 1% through step 3 (Shutting down services before rebooting): 11% of total
2025/08/04 08:46:32 DEBUG> SvtfsService.pm:65 Utils::SvtfsService::refreshServices - Fetching service list: state is stop/stopping, pid is 2818
2025/08/04 08:46:33 INFO> SvtfsService.pm:164 Utils::SvtfsService::pollForShutdown - The following SVTFS services have now terminated: Las tRunLevel, Control Plane RPC Server, Control Plane DSV, Task Manager Enabler, CGPS, Cluster Group Management Service, CGMS RPC Server, Clu ster Group Management Service MF, InfoSight, Node Sync Scheduler, Phone Home Monitor, SVT Eventmgr RPC Server, Hypervisor Sync Service, In telligent Workload Optimizer, Event Emitter Service, Control Plane Virtual RPC Server, VAAI Clone Manager, VAAI Session Manager, VAAI Sess ion Service, IP Failover Manager, Balancing Service, Leader Determination Server, LeaderDeterminationService, PrimaryViewService, Connecti vityService, ConnectivityService, UpgradePeerService, BroadcastTreeProvider, Shutdown Service, Failure Domain Connectivity Checker, Electi onService, FailureDomainViewManager, File Restore Service, Mount Service, Sqlite Memory Alarm Service, SocketLeak Alarm Service, Capacity Alarm Service, Backup Manager, Node Service, Backup Service, CPScheduler, Hive Manager, Resource Balancing Service, Dynamic Throttle Adjus ter, Hw Inventory Manager, Demuxer Manager, DemuxerCallbackImpl, SessionManager, Overlay, Arbiter Discovery, Cluster View Service, Failure Domain Service 2G, Configuration Database, Base Vault Cleanup Scheduler, PicoServiceProvider
2025/08/04 08:46:33 INFO> SvtfsService.pm:165 Utils::SvtfsService::pollForShutdown - Next service to shutdown: Analytics Service
2025/08/04 08:46:33 INFO> SvtfsService.pm:182 Utils::SvtfsService::pollForShutdown - Waiting for 10 services to terminate
2025/08/04 08:46:33 INFO> InitService.pm:419 Utils::InitService::waitForShutdown - Service svtfs state is now 'stopping', waiting for 'wai ting'
2025/08/04 08:46:38 DEBUG> SvtfsService.pm:61 Utils::SvtfsService::refreshServices - Not fetching service list: state is stop/waiting, pid is 0
2025/08/04 08:46:38 INFO> SvtfsService.pm:164 Utils::SvtfsService::pollForShutdown - The following SVTFS services have now terminated: Sto rage Interface Manager, StartupShutdown, Analytics Service, Control Plane Svc monitor DSV, Management Interface Manager, Federation Servic e, Message Service, Prometheus HTTP Service, Federation Interface Manager, Group RPC Service
2025/08/04 08:46:38 DEBUG> InitService.pm:265 Utils::InitService::waitForBackground - Background command '/bin/systemctl stop svtfs@0' has completed (0)
2025/08/04 08:46:38 INFO> InitService.pm:430 Utils::InitService::waitForShutdown - Service svtfs is stop/waiting
2025/08/04 08:46:38 INFO> SvtfsService.pm:121 Utils::SvtfsService::waitForShutdown - Clean shutdown successful
2025/08/04 08:46:38 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 100% through step 3 (Shutting down services before rebooting): 80% of total
2025/08/04 08:46:38 INFO> Software.pm:1411 UpgradeTypes::Software::callOaUpgrade - Calling oaUpgrade.pl to upgrade the TIA firmware
2025/08/04 08:46:38 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 0% through step 4 (Upgrading Accelerator card): 80% of total
2025/08/04 08:46:39 INFO> oaUpgrade.pl:137 OA::Upgrade::run - No upgrade needed without TIA
2025/08/04 08:46:39 INFO> Common.pm:166 Util::Common::Exit - /scratch/upgrade//oaUpgrade.pl exiting, requested exit code is 0
2025/08/04 08:46:39 INFO> Software.pm:1414 UpgradeTypes::Software::callOaUpgrade - oaUpgrade.pl returned expected return code 0
2025/08/04 08:46:39 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 100% through step 4 (Upgrading Accelerator card): 95% of total
2025/08/04 08:46:39 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 0% through step 5 (Saving the final configuration): 95% of total
2025/08/04 08:46:39 INFO> Software.pm:1457 UpgradeTypes::Software::finalizeSwitchover - Restarting the HyperProxy, which is normally shut down when svtfs shuts down
2025/08/04 08:46:39 INFO> InitService.pm:71 Utils::InitService::init - Service svt-hyperproxy-server is stop/waiting
2025/08/04 08:46:39 INFO> InitService.pm:309 Utils::InitService::start - Starting svt-hyperproxy-server
2025/08/04 08:46:39 DEBUG> InitService.pm:231 Utils::InitService::startBackground - Spawned command '/bin/systemctl start svt-hyperproxy-s erver' with PID 365501
2025/08/04 08:46:44 DEBUG> InitService.pm:265 Utils::InitService::waitForBackground - Background command '/bin/systemctl start svt-hyperpr oxy-server' has completed (0)
2025/08/04 08:46:44 INFO> InitService.pm:345 Utils::InitService::waitForRunning - Service svt-hyperproxy-server is start/running (PID 3655 19)
2025/08/04 08:46:44 WARN> Software.pm:1926 UpgradeTypes::Software::resetMetadataCacheSize - Could not determine metadata cache size from t he .vcconfig file - Not altering current value
2025/08/04 08:46:44 INFO> Software.pm:1888 UpgradeTypes::Software::alterSvtcfg - Adding new entry /NFSd/MaxWriteSize = 131072 in svtfs.xml
2025/08/04 08:46:44 INFO> Software.pm:1888 UpgradeTypes::Software::alterSvtcfg - Adding new entry /NFSd/MaxReadSize = 131072 in svtfs.xml
2025/08/04 08:46:44 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 25% through step 5 (Saving the final configuration): 96% of total
2025/08/04 08:46:44 INFO> Software.pm:1474 UpgradeTypes::Software::finalizeSwitchover - Calling session tickle one last time just before w e reboot
2025/08/04 08:46:44 INFO> Software.pm:1299 UpgradeTypes::Software::sessionTickle - Session tickling for session id: baceb8535ff737928017fa ad3736c36eb75a0757
2025/08/04 08:46:44 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 50% through step 5 (Saving the final configuration): 97% of total
2025/08/04 08:46:44 INFO> Software.pm:2573 UpgradeTypes::Software::mountByLabel - Mounting /upgrade (ext4) to /tmp/DbbAnBLYJk
2025/08/04 08:46:44 INFO> Software.pm:2729 UpgradeTypes::Software::setupChroot - Setting up chroot for /tmp/DbbAnBLYJk
2025/08/04 08:46:44 INFO> Software.pm:2841 UpgradeTypes::Software::getChrootKernelVersion - Detected next kernel version: 6.8.0-51-generic
2025/08/04 08:46:44 DEBUG> Software.pm:2965 UpgradeTypes::Software::_chmod - [chmod] 493 /tmp/DbbAnBLYJk/bin/uname
2025/08/04 08:46:44 DEBUG> Software.pm:2965 UpgradeTypes::Software::_chmod - [chmod] 493 /tmp/DbbAnBLYJk/sbin/depmod
2025/08/04 08:46:45 INFO> Software.pm:1484 UpgradeTypes::Software::finalizeSwitchover - Updating web services configuration and certificat es if needed
2025/08/04 08:46:45 INFO> Software.pm:1487 UpgradeTypes::Software::finalizeSwitchover -
2025/08/04 08:46:45 INFO> Software.pm:2841 UpgradeTypes::Software::getChrootKernelVersion - Detected next kernel version: 6.8.0-51-generic
2025/08/04 08:46:45 DEBUG> Software.pm:2965 UpgradeTypes::Software::_chmod - [chmod] 493 /tmp/DbbAnBLYJk/chrootDepmod.sh
2025/08/04 08:46:50 INFO> Software.pm:1516 UpgradeTypes::Software::finalizeSwitchover - Chroot result: depmod: FATAL: 6.8.0-51-generic: no t absolute path.
update-initramfs: Generating /boot/initrd.img-6.8.0-51-generic
2025/08/04 08:46:50 INFO> Software.pm:1523 UpgradeTypes::Software::finalizeSwitchover - Checking grub version on / (Filesystem 1K-bloc ks Used Available Use% Mounted on
overlay 22855944 35148 22820796 1% /
)
2025/08/04 08:46:50 INFO> Software.pm:1525 UpgradeTypes::Software::finalizeSwitchover - Checking grub version on chroot / (Filesystem 1K-blocks Used Available Use% Mounted on
/dev/sda4 10218772 4078168 5599932 43% /
)
2025/08/04 08:46:50 INFO> Software.pm:2141 UpgradeTypes::Software::getGrubTarget - Analyzing grub target.
2025/08/04 08:46:50 INFO> Software.pm:2171 UpgradeTypes::Software::getGrubTarget - Inspecting runtime variables.
2025/08/04 08:46:50 INFO> Software.pm:2189 UpgradeTypes::Software::getGrubTarget - grub target selected: x86_64-efi
2025/08/04 08:46:50 INFO> Software.pm:2141 UpgradeTypes::Software::getGrubTarget - Analyzing grub target.
2025/08/04 08:46:50 INFO> Software.pm:2180 UpgradeTypes::Software::getGrubTarget - Inspecting grub packages.
2025/08/04 08:46:50 INFO> Software.pm:2189 UpgradeTypes::Software::getGrubTarget - grub target selected: x86_64-efi
2025/08/04 08:46:50 INFO> Software.pm:2494 UpgradeTypes::Software::verifyGrubTarget - currentGrubTarget is x86_64-efi and destGrubTarget i s x86_64-efi
2025/08/04 08:46:50 INFO> Software.pm:2516 UpgradeTypes::Software::verifyGrubTarget - The version of grub installed is correct.
2025/08/04 08:46:50 INFO> Software.pm:2382 UpgradeTypes::Software::modifyGrubBootUUID - grub update on: label=/upgrade, mount=/tmp/DbbAnBL YJk, device=/dev/sda4.
2025/08/04 08:46:50 INFO> Software.pm:2414 UpgradeTypes::Software::modifyGrubBootUUID - Detected GRUB 2
2025/08/04 08:46:50 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /boot/efi
2025/08/04 08:46:50 INFO> Software.pm:2573 UpgradeTypes::Software::mountByLabel - Mounting BOOTEFI (vfat) to /tmp/DbbAnBLYJk/boot/efi
2025/08/04 08:46:50 INFO> Software.pm:2440 UpgradeTypes::Software::modifyGrubBootUUID - DEBUG: Running: /usr/sbin/chroot /tmp/DbbAnBLYJk / usr/sbin/grub-mkconfig -o /boot/grub/grub.cfg
2025/08/04 08:46:55 INFO> Software.pm:2442 UpgradeTypes::Software::modifyGrubBootUUID - DEBUG: Stdout: Sourcing file `/etc/default/grub'
Sourcing file `/etc/default/grub.d/init-select.cfg'
Sourcing file `/etc/default/grub.d/kdump-tools.cfg'
Generating grub configuration file ...
Found linux image: /boot/vmlinuz-6.8.0-51-generic
Found initrd image: /boot/initrd.img-6.8.0-51-generic
Warning: os-prober will be executed to detect other bootable partitions.
Its output will be used to detect bootable binaries on them and create new boot entries.
Found Ubuntu 22.04.5 LTS (22.04) on /dev/sda1
Adding boot menu entry for UEFI Firmware Settings ...
done
2025/08/04 08:46:55 INFO> Software.pm:2451 UpgradeTypes::Software::modifyGrubBootUUID - DEBUG: Running: /usr/sbin/chroot /tmp/DbbAnBLYJk / usr/sbin/grub-install --target x86_64-efi /dev/sda
2025/08/04 08:46:55 INFO> Software.pm:2453 UpgradeTypes::Software::modifyGrubBootUUID - DEBUG: Stdout: Installing for x86_64-efi platform.
Installation finished. No error reported.
2025/08/04 08:46:56 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/DbbAnBLYJk/boot/efi
2025/08/04 08:46:56 INFO> Software.pm:2573 UpgradeTypes::Software::mountByLabel - Mounting BOOTEFI (vfat) to /boot/efi
2025/08/04 08:46:56 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 100% through step 5 (Saving the final configuration): 99% of total
2025/08/04 08:46:56 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 0% through step 6 (Rebooting the Virtual Controller): 99% of total
2025/08/04 08:46:56 INFO> Software.pm:2938 UpgradeTypes::Software::cleanAllChroots - Cleaning chroot for /tmp/DbbAnBLYJk
2025/08/04 08:46:56 INFO> Software.pm:2912 UpgradeTypes::Software::restoreChrootWrappers - Restoring chroot wrapper for /sbin/depmod in /t mp/DbbAnBLYJk
2025/08/04 08:46:56 INFO> Software.pm:2912 UpgradeTypes::Software::restoreChrootWrappers - Restoring chroot wrapper for /bin/uname in /tmp /DbbAnBLYJk
2025/08/04 08:46:56 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/DbbAnBLYJk/sys/firmware/efi/efivars
2025/08/04 08:46:56 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/DbbAnBLYJk/scratch
2025/08/04 08:46:56 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/DbbAnBLYJk/core
2025/08/04 08:46:56 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/DbbAnBLYJk/mnt
2025/08/04 08:46:56 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/DbbAnBLYJk/var/log
2025/08/04 08:46:56 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/DbbAnBLYJk/var/svtfs
2025/08/04 08:46:56 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/DbbAnBLYJk/dev/pts
2025/08/04 08:46:56 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/DbbAnBLYJk/sys
2025/08/04 08:46:56 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/DbbAnBLYJk/proc
2025/08/04 08:46:56 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/DbbAnBLYJk/dev
2025/08/04 08:46:56 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/DbbAnBLYJk
2025/08/04 08:46:56 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 50% through step 6 (Rebooting the Virtual Controller): 100% of tota l
2025/08/04 08:46:56 DEBUG> StateMachine.pm:112 Util::StateMachine::do - Current state is Staged, attempting transition Switchover
2025/08/04 08:46:56 DEBUG> StateMachine.pm:123 Util::StateMachine::do - Going to state Pre-commit
2025/08/04 08:46:56 DEBUG> Partition.pm:187 Util::StateMachine::Partition::triggerUdevRefresh - Triggering udev refresh of sda1
2025/08/04 08:46:56 DEBUG> Partition.pm:187 Util::StateMachine::Partition::triggerUdevRefresh - Triggering udev refresh of sda4
2025/08/04 08:46:56 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:46:56 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:46:56 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:46:56 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:46:56 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:46:56 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:46:56 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 100% through step 6 (Rebooting the Virtual Controller): 100% of tot al
2025/08/04 08:46:56 INFO> Base.pm:217 UpgradeTypes::Base::systemReboot - Rebooting the system
2025/08/04 08:46:56 DEBUG> Base.pm:177 UpgradeTypes::Base::asyncSystem - Running asynchronous operation: shutdown -r now
2025/08/04 08:46:56 INFO> upgrade.pl:196 Upgrade::main - Ending upgrade.pl with SUCCESS
2025/08/04 08:46:56 INFO> Common.pm:166 Util::Common::Exit - /scratch/upgrade//upgrade.pl exiting, requested exit code is 0
Mon Aug 4 08:53:22 UTC 2025: upgrade firstboot.sh
+ /scratch/upgrade/postflight.pl
Statement unlikely to be reached at /scratch/upgrade/src/os/lib/Utils/InitService.pm line 228.
(Maybe you meant system() when you said exec()?)
2025/08/04 08:53:23 INFO> postflight.pl:198 Postflight::run - Postflight action: Verify the boot device labels are correct
2025/08/04 08:53:23 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 0% through step 1 (Booting up with new version): 0% of total
2025/08/04 08:53:23 INFO> StateMachine.pm:29 Util::StateMachine::Factory - Returning Partition-based state machine instance
2025/08/04 08:53:23 INFO> Partition.pm:73 Util::StateMachine::Partition::init - At init, the current state is Pre-commit
2025/08/04 08:53:23 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:53:23 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:53:23 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:53:23 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:53:23 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:53:23 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:53:23 INFO> PreflightPostflight.pm:44 Common::PreflightPostflight::printSuccess - +Passed+ Verify disk labels
2025/08/04 08:53:23 INFO> postflight.pl:198 Postflight::run - Postflight action: Check state of all network interfaces
2025/08/04 08:53:23 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 4% through step 1 (Booting up with new version): 0% of total
2025/08/04 08:53:23 INFO> PreflightPostflight.pm:44 Common::PreflightPostflight::printSuccess - +Passed+ Check state of all network inter faces
2025/08/04 08:53:23 INFO> postflight.pl:198 Postflight::run - Postflight action: Verify the OmniCube Accellerator upgrade was successfull
2025/08/04 08:53:23 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 8% through step 1 (Booting up with new version): 0% of total
2025/08/04 08:53:23 INFO> VerifyHwUpgrade.pm:68 PostFlight::VerifyHwUpgrade::run - No hardware upgrade was performed
2025/08/04 08:53:23 INFO> PreflightPostflight.pm:44 Common::PreflightPostflight::printSuccess - +Passed+ Verify OA Firmware upgrade compl eted successfully
2025/08/04 08:53:23 INFO> postflight.pl:198 Postflight::run - Postflight action: Creates the directory for placement of Java heap dumps on out of memory failures
2025/08/04 08:53:23 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 12% through step 1 (Booting up with new version): 1% of total
2025/08/04 08:53:23 INFO> Base.pm:2826 InstallTypes::Base::createCoreJava - Creating directory /core/java
2025/08/04 08:53:24 INFO> PreflightPostflight.pm:44 Common::PreflightPostflight::printSuccess - +Passed+ Create Core-Java Directory
2025/08/04 08:53:24 INFO> postflight.pl:198 Postflight::run - Postflight action: Enable writes to /roroot before configuration operations
2025/08/04 08:53:24 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 15% through step 1 (Booting up with new version): 1% of total
2025/08/04 08:53:24 INFO> PreflightPostflight.pm:44 Common::PreflightPostflight::printSuccess - +Passed+ Disable read-only root filesyste m
2025/08/04 08:53:24 INFO> postflight.pl:198 Postflight::run - Postflight action: Ensure svt services running as non-root have access to th eir required files and directories
2025/08/04 08:53:24 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 19% through step 1 (Booting up with new version): 1% of total
2025/08/04 08:53:24 INFO> UpdateFsPermissions.pm:126 PostFlight::UpdateFsPermissions::run - Setting up file ownership for cfgdbarchiver(99 3):cfgdbarchiver(993)
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/archive is already owne d by 993:993
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:91 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/cfgdbarchiver.log d oes not exist
2025/08/04 08:53:24 INFO> UpdateFsPermissions.pm:126 PostFlight::UpdateFsPermissions::run - Setting up file ownership for controlservices( 995):controlservices(995)
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/eventmgr.log is alr eady owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/eventmgr.log.1.log. zip is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/eventmgr.log.2.log. zip is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/eventmgr.log.3.log. zip is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/eventmgr.log.4.log. zip is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/resourcebalancer.lo g is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/resourcebalancer.lo g.1.log.zip is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/resourcebalancer.lo g.2.log.zip is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/resourcebalancer.lo g.3.log.zip is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/resourcebalancer.lo g.4.log.zip is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/resourcebalancer.lo g.5.log.zip is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/resourcebalancer.lo g.6.log.zip is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:91 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/autobalancer-status .json does not exist
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/automigration.log i s already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/automigration.log.1 .log.zip is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/automigration.log.1 0.log.zip is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/automigration.log.2 .log.zip is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/automigration.log.3 .log.zip is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/automigration.log.4 .log.zip is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/automigration.log.5 .log.zip is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/automigration.log.6 .log.zip is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/automigration.log.7 .log.zip is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/automigration.log.8 .log.zip is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/automigration.log.9 .log.zip is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/automigrationstate. log is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:91 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/balancer-osgibundle health.json does not exist
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:91 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/balancer-nondefault config.json does not exist
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/balancerleadershipc hanges.log is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/balancerstatus.txt is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/dispatcher.log is a lready owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/dispatcher.log.1.gz is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/dispatcher.log.2.gz is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/dispatcher.log.3.gz is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/dispatcher.log.4.gz is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/dispatcher.log.5.gz is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/dispatcher.log.6.gz is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/metrics-service-lea der.log is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/metrics-service.log is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/rhshostselection.lo g.0 is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/rhspoolinventory.lo g.0 is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/rhspoolinventory.lo g.0.lck is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/rhspoolinventory.lo g.1 is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/rhspoolinventory.lo g.2 is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/rhspoolinventory.lo g.3 is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/rhspoolinventory.lo g.4 is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/rhspoolinventory.lo g.5 is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/rhspoolinventory.lo g.6 is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/rhspoolinventory.lo g.7 is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/rhspoolinventory.lo g.8 is already owned by 995:995
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/rhspoolinventory.lo g.9 is already owned by 995:995
2025/08/04 08:53:24 INFO> UpdateFsPermissions.pm:126 PostFlight::UpdateFsPermissions::run - Setting up file ownership for svtremoteps(990) :svtremoteps(1009)
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/remoteps.log is alr eady owned by 990:1009
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/svtremoteps.out is already owned by 990:1009
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/svtremoteps.out.1 i s already owned by 990:1009
2025/08/04 08:53:24 INFO> UpdateFsPermissions.pm:126 PostFlight::UpdateFsPermissions::run - Setting up file ownership for caservice(989):c aservice(1011)
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/svt-cert-service.lo g is already owned by 989:1011
2025/08/04 08:53:24 INFO> UpdateFsPermissions.pm:126 PostFlight::UpdateFsPermissions::run - Setting up file ownership for svtkerb(991):svt kerb(1010)
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:91 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/0/log/svtkerb.log does no t exist
2025/08/04 08:53:24 INFO> UpdateFsPermissions.pm:126 PostFlight::UpdateFsPermissions::run - Setting up file ownership for rdanet(987):rdal ab(1013)
2025/08/04 08:53:24 INFO> RestoreFsPermissions.pm:95 VersionSpecific::RestoreFsPermissions::doChown - /var/svtfs/rda/outbox is already own ed by 987:1013
2025/08/04 08:53:24 INFO> PreflightPostflight.pm:44 Common::PreflightPostflight::printSuccess - +Passed+ Update Filesystem Permissions
2025/08/04 08:53:24 INFO> postflight.pl:198 Postflight::run - Postflight action: Upgrade postgres 10 to 14
2025/08/04 08:53:24 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 23% through step 1 (Booting up with new version): 1% of total
2025/08/04 08:53:43 WARN> UpgradePostgres.pm:109 PostFlight::UpgradePostgres::run - Required postgres file does not exist yet, sleeping
2025/08/04 08:54:03 WARN> UpgradePostgres.pm:109 PostFlight::UpgradePostgres::run - Required postgres file does not exist yet, sleeping
2025/08/04 08:54:23 WARN> UpgradePostgres.pm:109 PostFlight::UpgradePostgres::run - Required postgres file does not exist yet, sleeping
2025/08/04 08:54:43 WARN> UpgradePostgres.pm:109 PostFlight::UpgradePostgres::run - Required postgres file does not exist yet, sleeping
2025/08/04 08:55:03 WARN> UpgradePostgres.pm:109 PostFlight::UpgradePostgres::run - Required postgres file does not exist yet, sleeping
2025/08/04 08:55:23 WARN> UpgradePostgres.pm:109 PostFlight::UpgradePostgres::run - Required postgres file does not exist yet, sleeping
2025/08/04 08:55:43 WARN> UpgradePostgres.pm:109 PostFlight::UpgradePostgres::run - Required postgres file does not exist yet, sleeping
2025/08/04 08:56:03 WARN> UpgradePostgres.pm:109 PostFlight::UpgradePostgres::run - Required postgres file does not exist yet, sleeping
2025/08/04 08:56:23 WARN> UpgradePostgres.pm:109 PostFlight::UpgradePostgres::run - Required postgres file does not exist yet, sleeping
2025/08/04 08:56:43 WARN> UpgradePostgres.pm:109 PostFlight::UpgradePostgres::run - Required postgres file does not exist yet, sleeping
2025/08/04 08:56:44 ERROR> PreflightPostflight.pm:34 Common::PreflightPostflight::printFailed - !FAILED! UpgradePostgres
2025/08/04 08:56:44 ERROR> PreflightPostflight.pm:39 Common::PreflightPostflight::printFailed - /cfgdb not ready within 200 seco nds.
2025/08/04 08:56:44 ERROR> postflight.pl:244 Postflight::printFailed - PostFlight failure reason: Error in postflight failed: /cfgdb not r eady within 200 seconds.
2025/08/04 08:56:44 WARN> postflight.pl:254 Postflight::printFailed - PostFlight failure detected; Initiating automatic rollback
2025/08/04 08:56:44 INFO> StateMachine.pm:29 Util::StateMachine::Factory - Returning Partition-based state machine instance
2025/08/04 08:56:44 INFO> Partition.pm:73 Util::StateMachine::Partition::init - At init, the current state is Pre-commit
2025/08/04 08:56:44 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:56:44 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:56:44 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:44 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:44 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:56:44 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:56:44 INFO> Software.pm:1625 UpgradeTypes::Software::rollback - Rollback to previous version
2025/08/04 08:56:44 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 0% through step 1 (Rolling back configuration): 0% of total
2025/08/04 08:56:44 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:56:44 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:56:44 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:44 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:44 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:56:44 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:56:44 INFO> MigrateToDigitalVault.pm:129 VersionSpecific::MigrateToDigitalVault::shouldRunRollback - Vault and Vault backup exist. should rollback
2025/08/04 08:56:44 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:56:44 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:56:44 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:44 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:44 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:56:44 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:56:44 INFO> Software.pm:2024 UpgradeTypes::Software::versionSpecificRollback - Running rollback for version-specific plugin VersionSpecific::MigrateToDigitalVault
2025/08/04 08:56:44 INFO> MigrateToDigitalVault.pm:143 VersionSpecific::MigrateToDigitalVault::rollback - Vault backup dir present. will r estore and cleanup
2025/08/04 08:56:44 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:56:45 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:56:45 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:45 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:45 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:56:45 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:56:45 INFO> Software.pm:2024 UpgradeTypes::Software::versionSpecificRollback - Running rollback for version-specific plugin VersionSpecific::SshdConfig
2025/08/04 08:56:45 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 50% through step 1 (Rolling back configuration): 1% of total
2025/08/04 08:56:45 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:56:45 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:56:45 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:45 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:45 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:56:45 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:56:45 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 100% through step 1 (Rolling back configuration): 2% of total
2025/08/04 08:56:45 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:56:45 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:56:45 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:45 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:45 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:56:45 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:56:45 INFO> Base.pm:252 UpgradeTypes::Base::asyncFinishRollback - Asynchronously rolling back the firmware/FPGA
2025/08/04 08:56:45 INFO> Common.pm:166 Util::Common::Exit - /scratch/upgrade/postflight.pl exiting, requested exit code is 1
+ set +x
Mon Aug 4 08:56:45 UTC 2025: upgrade firstboot done
Statement unlikely to be reached at /scratch/upgrade/src/os/lib/Utils/InitService.pm line 228.
(Maybe you meant system() when you said exec()?)
2025/08/04 08:56:51 WARN> upgrade.pl:139 Upgrade::clean_fds - skip 0 : lr-x------ 1 root root 64 Aug 4 08:56 /proc/2475/fd/0 -> /dev/nu ll
2025/08/04 08:56:51 WARN> upgrade.pl:139 Upgrade::clean_fds - skip 1 : l-wx------ 1 root root 64 Aug 4 08:56 /proc/2475/fd/1 -> pipe:[1 3421]
2025/08/04 08:56:51 WARN> upgrade.pl:139 Upgrade::clean_fds - skip 2 : l-wx------ 1 root root 64 Aug 4 08:56 /proc/2475/fd/2 -> pipe:[1 3421]
2025/08/04 08:56:51 INFO> upgrade.pl:148 Upgrade::main - Staring upgrade.pl with --finishRollback
2025/08/04 08:56:51 INFO> StateMachine.pm:29 Util::StateMachine::Factory - Returning Partition-based state machine instance
2025/08/04 08:56:51 INFO> Partition.pm:73 Util::StateMachine::Partition::init - At init, the current state is Pre-commit
2025/08/04 08:56:51 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:56:51 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:56:51 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:51 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:51 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:56:51 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:56:51 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:56:51 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:56:51 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:52 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:52 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:56:52 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:56:52 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 0% through step 2 (Shutting down SVTFS): 2% of total
2025/08/04 08:56:52 INFO> InitService.pm:71 Utils::InitService::init - Service svtfs is stop/waiting
2025/08/04 08:56:52 DEBUG> SvtfsService.pm:61 Utils::SvtfsService::refreshServices - Not fetching service list: state is stop/waiting, pid is 0
2025/08/04 08:56:52 WARN> Software.pm:1362 UpgradeTypes::Software::cleanShutdown - SVTFS was not running as was expected
2025/08/04 08:56:52 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 100% through step 2 (Shutting down SVTFS): 80% of total
2025/08/04 08:56:52 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:56:52 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:56:52 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:52 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:52 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:56:52 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:56:52 INFO> Software.pm:1411 UpgradeTypes::Software::callOaUpgrade - Calling oaUpgrade.pl to rollback the TIA firmware
2025/08/04 08:56:52 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 0% through step 3 (Rolling back TIA firmware): 80% of total
Statement unlikely to be reached at /scratch/upgrade/src/os/lib/Utils/InitService.pm line 228.
(Maybe you meant system() when you said exec()?)
2025/08/04 08:56:52 INFO> oaUpgrade.pl:137 OA::Upgrade::run - No upgrade needed without TIA
2025/08/04 08:56:52 INFO> Common.pm:166 Util::Common::Exit - /scratch/upgrade//oaUpgrade.pl exiting, requested exit code is 0
2025/08/04 08:56:52 INFO> Software.pm:1414 UpgradeTypes::Software::callOaUpgrade - oaUpgrade.pl returned expected return code 0
2025/08/04 08:56:52 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 100% through step 3 (Rolling back TIA firmware): 95% of total
2025/08/04 08:56:52 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 0% through step 4 (Final rollback configuration): 95% of total
2025/08/04 08:56:52 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:56:52 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:56:52 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:52 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:53 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:56:53 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:56:53 INFO> Software.pm:2573 UpgradeTypes::Software::mountByLabel - Mounting /old (ext4) to /tmp/BIIluh5APH
2025/08/04 08:56:53 INFO> Software.pm:2729 UpgradeTypes::Software::setupChroot - Setting up chroot for /tmp/BIIluh5APH
2025/08/04 08:56:53 INFO> Software.pm:2841 UpgradeTypes::Software::getChrootKernelVersion - Detected next kernel version: 6.8.0-45-generic
2025/08/04 08:56:53 DEBUG> Software.pm:2965 UpgradeTypes::Software::_chmod - [chmod] 493 /tmp/BIIluh5APH/bin/uname
2025/08/04 08:56:53 DEBUG> Software.pm:2965 UpgradeTypes::Software::_chmod - [chmod] 493 /tmp/BIIluh5APH/sbin/depmod
2025/08/04 08:56:53 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:56:53 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:56:53 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:53 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:53 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:56:53 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:56:53 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:56:53 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:56:53 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:53 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:53 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:56:53 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:56:53 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:56:53 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:56:53 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:53 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:53 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:56:53 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:56:53 INFO> Software.pm:1901 UpgradeTypes::Software::restoreAllSvtcfg - Deleting newly-added /NFSd/MaxWriteSize from svtfs.x ml
2025/08/04 08:56:53 INFO> Software.pm:1901 UpgradeTypes::Software::restoreAllSvtcfg - Deleting newly-added /NFSd/MaxReadSize from svtfs.xm l
2025/08/04 08:56:54 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 25% through step 4 (Final rollback configuration): 96% of total
2025/08/04 08:56:54 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:56:54 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:56:54 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:54 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:54 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:56:54 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:56:54 INFO> Software.pm:2024 UpgradeTypes::Software::versionSpecificRollback - Running finalize rollback for version-specifi c plugin VersionSpecific::ConfigureRda
2025/08/04 08:56:54 INFO> ConfigureRda.pm:122 VersionSpecific::ConfigureRda::rollback - Starting rollback for RDA.
2025/08/04 08:56:54 INFO> ConfigureRda.pm:124 VersionSpecific::ConfigureRda::rollback - Stopping RDA services...
2025/08/04 08:56:54 WARN> ConfigureRda.pm:127 VersionSpecific::ConfigureRda::rollback - Failed to stop rda-cas-jobs service:Failed to stop rda-cas-jobs.service: Unit rda-cas-jobs.service not loaded.
2025/08/04 08:56:54 WARN> ConfigureRda.pm:128 VersionSpecific::ConfigureRda::rollback - Failed to stop rda-cas service:Failed to stop rda- cas.service: Unit rda-cas.service not loaded.
2025/08/04 08:56:54 INFO> ConfigureRda.pm:146 VersionSpecific::ConfigureRda::rollback - Updating RDA entry to svtfs.xml, /PhoneHome/RDA/En abled true
2025/08/04 08:56:54 INFO> ConfigureRda.pm:169 VersionSpecific::ConfigureRda::rollback - Updating heartbeat feature entry to svtfs.xml, /Ph oneHome/RDA/HBEnabled true
2025/08/04 08:56:54 INFO> ConfigureRda.pm:186 VersionSpecific::ConfigureRda::rollback - Updating ahs feature entry to svtfs.xml, /PhoneHom e/RDA/AhsFile true
2025/08/04 08:56:54 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:56:54 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:56:54 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:54 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:54 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:56:54 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:56:54 INFO> Software.pm:2024 UpgradeTypes::Software::versionSpecificRollback - Running finalize rollback for version-specifi c plugin VersionSpecific::Mva
2025/08/04 08:56:54 INFO> Mva.pm:366 VersionSpecific::Mva::rollback - Remove /mva/deploy directory
2025/08/04 08:56:54 INFO> Mva.pm:369 VersionSpecific::Mva::rollback - Remove /mva/next directory
2025/08/04 08:56:54 INFO> Mva.pm:389 VersionSpecific::Mva::rollback - Rename /mva/rollback to /mva/deploy directory
2025/08/04 08:56:54 INFO> NetworkInterfaceRename.pm:42 VersionSpecific::NetworkInterfaceRename::shouldRunRollback - shouldRunRollback: 0
2025/08/04 08:56:54 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:56:54 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:56:54 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:54 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:54 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:56:55 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:56:55 INFO> Software.pm:2024 UpgradeTypes::Software::versionSpecificRollback - Running finalize rollback for version-specifi c plugin VersionSpecific::Orchestrator
2025/08/04 08:56:55 INFO> Orchestrator.pm:93 VersionSpecific::Orchestrator::rollback - Detected Auto rollback flag: /var/svtfs/0/auto.roll back, So spaceprobe won't be stopped.
2025/08/04 08:56:55 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 75% through step 4 (Final rollback configuration): 98% of total
2025/08/04 08:56:55 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:56:55 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:56:55 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:55 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:55 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:56:55 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:56:55 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:56:55 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:56:55 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:55 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:55 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:56:55 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:56:55 INFO> Software.pm:2141 UpgradeTypes::Software::getGrubTarget - Analyzing grub target.
2025/08/04 08:56:55 INFO> Software.pm:2180 UpgradeTypes::Software::getGrubTarget - Inspecting grub packages.
2025/08/04 08:56:55 INFO> Software.pm:2189 UpgradeTypes::Software::getGrubTarget - grub target selected: x86_64-efi
2025/08/04 08:56:55 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /
2025/08/04 08:56:55 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/" UUID="47e83690-e17b-46ce-ba1e-c 6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:56:55 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:55 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:56:55 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /old
2025/08/04 08:56:55 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/old" UUID="0208a1c0-b09a-4a93-a42 a-65601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:56:55 INFO> Software.pm:2382 UpgradeTypes::Software::modifyGrubBootUUID - grub update on: label=/old, mount=/tmp/BIIluh5APH, device=/dev/sda1.
2025/08/04 08:56:55 INFO> Software.pm:2414 UpgradeTypes::Software::modifyGrubBootUUID - Detected GRUB 2
2025/08/04 08:56:55 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /boot/efi
2025/08/04 08:56:55 INFO> Software.pm:2573 UpgradeTypes::Software::mountByLabel - Mounting BOOTEFI (vfat) to /tmp/BIIluh5APH/boot/efi
2025/08/04 08:56:55 INFO> Software.pm:2440 UpgradeTypes::Software::modifyGrubBootUUID - DEBUG: Running: /usr/sbin/chroot /tmp/BIIluh5APH / usr/sbin/grub-mkconfig -o /boot/grub/grub.cfg
2025/08/04 08:57:00 INFO> Software.pm:2442 UpgradeTypes::Software::modifyGrubBootUUID - DEBUG: Stdout: Sourcing file `/etc/default/grub'
Sourcing file `/etc/default/grub.d/init-select.cfg'
Sourcing file `/etc/default/grub.d/kdump-tools.cfg'
Generating grub configuration file ...
Found linux image: /boot/vmlinuz-6.8.0-45-generic
Found initrd image: /boot/initrd.img-6.8.0-45-generic
Warning: os-prober will be executed to detect other bootable partitions.
Its output will be used to detect bootable binaries on them and create new boot entries.
Found Ubuntu 22.04.5 LTS (22.04) on /dev/sda4
Adding boot menu entry for UEFI Firmware Settings ...
done
2025/08/04 08:57:00 INFO> Software.pm:2451 UpgradeTypes::Software::modifyGrubBootUUID - DEBUG: Running: /usr/sbin/chroot /tmp/BIIluh5APH / usr/sbin/grub-install --target x86_64-efi /dev/sda
2025/08/04 08:57:00 INFO> Software.pm:2453 UpgradeTypes::Software::modifyGrubBootUUID - DEBUG: Stdout: Installing for x86_64-efi platform.
Installation finished. No error reported.
2025/08/04 08:57:00 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/BIIluh5APH/boot/efi
2025/08/04 08:57:00 INFO> Software.pm:2573 UpgradeTypes::Software::mountByLabel - Mounting BOOTEFI (vfat) to /boot/efi
2025/08/04 08:57:00 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 100% through step 4 (Final rollback configuration): 99% of total
2025/08/04 08:57:00 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 0% through step 5 (Rebooting): 99% of total
2025/08/04 08:57:00 INFO> Software.pm:2938 UpgradeTypes::Software::cleanAllChroots - Cleaning chroot for /tmp/BIIluh5APH
2025/08/04 08:57:00 INFO> Software.pm:2912 UpgradeTypes::Software::restoreChrootWrappers - Restoring chroot wrapper for /sbin/depmod in /t mp/BIIluh5APH
2025/08/04 08:57:00 INFO> Software.pm:2912 UpgradeTypes::Software::restoreChrootWrappers - Restoring chroot wrapper for /bin/uname in /tmp /BIIluh5APH
2025/08/04 08:57:00 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/BIIluh5APH/sys/firmware/efi/efivars
2025/08/04 08:57:00 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/BIIluh5APH/scratch
2025/08/04 08:57:00 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/BIIluh5APH/core
2025/08/04 08:57:00 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/BIIluh5APH/mnt
2025/08/04 08:57:00 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/BIIluh5APH/var/log
2025/08/04 08:57:00 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/BIIluh5APH/var/svtfs
2025/08/04 08:57:00 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/BIIluh5APH/dev/pts
2025/08/04 08:57:00 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/BIIluh5APH/sys
2025/08/04 08:57:00 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/BIIluh5APH/proc
2025/08/04 08:57:00 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/BIIluh5APH/dev
2025/08/04 08:57:00 INFO> Software.pm:2645 UpgradeTypes::Software::umount - Unmounting /tmp/BIIluh5APH
2025/08/04 08:57:00 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 50% through step 5 (Rebooting): 100% of total
2025/08/04 08:57:00 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 75% through step 5 (Rebooting): 100% of total
2025/08/04 08:57:00 DEBUG> StateMachine.pm:112 Util::StateMachine::do - Current state is Pre-commit, attempting transition Rollback
2025/08/04 08:57:00 DEBUG> StateMachine.pm:123 Util::StateMachine::do - Going to state Committed
2025/08/04 08:57:00 DEBUG> Partition.pm:187 Util::StateMachine::Partition::triggerUdevRefresh - Triggering udev refresh of sda4
2025/08/04 08:57:00 DEBUG> Partition.pm:187 Util::StateMachine::Partition::triggerUdevRefresh - Triggering udev refresh of sda1
2025/08/04 08:57:00 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda1 -> /
2025/08/04 08:57:00 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda1: LABEL="/" UUID="0208a1c0-b09a-4a93-a42a-6 5601ceefbf0" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="d1280aac-1052-4071-8515-dcf174c96092"
2025/08/04 08:57:00 INFO> Partition.pm:99 Util::StateMachine::Partition::dumpState - /dev/sda4 -> /dormant
2025/08/04 08:57:00 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState - /dev/sda4: LABEL="/dormant" UUID="47e83690-e17b-46ce -ba1e-c6c1b631d1ee" BLOCK_SIZE="4096" TYPE="ext4" PARTUUID="beed1ecd-fde6-418d-958d-d6236720ef7e"
2025/08/04 08:57:01 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:57:01 INFO> Partition.pm:103 Util::StateMachine::Partition::dumpState -
2025/08/04 08:57:01 INFO> Statusfile.pm:268 Util::Statusfile::atStep - 100% through step 5 (Rebooting): 100% of total
2025/08/04 08:57:01 INFO> Base.pm:217 UpgradeTypes::Base::systemReboot - Rebooting the system
2025/08/04 08:57:01 DEBUG> Base.pm:177 UpgradeTypes::Base::asyncSystem - Running asynchronous operation: shutdown -r now
2025/08/04 08:57:01 INFO> upgrade.pl:196 Upgrade::main - Ending upgrade.pl with SUCCESS
2025/08/04 08:57:01 INFO> Common.pm:166 Util::Common::Exit - /scratch/upgrade/upgrade.pl exiting, requested exit code is 0
root@omnicube-ip1-53:/home/svtcli#
The following output shows the current status of the svtfs@.service.
root@omnicube-ip1-53:/home/svtcli# systemctl start svtfs@0.service
Job for svtfs@0.service failed because the control process exited with error code.
See "systemctl status svtfs@0.service" and "journalctl -xeu svtfs@0.service" for details.
root@omnicube-ip1-53:/home/svtcli# journalctl -xeu svtfs@0.service
░░ The job identifier is 11132.
Aug 04 12:57:40 omnicube-ip1-53.hasanaltin.local svtfs@0.sh[12676]: 2025-08-04 12:57:40Z prestart: svtfs begin
Aug 04 12:57:40 omnicube-ip1-53.hasanaltin.local svtfs@0.sh[12676]: 2025-08-04 12:57:40Z ERROR: svt-hal@0 service is not running. Exiting
Aug 04 12:57:40 omnicube-ip1-53.hasanaltin.local systemd[1]: svtfs@0.service: Control process exited, code=exited, status=1/FAILURE
░░ Subject: Unit process exited
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ An ExecStartPre= process belonging to unit svtfs@0.service has exited.
░░
░░ The process' exit code is 'exited' and its exit status is 1.
Aug 04 12:57:40 omnicube-ip1-53.hasanaltin.local svtfs@0.sh[12687]: 2025-08-04 12:57:40Z post-stop: svtfs begin
Aug 04 12:57:40 omnicube-ip1-53.hasanaltin.local svtfs@0.sh[12736]: ifdown: interface svteth2 not configured
Aug 04 12:57:40 omnicube-ip1-53.hasanaltin.local svtfs@0.sh[12687]: 2025-08-04 12:57:40Z post-stop: svtfs successful
Aug 04 12:57:40 omnicube-ip1-53.hasanaltin.local systemd[1]: svtfs@0.service: Failed with result 'exit-code'.
░░ Subject: Unit failed
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ The unit svtfs@0.service has entered the 'failed' state with result 'exit-code'.
Aug 04 12:57:40 omnicube-ip1-53.hasanaltin.local systemd[1]: Failed to start SimpliVity OmniCube Instance 0.
░░ Subject: A start job for unit svtfs@0.service has failed
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ A start job for unit svtfs@0.service has finished with a failure.
░░
░░ The job identifier is 11132 and the job result is failed.
Aug 04 12:57:50 omnicube-ip1-53.hasanaltin.local systemd[1]: svtfs@0.service: Scheduled restart job, restart counter is at 1.
░░ Subject: Automatic restarting of a unit has been scheduled
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ Automatic restarting of the unit svtfs@0.service has been scheduled, as the result for
░░ the configured Restart= setting for the unit.
Aug 04 12:58:06 omnicube-ip1-53.hasanaltin.local systemd[1]: Stopped SimpliVity OmniCube Instance 0.
░░ Subject: A stop job for unit svtfs@0.service has finished
░░ Defined-By: systemd
░░ Support: http://www.ubuntu.com/support
░░
░░ A stop job for unit svtfs@0.service has finished.
░░
░░ The job identifier is 12081 and the job result is done.Since the OmniStack SimpliVity disks were inaccessible, the services could not start. As a result, the svtfs0.service failed to initiate, preventing the Upgrade Manager from accessing the OVC using vCenter credentials and causing the upgrade process to stall at 95%.
Solution
Two different methods were tested to resolve this issue, both of which worked successfully.
Method 1 – Power Drain Procedure
- Power down the server.
- Disconnect the power cable from the back of the server.
- Unseat all front drives.
- Press and hold the power button for 5 seconds.
- Wait for 30 seconds.
- Reconnect the power cable.
- Power up the server without the drives installed.
- Wait until the server completes POST (Power-On Self-Test), then power it off again.
- Reseat all front drives.
- Power up the server.
Method 2 – OVC and Host Restart
- Poweroff the OVC.
- Reboot the host.
When using this method, the Upgrade Manager will fail, allowing you to restart the deployment from the beginning.
Both methods were tested on separate nodes that experienced the same problem, and each approach successfully resolved the issue.
Wishing you a successful day!
Best regards,
Hasan
