Client upgrade on Linux fails

Hi We have had a failure on RHEL and we cant find any clues as to what has happened. The log is below.
I cant find the besclientupgrade log

At 10:08:36 +0000 - actionsite (http://xxxxxxx682.XXX.AAAAA.net:52311/cgi-bin/bfgather.exe/actionsite)
Command succeeded (Prefetch download manager collected file) prefetch BESClientUpgrade.rpm sha1:5e93833bd6181d3570766608a01da68392129d6e size:16983788 http://software.bigfix.com/download/bes/95/BESAgent-9.5.7.90-rhe6.x86_64.rpm sha256:39a4340a2eae9939f0eb0d1385247c8506737c9235ea9fb03091cfb285843d5b (action:13215)
Command succeeded (evaluated true) continue if {exists file ā€œ__Download/BESClientUpgrade.rpmā€} (action:13215)
Command succeeded folder delete ā€œ/var/opt/BESClient/__BESData/BES Support/__Local/Upgradeā€ (action:13215)
Command succeeded (evaluated true) continue if {27275049 < free space of drive of client folder of current site} (action:13215)
Command succeeded folder create ā€œ/var/opt/BESClient/__BESData/BES Support/__Local/Upgradeā€ (action:13215)
Command succeeded move __Download/BESClientUpgrade.rpm __Local/Upgrade/BESClientUpgrade.rpm (action:13215)
Command succeeded delete __appendfile (action:13215)
Command succeeded appendfile #!/bin/sh (action:13215)
Command succeeded (file created) appendfile #!/bin/sh (action:13215)
Command succeeded appendfile #!/bin/sh (action:13215)
Command succeeded appendfile /etc/init.d/besclient stop (action:13215)
Command succeeded appendfile /bin/rpm -U __Local/Upgrade/BESClientUpgrade.rpm (action:13215)
Command succeeded appendfile /etc/init.d/besclient start (action:13215)
Command succeeded appendfile /bin/rm -f __Local/Upgrade/BESClientUpgrade.rpm (action:13215)
Command succeeded move __appendfile __Local/Upgrade/besclientupgrade (action:13215)
Command started - wait /bin/sh __Local/Upgrade/besclientupgrade (action:13215)
At 10:08:37 +0000 - actionsite (http://xxxxxxx682.XXX.AAAAA.net:52311/cgi-bin/bfgather.exe/actionsite)
Command failed (Action ended while waiting for another process to complete) wait /bin/sh __Local/Upgrade/besclientupgrade (action:13215)
At 10:08:37 +0000 -
Client shutdown (Service manager stop request)

Current Date: February 26, 2018
Client version 9.2.8.74 built for RedHat 5 x86_64
Current Balance Settings: Use CPU: True Entitlement: 0 WorkIdle: 10 SleepIdle: 480
ICU data directory: '/var/opt/BESClientā€™
ICU init status: SUCCESS
ICU report character set: UTF-8
ICU fxf character set: windows-1252
ICU local character set: UTF-8
ICU transcoding between fxf and local character sets: ENABLED
ICU transcoding between report and local character sets: DISABLED
At 10:08:42 +0000 -
Starting client version 9.2.8.74
FIPS mode disabled by default.
Cryptographic module initialized successfully.
Using crypto library libBEScrypto - OpenSSL 1.0.1t-fips 3 May 2016
Restricted mode
Initializing Site: BES Support

There is nothing there out of the ordinary - the ā€œCommand failedā€ always happens because the agent is being shut down. The issue must be somewhere in the RPM functionality so its possible the RPM db has some issues on this endpoint?

Hi Thanks for your reply. Do you have any hints on what I could get the Linux guys to do? Sorry but the Linux team a separate team all together just wanted to know if there was something like ā€¦ can you check xxxx in RPM

@sauk Iā€™ve had the similar issue. My finding is that our Linux team packages the initial rpm and renames it differently. See below, when using the fixlet to update the client version mine fails the same as yours. I was trying to update a dev box from 9.5.7 to 9.5.8.

At 16:04:16 -0500 - mailboxsite (http://YOURBIGFIXSERVER:52311/cgi-bin/bfgather.exe/mailboxsite3714047)
Relevant - Updated CentOS Linux Client - IBM BigFix version 9.5.8 Now Available! (fixlet:21120)
At 16:04:17 -0500 -
ActionLogMessage: (action:21120) Action signature verified for Downloads
DownloadsAvailable: checking for 'http://YOURBIGFIXSERVER:52311/bfmirror/downloads/21120/0ā€™
DownloadsAvailable: false (action id 21120)
At 16:05:38 -0500 -
DownloadPing command received (ID=21120)
At 16:06:16 -0500 -
Report posted successfully
At 16:06:18 -0500 -
DownloadsAvailable: checking for 'http://YOURBIGFIXSERVER:52311/bfmirror/downloads/21120/0ā€™
DownloadsAvailable: true (action id 21120)
DownloadsAvailable: checking for 'http://YOURBIGFIXSERVER:52311/bfmirror/downloads/21120/0ā€™
DownloadsAvailable: true (action id 21120)
ActionLogMessage: (action:21120) Non-Distributed - DownloadsAvailable
At 16:06:19 -0500 -
ActionLogMessage: (action:21120) Submitting download request
ActionLogMessage: (action:21120) Download url: 'http://software.bigfix.com/download/bes/95/BESAgent-9.5.8.38-rhe6.x86_64.rpmā€™
At 16:06:53 -0500 -
ActionLogMessage: (action:21120) Non-Distributed - DownloadsAvailable
ActionLogMessage: (action:21120) Action signature verified for Execution
ActionLogMessage: (action:21120) starting action
At 16:06:53 -0500 - actionsite (http://YOURBIGFIXSERVER:52311/cgi-bin/bfgather.exe/actionsite)
Command succeeded (Prefetch download manager collected file) prefetch BESClientUpgrade.rpm sha1:9f526a91d3af47925dc44c2d0fa68c830fa6c2df size:16984792 http://software.bigfix.com/download/bes/95/BESAgent-9.5.8.38-rhe6.x86_64.rpm sha256:1e7aacc5ec929206cc92f5579b8c8446fbe9e1ae182233676b89c024225238f7 (action:21120)
Command succeeded (evaluated true) continue if {exists file ā€œ__Download/BESClientUpgrade.rpmā€} (action:21120)
Command succeeded folder delete ā€œ/var/opt/BESClient/__BESData/BES Support/__Local/Upgradeā€ (action:21120)
Command succeeded (evaluated true) continue if {22791178 < free space of drive of client folder of current site} (action:21120)
Command succeeded folder create ā€œ/var/opt/BESClient/__BESData/BES Support/__Local/Upgradeā€ (action:21120)
Command succeeded move __Download/BESClientUpgrade.rpm __Local/Upgrade/BESClientUpgrade.rpm (action:21120)
Command succeeded delete No ā€˜/var/opt/BESClient/__BESData/BES Support/__appendfileā€™ exists to delete, no failure reported (action:21120)
Command succeeded appendfile #!/bin/sh (action:21120)
Command succeeded (file created) appendfile #!/bin/sh (action:21120)
Command succeeded appendfile #!/bin/sh (action:21120)
Command succeeded appendfile /etc/init.d/besclient stop (action:21120)
Command succeeded appendfile /bin/rpm -U __Local/Upgrade/BESClientUpgrade.rpm (action:21120)
Command succeeded appendfile /etc/init.d/besclient start (action:21120)
Command succeeded appendfile /bin/rm -f __Local/Upgrade/BESClientUpgrade.rpm (action:21120)
Command succeeded move __appendfile __Local/Upgrade/besclientupgrade (action:21120)
Command started - wait /bin/sh __Local/Upgrade/besclientupgrade (action:21120)
At 16:06:55 -0500 - actionsite (http://YOURBIGFIXSERVER:52311/cgi-bin/bfgather.exe/actionsite)
Command failed (Action ended while waiting for another process to complete) wait /bin/sh __Local/Upgrade/besclientupgrade (action:21120)
At 16:06:56 -0500 -
Client shutdown (Service manager stop request)

Current Date: March 7, 2018
Client version 9.5.7.90 built for RedHat 6 x86_64 running on sysname:Linux release:2.6.32-696.1.1.el6.x86_64 arch:x86_64
Current Balance Settings: Use CPU: True Entitlement: 0 WorkIdle: 10 SleepIdle: 480
Locale: LC_ALL="" LC_CTYPE="" LC_MESSAGES="" LANG="en_US.UTF-8"
ICU 54.1 init status: SUCCESS
Agent internal character set: UTF-8
ICU report character set: UTF-8 - Transcoding Disabled
ICU fxf character set: windows-1252 (Latin 1 / Western European) - Transcoding Enabled
ICU local character set: UTF-8 - Transcoding Disabled

What I did was stop the BES agent and grep for the RPM:

$]rpm -qa |grep BES
BESAgent-9.5.2.56-rhe5.x86_64
BESClient_server-x86_64-latest.noarch
BESClient-1-latest.noarch

I manually uninstalled the following RPMā€™s as that is what they were being named and removed the client directories. I then reinstalled version 9.5.2 using the client deploy tool and then ran the fixlet to update the client version to 9.5.8. Even though the client successfully updated this time and the console shows fixed, the logs still show failed.

urrent Date: March 7, 2018
Client version 9.5.2.56 built for RedHat 5 x86_64 running on sysname:Linux release:2.6.32-696.1.1.el6.x86_64 arch:x86_64
Current Balance Settings: Use CPU: True Entitlement: 0 WorkIdle: 10 SleepIdle: 480
Locale: LC_ALL="" LC_CTYPE="" LC_MESSAGES="" LANG="en_US.UTF-8"
ICU 54.1 init status: SUCCESS
Agent internal character set: UTF-8
ICU report character set: UTF-8 - Transcoding Disabled
ICU fxf character set: windows-1252 (Latin 1 / Western European) - Transcoding Enabled
ICU local character set: UTF-8 - Transcoding Disabled
At 16:18:33 -0500 -
Starting client version 9.5.2.56
FIPS mode disabled by default.
Cryptographic module initialized successfully.
Using crypto library libBEScrypto - OpenSSL 1.0.1q-fips 3 Dec 2015
Initializing Site: actionsite
Restricted mode
Beginning Relay Select
At 16:18:34 -0500 -

ActionLogMessage: (action:21121) Download url: 'http://software.bigfix.com/download/bes/95/BESAgent-9.5.8.38-rhe6.x86_64.rpmā€™
At 16:34:42 -0500 -
GatherHashMV command received.
Already have this version of site.
At 16:35:16 -0500 -
ActionLogMessage: (action:21121) Non-Distributed - DownloadsAvailable
ActionLogMessage: (action:21121) Action signature verified for Execution
ActionLogMessage: (action:21121) starting action
At 16:35:17 -0500 -
GatherHashMV command received.
Already have this version of site.
At 16:35:17 -0500 - actionsite (http://YOURBIGFIXSERVER:52311/cgi-bin/bfgather.exe/actionsite)
Command succeeded (Prefetch download manager collected file) prefetch BESClientUpgrade.rpm sha1:9f526a91d3af47925dc44c2d0fa68c830fa6c2df size:16984792 http://software.bigfix.com/download/bes/95/BESAgent-9.5.8.38-rhe6.x86_64.rpm sha256:1e7aacc5ec929206cc92f5579b8c8446fbe9e1ae182233676b89c024225238f7 (action:21121)
Command succeeded (evaluated true) continue if {exists file ā€œ__Download/BESClientUpgrade.rpmā€} (action:21121)
Command succeeded folder delete No ā€˜/var/opt/BESClient/__BESData/BES Support/__Local/Upgradeā€™ exists to delete, no failure reported (action:21121)
Command succeeded (evaluated true) continue if {22791178 < free space of drive of client folder of current site} (action:21121)
Command succeeded folder create ā€œ/var/opt/BESClient/__BESData/BES Support/__Local/Upgradeā€ (action:21121)
Command succeeded move __Download/BESClientUpgrade.rpm __Local/Upgrade/BESClientUpgrade.rpm (action:21121)
Command succeeded delete No ā€˜/var/opt/BESClient/__BESData/BES Support/__appendfileā€™ exists to delete, no failure reported (action:21121)
Command succeeded appendfile #!/bin/sh (action:21121)
Command succeeded (file created) appendfile #!/bin/sh (action:21121)
Command succeeded appendfile #!/bin/sh (action:21121)
Command succeeded appendfile /etc/init.d/besclient stop (action:21121)
Command succeeded appendfile /bin/rpm -U __Local/Upgrade/BESClientUpgrade.rpm (action:21121)
Command succeeded appendfile /etc/init.d/besclient start (action:21121)
Command succeeded appendfile /bin/rm -f __Local/Upgrade/BESClientUpgrade.rpm (action:21121)
Command succeeded move __appendfile __Local/Upgrade/besclientupgrade (action:21121)
Command started - wait /bin/sh __Local/Upgrade/besclientupgrade (action:21121)
At 16:35:17 -0500 -
GatherHashMV command received.
Already have this version of site.
At 16:35:19 -0500 - actionsite (http://YOURBIGFIXSERVER:52311/cgi-bin/bfgather.exe/actionsite)
Command failed (Action ended while waiting for another process to complete) wait /bin/sh __Local/Upgrade/besclientupgrade (action:21121)
At 16:35:19 -0500 -
Client shutdown (Service manager stop request)

Current Date: March 7, 2018
Client version 9.5.8.38 built for RedHat 6 x86_64 running on sysname:Linux release:2.6.32-696.1.1.el6.x86_64 arch:x86_64
Current Balance Settings: Use CPU: True Entitlement: 0 WorkIdle: 10 SleepIdle: 480

1 Like

We faced similar issue. The log file showed only 'Command failed (Action ended while waiting for another process to complete). I understood, the other process was restart of BESClient service. However even after restart client log didn;t show any error message or details of why upgrade failed.

However, I tried manual upgrade and it through error stating there was no enough disk space in /opt/IBM/endpoint directory. We increased the space and the upgrade was went through successfully.

Thanks!