High CPU load - IOS actions

(imported topic written by TKMQ_Henrik_Bytoft_Holm)

Hi,

Then I issues a task for one of my IOS devices the Proxyagent.exe service is going 100% CPU load. The load is maintaied ontil the actions completes after ~15-30 min…

The agentlog tells nothing… but the logging comes into chunck every 5-15 min…

The issue drags down the overall perf. of the server… What the hell to do??

Enrollment is basic method, Enrollment site is running on public sig certificate, and all health checks are marked “pass” on the health dashboard

ov 2012 13:47:01 +0100 – Main Thread (1156) – Detected new device report from hbh’s iPad (GB028GVKZ3A).

Thu, 08 Nov 2012 13:47:02 +0100 – Main Thread (1156) – Reregistered Existing Device hbh’s iPad (DYTJ8PXFDJ8T) --> Computer ID 8680001 for plugin <Apple iOS 1>

Thu, 08 Nov 2012 13:47:02 +0100 – Main Thread (1156) – Reregistered Existing Device hbh’s iPad (GB028GVKZ3A) --> Computer ID 264766 for plugin <Apple iOS 1>

Thu, 08 Nov 2012 13:47:02 +0100 – Main Thread (1156) – New version of site http://tem.dansupport.dk:52311/cgi-bin/bfgather.exe/actionsite found, loading content from version 900.

Thu, 08 Nov 2012 13:49:59 +0100 – Service Thread (1136) – Received stop request

Thu, 08 Nov 2012 13:57:48 +0100 – Main Thread (2824) – Starting Proxy Agent 8.2.40030.0…

Thu, 08 Nov 2012 13:57:50 +0100 – Main Thread (2824) – Found 5 active devices…

Thu, 08 Nov 2012 13:57:50 +0100 – Main Thread (2824) – These devices will be included in refresh requests.

Thu, 08 Nov 2012 13:57:50 +0100 – Main Thread (2824) – Loading sites previously gathered on disk…

Thu, 08 Nov 2012 13:57:50 +0100 – Main Thread (2824) – Loading site http://sync.bigfix.com/cgi-bin/bfgather/bessupport

Thu, 08 Nov 2012 13:57:51 +0100 – Main Thread (2824) – 514 new or changed fixlets found.

Thu, 08 Nov 2012 13:57:51 +0100 – Main Thread (2824) – 55 new or changed properties found.

Thu, 08 Nov 2012 13:57:51 +0100 – Main Thread (2824) – Loading site http://sync.bigfix.com/cgi-bin/bfgather/besinventory

Thu, 08 Nov 2012 13:57:51 +0100 – Main Thread (2824) – 38 new or changed fixlets found.

Thu, 08 Nov 2012 13:57:51 +0100 – Main Thread (2824) – 208 new or changed properties found.

Thu, 08 Nov 2012 13:57:51 +0100 – Main Thread (2824) – Loading site http://sync.bigfix.com/cgi-bin/bfgather/bigfixlabs

Thu, 08 Nov 2012 13:57:51 +0100 – Main Thread (2824) – 9 new or changed fixlets found.

Thu, 08 Nov 2012 13:57:51 +0100 – Main Thread (2824) – 6 new or changed properties found.

Thu, 08 Nov 2012 13:57:51 +0100 – Main Thread (2824) – Loading site http://sync.bigfix.com/cgi-bin/bfgather/mdm

Thu, 08 Nov 2012 13:57:51 +0100 – Main Thread (2824) – 108 new or changed fixlets found.

Thu, 08 Nov 2012 13:57:51 +0100 – Main Thread (2824) – 124 new or changed properties found.

Thu, 08 Nov 2012 13:57:51 +0100 – Main Thread (2824) – Loading site http://tem.dansupport.dk:52311/cgi-bin/bfgather.exe/actionsite

Thu, 08 Nov 2012 14:14:09 +0100 – Main Thread (2824) – 50 new or changed fixlets found.

Thu, 08 Nov 2012 14:14:09 +0100 – Main Thread (2824) – 49 new or changed properties found.

Thu, 08 Nov 2012 14:14:09 +0100 – Main Thread (2824) – 79 new or changed actions detected.

Thu, 08 Nov 2012 14:14:09 +0100 – Main Thread (2824) – 168 new or changed analysis activations detected.

Thu, 08 Nov 2012 14:14:09 +0100 – Main Thread (2824) – Loading site http://tem.dansupport.dk:52311/cgi-bin/bfgather.exe/CustomSite_0000_-2d_Shared_content

Thu, 08 Nov 2012 14:14:09 +0100 – Main Thread (2824) – Loading site http://tem.dansupport.dk:52311/cgi-bin/bfgather.exe/CustomSite_0001

Thu, 08 Nov 2012 14:14:09 +0100 – Main Thread (2824) – 1 new or changed fixlets found.

Thu, 08 Nov 2012 14:14:09 +0100 – Main Thread (2824) – Loading site http://tem.dansupport.dk:52311/cgi-bin/bfgather.exe/CustomSite_0004

Thu, 08 Nov 2012 14:14:09 +0100 – Main Thread (2824) – 1 new or changed fixlets found.

Thu, 08 Nov 2012 14:14:09 +0100 – Main Thread (2824) – Loading site http://tem.dansupport.dk:52311/cgi-bin/bfgather.exe/opsite104

Thu, 08 Nov 2012 14:14:09 +0100 – Main Thread (2824) – Loading site http://tem.dansupport.dk:52311/cgi-bin/bfgather.exe/opsite2

Thu, 08 Nov 2012 14:14:09 +0100 – Main Thread (2824) – 3 new or changed actions detected.

Thu, 08 Nov 2012 14:14:09 +0100 – Heartbeat Thread (3856) – Heartbeat interval expired, triggering refresh of all Apple iOS 1 devices. Next refresh in 2 hours.

Thu, 08 Nov 2012 14:14:09 +0100 – Plugin Invocation Thread (3896) – Launching plugin: “C:\Program Files (x86)\BigFix Enterprise\Management Extender\Plugins\Apple iOS 1\plugin\iOSProxyPlugin.exe” --configOptions “port=52315;passwordFile=C:\Program Files (x86)\BigFix Enterprise\Management Extender\Plugins\Apple iOS 1\plugin\plugin.pw” --commandDir “C:\Program Files (x86)\BigFix Enterprise\Management Extender\Plugins\Apple iOS 1\PendingRefreshes”

Thu, 08 Nov 2012 14:14:10 +0100 – Main Thread (2824) – New version of site http://tem.dansupport.dk:52311/cgi-bin/bfgather.exe/actionsite found, loading content from version 909.

Thu, 08 Nov 2012 14:29:45 +0100 – Main Thread (2824) – 5 new or changed actions detected.

Thu, 08 Nov 2012 14:29:45 +0100 – Main Thread (2824) – New action <1875> targeted by ID or Computer Name detected, requesting refresh of computer <2825276> in plugin <Apple iOS 1>.

Thu, 08 Nov 2012 14:29:45 +0100 – Main Thread (2824) – New management rights or subscription action <1882> detected, requesting refresh of all devices.

Thu, 08 Nov 2012 14:29:45 +0100 – Main Thread (2824) – Removing expired or stopped action <1854>.

Thu, 08 Nov 2012 14:29:45 +0100 – Main Thread (2824) – Removing expired or stopped action <1858>.

Thu, 08 Nov 2012 14:29:45 +0100 – Main Thread (2824) – Removing expired or stopped action <1859>.

Thu, 08 Nov 2012 14:29:45 +0100 – Main Thread (2824) – Removing expired or stopped action <1860>.

Thu, 08 Nov 2012 14:29:45 +0100 – Main Thread (2824) – Removing expired or stopped action <1861>.

(imported comment written by Ivan.FPL)

Same here…

Our extender is running on 2 cores and 4GB RAM. Memory usage hovers at around 2GB, but the load on the CPU will be at mostly 100% for a few minutes before things calm down enough to where devices and actions respond quickly again. We have approximately 1,000 devices enrolled in MDM.

(imported comment written by TKMQ_Henrik_Bytoft_Holm)

ExtraInfo info

It tales 45-75 min for actions to reach the devices…

Er have only enrolled ~50 devices.

Dual core virtual server 4gb ram

Any hints or ideas? Anyone?

(imported comment written by BenKus)

Hey guys,

The Management Extender for iOS has a lot of work to do to communicate with the iOS devices (using HTTPS, which is a CPU-hungry protocol) and to evaluate Fixlets/properties/analyses/etc. (using the ProxyAgent).

We try to do these things as fast as possible, which is why you see the CPU spike when you are deploying actions/Fixlets/etc and the high CPU by itself should not be an issue… and since we expect a high peak-load for Management Extenders, we don’t recommend you share the Management Extender server with other functions that might be irritated by the high CPU.

If you Management Extender is a VM, we recommend you dedicate the CPUs to the server to help accommodate the load.

Ivan, your experience sounds normal where the CPU spikes to handle the HTTPS connections and reporting for the thousand devices.

Henrik, if you only have 50 devices, I wouldn’t expect the CPU to spike for very long… Can you confirm if your VM has dedicated CPUs? Also, what is your refresh interval for iOS devices (the default is 6 hours).

In general, if you want to be able to handle the devices faster, you can dedicate some more CPUs to the server.

Ben