Performance Optimizations for Operations Manager 2007 R2 and 2012

Please Note:   This blog has been updated to provide guidance on which settings are applicable to Operations Manager 2012.

This blog post is based on questions that people who attended our MMS 2010 session BB23 – Operations Manager 2007 SQL Server Configuration for Operations Manager 2007 Administrators. You know as I was typing the name of the session, I realize it is way too wordy.  In retrospect I could have simply named it, “Optimizing SQL Server for Operations Manager 2007”.  Here Chris Cubley and I delivered this at our internal TechReady conference in June with some spit and polish applied, and I did not think of it then. I digress…okay moving on

In our session we covered optimizations that are specific to Operations Manager 2007 R2 and these optimizations are applicable to a management group supporting an enterprise scenario (1,000 – 6,000+ agents). There is no performance benefit to be gained if you apply these settings to a management group that is managing less than 1,000 agents.

Management Server Health Service - OM 2007 R2

The recommended settings highlighted in this section are only applicable to Operations Manager 2007 R2. In Operations Manager 2012, the default settings for these Registry keys for the Health Service have higher values and are already optimized out of the box (at this point). 

The following are specific settings with recommended values from the product group based on their performance and scalability tests that can reduce resource utilization on the SQL Servers hosting the Operations Manager databases, and the management servers/Root Management Server:

To reduce resource utilization impact on the Root Management Server and management servers caused by the OpsMgr queues, perform these changes on the RMS/MS’s in the management group:

Registry Path

Registry Value (DWORD)

HKLM\SYSTEM\CurrentControlSet\Services\HealthService\Parameters\Persistence Cache Maximum

102400

HKLM\SYSTEM\CurrentControlSet\Services\HealthService\Parameters\Persistence Version Store Maximum

10240

HKLM\SYSTEM\CurrentControlSet\Services\HealthService\Parameters\State Queue Items (See note below)

20480

HKLM\SYSTEM\CurrentControlSet\Services\HealthService\Parameters\Persistence Checkpoint Depth Maximum

104857600

Note: This key does not exist by default and must be created manually.

Management Servers Config Service and Group Membership Calculation - OM 2007 R2 and OM 2012

In an Operations Manager 2007 R2 management group, to reduce resouce utilization on an Operations Manager 2007 R2 Root Management Server, perform the changes highlighted in the following table.  In an Operations Manager 2012 management group, only perform modify the Group Calculation Polling Interval highlighted in the following table on all management servers that are a member of the "All Management Servers Resource Pool" (which technically is every management server deployed in your management group, unless you have dedicated one or more management servers to a custom-defined pool for Network Device or Cross-Platform monitoring and have manually assigned management servers to the "All Management Servers Resource Pool").  The Config Service Polling Interval setting is not relevant to Operations Manager 2012, as the configuration settings related to the Config Service are defined in the ConfigService.Config xml file and there are a few modifications required in order to modify the polling interval.  This is noted in Kevin Holman's blog article.

Registry Path

Registry Value (DWORD)

HKLM\SOFTWARE\Microsoft\Microsoft Operations Manager\3.0\Config Service\Polling Interval Seconds

00000078           (2 minutes)

HKLM\SOFTWARE\Microsoft\Microsoft Operations Manager\3.0\GroupCalcPollingIntervalMilliseconds

000dbba0         (15 minutes)

Note: These Registry keys do not exist by default and must be created manually.

Before changing the Group Calculation interval I should point out a few things to help you make a well informed decision. By default group calculation is performed on the RMS every 30 seconds. In a management group supporting the enterprise scenario, you will typically see many custom groups defined for targeting overrides, scoping of user roles, and for controlling the behavior of notification subscriptions (at a minimum). Group calculation discovery rules can impact the performance of the OperationsManager database, as the behavior characteristics are queries run against the database instance space in the form of multiple read operations. If you have lot of groups and their group calculation criteria are complex, it will have a big hit on database performance. Other operations in the management group could be affected as well, such as slower discovery insertion, degraded console performance, and replication of configuration changes to agents is slower. Precisely how much degradation you’ll see in these other areas is predicated upon how much group calculation is overloaded.

Changing the calculation interval to a greater value could affect any overrides that target a group, since an object that would fall under the criteria of a group would not relate to that group and receive the override until the group calculation is performed. If you can tolerate the latency of group membership discovery, then you can increase the interval/frequency to a less frequent schedule, say every four or eight hours as an example.

Data Warehouse Synchronization - OM 2007 R2 and 2012

For reduced resource utilization impact on the OperationsManager databases caused by DW synchronization rules running on the RMS in an Operations Manager 2007 R2 management gorup or the management servers in an Operations Manager 2012 management gorup, create overrides in the Operations Manager console for the following rules to increase the interval and batch size of those operations:

Class

Rule/Monitor Name

Override Parameter

Override Value

Data Warehouse Synchronization Server

Data Warehouse monitor initial state synchronization rule

Batch Generation Frequency Seconds

300

Data Warehouse monitor initial state synchronization rule

Batch Size

1000

Data Warehouse object synchronization rule

Batch Generation Frequency Seconds

300

Data Warehouse object synchronization rule

Batch Size

1000

Data Warehouse report deployment rule

* Management Pack List Frequency Seconds

600

Data Warehouse report deployment rule

*Management Pack List Frequency Seconds

550

Data Warehouse report deployment rule

*Management Pack List Frequency Seconds

500

Data Warehouse managed object type synchronization rule

Batch Generation Frequency Seconds

300

Data Warehouse managed object type synchronization rule

Batch Size

1000

Data Warehouse relationship synchronization rule

Batch Generation Frequency Seconds

300

Data Warehouse relationship synchronization rule

Batch Size

1000

*Note: This override parameter actually affects three data sources referenced in this rule.

Console Refresh - OM 2007 R2 and OM 2012

The Operations Manager Console refresh interval is every 15 seconds by default. With multiple consoles in an enterprise scenario, this can negatively impact performance. For best performance, turning off Polling or increasing the interval can help. Perform this change on any Windows computer that has the console installed:

Registry Path

Registry Value (DWORD)

HKCU\Software\Microsoft\Microsoft Operations Manager\3.0\console\CacheParameters\ PollingInterval

0 – 10 (0 turns off automatic refresh and requires manual refresh via F5. The value 1 through 10 increments the refresh interval every 15 seconds. The maximum value of 10 is a refresh interval of 2 min 30 seconds).

Before making any changes, always test first and evaluate the results before implementing them in production.  If you make them in production due to constraints in being able to appropriately test/validate in your test lab, first establish a performance baseline before making any of the proposed changes stated here.  After each change, perform another performance measurement and compare it to the initial baseline statistics to determine if the results are above or below the baseline.

Comments

  • Anonymous
    January 01, 2003
    Would you recommend upping of these numbers for 8500 agents? Brian

  • Anonymous
    January 01, 2003
    The comment has been removed

  • Anonymous
    September 13, 2010
    The comment has been removed

  • Anonymous
    January 12, 2011
    Hi Matt Thanks for the great article. One thing, can you confirm if the registry values are Hex or Decimal values please ? Many Thanks Trevor

  • Anonymous
    January 12, 2011
    Matt, thanks for this post. We have large deployment and implemented some complex group membershiprules, so this is very handy. Question, are you sure the key 'HKLMSYSTEMCurrentControlSetServicesHealthServiceParametersPersistence Checkpoint Depth Maximum' is 104857600 and not 10485760? Default setting is 20971520. 10485760 is a 50% decrease. 104857600 is 500% increase. Thanks, Michiel

  • Anonymous
    January 16, 2011
    Trevor, The Registry values are in decimal format.

  • Anonymous
    January 19, 2011
    The comment has been removed

  • Anonymous
    June 04, 2012
    is there such a modification available for SCOM2012, too?

  • Anonymous
    September 19, 2012
    I'll be updating ths blog tonight to share details on what is/what isn't applicable for OM 2012.  Stay tuned!

  • Anonymous
    May 02, 2013
    Hello Matt, "first establish a performance baseline before making any of the proposed changes stated here" Do you have a list of reports/views which will give us the picture of the environemnt for this purpose. Thanks, Dom

  • Anonymous
    December 28, 2013
    Here’s a new Knowledge Base article we published today on SCOM 2007. This one talks about configuration

  • Anonymous
    December 28, 2013
    Pingback from How to detect and troubleshoot frequent configuration changes in Operations Manager 2007 - Safranka M??ty??s szakmai blogja - TechNetKlub

  • Anonymous
    December 28, 2013
    Pingback from How to detect and troubleshoot frequent configuration changes in Operations Manager 2007 - System Center Mindenkinek - TechNetKlub

  • Anonymous
    January 17, 2014
    A small, but usefull link collection to use for configuration and upgrading System Center Operations

  • Anonymous
    March 19, 2014
    The Registry Path does not exist in scom 2012!!!

  • Anonymous
    April 01, 2014
    I'm using SCOM 2007 R2, In my alert view if I change the resolution state value let's say from New to Acknowledged and save the changes. The console don't reflect this change as being made. This behavior is consistent on several different consoles and if I double click the alert it do show correctly but the console is still not updated. Do anyone have any suggestions?

  • Anonymous
    June 25, 2014
    There are many articles on tweaking certain registry settings for SCOM agents, Gateways, and Management

  • Anonymous
    April 14, 2016
    I do miss the parameter Maximum Global Pending Data Count in this blog.

    Also, i'm having doubts about Persistence Cache Maximum

    In this PDF ( http://download.microsoft.com/download/8/2/8/828C05A2-E6A0-436A-9AE1-704A8005E355/9780735695825.pdf ) they say;

    Another important setting is Persistence Cache Maximum of type DWORD. This setting controls the amount of memory in pages used by Persistence Manager for its data store on the local database. The default value for this is 262144 (decimal), which is also the recommended value. If you are running an older version of Operations Manager on management servers that manage a large number of objects, you should change the value to 262144 (decimal).

    The default and recommended values are the same here, i think that is a mistake, but still the numbers are much higher than addressed here (102400).

  • Anonymous
    April 14, 2016
    Persistence Version Store Maximum
    The default according to https://support.microsoft.com/en-us/kb/975057 is 5120 (80 megabytes) for a Management Server.
    This seems very low to me. The recommended value from this blog is 10240, which seems too low as well. I've set this to 131072 (which is 2GB i believe) which according to the pdf i posted above is the default!

    Persistence Manager also stores different versions of the data store. The DWORD Persistence Version Store Maximum setting controls how much memory (in pages) the version store can have. The default value is 131072 (decimal). On management servers where you have increased the value for Persistence Cache Maximum, you might also want to increase the value of Persistence Version Store Maximum.