Compare User Experience and Device Health in Your Organization with Similar Companies in the Industry (Benchmark)

Use the Aternity Benchmark dashboard to compare your company users experience with other Aternity customers and their monitored devices.

Aternity monitors over 500 customers globally and millions of end points are reporting to Aternity SaaS platform. The Benchmark feature enables you to compare the performance of users’ devices and applications to other Aternity customers and to understand the overall status of your IT. The Benchmarking considers the geographical location, the industry and the size of the company and provides different views of the data. Aternity is releasing now the first version of the feature and planning to add more capabilities in future releases allowing to drill down into specific application and into device's hardware.

For example, you can improve your overall score by resolving boot issues and MS Office performance.

See the distribution of various Aternity customers as of device health and application performance

See more about Aternity DEM-QTM on our YouTube channel.

To... Do This...

Allow a successful benchmarking by assigning your Industry and/or Company size

Sign in to Aternity. Hover over the panel, click the gear icon , and select My Account.

Select your industry and the amount of employees in your organization. Now you can see in the Benchmark dashboard the level of device health and user experience in your organization comparing to other companies in this industry. Learn more.
Define the industry and size of your company to get a precise benchmark
Tip

You are not limited to compare your business only within the same industry or size segment. Regardless of how you defined your company in the My Account screen, you can still compare your own business to a comparing business processes and performance of other Aternity customers if you change filters at the top of the DEM-Q screen. This way if you are performing in different business fields or have many subsidiaries you still see where you stand comparing to others.

Open the Benchmark dashboard

Sign in to Aternity and select Main Menu > Benchmarks (Premium).

On the DEM-Q dashboard, see Application Performance Score and Device Health Score:
  • Application Performance Score: The Performance score rates the performance of applications across your organization compared to other organizations based on activities performance and other application performance measures.

  • Device Health Score: The Health of the device is based on the Stability Index which is a WIndows score (from 1 to 10) of a PC's overall stability.

Tip

This dashboard shows the data for the last three months.

Locate your company on the graph

A small red square between all other dots on the graph is your company.
See the scores for your company

Each dot represents a company/customer account that Aternity monitors.

Note

At least three companies of the same industry are necessary for benchmarking. If less, it is not enough for comparing and the graph won't present data.

The tooltip shows company industry and size, if predefined in the My Account administration screen. If not, the tooltip shows Coming Soon.

Discover where you stand comparing to other Aternity customers

In the DEM-Q tab, see the scores at the right side of the screen (on gauge widgets).

When data shows on the dashboard, the light bulbs change to the gauge widgets that show your company-specific scores.

Understand the Did You Know? light bulbs

In the DEM-Q tab, see the scores at the right side of the screen. In addition, every time when the console refreshes, see one Did you know? bulb that brings interesting general facts about industry and provides essential facts about computers, software or browsers. Randomly, upon every refresh another light bulb will show.

Understand the colors of your scores and where you are comparing to others

Here is the legend for colors of your gauge widgets:
  • Green means you are within the top 70% in industry

  • Yellow means you match 15-30% in industry

  • Red means you are on the low side within 15% in industry

Learn where you stand comparing to other companies

Compare your company with companies in all regions or in a certain region only

In the DEM-Q tab, select the required Region at the top right side of the screen.
Select certain region or all regions to show on the comparison graph

Compare your company with companies in the same industry

In the DEM-Q tab, select the required Industry at the top right side of the screen.
Select your industry or all industries to show on the comparison graph

Compare your company with the companies of the same size

In the DEM-Q tab, select the Company Size at the top right side of the screen.
Select your company size or all sizes to show on the comparison graph

To analyze the selected KPIs and to compare between required measurements

Go to the Analyze tab and select what Health KPI and Performance KPI to display on the graph. For example, you can see that your apps response time is very high and can be improved, or that crash frequency is low enough which is good.

To visualize results on the graph by coloring attributes

Go to Analyze and color the data presented on the graph by an attribute, like Region, Company size allowing a more convenient view and ease of analysis.

For example, quickly see the distribution of activity response time in different regions where green presents APAC and yellow presents Europe.

Color results for easy filtering

Select the Health KPI for comparison

Go to the Analyze and select what Health KPI to display on the graph.
Select Health KPI to see on the graph

Health KPI measures the percentage and averages of errors, hangs, and crashes from all monitored devices.

The graph allows you to compare your Health KPI with other Aternity customers.

Field Description
Stability Index

The stability index (used to be reliability value) is a Windows score (from 1 to 10) of a PC's overall stability (search in Windows for the Windows Reliability Monitor). As the number and severity of errors increases, it lowers the stability index. Aternity displays the average for the previous day, or, if unavailable, it shows the most recent daily average. The server versions of Windows do not have this measurement, and therefore would not report it to Aternity.

Hours Between Crashes

The Hours Between Crashes is the number of hours that passes on average between crashes which occurred in an application during the total usage time.

Aternity monitors the performance of all applications which are automatically discovered. These include managed applications which have their own defined activities.

Hang Percent

This KPI measures the percentage hang time out of the total wait time for each customer.

Hang time measures the time when an application is listed as Not responding in the Windows Task Manager while it is in the foreground (in use). This measurement is used to calculate the wait time of an application, and the overall UXI.

Hours Between BSODs

The Hours Between BSOD is the number of application usage hours that pass on average between BSOD errors which happened during the total usage time. BSOD is a stop error, commonly called the blue screen of death. The Hours Between BSOD are calculated as total usage time divided by number of BSODs.

For more details about the measurements, hover over one of the dots and see the values for the selected KPI.
View the exact value for each KPI

Compare your company Performance KPI to other companies

Go to the Analyze tab and select what Performance KPI (measurements) to display on the graph for analysis.
Select performance KPI for the graph

Performance KPI measures the percentage and averages of response time, boot time, wait time, and load time from all monitored applications.

The graph allows you to compare your Performance KPI with other Aternity customers.

Field Description
Activity Response

An activity response is the time taken for an application to complete an activity in seconds. The time also has a severity status based on its expected time (measured using baselines or manual or SLA thresholds). For example, if the time required to launch an application is much slower than recent baselined measurements, it might be classed as Major.

An activity is a user action which you monitor for performance, like a mouse click or a key press, to measure the time until the app's GUI responds, known as the activity response time. In Aternity, you can compare response times in any app across the enterprise, and troubleshoot performance by seeing when they perform slower. For example, you can monitor the launch of an application, or the time it takes for an application to respond to a menu choice.

In Aternity, you can compare response times in any app across the enterprise, and troubleshoot performance by seeing when they perform slower.

Average Boot Time

This KPI measures the Average Boot Time which is the average of the Total Boot Time.

The total boot time on a Windows device starts from the time the Windows logo appears until the desktop appears and all components are loaded.

Wait Time Percent

This KPI measures the percentage wait time out of the usage time.

The wait time of a Windows application is defined as the time users spend waiting for the application to respond when it is actively running and in use (part of the usage time).

The total wait time is calculated as the time covered by the following components (which may overlap): the hang time when an application is not responding, or when the mouse pointer has a busy icon (Windows devices). For web applications, the wait time is the web page load time when both the browser window and its tab are in the foreground.

For web applications, the wait time is the web page load time when both the browser window and its tab are in the foreground.

Average Web Page Load Time

This KPI measures the average of the web page load time from all web pages load time.

The web page load time is the time required for a web page to load and finish rendering in a browser, from sending a URL request to when the page's events finish loading and it has a status of Completed. This measurement does NOT include the time to load additional page elements which occur after the main page has loaded, such as iframes that are embedded separate web pages, AJAX calls after the page is complete, or bookmarks with # in the URL). It does include AJAX calls that the page makes before it is complete.

For more details about the measurements, hover over one of the dots and see the values for the selected KPI.

Drill-down to your dashboards

Drill-down from the Benchmark dashboards to your specific dashboards for further analysis by hovering over Your Company and selecting in the tooltip the required dashboard's link (Analyze Applications or Device Health).

Select a dashboard in your account to view the details