learn

Benchmark Website Performance

Website performance benchmarking measures and evaluates your website’s efficiency based on specific metrics related to website responsiveness. It analyzes your site on multiple levels, from user interactions to third-party integrations. Website performance benchmarking aims to provide the right information to optimize your website to deliver a better user experience and outpace competitors.

This article explores different tools and methods used to benchmark website performance. We cover different metrics to consider and other essential overlooked aspects.

Summary of key best practices to benchmark website performance

Concept Description
Focus on key metrics Monitor the essential metrics, such as Core Web Vitals, but don’t forget to determine your unique KPIs.
Simulate real user conditions Evaluate website performance across various devices and network conditions.
Test actual performance Conduct tests at different times to understand how server load and traffic variations impact website performance.
Use multiple tools for comprehensive analysis Leverage a mix of benchmarking tools like Google Analytics, WebPageTest, and Catchpoint to gather data.
Follow industry standards Keep up with evolving industry standards like Core Web Vitals WCAG, and PCI DSS.
Create a baseline and then optimize Establish a performance baseline for benchmarking your website and making data-driven optimization decisions.
Compare with competitors Utilize tools like SimilarWeb and Semrush to benchmark against your competitors and set performance goals.
Monitor your internet stack Monitor your internet stack for an end-to-end view of factors impacting website performance.

Key metrics to benchmark website performance

There are many standardized measures to assess your website. Google’s Core Web Vitals (CWV) evaluate user experience. For example

  • Largest Contentful Paint (LCP) for loading performance.
  • interaction to next paint (INP) for user interaction.
  • Cumulative Layout Shift (CLS) for visual stability.

These metrics can directly impact the user’s perception of your site’s speed and smoothness. This guide explains CWV metrics in depth.

As shown below, Google has established ranges that can benchmark website performance.

Good Need improvement Poor
LCP <=2.5s <=4s >4s
INP <=200ms <=500ms >500ms
CLS <=0.1 <=0.25 >0.25

Beyond the CWV measurements, other website performance metrics include Time to First Byte (TTFB) and overall page load time. Both indicate server and network efficiency. They reveal insights into the latency of your server responses and the time it takes for content to be delivered to the user’s browser.

Besides the standard metrics, there are also custom metrics unique to each type of website. For instance, an e-commerce website might track custom metrics such as “add to cart” button responsiveness or checkout process efficiency, which are directly tied to business KPIs like conversion rates and revenue. The table below gives examples of custom metrics and how they map to standards.

Category Standard Metric Example or Description Custom Metric (E-commerce) KPI
Accessibility WCAG A Level Compliance All non-text content has text alternatives (WCAG 2.1, 1.1.1). Button accessibility on product pages User engagement, conversion rate
Accessibility WCAG AA Level Compliance Content is accessible by keyboard only (WCAG 2.1, 2.1.1) Navigation menu accessibility Bounce rate, user retention
Accessibility WCAG AAA Level Compliance Context-sensitive help available for all forms and crucial site sections (WCAG 2.1, 3.3.5). Accessibility of checkout process Conversion rate
Security Network Security (PCI DSS Requirement 1) Installation and maintenance of a firewall to protect cardholder data. Security of payment gateway Fraud rate, transaction security
Security Data Protection (PCI DSS Requirement 3) Encryption of cardholder data transmitted across open, public networks. Efficiency of the data encryption process Data breaches, compliance rate
Security Access Control (PCI DSS Requirement 7) Restriction of access to cardholder data by business need-to-know. Custom user roles and access management Operational efficiency, security
Performance Page Load Time Standard metric often used to gauge site performance. Load time of "Add to Cart" button User experience, sales volume
Performance Error Rate Rate of errors encountered by users, impacting user experience. Checkout process errors Checkout abandonment rate

How to benchmark website performance

You use different tools to collect data related to your main metrics. Data is collected under different conditions to get a complete picture of website performance. Over time, you improve your website and collect metric data again to check progress.

Simulate real user conditions

Simulate real user conditions and benchmark website performance for different possible scenarios. You will want to test your website and evaluate its performance on different devices, such as smartphones, tablets, desktop computers, and even under different network conditions, like WiFi, 4G, and 5 G. Doing this ensures that your site delivers a consistent and positive experience for diverse user groups.

Tests can be conducted by changing one variable at a time to understand how each factor affects performance. Each test cycle should alter only one variable (e.g., network type, device, or geographic user location) to accurately measure its impact on load time, responsiveness, error rate, and other metrics.

For instance, you might want to test your site's performance on a high-speed WiFi connection across different devices before changing network conditions to 4G or 5G. User location is another variable that needs special attention. Test the server’s capacity and response time variability to understand how geographic dispersion affects performance.

Test actual performance

You can also conduct tests to collect live performance data from actual users accessing your website, also known as real-user monitoring (RUM). You add Javascript tags to the website code. They collect data for different metrics when real users interact with your website. You gain real-time data for different conditions—both peak and off-peak hours. You might find that you need to upgrade your server capacity or budget for scalability.  

Tools

Organizations use a range of monitoring tools for benchmarking.

Google Analytics is a free tool to capture basic data on user behavior, traffic sources, and engagement.

Example Google Analytics dashboard view

Google’s PageSpeed Insights measures page load metrics and provides actionable recommendations for enhancements. Custom scripts within Google Tag Manager help you track customized metrics for your specific use case.

BrowserStack allows you to simulate a wide array of devices and network environments. You can quickly switch between testing environments without needing physical devices, making it easier to assess how different factors impact user experience.

Catchpoint is a comprehensive internet performance monitoring platform that provides a centralized view of your entire website performance, including synthetic and real-user monitoring (explained below). You gain insights into how end users experience your website and how internet stack dependencies impact your service delivery.

WebPageTest, a free offering by Catchpoint, offers a detailed analysis of loading times and interactive readiness. It allows for a more in-depth test of web applications under various network conditions.

Catchpoint Synthetic Monitoring allows you to simulate user interactions from various locations in a controlled environment. You can realistically emulate actual end-user behavior and the full user journey from network nodes around the globe.

Catchpoint Real User Monitoring records metrics related to real user interactions with your website across various devices, browsers, and network conditions. You can benchmark web performance data like response time against business metrics like page views and conversions. You can also create custom metrics specific to your business.

Example of a Catchpoint dashboard showing the performance experience of real users located in different countries.

Best practices to benchmark website performance

Consider the following as you measure website performance.

Follow industry standards

Industry standards ensure your benchmarking efforts are credible and consistent with industry norms. Standards like those set by the Web Content Accessibility Guidelines (WCAG) or Google’s CWV provide frameworks for measuring various website aspects.

For example, under the operability principle, the WCAG standards recommend that.

  • All functionality is accessible via the keyboard
  • Time limits can be adjusted or turned off
  • Content does not flash more than three times per second​.

Similarly, CWV metrics indicate factors that Google considers important in a webpage’s overall user experience. The latest iteration included Interaction to Next Paint (INP) in 2023. Metric standards are constantly being improved, so it is important to remain up-to-date.

Create a baseline and then optimize

You must establish a performance baseline to know where you stand and determine what improvements to make. You’ll want to include core performance metrics that reflect the critical aspects of your website’s user experience and functionality.

Your baseline is whatever you see during initial testing. Tools like Google Analytics, WebPageTest, or others, can help you collect the initial data to establish your baseline. Record the environmental conditions (like server configuration, third-party services used, etc.) and the exact specifications of the tests run.

From there, implement your improvements incrementally. Most speed optimization work focuses on front-end improvement around client-side code and image optimization. But you should also optimize database queries, caching strategies, and overall server configuration. These changes can significantly reduce HTTP wait times and improve your site's perceived responsiveness.

Continuously monitor your metrics to track the impact of any changes. You can configure monitoring tools like Catchpoint to provide real-time alerts when performance metrics degrade beyond a certain threshold.

Compare with competitors

Your competitors are a goldmine of resources—they’ve already done the hard work of building and optimizing their sites. You just need to do it better than them. Analyze how your competitors’ websites perform across various metrics such as load time, user engagement, and overall user experience.  That way, you can set realistic performance goals for yourself.

Tools like SimilarWeb provide insights into competitors’ traffic levels and user engagement, while SEO tools like Ahrefs and Semrush can reveal competitors’ best practices in content and digital marketing strategies. You can see a brief overview of what Semrush shows below:

You can also use tools like Builtwith to understand your competitors’ tech stacks and what technologies they’re using. When you understand how your competition is getting it done, you can identify performance gaps and set achievable goals to improve your website’s performance and user experience.

Monitor your website’s Internet stack

Modern websites often depend on third-party services and APIs to fulfill user requests. You also depend on different internet components like DNS (domain name service), content delivery network (CDN), and BGP (Border Gateway Protocol, used to route traffic between internet service providers) so users can find and interact with your website.

The internet stack that a website depends on for its performance

Their performance impacts the perceived performance of your website, which is why your company’s administrators must have a view of their proper functionality to troubleshoot user experience problems. Catchpoint monitors the internet stack proactively as part of a new monitoring category it pioneered, Internet performance monitoring (IPM). You can learn more about it here.

Conclusion

The business imperative to roll out new features on a website often takes precedence over incremental performance improvements. Engineers often have to convince leadership to invest in performance improvements over new development.

Website performance benchmarking gives you the data you need to demonstrate how faster page loads, reduced downtime, and improved user engagement directly contribute to increased sales and other business KPIs. You gain insights to make the right decisions to improve your website.