The full company list, product list, methodology, and notes can be found here.
This post focuses only on the results of the testing in the Enterprise price bracket for WordPress Hosting.
- 1 Other Price Tier Results
- 2 Enterprise Hosting Introduction
- 3 Hosting Plan Details
- 4 Load Storm Testing Results
- 5 Load Impact Testing Results
- 6 Uptime Monitoring Results
- 7 WebPageTest.org Results
- 8 WPPerformanceTester Results
- 9 Qualsys SSL Report Grade
- 10 Conclusion
Other Price Tier Results
Enterprise Hosting Introduction
The Enterprise testing this year had some fundamental differences from all the other price tiers that needs to be disclosed. These are complex and expensive systems that are normally customized on a per-customer basis by hosting companies. They all offer a much more hands on experience than hosting plans at the other end of the spectrum and charge accordingly. For that reason, the testing criteria are slightly different for the Enterprise tier.
The first change is there is no default setup, which is what I test in every other price tier. The companies were given explicit permission to customize their platform and knew what tests were coming their way. If the plans didn't perform as well as expected, their teams were allowed to optimize the configuration to attempt to improve performance. This is what I would expect from plans charging hundreds, if not thousands of dollars per month for large sites. So I wanted to let them perform their normal services for this tier.
The second major change is all sites were forced to use SSL (HTTPS) while every other plan tested in other price tiers were HTTP (the exception being Liquid Web which didn't want to disable SSL).
The third change is there is an additional test, an SSL test which was another non impacting metric.
Hosting Plan Details
Click the table below to see the full product specifications sheet.
Load Storm Testing Results
This test scaled from 500 to 10,000 users over 30 minutes with 10 minutes at the peak.
|Total Requests||Total Errors||Peak RPS||Average RPS||Peak Response Time(ms)||Average Response Time (ms)||Total Data Transferred (GB)||Peak Throughput (MB/s)||Average Throughput (MB/s)|
Kinsta, Pantheon [Reviews], PressLabs, SiteGround [Reviews], WordPress.com VIP and WPEngine [Reviews] all handled this test without issue. Pressable had the same Tokyo issue but otherwise was just fine.
Nexcess struggled slightly towards the end of the test mainly with the login portion which bursts the cache and likely the heaviest page to load during the test.
Load Impact Testing Results
This test scaled from 1 to 5000 users over 15 minutes. Error count capped at 5,000.
|Requests||Errors||Data Transferred (GB)||Peak Average Load Time (Seconds)||Peak Average Bandwidth (Mbps)||Peak Average Requests/Sec|
Nexcess struggled towards the end of this test showing increased response times and errors.
Uptime Monitoring Results
Overall, at the Enterprise level nobody struggled keeping the servers online. I would be shocked if that wasn't the case considering the cost and architecture of these systems.
|WPT Dulles||WPT Denver||WPT LA||WPT London||WPT Frankfurt||WPT Rose Hill, Mauritius|
|WPT Singapore||WPT Mumbai||WPT Japan||WPT Sydney||WPT Brazil|
There isn't a whole lot to say since this is a non-impacting metric in terms of the results. Nobody had huge issues.
I looked at the aggregate change again for the locations which were similar. There were 7 companies last year in this price bracket and we moved up to 8 this year. Across the nine same locations used, there was a cumulative decrease in response time of 3.58 seconds. For instance, Dulles dropped from 0.86 to 0.47 seconds on average.
I also thought it could be interesting to see what the average response time around the world was by company.
Average WPT Response Time
Pantheon and WordPress.com VIP seem to have the fastest delivery around the world with Presslabs following close behind.
|PHP Bench||WP Bench|
Presslabs had the fastest PHP bench and Kinsta had the fastest WP bench.
The average PHP bench went from 9.86 to 9.72 from the 2016 benchmarks in this price tier. The average WP bench went from 383 to 582. The PHP and WP bench both improved for this price tier, with the WP bench getting significantly faster.
WP Bench Historical Performance
One thing to note is that WP bench scores can vary tremendously based on the database architecture. You'll often see faster scores on architectures running the database locally compared to ones that run separately or have redundancy built in.
Qualsys SSL Report Grade
The tool is available at https://www.ssllabs.com/ssltest/
|Company||Qualsys SSL Report Grade|
There's very little to say here. Presslabs stands out because they earned an A+ but everyone else was an A.
Kinsta, Pantheon [Reviews], Pressable, PressLabs, SiteGround [Reviews], WordPress.com VIP, and WPEngine [Reviews] all earned Top Tier status this year for going through all the tests without any significant issues.
Individual Host Analysis
Kinsta had a perfect run at the Enterprise tier. This is why people shell out top dollar for Enterprise level hosting. Kinsta had perfect 100% uptime on both monitors. They also had 0 errors on both load tests and the lowest peak response time on the Load Storm test. A Top Tier Performance was rightly earned.
Nexcess had good uptime. The load tests were just out of the good range though. Load Impact started to show signs of load towards the end with increased response times and errors. Load Storm looked quite stable except it started to error out towards the end despite keeping a flat average response time. I'm sure they will be back next year with improved performance though watching how hard they were working to improve their entire WordPress stack throughout this testing. I'm glad to see another company jumping in at the Enterprise tier.
Pantheon [Reviews] had another near perfect run with 100% uptime on both monitors. A perfect Load Impact test with no errors. Just a handful of errors on the Load Storm test. Pantheon also consistently had some of the fastest delivery around the world in the WebPageTest tests at the Enterprise and lower price tiers. A Top Tier award was well deserved for Pantheon this year.
Pressable. Great uptime. Great Load Impact test. Again the weird Tokyo data center issue with Load Storm. It didn't impact it much though and Pressable earns another Top Tier award in the Enterprise category.
A regular in our testing, this is the first year PressLabs jumped up to compete in the Enterprise tier. And they did fantastic. 100% uptime. Almost no errors on Load Storm and a perfect Load Impact test. They even had the best rating on their SSL certificate. Great to see Presslabs jump up to play with the biggest boys and earn a Top Tier performance award.
SiteGround [Reviews] is another regular in our testing, generally in the lowest price tiers, for the first time jumped into the Enterprise category. They've historically done pretty well earning many Top Tier and honorable mentions over the years. The Enterprise tier didn't disappoint. SiteGround had good uptime and a measly 22 errors from the Load Storm and Load Impact tests combined. Another Top Tier performance for SiteGround in a new price tier, great to have them stepping up their offerings and delivering.
WordPress.com VIP. Maybe the biggest name in the Enterprise WordPress space, they've participated for the second consecutive year in the Enterprise category. They had good uptime and a total of 9 cumulative errors between the Load Storm and Load Impact tests. Their underlying infrastructure seems to have improved substantially from last year according to the WP bench which tests database performance. It was already top notch, but they apparently aren't slacking under the hood either. They also were delivering content the fastest on average around the world in the WebPageTest tests. Another Top Tier Performance award easily earned for WordPress.com VIP.
After a disappointing result last year in the Enterprise category, WPEngine [Reviews] came back with a vengeance. They submitted the most expensive plan in the category and their performance lived up to expectations. They had good uptime. They had minimal errors on the Load Impact and Load Storm tests. They earned Top Tier status this year, it's nice to see WP Engine can deliver at the Enterprise level.
Other Price Tier Results
Latest posts by Kevin Ohashi (see all)
- ICANN Fails the Internet Community, allows an unlimited non profit tax - July 1, 2019
- The Case for Regulatory Capture at ICANN - June 24, 2019
- Ethics and One Tweet’s Impact on Digital Ocean - June 6, 2019