Sponsored by LoadStorm. The easy and cost effective load testing tool for web and mobile applications.
The full company list, product list, methodology, and notes can be found here
This post focuses only on the results of the testing in the $201-500/month price bracket for WordPress Hosting.
Other Price Tier Results
<$25/Month Tier$25-50/Month Tier$51-100/Month Tier$101-200/Month Tier$201-500/Month Tier$500+/Month (Enterprise) Tier
$201-500/Month WordPress Hosting Products
$201-500/Month WordPress Hosting Performance Benchmarks Results
1. Load Storm
Test 500-5000 Concurrent Users over 30 Minutes, 10 Minutes at Peak
|Company||Total Requests||Total Errors||Peak RPS||Average RPS||Peak Response Time(ms)||Average Response Time(ms)||Total Data Transferred (GB)||Peak Throughput (MB/s)||Average Throughput (MB/s)|
Discussion of Load Storm Test Results
Kinsta and Pressidium were clearly the two best performers in this test.
Pressable had some minor issues that looked like they may have been security related to wp-login.
MediaTemple [Reviews] had a spike of errors at the very end and some minor errors throughout the test that might have been security related since they didn't impact response times at all.
PressLabs had some spikes and wp-login related problems but the server started to slow down its response times as the test progressed.
Pantheon [Reviews] had similar issues to PressLabs with slowing down and the largest chunk being wp-login related.
SiteGround [Reviews] started to have trouble around 12 minutes in and saw spikes, also mostly related to wp-login/admin. They also had increased and unstable response times associated with the spikes.
Pagely [Reviews] struggled the most with this test with spikes and increased response times. wp-login again was the worst offender.
What is amazing is none of these companies completely failed with 5000 real users logging in and bursting caches.
Test 1-3000 Concurrent Users over 60 seconds
Blitz Test Quick Results Table
|Company||Hits||Errors||Timeouts||Average Hits/Second||Average Response Time||Fastest Response||Slowest Response|
Discussion of Blitz Test 1 Results
This test is just testing whether the company is caching the front page and how well whatever caching system they have setup is performing (generally this hits something like Varnish or Nginx).
Who performed without any major issues?
Kinsta, Pantheon, Pressable, Pressidium, PressLabs, and SiteGround [Reviews] all had close to no errors (and exactly none in PressLabs's case).
Who had some minor issues?
Pagely [Reviews] had a couple spikes which increased response times and errors.
Who had some major issues?
MediaTemple [Reviews] had an early spike and a big spike later. The big spike later looks like it may have partially been a security measure. But it did eventually increase response times as well.
3. Uptime Monitoring
Both uptime monitoring solutions were third party providers that offer free services. UptimeRobot was paid for and monitoring on a 1 minute interval. All the companies were monitored over approximately two months (May-June 2016).
I hate having to penalize a company for uptime, but Pressable recorded 99.88 and 99.90 uptime scores which is below the 99.9% I expect from every company.
Every other company did well.
Every test was run with the settings: Chrome Browser, 9 Runs, native connection (no traffic shaping), first view only.
|Company||WPT Dulles||WPT Denver||WPT LA||WPT London||WPT Frankfurt||WPT South Africa|
|Company||WPT Singapore||WPT Shanghai||WPT Japan||WPT Sydney||WPT Brazil|
Fast. Not much to really say about these results. Nobody had issues, nothing was particularly interesting here other than nobody can get into China at any price level.
|Company||PHP Bench [Seconds] (lower=faster)||WP Bench [Queries Per Second](higher=faster)|
Not sure why SiteGround's PHP bench was so slow. The average WP Bench scores are also lower than every previous tier with PressLabs leading the way at 841. These more expensive solutions are generally trending towards cloud/clustered solutions which have slower database throughput in exchange for scale.
The high end WordPress hosting market is growing and has a lot of good options. No company in this tier completely faltered during the load tests despite a huge strain being put on them of 3000 concurrent hits to the frontpage and 5000 logged in users browsing the site.
Top Tier WordPress Hosting Performance
Kinsta and Pressidium clearly led the pack in terms of performance. They were the only two companies that handled LoadStorm without issue. They also didn't have any other issues across the other tests.
PressLabs earned itself an honorable mention. It had some issues with the LoadStorm test but it managed to stay up and did well on all the other tests.
Individual Host Analysis
Overall, a splendid performance that earned them top tier WordPress hosting in the $201-500/month range. No faults in their performance at any point.
It's nice to see Media Temple playing with the big boys and doing a respectable job. They had a little bit of trouble with the LoadStorm test and some possibly security related issues during the Blitz test which kept them out. But they weren't out of place in this bracket and were by far the cheapest at $240/month.
Pagely had some minor problems with the Blitz test but the LoadStorm test really seemed to be the big problem. The 5000 users seemed to clearly tax the server too much. Pagely reviewed the results and issued a full explanation. Their tl;dr was "Wrong plan/instance size for this test.
We price the value of our human Support and DevOps resources into the plan cost, which puts the ideal Pagely plan for this test outside the $500 cap. If the customer does not utilize the full range of services we provide they are essentially overpaying for AWS instances that in this case were undersized and not tuned for the test. "
Pantheon did well everywhere but LoadStorm which was a common theme for this bracket. They didn't fail, but they certainly were being taxed with increased load times and error rates.
Pressable could have earned an honorable mention if it wasn't for some uptime issues. They found themselves just below my 99.% expectation. They handled Blitz without issue and LoadStorm looked pretty good except wp-login had some what I imagine was security related issues.
I'm running out of positive adjectives to say how well Pressidium has done this year. A perfect LoadStorm test with zero errors, the lowest peak response time and lowest average response time. Followed up by a near perfect Blitz test. Top tier for sure.
PressLabs was the only company to earn an honorable mention. They had a bit of issues in the LoadStorm related to wp-login of course, but other than that put on an excellent performance.
In an odd twist of fate, I accidentally ran the same Blitz test on their lower priced cloud platform and it did better than the dedicated server. The shared infrastructure can often have far more powerful hardware backing it than dedicated machines and that's one of the interesting results. For large bursts, it may work better. Overall, this plan did pretty well, but LoadStorm clearly overloaded the server a bit too much to earn any special recognition.