Are We Testing the Right Things? Critical Thinking About Fusion-io Tests
In a world where we are seeing statistics flying around about performance, and everything is being done to create the ideal results from those statistics, questions often come up around what the real results of performance testing is.
SSD vs Spinning Disk: A Fusion-io Example
Recently we saw lots of news around Fusion-io regarding their purchase by SanDisk, and one of the compelling reasons for the 1.1 Billion dollar acquisition is the performance capability of the PCI flash hardware.
One thing that is worthwhile to do though, is to be sure you fully understand what the A/B testing was, or as we often say, was it an apples to apples comparison? There is no doubt about the performance features of PCI flash and the various Fusion-io offerings, but at the same time there was some great analysis done about a particular database performance test.
Since I love statistics and analysis, this seemed like a great article by Brent Ozar which helps to show how we may see statistics, but we do have to be careful what we infer from those results.