The Sad State Of Storage Benchmarks Today
Over the past decade, or more, storage systems have evolved significantly from simple RAID arrays of spinning disks with relatively tiny RAM caches to flash based systems that use log-based data structures and data deduplication. Unfortunately, the benchmarks we use to test storage systems haven’t evolved with them.
Unfortunately, the benchmarks we use to test storage systems haven’t evolved with them. In general, they create unrealistic I/O patterns with data that either doesn’t reduce at all or reduces so well it makes the storage system look much better than it really is. We’ll be writing more about benchmarks in The Other Other Operation Blog or you can watch our Executive Director, Howard Marks, talk about Lies, Dammed Lies, and Benchmarks at Tech Unplugged Amsterdam from October 2016.
Thanks to Tech Unplugged organizer Enrico Signoretti for inviting Howard to speak and allowing us to use the video.