eWeek: On Benchmarks

Sure, performance tests can be a valuable tool when looking at some categories of products. But the problem is that they tend to drown out other more important measures. My rule of thumb is that benchmarks matter only when a product is performing significantly better-or worse-than its peers. If an application or system is performing within the limits of acceptable performance, then a little bit faster or slower doesn't matter.