Major benchmarking service delists Samsung and HTC phones it suspects of cheating
Oh yes, things are really starting to kick off in the arcane world of smartphone benchmarking. First, there came clear evidence of phone makers manipulating scores in apps like AnTuTu and GFXBench, and now a more mainstream benchmarking company, Futuremark, has publicly delisted specific Samsung and HTC phones that it suspects of cheating. Futuremark says that the devices in question -- including the Galaxy Note 3, HTC One and HTC One Mini -- fail to adhere to the fairness policy, which requires that a device treats its 3DMark app just as it would treat any other app, with no tailor-made bursts of performance designed to achieve artificially high scores. Clearly, this bad behavior is just as endemic as we originally feared, so benchmark apps either need to toughen up, as Futuremark appears to be doing, or they need to find entirely new ways of measuring performance.
