Just recently, Huawei was caught cheating in 3DMark’s benchmark tests. Now, both Huawei and UL (creators of 3DMark) released a joint statement after they had a comprehensive discussion regarding the issue.
Huawei explained to UL that the devices in subject (P20, P20 Pro, Nova 3, and Honor Play) utilizes an artificial intelligent resource scheduling mechanism. This AI-powered feature allows Huawei and Honor smartphones to have better performance as it can optimize the resource allocation, depending on the tasks that the users are doing.
While UL did understand the purpose of the said feature, they are against the force use of “Performance Mode” when the smartphone detects that it’s running a benchmark application. This breaks UL’s rules that require devices to treat benchmark apps as just like any other app.
In the table below, we can see that the devices’ benchmark scores were much lower when UL ran a private and unlabeled version of the same app.
After a lengthy discussion, both parties came up with an agreement. Huawei will start to give users access to the “Performance Mode” feature with the upcoming EMUI 9.0 update. This will allow the users to control when they want to use their devices in full power, not just in running benchmark apps.
UL will then reinstate the delisted Huawei smartphones once the said feature becomes available to its users.
Huawei and UL also had a talk regarding the current state of benchmark testing and its methodologies. The two companies are open to participating in a movement that would develop a benchmarking standard.