New round of AMO's performance tests (2011-04-16) · 2011-04-17 17:42 by Wladimir Palant
I uploaded the overview for the new round of AMO‘s performance tests. The bug that skewed most Windows results so far has been fixed, so the results are more usable now. This week we have:
- 2 add-ons (SimilarWeb and Personas Plus) have extremely high Windows 7 numbers (more than 200% slowdown) for no apparent reason. The same add-ons score around 25% on Windows XP. Update (2011-04-18):
Both measurements appear to be correct, these add-ons really cause very significant slowdowns on Windows 7 (bug 650709). Why the same slowdowns supposedly don’t happen on other platforms is a good question, there might be bugs in Firefox itself involved.Update2 (2011-04-18): As Ted Mielczarek guessed correctly in bug 650709, the real issue here is IPv6 DNS resolution. Adding a pref to the test environment makes the delays introduced by these two extensions “normal” again.
- 9 add-ons that weren’t tested because of being platform-dependent (bug 648225)
- 2 add-ons (Google Toolbar and Memory Fox) weren’t tested because they have no stable version for download on addons.mozilla.org
- 1 add-on (Tab Mix Plus) wasn’t tested because Talos couldn’t understand its install.rdf file (bug 648978)
- 2 add-ons (Adblock Plus and Better Privacy) weren’t tested because the browser couldn’t be closed due to modal dialogs (bug 648222)
- 1 add-on (NoScript) wasn’t tested because it prevented the test page from working correctly
- 6 add-ons that were tested disabled because of not being compatible with Firefox (typically Thunderbird add-ons)
- 29 add-ons that were tested disabled because of not being explicitly compatible with Firefox 4 (bug 648229)
- 16 add-ons with test results probably considerably skewed by bug 648734 (standard deviation above 10% of the total Firefox start-up time). A lot more results were marked with a warning because of standard deviation above 2% of the total Firefox start-up time but I won’t count those.
Commenting is closed for this article.