Monday, December 06, 2010

Test suites on Windows

On my previous post I raised that xpcshell on Windows was quite bad on the minis. I assumed that it was mainly because the hardware was slower but Ted commented on the discussion groups saying that it might xpcshell might be slow because of the OS and not just the hardware change.
Guess what? Graphs are our good friends!

I compared all test suites and confirmed that it doesn't have to do too much with the hardware running the test suites. It seems that Win7 in it self is bad for running reftests and xpcshell.
Look at this graph and you will see how the two lines separate quite a lot for xpcshell and reftests.

For comparison, we can see that Win7 is constantly bad for xpcshell and reftests for debug builds as well as optimized builds.

Creative Commons License
This work by Zambrano Gasparnian, Armen is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License.


  1. Out of interest, what are specs of said machine? Win 7 is (broadly) more efficient than Win2k3 but only if you meet certain baseline requirements in terms of memory, etc.

  2. The Win7 machines we have are running on the Apple Minis that were released late 2009.

    The specs are:
    * Intel Core 2 DUO P7550@2.26 GHz
    * 2GB RAM

    The Win2k3 machines can either be an IX machine (hardware of 1/2 unit of a server shelf) or a VM.

    The IX machines have this spec:
    * Intel Xeon - X3430 @ 2.40GHz
    * 4GB RAM

    The VM machines have this spec:
    * Intel Xeon - L5335 @ 2.0GHz
    * 2GB RAM