Site Overlay

New daily Mozmill test-runs for Firefox

For a long time, exactly since January 29th in 2010, the Mozilla QA team is running daily Mozmill tests to prove the functionality of Firefox and the update system across all supported platforms and release branches. With those tests we were able to find a couple of regressions, which then were fixed before the next release of Firefox.

Given those results we have decided to extend our daily test-runs and not only run the functional and update tests, but also cover endurance tests, add-on tests, and the new remote tests.

Especially with the endurance tests, Dave Hunt has shown that we can retrieve a lot of useful memory related information and find regressions or bad interactions with add-ons very easily. So it makes a lot of sense to additionally perform those tests on Nightly and Aurora builds of Firefox. The test results can be found on our dashboard.

But also for add-on authors who have written Mozmill tests for their add-ons, we now provide test results. Regressions in the add-on or in Firefox itself can now be identified as close as possible. Currently only 2 add-ons have Mozmill tests and are being tested. If you are an add-on author get in contact with us, and we can work together to get your add-on tested.

Remote tests, which we haven’t talked about yet, are tests which connect the testing of the Firefox UI and remote websites. Those are fairly new, means they have been added recently, and currently only cover tests for the ‘Get Add-ons’ pane of the new Add-ons Manager. Those were necessary to create because Selenium can not automate the installation of add-ons. For the latest test results see our dashboard.

We are now looking forward to any regression we can detect with the newly added test-runs. And those we can not only identify by our daily test-runs, but also from reports sent by users of the Mozmill Crowd add-on. So please help us testing Firefox by sending your test reports. Thanks!

4 thoughts on “New daily Mozmill test-runs for Firefox

  1. I can not run mozmill crowd.
    When I press “Start Test-run” its says “Mozmill Crowd requires a location on the hard disk to prepare the test environment, storing of tests and results. Please select or create a folder” then i select /tmp folder and the installation proces never end. It stuck when says “Downloading/unpaking mercurial==1.7.3”.

    New python executable in /tmp/mozmill-env/bin/python
    Installing setuptools……………………….done.
    Searching for pip
    Reading http://pypi.python.org/simple/pip/
    Reading http://www.pip-installer.org
    Reading http://pip.openplans.org
    Best match: pip 1.0.2
    Processing pip-1.0.2-py2.6.egg
    pip 1.0.2 is already the active version in easy-install.pth
    Installing pip script to /tmp/mozmill-env/bin
    Installing pip-2.6 script to /tmp/mozmill-env/bin

    Using /tmp/mozmill-env/lib/python2.6/site-packages/pip-1.0.2-py2.6.egg
    Processing dependencies for pip
    Finished processing dependencies for pip
    Downloading/unpacking mercurial==1.7.3

    1. Does /tmp has the executable bit set? If not, it’s a known bug we will fix in the next version of Mozmill Crowd. In the meantime you could use your home folder instead.

      1. Thanks for your responce. I have make a new folder /home/mixalis/mozmill and I give full privilage to everyone but I still have the problem. It always say “Downloading/unpacking mercurial==1.7.3” but it never download that thing.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

By continuing to use the site, you agree to the use of cookies. more information

The cookie settings on this website are set to "allow cookies" to give you the best browsing experience possible. If you continue to use this website without changing your cookie settings or you click "Accept" below then you are consenting to this.

Close