mozci 0.4.0 released - Many bug fixes and improved performance

For the release notes with all there hyper-links go here.

NOTE: I did a 0.3.1 release but the right number should have been 0.4.0

This release does not add any major features, however, it fixes many issues and has much better performance.

Many thanks to @adusca, @jmaher and @vaibhavmagarwal for their contributions.

Features:

• An alltalos.py script has been added
• Issue #69 - Generate graph of builds to testers
• Added flake8 support - Remove pyflakes and pep8
• Allow skipping revisions on a list (09f7138)
• Issue #61 - Rename trigger_range.py to trigger.py

Fixes:

• All the documentation and roadmap have been polished
• Issue #90 - Do not trigger builds multiple times if we are intending the test jobs to be triggered multiple times
• Issue #94 - Load list of repositories from disk only once
• Issue #117 - gaia-try builders are always upstream builders
• Determine a running job correctly (068b5ee)
• Issue #142 - Loading buildjson files from disk is now only done once
• Issue #135 - Remove buildjson files which have fallen out of date
• Issue #146 - If the buildapi information about a build is corrupted, trigger that build again
• Some DONTBUILD pushes can have buildapi support (dcb942f)
• Issue #120 - Prevent triggering more build jobs than necessary

For all changes visit: 0.3.0...0.4.0

---

This work by Zambrano Gasparnian, Armen is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License.

How to generate data potentially useful to a dynamically generated trychooser UI

If you're interested on generating an up-to-date trychooser, I would love to hear from you.
adusca has helped me generate data similar to what a dynamic trychooser UI could use.
If you would like to help, please visit bug 983802 and let us know.

In order to generate the data all you have to do is:

git clone https://github.com/armenzg/mozilla_ci_tools.git
cd mozilla_ci_tools
python setup.py develop
python scripts/misc/write_tests_per_platform_graph.py

That's it! You will then have a graphs.json dictionary with some of the pieces needed. Once we have an idea on how to generate the UI and what we're missing we can modify this script.

Here's some of the output:

{
    "android": [
        "cppunit",
        "crashtest",
        "crashtest-1",
        "crashtest-2",
        "jsreftest-1",
        "jsreftest-2",
...

Here are the remaining keys:

[u'android', u'android-api-11', u'android-api-9', u'android-armv6', u'android-x86', u'emulator', u'emulator-jb', u'emulator-kk', u'linux', u'linux-pgo', u'linux32_gecko', u'linux64', u'linux64-asan', u'linux64-cc', u'linux64-mulet', u'linux64-pgo', u'linux64_gecko', u'macosx64', u'win32', u'win32-pgo', u'win64', u'win64-pgo']

---

This work by Zambrano Gasparnian, Armen is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License.

mozci 0.3.0 - Support for backfilling jobs on treeherder added

Sometime on treeherder, jobs get coalesced (a.k.a. we run the tests on the most recent revision) in order to handle load. This is good so we can catch up when many pushes are committed on a tree.

However, when a job run on the most recent code comes back failing we need to find out which revision introduced the the regression. This is when we need to backfill up to the last good run.

In this release of mozci we have added the ability to --backfill:

python scripts/trigger_range.py --buildername "b2g_ubuntu64_vm cedar debug test gaia-js-integration-5" --dry-run --revision 2dea8b3c6c91 --backfill

This should be useful specially for sheriffs.

You can start using mozci as long as you have LDAP credentials. Follow these steps to get started:

git clone https://github.com/armenzg/mozilla_ci_tools.git
python setup.py develop (or install)

Release notes

Thanks again to vaibhav1994 and adusca for their many contributions in this release.

Major changes

• Issue #75 - Added the ability to backfill changes until last good is found
• No need to use --repo-name anymore
• Issue #83 - Look for request_ids from a better place
• Add interface to get status information instead of scheduling info

Minor fixes:

• Fixes to make livehtml documentation
• Make determine_upstream_builder() case insensitive

Release notes: https://github.com/armenzg/mozilla_ci_tools/releases/tag/0.3.0
PyPi package: https://pypi.python.org/pypi/mozci/0.3.0
Changes: https://github.com/armenzg/mozilla_ci_tools/compare/0.2.5...0.3.0

---

This work by Zambrano Gasparnian, Armen is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License.

mozci 0.2.5 released - major bug fixes + many improvements

Big thanks again to vaibhav1994, adusca and valeriat for their many contributions in this release.

Release notes

Major bug fixes:

• Bug fix: Sort pushid_range numerically rather than alphabetically
• Calculation of hours_ago would not take days into consideration

Others:

• Added coveralls/coverage support
• Added "make livehtml" for live documentation changes
• Improved FAQ
• Updated roadmap
• Large documentation refactoring
• Automatically document scripts
• Added partial testing of mozci.mozci
• Streamed fetching of allthethings.json and verify integrity
• Clickable treeherder links
• Added support for zest.releaser

Release notes: https://github.com/armenzg/mozilla_ci_tools/releases/tag/0.2.5
PyPi package: https://pypi.python.org/pypi/mozci/0.2.5
Changes: https://github.com/armenzg/mozilla_ci_tools/compare/0.2.4...0.2.5

---

This work by Zambrano Gasparnian, Armen is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License.

How to generate allthethings.json

It's this easy!
    hg clone https://hg.mozilla.org/build/braindump
    cd braindump/community
    ./generate_allthethings_json.sh

allthethings.json is generated based on data from buildbot-configs.
It contains data about builders, schedulers, masters and slavepools.

If you want to extract information from allthethings.json feel free to use mozci to help you!
https://mozilla-ci-tools.readthedocs.org/en/latest/allthethings.html

---

This work by Zambrano Gasparnian, Armen is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License.