EDIT=We had to back out this change since it caused issues for PGO talos jobs. We will try again after further testing.
Pinning for Mozharness [1] has been enabled for the fx-team integration tree.
Nothing should be changing. This is a no-op change.
We're still using the default mozharness repository and the "production" branch is what is being checked out. This has been enabled on Try and Ash for almost two months and all issues have been ironed out. You can know if a job is using pinning of Mozharness if you see "repostory_manifest.py" in its log.
If you notice anything odd please let me know in bug 1110286.
If by Monday we don't see anything odd happening, I would like to enable it for mozilla-central for few days before enabling it on all trunk trees.
Again, this is a no-op change, however, I want people to be aware of it.
This work by Zambrano Gasparnian, Armen is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License.
This blog mainly contains posts about Mozilla release engineering projects that I am working on and some personal insights.
Thursday, January 22, 2015
Tuesday, January 13, 2015
Name wanted for a retrigger-based bisection tool
Hello all,
I'm looking for a name for the tool that I will be working on this quarter.
This quarter I will be working on creating a prototype of a command-line tool that can be used by sheriffs and others to automate retrigger-based bisection. This could be used to help bisect new intermittent oranges, and to backfill jobs that have been skipped due to coalescing. Integration with Treeherder or other service will be done later.
I'm proposing "TriggerCI" since it shows what it does regardless of what you use it for.
If this works for you, please let me know.
If you have another suggestion please let me know. I'm interested on fun and creative names since that part of my brain is dysfunctional :P
This work by Zambrano Gasparnian, Armen is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License.
I'm looking for a name for the tool that I will be working on this quarter.
This quarter I will be working on creating a prototype of a command-line tool that can be used by sheriffs and others to automate retrigger-based bisection. This could be used to help bisect new intermittent oranges, and to backfill jobs that have been skipped due to coalescing. Integration with Treeherder or other service will be done later.
I'm proposing "TriggerCI" since it shows what it does regardless of what you use it for.
If this works for you, please let me know.
If you have another suggestion please let me know. I'm interested on fun and creative names since that part of my brain is dysfunctional :P
This work by Zambrano Gasparnian, Armen is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License.
Labels:
planet
Monday, January 12, 2015
How to uplift changes through the various Mozilla release trees
One of my co-workers asked me a bit ago what is a clean way of uplifting patches through the different Mozilla release trees. In my case the patch is self-approved since it only affects test jobs and not the product (a=testing).
Once my change landed on one of the integration trees (e.g. mozilla-inbound, mozilla-central), I waited for it to be merged to mozilla-central (a sheriff made a note on the bug). At that point we can start the uplift process.
In particular, the changeset I want is:
https://hg.mozilla.org/integration/fx-team/rev/a13aa1af5d75
You can read more about it in here.
I have a unified checkout from which I can manage all the various release trees (aurora, beta, release, esr31 et al).
We graft the changeset, carefull check that we're pushing to the right place and push:
Repeat the same process for the remaining trees.
UPDATE: Fixed typo
This work by Zambrano Gasparnian, Armen is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License.
Once my change landed on one of the integration trees (e.g. mozilla-inbound, mozilla-central), I waited for it to be merged to mozilla-central (a sheriff made a note on the bug). At that point we can start the uplift process.
In particular, the changeset I want is:
https://hg.mozilla.org/integration/fx-team/rev/a13aa1af5d75
Note
I believe I have the named branches because I have the firefoxtree extension enabled.You can read more about it in here.
I have a unified checkout from which I can manage all the various release trees (aurora, beta, release, esr31 et al).
Update the tree
We update to the right brach:
hg pull beta hg update beta
Graft changeset
NOTE: Usage explained in here.
NOTE: Make sure you use --edit if you need to add a=testing to your commit message.
We graft the changeset, carefull check that we're pushing to the right place and push:
armenzg@armenzg-thinkpad:~/repos/branches/release_branches$ hg id 774733a9b2ad beta/tip armenzg@armenzg-thinkpad:~/repos/branches/release_branches$ hg graft --edit -r a13aa1af5d75 grafting revision 249741 merging testing/config/mozharness/android_arm_config.py armenzg@armenzg-thinkpad:~/repos/branches/release_branches$ hg out -r tip beta comparing with beta searching for changes changeset: 249997:93587eeda731 tag: tip user: Armen Zambrano Gasparnian date: Mon Jan 12 09:53:51 2015 -0500 summary: Bug 1064002 - Fix removal of --log-raw from xpcshell. r=chmanchester. a=testing armenzg@armenzg-thinkpad:~/repos/branches/release_branches$ hg push -r tip beta pushing to ssh://hg.mozilla.org/releases/mozilla-beta searching for changes remote: adding changesets remote: adding manifests remote: adding file changes remote: added 1 changesets with 1 changes to 1 files remote: Trying to insert into pushlog. remote: Inserted into the pushlog db successfully. remote: You can view your change at the following URL: remote: https://hg.mozilla.org/releases/mozilla-beta/rev/93587eeda731
Repeat the same process for the remaining trees.
UPDATE: Fixed typo
This work by Zambrano Gasparnian, Armen is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License.
Tuesday, January 06, 2015
Tooltool fetching can now use LDAP credentials from a file
You can now fetch tooltool files by using an authentication file.
All you have to do is append "--authentication-file file" to your tooltool fetching command.
This is important if you want to use automation to fetch files from tooltool on your behalf.
This was needed to allow Android test jobs to run locally since we need to download tooltool files for it.
EDIT: Fixed the tooltool hyperlink
EDIT: Removed labels to avoid re-posting after edit
This work by Zambrano Gasparnian, Armen is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License.
All you have to do is append "--authentication-file file" to your tooltool fetching command.
This is important if you want to use automation to fetch files from tooltool on your behalf.
This was needed to allow Android test jobs to run locally since we need to download tooltool files for it.
EDIT: Fixed the tooltool hyperlink
EDIT: Removed labels to avoid re-posting after edit
This work by Zambrano Gasparnian, Armen is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License.
Monday, January 05, 2015
Run Android test jobs locally
You can now run Android test jobs on your local machine with Mozharness.
As with any other developer capable Mozharness script, all you have to do is:
--test-suite mochitest-gl-1 --blob-upload-branch try
--download-symbols ondemand --cfg developer_config.py
--installer-url http://ftp.mozilla.org/pub/mozilla.org/mobile/nightly/latest-mozilla-central-android-api-9/en-US/fennec-37.0a1.en-US.android-arm.apk
--test-url http://ftp.mozilla.org/pub/mozilla.org/mobile/nightly/latest-mozilla-central-android-api-9/en-US/fennec-37.0a1.en-US.android-arm.tests.zip
Here's the bug where the work happened.
Here's the documentation on how to run Mozharness as a developer.
Please file a bug under Mozharness if you find any issues.
Here are some other related blog posts:
I wish we run all of our jobs in proper isolation!
This work by Zambrano Gasparnian, Armen is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License.
As with any other developer capable Mozharness script, all you have to do is:
- Append --cfg developer_config.py
- Append --installer-url and --test-url with appropriate URIs
An example for this is:
python scripts/android_emulator_unittest.py --cfg android/androidarm.py--test-suite mochitest-gl-1 --blob-upload-branch try
--download-symbols ondemand --cfg developer_config.py
--installer-url http://ftp.mozilla.org/pub/mozilla.org/mobile/nightly/latest-mozilla-central-android-api-9/en-US/fennec-37.0a1.en-US.android-arm.apk
--test-url http://ftp.mozilla.org/pub/mozilla.org/mobile/nightly/latest-mozilla-central-android-api-9/en-US/fennec-37.0a1.en-US.android-arm.tests.zip
Here's the bug where the work happened.
Here's the documentation on how to run Mozharness as a developer.
Please file a bug under Mozharness if you find any issues.
Here are some other related blog posts:
Disclaimers
Bug 1117954- I think that I need a different SDK or emulator version is needed to run Android API 10 jobs.I wish we run all of our jobs in proper isolation!
This work by Zambrano Gasparnian, Armen is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License.
Labels:
mozharness,
planet,
releng
Subscribe to:
Posts (Atom)