Project definition: Give Treeherder the ability to schedule TaskCluster jobs

This is a project definition that I put up for GSoC 2016. This helps students to get started researching the project.

The main things I give in here are:

• Background
• Where we came from, where we are and we are heading towards
• Goal
• Use case for developers
• Breakdown of components
• Rather than all aspects being mixed and not logically separate

NOTE: This project has few parts that have risks and could change the implementation. It depends on close collaboration with dustin.

-----------------------------------

Mentor: armenzg 

IRC:   #ateam channel

Give Treeherder the ability to schedule TaskCluster jobs

This work will enable "adding new jobs" on Treeherder to work with pushes lacking TaskCluster jobs (our new continuous integration system).

Read this blog post to know how the project was built for Buildbot jobs (our old continous integration system).

The main work for this project is tracked in bug 1254325.

In order for this to work we need the following pieces:

A - Generate data source with all possible tasks

• Bug 1232005 - Let the gecko decision task generate a file with all the possible TaskCluster jobs that could have been scheduled for a given push
• We will need to post this artifact into the TC index so we can fetch it
• We will probably need to create a "latest" alias
• RISK: The structure of graphs is going to change; the artifact will change in format:
• https://bugzilla.mozilla.org/show_bug.cgi?id=1178516
• graph-generation details
• Alternative mentor for this section are: garndt

B - Teach Treeherder to use the artifact

• Fetch that artifact for every tree and update the "runnable api"
• RISK: The structure of graphs is going to change; the artifact will change in format:
• https://bugzilla.mozilla.org/show_bug.cgi?id=1178516
• graph-generation details

• This will require close collaboration with Treeherder engineers
• This work can be done locally with a Treeherder instance
• It can also be deployed to the “staging” version of Treeherder to do tests
• Alternative mentors for this section is: camd

C - Teach pulse_actions to listen for requests from Treeherder

• pulse_actions is a pulse listener of Treeherder actions
• You can see pulse_actions’ workflow in here
• Once part B is completed, we will be able to listen for messages requesting certain TaskCluster tasks to be scheduled and we will schedule those tasks on behalf of the user
• RISK: Depending if the TaskCluster actions project is completed on time, we might instead make POST requests to an API

---

This work by Zambrano Gasparnian, Armen is licensed under a Creative Commons Attribution-Noncommercial-Share Alike 3.0 Unported License.