Hi,
On Mon, Sep 16, 2013 at 11:06 AM, Stephen Warren swarren@wwwdotorg.org wrote:
- The human and computer resources to back this up
Implementing much of the above is a lot of work to code, and support. It'll require quite a bit of HW to run on.
(Note that this not a comment on the current arm-soc builder or other public systems I linked to above, but some internal system...)
You provide a good written-down wishlist, and it's actually nearly identical to what my non-written down is w.r.t. features.
For example, I had a web interface going last year, with a distributed build environment. Turns out I had to redo it because it ate up the free quota of appengine resources very quickly due to the way I saved the logs, but it's definitely doable.
To be honest, the current state of things is that I built a service for myself that I wanted to see (the autobuilder and autobooter), and started emailing out the results to me and Kevin. He created the list for his equivalent testing, and I started cc:ing that as well. I'm happy to help out with doing a lot of this feature work but I don't have nearly enough cycles to do much of it -- I'm already short on hours in the day between Chrome OS work, upstream maintainership and this.
There's some security aspects that haven't been solved yet either. Right now I build linux-next and other source trees on a machine on my home network without isolating it. Getting some evil code into linux-next wouldn't be impossible, and from there on someone could get into my network. I need to isolate it more.
My next steps, besides some rewriting of my scripts to be more scalable and secure, is to add more testing on the host. Your list there summarizes what I had in mind pretty closely as well. I don't know if I'll be able to upload a Docker image for the work I'm doing, but if I or someone else can that could be a good way to deliver a "packaged" version of this for easy bootstrapping, since it could have all the toolchains and everything setup.
I suspect the resource and time problem is going to be the biggest hurdle. Linaro seems to be in a different spot w.r.t. what they want to do with testing, and their agenda does not align with the community in these aspects. So it'll come down to best efforts from people out there.
I've said I'm willing to add hardware to my setup if vendors want to send it to me, and I've had several who already sent hardware: Atmel SAMA5, Beaglebone Black, Nvidia Tegra Beaver, SolidRun Cubox, Allwinner A31, Cubieboard2 hardware is all provided by vendors -- thanks! The rest I've bought or ended up with from other sources.
-Olof