On Tue, 24 Sep 2013 11:44:49 +0530 Vishal Bhoj vishal.bhoj@linaro.org wrote:

Hi,

Looks like the slave instances are vanishing randomly. I have been trying to create Android release builds but the random failures in the connection slave instance is making it difficult to create the release. Here are the number of builds which have failed repeatedly:

There were earlier EC2 issues (end of last week/weekend), but EC2 slave issues protruded well into beginning of this week. So, there was very high and not-subsiding loadavg on the master (apparently, triggered by EC2 and then self-resonating), so we decided to stop all the builds and restart Jenkins on master. After the restart, master load is manageable and initial builds seem to progress well: https://android-build.linaro.org/jenkins/job/linaro-android-member-ti_panda-... https://android-build.linaro.org/jenkins/job/linaro-android_arndale-linaro-1...

The situation is watched closely. Bug ticket for this episode of Android Build instability is https://bugs.launchpad.net/linaro-android-infrastructure/+bug/1227975

Pandaboard: https://android-build.linaro.org/jenkins/job/linaro-android-member-ti_panda-... https://android-build.linaro.org/jenkins/job/linaro-android-member-ti_panda-... https://android-build.linaro.org/jenkins/job/linaro-android-member-ti_panda-... https://android-build.linaro.org/jenkins/job/linaro-android-member-ti_panda-...

Galaxy Nexus: https://android-build.linaro.org/jenkins/job/linaro-android_galaxynexus-lina... https://android-build.linaro.org/jenkins/job/linaro-android_galaxynexus-lina...

Arndale: https://android-build.linaro.org/jenkins/job/linaro-android_arndale-linaro-1... https://android-build.linaro.org/jenkins/job/linaro-android_arndale-linaro-1... https://android-build.linaro.org/jenkins/job/linaro-android_arndale-linaro-1... https://android-build.linaro.org/jenkins/job/linaro-android_arndale-linaro-1... https://android-build.linaro.org/jenkins/job/linaro-android_arndale-linaro-1...

Regards, Vishal