Hi all,
Earlier in the week in a call Loic mentioned that he had looked at a Mozilla/Boot2Gecko project that did HDMI capture and we could look at it for two reasons:
1) (the obvious) because we want to do HDMI capture ourselves, and
2) (slightly less obvious) to see how they specify tests that involve running code on a device and capturing data from an external source.
I don't know if this is what he had in mind, but google found for me "project eideticker":
https://wiki.mozilla.org/Project_Eideticker
(the reason I'm not sure if this is what Loic had in mind is that it's more a Fennec/Firefox thing than a B2G thing).
I haven't dug into the test specification side yet, but I did think this page was interesting:
https://wiki.mozilla.org/Project_Eideticker/DeckLink_Primer
IIRC, we had considered Blackmagic cards before (supported on Linux, relatively cheap). The limitations on this page look a bit less than ideal though...
Anyway, interesting reading for you all.
Cheers, mwh
On Wed, May 23, 2012, Michael Hudson-Doyle wrote:
https://wiki.mozilla.org/Project_Eideticker
Yup; looks like it
(the reason I'm not sure if this is what Loic had in mind is that it's more a Fennec/Firefox thing than a B2G thing).
The B2G folks actually put us in touch with the QA team lead back then; I'm short finding the QA notes, generally the notes from chats with Mozilla were at: https://wiki.linaro.org/OfficeofCTO/Mozilla/2011-09-06 https://wiki.linaro.org/OfficeofCTO/Mozilla/2011-09-13 https://wiki.linaro.org/OfficeofCTO/Mozilla/2011-09-20 and I think that last call is where we had discussed QA / validation, but it's not too specific in the notes, mostly Linaro's side of the story.
Loïc Minier loic.minier@linaro.org writes:
On Wed, May 23, 2012, Michael Hudson-Doyle wrote:
https://wiki.mozilla.org/Project_EidetickerYup; looks like it
OK. So I had poke into the source code to see how it works.
A 'test' in this world is a web page that you load. JS in this page does whatever it is you want to test, and then calls a "finish" function from eideticker.js. For copyright reasons (I think all tests are things like "a bunch of HTML we grabbed from cnn.com") there are no tests distributed with eideticker and can't find any on the web, so I haven't seen one.
The way the tests work is that when you run get-metric-for-build, a web server is started that can serve up the assets that make up the test and also has an api to start and stop the capturing. The browser on the DUT is instructed to load a HTML page which contains js that hits the "start capturing" API, waits 2 seconds and loads the test page. This (presumably) does its thing and then calls Eideticker.finish() -- which loads another HTML page, the JS of which waits 1 second and then hits the api to terminate the capturing. The host side code meanwhile is polling its capturing code and, when it sees that capturing is done it tears everything down and does some analysis on the video it got.
In sum, while I'm sure it works and provides useful results, it doesn't seem like anything terribly sophisticated.
To put things as they might be in our world, it's like inserting
ssh power-measurement-server start-capture sleep 2
before and
sleep 1 ssh power-measurement-server stop-capture
after the shell commands we run to execute a test. Maybe that's enough!
(the reason I'm not sure if this is what Loic had in mind is that it's more a Fennec/Firefox thing than a B2G thing).
The B2G folks actually put us in touch with the QA team lead back then; I'm short finding the QA notes, generally the notes from chats with Mozilla were at: https://wiki.linaro.org/OfficeofCTO/Mozilla/2011-09-06 https://wiki.linaro.org/OfficeofCTO/Mozilla/2011-09-13 https://wiki.linaro.org/OfficeofCTO/Mozilla/2011-09-20 and I think that last call is where we had discussed QA / validation, but it's not too specific in the notes, mostly Linaro's side of the story.
Yeah, there doesn't seem to be anything directly relevant in the notes.
Cheers, mwh
linaro-validation@lists.linaro.org
-
Loïc Minier -
Michael Hudson-Doyle