Hi Alan,

I'm afraid you missed the mailing list. :)

Finally I have managed to show the measurement in LAVA, though the unit is still missing:

https://validation.linaro.org/dashboard/streams/anonymous/botao-sun/bundles/...

https://validation.linaro.org/dashboard/attachment/791281/view

I tested the regular expression on a website and locally, it works well on both, for example:

1. Tested on a third-party website: https://pythex.org/?regex= ^%28%3FP%3Ctest_case_id%3Efio_\w%2B%29%3A\s%28%3FP%3Cresult%3E\w%2B%29\s%28%3FP%3Cmeasurement%3E[0-9.]%2B%29\s%28%3FP%3Cunits%3E\w%2B%29.*&test_string=fio_read%3A%20PASS%201105%20IOPS%0Afio_read%3A%20PASS%200%20NA%0Afio_read%3A%20FAIL%200%20NA%20-%20Command%20ran%20failed%20on%20%2Fdev%2Fsda&ignorecase=0&multiline=1&dotall=0&verbose=0

2. Tested locally:

#!/usr/bin/env python import re

test_string_pass = testcase_name + ": PASS" + " " + iops_result + " " + "IOPS" print test_string_pass test_string_pass_simple = testcase_name + ": PASS" + " 0" + " NA" print test_string_pass_simple test_string_fail = testcase_name + ": FAIL" + " 0" + " NA" + " - Command ran failed on /dev/sda" print test_string_fail

pattern = '^(?P<test_case_id>fio_\w+):\s(?P<result>\w+)\s(?P<measurement>[0-9.]+)\s(?P<units>\w+).*'

print re.findall(pattern, test_string_pass) print re.findall(pattern, test_string_pass_simple) print re.findall(pattern, test_string_fail)

The output is:

fio_read: PASS 1105 IOPS fio_read: PASS 0 NA fio_read: FAIL 0 NA - Command ran failed on /dev/sda [('fio_read', 'PASS', '1105', 'IOPS')] [('fio_read', 'PASS', '0', 'NA')] [('fio_read', 'FAIL', '0', 'NA')]

As you can see all four groups are captured there.

Any idea?

Thanks.

Best Regards Botao Sun

On 14 May 2014 04:57, Alan Bennett alan.bennett@linaro.org wrote:

Hi Botao;

I've had the most luck using the lava test shell api "lava-test-case", have you tried it?

Senthil/LAVA team, do we have some examples of using parsers and measurements?

Alan

lava-test-case test5 --result pass --measurement 99 --units bottles

Documentation:

https://validation.linaro.org/static/docs/writing-tests.html?recording-test-...

---------- Forwarded message ---------- From: Botao Sun botao.sun@linaro.org Date: 13 May 2014 06:52 Subject: [Linaro-validation] Measurement in LAVA. To: Linaro Validation linaro-validation@lists.linaro.org

Hi,

I'm recently working on some test cases which involve the measurement, but have no idea how to handle it after several failures occurred. For example:

https://validation.linaro.org/scheduler/job/126298

<LAVA_SIGNAL_STARTRUN fio-ubuntu db652397-5831-4cc3-b2b3-1246879ac696> echo LAVA_ACK /root test_case_id:fio_device_existence result:PASS which fio The FIO binary location is: /usr/bin/fio test_case_id:fio_existence result:PASS sudo fio -filename=/dev/sda -rw=read -direct=1 -iodepth 1 -thread -ioengine=psync -bs=4k -numjobs=1 -runtime=10 -group_reporting -name=fio_read > fio_read.txt 2>&1 0 The IOPS number in fio_read test is: 1104 test_case_id:fio_read result:PASS measurement:1104 units:persecond <LAVA_SIGNAL_ENDRUN fio-ubuntu db652397-5831-4cc3-b2b3-1246879ac696> <LAVA_DISPATCHER>2014-05-13 12:30:39 PM WARNING: Invalid measurement <LAVA_DISPATCHER>2014-05-13 12:30:39 PM WARNING: Invalid measurement

The regular expression I'm using is:

"^test_case_id:(?P<test_case_id>fio_\w+)\sresult:(?P<result>(PASS|FAIL))\s*(measurement:)*(?P<measurement>\d*)\s*(units:)*(?P<units>\s*)\s*"

which if convert it to a solid one would be:

"^test_case_id:fio_\w+\sresult:(PASS|FAIL)\s*(measurement:)*\d*\s*(units:)*\s*\s*"

And it has been tested locally which can capture following 3 different results (sample):

test_case_id:fio_read result:PASS measurement:1105 units:persecond test_case_id:fio_read result:PASS test_case_id:fio_read result:FAIL - Command ran failed on /dev/sda

A local test script in Python is:

#!/usr/bin/env python import re

pattern_solid = "^test_case_id:fio_\w+\sresult:(PASS|FAIL)\s*(measurement:)*\d*\s*(units:)*\s*\s*" testcase_name = "fio_read" iops_result = "1105"

test_string_pass = "test_case_id:" + testcase_name + " result:PASS " + "measurement:" + iops_result + " units:persecond" test_string_pass_simple = "test_case_id:" + testcase_name + " result:PASS" test_string_fail = "test_case_id:" + testcase_name + " result:FAIL" + " - Command ran failed on /dev/sda"

print re.search(pattern_solid, test_string_pass) print re.search(pattern_solid, test_string_pass_simple) print re.search(pattern_solid, test_string_fail)

So would you provide an example about how to deal with the measurement in LAVA?

Thanks.

Best Regards Botao Sun

---

linaro-validation mailing list linaro-validation@lists.linaro.org http://lists.linaro.org/mailman/listinfo/linaro-validation

--

Alan Bennett, Engineering Manager, LAVA & LSK Linaro.org http://www.linaro.org/ *│ *Open source software for ARM SoCs | Follow Linaro*:* Facebook http://www.facebook.com/pages/Linaro | Twitter http://twitter.com/#%21/linaroorg | Bloghttp://www.linaro.org/linaro-blog/ irc: akbennett | alan.bennett@linaro.org | linaro-validation@lists.linaro.org