linaro-dev November 2014

linaro-dev@lists.linaro.org

21 participants
27 discussions

by Koen Kooi

== Progress == * OpenEmbedded (100%) * OpenJDK build failures (CARD-787 <https://cards.linaro.org/browse/CARD-787>) * Prebuilt toolchain testing (CARD-1728) == Plans == * Release * OpenEmbedded * eglibc -> glibc move (CARD-787 <https://cards.linaro.org/browse/CARD-787> ) * update gcc (CARD-787 <https://cards.linaro.org/browse/CARD-787>) * update binutils (CARD-787 <https://cards.linaro.org/browse/CARD-787>) * Prebuilt toolchain testing (CARD-1728) -- Koen Kooi Builds and Baselines | Release Manager Linaro.org | Open source software for ARM SoCs

9 years, 10 months

[PATCH 1/3] rt-app: Add a script to tune parameters in json file.

by pi-cheng.chen

This scripts strips all comments in the input JSON file, modifies the parameters according to commnad line arguments, and write the content to a new JSON file. Signed-off-by: Pi-Cheng Chen <pi-cheng.chen(a)linaro.org> --- doc/tune_json.py | 138 +++++++++++++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 138 insertions(+) create mode 100755 doc/tune_json.py diff --git a/doc/tune_json.py b/doc/tune_json.py new file mode 100755 index 0000000..36746ff --- /dev/null +++ b/doc/tune_json.py @@ -0,0 +1,138 @@ +#!/usr/bin/env python + +import collections +import argparse +import shutil +import os +import sys +import json +import re + + +def find_dict_by_key(doc, key): + if key in doc and type(doc[key]) is collections.OrderedDict: + return doc[key] + + for k in doc: + if type(doc[k]) is collections.OrderedDict: + return find_dict_by_key(doc[k], key) + + +def dict_find_and_replace_value(dic, key, val): + for k in dic: + if type(dic[k]) is collections.OrderedDict: + dict_find_and_replace_value(dic[k], key, val) + if k == key: + dic[k] = val + + +def dict_of_loading(dic): + if not 'run' in dic: + return False, None + + for k in dic: + if 'timer' in k and 'period' in dic[k]: + return True, k + else: + return False, None + + +def calculate_and_update_loading(dic, loading): + of_loading, timer_id = dict_of_loading(dic) + + if of_loading: + period = dic[timer_id]['period'] + run = period * loading / 100 + dic['run'] = run + + for k in dic: + if type(dic[k]) is collections.OrderedDict: + calculate_and_update_loading(dic[k], loading) + + +# strip comments in json file and load the file as a dict +def load_json_file(filename): + try: + f = open(filename, 'r') + except: + print 'ERROR: Unable to open %s' %filename + sys.exit(2) + + comment_re = re.compile( + '(^)?[^\S\n]*/(?:\*(.*?)\*/[^\S\n]*|/[^\n]*)($)?', + re.DOTALL | re.MULTILINE) + + content = ''.join(f.readlines()) + + match = comment_re.search(content) + while match: + content = content[:match.start()] + content[match.end():] + match = comment_re.search(content) + + return json.JSONDecoder(object_pairs_hook=collections.OrderedDict).decode(content) + + +def dump_json_file(doc, filename): + try: + fo = open(filename, 'w+') + except: + print 'ERROR: Unable to open %s' %filename + sys.exit(2) + + json.dump(doc, fo, indent=4, sort_keys=False) + fo.close() + + +if __name__ == '__main__': + tmp = 'tmp.json' + + parser = argparse.ArgumentParser() + + parser.add_argument('-f', '--file', dest='infile', default='', help='input json filename') + parser.add_argument('-o', '--out', dest='outfile', default='workload.json', help='output json filename'); + parser.add_argument('--instance', default=0, type=int, help='number of thread instance') + parser.add_argument('--period', default=0, type=int, help='period of each thread/phase (ms)') + parser.add_argument('--run', default=0, type=int, help='run time of each thread/phase (ms)') + parser.add_argument('--sleep', default=0, type=int, help='sleep time of each thread/phase (ms)') + parser.add_argument('--loop', default=0,type=int, help='loop count of each thread/phase (-1 as infinite loop)') + parser.add_argument('--loading', default=0, type=int, help='loading of each thread (%%)') + parser.add_argument('--key', type=str, help='the key id of thread/phase in which the parameters will be changed') + + args = parser.parse_args() + + if not os.path.isfile(args.infile): + print 'ERROR: input file %s does not exist\n' %args.infile + parser.print_help() + sys.exit(2) + + shutil.copyfile(args.infile, tmp) + + doc = target = load_json_file(tmp) + + if args.key: + target = find_dict_by_key(doc, args.key) + if not target: + print 'ERROR: key id %s is not found' %args.key + sys.exit(2) + + if args.instance > 0: + dict_find_and_replace_value(target, 'instance', args.instance) + + if args.period > 0: + dict_find_and_replace_value(target, 'period', args.period * 1000) + + if args.run > 0: + dict_find_and_replace_value(target, 'run', args.run * 1000) + + if args.sleep > 0: + dict_find_and_replace_value(target, 'sleep', args.sleep * 1000) + + if args.loop > 0 or args.loop == -1: + dict_find_and_replace_value(target, 'loop', args.loop) + + if args.loading > 0: + calculate_and_update_loading(target, args.loading); + + dump_json_file(doc, tmp) + + os.rename(tmp, args.outfile) -- 1.9.1

9 years, 10 months

[ACTIVITY] Week 45

by Riku Voipio

== Progress == * Test arndale asix net regression fix for 3.18 (20%) * https://git.kernel.org/cgit/linux/kernel/git/torvalds/linux.git/commit/driv… * Local LAVA scripting (20%) * Booting trusty and utopic images for kvm testing (DEVPLAT-264 40%) * Moving CI towards utopic (10%) == Plans == * Switch kvm/xen guest images, DEVPLAT-264 * Find out the needed next steps for ARMv8 slaves (CARD-1729)

9 years, 10 months

[ACTIVITY] Week 46

by Vishal Bhoj

== Progress == * Ara 80% * Android L updates (20%) == Plans == * Fix premerge CI issues for LSK Android. * Fix CI loop with L updates. Regards, Vishal

9 years, 10 months

[ACTIVITY] Week 46

by Koen Kooi

== Progress == * OpenEmbedded (100%) * minimal + lamp images build again * Partially fix openjdk build. * Prebuilt toolchain CI loop working (CARD-1728) == Plans == * eglibc-linaro -> glibc-linaro switch -- Koen Kooi Builds and Baselines | Release Manager Linaro.org | Open source software for ARM SoCs

9 years, 10 months

VM Migration using Qemu on AArch64

by Yash Nandkeolyar

Hi, We are trying to do VM Migration using the version of Qemu obtained from the following branch: https://github.com/stsquad/qemu/tree/armv8-migration/v4 And we are also using Linux Kernel 3.16 compiled with the patches for AArch64 migration support obtained from the following link: http://patches.linaro.org/patchwork/bundle/alex.bennee@linaro.org/armv8-mig… We have tried both online and offline migration. However, we end up getting the following error at runtime during migration: qemu-system-aarch64: Unknown combination of migration flags: 0 qemu: warning: error while loading state section id 3 qemu-system-aarch64: load of migration failed: Input/output error Could anyone please suggest on this. -- Yash Nandkeolyar

9 years, 10 months

PVR DDK

by Sriram V

Hi, I am using OMAP4 Linaro tee (Linux 3.2). I have pulled the bug fixes on top of this tree for pvr drivers. (/drivers/gpu/pvr) For that, I also need to cross compile PVR DDK against Linux 3.2. Can anyone point me from where i can download PVR DDK sources? -- Regards, Sriram

9 years, 10 months

[ACTIVITY] Week 45

by Riku Voipio

== Progress == * Debug arndale asix net regression on 3.18 (50%) * https://www.mail-archive.com/linux-samsung-soc@vger.kernel.org/msg38355.html * Commit fixing on the way https://git.kernel.org/cgit/linux/kernel/git/davem/net.git/commit/?id=436c2… * Lava lab toying (20%) * documented to https://plus.google.com/u/0/+RikuVoipio/posts/AEZwQenjzLP * Cards updates CARD-643 CARD-1729 (20%) * Qemu linux-user pull request for 2.2 (10%) == Plans == * Switch kvm/xen guest images, DEVPLAT-264 * Find out the needed next steps for ARMv8 slaves (CARD-1729)

9 years, 10 months

[ACTIVITY] Week 45

by Dileep Katta

== Progress == * CARD 1103: Flash support on u-boot fastboot (CARD-1103: 0%) - None * Enabling UEFI Fastboot on Panda (CARD-198: 100%) - Testing and rework done, submitting the changes for internal review == Plans == * CARD 1103: Flash support on u-boot fastboot (CARD-1103: 50 %) - Some patches for fastboot needs to be added to Linaro tree. - Discuss with Praneeth and Fathi and work on the content agreed upon * Enabling UEFI Fastoot on Panda (CARD-198: 50%) - Work with UEFI experts in Linaro to get the changes reviewed - rework if required == Issues == * None

9 years, 10 months

[RFC] rt-app: add script to generate small task workloads

by pi-cheng.chen

Some examples to use the script to generate small tasks workloads: 1. to generate a workload with 4 threads, 10% load and 30ms period $ ./small_task_gen -t 4 -l 10 -p 3 2. to generate a workload with 3 threads, 15% load and random tick-aligned period $ ./small_task_gen -t 3 -l 15 -r --aligned 3. to generate a workload with 5 threads, 20% load and random non-tick-aligned period $ ./small_task_gen -t 5 -l 20 -r --unaligned --- doc/examples/small_task_gen | 117 ++++++++++++++++++++++++++++++++++++++++++++ 1 file changed, 117 insertions(+) create mode 100755 doc/examples/small_task_gen diff --git a/doc/examples/small_task_gen b/doc/examples/small_task_gen new file mode 100755 index 0000000..ba74753 --- /dev/null +++ b/doc/examples/small_task_gen @@ -0,0 +1,117 @@ +#!/usr/bin/env python + +import sys +import getopt +import random + +outfile = "small_tasks.json" +tasks = None +loading = None +period = None +randomized = None +aligned = None + + +def usage(): + print "Usage:" + print sys.argv[0] + " -t <number of tasks>" + print "\t\t -l <percentage of task loading> (1 - 100)" + print "\t\t -p <fixed period in ms>" + print "\t\t -r [--aligned | --unaligned] (randomize periods of tasks)" + print "\t\t -o <output JSON file name> (default: small_tasks.json)" + return + + +def parse_options(): + global outfile + global tasks + global loading + global period + global randomized + global aligned + + try: + opts, args = getopt.getopt(sys.argv[1:], "t:l:o:p:rh", + ["aligned", "unaligned"]) + except getopt.GetoptError: + usage() + sys.exit(2) + + for o, a in opts: + if o == "-t": + tasks = int(a) + print "number of tasks: %d" % tasks + if o == "-l": + loading = int(a) + print "task loading: %d" % loading + if o == "-o": + outfile = a; + print "output workload JSON file: " + outfile + if o == "-p": + period = int(a) + print "period of tasks: %d" % period + if o == "-r": + randomized = True + print "randomized: %r" % randomized + if o == "--aligned": + if aligned == False: + usage() + sys.exit(2) + aligned = True + print "aligned: %r" % aligned + if o in "--unaligned": + if aligned == True: + usage() + sys.exit(2) + aligned = False + print "aligned: %r" % aligned + if o == "-h": + usage() + sys.exit(2) + + if not period is None and not randomized is None: + usage() + sys.exit(2) + + if tasks is None or (period is None and randomized is None): + usage() + sys.exit(2) + + return + + +def generate_workload(): + try: + f = open(outfile, "w") + except IOError: + print "WARN: Unable to open " + infile + sys.exit(2) + + f.write("{\n") + f.write("\t\"tasks\" : {\n") + + for i in range(0, tasks): + + if randomized is None: + period_ns = period * 1000 + else: + period_ns = random.randrange(1, 6) * 10000 # random tick-aligned period from 10ms~50ms + if aligned == False: # add a period offset randomly from 1 of [300, 500, 700] + period_ns += (3000, 5000, 7000)[random.randrange(0, 3)] + + run_ns = period_ns * loading / 100 + + f.write("\t\t\"thread%d\" : {\n" % i) + f.write("\t\t\t\"loop\" : -1,\n") + f.write("\t\t\t\"run\" : %d,\n" % run_ns) + f.write("\t\t\t\"timer\" : { \"ref\" : \"tick\", \"period\" : %d },\n" % period_ns) + f.write("\t\t},\n") + + f.write("\t},\n") + f.write("}\n") + return + + +if __name__ == '__main__': + parse_options() + generate_workload() -- 1.9.1

9 years, 10 months

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

2014

2013

2012

2011

2010

linaro-dev November 2014