Sched-tools

sched-tools@lists.linaro.org

94 discussions

by Vincent Guittot

Align the comment and values of examples files Signed-off-by: Vincent Guittot <vincent.guittot(a)linaro.org> --- doc/examples/tutorial/example1.json | 2 +- doc/examples/tutorial/example2.json | 2 +- doc/examples/tutorial/example3.json | 4 ++-- doc/examples/tutorial/example5.json | 2 +- 4 files changed, 5 insertions(+), 5 deletions(-) diff --git a/doc/examples/tutorial/example1.json b/doc/examples/tutorial/example1.json index 4ae2914..48f4941 100644 --- a/doc/examples/tutorial/example1.json +++ b/doc/examples/tutorial/example1.json @@ -1,6 +1,6 @@ { /* - * Simple use case which creates a thread that run 1ms then sleep 9ms + * Simple use case which creates a thread that run 2ms then sleep 8ms * until the use case is stopped with Ctrl+C */ "tasks" : { diff --git a/doc/examples/tutorial/example2.json b/doc/examples/tutorial/example2.json index 6bf8973..970a37a 100644 --- a/doc/examples/tutorial/example2.json +++ b/doc/examples/tutorial/example2.json @@ -7,7 +7,7 @@ "thread0" : { "instance" : 1, "loop" : -1, - "run" : 20000, + "run" : 10000, "timer" : { "ref" : "unique", "period" : 100000 } } }, diff --git a/doc/examples/tutorial/example3.json b/doc/examples/tutorial/example3.json index 7dbd94c..a304d32 100644 --- a/doc/examples/tutorial/example3.json +++ b/doc/examples/tutorial/example3.json @@ -10,12 +10,12 @@ "phases" : { "light" : { "loop" : 10, - "run" : 1000, + "run" : 3000, "timer" : { "ref" : "unique", "period" : 30000 } }, "heavy" : { "loop" : 10, - "run" : 4000, + "run" : 27000, "timer" : { "ref" : "unique", "period" : 30000 } } } diff --git a/doc/examples/tutorial/example5.json b/doc/examples/tutorial/example5.json index 4ad421a..ab730a1 100644 --- a/doc/examples/tutorial/example5.json +++ b/doc/examples/tutorial/example5.json @@ -1,6 +1,6 @@ { /* This example doesn't care of unique id constraint imposed for json - * file and multiplies thge used of the same key id at same object's level. + * file and multiplies the used of the same key id at same object's level. * Removing this constraint makes the json file more readable and easier * to create. This file can't be used directly with rt-app but can be used * with workgen which parses and modifies it to match with json requirement -- 1.9.1

8 years, 9 months

Pagefault with Idlestat

by $rik＠nth

Hi Linaro Dev team, I am trying to debug some scheduler changes on my new QUalcomm snapdragon development board. To debug it further, i have cross compiled the idlestat and tried to run for collecting traces. But it shows segfault right after starting it with `idlestat --trace -f /sdcard/mytrace -t 10 -p -c -w -- cyclictest Pagefault logs can be found here [1] . Any suggestions will be much appreciated. [1] http://hastebin.com/efuximudum.xml -- Thanks & Regards, M.Srikanth Kumar.

8 years, 9 months

Re: [Sched-tools] [PATCH v2] rt-app: Add IO-bounded and memory-bounded events.

by Pi-Cheng Chen

Fix sched-tools list On Thu, Jul 2, 2015 at 3:15 PM, Pi-Cheng Chen <pi-cheng.chen(a)linaro.org> wrote: > Hi Vincent, > > On Fri, May 29, 2015 at 5:19 PM, Vincent Guittot > <vincent.guittot(a)linaro.org> wrote: >> Hi Pi-cheng, >> >> On 16 December 2014 at 04:57, pi-cheng.chen <pi-cheng.chen(a)linaro.org> wrote: >>> Add 2 new kind of event for running a memory or a io bounded load. >>> "mem" name for a load is memory bounded, and "iorun" name for a load is io >>> bounded. The default file to be written to create the load is /dev/null and >>> the device/file could be specified with "io_device" key in "global" section. >>> The size of per-thread memory buffer to create IO/memory load could also be >>> specified with "mem_buffer_size" in the same section. >>> >>> E.g. >>> "tasks" : { >>> "thread0" : >>> { "sleep" : 1000, "run" : 100, "mem" : 1000, "sleep" 10000, "iorun" : 1000 } >>> }, >>> "global" : { "io_device" : "/dev/ttyS0", "mem_buffer_size" : 1048576 } >>> >>> changes v1 to v2: >>> Allocate per-thread memory buffer. Add "mem_buffer_size" in global section to >>> set the size of memory buffer to be allocated. And fix possible buffer overrun >>> when creating IO-bounded load. >>> >>> Signed-off-by: pi-cheng.chen <pi-cheng.chen(a)linaro.org> >>> --- >>> src/rt-app.c | 104 +++++++++++++++++++++++++++++++++++++++++++++- >>> src/rt-app_parse_config.c | 27 ++++++++++++ >>> src/rt-app_types.h | 11 +++++ >>> 3 files changed, 140 insertions(+), 2 deletions(-) >>> >>> diff --git a/src/rt-app.c b/src/rt-app.c >>> index 3cd601d..16bbe48 100644 >>> --- a/src/rt-app.c >>> +++ b/src/rt-app.c >>> @@ -33,7 +33,9 @@ static volatile int continue_running; >>> static pthread_t *threads; >>> static int nthreads; >>> static int p_load; >>> +static int io_fd; >>> rtapp_options_t opts; >>> +static iomem_buf_t *iomem_buf; >> >> You should better create a iomem_buf_t iomem_buf field into the thread >> struct so you don't have to allocate additionnal array beside > > Yes. So the the array to be used could be allocated only when I get a > "mem" and "iorun" event during the resources parsing stage, right? > >> >>> >>> static ftrace_data_t ft_data = { >>> .debugfs = "/sys/kernel/debug", >>> @@ -110,8 +112,57 @@ static inline loadwait(unsigned long exec) >>> return load_count; >>> } >>> >>> +static void ioload(unsigned long count, iomem_buf_t *iomem) >>> +{ >>> + ssize_t ret; >>> + >>> + while (count != 0) { >>> + unsigned long size; >>> + >>> + if (count > iomem->size) >>> + size = iomem->size; >>> + else >>> + size = count; >> >> Why can't we loop on the buffer and write more than it's size in the io ? > > Sorry. I am not sure what you mean. Would you elaborate? > What I do here is trying to cut the requested IO size into small pieces > of chunk which is exactly the per-thread buffer sized to avoid buffer > overrun. > > It looks a little complicated because I want to start every IO/memory > busy loop from the position at which last IO/memory busy loop stopped. > I think it would help to trash the cache more. What do you think about it? > I remember you suggested to start at the zero position every time as Ivan > suggested at last connect, right? > > Thanks for reviewing. > > Best Regards, > Pi-Cheng > >> >>> + >>> + if (size > (iomem->size - iomem->pos)) >>> + size = iomem->size - iomem->pos; >>> + >>> + ret = write(io_fd, iomem->buf + iomem->pos, size); >>> + if (ret == -1) { >>> + perror("write"); >>> + return; >>> + } >>> + count -= ret; >>> + iomem->pos += ret; >>> + if (iomem->pos >= iomem->size) >>> + iomem->pos -= iomem->size; >>> + } >>> +} >>> + >>> +static void memload(unsigned long count, iomem_buf_t *iomem) >>> +{ >>> + while (count > 0) { >>> + unsigned long size; >>> + >>> + if (count > iomem->size) >>> + size = iomem->size; >>> + else >>> + size = count; >> >> same question as for io >> >>> + >>> + if (size > (iomem->size - iomem->pos)) >>> + size = iomem->size - iomem->pos; >>> + >>> + memset(iomem->buf + iomem->pos, 0, size); >>> + count -= size; >>> + iomem->pos += size; >>> + if (iomem->pos >= iomem->size) >>> + iomem->pos -= iomem->size; >>> + } >>> +} >>> + >>> static int run_event(event_data_t *event, int dry_run, >>> - unsigned long *perf, unsigned long *duration, rtapp_resource_t *resources) >>> + unsigned long *perf, unsigned long *duration, >>> + rtapp_resource_t *resources, int ind) >>> { >>> rtapp_resource_t *rdata = &(resources[event->res]); >>> rtapp_resource_t *ddata = &(resources[event->dep]); >>> @@ -196,6 +247,18 @@ static int run_event(event_data_t *event, int dry_run, >>> pthread_mutex_unlock(&(ddata->res.mtx.obj)); >>> break; >>> } >>> + case rtapp_mem: >>> + { >>> + log_debug("mem %d", event->count); >>> + memload(event->count, &iomem_buf[ind]); >>> + } >>> + break; >>> + case rtapp_iorun: >>> + { >>> + log_debug("iorun %d", event->count); >>> + ioload(event->count, &iomem_buf[ind]); >>> + } >>> + break; >>> } >>> >>> return lock; >>> @@ -218,7 +281,8 @@ int run(int ind, event_data_t *events, >>> log_ftrace(ft_data.marker_fd, >>> "[%d] locking %d", >>> ind, events[i].type); >>> - lock += run_event(&events[i], !continue_running, &perf, duration, resources); >>> + lock += run_event(&events[i], !continue_running, &perf, >>> + duration, resources, ind); >>> } >>> >>> return perf; >>> @@ -488,6 +552,35 @@ int main(int argc, char* argv[]) >>> >>> parse_command_line(argc, argv, &opts); >>> >>> + /* >>> + * allocate per-thread memory buffers for memory-bound and IO-bound >>> + * busy loops >>> + */ >>> + iomem_buf = malloc(sizeof(iomem_buf_t) * opts.nthreads); >>> + if (!iomem_buf) { >>> + log_error("Cannot allocate memory for IO/memory buffer struct"); >>> + exit(EXIT_FAILURE); >>> + } >>> + for (i = 0; i < opts.nthreads; i++) { >>> + iomem_buf_t *iomem = &iomem_buf[i]; >>> + >>> + iomem->size = opts.mem_buffer_size; >>> + iomem->buf = malloc(iomem->size); >>> + if (!iomem->buf) { >>> + log_error("Cannot allocate memory for memory-bounded" >>> + "and IO-bounded busy loops"); >>> + exit(EXIT_FAILURE); >>> + } >>> + iomem->pos = 0; >>> + } >>> + >>> + /* open file for IO-bound busy loops */ >>> + io_fd = open(opts.io_device, O_CREAT | O_WRONLY, 0644); >>> + if (io_fd < 0) { >>> + log_error("Cannot open io_device file %s", opts.io_device); >>> + exit(EXIT_FAILURE); >>> + } >>> + >>> /* allocated threads */ >>> nthreads = opts.nthreads; >>> threads = malloc(nthreads * sizeof(pthread_t)); >>> @@ -713,6 +806,13 @@ int main(int argc, char* argv[]) >>> close(ft_data.trace_fd); >>> close(ft_data.marker_fd); >>> } >>> + >>> + close(io_fd); >>> + >>> + for (i = 0; i < nthreads; i++) >>> + free(iomem_buf[i].buf); >>> + free(iomem_buf); >>> + >>> exit(EXIT_SUCCESS); >>> >>> >>> diff --git a/src/rt-app_parse_config.c b/src/rt-app_parse_config.c >>> index e062f79..9bdf38a 100644 >>> --- a/src/rt-app_parse_config.c >>> +++ b/src/rt-app_parse_config.c >>> @@ -27,6 +27,7 @@ Foundation, Inc., 51 Franklin Street, Fifth Floor, Boston, MA 02110-1301, USA. >>> #define PIN2 PIN" " >>> #define PIN3 PIN2" " >>> #define JSON_FILE_BUF_SIZE 4096 >>> +#define DEFAULT_MEM_BUF_SIZE (4 * 1024 * 1024) >>> >>> /* redefine foreach as in <json/json_object.h> but to be ANSI >>> * compatible */ >>> @@ -320,6 +321,22 @@ parse_thread_event_data(char *name, struct json_object *obj, >>> return; >>> } >>> >>> + if (!strncmp(name, "mem", strlen("mem")) || >>> + !strncmp(name, "iorun", strlen("iorun"))) { >>> + if (!json_object_is_type(obj, json_type_int)) >>> + goto unknown_event; >>> + >>> + data->count = json_object_get_int(obj); >>> + >>> + if (!strncmp(name, "mem", strlen("mem"))) >>> + data->type = rtapp_mem; >>> + else >>> + data->type = rtapp_iorun; >>> + >>> + log_info(PIN2 "type %d count %d", data->type, data->count); >>> + return; >>> + } >>> + >>> if (!strncmp(name, "lock", strlen("lock")) || >>> !strncmp(name, "unlock", strlen("unlock"))) { >>> >>> @@ -493,6 +510,10 @@ obj_is_event(char *name) >>> return rtapp_suspend; >>> if (!strncmp(name, "resume", strlen("resume"))) >>> return rtapp_resume; >>> + if (!strncmp(name, "mem", strlen("mem"))) >>> + return rtapp_mem; >>> + if (!strncmp(name, "iorun", strlen("iorun"))) >>> + return rtapp_iorun; >>> >>> return 0; >>> } >>> @@ -677,6 +698,8 @@ parse_global(struct json_object *global, rtapp_options_t *opts) >>> opts->logbasename = strdup("rt-app"); >>> opts->ftrace = 0; >>> opts->pi_enabled = 0; >>> + opts->io_device = strdup("/dev/null"); >>> + opts->mem_buffer_size = DEFAULT_MEM_BUF_SIZE; >>> return; >>> } >>> >>> @@ -719,6 +742,10 @@ parse_global(struct json_object *global, rtapp_options_t *opts) >>> TRUE, "rt-app"); >>> opts->ftrace = get_bool_value_from(global, "ftrace", TRUE, 0); >>> opts->pi_enabled = get_bool_value_from(global, "pi_enabled", TRUE, 0); >>> + opts->io_device = get_string_value_from(global, "io_device", TRUE, >>> + "/dev/null"); >>> + opts->mem_buffer_size = get_int_value_from(global, "mem_buffer_size", >>> + TRUE, DEFAULT_MEM_BUF_SIZE); >>> >>> } >>> >>> diff --git a/src/rt-app_types.h b/src/rt-app_types.h >>> index cefb3a6..d230d45 100644 >>> --- a/src/rt-app_types.h >>> +++ b/src/rt-app_types.h >>> @@ -65,6 +65,8 @@ typedef enum resource_t >>> rtapp_timer, >>> rtapp_suspend, >>> rtapp_resume, >>> + rtapp_mem, >>> + rtapp_iorun, >>> } resource_t; >>> >>> struct _rtapp_mutex { >>> @@ -103,6 +105,7 @@ typedef struct _event_data_t { >>> int res; >>> int dep; >>> int duration; >>> + int count; >>> } event_data_t; >>> >>> typedef struct _phase_data_t { >>> @@ -165,6 +168,8 @@ typedef struct _rtapp_options_t { >>> >>> int ftrace; >>> int die_on_dmiss; >>> + char *io_device; >>> + int mem_buffer_size; >>> } rtapp_options_t; >>> >>> typedef struct _timing_point_t { >>> @@ -177,4 +182,10 @@ typedef struct _timing_point_t { >>> __u64 rel_start_time; >>> } timing_point_t; >>> >>> +typedef struct { >>> + char *buf; >>> + int pos; >>> + int size; >>> +} iomem_buf_t; >>> + >>> #endif // _RTAPP_TYPES_H_ >>> -- >>> 1.9.1 >>>

8 years, 10 months

[PATCH v3] workgen: Add video playback use cases

by Pi-Cheng Chen

Add video playback use cases Changes from v2 - replace "broad" with "resume" - create -short and -long version of video playback use case Changes from v1 - use suspend/resume as possible to simplify the use case Signed-off-by: Pi-Cheng Chen <pi-cheng.chen(a)linaro.org> --- doc/examples/video-long.json | 252 ++++++++++++++++++++++++++++++++++++++++++ doc/examples/video-short.json | 252 ++++++++++++++++++++++++++++++++++++++++++ 2 files changed, 504 insertions(+) create mode 100644 doc/examples/video-long.json create mode 100644 doc/examples/video-short.json diff --git a/doc/examples/video-long.json b/doc/examples/video-long.json new file mode 100644 index 0000000..bca02d9 --- /dev/null +++ b/doc/examples/video-long.json @@ -0,0 +1,252 @@ +{ + "tasks" : { + "surfaceflinger" : { + "priority" : -7, + "loop" : -1, + "suspend", + "run" : 1500 + }, + + "DispSync" : { + "priority" : -7, + "loop" : -1, + "phases" : { + "p1" : { + "suspend", + "run" : 35, + "resume" : "EventThread", + "run" : 40, + }, + + "p2" : { + "loop" : 2, + "suspend", + "run" : 30 + } + }, + }, + + "hwc_eventmon" : { + "priority" : -19, + "loop" : -1, + "resume" : "DispSync", + "run" : 115, + "timer" : { "ref" : "timerA", "period" : 16667 } + }, + + "EventThread1" : { + "priority" : -8, + "loop" : -1, + "phases" : { + "p1" : { + "suspend" : "EventThread", + "run" : 25, + "resume" : "DispSync", + "sleep" : 9650, + "run" : 70, + "resume" : "DispSync", + "run" : 80 + }, + + "p2" : { + "suspend" : "EventThread", + "run" : 90, + "resume" : "DispSync" + } + } + }, + + "EventThread2" : { + "priority" : -8, + "loop" : -1, + "phases" : { + "p1" : { + "suspend" : "EventThread", + "run" : 30, + "resume" : "surfaceflinger" + }, + + "p2" : { + "suspend" : "EventThread", + "run" : 35, + "sleep" : 2000, + "run" : 110, + "resume" : "DispSync", + "run" : 60 + } + } + }, + + "waker" : { + "priority" : -19, + "loop" : -1, + "resume" : "NuPlayerRenderer", + "timer" : { "ref" : "timerB", "period" : 33333 } + }, + + "NuPlayerRenderer" : { + "priority" : -15, + "loop" : -1, + "phases" : { + "p1" : { + "loop" : 3, + "suspend" : "NuPlayerRenderer", + "run" : 140, + "resume" : "NuPlayerDriver1", + "run" : 95 + }, + + "p2" : { + "sleep" : 27000, + "run" : 580, + "resume" : "NPDecoder", + "resume" : "NPDecoder-CL", + "resume" : "gle.aac.decoder" + } + } + }, + + "NuPlayerDriver1" : { + "priority" : -15, + "loop" : -1, + "suspend", + "run" : 100, + "lock" : "NuPlayerDriver", + "sync" : { "ref" : "NuPlayerDriver", "mutex" : "NuPlayerDriver" }, + "unlock" : "NuPlayerDriver", + "run" : 50, + "suspend" : "NuPlayerDriver", + "run" : 80, + "lock" : "NuPlayerDriver", + "sync" : { "ref" : "NuPlayerDriver", "mutex" : "NuPlayerDriver" }, + "unlock" : "NuPlayerDriver", + "run" : 370, + "lock" : "NuPlayerDriver", + "sync" : { "ref" : "NuPlayerDriver", "mutex" : "NuPlayerDriver" }, + "unlock" : "NuPlayerDriver", + "run" : 135, + "resume" : "NuPlayerDriver" + }, + + "NuPlayerDriver2" : { + "priority" : -15, + "loop" : -1, + "suspend" : "NuPlayerDriver", + "run" : 110, + "resume" : "NuPlayerDriver", + "resume" : "CodecLooper1", + "sleep" : 2500, + "run" : 80, + "lock" : "NuPlayerDriver", + "sync" : { "ref" : "NuPlayerDriver", "mutex" : "NuPlayerDriver" }, + "unlock" : "NuPlayerDriver", + "run" : 50, + "lock" : "NuPlayerDriver", + "sync" : { "ref" : "NuPlayerDriver", "mutex" : "NuPlayerDriver" }, + "unlock" : "NuPlayerDriver", + "run" : 70, + "lock" : "NuPlayerDriver", + "sync" : { "ref" : "NuPlayerDriver", "mutex" : "NuPlayerDriver" }, + "unlock" : "NuPlayerDriver", + "run" : 35 + }, + + "CodecLooper1" : { + "priority" : -15, + "loop" : -1, + "suspend", + "run" : 230, + "sleep" : 80, + "run" : 150, + "sleep" : 210, + "run" : 330, + "resume" : "CodecLooper2", + "sleep" : 900, + "run" : 170, + "sleep" : 670, + "run" : 125, + "resume" : "CodecLooper2" + }, + + "CodecLooper2" : { + "priority" : -1, + "loop" : -1, + "suspend", + "run" : 160, + "resume" : "CodecLooper3", + "sleep" : 590, + "resume" : "OMXCallbackDisp2", + "run" : 75, + "suspend", + "run" : 260 + }, + + "OMXCallbackDisp2" : { + "priority" : -1, + "loop" : -1, + "suspend", + "run" : 180 + }, + + "CodecLooper3" : { + "priority" : -1, + "loop" : -1, + "suspend", + "run" : 1000 + }, + + "NPDecoder" : { + "priority" : -15, + "loop" : -1, + "suspend", + "run" : 500, + "sleep" : 680, + "resume" : "OMXCallbackDisp1", + "run" : 2000 + }, + + "NPDecoder-CL" : { + "priority" : -15, + "loop" : -1, + "suspend", + "run" : 570, + "sleep" : 570, + "run" : 2100 + }, + + "gle.aac.decoder" : { + "priority" : -1, + "loop" : -1, + "suspend", + "run" : 2400, + "sleep" : 430, + "run" : 45 + }, + + "OMXCallbackDisp1" : { + "priority" : -1, + "loop" : -1, + "suspend", + "run" : 135, + "sleep" : 230, + "run" : 140, + "sleep" : 330, + "run" : 190, + "sleep" : 550, + "run" : 160 + } + }, + + "global" : { + "default_policy" : "SCHED_OTHER", + "duration" : 600, + "ftrace" : false, + "gnuplot" : false, + "logdir" : "./", + "log_basename" : "video", + "lock_pages" : true, + "frag" : 1, + "calibration" : "CPU0" + } +} + diff --git a/doc/examples/video-short.json b/doc/examples/video-short.json new file mode 100644 index 0000000..4592525 --- /dev/null +++ b/doc/examples/video-short.json @@ -0,0 +1,252 @@ +{ + "tasks" : { + "surfaceflinger" : { + "priority" : -7, + "loop" : -1, + "suspend", + "run" : 1500 + }, + + "DispSync" : { + "priority" : -7, + "loop" : -1, + "phases" : { + "p1" : { + "suspend", + "run" : 35, + "resume" : "EventThread", + "run" : 40, + }, + + "p2" : { + "loop" : 2, + "suspend", + "run" : 30 + } + }, + }, + + "hwc_eventmon" : { + "priority" : -19, + "loop" : -1, + "resume" : "DispSync", + "run" : 115, + "timer" : { "ref" : "timerA", "period" : 16667 } + }, + + "EventThread1" : { + "priority" : -8, + "loop" : -1, + "phases" : { + "p1" : { + "suspend" : "EventThread", + "run" : 25, + "resume" : "DispSync", + "sleep" : 9650, + "run" : 70, + "resume" : "DispSync", + "run" : 80 + }, + + "p2" : { + "suspend" : "EventThread", + "run" : 90, + "resume" : "DispSync" + } + } + }, + + "EventThread2" : { + "priority" : -8, + "loop" : -1, + "phases" : { + "p1" : { + "suspend" : "EventThread", + "run" : 30, + "resume" : "surfaceflinger" + }, + + "p2" : { + "suspend" : "EventThread", + "run" : 35, + "sleep" : 2000, + "run" : 110, + "resume" : "DispSync", + "run" : 60 + } + } + }, + + "waker" : { + "priority" : -19, + "loop" : -1, + "resume" : "NuPlayerRenderer", + "timer" : { "ref" : "timerB", "period" : 33333 } + }, + + "NuPlayerRenderer" : { + "priority" : -15, + "loop" : -1, + "phases" : { + "p1" : { + "loop" : 3, + "suspend" : "NuPlayerRenderer", + "run" : 140, + "resume" : "NuPlayerDriver1", + "run" : 95 + }, + + "p2" : { + "sleep" : 27000, + "run" : 580, + "resume" : "NPDecoder", + "resume" : "NPDecoder-CL", + "resume" : "gle.aac.decoder" + } + } + }, + + "NuPlayerDriver1" : { + "priority" : -15, + "loop" : -1, + "suspend", + "run" : 100, + "lock" : "NuPlayerDriver", + "sync" : { "ref" : "NuPlayerDriver", "mutex" : "NuPlayerDriver" }, + "unlock" : "NuPlayerDriver", + "run" : 50, + "suspend" : "NuPlayerDriver", + "run" : 80, + "lock" : "NuPlayerDriver", + "sync" : { "ref" : "NuPlayerDriver", "mutex" : "NuPlayerDriver" }, + "unlock" : "NuPlayerDriver", + "run" : 370, + "lock" : "NuPlayerDriver", + "sync" : { "ref" : "NuPlayerDriver", "mutex" : "NuPlayerDriver" }, + "unlock" : "NuPlayerDriver", + "run" : 135, + "resume" : "NuPlayerDriver" + }, + + "NuPlayerDriver2" : { + "priority" : -15, + "loop" : -1, + "suspend" : "NuPlayerDriver", + "run" : 110, + "resume" : "NuPlayerDriver", + "resume" : "CodecLooper1", + "sleep" : 2500, + "run" : 80, + "lock" : "NuPlayerDriver", + "sync" : { "ref" : "NuPlayerDriver", "mutex" : "NuPlayerDriver" }, + "unlock" : "NuPlayerDriver", + "run" : 50, + "lock" : "NuPlayerDriver", + "sync" : { "ref" : "NuPlayerDriver", "mutex" : "NuPlayerDriver" }, + "unlock" : "NuPlayerDriver", + "run" : 70, + "lock" : "NuPlayerDriver", + "sync" : { "ref" : "NuPlayerDriver", "mutex" : "NuPlayerDriver" }, + "unlock" : "NuPlayerDriver", + "run" : 35 + }, + + "CodecLooper1" : { + "priority" : -15, + "loop" : -1, + "suspend", + "run" : 230, + "sleep" : 80, + "run" : 150, + "sleep" : 210, + "run" : 330, + "resume" : "CodecLooper2", + "sleep" : 900, + "run" : 170, + "sleep" : 670, + "run" : 125, + "resume" : "CodecLooper2" + }, + + "CodecLooper2" : { + "priority" : -1, + "loop" : -1, + "suspend", + "run" : 160, + "resume" : "CodecLooper3", + "sleep" : 590, + "resume" : "OMXCallbackDisp2", + "run" : 75, + "suspend", + "run" : 260 + }, + + "OMXCallbackDisp2" : { + "priority" : -1, + "loop" : -1, + "suspend", + "run" : 180 + }, + + "CodecLooper3" : { + "priority" : -1, + "loop" : -1, + "suspend", + "run" : 1000 + }, + + "NPDecoder" : { + "priority" : -15, + "loop" : -1, + "suspend", + "run" : 500, + "sleep" : 680, + "resume" : "OMXCallbackDisp1", + "run" : 2000 + }, + + "NPDecoder-CL" : { + "priority" : -15, + "loop" : -1, + "suspend", + "run" : 570, + "sleep" : 570, + "run" : 2100 + }, + + "gle.aac.decoder" : { + "priority" : -1, + "loop" : -1, + "suspend", + "run" : 2400, + "sleep" : 430, + "run" : 45 + }, + + "OMXCallbackDisp1" : { + "priority" : -1, + "loop" : -1, + "suspend", + "run" : 135, + "sleep" : 230, + "run" : 140, + "sleep" : 330, + "run" : 190, + "sleep" : 550, + "run" : 160 + } + }, + + "global" : { + "default_policy" : "SCHED_OTHER", + "duration" : 6, + "ftrace" : false, + "gnuplot" : false, + "logdir" : "./", + "log_basename" : "video", + "lock_pages" : true, + "frag" : 1, + "calibration" : "CPU0" + } +} + -- 1.9.1

8 years, 10 months

[PATCH] workgen: Add a video playback use case

by Pi-Cheng Chen

Signed-off-by: Pi-Cheng Chen <pi-cheng.chen(a)linaro.org> --- doc/examples/video_playback.json | 278 +++++++++++++++++++++++++++++++++++++++ 1 file changed, 278 insertions(+) create mode 100644 doc/examples/video_playback.json diff --git a/doc/examples/video_playback.json b/doc/examples/video_playback.json new file mode 100644 index 0000000..941b20f --- /dev/null +++ b/doc/examples/video_playback.json @@ -0,0 +1,278 @@ +{ + "tasks" : { + "surfaceflinger" : { + "priority" : -7, + "loop" : -1, + "suspend" : "surfaceflinger", + "run" : 1500 + }, + + "DispSync" : { + "priority" : -7, + "loop" : -1, + "phases" : { + "p1" : { + "lock" : "mutexB", + "wait" : { "ref" : "DispSync", "mutex" : "mutexB" }, + "unlock": "mutexB", + "run" : 35, + "lock" : "mutexA", + "broad" : "EventThread", + "unlock" : "mutexA", + "run" : 40, + }, + + "p2" : { + "loop" : 2, + + "lock" : "mutexB", + "wait" : { "ref" : "DispSync", "mutex" : "mutexB" }, + "unlock": "mutexB", + "run" : 30 + } + }, + }, + + "hwc_eventmon" : { + "priority" : -19, + "loop" : -1, + "lock" : "mutexB", + "signal" : "DispSync", + "unlock": "mutexB", + "run" : 115, + "timer" : { "ref" : "timerA", "period" : 16667 } + }, + + "EventThread1" : { + "priority" : -8, + "loop" : -1, + "phases" : { + "p1" : { + "lock" : "mutexA", + "wait" : { "ref" : "EventThread", "mutex" : "mutexA" }, + "unlock" : "mutexA", + "run" : 25, + "lock" : "mutexB", + "signal" : "DispSync", + "unlock": "mutexB", + "sleep" : 9650, + "run" : 70, + "lock" : "mutexB", + "signal" : "DispSync", + "unlock": "mutexB", + "run" : 80 + }, + + "p2" : { + "lock" : "mutexA", + "wait" : { "ref" : "EventThread", "mutex" : "mutexA" }, + "unlock" : "mutexA", + "run" : 90, + "lock" : "mutexB", + "signal" : "DispSync", + "unlock": "mutexB" + } + } + }, + + "EventThread2" : { + "priority" : -8, + "loop" : -1, + "phases" : { + "p1" : { + "lock" : "mutexA", + "wait" : { "ref" : "EventThread", "mutex" : "mutexA" }, + "unlock" : "mutexA", + "run" : 30, + "resume" : "surfaceflinger" + }, + + "p2" : { + "lock" : "mutexA", + "wait" : { "ref" : "EventThread", "mutex" : "mutexA" }, + "unlock" : "mutexA", + "run" : 35, + "sleep" : 2000, + "run" : 110, + "lock" : "mutexB", + "signal" : "DispSync", + "unlock": "mutexB", + "run" : 60 + } + } + }, + + "waker" : { + "priority" : -19, + "loop" : -1, + "resume" : "NuPlayerRenderer", + "timer" : { "ref" : "timerB", "period" : 33333 } + }, + + "NuPlayerRenderer" : { + "priority" : -15, + "loop" : -1, + "phases" : { + "p1" : { + "loop" : 3, + "suspend" : "NuPlayerRenderer", + "run" : 140, + "signal" : "NuPlayerDriver1", + "run" : 95 + }, + + "p2" : { + "sleep" : 27000, + "run" : 580, + "resume" : "NPDecoder", + "resume" : "NPDecoder-CL", + "resume" : "gle.aac.decoder" + } + } + }, + + "NuPlayerDriver1" : { + "priority" : -15, + "loop" : -1, + "suspend" : "NuPlayerDriver1", + "run" : 100, + "lock" : "mutexC", + "sync" : { "ref" : "NuPlayerDriver", "mutex" : "mutexC" }, + "unlock" : "mutexC", + "run" : 50, + "lock" : "mutexC", + "wait" : { "ref" : "NuPlayerDriver", "mutex" : "mutexC" }, + "unlock" : "mutexC", + "run" : 80, + "lock" : "mutexC", + "sync" : { "ref" : "NuPlayerDriver", "mutex" : "mutexC" }, + "unlock" : "mutexC", + "run" : 370, + "lock" : "mutexC", + "sync" : { "ref" : "NuPlayerDriver", "mutex" : "mutexC" }, + "unlock" : "mutexC", + "run" : 135, + "lock" : "mutexC", + "signal" : "NuPlayerDriver", + "unlock" : "mutexC" + }, + + "NuPlayerDriver2" : { + "priority" : -15, + "loop" : -1, + "lock" : "mutexC", + "wait" : { "ref" : "NuPlayerDriver", "mutex" : "mutexC" }, + "unlock" : "mutexC", + "run" : 110, + "lock" : "mutexC", + "signal" : "NuPlayerDriver", + "unlock" : "mutexC", + "lock" : "mutexD", + "signal" : "CodecLooper1", + "unlock" : "mutexD", + "sleep" : 2500, + "run" : 80, + "lock" : "mutexC", + "sync" : { "ref" : "NuPlayerDriver", "mutex" : "mutexC" }, + "unlock" : "mutexC", + "run" : 50, + "lock" : "mutexC", + "sync" : { "ref" : "NuPlayerDriver", "mutex" : "mutexC" }, + "unlock" : "mutexC", + "run" : 70, + "lock" : "mutexC", + "sync" : { "ref" : "NuPlayerDriver", "mutex" : "mutexC" }, + "unlock" : "mutexC", + "run" : 35 + }, + + "CodecLooper1" : { + "priority" : -15, + "loop" : -1, + "lock" : "mutexD", + "wait" : { "ref" : "CodecLooper1", "mutex" : "mutexD" }, + "unlock" : "mutexD", + "run" : 230, + "sleep" : 80, + "run" : 150, + "sleep" : 210, + "run" : 330, + "resume" : "CodecLooper2", + "sleep" : 900, + "run" : 170, + "sleep" : 670, + "run" : 125, + "resume" : "CodecLooper2" + }, + + "CodecLooper2" : { + "priority" : -1, + "loop" : -1, + "suspend" : "CodecLooper2", + "run" : 160, + "resume" : "CodecLooper3", + "sleep" : 590, + "resume" : "OMXCallbackDisp2", + "run" : 75, + "suspend" : "CodecLooper2", + "run" : 260 + }, + + "OMXCallbackDisp2" : { + "priority" : -1, + "loop" : -1, + "suspend" : "OMXCallbackDisp2", + "run" : 180 + }, + + "CodecLooper3" : { + "priority" : -1, + "loop" : -1, + "suspend" : "CodecLooper3", + "run" : 1000 + }, + + "NPDecoder" : { + "priority" : -15, + "loop" : -1, + "suspend" : "NPDecoder", + "run" : 500, + "sleep" : 680, + "resume" : "OMXCallbackDisp1", + "run" : 2000 + }, + + "NPDecoder-CL" : { + "priority" : -15, + "loop" : -1, + "suspend" : "NPDecoder-CL", + "run" : 570, + "sleep" : 570, + "run" : 2100 + }, + + "gle.aac.decoder" : { + "priority" : -1, + "loop" : -1, + "suspend" : "gle.aac.decoder", + "run" : 2400, + "sleep" : 430, + "run" : 45 + }, + + "OMXCallbackDisp1" : { + "priority" : -1, + "loop" : -1, + "suspend" : "OMXCallbackDisp1", + "run" : 135, + "sleep" : 230, + "run" : 140, + "sleep" : 330, + "run" : 190, + "sleep" : 550, + "run" : 160 + } + } +} + + -- 1.9.1

8 years, 10 months

[RESEND PATCH v3] doc: measure the efficiency of cpufreq governors

by Xunlei Pang

From: Xunlei Pang <pang.xunlei(a)linaro.org> DVFS adds a latency in the execution of task because of the time to decide to move at max freq. We need to measure this latency and check that the governor stays in an acceptable range. When rt-app runs a json file, a log file is created for each thread. This log file records the number of loop that has been executed and the duration for executing these loops (per phase). We can use these figures to evaluate to latency that is added by a cpufreq governor and its "performance efficiency". We use the run+sleep pattern to do the measurement, for the run time per loop, the performance governor should run the expected duration as the CPU stays a max freq. At the opposite, the powersave governor will give use the longest duration (as it stays at lowest OPP). Other governor will be somewhere between the 2 previous duration as they will use several OPP and will go back to max frequency after a defined duration which depends on its monitoring period. The formula: duration of powersave gov - duration of the gov -------------------------------------------------------- x 100% duration of powersave gov - duration of performance gov will give the efficiency of the governor. 100% means as efficient as the perf governor and 0% means as efficient as the powersave governor. This patch offers json files and shell scripts to do the measurement. Usage: ./calibration.sh <cpu> cpu: cpu number on which you want to run the test ./test.sh <governor> <cpu> <runtime> <sleeptime> [<loops>] governor: target CPUFreq governor you want to test cpu: cpu number on which you want to run the test. Be the same as the one passed to "calibration.sh". runtime: running time in ms per loop of the workload pattern sleeptime: sleeping time in ms per loop of the workload pattern loops: repeat times of the workload pattern. default: 10 Example: "./calibration.sh 0" means to calculate the computing capacity of CPU0 which will be used in the following test. "./test.sh ondemand 0 100 100 20" means to test "ondemand" on CPU0 with workload pattern "run 100ms + sleep 100ms"(20 loops). NOTE: - Make sure there are "sed", "cut", "grep", "rt-app", etc tools on your test machine, and run the scripts under root privilege. - Run the test while the system is idle. - You can change the target governor's parameters after running "calibration.sh", but before "test.sh". Signed-off-by: Xunlei Pang <pang.xunlei(a)linaro.org> --- doc/examples/cpufreq_governor_efficiency/README | 60 ++++++++++++ .../cpufreq_governor_efficiency/calibration.json | 26 ++++++ .../cpufreq_governor_efficiency/calibration.sh | 17 ++++ doc/examples/cpufreq_governor_efficiency/dvfs.json | 27 ++++++ doc/examples/cpufreq_governor_efficiency/dvfs.sh | 38 ++++++++ doc/examples/cpufreq_governor_efficiency/test.sh | 104 +++++++++++++++++++++ 6 files changed, 272 insertions(+) create mode 100755 doc/examples/cpufreq_governor_efficiency/README create mode 100755 doc/examples/cpufreq_governor_efficiency/calibration.json create mode 100755 doc/examples/cpufreq_governor_efficiency/calibration.sh create mode 100755 doc/examples/cpufreq_governor_efficiency/dvfs.json create mode 100755 doc/examples/cpufreq_governor_efficiency/dvfs.sh create mode 100755 doc/examples/cpufreq_governor_efficiency/test.sh diff --git a/doc/examples/cpufreq_governor_efficiency/README b/doc/examples/cpufreq_governor_efficiency/README new file mode 100755 index 0000000..10482b8 --- /dev/null +++ b/doc/examples/cpufreq_governor_efficiency/README @@ -0,0 +1,60 @@ +Measure the efficiency of cpufreq governors using rt-app + +BACKGROUND: + DVFS adds a latency in the execution of task because of the time to + decide to move at max freq. We need to measure this latency and check + that the governor stays in an acceptable range. + + When rt-app runs a json file, a log file is created for each thread. + This log file records the number of loop that has been executed and + the duration for executing these loops (per phase). We can use these + figures to evaluate to latency that is added by a cpufreq governor + and its "performance efficiency". + + We use the run+sleep pattern to do the measurement, for the run time per + loop, the performance governor should run the expected duration as the + CPU stays a max freq. At the opposite, the powersave governor will give + use the longest duration (as it stays at lowest OPP). Other governor will + be somewhere between the 2 previous duration as they will use several OPP + and will go back to max frequency after a defined duration which depends + on its monitoring period. + + The formula: + + duration of powersave gov - duration of the gov + -------------------------------------------------------- x 100% + duration of powersave gov - duration of performance gov + + will give the efficiency of the governor. 100% means as efficient as + the perf governor and 0% means as efficient as the powersave governor. + + This test offers json files and shell scripts to do the measurement. + +Usage: + ./calibration.sh <cpu> + cpu: cpu number on which you want to run the test + + ./test.sh <governor> <cpu> <runtime> <sleeptime> [<loops>] + governor: target CPUFreq governor you want to test + cpu: cpu number on which you want to run the test. Be the same + as the one passing to "calibration.sh". + runtime: running time in ms per loop of the workload pattern + sleeptime: sleeping time in ms per loop of the workload pattern + loops: repeat times of the workload pattern. default: 10 + +Example: + "./calibration.sh 0" means to calculate the computing capacity of CPU0 which + will be used in the following test. + + "./test.sh ondemand 0 100 100 20" means to + test "ondemand" on CPU0 with workload pattern "run 100ms + sleep 100ms"(20 loops). + +NOTE: + - Make sure there are "sed", "cut", "grep", "rt-app", etc tools on + your test machine, and run the scripts under root privilege. + + - Run the test while the system is idle. + + - You can change the target governor's parameters after running "calibration.sh", + but before "test.sh". + diff --git a/doc/examples/cpufreq_governor_efficiency/calibration.json b/doc/examples/cpufreq_governor_efficiency/calibration.json new file mode 100755 index 0000000..2d5870c --- /dev/null +++ b/doc/examples/cpufreq_governor_efficiency/calibration.json @@ -0,0 +1,26 @@ +{ + "tasks" : { + "thread" : { + "instance" : 1, + "loop" : 1, + "phases" : { + "run" : { + "loop" : 1, + "run" : 2000, + }, + "sleep" : { + "loop" : 1, + "sleep" : 2000, + } + } + } + }, + "global" : { + "default_policy" : "SCHED_FIFO", + "calibration" : "CPU0", + "lock_pages" : true, + "ftrace" : false, + "logdir" : "./", + } +} + diff --git a/doc/examples/cpufreq_governor_efficiency/calibration.sh b/doc/examples/cpufreq_governor_efficiency/calibration.sh new file mode 100755 index 0000000..a217487 --- /dev/null +++ b/doc/examples/cpufreq_governor_efficiency/calibration.sh @@ -0,0 +1,17 @@ +#!/bin/sh + +set -e + +if [ ! $1 ] ; then + echo "Please input one cpu" + exit +fi + +echo performance > /sys/devices/system/cpu/cpu$1/cpufreq/scaling_governor + +sleep 1 + +sed 's/"calibration" : "CPU.*",/"calibration" : "CPU'$1'",/' -i calibration.json +pLoad=$(rt-app calibration.json 2>&1 |grep pLoad |sed 's/.*= $.*$ns.*/\1/') +sed 's/"calibration" : .*,/"calibration" : '$pLoad',/' -i dvfs.json +echo CPU$1\'s pLoad is $pLoad diff --git a/doc/examples/cpufreq_governor_efficiency/dvfs.json b/doc/examples/cpufreq_governor_efficiency/dvfs.json new file mode 100755 index 0000000..c8447df --- /dev/null +++ b/doc/examples/cpufreq_governor_efficiency/dvfs.json @@ -0,0 +1,27 @@ +{ + "tasks" : { + "thread" : { + "instance" : 1, + "cpus" : [0], +"loop" : 21, + "phases" : { + "running" : { + "loop" : 1, + "run" : 100, + }, + "sleeping" : { + "loop" : 1, + "sleep" : 100, + } + } + } + }, + "global" : { + "default_policy" : "SCHED_OTHER", + "calibration" : 90, + "lock_pages" : true, + "ftrace" : false, + "logdir" : "./", + } +} + diff --git a/doc/examples/cpufreq_governor_efficiency/dvfs.sh b/doc/examples/cpufreq_governor_efficiency/dvfs.sh new file mode 100755 index 0000000..00ce81d --- /dev/null +++ b/doc/examples/cpufreq_governor_efficiency/dvfs.sh @@ -0,0 +1,38 @@ +#!/bin/sh + +# $1 $2 $3 $4 $5: governor cpu run sleep loops +set -e + +echo $1 > /sys/devices/system/cpu/cpu$2/cpufreq/scaling_governor +#echo $1 > /sys/devices/system/cpu/cpu1/cpufreq/scaling_governor +sed 's/"cpus" : \[.*\],/"cpus" : \['$2'\],/' -i dvfs.json +sleep 3 + +if [ $3 ] ; then + sed 's/"run" : .*,/"run" : '$3',/' -i dvfs.json +fi + +if [ $4 ] ; then + sed 's/"sleep" : .*,/"sleep" : '$4',/' -i dvfs.json +fi + +if [ $5 ] ; then + sed 's/^"loop" : .*,/"loop" : '$5',/' -i dvfs.json +fi + +rt-app dvfs.json 2> /dev/null + +if [ $1 ] ; then + mv -f rt-app-thread-0.log rt-app_$1_run$3us_sleep$4us.log + + sum=0 + loop=0 + for i in $(cat rt-app_$1_run$3us_sleep$4us.log | sed 'n;d' | sed '1d' |cut -f 3); do + loop=$(expr $loop + 1) + sum=$(expr $sum + $i) + done + sum=$(expr $sum / $loop) + echo $sum + rm -f rt-app_$1_run$3us_sleep$4us.log +fi + diff --git a/doc/examples/cpufreq_governor_efficiency/test.sh b/doc/examples/cpufreq_governor_efficiency/test.sh new file mode 100755 index 0000000..0160952 --- /dev/null +++ b/doc/examples/cpufreq_governor_efficiency/test.sh @@ -0,0 +1,104 @@ +#!/bin/sh + +set -e + +test_efficiency() { + + FILENAME="results_$RANDOM$$.txt" + + if [ -e /sys/devices/system/cpu/cpu0/cpufreq/scaling_available_governors ]; then + for i in $(cat /sys/devices/system/cpu/cpu0/cpufreq/scaling_available_governors); do + if [ $i = $1 ] ; then + gov_target=$i + fi + export gov_$i=$(echo $i) + done + else + echo "cpufreq sysfs is not available!" + exit + fi + + if [ ! $gov_target ] ; then + echo " Can't find $1 governor!" + exit + fi + + if [ ! $gov_performance ] ; then + echo "Can't find performance governor!" + exit + fi + + if [ ! $gov_powersave ] ; then + echo "Can't find powersave governor!" + exit + fi + + if [ $gov_target = $gov_performance ] || [ $gov_target = $gov_powersave ] ; then + echo "Please input a governor other than \"performance\" or \"powersave\"" + exit + fi + + # Get target gov data first + dvfs.sh $1 $2 $3 $4 $5 > $FILENAME + target=$(cat $FILENAME |sed -n '1p') + + # Get powersave data + dvfs.sh powersave $2 $3 $4 $5 > $FILENAME + powersave=$(cat $FILENAME |sed -n '1p') + + # Get performance data + dvfs.sh performance $2 $3 $4 $5 > $FILENAME + performance=$(cat $FILENAME |sed -n '1p') + + if [ $performance -ge $powersave ] ; then + echo "powersave: $powersave" + echo "performance: $performance" + echo "Error! performance spent more time than powersave!" + exit + fi + + echo "\"powersave\" efficiency: 0%" + echo "\"performance\" efficiency: 100%" + + denominator=$(expr $powersave - $performance) + + if [ $powersave -le $target ]; then + target=0 + else + numerator=$(expr $powersave - $target) + numerator=$(expr $numerator \* 100) + target=$(expr $numerator / $denominator) + if [ $target -gt 100 ]; then + target=100 + fi + fi + + echo "\"$gov_target\" efficiency: $target%" + + rm -f $FILENAME +} + +if [ $# -lt 4 ]; then + echo "Usage: ./test.sh <governor> <cpu> <runtime> <sleeptime> [<loops>]" + echo "governor: target CPUFreq governor you want to test" + echo "cpu: cpu number on which you want to run the test" + echo "runtime: running time in ms per loop of the workload pattern" + echo "sleeptime: sleeping time in ms per loop of the workload pattern" + echo "loops: repeat times of the workload pattern. default: 10" + echo "\nExample:\n\"./test.sh ondemand 0 100 100 20\" means\nTest \"ondemand\" on CPU0 with workload pattern \"run 100ms + sleep 100ms\"(20 loops).\n" + exit +fi + +if [ $# = 4 ]; then + loops=10 +else + loops=$5 +fi + +echo "Test \"$1\" on CPU$2 with workload pattern \"run $3ms + sleep $4ms\"($loops loops)." + +sleep 1 +PATH=$PATH:. + +test_efficiency $1 $2 $(expr $3 \* 1000) $(expr $4 \* 1000) $loops + -- 1.9.1

8 years, 10 months

[RESEND PATCH v2] doc: measure the efficiency of cpufreq governors

by Xunlei Pang

From: Xunlei Pang <pang.xunlei(a)linaro.org> DVFS adds a latency in the execution of task because of the time to decide to move at max freq. We need to measure this latency and check that the governor stays in an acceptable range. When workgen runs a json file, a log file is created for each thread. This log file records the number of loop that has been executed and the duration for executing these loops (per phase). We can use these figures to evaluate to latency that is added by a cpufreq governor and its "performance efficiency". We use the run+sleep pattern to do the measurement, for the run time per loop, the performance governor should run the expected duration as the CPU stays a max freq. At the opposite, the powersave governor will give use the longest duration (as it stays at lowest OPP). Other governor will be somewhere between the 2 previous duration as they will use several OPP and will go back to max frequency after a defined duration which depends on its monitoring period. The formula: duration of powersave gov - duration of the gov -------------------------------------------------------- x 100% duration of powersave gov - duration of performance gov will give the efficiency of the governor. 100% means as efficient as the perf governor and 0% means as efficient as the powersave governor. This patch offers json files and shell scripts to do the measurement, Usage: ./test.sh <cpus> <runtime> <sleeptime> cpus: number of cpus in the CPU0's frequency domain runtime: running time in ms per loop of the workload pattern sleeptime: sleeping time in ms per loop of the workload pattern Example: "./test.sh 4 100 1000" means CPU0~CPU3 sharing frequency, "100ms run + 1000ms sleep" workload pattern. test result on my machine: ~#./test.sh 4 100 1000 Frequency domain CPU0~CPU3, run 100ms, sleep 1000ms: powersave efficiency: 0% performance efficiency: 100% conservative efficiency: 28% ondemand efficiency: 95% NOTE: Make sure there are "sed", "cut", "grep", "rt-app", etc tools on your test machine, and run the script under root privilege. Signed-off-by: Xunlei Pang <pang.xunlei(a)linaro.org> --- doc/examples/cpufreq_governor_efficiency/README | 54 ++++++++++++++ .../cpufreq_governor_efficiency/calibration.json | 27 +++++++ .../cpufreq_governor_efficiency/calibration.sh | 11 +++ doc/examples/cpufreq_governor_efficiency/dvfs.json | 27 +++++++ doc/examples/cpufreq_governor_efficiency/dvfs.sh | 38 ++++++++++ doc/examples/cpufreq_governor_efficiency/test.sh | 82 ++++++++++++++++++++++ 6 files changed, 239 insertions(+) create mode 100644 doc/examples/cpufreq_governor_efficiency/README create mode 100644 doc/examples/cpufreq_governor_efficiency/calibration.json create mode 100755 doc/examples/cpufreq_governor_efficiency/calibration.sh create mode 100644 doc/examples/cpufreq_governor_efficiency/dvfs.json create mode 100755 doc/examples/cpufreq_governor_efficiency/dvfs.sh create mode 100755 doc/examples/cpufreq_governor_efficiency/test.sh diff --git a/doc/examples/cpufreq_governor_efficiency/README b/doc/examples/cpufreq_governor_efficiency/README new file mode 100644 index 0000000..cc8efe1 --- /dev/null +++ b/doc/examples/cpufreq_governor_efficiency/README @@ -0,0 +1,54 @@ +Measure the efficiency of cpufreq governors using rt-app + +BACKGROUND: + DVFS adds a latency in the execution of task because of the time to + decide to move at max freq. We need to measure this latency and check + that the governor stays in an acceptable range. + + When workgen runs a json file, a log file is created for each thread. + This log file records the number of loop that has been executed and + the duration for executing these loops (per phase). We can use these + figures to evaluate to latency that is added by a cpufreq governor + and its "performance efficiency". + + We use the run+sleep pattern to do the measurement, for the run time per + loop, the performance governor should run the expected duration as the + CPU stays a max freq. At the opposite, the powersave governor will give + use the longest duration (as it stays at lowest OPP). Other governor will + be somewhere between the 2 previous duration as they will use several OPP + and will go back to max frequency after a defined duration which depends + on its monitoring period. + + The formula: + + duration of powersave gov - duration of the gov + -------------------------------------------------------- x 100% + duration of powersave gov - duration of performance gov + + will give the efficiency of the governor. 100% means as efficient as + the perf governor and 0% means as efficient as the powersave governor. + + This test offers json files and shell scripts to do the measurement, + +USAGE: + ./test.sh <cpus> <runtime> <sleeptime> + cpus: number of cpus in the CPU0's frequency domain + runtime: running time in ms per loop of the workload pattern + sleeptime: sleeping time in ms per loop of the workload pattern + +Example: + "./test.sh 4 100 1000" means + CPU0~CPU3 sharing frequency, "100ms run + 1000ms sleep" workload pattern. + + test result on an Intel machine: + ~#./test.sh 4 100 1000 + Frequency domain CPU0~CPU3, run 100ms, sleep 1000ms: + powersave efficiency: 0% + performance efficiency: 100% + conservative efficiency: 28% + ondemand efficiency: 95% + +NOTE: + Make sure there are "sed", "cut", "grep", "rt-app", etc tools on your test + machine, and run the script under root privilege. + diff --git a/doc/examples/cpufreq_governor_efficiency/calibration.json b/doc/examples/cpufreq_governor_efficiency/calibration.json new file mode 100644 index 0000000..4377990 --- /dev/null +++ b/doc/examples/cpufreq_governor_efficiency/calibration.json @@ -0,0 +1,27 @@ +{ + "tasks" : { + "thread" : { + "instance" : 1, + "cpus" : [0], + "loop" : 1, + "phases" : { + "run" : { + "loop" : 1, + "run" : 200000, + }, + "sleep" : { + "loop" : 1, + "sleep" : 200000, + } + } + } + }, + "global" : { + "default_policy" : "SCHED_FIFO", + "calibration" : "CPU0", + "lock_pages" : true, + "ftrace" : true, + "logdir" : "./", + } +} + diff --git a/doc/examples/cpufreq_governor_efficiency/calibration.sh b/doc/examples/cpufreq_governor_efficiency/calibration.sh new file mode 100755 index 0000000..d10e644 --- /dev/null +++ b/doc/examples/cpufreq_governor_efficiency/calibration.sh @@ -0,0 +1,11 @@ +#!/bin/sh + +set -e + +echo performance > /sys/devices/system/cpu/cpu0/cpufreq/scaling_governor + +sleep 1 + +pLoad=$(rt-app calibration.json 2>&1 |grep pLoad |sed 's/.*= $.*$ns.*/\1/') +sed 's/"calibration" : .*,/"calibration" : '$pLoad',/' -i dvfs.json + diff --git a/doc/examples/cpufreq_governor_efficiency/dvfs.json b/doc/examples/cpufreq_governor_efficiency/dvfs.json new file mode 100644 index 0000000..b413156 --- /dev/null +++ b/doc/examples/cpufreq_governor_efficiency/dvfs.json @@ -0,0 +1,27 @@ +{ + "tasks" : { + "thread" : { + "instance" : 1, + "cpus" : [0], + "loop" : 5, + "phases" : { + "running" : { + "loop" : 1, + "run" : 100000, + }, + "sleeping" : { + "loop" : 1, + "sleep" : 1000000, + } + } + } + }, + "global" : { + "default_policy" : "SCHED_OTHER", + "calibration" : 90, + "lock_pages" : true, + "ftrace" : true, + "logdir" : "./", + } +} + diff --git a/doc/examples/cpufreq_governor_efficiency/dvfs.sh b/doc/examples/cpufreq_governor_efficiency/dvfs.sh new file mode 100755 index 0000000..8591fc7 --- /dev/null +++ b/doc/examples/cpufreq_governor_efficiency/dvfs.sh @@ -0,0 +1,38 @@ +#!/bin/sh + +#echo $1 $2 $3 +set -e + +if [ $1 ] && [ $2 ] ; then + for i in $(seq 0 1 $(expr $2 - 1)); do + echo $1 > /sys/devices/system/cpu/cpu$i/cpufreq/scaling_governor + #cat /sys/devices/system/cpu/cpu$i/cpufreq/scaling_governor + done + + sleep 3 +fi + +if [ $3 ] ; then + sed 's/"run" : .*,/"run" : '$3',/' -i dvfs.json +fi + +if [ $4 ] ; then + sed 's/"sleep" : .*,/"sleep" : '$4',/' -i dvfs.json +fi + +#cat dvfs.json + +rt-app dvfs.json 2> /dev/null + +if [ $1 ] ; then + mv -f rt-app-thread-0.log rt-app_$1_run$3us_sleep$4us.log + + sum=0 + for i in $(cat rt-app_$1_run$3us_sleep$4us.log | sed 'n;d' | sed '1d' |cut -f 3); do + sum=$(expr $sum + $i) + done + sum=$(expr $sum / 5) + echo $sum + rm -f rt-app_$1_run$3us_sleep$4us.log +fi + diff --git a/doc/examples/cpufreq_governor_efficiency/test.sh b/doc/examples/cpufreq_governor_efficiency/test.sh new file mode 100755 index 0000000..d72fc6a --- /dev/null +++ b/doc/examples/cpufreq_governor_efficiency/test.sh @@ -0,0 +1,82 @@ +#!/bin/sh + +set -e + +set_calibration() { + calibration.sh +} + +test_efficiency() { + + FILENAME="results_$RANDOM$$.txt" + + if [ -e /sys/devices/system/cpu/cpu0/cpufreq/scaling_available_governors ]; then + for i in $(cat /sys/devices/system/cpu/cpu0/cpufreq/scaling_available_governors); do + export gov_$i=$(echo $i) + done + else + echo "cpufreq is not available!" + exit + fi + + if [ ! $gov_performance ] ; then + echo "Can't find performance governor!" + exit + fi + + if [ ! $gov_powersave ] ; then + echo "Can't find powersave governor!" + exit + fi + + # Get powersave data + dvfs.sh powersave $1 $2 $3 > $FILENAME + powersave=$(cat $FILENAME |sed -n '1p') + + # Get performance data + dvfs.sh performance $1 $2 $3 > $FILENAME + performance=$(cat $FILENAME |sed -n '1p') + + if [ $performance -ge $powersave ] ; then + echo "Error! Probably not input all the cpus in the same frequency domain" + exit + fi + + denominator=$(expr $powersave - $performance) + echo "powersave efficiency: 0%" + echo "performance efficiency: 100%" + + # Calcuate other governors data + for gov_next in $gov_conservative $gov_ondemand $gov_cfs; do + if [ "$gov_next" != "" ] ; then + dvfs.sh $gov_next $1 $2 $3 > $FILENAME + data=$(cat $FILENAME |sed -n '1p'); + numerator=$(expr $powersave - $data) + numerator=$(expr $numerator \* 100) + if [ $numerator -lt 0 ] ; then + let numerator=0 + fi + data=$(expr $numerator / $denominator) + echo "$gov_next efficiency: $data%" + fi + done + + rm -f $FILENAME +} + +if [ $# -lt 3 ]; then + echo "Usage: ./test.sh <cpus> <runtime> <sleeptime>" + echo "cpus: number of cpus in the CPU0's frequency domain" + echo "runtime: running time in ms per loop of the workload pattern" + echo "sleeptime: sleeping time in ms per loop of the workload pattern" + echo -e "\nExample: \n\"./test.sh 4 100 1000\" means\nCPU0~CPU3 sharing frequency, \"100ms run + 1000ms sleep\" workload pattern.\n" + exit +fi + +echo "Frequency domain CPU0~CPU$(expr $1 - 1), run $2ms, sleep $3ms:" + +sleep 1 +PATH=$PATH:. +set_calibration +test_efficiency $1 $(expr $2 \* 1000) $(expr $3 \* 1000) + -- 1.9.1

8 years, 10 months

[PATCH v3] doc: measure the efficiency of cpufreq governors

by Xunlei Pang

From: Xunlei Pang <pang.xunlei(a)linaro.org> DVFS adds a latency in the execution of task because of the time to decide to move at max freq. We need to measure this latency and check that the governor stays in an acceptable range. When rt-app runs a json file, a log file is created for each thread. This log file records the number of loop that has been executed and the duration for executing these loops (per phase). We can use these figures to evaluate to latency that is added by a cpufreq governor and its "performance efficiency". We use the run+sleep pattern to do the measurement, for the run time per loop, the performance governor should run the expected duration as the CPU stays a max freq. At the opposite, the powersave governor will give use the longest duration (as it stays at lowest OPP). Other governor will be somewhere between the 2 previous duration as they will use several OPP and will go back to max frequency after a defined duration which depends on its monitoring period. The formula: duration of powersave gov - duration of the gov -------------------------------------------------------- x 100% duration of powersave gov - duration of performance gov will give the efficiency of the governor. 100% means as efficient as the perf governor and 0% means as efficient as the powersave governor. This patch offers json files and shell scripts to do the measurement, Usage: ./calibration.sh <cpu> cpu: cpu number on which you want to run the test ./test.sh <governor> <cpu> <runtime> <sleeptime> [<loops>] governor: target CPUFreq governor you want to test cpu: cpu number on which you want to run the test. Be the same as the one passed to "calibration.sh". runtime: running time in ms per loop of the workload pattern sleeptime: sleeping time in ms per loop of the workload pattern loops: repeat times of the workload pattern. default: 10 Example: "./calibration.sh 0" means to calculate the computing capacity of CPU0 which will be used in the following test. "./test.sh ondemand 0 100 100 20" means to test "ondemand" on CPU0 with workload pattern "run 100ms + sleep 100ms"(20 loops). NOTE: - Make sure there are "sed", "cut", "grep", "rt-app", etc tools on your test machine, and run the scripts under root privilege. - Run the test while the system is idle. - You can change the target governor's parameters after running "calibration.sh", but before "test.sh". Signed-off-by: Xunlei Pang <pang.xunlei(a)linaro.org> --- doc/examples/cpufreq_governor_efficiency/README | 60 ++++++++++++ .../cpufreq_governor_efficiency/calibration.json | 26 ++++++ .../cpufreq_governor_efficiency/calibration.sh | 17 ++++ doc/examples/cpufreq_governor_efficiency/dvfs.json | 27 ++++++ doc/examples/cpufreq_governor_efficiency/dvfs.sh | 36 +++++++ doc/examples/cpufreq_governor_efficiency/test.sh | 104 +++++++++++++++++++++ 6 files changed, 270 insertions(+) create mode 100644 doc/examples/cpufreq_governor_efficiency/README create mode 100644 doc/examples/cpufreq_governor_efficiency/calibration.json create mode 100755 doc/examples/cpufreq_governor_efficiency/calibration.sh create mode 100644 doc/examples/cpufreq_governor_efficiency/dvfs.json create mode 100755 doc/examples/cpufreq_governor_efficiency/dvfs.sh create mode 100755 doc/examples/cpufreq_governor_efficiency/test.sh diff --git a/doc/examples/cpufreq_governor_efficiency/README b/doc/examples/cpufreq_governor_efficiency/README new file mode 100644 index 0000000..a6dc6de --- /dev/null +++ b/doc/examples/cpufreq_governor_efficiency/README @@ -0,0 +1,60 @@ +Measure the efficiency of cpufreq governors using rt-app + +BACKGROUND: + DVFS adds a latency in the execution of task because of the time to + decide to move at max freq. We need to measure this latency and check + that the governor stays in an acceptable range. + + When rt-app runs a json file, a log file is created for each thread. + This log file records the number of loop that has been executed and + the duration for executing these loops (per phase). We can use these + figures to evaluate to latency that is added by a cpufreq governor + and its "performance efficiency". + + We use the run+sleep pattern to do the measurement, for the run time per + loop, the performance governor should run the expected duration as the + CPU stays a max freq. At the opposite, the powersave governor will give + use the longest duration (as it stays at lowest OPP). Other governor will + be somewhere between the 2 previous duration as they will use several OPP + and will go back to max frequency after a defined duration which depends + on its monitoring period. + + The formula: + + duration of powersave gov - duration of the gov + -------------------------------------------------------- x 100% + duration of powersave gov - duration of performance gov + + will give the efficiency of the governor. 100% means as efficient as + the perf governor and 0% means as efficient as the powersave governor. + + This test offers json files and shell scripts to do the measurement, + +Usage: + ./calibration.sh <cpu> + cpu: cpu number on which you want to run the test + + ./test.sh <governor> <cpu> <runtime> <sleeptime> [<loops>] + governor: target CPUFreq governor you want to test + cpu: cpu number on which you want to run the test. Be the same + as the one passing to "calibration.sh". + runtime: running time in ms per loop of the workload pattern + sleeptime: sleeping time in ms per loop of the workload pattern + loops: repeat times of the workload pattern. default: 10 + +Example: + "./calibration.sh 0" means to calculate the computing capacity of CPU0 which + will be used in the following test. + + "./test.sh ondemand 0 100 100 20" means to + test "ondemand" on CPU0 with workload pattern "run 100ms + sleep 100ms"(20 loops). + +NOTE: + - Make sure there are "sed", "cut", "grep", "rt-app", etc tools on + your test machine, and run the scripts under root privilege. + + - Run the test while the system is idle. + + - You can change the target governor's parameters after running "calibration.sh", + but before "test.sh". + diff --git a/doc/examples/cpufreq_governor_efficiency/calibration.json b/doc/examples/cpufreq_governor_efficiency/calibration.json new file mode 100644 index 0000000..2d5870c --- /dev/null +++ b/doc/examples/cpufreq_governor_efficiency/calibration.json @@ -0,0 +1,26 @@ +{ + "tasks" : { + "thread" : { + "instance" : 1, + "loop" : 1, + "phases" : { + "run" : { + "loop" : 1, + "run" : 2000, + }, + "sleep" : { + "loop" : 1, + "sleep" : 2000, + } + } + } + }, + "global" : { + "default_policy" : "SCHED_FIFO", + "calibration" : "CPU0", + "lock_pages" : true, + "ftrace" : false, + "logdir" : "./", + } +} + diff --git a/doc/examples/cpufreq_governor_efficiency/calibration.sh b/doc/examples/cpufreq_governor_efficiency/calibration.sh new file mode 100755 index 0000000..a217487 --- /dev/null +++ b/doc/examples/cpufreq_governor_efficiency/calibration.sh @@ -0,0 +1,17 @@ +#!/bin/sh + +set -e + +if [ ! $1 ] ; then + echo "Please input one cpu" + exit +fi + +echo performance > /sys/devices/system/cpu/cpu$1/cpufreq/scaling_governor + +sleep 1 + +sed 's/"calibration" : "CPU.*",/"calibration" : "CPU'$1'",/' -i calibration.json +pLoad=$(rt-app calibration.json 2>&1 |grep pLoad |sed 's/.*= $.*$ns.*/\1/') +sed 's/"calibration" : .*,/"calibration" : '$pLoad',/' -i dvfs.json +echo CPU$1\'s pLoad is $pLoad diff --git a/doc/examples/cpufreq_governor_efficiency/dvfs.json b/doc/examples/cpufreq_governor_efficiency/dvfs.json new file mode 100644 index 0000000..9a1accf --- /dev/null +++ b/doc/examples/cpufreq_governor_efficiency/dvfs.json @@ -0,0 +1,27 @@ +{ + "tasks" : { + "thread" : { + "instance" : 1, + "cpus" : [0], +"loop" : 10, + "phases" : { + "running" : { + "loop" : 1, + "run" : 10000, + }, + "sleeping" : { + "loop" : 1, + "sleep" : 10000, + } + } + } + }, + "global" : { + "default_policy" : "SCHED_OTHER", + "calibration" : 90, + "lock_pages" : true, + "ftrace" : false, + "logdir" : "./", + } +} + diff --git a/doc/examples/cpufreq_governor_efficiency/dvfs.sh b/doc/examples/cpufreq_governor_efficiency/dvfs.sh new file mode 100755 index 0000000..014531f --- /dev/null +++ b/doc/examples/cpufreq_governor_efficiency/dvfs.sh @@ -0,0 +1,36 @@ +#!/bin/sh + +# $1 $2 $3 $4 $5: governor cpu run sleep loops +set -e + +echo $1 > /sys/devices/system/cpu/cpu$2/cpufreq/scaling_governor +#echo $1 > /sys/devices/system/cpu/cpu1/cpufreq/scaling_governor +sed 's/"cpus" : \[.*\],/"cpus" : \['$2'\],/' -i dvfs.json +sleep 3 + +if [ $3 ] ; then + sed 's/"run" : .*,/"run" : '$3',/' -i dvfs.json +fi + +if [ $4 ] ; then + sed 's/"sleep" : .*,/"sleep" : '$4',/' -i dvfs.json +fi + +if [ $5 ] ; then + sed 's/^"loop" : .*,/"loop" : '$5',/' -i dvfs.json +fi + +rt-app dvfs.json 2> /dev/null + +if [ $1 ] ; then + mv -f rt-app-thread-0.log rt-app_$1_run$3us_sleep$4us.log + + sum=0 + for i in $(cat rt-app_$1_run$3us_sleep$4us.log | sed 'n;d' | sed '1d' |cut -f 3); do + sum=$(expr $sum + $i) + done + sum=$(expr $sum / 5) + echo $sum + rm -f rt-app_$1_run$3us_sleep$4us.log +fi + diff --git a/doc/examples/cpufreq_governor_efficiency/test.sh b/doc/examples/cpufreq_governor_efficiency/test.sh new file mode 100755 index 0000000..0160952 --- /dev/null +++ b/doc/examples/cpufreq_governor_efficiency/test.sh @@ -0,0 +1,104 @@ +#!/bin/sh + +set -e + +test_efficiency() { + + FILENAME="results_$RANDOM$$.txt" + + if [ -e /sys/devices/system/cpu/cpu0/cpufreq/scaling_available_governors ]; then + for i in $(cat /sys/devices/system/cpu/cpu0/cpufreq/scaling_available_governors); do + if [ $i = $1 ] ; then + gov_target=$i + fi + export gov_$i=$(echo $i) + done + else + echo "cpufreq sysfs is not available!" + exit + fi + + if [ ! $gov_target ] ; then + echo " Can't find $1 governor!" + exit + fi + + if [ ! $gov_performance ] ; then + echo "Can't find performance governor!" + exit + fi + + if [ ! $gov_powersave ] ; then + echo "Can't find powersave governor!" + exit + fi + + if [ $gov_target = $gov_performance ] || [ $gov_target = $gov_powersave ] ; then + echo "Please input a governor other than \"performance\" or \"powersave\"" + exit + fi + + # Get target gov data first + dvfs.sh $1 $2 $3 $4 $5 > $FILENAME + target=$(cat $FILENAME |sed -n '1p') + + # Get powersave data + dvfs.sh powersave $2 $3 $4 $5 > $FILENAME + powersave=$(cat $FILENAME |sed -n '1p') + + # Get performance data + dvfs.sh performance $2 $3 $4 $5 > $FILENAME + performance=$(cat $FILENAME |sed -n '1p') + + if [ $performance -ge $powersave ] ; then + echo "powersave: $powersave" + echo "performance: $performance" + echo "Error! performance spent more time than powersave!" + exit + fi + + echo "\"powersave\" efficiency: 0%" + echo "\"performance\" efficiency: 100%" + + denominator=$(expr $powersave - $performance) + + if [ $powersave -le $target ]; then + target=0 + else + numerator=$(expr $powersave - $target) + numerator=$(expr $numerator \* 100) + target=$(expr $numerator / $denominator) + if [ $target -gt 100 ]; then + target=100 + fi + fi + + echo "\"$gov_target\" efficiency: $target%" + + rm -f $FILENAME +} + +if [ $# -lt 4 ]; then + echo "Usage: ./test.sh <governor> <cpu> <runtime> <sleeptime> [<loops>]" + echo "governor: target CPUFreq governor you want to test" + echo "cpu: cpu number on which you want to run the test" + echo "runtime: running time in ms per loop of the workload pattern" + echo "sleeptime: sleeping time in ms per loop of the workload pattern" + echo "loops: repeat times of the workload pattern. default: 10" + echo "\nExample:\n\"./test.sh ondemand 0 100 100 20\" means\nTest \"ondemand\" on CPU0 with workload pattern \"run 100ms + sleep 100ms\"(20 loops).\n" + exit +fi + +if [ $# = 4 ]; then + loops=10 +else + loops=$5 +fi + +echo "Test \"$1\" on CPU$2 with workload pattern \"run $3ms + sleep $4ms\"($loops loops)." + +sleep 1 +PATH=$PATH:. + +test_efficiency $1 $2 $(expr $3 \* 1000) $(expr $4 \* 1000) $loops + -- 1.9.1

8 years, 10 months

[PATCH] rt-app: remove compiler warnings during parse_config

by Jorge Ramirez-Ortiz

This patch fixes the compiler warnings caused by the invalid use of const. It also provides a certain level of encapsulation when parsing the thread_event data. Some of the macros could be merged simplifying the code a bit more but I am not sure if it would make the code too obfuscated.

8 years, 10 months

[PATCH] rt-app: remove compiler warnings during parse_config

by Jorge Ramirez-Ortiz

8 years, 10 months

← Newer
1
2
3
4
5
6
7
8
9
10
Older →

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

Sched-tools