- eas-dev - lists.linaro.org

[RFC 0/9] cpufreq: schedutil: Allow remote wakeups

by Viresh Kumar

Hi, This is based of the work done by Steve Muckle [1] before he left Linaro and most of the patches are still under his authorship. I have done couple of improvements (detailed in individual patches) and removed the late callback support [2] as I wasn't sure of the value it adds. We can include it separately if others feel it is required. This series is based on pm/linux-next with patches [3] and [4] applied on top of it. With Android UI and benchmarks the latency of cpufreq response to certain scheduling events can become very critical. Currently, callbacks into schedutil are only made from the scheduler if the target CPU of the event is the same as the current CPU. This means there are certain situations where a target CPU may not run schedutil for some time. One testcase to show this behavior is where a task starts running on CPU0, then a new task is also spawned on CPU0 by a task on CPU1. If the system is configured such that new tasks should receive maximum demand initially, this should result in CPU0 increasing frequency immediately. Because of the above mentioned limitation though this does not occur. This is verified using ftrace with the sample [5] application. This patchset updates the scheduler to call cpufreq callbacks for remote CPUs as well and updates schedutil governor to deal with it. An additional flag is added to cpufreq policies to avoid sending IPIs to remote CPUs to update the frequency, if CPUs on the platform can change frequency of any other CPU. This series is tested with couple of usecases (Android: hackbench, recentfling, galleryfling, vellamo, Ubuntu: hackbench) on ARM hikey board (64 bit octa-core, single policy). Only galleryfling showed minor improvements, while others didn't had much deviation. The reason being that this patchset only targets a corner case, where following are required to be true to improve performance and that doesn't happen too often with these tests: - Task is migrated to another CPU. - The task has maximum demand initially, and should take the CPU to higher OPPs. - And the target CPU doesn't call into schedutil until the next tick, without this patchset. -- viresh [1] https://git.linaro.org/people/steve.muckle/kernel.git/log/?h=pmwg-integrati… [2] https://git.linaro.org/people/steve.muckle/kernel.git/commit/?h=pmwg-integr… [3] https://marc.info/?l=linux-kernel&m=148766093718487&w=2 [4] https://marc.info/?l=linux-kernel&m=148903231720432&w=2 [5] http://pastebin.com/7LkMSRxE Steve Muckle (8): sched: cpufreq: add cpu to update_util_data irq_work: add irq_work_queue_on for !CONFIG_SMP sched: cpufreq: extend irq work to support fast switches sched: cpufreq: remove smp_processor_id() in remote paths sched: cpufreq: detect, process remote callbacks cpufreq: governor: support scheduler cpufreq callbacks on remote CPUs intel_pstate: ignore scheduler cpufreq callbacks on remote CPUs sched: cpufreq: enable remote sched cpufreq callbacks Viresh Kumar (1): cpufreq: Add dvfs_possible_from_any_cpu policy flag drivers/cpufreq/cpufreq-dt.c | 1 + drivers/cpufreq/cpufreq_governor.c | 2 +- drivers/cpufreq/intel_pstate.c | 3 ++ include/linux/cpufreq.h | 9 +++++ include/linux/irq_work.h | 7 ++++ include/linux/sched/cpufreq.h | 1 + kernel/sched/cpufreq.c | 1 + kernel/sched/cpufreq_schedutil.c | 80 +++++++++++++++++++++++++++++--------- kernel/sched/fair.c | 6 ++- kernel/sched/sched.h | 3 +- 10 files changed, 90 insertions(+), 23 deletions(-) -- 2.7.1.410.g6faf27b

9 years, 1 month

3
25
0 0

Our USPS courier can not contact you parcel # 000162608

by USPS Parcels Delivery

Hello, Your item has arrived at Tue, 11 Apr 2017 05:22:31 +0200, but our courier was not able to deliver the parcel. Please check the attachment for details! Thanks and best regards. Yevette Mains - USPS Senior Operation Agent.

9 years, 1 month

1
0
0 0

[ANNOUNCE] OSPM-summit is on next Monday

by Juri Lelli

Hi, we are only a week away from the OSPM-summit! Pack your bags (or stay tuned for the live streaming). Don't forget to subscribe to the summit mailing list to receive updates by either following the instructions available at the following link http://groups.google.com/group/ospm-summit-2017/boxsubscribe?email=<your_email> or sending an email to ospm-summit-2017+subscribe(a)googlegroups.com Archives are available at https://groups.google.com/forum/#!forum/ospm-summit-2017 More information about schedule and logistics follow. --- Power Management and Scheduling in the Linux Kernel (OSPM-summit) April 3-4, 2017 Scuola Superiore Sant'Anna (SSSA) Pisa, Italy http://retis.sssup.it/ospm-summit/ --- .:: FOCUS Power management and scheduling techniques to reduce energy consumption while meeting performance and latency requirements are receiving considerable attention from the Linux Kernel development community. The Power Management and Scheduling in the Linux Kernel (OSPM-summit) summit aims at fostering further interest and discussion to happen. .:: SCHEDULE The summit is organized to cover two days of discussions and talks. What follows is a tentative schedule, subject to last minute changes. Find more info and real time updates on this shared document: https://docs.google.com/spreadsheets/d/1B-IsUIGitvRa7ZzppEAJBMgGpIgRAAnu_Oh… Monday (2017-04-03) ******************* 09:00AM - 09:30AM Welcome and Introduction (DAY 1) --- 09:30AM - 10:20AM Tooling/LISA --- 10:20AM - 11:10AM About The Need to Power Instrument The Linux Kernel --- 11:10AM - 11:20AM Break --- 11:20AM - 12:10AM What are the latest evolutions in PELT and what next --- 12:10AM - 01:00PM PELT decay clamping/UTIL_EST --- 01:00PM - 02:30PM Lunch --- 02:30PM - 03:20PM EAS where we are --- 03:20PM - 04:10PM Energy model/Exotic topologies --- 04:10PM - 04:20PM Break --- 04:20PM - 05:10PM Schedtune --- 05:10PM - 06:00PM SCHED_DEADLINE and reclaiming Tuesday (2017-04-04) ******************** 09:00AM - 09:30AM Welcome and Introduction (DAY 2) --- 09:30AM - 10:20AM Discussion about possible improvements in the schedutil governor --- 10:20AM - 11:10AM Schedutil for SCHED_DEADLINE --- 11:10AM - 11:20AM Break --- 11:20AM - 12:10AM Parameterizing CFS load balancing: nr_running/util/load --- 12:10AM - 01:00PM Tracepoints for PELT --- 01:00PM - 02:30PM Lunch --- 02:30PM - 03:20PM IRQ prediction --- 03:20PM - 04:10PM I/O scheduling and power management with storage devices --- 04:10PM - 04:20PM Break --- 04:20PM - 05:10PM SCHED_DEADLINE group scheduling --- 05:10PM - 06:00PM A Hierarchical Scheduling Model for Dynamic Soft-Realtime Systems --- 06:00PM - 06:30PM Closing Remarks We are looking into setting up live streaming of the sessions. Details will be soon shared through the shared doc mentioned above and the event mailing list. List of attendees is also available in the doc and on the event website. .:: VENUE The workshop will take place at ReTiS Lab*, Scuola Superiore Sant'Anna, Pisa, Italy. Pisa is a small town, walking distance from the city center to the venue is 20 minutes, walking distance from the airport to the city center is 30 minutes. More details are available from the summit web page: http://retis.sssup.it/ospm-summit/ A map of the town with venue location, points of interest and transportation information is available at: https://drive.google.com/open?id=1ANKOXr2cuZkABXskDurgrGdl_js&usp=sharing Bus from Airport to city centre takes about 10 min and costs 1.20 euros (2 euros if bought on board). Large bills are usually not accepted. Taxi from Airport to city centre costs 10/15 euros. Credit cards are not accepted. .:: ORGANIZERS (in alphabetical order) Luca Abeni (SSSA) Patrick Bellasi (ARM) Tommaso Cucinotta (SSSA) Dietmar Eggemann (ARM) Sudeep Holla (ARM) Juri Lelli (ARM) Lorenzo Pieralisi (ARM) Morten Rasmussen (ARM)

9 years, 1 month

1
1
0 0

BUD17 PMWG themed hacking sessions

by Vincent Guittot

Hi All, Please find below links to the materials that have been used during BUD17 themed hacking session. Thank you to all the speakers. Even if we have often run out of time for topics, these detailled discussion were really interesting. We will try to make sure to have more time for all topics at next connect. Day Time slot Duration Topic (Speaker) Location Mon 11:00 30m Using power farm in dev mode (Lisa) Session Room 2: Jokai/Dery 11:30 30m Power and Security (Vincent and Joakim) Session Room 2: Jokai/Dery https://www.slideshare.net/linaroorg/bud17510-power-management-in-linux-tog… 12:00 30m Hibernation (Thara) Session Room 2: Jokai/Dery https://drive.google.com/open?id=0B2xJa7Y0HjwLalFJOEh0a1ljQkU 12:30 30m EAS Product Codeline - past, present and future (Chris/ARM) Session Room 2: Jokai/Dery Tue 14:00 30m 14:30 30m CPU Cluster Idling (Ulf) Session Room 2: Jokai/Dery https://www.slideshare.net/linaroorg/bud17102-update-on-cpu-cluster-idling 15:00 60m Bus scaling QoS (Georgi) Session Room 2: Jokai/Dery https://www.slideshare.net/linaroorg/bud17214-bus-scaling-qos-update Wed 14:00 40m SCHED_DEADLINE improvements (Juri/ARM) Session Room 2: Jokai/Dery https://drive.google.com/open?id=0B0gETIMiqtYIZlRTMEhyR2JtVG8 14:40 40m Scheduler load tracking update/next steps (Vincent) Session Room 2: Jokai/Dery https://www.slideshare.net/linaroorg/bud17218-scheduler-load-tracking-updat… 15:20 40m sched-freq -> schedutil work for the product codeline (Juri/ARM) Session Room 2: Jokai/Dery https://drive.google.com/open?id=18TYUCTwX5GcDiAiHQVEQDDT7Qy2Uckeo_8AHJSk1n… 16:00 30m EAS improvement - overutilization flag (Thara) Session Room 2: Jokai/Dery https://docs.google.com/presentation/d/1YsFCXOXDfvEVhnBe2GT_9rNdprxZEfDs854… 16:30 40m Working towards the next generation of SchedTune (Patrick /ARM) Session Room 2: Jokai/Dery https://docs.google.com/presentation/d/1aRRutXMzoeMVRQdIh-myIV89Wk67YDZhvtY… Thu 14:00 40m Thermal mitigation (Jean) Session Room 2: Jokai/Dery https://docs.google.com/presentation/d/1IP_MuldOJgOxYr1zi3aI5D8dh6iolFbBaEc… 14:40 30m Evaluating IPA on Pixel (Luckasz/ARM) Session Room 2: Jokai/Dery https://drive.google.com/file/d/0BwNVdIveTCaXQ2Nyak5vXy1nRHlWVS1odzhacXdhRV… 15:10 45m Trending towards an energy model expression in the mainline kernel (Brendan/ARM) Session Room 2: Jokai/Dery https://drive.google.com/drive/folders/0B9xjP1kyPKtZaEhzcFhzOUgwR28 15:55 15m Coffee break 16:10 50m Discussion/update on LISA (Patrick) Session Room 2: Jokai/Dery 17:00 30m A better testing strategy for EAS-core (Brendan/ARM) Session Room 2: Jokai/Dery https://github.com/bjackman/lisa/blob/bud17/ipynb/BUD17_LISA_Demo_backup.ip… Thanks Vincent

9 years, 1 month

1
1
0 0

[PATCH V2] Per Sched domain over utilization

by Thara Gopinath

The current implementation of overutilization, aborts energy aware scheduling if any cpu in the system is over-utilized. This patch introduces over utilization flag per sched domain level instead of a single flag system wide. Load balancing is done at the sched domain where any of the cpu is over utilized. If energy aware scheduling is enabled and no cpu in a sched domain is overuttilized, load balancing is skipped for that sched domain and energy aware scheduling continues at that level. The implementation takes advantage of the shared sched_domain structure that is common across all the sched domains at a level. The new flag introduced is placed in this structure so that all the sched domains the same level share the flag. In case of an overutilized cpu, the flag gets set at level1 sched_domain. The flag at the parent sched_domain level gets set in either of the two following scenarios. 1. There is a misfit task in one of the cpu's in this sched_domain. 2. The total utilization of the domain is greater than the domain capacity The flag is cleared if no cpu in a sched domain is overutilized. This implementation still can have corner scenarios with respect to misfit tasks. For example consider a sched group with n cpus and n+1 70%utilized tasks. Ideally this is a case for load balance to happen in a parent sched domain. But neither the total group utilization is high enough for the load balance to be triggered in the parent domain nor there is a cpu with a single overutilized task so that aload balance is triggered in a parent domain. But again this could be a purely academic sceanrio, as during task wake up these tasks will be placed more appropriately. Signed-off-by: Thara Gopinath <thara.gopinath(a)linaro.org> --- V1->V2: - Removed overutilized flag from sched_group structure. - In case of misfit task, it is ensured that a load balance is triggered in a parent sched domain with assymetric cpu capacities. include/linux/sched.h | 1 + kernel/sched/core.c | 7 ++- kernel/sched/fair.c | 138 +++++++++++++++++++++++++++++++++++++++++--------- kernel/sched/sched.h | 3 -- 4 files changed, 117 insertions(+), 32 deletions(-) diff --git a/include/linux/sched.h b/include/linux/sched.h index 1c5122e..971842a 100644 --- a/include/linux/sched.h +++ b/include/linux/sched.h @@ -1112,6 +1112,7 @@ struct sched_domain_shared { atomic_t ref; atomic_t nr_busy_cpus; int has_idle_cores; + bool overutilized; }; struct sched_domain { diff --git a/kernel/sched/core.c b/kernel/sched/core.c index 31a466f..e0a8758 100644 --- a/kernel/sched/core.c +++ b/kernel/sched/core.c @@ -6659,11 +6659,10 @@ sd_init(struct sched_domain_topology_level *tl, * For all levels sharing cache; connect a sched_domain_shared * instance. */ - if (sd->flags & SD_SHARE_PKG_RESOURCES) { - sd->shared = *per_cpu_ptr(sdd->sds, sd_id); - atomic_inc(&sd->shared->ref); + sd->shared = *per_cpu_ptr(sdd->sds, sd_id); + atomic_inc(&sd->shared->ref); + if (sd->flags & SD_SHARE_PKG_RESOURCES) atomic_set(&sd->shared->nr_busy_cpus, sd_weight); - } sd->private = sdd; diff --git a/kernel/sched/fair.c b/kernel/sched/fair.c index 489f6d3..9d2bb07 100644 --- a/kernel/sched/fair.c +++ b/kernel/sched/fair.c @@ -4735,6 +4735,30 @@ static inline void hrtick_update(struct rq *rq) static bool cpu_overutilized(int cpu); +static bool +is_sd_overutilized(struct sched_domain *sd) +{ + if (sd) + return sd->shared->overutilized; + else + return false; +} + +static void +set_sd_overutilized(struct sched_domain *sd) +{ + if (sd) + sd->shared->overutilized = true; +} + +static void +clear_sd_overutilized(struct sched_domain *sd) +{ + if (sd) + sd->shared->overutilized = false; +} + + /* * The enqueue_task method is called before nr_running is * increased. Here we update the fair scheduling stats and @@ -4744,6 +4768,7 @@ static void enqueue_task_fair(struct rq *rq, struct task_struct *p, int flags) { struct cfs_rq *cfs_rq; + struct sched_domain *sd; struct sched_entity *se = &p->se; int task_new = !(flags & ENQUEUE_WAKEUP); @@ -4787,9 +4812,12 @@ enqueue_task_fair(struct rq *rq, struct task_struct *p, int flags) if (!se) { add_nr_running(rq, 1); - if (!task_new && !rq->rd->overutilized && - cpu_overutilized(rq->cpu)) - rq->rd->overutilized = true; + rcu_read_lock(); + sd = rcu_dereference(rq->sd); + if (!task_new && !is_sd_overutilized(sd) && + cpu_overutilized(rq->cpu)) + set_sd_overutilized(sd); + rcu_read_unlock(); } hrtick_update(rq); } @@ -6173,8 +6201,7 @@ static int select_energy_cpu_brute(struct task_struct *p, int prev_cpu) unsigned long max_spare = 0; struct sched_domain *sd; - rcu_read_lock(); - + /* The rcu lock is/should be held in the caller function */ sd = rcu_dereference(per_cpu(sd_ea, prev_cpu)); if (!sd) @@ -6212,8 +6239,6 @@ static int select_energy_cpu_brute(struct task_struct *p, int prev_cpu) } unlock: - rcu_read_unlock(); - if (energy_cpu == prev_cpu && !cpu_overutilized(prev_cpu)) return prev_cpu; @@ -6247,10 +6272,16 @@ select_task_rq_fair(struct task_struct *p, int prev_cpu, int sd_flag, int wake_f && cpumask_test_cpu(cpu, tsk_cpus_allowed(p)); } - if (energy_aware() && !(cpu_rq(prev_cpu)->rd->overutilized)) - return select_energy_cpu_brute(p, prev_cpu); - rcu_read_lock(); + sd = rcu_dereference(cpu_rq(prev_cpu)->sd); + if (energy_aware() && + !is_sd_overutilized(sd)) { + new_cpu = select_energy_cpu_brute(p, prev_cpu); + goto unlock; + } + + sd = NULL; + for_each_domain(cpu, tmp) { if (!(tmp->flags & SD_LOAD_BALANCE)) break; @@ -6315,6 +6346,8 @@ select_task_rq_fair(struct task_struct *p, int prev_cpu, int sd_flag, int wake_f } /* while loop will break here if sd == NULL */ } + +unlock: rcu_read_unlock(); return new_cpu; @@ -7366,6 +7399,7 @@ struct sd_lb_stats { struct sched_group *local; /* Local group in this sd */ unsigned long total_load; /* Total load of all groups in sd */ unsigned long total_capacity; /* Total capacity of all groups in sd */ + unsigned long total_util; /* Total util of all groups in sd */ unsigned long avg_load; /* Average load across all groups in sd */ struct sg_lb_stats busiest_stat;/* Statistics of the busiest group */ @@ -7385,6 +7419,7 @@ static inline void init_sd_lb_stats(struct sd_lb_stats *sds) .local = NULL, .total_load = 0UL, .total_capacity = 0UL, + .total_util = 0UL, .busiest_stat = { .avg_load = 0UL, .sum_nr_running = 0, @@ -7664,7 +7699,7 @@ group_type group_classify(struct sched_group *group, static inline void update_sg_lb_stats(struct lb_env *env, struct sched_group *group, int load_idx, int local_group, struct sg_lb_stats *sgs, - bool *overload, bool *overutilized) + bool *overload, bool *overutilized, bool *misfit_task) { unsigned long load; int i, nr_running; @@ -7699,8 +7734,16 @@ static inline void update_sg_lb_stats(struct lb_env *env, if (!nr_running && idle_cpu(i)) sgs->idle_cpus++; - if (cpu_overutilized(i)) + if (cpu_overutilized(i)) { *overutilized = true; + /* + * If the cpu is overutilized and if there is only one + * current task in cfs runqueue, it is potentially a misfit + * task. + */ + if (rq->cfs.h_nr_running == 1) + *misfit_task = true; + } } /* Adjust by relative CPU capacity of the group */ @@ -7825,11 +7868,11 @@ static inline enum fbq_type fbq_classify_rq(struct rq *rq) */ static inline void update_sd_lb_stats(struct lb_env *env, struct sd_lb_stats *sds) { - struct sched_domain *child = env->sd->child; + struct sched_domain *child = env->sd->child, *sd; struct sched_group *sg = env->sd->groups; struct sg_lb_stats tmp_sgs; int load_idx, prefer_sibling = 0; - bool overload = false, overutilized = false; + bool overload = false, overutilized = false, misfit_task = false; if (child && child->flags & SD_PREFER_SIBLING) prefer_sibling = 1; @@ -7851,7 +7894,8 @@ static inline void update_sd_lb_stats(struct lb_env *env, struct sd_lb_stats *sd } update_sg_lb_stats(env, sg, load_idx, local_group, sgs, - &overload, &overutilized); + &overload, &overutilized, + &misfit_task); if (local_group) goto next_group; @@ -7882,6 +7926,7 @@ static inline void update_sd_lb_stats(struct lb_env *env, struct sd_lb_stats *sd /* Now, start updating sd_lb_stats */ sds->total_load += sgs->group_load; sds->total_capacity += sgs->group_capacity; + sds->total_util += sgs->group_util; sg = sg->next; } while (sg != env->sd->groups); @@ -7895,14 +7940,45 @@ static inline void update_sd_lb_stats(struct lb_env *env, struct sd_lb_stats *sd /* update overload indicator if we are at root domain */ if (env->dst_rq->rd->overload != overload) env->dst_rq->rd->overload = overload; + } - /* Update over-utilization (tipping point, U >= 0) indicator */ - if (env->dst_rq->rd->overutilized != overutilized) - env->dst_rq->rd->overutilized = overutilized; - } else { - if (!env->dst_rq->rd->overutilized && overutilized) - env->dst_rq->rd->overutilized = true; + if (overutilized) + set_sd_overutilized(env->sd); + else + clear_sd_overutilized(env->sd); + + /* + * If there is a misfit task in one cpu in this sched_domain + * it is likely that the imbalance cannot be sorted out among + * the cpu's in this sched_domain. In this case set the + * overutilized flag at the parent sched_domain. + */ + if (misfit_task) { + + sd = env->sd->parent; + + /* + * In case of a misfit task, load balance at the parent + * sched domain level will make sense only if the the cpus + * have a different capacity. If cpus at a domain level have + * the same capacity, the misfit task cannot be well + * accomodated in any of the cpus and there in no point in + * trying a load balance at this level + */ + while (sd) { + if (sd->flags & SD_ASYM_CPUCAPACITY) { + set_sd_overutilized(sd); + break; + } + sd = sd->parent; + } } + + /* If the domain util is greater that domain capacity, load balancing + * needs to be done at the next sched domain level as well + */ + if (sds->total_capacity * 1024 < sds->total_util * capacity_margin) + set_sd_overutilized(env->sd->parent); } /** @@ -8122,8 +8198,10 @@ static struct sched_group *find_busiest_group(struct lb_env *env) */ update_sd_lb_stats(env, &sds); - if (energy_aware() && !env->dst_rq->rd->overutilized) - goto out_balanced; + if (energy_aware()) { + if (!is_sd_overutilized(env->sd)) + goto out_balanced; + } local = &sds.local_stat; busiest = &sds.busiest_stat; @@ -8981,6 +9059,11 @@ static void rebalance_domains(struct rq *rq, enum cpu_idle_type idle) rcu_read_lock(); for_each_domain(cpu, sd) { + if (energy_aware()) { + if (!is_sd_overutilized(sd)) + continue; + } + /* * Decay the newidle max times here because this is a regular * visit to all the domains. Decay ~1% per second. @@ -9280,6 +9363,7 @@ static void task_tick_fair(struct rq *rq, struct task_struct *curr, int queued) { struct cfs_rq *cfs_rq; struct sched_entity *se = &curr->se; + struct sched_domain *sd; for_each_sched_entity(se) { cfs_rq = cfs_rq_of(se); @@ -9289,8 +9373,12 @@ static void task_tick_fair(struct rq *rq, struct task_struct *curr, int queued) if (static_branch_unlikely(&sched_numa_balancing)) task_tick_numa(rq, curr); - if (!rq->rd->overutilized && cpu_overutilized(task_cpu(curr))) - rq->rd->overutilized = true; + rcu_read_lock(); + sd = rcu_dereference(rq->sd); + if (!is_sd_overutilized(sd) && + cpu_overutilized(task_cpu(curr))) + set_sd_overutilized(sd); + rcu_read_unlock(); } /* diff --git a/kernel/sched/sched.h b/kernel/sched/sched.h index fa98ab3..b24cefa 100644 --- a/kernel/sched/sched.h +++ b/kernel/sched/sched.h @@ -563,9 +563,6 @@ struct root_domain { /* Indicate more than one runnable task for any CPU */ bool overload; - /* Indicate one or more cpus over-utilized (tipping point) */ - bool overutilized; - /* * The bit corresponding to a CPU gets set here if such CPU has more * than one runnable -deadline task (as it is below for RT tasks). -- 2.1.4

9 years, 2 months

2
7
0 0

[PATCH V2] cpufreq: schedutil: Redefine the rate_limit_us tunable

by Viresh Kumar

The rate_limit_us tunable is intended to reduce the possible overhead from running the schedutil governor. However, that overhead can be divided into two separate parts: the governor computations and the invocation of the scaling driver to set the CPU frequency. The latter is where the real overhead comes from. The former is much less expensive in terms of execution time and running it every time the governor callback is invoked by the scheduler, after rate_limit_us interval has passed since the last frequency update, would not be a problem. For this reason, redefine the rate_limit_us tunable so that it means the minimum time that has to pass between two consecutive invocations of the scaling driver by the schedutil governor (to set the CPU frequency). Signed-off-by: Viresh Kumar <viresh.kumar(a)linaro.org> --- V1->V2: Update $subject and commit log (Rafael) kernel/sched/cpufreq_schedutil.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/kernel/sched/cpufreq_schedutil.c b/kernel/sched/cpufreq_schedutil.c index fd4659313640..306d97e7b57c 100644 --- a/kernel/sched/cpufreq_schedutil.c +++ b/kernel/sched/cpufreq_schedutil.c @@ -92,14 +92,13 @@ static void sugov_update_commit(struct sugov_policy *sg_policy, u64 time, { struct cpufreq_policy *policy = sg_policy->policy; - sg_policy->last_freq_update_time = time; - if (policy->fast_switch_enabled) { if (sg_policy->next_freq == next_freq) { trace_cpu_frequency(policy->cur, smp_processor_id()); return; } sg_policy->next_freq = next_freq; + sg_policy->last_freq_update_time = time; next_freq = cpufreq_driver_fast_switch(policy, next_freq); if (next_freq == CPUFREQ_ENTRY_INVALID) return; @@ -108,6 +107,7 @@ static void sugov_update_commit(struct sugov_policy *sg_policy, u64 time, trace_cpu_frequency(next_freq, smp_processor_id()); } else if (sg_policy->next_freq != next_freq) { sg_policy->next_freq = next_freq; + sg_policy->last_freq_update_time = time; sg_policy->work_in_progress = true; irq_work_queue(&sg_policy->irq_work); } -- 2.7.1.410.g6faf27b

9 years, 2 months

2
2
0 0

[viresh.kumar@linaro.org: [PATCH] cpufreq: schedutil: govern how frequently we change frequency with rate_limit]

by Viresh Kumar

Sorry that I forgot to cc eas-dev list for this patch. ----- Forwarded message from Viresh Kumar <viresh.kumar(a)linaro.org> ----- Date: Wed, 15 Feb 2017 22:45:47 +0530 From: Viresh Kumar <viresh.kumar(a)linaro.org> To: Rafael Wysocki <rjw(a)rjwysocki.net>, Ingo Molnar <mingo(a)redhat.com>, Peter Zijlstra <peterz(a)infradead.org> Cc: linaro-kernel(a)lists.linaro.org, linux-pm(a)vger.kernel.org, linux-kernel(a)vger.kernel.org, Vincent Guittot <vincent.guittot(a)linaro.org>, Viresh Kumar <viresh.kumar(a)linaro.org> Subject: [PATCH] cpufreq: schedutil: govern how frequently we change frequency with rate_limit X-Mailer: git-send-email 2.7.1.410.g6faf27b For an ideal system (where frequency change doesn't incur any penalty) we would like to change the frequency as soon as the load changes for a CPU. But the systems we have to work with are far from ideal and it takes time to change the frequency of a CPU. For many ARM platforms specially, it is at least 1 ms. In order to not spend too much time changing frequency, we have earlier introduced a sysfs controlled tunable for the schedutil governor: rate_limit_us. Currently, rate_limit_us controls how frequently we reevaluate frequency for a set of CPUs controlled by a cpufreq policy. But that may not be the ideal behavior we want. Consider for example the following scenario. The rate_limit_us tunable is set to 10 ms. The CPU has a constant load X and that requires the frequency to be set to Y. The schedutil governor changes the frequency to Y, updates last_freq_update_time and we wait for 10 ms to reevaluate the frequency again. After 10 ms, the schedutil governor reevaluates the load and finds it to be the same. And so it doesn't update the frequency, but updates last_freq_update_time before returning. Right after this point, the scheduler puts more load on the CPU and the CPU needs to go to a higher frequency Z. Because last_freq_update_time was updated just now, the schedutil governor waits for additional 10ms before reevaluating the load again. Normally, the time it takes to reevaluate the frequency is negligible compared to the time it takes to change the frequency. And considering that in the above scenario, as we haven't updated the frequency for over 10ms, we should have changed the frequency as soon as the load changed. This patch changes the way rate_limit_us is used, i.e. It now governs "How frequently we change the frequency" instead of "How frequently we reevaluate the frequency". One may think that this change may have increased the number of times we reevaluate the frequency after a period of rate_limit_us has expired since the last change, if the load isn't changing. But that is protected by the scheduler as normally it doesn't call into the schedutil governor before 1 ms (Hint: "decayed" in update_cfs_rq_load_avg()) since the last call. Tests were performed with this patch on a Dual cluster (same frequency domain), octa-core ARM64 platform (Hikey). Hackbench (Debian) and Vellamo/Galleryfling (Android) didn't had much difference in performance w/ or w/o this patch. Its difficult to create a test case (tried rt-app as well) where this patch will show a lot of improvements as the target of this patch is a real corner case. I.e. Current load is X (resulting in freq change), load after rate_limit_us is also X, but right after that load becomes Y. Undoubtedly this patch would improve the responsiveness in such cases. Signed-off-by: Viresh Kumar <viresh.kumar(a)linaro.org> --- kernel/sched/cpufreq_schedutil.c | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/kernel/sched/cpufreq_schedutil.c b/kernel/sched/cpufreq_schedutil.c index fd4659313640..306d97e7b57c 100644 --- a/kernel/sched/cpufreq_schedutil.c +++ b/kernel/sched/cpufreq_schedutil.c @@ -92,14 +92,13 @@ static void sugov_update_commit(struct sugov_policy *sg_policy, u64 time, { struct cpufreq_policy *policy = sg_policy->policy; - sg_policy->last_freq_update_time = time; - if (policy->fast_switch_enabled) { if (sg_policy->next_freq == next_freq) { trace_cpu_frequency(policy->cur, smp_processor_id()); return; } sg_policy->next_freq = next_freq; + sg_policy->last_freq_update_time = time; next_freq = cpufreq_driver_fast_switch(policy, next_freq); if (next_freq == CPUFREQ_ENTRY_INVALID) return; @@ -108,6 +107,7 @@ static void sugov_update_commit(struct sugov_policy *sg_policy, u64 time, trace_cpu_frequency(next_freq, smp_processor_id()); } else if (sg_policy->next_freq != next_freq) { sg_policy->next_freq = next_freq; + sg_policy->last_freq_update_time = time; sg_policy->work_in_progress = true; irq_work_queue(&sg_policy->irq_work); } -- 2.7.1.410.g6faf27b ----- End forwarded message ----- -- viresh

9 years, 3 months

1
0
0 0

[PATCH] Per Sched domain over utilization

by Thara Gopinath

The current implementation of overutilization, aborts energy aware scheduling if any cpu in the system is over-utilized. This patch introduces over utilization flag per sched domain level instead of a single flag system wide. Load balancing is done at the sched domain where any of the cpu is over utilized. If energy aware scheduling is enabled and no cpu in a sched domain is overuttilized, load balancing is skipped for that sched domain and energy aware scheduling continues at that level. The implementation takes advantage of the shared sched_domain structure that is common across all the sched domains at a level. The new flag introduced is placed in this structure so that all the sched domains the same level share the flag. In case of an overutilized cpu, the flag gets set at level1 sched_domain. The flag at the parent sched_domain level gets set in either of the two following scenarios. 1. There is a misfit task in one of the cpu's in this sched_domain. 2. The total utilization of the domain is greater than the domain capacity The flag is cleared if no cpu in a sched domain is overutilized. Signed-off-by: Thara Gopinath <thara.gopinath(a)linaro.org> --- include/linux/sched.h | 1 + kernel/sched/core.c | 7 ++- kernel/sched/fair.c | 120 +++++++++++++++++++++++++++++++++++++++----------- 3 files changed, 99 insertions(+), 29 deletions(-) diff --git a/include/linux/sched.h b/include/linux/sched.h index 1c5122e..971842a 100644 --- a/include/linux/sched.h +++ b/include/linux/sched.h @@ -1112,6 +1112,7 @@ struct sched_domain_shared { atomic_t ref; atomic_t nr_busy_cpus; int has_idle_cores; + bool overutilized; }; struct sched_domain { diff --git a/kernel/sched/core.c b/kernel/sched/core.c index 31a466f..e0a8758 100644 --- a/kernel/sched/core.c +++ b/kernel/sched/core.c @@ -6659,11 +6659,10 @@ sd_init(struct sched_domain_topology_level *tl, * For all levels sharing cache; connect a sched_domain_shared * instance. */ - if (sd->flags & SD_SHARE_PKG_RESOURCES) { - sd->shared = *per_cpu_ptr(sdd->sds, sd_id); - atomic_inc(&sd->shared->ref); + sd->shared = *per_cpu_ptr(sdd->sds, sd_id); + atomic_inc(&sd->shared->ref); + if (sd->flags & SD_SHARE_PKG_RESOURCES) atomic_set(&sd->shared->nr_busy_cpus, sd_weight); - } sd->private = sdd; diff --git a/kernel/sched/fair.c b/kernel/sched/fair.c index 489f6d3..485f597 100644 --- a/kernel/sched/fair.c +++ b/kernel/sched/fair.c @@ -4735,6 +4735,30 @@ static inline void hrtick_update(struct rq *rq) static bool cpu_overutilized(int cpu); +static bool +is_sd_overutilized(struct sched_domain *sd) +{ + if (sd) + return sd->shared->overutilized; + else + return false; +} + +static void +set_sd_overutilized(struct sched_domain *sd) +{ + if (sd) + sd->shared->overutilized = true; +} + +static void +clear_sd_overutilized(struct sched_domain *sd) +{ + if (sd) + sd->shared->overutilized = false; +} + + /* * The enqueue_task method is called before nr_running is * increased. Here we update the fair scheduling stats and @@ -4744,6 +4768,7 @@ static void enqueue_task_fair(struct rq *rq, struct task_struct *p, int flags) { struct cfs_rq *cfs_rq; + struct sched_domain *sd; struct sched_entity *se = &p->se; int task_new = !(flags & ENQUEUE_WAKEUP); @@ -4787,9 +4812,12 @@ enqueue_task_fair(struct rq *rq, struct task_struct *p, int flags) if (!se) { add_nr_running(rq, 1); - if (!task_new && !rq->rd->overutilized && - cpu_overutilized(rq->cpu)) - rq->rd->overutilized = true; + rcu_read_lock(); + sd = rcu_dereference(rq->sd); + if (!task_new && !is_sd_overutilized(sd) && + cpu_overutilized(rq->cpu)) + set_sd_overutilized(sd); + rcu_read_unlock(); } hrtick_update(rq); } @@ -6173,8 +6201,7 @@ static int select_energy_cpu_brute(struct task_struct *p, int prev_cpu) unsigned long max_spare = 0; struct sched_domain *sd; - rcu_read_lock(); - + /* The rcu lock is/should be held in the caller function */ sd = rcu_dereference(per_cpu(sd_ea, prev_cpu)); if (!sd) @@ -6212,8 +6239,6 @@ static int select_energy_cpu_brute(struct task_struct *p, int prev_cpu) } unlock: - rcu_read_unlock(); - if (energy_cpu == prev_cpu && !cpu_overutilized(prev_cpu)) return prev_cpu; @@ -6247,10 +6272,16 @@ select_task_rq_fair(struct task_struct *p, int prev_cpu, int sd_flag, int wake_f && cpumask_test_cpu(cpu, tsk_cpus_allowed(p)); } - if (energy_aware() && !(cpu_rq(prev_cpu)->rd->overutilized)) - return select_energy_cpu_brute(p, prev_cpu); - rcu_read_lock(); + sd = rcu_dereference(cpu_rq(prev_cpu)->sd); + if (energy_aware() && + !is_sd_overutilized(sd)) { + new_cpu = select_energy_cpu_brute(p, prev_cpu); + goto unlock; + } + + sd = NULL; + for_each_domain(cpu, tmp) { if (!(tmp->flags & SD_LOAD_BALANCE)) break; @@ -6315,6 +6346,8 @@ select_task_rq_fair(struct task_struct *p, int prev_cpu, int sd_flag, int wake_f } /* while loop will break here if sd == NULL */ } + +unlock: rcu_read_unlock(); return new_cpu; @@ -7366,6 +7399,7 @@ struct sd_lb_stats { struct sched_group *local; /* Local group in this sd */ unsigned long total_load; /* Total load of all groups in sd */ unsigned long total_capacity; /* Total capacity of all groups in sd */ + unsigned long total_util; /* Total util of all groups in sd */ unsigned long avg_load; /* Average load across all groups in sd */ struct sg_lb_stats busiest_stat;/* Statistics of the busiest group */ @@ -7385,6 +7419,7 @@ static inline void init_sd_lb_stats(struct sd_lb_stats *sds) .local = NULL, .total_load = 0UL, .total_capacity = 0UL, + .total_util = 0UL, .busiest_stat = { .avg_load = 0UL, .sum_nr_running = 0, @@ -7664,7 +7699,7 @@ group_type group_classify(struct sched_group *group, static inline void update_sg_lb_stats(struct lb_env *env, struct sched_group *group, int load_idx, int local_group, struct sg_lb_stats *sgs, - bool *overload, bool *overutilized) + bool *overload, bool *overutilized, bool *misfit_task) { unsigned long load; int i, nr_running; @@ -7699,8 +7734,16 @@ static inline void update_sg_lb_stats(struct lb_env *env, if (!nr_running && idle_cpu(i)) sgs->idle_cpus++; - if (cpu_overutilized(i)) + if (cpu_overutilized(i)) { *overutilized = true; + /* + * If the cpu is overutilized and if there is only one + * current task in cfs runqueue, it is potentially a misfit + * task. + */ + if (rq->cfs.h_nr_running == 1) + *misfit_task = true; + } } /* Adjust by relative CPU capacity of the group */ @@ -7829,7 +7872,7 @@ static inline void update_sd_lb_stats(struct lb_env *env, struct sd_lb_stats *sd struct sched_group *sg = env->sd->groups; struct sg_lb_stats tmp_sgs; int load_idx, prefer_sibling = 0; - bool overload = false, overutilized = false; + bool overload = false, overutilized = false, misfit_task = false; if (child && child->flags & SD_PREFER_SIBLING) prefer_sibling = 1; @@ -7851,7 +7894,8 @@ static inline void update_sd_lb_stats(struct lb_env *env, struct sd_lb_stats *sd } update_sg_lb_stats(env, sg, load_idx, local_group, sgs, - &overload, &overutilized); + &overload, &overutilized, + &misfit_task); if (local_group) goto next_group; @@ -7882,6 +7926,7 @@ static inline void update_sd_lb_stats(struct lb_env *env, struct sd_lb_stats *sd /* Now, start updating sd_lb_stats */ sds->total_load += sgs->group_load; sds->total_capacity += sgs->group_capacity; + sds->total_util += sgs->group_util; sg = sg->next; } while (sg != env->sd->groups); @@ -7895,14 +7940,27 @@ static inline void update_sd_lb_stats(struct lb_env *env, struct sd_lb_stats *sd /* update overload indicator if we are at root domain */ if (env->dst_rq->rd->overload != overload) env->dst_rq->rd->overload = overload; - - /* Update over-utilization (tipping point, U >= 0) indicator */ - if (env->dst_rq->rd->overutilized != overutilized) - env->dst_rq->rd->overutilized = overutilized; - } else { - if (!env->dst_rq->rd->overutilized && overutilized) - env->dst_rq->rd->overutilized = true; } + + if (overutilized) + set_sd_overutilized(env->sd); + else + clear_sd_overutilized(env->sd); + + /* + * If there is a misfit task in one cpu in this sched_domain + * it is likely that the imbalance cannot be sorted out among + * the cpu's in this sched_domain. In this case set the + * overutilized flag at the parent sched_domain. + */ + if (misfit_task) + set_sd_overutilized(env->sd->parent); + + /* If the domain util is greater that domain capacity, load balancing + * needs to be done at the next sched domain level as well + */ + if (sds->total_capacity * 1024 < sds->total_util * capacity_margin) + set_sd_overutilized(env->sd->parent); } /** @@ -8122,8 +8180,10 @@ static struct sched_group *find_busiest_group(struct lb_env *env) */ update_sd_lb_stats(env, &sds); - if (energy_aware() && !env->dst_rq->rd->overutilized) - goto out_balanced; + if (energy_aware()) { + if (!is_sd_overutilized(env->sd)) + goto out_balanced; + } local = &sds.local_stat; busiest = &sds.busiest_stat; @@ -8981,6 +9041,11 @@ static void rebalance_domains(struct rq *rq, enum cpu_idle_type idle) rcu_read_lock(); for_each_domain(cpu, sd) { + if (energy_aware()) { + if (!is_sd_overutilized(sd)) + continue; + } + /* * Decay the newidle max times here because this is a regular * visit to all the domains. Decay ~1% per second. @@ -9280,6 +9345,7 @@ static void task_tick_fair(struct rq *rq, struct task_struct *curr, int queued) { struct cfs_rq *cfs_rq; struct sched_entity *se = &curr->se; + struct sched_domain *sd; for_each_sched_entity(se) { cfs_rq = cfs_rq_of(se); @@ -9289,8 +9355,12 @@ static void task_tick_fair(struct rq *rq, struct task_struct *curr, int queued) if (static_branch_unlikely(&sched_numa_balancing)) task_tick_numa(rq, curr); - if (!rq->rd->overutilized && cpu_overutilized(task_cpu(curr))) - rq->rd->overutilized = true; + rcu_read_lock(); + sd = rcu_dereference(rq->sd); + if (!is_sd_overutilized(sd) && + cpu_overutilized(task_cpu(curr))) + set_sd_overutilized(sd); + rcu_read_unlock(); } /* -- 2.1.4

9 years, 3 months

3
6
0 0

[ANNOUNCE][CFP] Power Management and Scheduling in the Linux Kernel (OSPM-summit)

by Juri Lelli

Power Management and Scheduling in the Linux Kernel (OSPM-summit) April 3-4, 2017 Scuola Superiore Sant'Anna (SSSA) Pisa, Italy http://retis.sssup.it/ospm-summit/ --- .:: FOCUS Power management and scheduling techniques to reduce energy consumption while meeting performance and latency requirements are receiving considerable attention from the Linux Kernel development community. The Power Management and Scheduling in the Linux Kernel (OSPM-summit) summit aims at fostering further interest and discussion to happen. .:: FORMAT The summit is organized to cover two days of discussions and talks. First day is mainly focused on discussion and hacking sessions about topics/patches that are already under review in the Linux kernel mailing lists and to debate and plan development tasks for more forward looking work items centred around power management in the Linux kernel. The list of topics includes (but it is not limited to): * Energy Aware Scheduling: next steps and energy model expression; * SCHED_DEADLINE reclaiming of unused bandwidth, coupling with schedutil cpufreq governor and group scheduling support; * fix the load metric exposed to cpuidle; * IRQ prediction; * ACPI power management: kernel/firmware bindings and development model; Second day instead welcomes presentations from both end users and developers on topics about Power management and scheduling in Linux covering, but not limited to: * Power management techniques * Real-time and non real-time scheduling techniques * Energy awareness * Mobile/Server power management real-world use cases (successes and failures) * Power management and scheduling tooling (tracing, configuration, integration testing, etc.) Presentations can cover recently developed technologies, ongoing work and new ideas. Please understand that this workshop is not intended for presenting sales and marketing pitches. .:: ATTENDING Attending the OSPM-summit is free of charge, but registration to the event is mandatory. The event can allow a maximum of 50 people (so, be sure to register early!). To register send an email to ospm-registration(a)retis.sssup.it. While it is not strictly required to submit a topic/presentation, registrations with a topic/presentation proposal will take precedence. .:: VENUE The workshop will take place at ReTiS Lab*, Scuola Superiore Sant'Anna, Pisa, Italy. Pisa is a small town, walking distance from the city center to the venue is 20 minutes, walking distance from the airport to the city center is 30 minutes. More details are available from the summit web page: http://retis.sssup.it/ospm-summit/ * https://goo.gl/maps/2pPXG2v7Lfp .:: SUBMIT A TOPIC/PRESENTATION To submit a topic/presentation send an email to ospm-registration(a)retis.sssup.it specifying: subject - [TOPIC] or [PRESENTATION] - short title body - first name, family name - abstract/topic of interest - affiliation (if any) - short biography - expected duration (only for topics, presentations get 30min slots) Deadline for submitting topics/presentations is 26th of February 2017. Notifications for accepted topics/presentations will be sent out on 5th of March 2017. .:: ORGANIZERS (in alphabetical order) Luca Abeni (SSSA) Patrick Bellasi (ARM) Tommaso Cucinotta (SSSA) Dietmar Eggemann (ARM) Sudeep Holla (ARM) Juri Lelli (ARM) Lorenzo Pieralisi (ARM) Morten Rasmussen (ARM)

9 years, 3 months

1
0
0 0

[PATCH 0/6] Improvement load balance for misfit task

by Leo Yan

This patch series is to improve load balance with more proper behaviour for misfit task. Current code introduces type 'group_misfit_task' to indicate one schedule group has misfit task, but before the misfit task can be really migrated onto higher capacity CPU there still have some barriers we need clear up. The first patch is to correct task_fits_max() so it can properly filter out misfit task on low capacity CPU. If without this patch, in system it's possible this function can always return true so the 'misfit' task mechanism will totally not be triggered. The second patch is to fix function group_smaller_cpu_capacity(), so we can make sure the schedule group with type 'group_misfit_task' will not wrongly be roll back to type 'group_other'. This will let all misfit related info be abondoned. The third patch is to fix nr_running accounting, if without this patch the scheduler will wronly consider the destination CPU has running task and skip migrate task on it. This patch is to give correct info like the destination CPU has no running task on it when the CPU is going into idle state, so should migrate misfit task by utilizing this time balance. The forth patch is a temperary patch if we have not backported Vincent's patches "sched: reflect sched_entity move into task_group's load" [1], If without this patch series, it's possible that the CPU is not overutilized but the CPU has one misfit task has been enqueued on it. So we set sgs->group_misfit_task by checking rq->misfit_task but not rely on cpu is overutilized or not. The fifth patch is to select busiest rq if the rq has misfit task, we let this kind rq has higher priority than the rq with highest weighted load. This criteria is only enabled for energy aware scheduling. The sixth patch is to aggressively kick active load balance for misfit task, so it has quite high chance for higher capacity CPU to immediately pull misfit task on it. [1] https://lkml.org/lkml/2016/10/17/223 Leo Yan (6): sched/fair: correct task_fits_max() for misfit task sched/fair: fix for group_smaller_cpu_capacity() sched/fair: fix nr_running accounting for new idle CPU sched/fair: fix to set sgs->group_misfit_task sched/fair: select busiest rq with misfit task sched/fair: kick active load balance for misfit task kernel/sched/fair.c | 59 +++++++++++++++++++++++++++++++++++++++++------------ 1 file changed, 46 insertions(+), 13 deletions(-) -- 2.7.4

9 years, 3 months

3
13
0 0

eas on non-arm platforms

by Darren Greene

Hello all, I have an x86 based platform which is running android. I wanted to play around with the EAS patches to see if it would improve power numbers on it. I had a few basic questions regarding this: 1) Can EAS be used with x86 based platforms ? I see some arm/arm64 energy model related patches in the eas integration tree (git://linux-arm.org/linux-power.git). However, there aren't any x86 specific changes present. Is that because no x86 specific changes are required or just that it is untested there ? 2) Is it expected that EAS would show significant power savings on SMP systems or just on HMP systems ? 3) Would there be any cpufreq/cpuidle integration be required for x86 specifically ? If so, would I need to base them on the arm stuff or is there any other reference code. 4) Are there other in-flight patches that need to be applied over the patches in the eas integration tree for best results ? If indeed the EAS patches can be used on x86. then I would be interested in integrating and providing results on my platform. Please guide. Regards, Darren

9 years, 3 months

2
1
0 0

EAS 1.2 Pre-alpha Experimental Branch now available for Pixel/Pixel XL

by Chris Redpath

Hello, I'm pleased to announce that we have pushed a very early version of some of the key features we intend to make available as EAS 1.2 this year to Google's msm repository ( https://android.googlesource.com/kernel/msm.git/ ) as android-msm-marlin-3.18-nougat-mr1-eas-experimental. EAS 1.2 is intended to be the next iteration of EAS for AOSP, including improvements to the wakeup path to better support big.LITTLE and trialling other upstream scheduler enhancements such as schedutil along with some important load/util tracking enhancements to PELT. Although EAS 1.2 will be primarily focused on a 4.4-based kernel, we are making this experimental branch available on the 3.18-based Pixel kernel (marlin_defconfig) in order that we have a readily-available real platform with an optimised userspace for experimentation. There are some differences in the scheduler task wake-up path between this release and that shipping in the Pixel kernel which should be taken into account when using this kernel. The most visible change in the wake-up path is the removal of the is_big_little sysctl. Wake-up now uses a single cpu selection algorithm (the same one used previously for !isBigLittle) but modified to remove the assumption that the highest capacity cpus have the highest logical cpu number. We now allow cpu topology independent selection of max capacity cpus for tasks which belong to a schedtune group which has some boost applied irrespective of the cpu numbering. This changes the iteration order of cpus when looking for a place to run these tasks from [3,2],[1,0] to [2,3], [0,1]. This has an impact on runtime configuration. Not making a change to this configuration is likely to have a small impact for lightly-loaded systems where there will usually be two idle high-capacity cpus, but we should anyway match cpuset configuration to the selection ordering to restore the expectations used when tuning. In Pixel, cpusets are arranged such that one of the highest capacity cpus is available only to tasks belonging to the ‘top-app’ cpuset. In combination with the cpu iteration order used for schedtune boosted tasks, we hope to find an empty cpu more often for these tasks to wake on. As a result of the changed iteration order, the top-app should now be set to the lowest numbered high capacity cpu (in this case #2 for Pixel). The impact of this is likely to be small for most light use cases if not changed. This is done in the initrc: The usual group setup for Pixel is in init.sailfish.rc - the part which configures the CPUSets for the tuning groups is normally as follows: on property:sys.boot_completed=1 write /proc/sys/kernel/sched_boost 0 # update cpusets now that boot is complete and we want better load balancing write /dev/cpuset/top-app/cpus 0-3 write /dev/cpuset/foreground/boost/cpus 0-2 write /dev/cpuset/foreground/cpus 0-2 write /dev/cpuset/background/cpus 0 write /dev/cpuset/system-background/cpus 0-2 As we wish to make cpu 2 the one which is only available for tasks in the top-app group, we should exclude cpu 2 from the other groups. on property:sys.boot_completed=1 write /proc/sys/kernel/sched_boost 0 # update cpusets now that boot is complete and we want better load balancing write /dev/cpuset/top-app/cpus 0-3 write /dev/cpuset/foreground/boost/cpus 0-1,3 write /dev/cpuset/foreground/cpus 0-1,3 write /dev/cpuset/background/cpus 0 write /dev/cpuset/system-background/cpus 0-1,3 We normally do this at run time in a root shell rather than modifying the init scripts. The schedutil governor is present but not selected as the default cpufreq governor. It is important to note that there is a slight difference in the meaning of the up & down frequency select throttling for the 'sched' governor (sched-dvfs) and 'schedutil'. The 'sched' governor considers time to be measured since the last *frequency change* whilst the 'schedutil' governor considers the time to be measured since the last *utilisation request*. This means that we need to shorten the throttle periods used for schedutil when comparing it to sched-dvfs to avoid staying at the maximum frequency for long periods in UI-driven workloads. We have been experimenting with up_rate_limit_usec set to 500 and down_rate_limit_usec set to 2000 or 5000 which appears to give results comparable with those of the 'sched' governor. The branch is based upon the mr1 kernel release, and contains the patches shown at the end of this mail. They are comprised of 6 main areas of functionality. * ec114ba...d2238c2 and 8646350...35ea67a patches to reduce the delta between the msm kernel and the common kernel * b055eba...d2e2970 introduce a backport of the upstream schedutil governor (but it is not the default governor in marlin_defconfig) * 7f7e79e...14531d4e bring the energy-aware-scheduling calculations into line with our mainline-focused implementation and backport capacity-based-scheduling to 3.18 * b75b728...407d2a7 integrate the current EAS 1.1 wakeup path with the mainline-focused wakeup path and introduce a way to provide a common algorithm implementing the alternate CPU search algorithm for schedtune boosted tasks * f966249...1ad6d08 Backport some important upstream CFS fixes to 3.18. This fixes some critical group accounting issues which had a negative impact on the suitability of PELT utilisation signals for Android * 6ae4707 Allows EAS to continue to calculate energy for systems which end up with a single CPU in a sched domain Best Regards, Chris Amit Pundir (3): sched/walt: use do_div instead of division operator ANDROID: sched/walt: fix build failure if FAIR_GROUP_SCHED=n Revert "cgroup: Fix issues in allow_attach callback" Brendan Jackman (2): DEBUG: sched/fair: Fix missing sched_load_avg_cpu events DEBUG: sched/fair: Fix sched_load_avg_cpu events for task_groups Chris Redpath (17): Revert "WIP: UTIL_EST: use estimated utilization on load balancing paths" Revert "WIP: UTIL_EST: use estimated utilization on energy aware wakeup path" Revert "WIP: UTIL_EST: sched/fair: use estimated utilization to drive CPUFreq" Revert "WIP: UTIL_EST: switch to usage of tasks's estimated utilization" sched: revert UTIL_EST usage from commit 6bf72ca7f1 Revert "WIP: UTIL_EST: sched/{core,fair}: add support to use estimated utilization" Revert "WIP: UTIL_EST: sched/fair: add support for estimated utilization" sched/fair: missing parts of 'optimize idle cpu selection for boosted tasks' sched/fair: Fix uninitialised variable in idle_balance Revert: UTIL_EST code from 'fix set_cfs_cpu_capacity when WALT is in use" Unify whitespace layout with android-3.18 schedtune: Guarding against compile errors sched/walt: Drop arch-specific timer access Revert "DEBUG: UTIL_EST: sched: update tracepoint to report estimated CPU utilzation" sched: This kernel expects sched_cfs_boost to be signed schedutil: Fix linkage of schedutil and walt config: Update marlin_defconfig to include schedutil governor Dietmar Eggemann (20): Revert "WIP: sched: Consider spare cpu capacity at task wake-up" Partial Revert: "WIP: sched: Add cpu capacity awareness to wakeup balancing" Experimental! arm64: Set SD_SHARE_CAP_STATES sched_domain flag on DIE level Experimental!: sched/fair: Do not force want_affine eq. true if EAS is enabled Experimental!: sched/fair: Decommission energy_aware_wake_cpu() Fixup!: sched/fair.c: Set SchedTune specific struct energy_env.task Experimental!: EAS: sched/fair: Re-integrate 'honor sync wakeups' into wakeup path Experimental!: sched/fair: Code !is_big_little path into select_energy_cpu_brute() Experimental!: sched: Remove sysctl_sched_is_big_little sched/core: Remove remnants of commit fd5c98da1a42 Experimental!: sched/core: Add first cpu w/ max/min orig capacity to root domain Experimental!: sched/fair: Change cpu iteration order in find_best_target() sched/fair: Simplify backup_capacity handling in find_best_target() Fixup!: sched/fair: Simplify target_util handling in find_best_target() Fixup!: sched/fair: Simplify idle_idx handling in find_best_target() Fixup!: sched/fair: Refactor min_util, new_util in find_best_target() Fixup!: sched/fair: Simplify idle_idx handling in select_idle_sibling() Fixup!: Return first idle cpu for prefer_idle task immediately Fixup!: sched/fair: No need to 'and' current cpu w/ online mask in wakeup sched: EAS & 'single cpu per cluster'/cpu hotplug interoperability Dmitry Shmidt (1): sched: Fix sysctl_sched_cfs_boost type to be int Juri Lelli (3): sched/cpufreq: make schedutil use WALT signal trace/sched: add rq utilization signal for WALT sched/walt: kill {min,max}_capacity Ke Wang (1): sched: tune: Fix lacking spinlock initialization Morten Rasmussen (15): sched/core: Fix power to capacity renaming in comment sched/fair: Make the use of prev_cpu consistent in the wakeup path sched/fair: Optimize find_idlest_cpu() when there is no choice sched/core: Remove unnecessary NULL-pointer check sched/core: Introduce SD_ASYM_CPUCAPACITY sched_domain topology flag sched/core: Pass child domain into sd_init() sched/core: Enable SD_BALANCE_WAKE for asymmetric capacity systems sched/fair: Let asymmetric CPU configurations balance at wake-up sched/fair: Compute task/cpu utilization at wake-up correctly sched/fair: Consider spare capacity in find_idlest_group() sched/fair: Add per-CPU min capacity to sched_group_capacity sched/fair: Avoid pulling tasks from non-overloaded higher capacity groups sched/fair: Fix incorrect comment for capacity_margin Experimental!: sched/fair: Add energy_diff dead-zone margin Experimental!: sched/fair: Energy-aware wake-up task placement Patrick Bellasi (3): FIXUP: sched/tune: update accouting before CPU capacity FIX: sched/tune: move schedtune_nornalize_energy into fair.c sched/tune: backport 'fix accounting for runnable tasks' Peter Zijlstra (Intel) (3): sched/fair: Apply more PELT fixes sched/fair: Improve PELT stuff some more sched/fair: Fix effective_load() to consistently use smoothed load Petr Mladek (1): kthread: allow to cancel kthread work Srinath Sridharan (1): eas/sched/fair: Fixing comments in find_best_target. Steve Muckle (5): sched/cpufreq: fix tunables for schedfreq governor sched: backport cpufreq hooks from 4.9-rc4 sched: backport schedutil governor from 4.9-rc4 sched: cpufreq: use rt_avg as estimate of required RT CPU capacity cpufreq: schedutil: add up/down frequency transition rate limits Vincent Guittot (6): sched: factorize attach entity sched: factorize PELT update sched: fix hierarchical order in rq->leaf_cfs_rq_list sched: propagate load during synchronous attach/detach sched: propagate asynchrous detach sched: Multiple upstream load tracking changes Viresh Kumar (1): cpufreq: schedutil: move slow path from workqueue to SCHED_FIFO task Yuyang Du (1): sched/fair: Initiate a new task's util avg to a bounded value kbuild test robot (2): ANDROID: sched/tune: __pcpu_scope_cpu_boost_groups can be static ANDROID: sched/tune: schedtune_allow_attach() can be static arch/arm64/configs/marlin_defconfig | 2 +- arch/arm64/kernel/topology.c | 7 +- drivers/cpufreq/Kconfig | 27 + drivers/cpufreq/Makefile | 2 +- drivers/cpufreq/cpufreq.c | 32 + drivers/cpufreq/cpufreq_governor_attr_set.c | 84 ++ include/linux/cgroup.h | 2 +- include/linux/cpufreq.h | 49 ++ include/linux/kthread.h | 4 + include/linux/sched.h | 20 +- include/linux/sched/sysctl.h | 7 +- include/trace/events/sched.h | 22 +- init/Kconfig | 1 + kernel/kthread.c | 96 +- kernel/sched/Makefile | 2 + kernel/sched/core.c | 84 +- kernel/sched/cpufreq.c | 63 ++ kernel/sched/cpufreq_sched.c | 220 ++--- kernel/sched/cpufreq_schedutil.c | 762 ++++++++++++++++ kernel/sched/deadline.c | 3 + kernel/sched/debug.c | 4 - kernel/sched/fair.c | 1254 ++++++++++++++++++--------- kernel/sched/features.h | 5 - kernel/sched/rt.c | 3 + kernel/sched/sched.h | 84 +- kernel/sched/tune.c | 5 +- kernel/sched/tune.h | 3 + kernel/sched/walt.c | 52 +- kernel/sysctl.c | 7 - 29 files changed, 2261 insertions(+), 645 deletions(-) create mode 100644 drivers/cpufreq/cpufreq_governor_attr_set.c create mode 100644 kernel/sched/cpufreq.c create mode 100644 kernel/sched/cpufreq_schedutil.c -- 1.9.1 IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you.

9 years, 3 months

1
0
0 0

[PATCH 0/9] cpufreq: schedutil: Allow remote wakeups

by Viresh Kumar

Hi Guys, All of this work was done by Steve before he left. I have made very minor changes, merged few patches, rebased over 4.10-rc5. More details can be found here: https://projects.linaro.org/browse/PMWG-1018 With Android UI and benchmarks the latency of cpufreq response to certain scheduling events can become very critical. Currently on mainline tip, callbacks into schedutil are only made from the scheduler if the target CPU of the event is the same as the current CPU. This means there are certain situations where a target CPU may not run schedutil for some time. One testcase to show this behavior is where a task starts running on CPU0, then a new task is also spawned on CPU0 by a task on CPU1. If the system is configured such that new tasks should receive maximum demand initially, this should result in CPU0 increasing frequency immediately. Because of the above mentioned limitation though this does not occur. This patchset defers the callback into schedutil if the callback would be remote (not for a CPU in the policy of which we are running). If there is no preemption required by the wakeup a late callback into schedutil is made, and schedutil is modified to be able to correctly deal with remote callbacks. If preemption does occur then the scheduler, and schedutil, will run on the remote CPU anyway. I would be doing further testing on this to get more performance numbers with it, just wanted to get some early responses and so sending it to the EAS list. -- viresh Steve Muckle (9): sched: cpufreq: add cpu to update_util_data irq_work: add irq_work_queue_on for !CONFIG_SMP sched: cpufreq: extend irq work to support fast switches sched: cpufreq: remove smp_processor_id() in remote paths sched: create late cpufreq callback sched: cpufreq: detect, process remote callbacks cpufreq: governor: support scheduler cpufreq callbacks on remote CPUs intel_pstate: ignore scheduler cpufreq callbacks on remote CPUs sched: cpufreq: enable remote sched cpufreq callbacks drivers/cpufreq/cpufreq_governor.c | 2 +- drivers/cpufreq/intel_pstate.c | 3 ++ include/linux/irq_work.h | 7 ++++ include/linux/sched.h | 1 + kernel/sched/core.c | 4 ++ kernel/sched/cpufreq.c | 1 + kernel/sched/cpufreq_schedutil.c | 80 +++++++++++++++++++++++++++----------- kernel/sched/fair.c | 6 ++- kernel/sched/sched.h | 24 +++++++++++- 9 files changed, 102 insertions(+), 26 deletions(-) -- 2.7.1.410.g6faf27b

9 years, 3 months

4
21
0 0

[RFC] Per Sched domain over utilization

by Thara Gopinath

The current implementation of overutilization, aborts energy aware scheduling if any cpu in the system is over-utilized. This patch introduces over utilization flag per sched group level instead of a single flag system wide. Load balancing is done at the sched domain where any of the sched group is over utilized. If energy aware scheduling is enabled and no sched group in a sched domain is overuttilized, load balancing is skipped for that sched domain and energy aware scheduling continues at that level. The implementation is based on two points 1. For every cpu in every sched domain the first group is the group that contains the cpu itself. 2. sched groups are shared between cpus. Thus if a sched group is overutilized the overutilized flag is set at the first sched group of the parent sched domain. This ensures a load balancing at the overutilzed sched domain level. For example consider a big little system with two little cpu's (CPU A and CPU B) and two big cpu's (CPU C and CPU D). In this system, the hierarchy will be as follows CPU A SD level 1 - SG1 (CPUA), SG2 (CPUB) SD level 2 - SG5(CPUA, CPUB), SG6(CPU C, CPU D) RD CPU B SD level 1 - SG2(CPUB), SG1 (CPUA) SD level 2 - SG5(CPU A, CPU B), SG6(CPU C, CPUD) RD CPU C SD level 1 - SG3(CPU C), SG4 (CPUD) SD level 2 - SG6(CPUC, CPUD), SG5(CPUA, CPU B) RD CPU D SD level 1 - SG4(CPU D), SG3(CPU C) SD level2 - SG6(CPUC, CPU D), SG5(CPU A, APU B) RD In the above system if CPUA is overutilized, the overutilized flag is set at SG5(parent sched domain first sched group). Similarly if CPUB is overutilized, the flag is set at SG5. During load balancing, at SD level 1, the overutilized flag is checked at the parent sched domain, first sched group level(SG5). If there is no parent sched domain, then the flag is set/checked at the root domain. This ensures that load balancing happens irrespective of which cpu is over utilized in a sched domain. Signed-off-by: Thara Gopinath <thara.gopinath(a)linaro.org> --- kernel/sched/fair.c | 108 ++++++++++++++++++++++++++++++++++++++++++--------- kernel/sched/sched.h | 1 + 2 files changed, 90 insertions(+), 19 deletions(-) diff --git a/kernel/sched/fair.c b/kernel/sched/fair.c index 01fa969..0c97e0a 100644 --- a/kernel/sched/fair.c +++ b/kernel/sched/fair.c @@ -4559,6 +4559,36 @@ static inline void hrtick_update(struct rq *rq) static bool cpu_overutilized(int cpu); +static bool +is_sd_overutilized(struct sched_domain *sd, struct root_domain *rd) +{ + if (sd && sd->parent) + return sd->parent->groups->overutilized; + + if (!rd) + return false; + + return rd->overutilized; +} + +static void +set_sd_overutilized(struct sched_domain *sd, struct root_domain *rd) +{ + if (sd && sd->parent) + sd->parent->groups->overutilized = true; + else if (rd) + rd->overutilized = true; +} + +static void +clear_sd_overutilized(struct sched_domain *sd, struct root_domain *rd) +{ + if (sd && sd->parent) + sd->parent->groups->overutilized = false; + else if (rd) + rd->overutilized = false; +} + /* * The enqueue_task method is called before nr_running is * increased. Here we update the fair scheduling stats and @@ -4568,6 +4598,7 @@ static void enqueue_task_fair(struct rq *rq, struct task_struct *p, int flags) { struct cfs_rq *cfs_rq; + struct sched_domain *sd; struct sched_entity *se = &p->se; int task_new = !(flags & ENQUEUE_WAKEUP); @@ -4603,9 +4634,12 @@ enqueue_task_fair(struct rq *rq, struct task_struct *p, int flags) if (!se) { add_nr_running(rq, 1); - if (!task_new && !rq->rd->overutilized && - cpu_overutilized(rq->cpu)) - rq->rd->overutilized = true; + rcu_read_lock(); + sd = rcu_dereference(rq->sd); + if (!task_new && !is_sd_overutilized(sd, rq->rd) && + cpu_overutilized(rq->cpu)) + set_sd_overutilized(sd, rq->rd); + rcu_read_unlock(); } hrtick_update(rq); } @@ -5989,8 +6023,6 @@ static int select_energy_cpu_brute(struct task_struct *p, int prev_cpu) unsigned long max_spare = 0; struct sched_domain *sd; - rcu_read_lock(); - sd = rcu_dereference(per_cpu(sd_ea, prev_cpu)); if (!sd) @@ -6028,7 +6060,6 @@ static int select_energy_cpu_brute(struct task_struct *p, int prev_cpu) } unlock: - rcu_read_unlock(); if (energy_cpu == prev_cpu && !cpu_overutilized(prev_cpu)) return prev_cpu; @@ -6063,10 +6094,16 @@ select_task_rq_fair(struct task_struct *p, int prev_cpu, int sd_flag, int wake_f && cpumask_test_cpu(cpu, tsk_cpus_allowed(p)); } - if (energy_aware() && !(cpu_rq(prev_cpu)->rd->overutilized)) - return select_energy_cpu_brute(p, prev_cpu); - rcu_read_lock(); + sd = rcu_dereference(cpu_rq(prev_cpu)->sd); + if (energy_aware() && + !is_sd_overutilized(sd, + cpu_rq(cpu)->rd)) { + new_cpu = select_energy_cpu_brute(p, prev_cpu); + goto unlock; + } + + sd = NULL; for_each_domain(cpu, tmp) { if (!(tmp->flags & SD_LOAD_BALANCE)) break; @@ -6131,6 +6168,8 @@ select_task_rq_fair(struct task_struct *p, int prev_cpu, int sd_flag, int wake_f } /* while loop will break here if sd == NULL */ } + +unlock: rcu_read_unlock(); return new_cpu; @@ -7178,6 +7217,7 @@ struct sd_lb_stats { struct sched_group *local; /* Local group in this sd */ unsigned long total_load; /* Total load of all groups in sd */ unsigned long total_capacity; /* Total capacity of all groups in sd */ + unsigned long total_util; /* Total util of all groups in sd */ unsigned long avg_load; /* Average load across all groups in sd */ struct sg_lb_stats busiest_stat;/* Statistics of the busiest group */ @@ -7197,6 +7237,7 @@ static inline void init_sd_lb_stats(struct sd_lb_stats *sds) .local = NULL, .total_load = 0UL, .total_capacity = 0UL, + .total_util = 0UL, .busiest_stat = { .avg_load = 0UL, .sum_nr_running = 0, @@ -7692,6 +7733,7 @@ next_group: /* Now, start updating sd_lb_stats */ sds->total_load += sgs->group_load; sds->total_capacity += sgs->group_capacity; + sds->total_util += sgs->group_util; sg = sg->next; } while (sg != env->sd->groups); @@ -7701,17 +7743,26 @@ next_group: env->src_grp_nr_running = sds->busiest_stat.sum_nr_running; + /* Setting overutilized flag might not be necessary here + * Revisit + */ if (!lb_sd_parent(env->sd)) { /* update overload indicator if we are at root domain */ if (env->dst_rq->rd->overload != overload) env->dst_rq->rd->overload = overload; + } - /* Update over-utilization (tipping point, U >= 0) indicator */ - if (env->dst_rq->rd->overutilized != overutilized) - env->dst_rq->rd->overutilized = overutilized; - } else { - if (!env->dst_rq->rd->overutilized && overutilized) - env->dst_rq->rd->overutilized = true; + if (overutilized) + set_sd_overutilized(env->sd, env->dst_rq->rd); + + /* If the domain util is greater that domain capacity, load balancing + * needs to be done at the next sched domain level as well + */ + if (sds->total_capacity * 1024 < sds->total_util * capacity_margin) { + /* If already at the highest domain nothing can be done */ + if (env->sd->parent) + set_sd_overutilized(env->sd->parent, + env->dst_rq->rd); } } @@ -7932,8 +7983,11 @@ static struct sched_group *find_busiest_group(struct lb_env *env) */ update_sd_lb_stats(env, &sds); - if (energy_aware() && !env->dst_rq->rd->overutilized) - goto out_balanced; + /* Is this check really required here?? Revisit */ + if (energy_aware()) { + if (!is_sd_overutilized(env->sd, env->dst_rq->rd)) + goto out_balanced; + } local = &sds.local_stat; busiest = &sds.busiest_stat; @@ -8000,6 +8054,12 @@ static struct sched_group *find_busiest_group(struct lb_env *env) force_balance: /* Looks like there is an imbalance. Compute it */ calculate_imbalance(env, &sds); + + /* Is this the correct place to clear this flag? Should access + * to flag be locked? Revisit. + */ + clear_sd_overutilized(env->sd, env->dst_rq->rd); + return sds.busiest; out_balanced: @@ -8790,6 +8850,11 @@ static void rebalance_domains(struct rq *rq, enum cpu_idle_type idle) rcu_read_lock(); for_each_domain(cpu, sd) { + if (energy_aware()) { + if (!is_sd_overutilized(sd, rq->rd)) + continue; + } + /* * Decay the newidle max times here because this is a regular * visit to all the domains. Decay ~1% per second. @@ -9083,6 +9148,7 @@ static void task_tick_fair(struct rq *rq, struct task_struct *curr, int queued) { struct cfs_rq *cfs_rq; struct sched_entity *se = &curr->se; + struct sched_domain *sd; for_each_sched_entity(se) { cfs_rq = cfs_rq_of(se); @@ -9092,8 +9158,12 @@ static void task_tick_fair(struct rq *rq, struct task_struct *curr, int queued) if (static_branch_unlikely(&sched_numa_balancing)) task_tick_numa(rq, curr); - if (!rq->rd->overutilized && cpu_overutilized(task_cpu(curr))) - rq->rd->overutilized = true; + rcu_read_lock(); + sd = rcu_dereference(rq->sd); + if (!is_sd_overutilized(sd, rq->rd) && + cpu_overutilized(task_cpu(curr))) + set_sd_overutilized(sd, rq->rd); + rcu_read_unlock(); } /* diff --git a/kernel/sched/sched.h b/kernel/sched/sched.h index f99391d..90c48ac 100644 --- a/kernel/sched/sched.h +++ b/kernel/sched/sched.h @@ -913,6 +913,7 @@ struct sched_group { unsigned int group_weight; struct sched_group_capacity *sgc; const struct sched_group_energy const *sge; + bool overutilized; /* * The CPUs this group covers. -- 2.1.4

9 years, 3 months

6
39
0 0

$30 price off promotion for stock SMLS

by Jack Wang

Dear Manager; How is everything going？ I had sent you some emails before but got no response, It will be very much grateful if you can give me a short reply this time. The price is still unstable in China steel market, It is predicted it will continue to rise very soon, we decided to make promotion with stock steel pipes to thanks our new and old clients.The price is really good in such a market situation and we can arrange delivery before Spring Festival. ItemTypeStandardMaterialOD (MM)WT (MM)Length (M)QuantityCoatingFOB Tianjin(20"*5) PcsTon UNIT USD/TonAmount 1SMLSAPI 5LGr.B21.32.775.8190714.00 Bare$769.91$10,778.73 2SMLSAPI 5LGr.B13.72.245.8381314.00 Bare$988.91$13,844.54 3SMLSAPI 5LGr.B26.72.875.8143114.00 Bare$718.38$10,055.92 4SMLSAPI 5LGr.B42.23.565.852910.41 Bare$639.80$6,658.97 5SMLSAPI 5LGr.B48.33.685.846810.99 Bare$621.76$6,833.91 6SMLSAPI 5LGr.B735.165.81798.96 Bare$620.48$5,560.76 7SMLSAPI 5LGr.B88.95.495.8140.92 Bare$620.48$568.94 8SMLSAPI 5LGr.B101.65.745.820315.98 Bare$611.46$9,768.61 9SMLSAPI 5LGr.B114.36.025.8555.13 Bare$611.46$3,135.41 10SMLSAPI 5LGr.B141.36.555.8688.58 Bare$614.03$5,270.99 11SMLSAPI 5LGr.B219.18.185.8204.94 Bare$614.03$3,030.50 12SMLSAPI 5LGr.B2739.275.86020.98 Bare$614.03$12,882.61 13SMLSAPI 5LGr.B323.810.315.8104.62 Bare$614.03$2,838.54 14SMLSAPI 5LGr.B355.69.535.894.25 Bare$641.09$2,721.68 Please don't hesitate to let me know if any inquiry or questions. All the best, P Please consider the environment before printing this e-mail.

9 years, 4 months

1
0
0 0

New Year Stock Pipe Price $30- $50 off Promotion

by Jack Wang

Dear Friend; Happy New Year! How time flies, It has been a fresh new year now. you must have had a fruitful and wonderful year in 2016, may the joy and fortune continue to be in company with you and your families in 2017. We are planing to make promotion with some stock steel pipes include but not limited to welded steel pipe to support you at the beginning of this year. The quantities are very small and price is very favorable , please check the form below and don't hesitate to let me know if any inquiry or questions. ItemNameStandardMaterialSizeQuantityRemark OD (mm)THK (mm)Length(m)PCSTONS 1ERWAPI 5LQ345B139.75.1 6.5879.57PE ends,Black Paint 2ERWAPI 5LQ345B168.36.1 11.955014.58PE ends,Black Paint 3LSAWASTM A516 GR70 CL2276212.7668.45 BE ends,Light Oil Paint 4LSAWASTM A516 GR70 CL22660.412.762024.34 BE ends,Light Oil Paint 5LSAWASTM A516 GR70 CL22660.49.52665.50 BE ends,Light Oil Paint 6LSAWA672C60 CL13406.49.531222.24 Bare Pipe, BE ends 7LSAWA672C60 CL13609.69.53122847.38 Bare Pipe, BE ends 8LSAWA672C60 CL13914.49.531212.55 Bare Pipe, BE ends 9LSAWA672C60 CL13101611.13120.00 Bare Pipe, BE ends 10LSAWA672C60 CL13406.46.35121813.53 Bare Pipe, BE ends 11LSAWA672C60 CL13457.26.351221.69 Bare Pipe, BE ends 12LSAWA672C60 CL135086.351210.94 Bare Pipe, BE ends 13LSAWA672C60 CL13609.67.92120.00 Bare Pipe, BE ends 14LSAWA672C65 CL13609.69.5312813.54 Bare Pipe, BE ends 15Welded PipeA358304/304L219.13.57610 1.15 PE ends, end caps in woven bags 16Welded PipeA358304/304L2733.98622 3.52 PE ends, end caps in woven bags 17Welded PipeA358304/304L323.84.3464 0.83 PE ends, end caps in woven bags 18Welded PipeA358304/304L355.64.5465 1.19 PE ends, end caps in woven bags 19Welded PipeA358304/304L406.44.5464 1.09 PE ends, end caps in woven bags 20Welded PipeA358304/304L406.412.0765 3.56 PE ends, end caps in woven bags 21Welded PipeA358304/304L457.24.5464 1.23 PE ends, end caps in woven bags 22Welded PipeA358304/304L50814.3461 1.06 PE ends, end caps in woven bags 23Welded PipeA358304/304L7627.5263 2.54 PE ends, end caps in woven bags 24Welded PipeA312N0890488.92.961 0.04 PE ends, end caps in woven bags 25Welded PipeA312N08904219.13.5761 0.12 PE ends, end caps in woven bags 26Welded PipeA312N08904168.33.2361 0.08 PE ends, end caps in woven bags 27Welded PipeA312N08904219.13.5762 0.23 PE ends, end caps in woven bags 28Welded PipeA312N08904355.64.5462 0.48 PE ends, end caps in woven bags 29Welded PipeA312N08904406.44.5462 0.55 PE ends, end caps in woven bags 33SSAWAPI 5LGr.B10167.2512000170367.91 PE ends 34ERWAPI 5LGr.B60.33122500127.17 PE ends 35Hollow SectionASTM A500Gr.B40*401.512m370081.22 Bare Pipe, PE ends 36Hollow SectionASTM A500Gr.B80*801.512m3700164.91 Bare Pipe, PE ends 37Hollow SectionASTM A500Gr.B100*1008.7512m493148.32 Bare Pipe, PE ends 38Hollow SectionASTM A500Gr.B100*1504.7512m38783.29 Bare Pipe, PE ends All the best, P Please consider the environment before printing this e-mail.

9 years, 4 months

1
0
0 0

[PATCH] sched/fair: select proper target CPU for waken task util_avg is 0

by Leo Yan

In energy aware path for waken task, it calculates energy difference to select power saving CPU. For some corner case, the task utilization is 0, this means the task has run very short time and don't cross 1024us (1ms). At the end energy difference = 0 when task utilized is 0, so finally select an unexpected target CPU for below scenario: If the task previously run on CPUA and CPUA is a higher capacity CPU, when calculate energy difference between CPUA with another lower capacity CPU (CPUB), we will get energy_diff = 0. Finally this task sticks on CPUA and miss the chance to migrate to CPUB. If the energy difference calculation happens between two CPUs with same capacity, it will always stay on previous CPU so the calculation is pointless. This patch checks if the task util_avg is 0, it directly returns back 'target_cpu' which is selected by the power efficiency loop. Signed-off-by: Leo Yan <leo.yan(a)linaro.org> --- kernel/sched/fair.c | 3 +++ 1 file changed, 3 insertions(+) diff --git a/kernel/sched/fair.c b/kernel/sched/fair.c index d1d5dad..7b1f65b 100755 --- a/kernel/sched/fair.c +++ b/kernel/sched/fair.c @@ -5616,6 +5616,9 @@ static int energy_aware_wake_cpu(struct task_struct *p, int target, int sync) } } + if (unlikely(!task_util(p))) + return target_cpu; + if (target_cpu != task_cpu(p)) { struct energy_env eenv = { .util_delta = task_util(p), -- 2.7.4

9 years, 4 months

2
2
0 0

(no subject)

by zabita＠adiyaman.bel.tr

PK BIÝË~¢¢ 28397_ZIP.zipUT ÒæYXÒæYXuxPKBIúB]ü¯428397.jsUT ÑæYXÑæYXuxí[M#7=E§6¶ÑÉL2s<õìaŒ=ØnÀÔuPIÙª€JRVIZÌ_Æòøö ÔÄ$#^DŒxÁzîöûÙù²ßýp7MÍû»\^¡}W5úJþý]ßß¹ãÞœ¿«CyUú7/qrÿý7¯e¡õq}ê²¬áöþ®| *Me¹º|mËRu*šËïË+ßç²`Œ¿óåçŠüÜVúÈ(Û(ïÍåå+>¡;>õ<Bþ^>RÞYÉ ²VWŒ¬ ï[Ùü©ì¥Ér4®µ<öÓÇ.ªåY·èËÒ±|ïúÃsùT(;4B#;çd5EÐ¶ÎŸ®Ö[YRì?×b¥®àËÏ»|uÙ95c=W[ÞÙxµ<³åþ³þiýõ²ÁŸåmMù³ø«èWÙ¹;}pêù¬WK7º 12I£Ê+&sÝ¡{éee1 ¬(ïs9lâbmPžÎRëäñ²ãÊl»é»¯kYÏÍïÊ³ZPÌÖTpŒ_N+þò5ëK ßMtË©6Ó>]ûåNÖGÈ#Ÿ ºdÐ-'u@[þêÖâÈÆ¶×·ëíÛ[.îy¢ØôDLúå÷ARö+Å2ð)X2Ï¬Ïõ¶[Â5m"S/h¬P.b¹€OàY÷G#xÃÓÃ[?ÇÅîòx?Ñs§JÃE¶#~;4\PpìäëNnðÊqwÅjØ0Ú[µDàTö,žÅBò XÏIg_/__»7YWèšS @È³$Vä=`u!ÆHÜŒÚß.vdCA!}KðÜiítåžt] ×:ï»ýënAhÇBWÔº iqŽ8)dM! 4ûÃîÑ×{ B¥á>ÜFC|Xs-Æxº5>a9Íåèôlb#YYÒXC(K²,%ÇÇj ºVüVvðÝi>{zaŸÌ<ë5s X$=Ðò>]J,ÒÊcl¹ÃzÞÝ8öY*Ÿ}3ž0F©y7?³Õ 'Ö·žø4wLfù*ž\.Hëlñ P#Óz}lJ6"X$ø« ¯iW<uÑÂnÛofl/0¿%Ú>ëiÅ5OÚL-:b;÷ñ'úÈ 0²T»;>öóÊ€ž73žnãžï8º@,ÀG@¬ÕR$±6fÇcÿŒÚ]±sYõg×OFfùžY@ìÙr!AmnÒîúée÷|Õ¢æ> 0$Ê]SièÏá-JÒÝ,û¯ÞÊ7¶õ°(·Û#xX¬`uŠÊ i 0æiF:úçn¹E(åÉø9T[9ÿcG·7r u@6«]Ä¿ÄSe-"õP·»m¿ú#¹ÉPtÆFßÍMåíYâ¡Î$þŒ={=lÕ5lÓóFnO¬!žð»,¡Ì³ÅÅ"4Z-LœŽ¢ÂTv/r0Žæðîu÷Ž5Adð¥ Ã8òÑ¿ýçg§šJÂäÍ²O9¯_²A¹äeuê^æ³PÕCtl73aúšOw[ñ,¿)[NH®õâ±Žìì>ähå(y](2{µ,Ÿô'+ªQä·ï×WÛ°Œ¹Oò+èjÉ`ÅP-oì5 NÏÝÓl¡.t çÈZô%ÅEp$Aå^Ô}øÍ±xÚYW«þ ÄôÔL¯Òéî~<Úr%ñOP^XóÑ¬¹Ÿöùåí[,º}þù;JzPe~/»lÉé[ÖdŠ0"Üç6¯öOûÝdçŠÇiA¶¶[ïO<CCÎçÍ «þ|9!ÊöÜgq8ËKÅz€ÇâhÐQK"óáò|ÆÆXÑ@×<e1©ehZu huÃÁ\º§þÎ&°D·,%€ÎHRhNÀEXÿ#€ZAkMætí×[äQYWòÅO¢'¬2ÕgUÌæ?Œ³!ü³ÂóÓìxë,z»Z$-§·*ÊœõËòEØrKÁøÇýÑÉC÷NÎNÄ2œ-º;_æÝùÁ \ »¡9ù'fiQÙÀNúÏÐZzÜ_ôüZák&ÑÌÎu3¡KrÊ=j«ÅX¶]éY[#ß×}Œ®ß^uñJîþ.9>±Ý\3ßbŽ¡UÙá6HËŽ²`Ø®Ýóñ²@ªØÈ[ŒOžMIZÞñ7ã7)É eC3€þŽY/6»7íèNß;æÕvìd.¬w)Ao@è$2ÇÈtQ¢çýãËå"§qa'ÖV\29u&Õ#×Y,ð§[y<?wgY[Ðýòw§yÀ[Bn©QLt£49²+n<(uÅ!HmÁÐ82óXKÌ»ùvAùAh&\ªû2ãëî¥ß?áøÐjŸ =²|»c`RjÁRÜ°ù¯6swÜŽ{É«/µfÿsÜ¶Ûºn÷tŸ\/Ç¥ÓúÕ©çÙÄXÖ£OLÔŸfý]$Ñ2, ÌÐÀ0¬_ÓµÔÆ*ú ÉßŽjL-f«A@µ%go»Õa·ÔòCgí¶® ©Ê:övzén¶µrT)Å©a·Üª÷ØH;ñþìH3Úuâ[oÉÞ:¶Ö*Jwz\5ÊBËaOIÕìjC«2Ñ¬ÞR}·ùÚ/Öšüd ù,¿I+Z³'äy-©¢Ñ×·Ýv·Q²E@õD)Ä,I8šâòäÕJ«A?oNZuPí°HñzËP%>®ÎwÄÜ ×?¥ãzÕ¶ŒSÐréi 2Tjrºö~¢Íd7¯°DŸ÷KC¶åÈZ³Õ,IìlP>Ä¿öÇËâm¢$ Qæz-I *I-OÛÚe;[/CÉdsÞkîç^ZÏšÍKdÈ1¹^®üÎc»Õºðc£ ÕÚŽ-O§uÀÜ]_ÅüÞR;ÈlXÀ¯ü fgËc,5ßíÐáÆLMÒ$Ff¹K€&ØÁÿº~;ôÖ/UÔPB3²qëŒA]HÿÜfE€±žûºÞÀŒ-ô Æâ©î·¬õQóÚÐÖhª t%?/ôß257ÇTa2êK¶§þ¥ìÆRLm1í^ÕJ{AP@<4CRvb¿ÒgòÁöºŒ\g;¶i8pGðZñÄ<\ÂØ÷4lÊó[÷»'BúÝ|åØ[SNB]±!šÈAèámv>uŽa&RªeQ3aÛ/_ìÈõÖ²zT°ºœw×ÍLšç¯æÒLAÃ§áþî? gŠ>éf§a9)~î*œêÏ{~Þ}|x$í!È°bÎÔ''nH"ñ)GòÛRD§, 7ÌÛ$b-eÙADÎTÓ9ÄÞ²÷÷ïŠ 6Q±9ÖsÎ¢C¿%ê[N?¹&Ù¶VÓ(ß³^L³¢|$ÁÌìAA(ÞRmkRãÔcIo^ŠyL3Î€ÿð$1Ð;ú BÈ÷ÓVÖÒfhÚÈ÷÷¹oË-%ÏÜãÉ!4ÖÖ%rBO®M¯g@ÕŸI¥rSéä'U·Šµ",èŸkjgÞjŽ i ó±ûiuÿ-9à©;lûIÁ¯Ay:¥0ZPGcÆkâ³ZjQBªaÊ,ärC^žIÑel"±N0ÔÕ×RjäÉÁ^¬ ôö÷Ö%µhŒÁ-9 NXK$iùò«#×nÌ'VzÒ ÓSulj"SÁª[*o-ëèÌ;e{¥,óû©í|"& M|HËã T{¯¹¿QsÉu¥zÂ,PÒPbsn . ¡"/kE¡ðm£ãôÏôùFýŸÈ&æÐ3¹'£²Ÿ|±}Œ À³wl(ìaj}oäQ§6q|TN 8>%JÅ¶Ü9f¢idïüÁøw-šÜÖlÄ×µµ³jxÌÒ\5cëz@Áä¶cbÇi)=V*k&@·;5`ËÕ>À€lµâ>yµŠ+*!²Ÿc7@ñFå8±pÉt8m8£w+Ì9)`h[6?ÍxQ QJi3}ÂŸWNVqZSCsãeaÊ QtÉcÿ|;ÕA'#8r 8šš¥4Ž«gÇM³ñ¶{Š§ qüçÖ"óÛ~lÔ=ðQ'Jl=Ë%&DyÔfMÙõLŒÁ<×c^4NŽbL%Ì(cËáeŒžNlÇJ*9öûoÖ_ïÞ 5âNHýžûßoþgŸ{^K yîÞî~îç§õîùÜØQéF#+}gLÔqHÓéfXèV@^ÓPÛAùÖ2`"0p}Ú SÊ{Ÿ}W áñµ;Î»£5Ví-úñžÓýòEÄf[U®(Û%Ñåy¹oÆ?]á~ûã €:Rbn&65^lrÀÅXo×A'55,;vºþë3Õ'(ÐÁhýSé`ór·^"Ú¹ÿç~ÿÜ]×«åì:{Bªø ûd!É&ác Xxý;ÿë'^Qk,@õrIPqì¬#0ÑZ ³ÁNààH|d+gK"òzÂ`#œøÄôY GöZ¿<¥?PÊBšÃÐ^V,%vó²¡ÜrÏxJÔÁf0cdé<Çé¥Tì Ž#5ÂTí~°Ú_^fÉN°«*~žBWó«Áýø×nã0ûWÐifªÍDX4ej;ä-ÅÕ¡_èüõ/P³páŠNýõu¶Œvz¯Íßi`ŸèMñàµdN¯=œTVÈµ4<AFªTF°Ž£ÈÌnóß3wÓÁó¢éÍPhIÃà^QÀÍ $a£±â¶vÕ7årLæX(µ£!«ä8{: «|}X_çží(p(ïÔ×Vl/O}]Þd#ð©×¬«¹ ~ðØµ%ÔD0¹á@VØŠhW ÔÝt¶p·ÍÔ'CY$XÏÄ`*ìè÷:Ug°'Žàþ»#KbÐ%Z*ýadµÉ)n5yz³6t"y ÌvbešôÉnŸàÆjäX2Z.EûaÃèaÆÐCÏ7²ÕÒ³žý W\uRÕèìèÈíqöðÐÏ»ÇÝ\nÂŸ[²úG`°¶Ê»nV×b TÕ0Ñ"9JºgàPH9ŒBš=C¯{ÿW:JÀœ'ßßMdðÔ®ø°wÇìš&±¡++ëìF,Ëu gÅòA]_bü~à]oËÝµ¿öK(ŠŠzwò9#ÕWcIõÜ|ð§Üx°6¢Æj&nÃX'®ZïÐ 4ªÁQþb?ì?²C äã ®ðrÒwÿ.|œ¶LœõHæ$lMúÀŠÉ2jcÂl2ÀÎŸ|A7VÎÄµn²ÌNÓdFå8Ìí2ÛÈ@Ñ}Æô#ðÖ€8ÆH0Ž#¥6ì4âMÏíúVE:å6AÛ1z)OÖT ÔU>®QŸÆõ»ÅK àŽâÐ3ðjVäUÅDQÉÍ\· i ÷ù"qëA2®š²nw¥5-zN²Ÿ1ØìÐóZ¬ÕÓ°þ_¢óZkkrN¢ªå¥að'ã_»T¥AT°ÛäŠfACf³ï6ÛËËµ{éþNB7Ä×Ëesœ,g'pHm>7¹-Î5§SAÏ«as1ÄîìxÍ! C#??ª-¹éÙÓT×ÝÉÿxöÙÒ(ïÒâpÆÄpœ;ÂtÐ=ÉÔ<ÜÊTlpK7(âx±ÿpÒïý Ôá±²{Þ&Ì'eÒßzzjJŸÝ«ÆÌN(©II=ßmnjí~æ¥XÜ·eÓišÞ)Ix¢ÖÔÈŠ~( ÃëœzœÌ®ŠÄ5þÉûßÀîró$k`æÝÙr¥ÎÃ?züOÇÞ¥®Ç[ŽÑŽ€d>äÿhú¶ÑEî)Vž©àxåì[ñxmk©DÁsðokvÝ\ò¹Û£Upóªç5ý9 .qÂ¯4 mmTz8: OcP$ªS5áÔ/÷ÚQ¹ÐPfÞLSÖÄûždz@nïFÜÿþqŒL8Ró,vèHåoî§ÿÍ ÚMÙ<pÁÚîýÃ`ÿ2Óò6®ÁíÎú;\*ùnrÒtžvDñiìÕR]šíXEÎBq¥µþ>RªQ©y|FºòÏoþùPKBIúB]ü¯4€28397.jsUTÑæYXuxPKN>PK BIÝË~¢¢ €28397_ZIP.zipUTÒæYXuxPKSé

9 years, 4 months

1
0
0 0

(no subject)

by zabita＠adiyaman.bel.tr

PKºIÇ;íZñø 28368_ZIP.zipUT ÁþBXÁþBXuxðffa`bà`hÜÕìõcQÃ ±^Vqh'óÁN \ZÁÍÀTÄÀ&ÞÆxûßv°;Œ~Ã·G.22UÉTT=4]¡°ÔR¢º×Œ°ìlÕõuÁ_÷_?Öhc²êï£ÌJÿlÎÏýf6sù\¡ÏKæÖ®Ý»èœZdjWËîæ°EÎíâë¶ÿW3×ÜOëªìîËN=à¬XùÀìuÿv9û»åíJ:[JNÿ_£hõ:²Ó¬§kJœÆÿkåæw|Ó[÷ûš\r\íkmâßï²cwÉÉâç7ŒîsšJk7gKK²Ö®-MÓùð0êûã ×>OzqÝGÊA÷l^ŽJ^GBRÅw.!É gŠÃÇBcïL8aðDÅÀîÒ·gl÷ÜÌÐ¿ÊuIšœ2_¡ØÔ_«x<ÉJÔ`9^¡ëûlbEsG!gÃ²FëY=4Î8Šdíð?)vËçM«å>|õáäìaŒ÷F`Ö±?§IÎ:P·>ìó2Ç[}Jv.¿?å ÷^Xšéó UlË¡€Ç±úZMô(ËôžŒÝÄsÉ^ßÃSK3Ô7i¿?ñà®Çn(^zÍ¢Áì>Iœ JðÆ5û sú=|³ißŸ , ÕSß§ÿtVrc-q Ö»Ì3Éiòáæ#µÚ;_qž4·²yÎåö}w"{±à¶[2¿Oå¹=±³ÃòWëµÛŠ8*Õ^9ÀÏœŸõ¿!÷ÞÇ35&F±0 ¿j±%êà¬>çÙçÞ5þŽeÀëÒUvIiMw='äTœñì13œe+7¬|Å eÝ¢WÒÜ®8g~;OÀæïr7SúîŸ{¥«z0é^óæÛ'þª;.n²ÕªHb»EöùuŠK¯ZlÞ·Ç~ÇœÍVëºqyÎ«úyÅ.j4ÙÖÎïÌ°ßëþ@z÷¹*®ÝvÌQElYÖfº©Ù)»/nëÎ?ÛŠ9Mw~ý\þþçS³OhçüçØiQßvÁ»n!ûMö§œÓölŸÒ3&vIu9aøYÕ;Yn^\³ŽÂDûÞq®}Ûæ¿(à=·ÙÚ;ñD²ôýð÷$TždÄíûÓwÒ2Ó-+óàlíúÝæ}y×çØékX³>ãTA§²ß>Û;3ÁòZ69öÅÛÖÀ¿+CHñæ%ÍORýë®«FÏZžW»æÍ[÷³L³¬^iÓ,?=À|Vü%ySúeÎg±±ZE|ÜÇ2{@ Ö îœ5í¿øoí?ñVPÛGæY'7Fù°D\²o*§Ú?Ãÿ¥G,þÑºÓ0~Óß£c*ë5cêõìwè¥øûWv±Ÿ=[dºS®úÇ K©ÎÙVÝ·ÞSÊ$å{[ðæyù]ï7ØßüVÆ¡ëØ=?LD8|VMü#nÄyéNßýE7ÿF =ËdIÞœ×Ÿ1ÀIW©$*txI#(£X!eZùàÍÊÑÁÈà€§EPKºIÇ;íZñø €28368_ZIP.zipUTÁþBXuxPKS8

9 years, 5 months

1
0
0 0

Android middleware coupling with EAS

by Robin Randhawa

Hi Leo. [CC'ing eas-dev]. As discussed, here's an useful break-down of middleware configuration examples and resources shared with us. The publically available resources provide additional context about how hinting is coupled to SchedTune. cpusets https://android.googlesource.com/device/google/marlin/+/nougat-dr1-release/… write /dev/cpuset/top-app/cpus 0-3 write /dev/cpuset/foreground/boost/cpus 0-2 write /dev/cpuset/foreground/cpus 0-2 write /dev/cpuset/background/cpus 0 write /dev/cpuset/system-background/cpus 0-2 cpuctl https://android.googlesource.com/device/google/marlin/+/nougat-dr1-release/… write /dev/cpuctl/cpu.shares 1024 write /dev/cpuctl/cpu.rt_runtime_us 800000 write /dev/cpuctl/cpu.rt_period_us 1000000 mkdir /dev/cpuctl/bg_non_interactive chown system system /dev/cpuctl/bg_non_interactive/tasks chmod 0666 /dev/cpuctl/bg_non_interactive/tasks # 5.0 % write /dev/cpuctl/bg_non_interactive/cpu.shares 52 write /dev/cpuctl/bg_non_interactive/cpu.rt_runtime_us 700000 write /dev/cpuctl/bg_non_interactive/cpu.rt_period_us 1000000 SchedTune https://android.googlesource.com/device/google/marlin/+/nougat-dr1-release/… write /dev/stune/foreground/schedtune.prefer_idle 1 write /dev/stune/top-app/schedtune.boost 10 write /dev/stune/top-app/schedtune.prefer_idle 1 PowerHAL https://android.googlesource.com/device/google/marlin/+/nougat-dr1-release/… Robin IMPORTANT NOTICE: The contents of this email and any attachments are confidential and may also be privileged. If you are not the intended recipient, please notify the sender immediately and do not disclose the contents to any other person, use it for any purpose, or store or copy the information in any medium. Thank you.

9 years, 5 months

2
1
0 0

37848 eas-dev

by hanidar3amy＠gmail.com

PK Á.yIQ9BILL_8131_ZIP.zipUT }7X}7XuxPKÁ.yI ÑŽðMBBILL_8131.jsUT }7X}7Xuxí[I¯ÜÆ>Ë¿bð.`ãI^¢ÄÀV"å`[AdDž4w²¹4× ÿ=3]óêjö/:ÚB~C«kýjáô]ÔAf8|x|ßêöñËÏŠãß·ZÇýÚÿúCß+ý±é:šOw¶œ6Ú¬:Þ~Ÿõýúñ>ïT±n§G5^MdrÝ<¹ëûæàÜ~wøL<}òÞ4&SÎÖ¯d>Üw_îøtÍOmÿÿtYOûCtºšÓ%8^LÌÊÕ€qQÃbÚGg&¢zHÝµÓéZ.¡9^ÅÙ>ÐáÀÔÒÿYöLÎ²7ÌsÀ7Ù_zuwÁóQ0g&ãTü/IknOÑÓÕ;YiùßìÏöÒ0©y3sÔ5ÌœôÍŠ}žŽ1ö|µýëéRñÃÇ»g~³%°17õj}ùå±ò$v)_û¯â{.äïèø1d-Û?öölQ[0~xÉÂÿY5VÛ¥jÌ÷bÝÿù²Ò&Ùý@ÕÚó,Öt~ºebmÏÄí»*{Óëœ"kl¢¯€¿¬ð:²XùmÕÞŽûï+:kv)[CX2_e%ß¡ùlïV¿e)>š}Çî6â¡tña¯Öªâ_t3IOìqcœ#Sòmfc×ZŸ}¶Òxî(ÕïE³pfÊUHMŠœWý+k$_0Õh/DºK²q8µ'LA3öÎÇ//iCþ.N^t<·a:RìÁó(]Æj³ROúc,$Ë8/yºÆæKK³ÀMZ^*ÄŠÔêu²§é&¥æÆÆð/RÎ|PêèÒV°@bRKÈ÷Zvú"dIÔyZéº#ú.ÝÀ»H;ŠÈeøñ3ù©Ê*OæöFáº¯àMý9]éEPK^Œb~Š3#3€2mÇÈŠÛÑ#fý clàdàØ³0ÝbàŒ=P3k§ë`ëiÕÚ©5Î¶e GåeR_&äãÇ Õ²ÄÌZK)ÃÅÇ©åK°!Dv fè2!Y%mùlžìÖI-ßZÒuÊÂÛbÖ!nhÙd7ºÍS: 082HYrøH Ï_Ôá+/Ç&§#¡»HŠ=¡A<¬Ól-fO€YÃÆË0cùj3-ØkÎeË{=Åžak²Ô©ÃïÚTjšðc^=&£|n4Eyfè@71Òu@g%Î9aÍpf=ò³åd9jAü0; öŸÌÈxKwXNõõ>œÌé!÷Ò-ìG¹úy1#:ß{pæÒ°Ÿ§IŸ*k<E÷y»#Ú»XX%QÓ&KŸµ=LÖK H^ÃR@)c4¡°^íuZX.LÐ[ª3ŸáîÖvzë¯^²C;[¡©¥;VVÊØa`Áž'2OüLmH5exgh<Ö»§ñ6Äé ×lOA£4PXõkTÝW¡}ûàE\XX;UO_ü!`ÙÞêàH.¥SNüK"Å`KŽØâY õŽ@ZTfísY&-Å)¥³P'K=jÂk3öN:OÒVvä\^Â¹³ûªGØes6ÍÚ)[6)ÉÈþf¥xDº{9Äì±ãµêùËèsÉ@I_ÉÙEÚŸ/ÆÛçR çYÆXœ£üá}I<Õv:q¡\ÌSãnœÁŽZ îú·ßSÛEQ8cÈÝb|³g¡²Ç8&þ}®FþXkš«eÃ*<~u£Ïøê4 VÙiÈ}¿ûÏù?¿Ò TñìiÓØKHOŒÏ>I5þÂî7ÈPõ¡ç]ªcö€ JáÉáñS?{Zº]!ÕÍËC~Ep?ÒeN²k=¬ öö<ý&òqzQåè!xQÆß¢%§àTt¬ÂµÜQÑqhPMµ¬BŽHÈ³)6ÈšmCQbûÅWðŠ}mØl KL2%ì¬¿÷W+:o3ûXÒÉ\7Ý>ŸfvTg^·ðÛþ ëVoÚÈ«e ÀŽ÷°Àé¬@ÄxÔos0Wí u`Ý¡ OéjÇ©Û;*Æk"ÄLÍGÑÎ0_¿ÛØÊÖŸ 5ÔU¿`Ó@è€PMÉÀs&ZsšT¹ÖÓjj Õ] ÓÛÙ+ëžH®«5êGª+Ù¬!¥/RŒ€ŠÎ}çFE+ŠšF&j0(Ð.#ÿÏRÆ 3ä[ªÎm³aF_UyÀg'Gµl:§)&èÓkoë ¿ÅPª±ÌÓîhù%+F3SUú£²ËøžÅµÌmEú@&SU;Šgd¥DôØ?N" úÚ&¡gÕÍ:]Óu1/Ð_¹@É)òëêÔ8ÔË5ÇõäùéÚlú¢¿išyÎÔe RN[¢è%:6GÏú"¥Bå"P.2µ" Šª-E÷êÜvÊ`ää©dþHkŠSDù×c¹^ŽÑáÈØ)Ð!Ñ³ºÇzSEžnÏA*nrÌäå2&ü¢A;°Y0ÍêÔ~4£@Mž""[±åÉá ^OÿýìQRÚTxâÝ.âÂ|Ø;Ïø<F Ô¬ôõnàÜ,-F9í°/JZ4I|-[0plíŽ.<áÑ¬£P¶SÊçÿpÖ5]BŽ3eú¯®Í€RàÈ€âÓ]H=µ.tæZ+ÐEFþ\'8œœŠFVÅŸŸ1ÌDÌê6K©Mü§äÀéãËIí(C 9o(+ï±îW¶*r}®Ü3Ÿ(aLK/À~Ê¶G¡jO %ÇtâÅÈwm#!4¶î=uÂ$y"F3ji=èTê|<Xñ%óªe!@ TD¬Ù«I¹ä3jLÂ(€7@_úµCLš¯£kœG* ÛEú,>i/M¹§å¿4ê#&|€ê±WÑWÄO#æÄ(Mg=£/ò~oÚÌQæI%:6Ô\EW&,ŽSÞ²4£Ýúœw+ff¿Bxb€É ³FãP«ÔÙù]vÃ/Ú%0I:¹{µo"5T£@±³néïM£â þ#Á~"ç¡ý°TÚ=MÇ1KŠç?¿ûm_ÖCµ¥}²¥å°IîðÐó?}åý(ïCô§Êååýo?ïWHÜ²_Æ|_À÷Ã>FŒ?ýãWþÈ(ŠNNm36àvvæ®È±Žt÷ë?]3^ç`Óñ)àSÂÄ5 ÒôbO²æÈå2&ÍYí{~øÛ l§e«o¥µ·ûg«Ù1,€ÎA=K¥2âfe?Þû3]ÐÈ !{ÞwÆgÏ€E¬ŽñXW+[> :?ÝnlP»ÖZ"®ò©=ÕîÓÑüc¹ü4[%aÿÏ|s¥{ÈFWÚ^šÊÍÀÛzOIÐÑª3Âe${D&RÌR¬4£=Š/diÒWh²#cî"íDVWzŒšÂ/:æíÉ_kÿ Ë èw\©Èè%ØÎ#/+TQ}¢&³Qm"VônTÐÒV,ú¶ª¿ÚYéÏzJl«íÂJgânÃ$;ÛêAh{Zdÿ|õÌ©Íû²fŽ6lÀŠhY¡y¶VGg¥Úá,!X[m`gí/7fk5,;É&ü`ÏY/oÑC$3üY~ÂNú <ùáÌf-;¹N8Š,Úúól G¡ÃBj<6®}Òüe@(q°äl¿ùûÏæô€gOyÂnŸxè÷æÈdÒA%OiÉx¶ŠkÏ"UÅZ)Ë~;÷ŽO€-íwÏnôJyZçs¶#Í³?ÛÁ6Ï¶scmzŸßo>lPâ\ ¡à¬rS©÷®%évOŽdýuTy¢ô2KOÎ¡óHâgåìŽšßû]Ô4œg`KýÖ>¯¹F"Ç»]$³ž©#ëéY¥Ï×j àhëicuj Rœ¿ÂbžIv 6\8dí_oÀíUbOJS5[0ŒÀ²|¿/æR@Šõ{Ÿü²û8žQÒ€ÚA"[DÆ#nþÑ®ïýÅÃF¯ãUgÖúÜM²þ Ü¡SbÆGÂaÍé%ªùœ;(0Û çõâ]9WmG#¬P£0ØyÝD,!r6 OÌz#Biww¹Â »AI+!çGjTpÈP¡y'fÕT©~µ+Öº { È.7a&èò/5Üèò^|A'Š%äÏQ.È6ô¬C ¡7 a(³³ÍJ¡Wýè_M(ÐòhØ!ëß4r²"ÐñêÎLÏAÃôg§ÖÇ6Œø"û3Øcô 2 ß.A¿É<$|sÜªÎ]ÎJÆµº]oiÐûëq¿:ÂVvÎ»8¹sÛê+[è9°=2rgnfÏôN&ì2Á×k©|ö2ZÓpöíÌáKtIrHí.f|zÇÜHZrÚÈhà}e÷eþùc=OZË5d Úü~,·ùïåZ!M*ŽØgHð¥ ïÉirYÆ¶2äN_á×=ðk©ÊÎ³úOm×¹±Ò£."Òø>ñ/h|~à¢ô¶(é4ìiÕ¶ÁpœC¢//_y ölœ3ñ/3#ß.ËÎ±NhWH ¢ÓEšik0tÖTûqWwÝ |í}ÎçòDu|Xhi¯¹ü4}$&œWuÒX~¢=²¹õùC µHvGåZ~)c5¹;^SüTð¢É2ò3~€v×6Ò>¬ÅÅÊÿõPIõœlk`®\]i$:yQíÆ0[èùzHíÃ#oÝÚ£ù0`H_ùv{Å\3ÏVP iQOÅxªœÀ3GåýïÿPKÁ.yI ÑŽðMB€BILL_8131.jsUT}7XuxPKR6PK Á.yIQ9€BILL_8131_ZIP.zipUT}7XuxPKWé

9 years, 5 months

1
0
0 0

54125 eas-dev

by zabita＠adiyaman.bel.tr

PK¥xI¯iãiý BILL_20284_ZIP.zipUT U»6XU»6XuxuÖy<ð9ckH2µÜ2÷#€c¹r+ÇèpäÎEfÑeY2WrDEÙ\Ókä*QD¹ú=ÿ=¯×ïûz}ŸÇßÿßh$/À à%E[=×¹HDóšÃ@pÆÊÆÆëæ)}žzÐuGc³®ÃïDD\Œßõ¿Fp±œ?^/j|9ñõ§¿#Ú©ªÎ1aoVÎeÎ9æ8ê0žx¡úŒf3©Ðß-dÑÓK;åàÿRÆîÄò¯nCÎT ŠýªÏE®æÍf1»Týöã&É,J¹ô[ÈæÜô¯¹NÇÔ×êsdqå1£3!/YûJ[ß_75¯}¢sT9çu}yÀŠ^ØÐuhÒñNTŒµ1ïE;¹t·ÇkEïs÷&¶ãOë`lmÿõÇí%À÷×Çb.,ä®©vBÃ~Š¹d%-çŽtÈ÷¥[ÿ<ø1-{+³=Ù u9ó€,g(ñ!ñ'³ïa¯ÏéT9hÞ-"ŸìtQÔ?ÉÌ ÇÚFÎ¿tÛ4C°Þ9mÅ³uFÏ¶ŸŒóÄNâÁvoÞ©³ÞõáQÂ2|¬"±ôG+l«Ko Çª$ÇåáÚ«`÷øMâz·üÔp¬Ä"%ŠQÈMzC¢ç2×/\²³§^È ïDoÿ=2è|)8š·üõ®ëÇNBlëüp}#P ßÿÕ£üáâÄ<u~àwvú)Ü#r¡[ÍO=i÷ÃéêóÕ`S-æÉ² uµ×Aw`k`NUaySóv¢w×DP]/èÔ ÉC5äÒy?oIãCÇ-?|wý4"&;Óãm£K ¢ôklÁ"§÷.ÜX\â*ÄÒÄ4[;nãïÉ8{7ûr.ªU=zž&²¿þÌÌ@_âVá®á/hÑ«Ž \ri`ÝÀõÛÉüŸ>1{éuf/š6ÇµN_%ùÈW&Kja÷EíšX}1ç(ùbªs<JcQ}³RÞ³8ª"Ì2Œ³*Öæy âÅ]ŽûÔHCïCªÞŽý¬QßÏ#Ÿu¡Í3Ê1³÷5§cÕÈÚ}ÖQ9Ü7üõñ.ZhŠG œöÀjCO|ÞðÄ¥ Kl^¡%Aì»/pHùÏ¶"[fì¥Ò·Vö«ËM·qt€ û"î+ä¢L6šõ\I#ZOÂ¹ídôhß>©`Uz ß[x®EÂi6óC/÷k0û¥!ó,Í¥ÁÎ=iœyØ ¡bwrŸ5ïŠÃDáóOùßmºü9'Q{ŠAcôl£êÖåHj#A[z:UÎtp»xóÔ[v!Ï=€Å¥&{W÷)z*k¹j²&=P)å³ f4:r€8bÍ L'Ybùß»µ(Ô ¯<.;-æºÜ0±î×P£žzqÓ¯y_¹òðUÇ/µRSçªðº£~³¹BBÑ3³Õ¹lÝîM£ª6|pzšgP{Á'¢n¶u4ÕëèE\l€ÇwxÔCÐd4VBŒwp(ÒUïÓNŽoj|çÝ|quÊhóàçÅ>H2ÜŸIœ!:®7F1á4dÌL+&%°R 93ºÁ³l{á8¿<À`_ááZuôqPŸþÖ¯ßë#Zjbîó_[Ÿå-Ž¶WØèn"yýÇ]O¬V¿ªiåÉŒ{üUVØ|ÉÇüëËßoð» £õË·©6ïJàzZ è:Ò¥ òÊ1ñ$sÖ-mâŽ§[lB }âÔ¥$EÐn>Œ?Úl¿»ð}ÜÜÁ§ždõ/AõÔ6"9®¶05Ð*O² t6ì÷¶üò=ªPf€ô3¬Îo'§Å¬êÙ=¹Ìlí$;ÂyÄQµåC¯ÎãøÍOäÌ¡kÙ¥!!gO<7ãÂ?NR6v99fêÎy\ž@^ç² çOÈ | :_ö¿EÄh>úE.«$ÀÅÅVX ÿNÉ§Q9Â~êÔùAVq_»yÏV6§{èÀÜíJ·èŒürPäÒQhêÉßòÆ*xø Jê£îèúNÅ÷žèG1hv€öÐ3ÑFà5q£/8DGªµ°Ó|ÐD€êÛgºoÂãkÜKf GÉÁãÉžt7× ··ÙeµÆïr€nù&[œÀQ^mãuiuyjÐ1v£vZêå^v³Ý µßtÌ¥% dâÞº*.O±okàÄæJZ¶;wa"ú|cD?ÜÞ Ù(¿ÜyÌëä!-ã@òáx€xÃ«¶5Q;©Æ|w[}Š(#9u]ZÐé,{ +|R à¹ðë¢ìñÕÃ»w¯ÎÚšÁè·aPm8µ®ª~bV®ôŠÉµºør9øcÌlÝð°z,X:ÈK8coW-``Nk|šÖ/Y¢Já¹¹%yvµÙ=§¿V`J!¹ ª¯60wáÒ¹c7\ünéº^ñ1ñý.Á+Æ4îåëEQSâÚXìÚ#`åøíýµOŸ{¡qæHXÙ%ª[³4()ËWÌÂ!Š]»¿Ú€r¡Äý(©=øjÏzga`-ð§i_;9+Å8ÂÁ¶tJØFêõªfBfã_N²'ÙBéßgÖ{N^Äß×æd5C u0x#}à3xïQP±úöØÙŽµÊ«û-®Ð8šXüÇ~oÚ>7ÉÅ-Çóÿ`rè9\¿CNþ³ý)Àò¢ ÀÿŸq0¿gÿëPK¥xI¯iãiý €BILL_20284_ZIP.zipUTU»6XuxPKXI

9 years, 5 months

1
0
0 0

Computer Software Clients List Q4 Offer

by Claire Divas

Hi, Would you be keen on Computer Software Clients List for your deals and showcasing effort? Key Decision makers: CIOs /COOs/ CTOs/ CFO's/ IT Directors IT Management IT Architects Line of Business Managers & Directors Security Professionals Data Centre Managers IP Communications industry' Including Service Providers Carriers, Enterprises, Government Agencies Reseller Manufacturers Developers As well as Business and Technology Leaders, CTOs, Channel & Partner Managers, Business Development Managers, Analysts & Infrastructure Teams from Cloud Service Providers, Telecommunications, ISPs, ISVs and the IT Channel and Industry serving the cloud community. We are glad to inform you that we running with a Q4 Offer and can provide you the complete list for a discount price. Looking forward to hear from you. Regards, Claire Divas Online Marketing Manager To opt out kindly reply back with 'unsubscribe' or 'leave out'

9 years, 5 months

1
0
0 0

DEV, Delivery Notification, ID 000361707

by FedEx Standard Overnight

Dear Dev, Courier was unable to deliver the parcel to you. Shipment Label is attached to email. Thank you for choosing FedEx, Joel Dickinson, FedEx Delivery Agent.

9 years, 6 months

1
0
0 0

[PATCH 0/3] Backport walt_{prepare|finish}_migrate() for kernel v4.4

by Leo Yan

This patch series is to backport walt_prepare_migrate() and walt_finish_migrate() functions from Vikram latest WALT patch series [1] to Android common kernel 4.4. We use these two functions to replace function walt_fixup_busy_time(), as result the scheduler will saperately acquire lock for source rq and destination rq and don't need use function double_lock_balance(). So this will let scheduler flows more safe due we can ensure atomicity by using walt_prepare_migrate() and walt_finish_migrate(). Thanks for Patrick and Vikram's suggestions for this. Leo Yan (3): sched/walt: port walt_{prepare|finish}_migrate() functions sched/core: fix atomicity broken issue sched/walt: remove walt_fixup_busy_time() kernel/sched/core.c | 10 ++++--- kernel/sched/deadline.c | 8 ++++++ kernel/sched/fair.c | 4 +-- kernel/sched/rt.c | 4 +++ kernel/sched/walt.c | 75 +++++++++++++++++++++++++++++++++++++------------ kernel/sched/walt.h | 6 ++-- 6 files changed, 81 insertions(+), 26 deletions(-) -- 1.9.1

9 years, 6 months

2
8
0 0

2026

2025

2024

2023

2022

2021

2020

2019

2018

2017

2016

2015

eas-dev