linux-toradex.git/kernel/sched/debug.c, branch v3.14.3

sched/clock, x86: Use a static_key for sched_clock_stable

2014-01-13T14:13:13+00:00

In order to avoid the runtime condition and variable load turn
sched_clock_stable into a static_key.

Also provide a shorter implementation of local_clock() and
cpu_clock(int) when sched_clock_stable==1.

                        MAINLINE   PRE       POST

    sched_clock_stable: 1          1         1
    (cold) sched_clock: 329841     221876    215295
    (cold) local_clock: 301773     234692    220773
    (warm) sched_clock: 38375      25602     25659
    (warm) local_clock: 100371     33265     27242
    (warm) rdtsc:       27340      24214     24208
    sched_clock_stable: 0          0         0
    (cold) sched_clock: 382634     235941    237019
    (cold) local_clock: 396890     297017    294819
    (warm) sched_clock: 38194      25233     25609
    (warm) local_clock: 143452     71234     71232
    (warm) rdtsc:       27345      24245     24243

Signed-off-by: Peter Zijlstra 
Cc: Linus Torvalds 
Cc: Andrew Morton 
Link: http://lkml.kernel.org/n/tip-eummbdechzz37mwmpags1gjr@git.kernel.org
Signed-off-by: Ingo Molnar

sched/numa: Use wrapper function task_node to get node which task is on

2013-12-17T14:24:39+00:00

Use wrapper function task_node to get node which task is on.

Signed-off-by: Wanpeng Li 
Acked-by: Mel Gorman 
Reviewed-by: Naoya Horiguchi 
Reviewed-by: Rik van Riel 
Acked-by: David Rientjes 
Signed-off-by: Peter Zijlstra 
Cc: Andrew Morton 
Link: http://lkml.kernel.org/r/1386833006-6600-2-git-send-email-liwanp@linux.vnet.ibm.com
Signed-off-by: Ingo Molnar

sched: Avoid throttle_cfs_rq() racing with period_timer stopping

2013-10-29T11:02:32+00:00

throttle_cfs_rq() doesn't check to make sure that period_timer is running,
and while update_curr/assign_cfs_runtime does, a concurrently running
period_timer on another cpu could cancel itself between this cpu's
update_curr and throttle_cfs_rq(). If there are no other cfs_rqs running
in the tg to restart the timer, this causes the cfs_rq to be stranded
forever.

Fix this by calling __start_cfs_bandwidth() in throttle if the timer is
inactive.

(Also add some sched_debug lines for cfs_bandwidth.)

Tested: make a run/sleep task in a cgroup, loop switching the cgroup
between 1ms/100ms quota and unlimited, checking for timer_active=0 and
throttled=1 as a failure. With the throttle_cfs_rq() change commented out
this fails, with the full patch it passes.

Signed-off-by: Ben Segall 
Signed-off-by: Peter Zijlstra 
Cc: pjt@google.com
Link: http://lkml.kernel.org/r/20131016181632.22647.84174.stgit@sword-of-the-dawn.mtv.corp.google.com
Signed-off-by: Ingo Molnar

sched/numa: Add debugging

2013-10-09T12:48:04+00:00

Signed-off-by: Ingo Molnar 
Reviewed-by: Rik van Riel 
Cc: Johannes Weiner 
Cc: Mel Gorman 
Cc: Srikar Dronamraju 
Cc: Andrea Arcangeli 
Signed-off-by: Peter Zijlstra 
Signed-off-by: Ingo Molnar 
Link: http://lkml.kernel.org/r/1381141781-10992-53-git-send-email-mgorman@suse.de

sched/debug: Take PID namespace into account

2013-09-12T17:14:16+00:00

Emmanuel reported that /proc/sched_debug didn't report the right PIDs
when using namespaces, cure this.

Reported-by: Emmanuel Deloget 
Signed-off-by: Peter Zijlstra 
Link: http://lkml.kernel.org/r/20130909110141.GM31370@twins.programming.kicks-ass.net
Signed-off-by: Ingo Molnar

sched/debug: Remove CONFIG_FAIR_GROUP_SCHED mask

2013-06-28T11:17:17+00:00

Now that we are using runnable load avg in sched balance, we don't
need to keep it under CONFIG_FAIR_GROUP_SCHED.

Also align the code style to #ifdef instead of #if defined() and
reorder the tg output info.

Signed-off-by: Alex Shi 
Cc: pjt@google.com
Cc: kamalesh@linux.vnet.ibm.com
Cc: peterz@infradead.org
Link: http://lkml.kernel.org/r/1372417835-4698-1-git-send-email-alex.shi@intel.com
Signed-off-by: Ingo Molnar

sched/debug: Fix formatting of /proc//sched

2013-06-28T09:13:35+00:00

This patch alters format string's width, to align all statistics
at par with the longest struct sched_statistic member name under
/proc//sched.

Signed-off-by: Kamalesh Babulal 
Cc: peterz@infradead.org
Link: http://lkml.kernel.org/r/20130627165005.GA15583@linux.vnet.ibm.com
Signed-off-by: Ingo Molnar

sched/debug: Add load-tracking statistics to task

2013-06-27T08:07:46+00:00

At present we print per-entity load-tracking statistics for
cfs_rq of cgroups/runqueues. Given that per task statistics
is maintained, it can be used to know the contribution made
by the task to its parenting cfs_rq level.

This patch adds per-task load-tracking statistics to /proc//sched.

Signed-off-by: Kamalesh Babulal 
Signed-off-by: Peter Zijlstra 
Link: http://lkml.kernel.org/r/20130625080336.GA20175@linux.vnet.ibm.com
Signed-off-by: Ingo Molnar

sched/tg: Use 'unsigned long' for load variable in task group

2013-06-27T08:07:40+00:00

Since tg->load_avg is smaller than tg->load_weight, we don't need a
atomic64_t variable for load_avg in 32 bit machine.
The same reason for cfs_rq->tg_load_contrib.

The atomic_long_t/unsigned long variable type are more efficient and
convenience for them.

Signed-off-by: Alex Shi 
Tested-by: Vincent Guittot 
Signed-off-by: Peter Zijlstra 
Link: http://lkml.kernel.org/r/1371694737-29336-11-git-send-email-alex.shi@intel.com
Signed-off-by: Ingo Molnar

sched: Change cfs_rq load avg to unsigned long

2013-06-27T08:07:38+00:00

Since the 'u64 runnable_load_avg, blocked_load_avg' in cfs_rq struct are
smaller than 'unsigned long' cfs_rq->load.weight. We don't need u64
vaiables to describe them. unsigned long is more efficient and convenience.

Signed-off-by: Alex Shi 
Reviewed-by: Paul Turner 
Tested-by: Vincent Guittot 
Signed-off-by: Peter Zijlstra 
Link: http://lkml.kernel.org/r/1371694737-29336-10-git-send-email-alex.shi@intel.com
Signed-off-by: Ingo Molnar