linux-toradex.git/kernel/kprobes.c, branch v2.6.28.9

kernel/kprobes.c: don't pad kretprobe_table_locks[] on uniprocessor builds

2008-11-13T01:17:17+00:00

We only need the cacheline padding on SMP kernels.  Saves 6k:

   text    data     bss     dec     hex filename
   5713     388    8840   14941    3a5d kernel/kprobes.o
   5713     388    2632    8733    221d kernel/kprobes.o

Acked-by: Masami Hiramatsu 
Cc: Ananth N Mavinakayanahalli 
Signed-off-by: Andrew Morton 
Signed-off-by: Linus Torvalds

kprobes: disable preempt for module_text_address() and kernel_text_address()

2008-11-13T01:17:16+00:00

__register_kprobe() can be preempted after checking probing address but
before module_text_address() or try_module_get(), and in this interval
the module can be unloaded.  In that case, try_module_get(probed_mod)
will access to invalid address, or kprobe will probe invalid address.

This patch uses preempt_disable() to protect it and uses
__module_text_address() and __kernel_text_address().

Signed-off-by: Lai Jiangshan 
Signed-off-by: Masami Hiramatsu 
Cc: Ananth N Mavinakayanahalli 
Cc: Hiroshi Shimamoto 
Signed-off-by: Andrew Morton 
Signed-off-by: Linus Torvalds

make kprobes.c:kretprobe_table_lock() static

2008-10-16T18:21:52+00:00

Make the needlessly global kretprobe_table_lock() static.

Signed-off-by: Adrian Bunk 
Acked-by: Ananth N Mavinakayanahalli 
Signed-off-by: Andrew Morton 
Signed-off-by: Linus Torvalds

kprobes: remove redundant config check

2008-07-25T17:53:30+00:00

I noticed that there's a CONFIG_KPROBES check inside kernel/kprobes.c,
which is redundant.

Signed-off-by: Abhishek Sagar 
Acked-by: Masami Hiramatsu 
Cc: Ananth N Mavinakayanahalli 
Cc: Anil S Keshavamurthy 
Signed-off-by: Andrew Morton 
Signed-off-by: Linus Torvalds

kprobes: improve kretprobe scalability with hashed locking

2008-07-25T17:53:30+00:00

Currently list of kretprobe instances are stored in kretprobe object (as
used_instances,free_instances) and in kretprobe hash table.  We have one
global kretprobe lock to serialise the access to these lists.  This causes
only one kretprobe handler to execute at a time.  Hence affects system
performance, particularly on SMP systems and when return probe is set on
lot of functions (like on all systemcalls).

Solution proposed here gives fine-grain locks that performs better on SMP
system compared to present kretprobe implementation.

Solution:

 1) Instead of having one global lock to protect kretprobe instances
    present in kretprobe object and kretprobe hash table.  We will have
    two locks, one lock for protecting kretprobe hash table and another
    lock for kretporbe object.

 2) We hold lock present in kretprobe object while we modify kretprobe
    instance in kretprobe object and we hold per-hash-list lock while
    modifying kretprobe instances present in that hash list.  To prevent
    deadlock, we never grab a per-hash-list lock while holding a kretprobe
    lock.

 3) We can remove used_instances from struct kretprobe, as we can
    track used instances of kretprobe instances using kretprobe hash
    table.

Time duration for kernel compilation ("make -j 8") on a 8-way ppc64 system
with return probes set on all systemcalls looks like this.

cacheline              non-cacheline             Un-patched kernel
aligned patch 	       aligned patch
===============================================================================
real    9m46.784s       9m54.412s                  10m2.450s
user    40m5.715s       40m7.142s                  40m4.273s
sys     2m57.754s       2m58.583s                  3m17.430s
===========================================================

Time duration for kernel compilation ("make -j 8) on the same system, when
kernel is not probed.
=========================
real    9m26.389s
user    40m8.775s
sys     2m7.283s
=========================

Signed-off-by: Srinivasa DS 
Signed-off-by: Jim Keniston 
Acked-by: Ananth N Mavinakayanahalli 
Cc: Anil S Keshavamurthy 
Cc: David S. Miller 
Cc: Masami Hiramatsu 
Signed-off-by: Andrew Morton 
Signed-off-by: Linus Torvalds

kernel/kprobes.c: Made kprobe_blacklist static.

2008-07-10T17:13:51+00:00

Signed-off-by: Daniel Guilak 
Signed-off-by: Linus Torvalds

kprobes: fix error checking of batch registration

2008-06-13T01:05:40+00:00

Fix error checking routine to catch an error which occurs in first
__register_*probe().

Signed-off-by: Masami Hiramatsu 
Cc: Ananth N Mavinakayanahalli 
Cc: Jim Keniston 
Cc: David Miller 
Cc: Anil S Keshavamurthy 
Signed-off-by: Andrew Morton 
Signed-off-by: Linus Torvalds

kprobes: add (un)register_jprobes for batch registration

2008-04-28T15:58:32+00:00

Introduce unregister_/register_jprobes() for jprobe batch registration.

Signed-off-by: Masami Hiramatsu 
Cc: Ananth N Mavinakayanahalli 
Cc: Jim Keniston 
Cc: Prasanna S Panchamukhi 
Cc: Shaohua Li 
Cc: David Miller 
Cc: "Frank Ch. Eigler" 
Signed-off-by: Andrew Morton 
Signed-off-by: Linus Torvalds

kprobes: add (un)register_kretprobes for batch registration

2008-04-28T15:58:32+00:00

Introduce unregister_/register_kretprobes() for kretprobe batch registration.

Signed-off-by: Masami Hiramatsu 
Cc: Ananth N Mavinakayanahalli 
Cc: Jim Keniston 
Cc: Prasanna S Panchamukhi 
Cc: Shaohua Li 
Cc: David Miller 
Cc: "Frank Ch. Eigler" 
Signed-off-by: Andrew Morton 
Signed-off-by: Linus Torvalds

kprobes: add (un)register_kprobes for batch registration

2008-04-28T15:58:32+00:00

Introduce unregister_/register_kprobes() for kprobe batch registration.  This
can reduce waiting time for synchronized_sched() when a lot of probes have to
be unregistered at once.

Signed-off-by: Masami Hiramatsu 
Cc: Ananth N Mavinakayanahalli 
Cc: Jim Keniston 
Cc: Prasanna S Panchamukhi 
Cc: Shaohua Li 
Cc: David Miller 
Cc: "Frank Ch. Eigler" 
Signed-off-by: Andrew Morton 
Signed-off-by: Linus Torvalds