Target_feb29.log - LTTng-tools - LTTng bugs repository

Feature #137 » Target_feb29.log

log file for the steps described in this report - Tan le tran, 02/29/2012 10:58 AM

       =~=~=~=~=~=~=~=~=~=~=~= PuTTY log 2012.02.29 09:28:30 =~=~=~=~=~=~=~=~=~=~=~=
       SC-1:/usr/bin # lttng-sessiond -vvv &
       [1] 21537
       SC-1:/usr/bin # DEBUG3: Creating LTTng run directory: /var/run/lttng [in create_lttng_rundir() at main.c:4062]
       DEBUG2: Kernel consumer err path: /var/run/lttng/kconsumerd/error [in main() at main.c:4289]
       DEBUG2: Kernel consumer cmd path: /var/run/lttng/kconsumerd/command [in main() at main.c:4291]
       DEBUG1: Client socket path /var/run/lttng/client-lttng-sessiond [in main() at main.c:4334]
       DEBUG1: Application socket path /var/run/lttng/apps-lttng-sessiond [in main() at main.c:4335]
       DEBUG1: LTTng run directory path: /var/run/lttng [in main() at main.c:4336]
       DEBUG2: UST consumer 32 bits err path: /var/run/lttng/ustconsumerd32/error [in main() at main.c:4345]
       DEBUG2: UST consumer 32 bits cmd path: /var/run/lttng/ustconsumerd32/command [in main() at main.c:4347]
       DEBUG2: UST consumer 64 bits err path: /var/run/lttng/ustconsumerd64/error [in main() at main.c:4356]
       DEBUG2: UST consumer 64 bits cmd path: /var/run/lttng/ustconsumerd64/command [in main() at main.c:4358]
       DEBUG2: Creating consumer directory: /var/run/lttng/kconsumerd [in set_consumer_sockets() at main.c:4104]
       FATAL: Module lttng_tracer not found.
       Error: Unable to load module lttng-tracer
       DEBUG1: Failed to open /proc/lttng [in init_kernel_tracer() at main.c:1740]
       Error: Unable to remove module lttng-tracer
       Warning: No kernel tracer available
       DEBUG2: Creating consumer directory: /var/run/lttng/ustconsumerd64 [in set_consumer_sockets() at main.c:4104]
       DEBUG2: Creating consumer directory: /var/run/lttng/ustconsumerd32 [in set_consumer_sockets() at main.c:4104]
       DEBUG1: Signal handler set for SIGTERM, SIGPIPE and SIGINT [in set_signal_handler() at main.c:4195]
       DEBUG1: All permissions are set [in set_permissions() at main.c:4033]
       DEBUG3: Created hashtable size 4 at 0x62f4b0 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: Created hashtable size 4 at 0x62f770 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG1: epoll set max size is 3346780 [in compat_epoll_set_max_size() at compat/compat-epoll.c:220]
       DEBUG1: [thread] Dispatch UST command started [in thread_dispatch_ust_registration() at main.c:1223]
       DEBUG1: Futex n to 1 prepare done [in futex_nto1_prepare() at futex.c:74]
       DEBUG1: Woken up but nothing in the UST command queue [in thread_dispatch_ust_registration() at main.c:1233]
       DEBUG1: [thread] Manage client started [in thread_manage_clients() at main.c:3595]
       DEBUG1: [thread] Manage application registration started [in thread_registration_apps() at main.c:1291]
       DEBUG1: Thread manage kernel started [in thread_manage_kernel() at main.c:799]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Updating kernel poll set [in update_kernel_poll() at main.c:671]
       DEBUG1: [thread] Manage application started [in thread_manage_apps() at main.c:1077]
       DEBUG1: Notifying applications of session daemon state: 1 [in notify_ust_apps() at main.c:610]
       DEBUG1: Thread kernel polling on 2 fds [in thread_manage_kernel() at main.c:828]
       DEBUG1: Apps thread polling on 2 fds [in thread_manage_apps() at main.c:1098]
       DEBUG1: Got the wait shm fd 18 [in get_wait_shm() at shm.c:113]
       DEBUG1: Futex wait update active 1 [in futex_wait_update() at futex.c:63]
       DEBUG1: Accepting application registration [in thread_registration_apps() at main.c:1322]
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       (reverse-i-search)`': p': ps -elf |egrep -i 'ltt|test's':
       SC-1:/usr/bin #
 S root     21537 13837  0  80   0 - 24734 futex_ 09:28 pts/2    00:00:00 lttng-sessiond -vvv
 R root     21546 13837  0  80   0 -   978 -      09:28 pts/2    00:00:00 egrep -i ltt|test
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       (reverse-i-search)`': d': lttng-sessiond -vvv &i': dir |grep TestAr':
       SC-1:/usr/bin #
       -rwxr-xr-x 1 root  root      73105 Feb 28 14:32 TestApp_Fork1_StaticString
       -rwxr-xr-x 1 root  root     144142 Feb 27 22:48 TestApp_Fork1_byDXsysRoot
       -rwxr-xr-x 1 root  root      73105 Feb 27 22:36 TestApp_Fork1_byTraceEA
       -rwxr-xr-x 1 root  root      73194 Feb 28 18:27 TestApp_Fork1_fixed
       -rwxr-xr-x 1 root  root      73194 Feb 28 17:37 TestApp_Fork1_new_header
       -rwxr-xr-x 1 root  root      73194 Feb 28 17:46 TestApp_Fork1_new_header_try2
       -rwxr-xr-x 1 root  root      81132 Feb 28 13:20 TestApp_Fork1_noLttng
       -rwxr-xr-x 1 root  root      73105 Feb 28 14:38 TestApp_Fork1_noString
       -rwxr-xr-x 1 root  root      73105 Feb 28 14:41 TestApp_Fork1_noTracePoint
       -rwxr-xr-x 1 root  root        112 Feb 28 13:20 TestApp_Fork1_run_withLttng
       -rwxr-xr-x 1 root  root      73105 Feb 28 15:21 TestApp_Fork1_tp_in_bothProc
       -rwxr-xr-x 1 root  root      73105 Feb 28 14:17 TestApp_Fork1_try1
       drwxr-xr-x 2 root  root       4096 Feb 27 22:33 TestApp_previous
       -rwxr-xr-x 1 root  root      71724 Feb 28 10:41 TestApp_type1_noLttng
       -rwxr-xr-x 1 root  root         91 Feb 28 10:41 TestApp_type1_run_withLttng
       -rwxr-xr-x 1 root  root      81098 Feb 28 13:20 liblttng-ust-provider-TestApp-Fork1.so
       -rwxr-xr-x 1 root  root      58918 Feb 28 10:41 liblttng-ust-provider-TestApp-type1.so
       SC-1:/usr/bin #
       SC-1:/usr/bin # more TestApp_type1_run_withLttng
       #!/bin/sh
       LD_PRELOAD=./liblttng-ust-provider-TestApp-type1.so ./TestApp_type1_noLttng ${*}
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       SC-1:/usr/bin # TestApp_type1_run_withLttng 50000 np &
       [2] 21550
       SC-1:/usr/bin # DEBUG1: UST registration received with pid:21551 ppid:21550 uid:0 gid:0 sock:18 name:TestApp_type1_n (version 2.0) [in thread_registration_apps() at main.c:1392]
       DEBUG1: Futex n to 1 wake done [in futex_nto1_wake() at futex.c:101]
       DEBUG1: Accepting application registration [in thread_registration_apps() at main.c:1322]
       DEBUG1: Futex n to 1 wait done [in futex_nto1_wait() at futex.c:88]
       DEBUG1: Futex n to 1 prepare done [in futex_nto1_prepare() at futex.c:74]
       DEBUG1: Dispatching UST registration pid:21551 ppid:21550 uid:0 gid:0 sock:18 name:TestApp_type1_n (version 2.0) [in thread_dispatch_ust_registration() at main.c:1245]
       DEBUG1: Woken up but nothing in the UST command queue [in thread_dispatch_ust_registration() at main.c:1233]
       DEBUG3: Created hashtable size 4 at 0x630320 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG1: App registered with pid:21551 ppid:21550 uid:0 gid:0 sock:18 name:TestApp_type1_n (version 2.0) [in ust_app_register() at ust-app.c:1317]
       DEBUG2: UST app PID 21551 is compatible with major version 2 (supporting <= 2) [in ust_app_validate_version() at ust-app.c:2562]
       DEBUG1: Apps with sock 18 added to poll set [in thread_manage_apps() at main.c:1176]
       DEBUG1: Apps thread polling on 3 fds [in thread_manage_apps() at main.c:1098]
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       SC-1:/usr/bin # lttng list -u
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 14 [in process_client_msg() at main.c:3166]
       DEBUG2: UST app list events done (10 events) [in ust_app_list_events() at ust-app.c:1443]
       DEBUG1: Sending response (size: 5856, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       UST events:
       -------------
       PID: 21551 - Name: ./TestApp_type1_noLttng
             com_ericsson_cba_trace_testapp_hightraf:KiloPerSec (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace_testapp_hightraf:HundredPerSec (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace_testapp_lowtraf:TenPerSecB (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace_testapp_lowtraf:TenPerSecA (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace_testapp_lowtraf:OnePerSecA (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba:AfterAllLoops (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba:cba_domain_event (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace:trace_domain_event (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace_testapp:testapp_domain_event (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
       SC-1:/usr/bin #
       SC-1:/usr/bin #    export MYSESSION=feb29_ses1
       SC-1:/usr/bin #    lttng create $MYSESSION -o /tmp/tdlt/$MYSESSION
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 8 [in process_client_msg() at main.c:3166]
       DEBUG2: Trying to find session by name feb29_ses1 [in session_find_by_name() at session.c:128]
       DEBUG3: mkdir() recursive /tmp/tdlt/feb29_ses1 with mode 504 for uid 0 and gid 0 [in run_as_mkdir_recursive() at runas.c:288]
       DEBUG1: Tracing session feb29_ses1 created in /tmp/tdlt/feb29_ses1 with ID 1 by UID 0 GID 0 [in session_create() at session.c:236]
       DEBUG1: Sending response (size: 16, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       Session feb29_ses1 created.
       Traces will be written in /tmp/tdlt/feb29_ses1
       SC-1:/usr/bin # lttng enable-event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecA -u
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 6 [in process_client_msg() at main.c:3166]
       DEBUG1: Getting session feb29_ses1 by name [in process_client_msg() at main.c:3217]
       DEBUG2: Trying to find session by name feb29_ses1 [in session_find_by_name() at session.c:128]
       DEBUG1: Creating UST session [in create_ust_session() at main.c:1824]
       DEBUG3: Created hashtable size 4 at 0x63b0f0 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: Created hashtable size 4 at 0x63b3b0 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: Created hashtable size 4 at 0x63b670 of type 0 [in lttng_ht_new() at hashtable.c:96]
       DEBUG2: UST trace session create successful [in trace_ust_create_session() at trace-ust.c:119]
       DEBUG3: mkdir() recursive /tmp/tdlt/feb29_ses1/ust with mode 504 for uid 0 and gid 0 [in run_as_mkdir_recursive() at runas.c:288]
       DEBUG1: Spawning consumerd [in spawn_consumerd() at main.c:1528]
       DEBUG2: Consumer pid 21583 [in start_consumerd() at main.c:1699]
       DEBUG2: Spawning consumer control thread [in start_consumerd() at main.c:1702]
       DEBUG1: [thread] Manage consumer started [in thread_manage_consumer() at main.c:908]
       DEBUG1: Using 64-bit UST consumer at: /usr/bin/lttng-consumerd [in spawn_consumerd() at main.c:1602]
       DEBUG2: Receiving code from consumer err_sock [in thread_manage_consumer() at main.c:969]
       DEBUG1: consumer command socket ready [in thread_manage_consumer() at main.c:988]
       DEBUG2: Trace UST channel channel0 not found by name [in trace_ust_find_channel_by_name() at trace-ust.c:52]
       DEBUG3: Created hashtable size 4 at 0x63cfd0 of type 0 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: Created hashtable size 4 at 0x63d290 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG2: Trace UST channel channel0 created [in trace_ust_create_channel() at trace-ust.c:178]
       DEBUG2: Channel channel0 being created in UST global domain [in channel_ust_create() at channel.c:248]
       DEBUG2: UST app adding channel channel0 to global domain for session id 1 [in ust_app_create_channel_glb() at ust-app.c:1742]
       DEBUG2: UST app pid: 21551 session id 1 not found, creating it [in create_ust_app_session() at ust-app.c:855]
       DEBUG3: Created hashtable size 4 at 0x63e5b0 of type 0 [in lttng_ht_new() at hashtable.c:96]
       DEBUG2: Shadow copy of session handle -1 [in shadow_copy_session() at ust-app.c:766]
       DEBUG2: UST app session created successfully with handle 2 [in create_ust_app_session() at ust-app.c:879]
       DEBUG3: Created hashtable size 4 at 0x63f620 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: Created hashtable size 4 at 0x63f8c0 of type 0 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: UST app channel channel0 allocated [in alloc_ust_app_channel() at ust-app.c:281]
       DEBUG2: UST app shadow copy of channel channel0 started [in shadow_copy_channel() at ust-app.c:706]
       DEBUG3: UST app shadow copy of channel channel0 done [in shadow_copy_channel() at ust-app.c:743]
       DEBUG2: UST app channel channel0 created successfully for pid:21551 and sock:18 [in create_ust_channel() at ust-app.c:593]
       DEBUG2: UST app create channel channel0 for PID 21551 completed [in create_ust_app_channel() at ust-app.c:1098]
       DEBUG2: Channel channel0 created successfully [in channel_ust_create() at channel.c:273]
       DEBUG2: Trace UST channel channel0 found by name [in trace_ust_find_channel_by_name() at trace-ust.c:47]
       DEBUG2: Trace UST event NOT found by name com_ericsson_cba_trace_testapp_lowtraf:OnePerSecA [in trace_ust_find_event_by_name() at trace-ust.c:79]
       DEBUG3: Created hashtable size 4 at 0x63fde0 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG2: Trace UST event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecA, loglevel (0,-1) created [in trace_ust_create_event() at trace-ust.c:251]
       DEBUG1: UST app creating event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecA for all apps for session id 1 [in ust_app_create_event_glb() at ust-app.c:1866]
       DEBUG3: Created hashtable size 4 at 0x640410 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: UST app event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecA allocated [in alloc_ust_app_event() at ust-app.c:316]
       DEBUG2: UST app event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecA created successfully for pid:21551 [in create_ust_event() at ust-app.c:632]
       DEBUG2: UST app create event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecA for PID 21551 completed [in create_ust_app_event() at ust-app.c:1149]
       DEBUG1: Event UST com_ericsson_cba_trace_testapp_lowtraf:OnePerSecA created in channel channel0 [in event_ust_enable_tracepoint() at event.c:424]
       DEBUG1: Sending response (size: 16, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       UST event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecA created in channel channel0
       SC-1:/usr/bin #
       SC-1:/usr/bin #    lttng list $MYSESSION
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 13 [in process_client_msg() at main.c:3166]
       DEBUG1: Counting number of available session for UID 0 GID 0 [in lttng_sessions_count() at main.c:1916]
       DEBUG1: Getting all available session for UID 0 GID 0 [in list_lttng_sessions() at main.c:1943]
       DEBUG1: Sending response (size: 4388, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       Tracing session feb29_ses1: [inactive]
           Trace path: /tmp/tdlt/feb29_ses1
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 11 [in process_client_msg() at main.c:3166]
       DEBUG1: Getting session feb29_ses1 by name [in process_client_msg() at main.c:3217]
       DEBUG2: Trying to find session by name feb29_ses1 [in session_find_by_name() at session.c:128]
       DEBUG3: Listing domains found UST global domain [in cmd_list_domains() at main.c:3045]
       DEBUG1: Sending response (size: 324, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       === Domain: UST global ===
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 10 [in process_client_msg() at main.c:3166]
       DEBUG1: Getting session feb29_ses1 by name [in process_client_msg() at main.c:3217]
       DEBUG2: Trying to find session by name feb29_ses1 [in session_find_by_name() at session.c:128]
       DEBUG3: Number of UST global channels 1 [in cmd_list_channels() at main.c:3092]
       DEBUG1: Listing channels for session feb29_ses1 [in list_lttng_channels() at main.c:1973]
       DEBUG1: Sending response (size: 624, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       Channels:
       -------------
       - channel0: [enabled]
           Attributes:
             overwrite mode: 0
             subbufers size: 4096
             number of subbufers: 4
             switch timer interval: 0
             read timer interval: 200
             output: mmap()
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 12 [in process_client_msg() at main.c:3166]
       DEBUG1: Getting session feb29_ses1 by name [in process_client_msg() at main.c:3217]
       DEBUG2: Trying to find session by name feb29_ses1 [in session_find_by_name() at session.c:128]
       DEBUG1: Listing UST global events for channel channel0 [in list_lttng_ust_global_events() at main.c:2033]
       DEBUG3: Listing UST global 1 events [in list_lttng_ust_global_events() at main.c:2053]
       DEBUG1: Sending response (size: 600, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
           Events:
             com_ericsson_cba_trace_testapp_lowtraf:OnePerSecA (type: tracepoint) [enabled]
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       (reverse-i-search)`': p': lttng enable-event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecA -u
       (reverse-i-search)`ps': ps -elf |egrep -i 'ltt|test'
       (reverse-i-search)`ps':
       SC-1:/usr/bin #
 S root     21537 13837  0  80   0 - 71839 futex_ 09:28 pts/2    00:00:00 lttng-sessiond -vvv
 S root     21550 13837  0  80   0 -  2788 wait   09:29 pts/2    00:00:00 /bin/sh /usr/bin/TestApp_type1_run_withLttng 50000 np
 S root     21551 21550  0  80   0 - 11760 -      09:29 pts/2    00:00:00 ./TestApp_type1_noLttng 50000 np
 S root     21583 21537  0  80   0 - 17985 futex_ 09:30 pts/2    00:00:00 lttng-consumerd --quiet -u --consumerd-cmd-sock /var/run/lttng/ustconsumerd64/command --consumerd-err-sock /var/run/lttng/ustconsumerd64/error
 S root     21589 13837  0  80   0 -   979 pipe_w 09:30 pts/2    00:00:00 egrep -i ltt|test
       SC-1:/usr/bin #
       SC-1:/usr/bin #    date; lttng start
       Wed Feb 29 09:30:55 EST 2012
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 16 [in process_client_msg() at main.c:3166]
       DEBUG1: Getting session feb29_ses1 by name [in process_client_msg() at main.c:3217]
       DEBUG2: Trying to find session by name feb29_ses1 [in session_find_by_name() at session.c:128]
       DEBUG1: Starting all UST traces [in ust_app_start_trace_all() at ust-app.c:2144]
       DEBUG1: Starting tracing for ust app pid 21551 [in ust_app_start_trace() at ust-app.c:1920]
       DEBUG2: UST metadata opened for app pid 21551 [in create_ust_app_metadata() at ust-app.c:1190]
       DEBUG3: mkdir() /tmp/tdlt/feb29_ses1/ust/TestApp_type1_n-21551-20120229-093026 with mode 504 for uid 0 and gid 0 [in run_as_mkdir() at runas.c:299]
       DEBUG2: UST metadata stream object created for app pid 21551 [in create_ust_app_metadata() at ust-app.c:1215]
       DEBUG2: UST stream 1 ready at /tmp/tdlt/feb29_ses1/ust/TestApp_type1_n-21551-20120229-093026/channel0_0 [in ust_app_start_trace() at ust-app.c:1976]
       DEBUG2: UST stream 2 ready at /tmp/tdlt/feb29_ses1/ust/TestApp_type1_n-21551-20120229-093026/channel0_1 [in ust_app_start_trace() at ust-app.c:1976]
       DEBUG2: UST stream 3 ready at /tmp/tdlt/feb29_ses1/ust/TestApp_type1_n-21551-20120229-093026/channel0_2 [in ust_app_start_trace() at ust-app.c:1976]
       DEBUG2: UST stream 4 ready at /tmp/tdlt/feb29_ses1/ust/TestApp_type1_n-21551-20120229-093026/channel0_3 [in ust_app_start_trace() at ust-app.c:1976]
       DEBUG2: UST stream 5 ready at /tmp/tdlt/feb29_ses1/ust/TestApp_type1_n-21551-20120229-093026/channel0_4 [in ust_app_start_trace() at ust-app.c:1976]
       DEBUG2: UST stream 6 ready at /tmp/tdlt/feb29_ses1/ust/TestApp_type1_n-21551-20120229-093026/channel0_5 [in ust_app_start_trace() at ust-app.c:1976]
       DEBUG2: UST stream 7 ready at /tmp/tdlt/feb29_ses1/ust/TestApp_type1_n-21551-20120229-093026/channel0_6 [in ust_app_start_trace() at ust-app.c:1976]
       DEBUG2: UST stream 8 ready at /tmp/tdlt/feb29_ses1/ust/TestApp_type1_n-21551-20120229-093026/channel0_7 [in ust_app_start_trace() at ust-app.c:1976]
       DEBUG1: Sending metadata stream fd [in ust_consumer_send_session() at ust-consumer.c:126]
       DEBUG1: Sending metadata channel 25 to consumer [in ust_consumer_send_session() at ust-consumer.c:142]
       DEBUG1: Sending metadata stream 27 to consumer [in ust_consumer_send_session() at ust-consumer.c:166]
       DEBUG1: Sending streams of channel channel0 to UST consumer [in send_channel_streams() at ust-consumer.c:43]
       DEBUG1: Sending channel 23 to consumer [in send_channel_streams() at ust-consumer.c:58]
       DEBUG1: Sending stream 29 to consumer [in send_channel_streams() at ust-consumer.c:91]
       DEBUG1: Sending stream 31 to consumer [in send_channel_streams() at ust-consumer.c:91]
       DEBUG1: Sending stream 33 to consumer [in send_channel_streams() at ust-consumer.c:91]
       DEBUG1: Sending stream 35 to consumer [in send_channel_streams() at ust-consumer.c:91]
       DEBUG1: Sending stream 37 to consumer [in send_channel_streams() at ust-consumer.c:91]
       DEBUG1: Sending stream 39 to consumer [in send_channel_streams() at ust-consumer.c:91]
       DEBUG1: Sending stream 41 to consumer [in send_channel_streams() at ust-consumer.c:91]
       DEBUG1: Sending stream 43 to consumer [in send_channel_streams() at ust-consumer.c:91]
       DEBUG1: consumer channel streams sent [in send_channel_streams() at ust-consumer.c:107]
       DEBUG1: consumer fds (metadata and channel streams) sent [in ust_consumer_send_session() at ust-consumer.c:201]
       TEST: lib_ring_buffer_reserve data_size 629
       TEST: lib_ring_buffer_reserve slot_size 629
       TEST: lib_ring_buffer_reserve data_size 163
       TEST: lib_ring_buffer_reserve slot_size 163
       TEST: lib_ring_buffer_reserve data_size 27
       TEST: lib_ring_buffer_reserve slot_size 27
       TEST: lib_ring_buffer_reserve data_size 48
       TEST: lib_ring_buffer_reserve slot_size 48
       TEST: lib_ring_buffer_reserve data_size 171
       TEST: lib_ring_buffer_reserve slot_size 171
       TEST: lib_ring_buffer_reserve data_size 363
       TEST: lib_ring_buffer_reserve slot_size 363
       TEST: lib_ring_buffer_reserve data_size 205
       TEST: lib_ring_buffer_reserve slot_size 205
       TEST: lib_ring_buffer_reserve data_size 537
       TEST: lib_ring_buffer_reserve slot_size 537
       TEST: lib_ring_buffer_reserve data_size 106
       TEST: lib_ring_buffer_reserve slot_size 106
       TEST: lib_ring_buffer_reserve data_size 4
       TEST: lib_ring_buffer_reserve slot_size 4
       TEST: lib_ring_buffer_reserve data_size 94
       TEST: lib_ring_buffer_reserve slot_size 94
       TEST: lib_ring_buffer_reserve data_size 16
       TEST: lib_ring_buffer_reserve slot_size 16
       TEST: lib_ring_buffer_reserve data_size 20
       TEST: lib_ring_buffer_reserve slot_size 20
       TEST: lib_ring_buffer_reserve data_size 19
       TEST: lib_ring_buffer_reserve slot_size 19
       TEST: lib_ring_buffer_reserve data_size 84
       TEST: lib_ring_buffer_reserve slot_size 84
       TEST: lib_ring_buffer_reserve data_size 8
       TEST: lib_ring_buffer_reserve slot_size 8
       DEBUG1: Sending response (size: 16, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       Tracing started for session feb29_ses1
       SC-1:/usr/bin # TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       SC-1:/usr/bin # TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       (reverse-i-search)`': p': ps -elf |egrep -i 'ltt|test'TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       s':
       SC-1:/usr/bin #
 S root     21537 13837  0  80   0 - 71839 futex_ 09:28 pts/2    00:00:00 lttng-sessiond -vvv
 S root     21550 13837  0  80   0 -  2788 wait   09:29 pts/2    00:00:00 /bin/sh /usr/bin/TestApp_type1_run_withLttng 50000 np
 S root     21551 21550  0  80   0 - 11766 -      09:29 pts/2    00:00:00 ./TestApp_type1_noLttng 50000 np
 S root     21583 21537  0  80   0 - 18037 futex_ 09:30 pts/2    00:00:00 lttng-consumerd --quiet -u --consumerd-cmd-sock /var/run/lttng/ustconsumerd64/command --consumerd-err-sock /var/run/lttng/ustconsumerd64/error
 S root     21603 13837  0  80   0 -   979 pipe_w 09:31 pts/2    00:00:00 egrep -i ltt|test
       SC-1:/usr/bin # TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       killTEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
        TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
 TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
 TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       SC-1:/usr/bin # TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       Error: consumer err socket second poll error
       DEBUG1: consumer thread dying [in thread_manage_consumer() at main.c:1053]
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       SC-1:/usr/bin # TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       SC-1:/usr/bin # TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       (reverse-i-search)`': TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       p': ps -elf |egrep -i 'ltt|test's': TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       SC-1:/usr/bin #
 S root     21537 13837  0  80   0 - 71839 futex_ 09:28 pts/2    00:00:00 lttng-sessiond -vvv
 S root     21550 13837  0  80   0 -  2788 wait   09:29 pts/2    00:00:00 /bin/sh /usr/bin/TestApp_type1_run_withLttng 50000 np
 S root     21551 21550  0  80   0 - 11766 -      09:29 pts/2    00:00:00 ./TestApp_type1_noLttng 50000 np
 Z root     21583 21537  0  80   0 -     0 exit   09:30 pts/2    00:00:00 [lttng-consumerd] <defunct>
 S root     21610 13837  0  80   0 -   979 pipe_w 09:31 pts/2    00:00:00 egrep -i ltt|test
       SC-1:/usr/bin # TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       SC-1:/usr/bin # TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       SC-1:/usr/bin #    date; lttng stop
       Wed Feb 29 09:31:57 EST 2012
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 17 [in process_client_msg() at main.c:3166]
       DEBUG1: Getting session feb29_ses1 by name [in process_client_msg() at main.c:3217]
       DEBUG2: Trying to find session by name feb29_ses1 [in session_find_by_name() at session.c:128]
       DEBUG1: Stopping all UST traces [in ust_app_stop_trace_all() at ust-app.c:2170]
       DEBUG1: Stopping tracing for ust app pid 21551 [in ust_app_stop_trace() at ust-app.c:2028]
       DEBUG1: Sending response (size: 16, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       Tracing stopped for session feb29_ses1
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       (reverse-i-search)`': p': ps -elf |egrep -i 'ltt|test's':
       SC-1:/usr/bin #
 S root     21537 13837  0  80   0 - 71871 futex_ 09:28 pts/2    00:00:00 lttng-sessiond -vvv
 S root     21550 13837  0  80   0 -  2788 wait   09:29 pts/2    00:00:00 /bin/sh /usr/bin/TestApp_type1_run_withLttng 50000 np
 S root     21551 21550  0  80   0 - 11766 -      09:29 pts/2    00:00:00 ./TestApp_type1_noLttng 50000 np
 Z root     21583 21537  0  80   0 -     0 exit   09:30 pts/2    00:00:00 [lttng-consumerd] <defunct>
 S root     21614 13837  0  80   0 -   979 pipe_w 09:32 pts/2    00:00:00 egrep -i ltt|test
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       SC-1:/usr/bin # lttng list
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 13 [in process_client_msg() at main.c:3166]
       DEBUG1: Counting number of available session for UID 0 GID 0 [in lttng_sessions_count() at main.c:1916]
       DEBUG1: Getting all available session for UID 0 GID 0 [in list_lttng_sessions() at main.c:1943]
       DEBUG1: Sending response (size: 4388, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       Available tracing sessions:
 ) feb29_ses1 (/tmp/tdlt/feb29_ses1) [inactive]
       Use lttng list <session_name> for more details
       SC-1:/usr/bin #
       SC-1:/usr/bin # lttng start feb29_ses1
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 16 [in process_client_msg() at main.c:3166]
       DEBUG1: Getting session feb29_ses1 by name [in process_client_msg() at main.c:3217]
       DEBUG2: Trying to find session by name feb29_ses1 [in session_find_by_name() at session.c:128]
       DEBUG1: Starting all UST traces [in ust_app_start_trace_all() at ust-app.c:2144]
       DEBUG1: Starting tracing for ust app pid 21551 [in ust_app_start_trace() at ust-app.c:1920]
       DEBUG1: Sending response (size: 16, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       Tracing started for session feb29_ses1
       SC-1:/usr/bin # TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve_slow slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       SC-1:/usr/bin #
       (reverse-i-search)`': p': ps -elf |egrep -i 'ltt|test'TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       s':
       SC-1:/usr/bin #
 S root     21537 13837  0  80   0 - 71871 futex_ 09:28 pts/2    00:00:00 lttng-sessiond -vvv
 S root     21550 13837  0  80   0 -  2788 wait   09:29 pts/2    00:00:00 /bin/sh /usr/bin/TestApp_type1_run_withLttng 50000 np
 S root     21551 21550  0  80   0 - 11766 -      09:29 pts/2    00:00:00 ./TestApp_type1_noLttng 50000 np
 Z root     21583 21537  0  80   0 -     0 exit   09:30 pts/2    00:00:00 [lttng-consumerd] <defunct>
 S root     21618 13837  0  80   0 -   979 pipe_w 09:32 pts/2    00:00:00 egrep -i ltt|test
       SC-1:/usr/bin # TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve_slow slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       TEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       ltTEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       tng sTEST: lib_ring_buffer_reserve data_size 13
       TEST: lib_ring_buffer_reserve slot_size 26
       top
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 17 [in process_client_msg() at main.c:3166]
       DEBUG1: Getting session feb29_ses1 by name [in process_client_msg() at main.c:3217]
       DEBUG2: Trying to find session by name feb29_ses1 [in session_find_by_name() at session.c:128]
       DEBUG1: Stopping all UST traces [in ust_app_stop_trace_all() at ust-app.c:2170]
       DEBUG1: Stopping tracing for ust app pid 21551 [in ust_app_stop_trace() at ust-app.c:2028]
       DEBUG1: Sending response (size: 16, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       Tracing stopped for session feb29_ses1
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       (reverse-i-search)`': p': lttng stops': ps -elf |egrep -i 'ltt|test'
       (reverse-i-search)`ps':
       SC-1:/usr/bin #
 S root     21537 13837  0  80   0 - 71871 futex_ 09:28 pts/2    00:00:00 lttng-sessiond -vvv
 S root     21550 13837  0  80   0 -  2788 wait   09:29 pts/2    00:00:00 /bin/sh /usr/bin/TestApp_type1_run_withLttng 50000 np
 S root     21551 21550  0  80   0 - 11766 -      09:29 pts/2    00:00:00 ./TestApp_type1_noLttng 50000 np
 Z root     21583 21537  0  80   0 -     0 exit   09:30 pts/2    00:00:00 [lttng-consumerd] <defunct>
 S root     21625 13837  0  80   0 -   979 pipe_w 09:33 pts/2    00:00:00 egrep -i ltt|test
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       SC-1:/usr/bin # dir /tmp/tdlt/feb29_ses1/ust/TestApp_type1_n-21551-20120229-093026/
       total 0
       -rwxrwxrwx 1 root root 0 Feb 29 09:30 channel0_0
       -rwxrwxrwx 1 root root 0 Feb 29 09:30 channel0_1
       -rwxrwxrwx 1 root root 0 Feb 29 09:30 channel0_2
       -rwxrwxrwx 1 root root 0 Feb 29 09:30 channel0_3
       -rwxrwxrwx 1 root root 0 Feb 29 09:30 channel0_4
       -rwxrwxrwx 1 root root 0 Feb 29 09:30 channel0_5
       -rwxrwxrwx 1 root root 0 Feb 29 09:30 channel0_6
       -rwxrwxrwx 1 root root 0 Feb 29 09:30 channel0_7
       -rwxrwxrwx 1 root root 0 Feb 29 09:30 metadata
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       SC-1:/usr/bin # lttng list
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 13 [in process_client_msg() at main.c:3166]
       DEBUG1: Counting number of available session for UID 0 GID 0 [in lttng_sessions_count() at main.c:1916]
       DEBUG1: Getting all available session for UID 0 GID 0 [in list_lttng_sessions() at main.c:1943]
       DEBUG1: Sending response (size: 4388, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       Available tracing sessions:
 ) feb29_ses1 (/tmp/tdlt/feb29_ses1) [inactive]
       Use lttng list <session_name> for more details
       SC-1:/usr/bin # lttng destroy
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 9 [in process_client_msg() at main.c:3166]
       DEBUG1: Getting session feb29_ses1 by name [in process_client_msg() at main.c:3217]
       DEBUG2: Trying to find session by name feb29_ses1 [in session_find_by_name() at session.c:128]
       DEBUG3: No kernel session when tearing down session [in teardown_kernel_session() at main.c:317]
       DEBUG1: Tearing down UST session(s) [in teardown_ust_session() at main.c:347]
       DEBUG1: Destroy all UST traces [in ust_app_destroy_trace_all() at ust-app.c:2196]
       DEBUG1: Destroy tracing for ust app pid 21551 [in ust_app_destroy_trace() at ust-app.c:2098]
       DEBUG2: Trace UST destroy session 1 [in trace_ust_destroy_session() at trace-ust.c:539]
       DEBUG1: Destroying session feb29_ses1 [in session_destroy() at session.c:155]
       DEBUG1: Sending response (size: 16, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG2: Trace destroy UST channel channel0 [in trace_ust_destroy_channel() at trace-ust.c:424]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Updating kernel poll set [in update_kernel_poll() at main.c:671]
       DEBUG1: Thread kernel polling on 2 fds [in thread_manage_kernel() at main.c:828]
       Session feb29_ses1 destroyed at /root
       SC-1:/usr/bin # DEBUG2: Trace destroy UST event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecA [in trace_ust_destroy_event() at trace-ust.c:382]
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       (reverse-i-search)`': p': dir /tmp/tdlt/feb29_ses1/ust/TestApp_type1_n-21551-20120229-093026/
       (reverse-i-search)`ps': ps -elf |egrep -i 'ltt|test'
       (reverse-i-search)`ps':
       SC-1:/usr/bin #
 S root     21537 13837  0  80   0 - 32960 futex_ 09:28 pts/2    00:00:00 lttng-sessiond -vvv
 S root     21550 13837  0  80   0 -  2788 wait   09:29 pts/2    00:00:00 /bin/sh /usr/bin/TestApp_type1_run_withLttng 50000 np
 S root     21551 21550  0  80   0 - 11703 -      09:29 pts/2    00:00:00 ./TestApp_type1_noLttng 50000 np
 Z root     21583 21537  0  80   0 -     0 exit   09:30 pts/2    00:00:00 [lttng-consumerd] <defunct>
 S root     21647 13837  0  80   0 -   979 pipe_w 09:42 pts/2    00:00:00 egrep -i ltt|test
       SC-1:/usr/bin #
       SC-1:/usr/bin #    export MYSESSION=feb29_ses2
       SC-1:/usr/bin #    lttng create $MYSESSION -o /tmp/tdlt/$MYSESSION
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 8 [in process_client_msg() at main.c:3166]
       DEBUG2: Trying to find session by name feb29_ses2 [in session_find_by_name() at session.c:128]
       DEBUG3: mkdir() recursive /tmp/tdlt/feb29_ses2 with mode 504 for uid 0 and gid 0 [in run_as_mkdir_recursive() at runas.c:288]
       DEBUG1: Tracing session feb29_ses2 created in /tmp/tdlt/feb29_ses2 with ID 1 by UID 0 GID 0 [in session_create() at session.c:236]
       DEBUG1: Sending response (size: 16, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       Session feb29_ses2 created.
       Traces will be written in /tmp/tdlt/feb29_ses2
       SC-1:/usr/bin # lttng list -u
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 14 [in process_client_msg() at main.c:3166]
       DEBUG2: UST app list events done (10 events) [in ust_app_list_events() at ust-app.c:1443]
       DEBUG1: Sending response (size: 5856, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       UST events:
       -------------
       PID: 21551 - Name: ./TestApp_type1_noLttng
             com_ericsson_cba_trace_testapp_hightraf:KiloPerSec (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace_testapp_hightraf:HundredPerSec (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace_testapp_lowtraf:TenPerSecB (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace_testapp_lowtraf:TenPerSecA (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace_testapp_lowtraf:OnePerSecA (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba:AfterAllLoops (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba:cba_domain_event (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace:trace_domain_event (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace_testapp:testapp_domain_event (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
       SC-1:/usr/bin #    lttng enable-event com_ericsson_cba_trace:trace_domain_event -s $MYSESSION -u
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 6 [in process_client_msg() at main.c:3166]
       DEBUG1: Getting session feb29_ses2 by name [in process_client_msg() at main.c:3217]
       DEBUG2: Trying to find session by name feb29_ses2 [in session_find_by_name() at session.c:128]
       DEBUG1: Creating UST session [in create_ust_session() at main.c:1824]
       DEBUG3: Created hashtable size 4 at 0x63e5b0 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: Created hashtable size 4 at 0x63b670 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: Created hashtable size 4 at 0x63b0f0 of type 0 [in lttng_ht_new() at hashtable.c:96]
       DEBUG2: UST trace session create successful [in trace_ust_create_session() at trace-ust.c:119]
       DEBUG3: mkdir() recursive /tmp/tdlt/feb29_ses2/ust with mode 504 for uid 0 and gid 0 [in run_as_mkdir_recursive() at runas.c:288]
       DEBUG1: Spawning consumerd [in spawn_consumerd() at main.c:1528]
       DEBUG2: Consumer pid 21657 [in start_consumerd() at main.c:1699]
       DEBUG2: Spawning consumer control thread [in start_consumerd() at main.c:1702]
       DEBUG1: [thread] Manage consumer started [in thread_manage_consumer() at main.c:908]
       listen: Invalid argument
       DEBUG1: consumer thread dying [in thread_manage_consumer() at main.c:1053]
       DEBUG1: Using 64-bit UST consumer at: /usr/bin/lttng-consumerd [in spawn_consumerd() at main.c:1602]
       Error: The consumer thread was never ready. Killing it
       DEBUG2: Trace UST channel channel0 not found by name [in trace_ust_find_channel_by_name() at trace-ust.c:52]
       DEBUG3: Created hashtable size 4 at 0x64e660 of type 0 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: Created hashtable size 4 at 0x63f370 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG2: Trace UST channel channel0 created [in trace_ust_create_channel() at trace-ust.c:178]
       DEBUG2: Channel channel0 being created in UST global domain [in channel_ust_create() at channel.c:248]
       DEBUG2: UST app adding channel channel0 to global domain for session id 1 [in ust_app_create_channel_glb() at ust-app.c:1742]
       DEBUG2: UST app pid: 21551 session id 1 not found, creating it [in create_ust_app_session() at ust-app.c:855]
       DEBUG3: Created hashtable size 4 at 0x63bc30 of type 0 [in lttng_ht_new() at hashtable.c:96]
       DEBUG2: Shadow copy of session handle -1 [in shadow_copy_session() at ust-app.c:766]
       DEBUG2: UST app session created successfully with handle 2 [in create_ust_app_session() at ust-app.c:879]
       DEBUG3: Created hashtable size 4 at 0x63c180 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: Created hashtable size 4 at 0x63c440 of type 0 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: UST app channel channel0 allocated [in alloc_ust_app_channel() at ust-app.c:281]
       DEBUG2: UST app shadow copy of channel channel0 started [in shadow_copy_channel() at ust-app.c:706]
       DEBUG3: UST app shadow copy of channel channel0 done [in shadow_copy_channel() at ust-app.c:743]
       DEBUG2: UST app channel channel0 created successfully for pid:21551 and sock:18 [in create_ust_channel() at ust-app.c:593]
       DEBUG2: UST app create channel channel0 for PID 21551 completed [in create_ust_app_channel() at ust-app.c:1098]
       DEBUG2: Channel channel0 created successfully [in channel_ust_create() at channel.c:273]
       DEBUG2: Trace UST channel channel0 found by name [in trace_ust_find_channel_by_name() at trace-ust.c:47]
       DEBUG2: Trace UST event NOT found by name com_ericsson_cba_trace:trace_domain_event [in trace_ust_find_event_by_name() at trace-ust.c:79]
       DEBUG3: Created hashtable size 4 at 0x63c980 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG2: Trace UST event com_ericsson_cba_trace:trace_domain_event, loglevel (0,-1) created [in trace_ust_create_event() at trace-ust.c:251]
       DEBUG1: UST app creating event com_ericsson_cba_trace:trace_domain_event for all apps for session id 1 [in ust_app_create_event_glb() at ust-app.c:1866]
       DEBUG3: Created hashtable size 4 at 0x65a6f0 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: UST app event com_ericsson_cba_trace:trace_domain_event allocated [in alloc_ust_app_event() at ust-app.c:316]
       DEBUG2: UST app event com_ericsson_cba_trace:trace_domain_event created successfully for pid:21551 [in create_ust_event() at ust-app.c:632]
       DEBUG2: UST app create event com_ericsson_cba_trace:trace_domain_event for PID 21551 completed [in create_ust_app_event() at ust-app.c:1149]
       DEBUG1: Event UST com_ericsson_cba_trace:trace_domain_event created in channel channel0 [in event_ust_enable_tracepoint() at event.c:424]
       DEBUG1: Sending response (size: 16, retcode: Success) [in thread_manage_clients() at main.c:3733]
       sendmsg: Socket operation on non-socket
       Error: Failed to send data back to client
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       hh  Ca ^^?^[[3~        Can not access back to the prompt !!!!!^[[D
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 13 [in process_client_msg() at main.c:3166]
       DEBUG1: Counting number of available session for UID 0 GID 0 [in lttng_sessions_count() at main.c:1916]
       DEBUG1: Getting all available session for UID 0 GID 0 [in list_lttng_sessions() at main.c:1943]
       DEBUG1: Sending response (size: 4388, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       (from other terminal): lttng start
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 16 [in process_client_msg() at main.c:3166]
       DEBUG1: Getting session feb29_ses2 by name [in process_client_msg() at main.c:3217]
       DEBUG2: Trying to find session by name feb29_ses2 [in session_find_by_name() at session.c:128]
       DEBUG1: Starting all UST traces [in ust_app_start_trace_all() at ust-app.c:2144]
       DEBUG1: Starting tracing for ust app pid 21551 [in ust_app_start_trace() at ust-app.c:1920]
       DEBUG2: UST metadata opened for app pid 21551 [in create_ust_app_metadata() at ust-app.c:1190]
       DEBUG3: mkdir() /tmp/tdlt/feb29_ses2/ust/TestApp_type1_n-21551-20120229-094433 with mode 504 for uid 0 and gid 0 [in run_as_mkdir() at runas.c:299]
       DEBUG2: UST metadata stream object created for app pid 21551 [in create_ust_app_metadata() at ust-app.c:1215]
       DEBUG2: UST stream 1 ready at /tmp/tdlt/feb29_ses2/ust/TestApp_type1_n-21551-20120229-094433/channel0_0 [in ust_app_start_trace() at ust-app.c:1976]
       DEBUG2: UST stream 2 ready at /tmp/tdlt/feb29_ses2/ust/TestApp_type1_n-21551-20120229-094433/channel0_1 [in ust_app_start_trace() at ust-app.c:1976]
       DEBUG2: UST stream 3 ready at /tmp/tdlt/feb29_ses2/ust/TestApp_type1_n-21551-20120229-094433/channel0_2 [in ust_app_start_trace() at ust-app.c:1976]
       DEBUG2: UST stream 4 ready at /tmp/tdlt/feb29_ses2/ust/TestApp_type1_n-21551-20120229-094433/channel0_3 [in ust_app_start_trace() at ust-app.c:1976]
       DEBUG2: UST stream 5 ready at /tmp/tdlt/feb29_ses2/ust/TestApp_type1_n-21551-20120229-094433/channel0_4 [in ust_app_start_trace() at ust-app.c:1976]
       DEBUG2: UST stream 6 ready at /tmp/tdlt/feb29_ses2/ust/TestApp_type1_n-21551-20120229-094433/channel0_5 [in ust_app_start_trace() at ust-app.c:1976]
       DEBUG2: UST stream 7 ready at /tmp/tdlt/feb29_ses2/ust/TestApp_type1_n-21551-20120229-094433/channel0_6 [in ust_app_start_trace() at ust-app.c:1976]
       DEBUG2: UST stream 8 ready at /tmp/tdlt/feb29_ses2/ust/TestApp_type1_n-21551-20120229-094433/channel0_7 [in ust_app_start_trace() at ust-app.c:1976]
       DEBUG1: Sending metadata stream fd [in ust_consumer_send_session() at ust-consumer.c:126]
       DEBUG1: Sending metadata channel 19 to consumer [in ust_consumer_send_session() at ust-consumer.c:142]
       sendmsg: Socket operation on non-socket
       send consumer channel: Socket operation on non-socket
       DEBUG1: Sending response (size: 16, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       (from other terminal): lttng stop
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 17 [in process_client_msg() at main.c:3166]
       DEBUG1: Getting session feb29_ses2 by name [in process_client_msg() at main.c:3217]
       DEBUG2: Trying to find session by name feb29_ses2 [in session_find_by_name() at session.c:128]
       DEBUG1: Stopping all UST traces [in ust_app_stop_trace_all() at ust-app.c:2170]
       DEBUG1: Stopping tracing for ust app pid 21551 [in ust_app_stop_trace() at ust-app.c:2028]
       Error: Error stopping tracing for app pid: 21551
       DEBUG1: Sending response (size: 16, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       ^Z
       [3]+  Stopped                 lttng enable-event com_ericsson_cba_trace:trace_domain_event -s $MYSESSION -u
       SC-1:/usr/bin # bg
       [3]+ lttng enable-event com_ericsson_cba_trace:trace_domain_event -s $MYSESSION -u &
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       (reverse-i-search)`': p': ps -elf |egrep -i 'ltt|test's':
       SC-1:/usr/bin #
 S root     21537 13837  0  80   0 - 75969 futex_ 09:28 pts/2    00:00:00 lttng-sessiond -vvv
 S root     21550 13837  0  80   0 -  2788 wait   09:29 pts/2    00:00:00 /bin/sh /usr/bin/TestApp_type1_run_withLttng 50000 np
 S root     21551 21550  0  80   0 - 11766 -      09:29 pts/2    00:00:00 ./TestApp_type1_noLttng 50000 np
 Z root     21583 21537  0  80   0 -     0 exit   09:30 pts/2    00:00:00 [lttng-consumerd] <defunct>
 S root     21655 13837  0  80   0 -  5696 -      09:44 pts/2    00:00:00 lttng enable-event com_ericsson_cba_trace:trace_domain_event -s feb29_ses2 -u
 S root     21657 21537  0  80   0 - 17985 futex_ 09:44 pts/2    00:00:00 lttng-consumerd --quiet -u --consumerd-cmd-sock /var/run/lttng/ustconsumerd64/command --consumerd-err-sock /var/run/lttng/ustconsumerd64/error
 S root     21744 13837  0  80   0 -   979 pipe_w 09:54 pts/2    00:00:00 egrep -i ltt|test
       SC-1:/usr/bin #
       SC-1:/usr/bin # dir     lttng list
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 13 [in process_client_msg() at main.c:3166]
       DEBUG1: Counting number of available session for UID 0 GID 0 [in lttng_sessions_count() at main.c:1916]
       DEBUG1: Getting all available session for UID 0 GID 0 [in list_lttng_sessions() at main.c:1943]
       DEBUG1: Sending response (size: 4388, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       Available tracing sessions:
 ) feb29_ses2 (/tmp/tdlt/feb29_ses2) [inactive]
       Use lttng list <session_name> for more details
       SC-1:/usr/bin #
       SC-1:/usr/bin # lttng       dir /tmp/tdlt/feb29_ses2/ust/TestApp_type1_n-21551-20120229-094433/
       total 0
       SC-1:/usr/bin #
       SC-1:/usr/bin # lttng list -u
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 14 [in process_client_msg() at main.c:3166]
       DEBUG2: UST app list events done (10 events) [in ust_app_list_events() at ust-app.c:1443]
       DEBUG1: Sending response (size: 5856, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       UST events:
       -------------
       PID: 21551 - Name: ./TestApp_type1_noLttng
             com_ericsson_cba_trace_testapp_hightraf:KiloPerSec (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace_testapp_hightraf:HundredPerSec (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace_testapp_lowtraf:TenPerSecB (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace_testapp_lowtraf:TenPerSecA (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace_testapp_lowtraf:OnePerSecA (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba:AfterAllLoops (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba:cba_domain_event (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace:trace_domain_event (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace_testapp:testapp_domain_event (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
       SC-1:/usr/bin #
       SC-1:/usr/bin # lttng enable-event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB -s feb29_ses2 -u
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 6 [in process_client_msg() at main.c:3166]
       DEBUG1: Getting session feb29_ses2 by name [in process_client_msg() at main.c:3217]
       DEBUG2: Trying to find session by name feb29_ses2 [in session_find_by_name() at session.c:128]
       DEBUG1: Spawning consumerd [in spawn_consumerd() at main.c:1528]
       DEBUG2: Consumer pid 21753 [in start_consumerd() at main.c:1699]
       DEBUG2: Spawning consumer control thread [in start_consumerd() at main.c:1702]
       DEBUG1: [thread] Manage consumer started [in thread_manage_consumer() at main.c:908]
       listen: Invalid argument
       DEBUG1: consumer thread dying [in thread_manage_consumer() at main.c:1053]
       DEBUG1: Using 64-bit UST consumer at: /usr/bin/lttng-consumerd [in spawn_consumerd() at main.c:1602]
       ^Z
       [4]+  Stopped                 lttng enable-event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB -s feb29_ses2 -u
       SC-1:/usr/bin # bg
       [4]+ lttng enable-event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB -s feb29_ses2 -u &
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       (reverse-i-search)`': p': lttng enable-event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB -s feb29_ses2 -u
       (reverse-i-search)`ps': ps -elf |egrep -i 'ltt|test'
       (reverse-i-search)`ps':
       SC-1:/usr/bin #
 S root     21537 13837  0  80   0 - 78049 futex_ 09:28 pts/2    00:00:00 lttng-sessiond -vvv
 S root     21550 13837  0  80   0 -  2788 wait   09:29 pts/2    00:00:00 /bin/sh /usr/bin/TestApp_type1_run_withLttng 50000 np
 S root     21551 21550  0  80   0 - 11766 -      09:29 pts/2    00:00:00 ./TestApp_type1_noLttng 50000 np
 Z root     21583 21537  0  80   0 -     0 exit   09:30 pts/2    00:00:00 [lttng-consumerd] <defunct>
 S root     21655 13837  0  80   0 -  5696 -      09:44 pts/2    00:00:00 lttng enable-event com_ericsson_cba_trace:trace_domain_event -s feb29_ses2 -u
 S root     21657 21537  0  80   0 - 17985 futex_ 09:44 pts/2    00:00:00 lttng-consumerd --quiet -u --consumerd-cmd-sock /var/run/lttng/ustconsumerd64/command --consumerd-err-sock /var/run/lttng/ustconsumerd64/error
 S root     21752 13837  0  80   0 -  5696 -      09:56 pts/2    00:00:00 lttng enable-event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB -s feb29_ses2 -u
 S root     21753 21537  0  80   0 - 17985 futex_ 09:56 pts/2    00:00:00 lttng-consumerd --quiet -u --consumerd-cmd-sock /var/run/lttng/ustconsumerd64/command --consumerd-err-sock /var/run/lttng/ustconsumerd64/error
 S root     21758 13837  0  80   0 -   979 pipe_w 09:56 pts/2    00:00:00 egrep -i ltt|test
       SC-1:/usr/bin # Error: The consumer thread was never ready. Killing it
       DEBUG2: Trace UST channel channel0 found by name [in trace_ust_find_channel_by_name() at trace-ust.c:47]
       DEBUG2: Trace UST event NOT found by name com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB [in trace_ust_find_event_by_name() at trace-ust.c:79]
       DEBUG3: Created hashtable size 4 at 0x672a10 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG2: Trace UST event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB, loglevel (0,-1) created [in trace_ust_create_event() at trace-ust.c:251]
       DEBUG1: UST app creating event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB for all apps for session id 1 [in ust_app_create_event_glb() at ust-app.c:1866]
       DEBUG3: Created hashtable size 4 at 0x673040 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: UST app event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB allocated [in alloc_ust_app_event() at ust-app.c:316]
       DEBUG2: UST app event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB created successfully for pid:21551 [in create_ust_event() at ust-app.c:632]
       DEBUG2: UST app create event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB for PID 21551 completed [in create_ust_app_event() at ust-app.c:1149]
       DEBUG1: Event UST com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB created in channel channel0 [in event_ust_enable_tracepoint() at event.c:424]
       DEBUG1: Sending response (size: 16, retcode: Success) [in thread_manage_clients() at main.c:3733]
       sendmsg: Bad file descriptor
       Error: Failed to send data back to client
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       (reverse-i-search)`': p': ps -elf |egrep -i 'ltt|test's':
       SC-1:/usr/bin #
 S root     21537 13837  0  80   0 - 86241 futex_ 09:28 pts/2    00:00:00 lttng-sessiond -vvv
 S root     21550 13837  0  80   0 -  2788 wait   09:29 pts/2    00:00:00 /bin/sh /usr/bin/TestApp_type1_run_withLttng 50000 np
 S root     21551 21550  0  80   0 - 11766 -      09:29 pts/2    00:00:00 ./TestApp_type1_noLttng 50000 np
 Z root     21583 21537  0  80   0 -     0 exit   09:30 pts/2    00:00:00 [lttng-consumerd] <defunct>
 S root     21655 13837  0  80   0 -  5696 -      09:44 pts/2    00:00:00 lttng enable-event com_ericsson_cba_trace:trace_domain_event -s feb29_ses2 -u
 S root     21657 21537  0  80   0 - 17985 futex_ 09:44 pts/2    00:00:00 lttng-consumerd --quiet -u --consumerd-cmd-sock /var/run/lttng/ustconsumerd64/command --consumerd-err-sock /var/run/lttng/ustconsumerd64/error
 S root     21752 13837  0  80   0 -  5696 -      09:56 pts/2    00:00:00 lttng enable-event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB -s feb29_ses2 -u
 S root     21753 21537  0  80   0 - 17985 futex_ 09:56 pts/2    00:00:00 lttng-consumerd --quiet -u --consumerd-cmd-sock /var/run/lttng/ustconsumerd64/command --consumerd-err-sock /var/run/lttng/ustconsumerd64/error
 S root     21764 13837  0  80   0 -   979 pipe_w 09:57 pts/2    00:00:00 egrep -i ltt|test
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       SC-1:/usr/bin # lttng list
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 13 [in process_client_msg() at main.c:3166]
       DEBUG1: Counting number of available session for UID 0 GID 0 [in lttng_sessions_count() at main.c:1916]
       DEBUG1: Getting all available session for UID 0 GID 0 [in list_lttng_sessions() at main.c:1943]
       DEBUG1: Sending response (size: 4388, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       Available tracing sessions:
 ) feb29_ses2 (/tmp/tdlt/feb29_ses2) [inactive]
       Use lttng list <session_name> for more details
       SC-1:/usr/bin #
       SC-1:/usr/bin # lttng destroy
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 9 [in process_client_msg() at main.c:3166]
       DEBUG1: Getting session feb29_ses2 by name [in process_client_msg() at main.c:3217]
       DEBUG2: Trying to find session by name feb29_ses2 [in session_find_by_name() at session.c:128]
       DEBUG3: No kernel session when tearing down session [in teardown_kernel_session() at main.c:317]
       DEBUG1: Tearing down UST session(s) [in teardown_ust_session() at main.c:347]
       DEBUG1: Destroy all UST traces [in ust_app_destroy_trace_all() at ust-app.c:2196]
       DEBUG1: Destroy tracing for ust app pid 21551 [in ust_app_destroy_trace() at ust-app.c:2098]
       DEBUG2: Trace UST destroy session 1 [in trace_ust_destroy_session() at trace-ust.c:539]
       Session feb29_ses2 destroyed at /root
       DEBUG1: Destroying session feb29_ses2 [in session_destroy() at session.c:155]
       DEBUG1: Sending response (size: 16, retcode: Success) [in thread_manage_clients() at main.c:3733]
       sendmsg: Bad file descriptor
       Error: Failed to send data back to client
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Updating kernel poll set [in update_kernel_poll() at main.c:671]
       DEBUG1: Thread kernel polling on 2 fds [in thread_manage_kernel() at main.c:828]
       SC-1:/usr/bin # DEBUG2: Trace destroy UST channel channel0 [in trace_ust_destroy_channel() at trace-ust.c:424]
       DEBUG2: Trace destroy UST event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB [in trace_ust_destroy_event() at trace-ust.c:382]
       DEBUG2: Trace destroy UST event com_ericsson_cba_trace:trace_domain_event [in trace_ust_destroy_event() at trace-ust.c:382]
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       (reverse-i-search)`': p': ps -elf |egrep -i 'ltt|test's':
       SC-1:/usr/bin #
 S root     21537 13837  0  80   0 - 37089 futex_ 09:28 pts/2    00:00:00 lttng-sessiond -vvv
 S root     21550 13837  0  80   0 -  2788 wait   09:29 pts/2    00:00:00 /bin/sh /usr/bin/TestApp_type1_run_withLttng 50000 np
 S root     21551 21550  0  80   0 - 11766 -      09:29 pts/2    00:00:00 ./TestApp_type1_noLttng 50000 np
 Z root     21583 21537  0  80   0 -     0 exit   09:30 pts/2    00:00:00 [lttng-consumerd] <defunct>
 S root     21655 13837  0  80   0 -  5696 -      09:44 pts/2    00:00:00 lttng enable-event com_ericsson_cba_trace:trace_domain_event -s feb29_ses2 -u
 S root     21657 21537  0  80   0 - 17985 futex_ 09:44 pts/2    00:00:00 lttng-consumerd --quiet -u --consumerd-cmd-sock /var/run/lttng/ustconsumerd64/command --consumerd-err-sock /var/run/lttng/ustconsumerd64/error
 S root     21752 13837  0  80   0 -  5696 -      09:56 pts/2    00:00:00 lttng enable-event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB -s feb29_ses2 -u
 S root     21753 21537  0  80   0 - 17985 futex_ 09:56 pts/2    00:00:00 lttng-consumerd --quiet -u --consumerd-cmd-sock /var/run/lttng/ustconsumerd64/command --consumerd-err-sock /var/run/lttng/ustconsumerd64/error
 S root     21869 13837  0  80   0 -   979 pipe_w 10:29 pts/2    00:00:00 egrep -i ltt|test
       SC-1:/usr/bin # kill 21537
       DEBUG1: SIGTERM caught [in sighandler() at main.c:4154]
       DEBUG1: Terminating all threads [in stop_threads() at main.c:365]
       SC-1:/usr/bin # DEBUG1: Application communication apps dying [in thread_manage_apps() at main.c:1202]
       DEBUG1: UST Registration thread dying [in thread_registration_apps() at main.c:1411]
       DEBUG1: Futex n to 1 wait done [in futex_nto1_wait() at futex.c:88]
       DEBUG1: Client thread dying [in thread_manage_clients() at main.c:3746]
       DEBUG1: Kernel thread dying [in thread_manage_kernel() at main.c:888]
       DEBUG1: Notifying applications of session daemon state: 0 [in notify_ust_apps() at main.c:610]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Got the wait shm fd 0 [in get_wait_shm() at shm.c:113]
       DEBUG1: Dispatch thread dying [in thread_dispatch_ust_registration() at main.c:1273]
       DEBUG1: Futex n to 1 wake done [in futex_nto1_wake() at futex.c:101]
       DEBUG1: Futex wait update active 0 [in futex_wait_update() at futex.c:63]
       DEBUG1: Cleaning up [in cleanup() at main.c:385]
       DEBUG1: Removing /var/run/lttng directory [in cleanup() at main.c:387]
       DEBUG1: Cleaning up all sessions [in cleanup() at main.c:400]
       DEBUG1: Closing all UST sockets [in cleanup() at main.c:415]
       DEBUG2: UST app cleaning registered apps hash table [in ust_app_clean_list() at ust-app.c:1460]
       DEBUG2: Closing kernel fd [in cleanup() at main.c:421]
       DEBUG1: Unloading kernel modules [in cleanup() at main.c:423]
       DEBUG1: Modprobe removal successful lttng-probe-timer [in modprobe_remove_lttng_data() at modprobe.c:118]
       DEBUG1: Modprobe removal successful lttng-probe-statedump [in modprobe_remove_lttng_data() at modprobe.c:118]
       DEBUG1: Modprobe removal successful lttng-probe-signal [in modprobe_remove_lttng_data() at modprobe.c:118]
       DEBUG3: Call RCU deleting app PID 21551 [in delete_ust_app_rcu() at ust-app.c:220]
       DEBUG2: UST app pid 21551 deleted [in delete_ust_app() at ust-app.c:203]
       DEBUG1: Modprobe removal successful lttng-probe-sched [in modprobe_remove_lttng_data() at modprobe.c:118]
       DEBUG1: Modprobe removal successful lttng-probe-kvm [in modprobe_remove_lttng_data() at modprobe.c:118]
       DEBUG1: Modprobe removal successful lttng-probe-irq [in modprobe_remove_lttng_data() at modprobe.c:118]
       DEBUG1: Modprobe removal successful lttng-probe-block [in modprobe_remove_lttng_data() at modprobe.c:118]
       DEBUG1: Modprobe removal successful lttng-types [in modprobe_remove_lttng_data() at modprobe.c:118]
       Error: Unable to remove module lttng-probe-lttng
       Error: Unable to remove module lttng-ring-buffer-metadata-mmap-client
       Error: Unable to remove module lttng-ring-buffer-client-mmap-overwrite
       Error: Unable to remove module lttng-ring-buffer-client-mmap-discard
       Error: Unable to remove module lttng-ring-buffer-metadata-client
       Error: Unable to remove module lttng-ring-buffer-client-overwrite
       Error: Unable to remove module lttng-ring-buffer-client-discard
       Error: Unable to remove module lttng-lib-ring-buffer
       DEBUG1: Modprobe removal successful lttng-kretprobes [in modprobe_remove_lttng_data() at modprobe.c:118]
       DEBUG1: Modprobe removal successful lttng-kprobes [in modprobe_remove_lttng_data() at modprobe.c:118]
       DEBUG1: Modprobe removal successful lttng-ftrace [in modprobe_remove_lttng_data() at modprobe.c:118]
       Error: Unable to remove module lttng-tracer
       DEBUG1: *** assert failed :-) *** ==> Matthew, BEET driven development works! [in cleanup() at main.c:433]
       [1]   Done                    lttng-sessiond -vvv
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       (reverse-i-search)`': p': ps -elf |egrep -i 'ltt|test's':
       SC-1:/usr/bin #
 S root     21550 13837  0  80   0 -  2788 wait   09:29 pts/2    00:00:00 /bin/sh /usr/bin/TestApp_type1_run_withLttng 50000 np
 S root     21551 21550  0  80   0 - 11766 -      09:29 pts/2    00:00:00 ./TestApp_type1_noLttng 50000 np
 S root     21655 13837  0  80   0 -  5696 -      09:44 pts/2    00:00:00 lttng enable-event com_ericsson_cba_trace:trace_domain_event -s feb29_ses2 -u
 S root     21657     1  0  80   0 - 17985 futex_ 09:44 pts/2    00:00:00 lttng-consumerd --quiet -u --consumerd-cmd-sock /var/run/lttng/ustconsumerd64/command --consumerd-err-sock /var/run/lttng/ustconsumerd64/error
 S root     21752 13837  0  80   0 -  5696 -      09:56 pts/2    00:00:00 lttng enable-event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB -s feb29_ses2 -u
 S root     21753     1  0  80   0 - 17985 futex_ 09:56 pts/2    00:00:00 lttng-consumerd --quiet -u --consumerd-cmd-sock /var/run/lttng/ustconsumerd64/command --consumerd-err-sock /var/run/lttng/ustconsumerd64/error
 S root     21896 13837  0  80   0 -   979 pipe_w 10:29 pts/2    00:00:00 egrep -i ltt|test
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       SC-1:/usr/bin # lttng  -sessiond -vvv
       DEBUG3: Creating LTTng run directory: /var/run/lttng [in create_lttng_rundir() at main.c:4062]
       DEBUG2: Kernel consumer err path: /var/run/lttng/kconsumerd/error [in main() at main.c:4289]
       DEBUG2: Kernel consumer cmd path: /var/run/lttng/kconsumerd/command [in main() at main.c:4291]
       DEBUG1: Client socket path /var/run/lttng/client-lttng-sessiond [in main() at main.c:4334]
       DEBUG1: Application socket path /var/run/lttng/apps-lttng-sessiond [in main() at main.c:4335]
       DEBUG1: LTTng run directory path: /var/run/lttng [in main() at main.c:4336]
       DEBUG2: UST consumer 32 bits err path: /var/run/lttng/ustconsumerd32/error [in main() at main.c:4345]
       DEBUG2: UST consumer 32 bits cmd path: /var/run/lttng/ustconsumerd32/command [in main() at main.c:4347]
       DEBUG2: UST consumer 64 bits err path: /var/run/lttng/ustconsumerd64/error [in main() at main.c:4356]
       DEBUG2: UST consumer 64 bits cmd path: /var/run/lttng/ustconsumerd64/command [in main() at main.c:4358]
       DEBUG2: Creating consumer directory: /var/run/lttng/kconsumerd [in set_consumer_sockets() at main.c:4104]
       FATAL: Module lttng_tracer not found.
       Error: Unable to load module lttng-tracer
       DEBUG1: Failed to open /proc/lttng [in init_kernel_tracer() at main.c:1740]
       Error: Unable to remove module lttng-tracer
       Warning: No kernel tracer available
       DEBUG2: Creating consumer directory: /var/run/lttng/ustconsumerd64 [in set_consumer_sockets() at main.c:4104]
       DEBUG2: Creating consumer directory: /var/run/lttng/ustconsumerd32 [in set_consumer_sockets() at main.c:4104]
       DEBUG1: Signal handler set for SIGTERM, SIGPIPE and SIGINT [in set_signal_handler() at main.c:4195]
       DEBUG1: All permissions are set [in set_permissions() at main.c:4033]
       DEBUG3: Created hashtable size 4 at 0x62f4b0 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: Created hashtable size 4 at 0x62f770 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG1: epoll set max size is 3346780 [in compat_epoll_set_max_size() at compat/compat-epoll.c:220]
       DEBUG1: [thread] Dispatch UST command started [in thread_dispatch_ust_registration() at main.c:1223]
       DEBUG1: Futex n to 1 prepare done [in futex_nto1_prepare() at futex.c:74]
       DEBUG1: [thread] Manage client started [in thread_manage_clients() at main.c:3595]
       DEBUG1: [thread] Manage application registration started [in thread_registration_apps() at main.c:1291]
       DEBUG1: Woken up but nothing in the UST command queue [in thread_dispatch_ust_registration() at main.c:1233]
       DEBUG1: [thread] Manage application started [in thread_manage_apps() at main.c:1077]
       DEBUG1: Apps thread polling on 2 fds [in thread_manage_apps() at main.c:1098]
       DEBUG1: Thread manage kernel started [in thread_manage_kernel() at main.c:799]
       DEBUG1: Notifying applications of session daemon state: 1 [in notify_ust_apps() at main.c:610]
       DEBUG1: Updating kernel poll set [in update_kernel_poll() at main.c:671]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Thread kernel polling on 2 fds [in thread_manage_kernel() at main.c:828]
       DEBUG1: Got the wait shm fd 18 [in get_wait_shm() at shm.c:113]
       DEBUG1: Futex wait update active 1 [in futex_wait_update() at futex.c:63]
       DEBUG1: Accepting application registration [in thread_registration_apps() at main.c:1322]
       ^Z
       [5]+  Stopped                 lttng-sessiond -vvv
       SC-1:/usr/bin # bg
       [5]+ lttng-sessiond -vvv &
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       (reverse-i-search)`': p': ps -elf |egrep -i 'ltt|test's':
       SC-1:/usr/bin #
 S root     21550 13837  0  80   0 -  2788 wait   09:29 pts/2    00:00:00 /bin/sh /usr/bin/TestApp_type1_run_withLttng 50000 np
 S root     21551 21550  0  80   0 - 11766 -      09:29 pts/2    00:00:00 ./TestApp_type1_noLttng 50000 np
 S root     21655 13837  0  80   0 -  5696 -      09:44 pts/2    00:00:00 lttng enable-event com_ericsson_cba_trace:trace_domain_event -s feb29_ses2 -u
 S root     21657     1  0  80   0 - 17985 futex_ 09:44 pts/2    00:00:00 lttng-consumerd --quiet -u --consumerd-cmd-sock /var/run/lttng/ustconsumerd64/command --consumerd-err-sock /var/run/lttng/ustconsumerd64/error
 S root     21752 13837  0  80   0 -  5696 -      09:56 pts/2    00:00:00 lttng enable-event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB -s feb29_ses2 -u
 S root     21753     1  0  80   0 - 17985 futex_ 09:56 pts/2    00:00:00 lttng-consumerd --quiet -u --consumerd-cmd-sock /var/run/lttng/ustconsumerd64/command --consumerd-err-sock /var/run/lttng/ustconsumerd64/error
 S root     21917 13837  0  80   0 - 24734 futex_ 10:31 pts/2    00:00:00 lttng-sessiond -vvv
 S root     21930 13837  0  80   0 -   979 pipe_w 10:31 pts/2    00:00:00 egrep -i ltt|test
       SC-1:/usr/bin #
       SC-1:/usr/bin # lttng list
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 13 [in process_client_msg() at main.c:3166]
       DEBUG1: Counting number of available session for UID 0 GID 0 [in lttng_sessions_count() at main.c:1916]
       DEBUG1: Getting all available session for UID 0 GID 0 [in list_lttng_sessions() at main.c:1943]
       DEBUG1: Sending response (size: 16, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       Currently no available tracing session
       SC-1:/usr/bin #
       SC-1:/usr/bin #    export MYSESSION=feb29_ses3
       SC-1:/usr/bin #    lttng create $MYSESSION -o /tmp/tdlt/$MYSESSION
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 8 [in process_client_msg() at main.c:3166]
       DEBUG2: Trying to find session by name feb29_ses3 [in session_find_by_name() at session.c:128]
       DEBUG3: mkdir() recursive /tmp/tdlt/feb29_ses3 with mode 504 for uid 0 and gid 0 [in run_as_mkdir_recursive() at runas.c:288]
       DEBUG1: Tracing session feb29_ses3 created in /tmp/tdlt/feb29_ses3 with ID 1 by UID 0 GID 0 [in session_create() at session.c:236]
       DEBUG1: Sending response (size: 16, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       Session feb29_ses3 created.
       Traces will be written in /tmp/tdlt/feb29_ses3
       SC-1:/usr/bin #    lttng enable-event com_ericsson_cba_trace:trace_domain_event -s $MYSESSION -u
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 6 [in process_client_msg() at main.c:3166]
       DEBUG1: Getting session feb29_ses3 by name [in process_client_msg() at main.c:3217]
       DEBUG2: Trying to find session by name feb29_ses3 [in session_find_by_name() at session.c:128]
       DEBUG1: Creating UST session [in create_ust_session() at main.c:1824]
       DEBUG3: Created hashtable size 4 at 0x63ad80 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: Created hashtable size 4 at 0x63b040 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: Created hashtable size 4 at 0x63b300 of type 0 [in lttng_ht_new() at hashtable.c:96]
       DEBUG2: UST trace session create successful [in trace_ust_create_session() at trace-ust.c:119]
       DEBUG3: mkdir() recursive /tmp/tdlt/feb29_ses3/ust with mode 504 for uid 0 and gid 0 [in run_as_mkdir_recursive() at runas.c:288]
       DEBUG1: Spawning consumerd [in spawn_consumerd() at main.c:1528]
       DEBUG2: Consumer pid 21936 [in start_consumerd() at main.c:1699]
       DEBUG2: Spawning consumer control thread [in start_consumerd() at main.c:1702]
       DEBUG1: [thread] Manage consumer started [in thread_manage_consumer() at main.c:908]
       DEBUG1: Using 64-bit UST consumer at: /usr/bin/lttng-consumerd [in spawn_consumerd() at main.c:1602]
       DEBUG2: Receiving code from consumer err_sock [in thread_manage_consumer() at main.c:969]
       DEBUG1: consumer command socket ready [in thread_manage_consumer() at main.c:988]
       DEBUG2: Trace UST channel channel0 not found by name [in trace_ust_find_channel_by_name() at trace-ust.c:52]
       DEBUG3: Created hashtable size 4 at 0x63cc60 of type 0 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: Created hashtable size 4 at 0x63cf20 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG2: Trace UST channel channel0 created [in trace_ust_create_channel() at trace-ust.c:178]
       DEBUG2: Channel channel0 being created in UST global domain [in channel_ust_create() at channel.c:248]
       DEBUG2: UST app adding channel channel0 to global domain for session id 1 [in ust_app_create_channel_glb() at ust-app.c:1742]
       DEBUG2: Channel channel0 created successfully [in channel_ust_create() at channel.c:273]
       DEBUG2: Trace UST channel channel0 found by name [in trace_ust_find_channel_by_name() at trace-ust.c:47]
       DEBUG2: Trace UST event NOT found by name com_ericsson_cba_trace:trace_domain_event [in trace_ust_find_event_by_name() at trace-ust.c:79]
       DEBUG3: Created hashtable size 4 at 0x63d440 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG2: Trace UST event com_ericsson_cba_trace:trace_domain_event, loglevel (0,-1) created [in trace_ust_create_event() at trace-ust.c:251]
       DEBUG1: UST app creating event com_ericsson_cba_trace:trace_domain_event for all apps for session id 1 [in ust_app_create_event_glb() at ust-app.c:1866]
       DEBUG1: Event UST com_ericsson_cba_trace:trace_domain_event created in channel channel0 [in event_ust_enable_tracepoint() at event.c:424]
       DEBUG1: Sending response (size: 16, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       UST event com_ericsson_cba_trace:trace_domain_event created in channel channel0
       SC-1:/usr/bin #
       (reverse-i-search)`': p': ps -elf |egrep -i 'ltt|test's':
       SC-1:/usr/bin #
 S root     21550 13837  0  80   0 -  2788 wait   09:29 pts/2    00:00:00 /bin/sh /usr/bin/TestApp_type1_run_withLttng 50000 np
 S root     21551 21550  0  80   0 - 11766 -      09:29 pts/2    00:00:00 ./TestApp_type1_noLttng 50000 np
 S root     21655 13837  0  80   0 -  5696 -      09:44 pts/2    00:00:00 lttng enable-event com_ericsson_cba_trace:trace_domain_event -s feb29_ses2 -u
 S root     21657     1  0  80   0 - 17985 futex_ 09:44 pts/2    00:00:00 lttng-consumerd --quiet -u --consumerd-cmd-sock /var/run/lttng/ustconsumerd64/command --consumerd-err-sock /var/run/lttng/ustconsumerd64/error
 S root     21752 13837  0  80   0 -  5696 -      09:56 pts/2    00:00:00 lttng enable-event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB -s feb29_ses2 -u
 S root     21753     1  0  80   0 - 17985 futex_ 09:56 pts/2    00:00:00 lttng-consumerd --quiet -u --consumerd-cmd-sock /var/run/lttng/ustconsumerd64/command --consumerd-err-sock /var/run/lttng/ustconsumerd64/error
 S root     21917 13837  0  80   0 - 51359 futex_ 10:31 pts/2    00:00:00 lttng-sessiond -vvv
 S root     21936 21917  0  80   0 - 17985 futex_ 10:32 pts/2    00:00:00 lttng-consumerd --quiet -u --consumerd-cmd-sock /var/run/lttng/ustconsumerd64/command --consumerd-err-sock /var/run/lttng/ustconsumerd64/error
 S root     21941 13837  0  80   0 -   979 pipe_w 10:32 pts/2    00:00:00 egrep -i ltt|test
       SC-1:/usr/bin #    lttng list $MYSESSION
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 13 [in process_client_msg() at main.c:3166]
       DEBUG1: Counting number of available session for UID 0 GID 0 [in lttng_sessions_count() at main.c:1916]
       DEBUG1: Getting all available session for UID 0 GID 0 [in list_lttng_sessions() at main.c:1943]
       DEBUG1: Sending response (size: 4388, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       Tracing session feb29_ses3: [inactive]
           Trace path: /tmp/tdlt/feb29_ses3
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 11 [in process_client_msg() at main.c:3166]
       DEBUG1: Getting session feb29_ses3 by name [in process_client_msg() at main.c:3217]
       DEBUG2: Trying to find session by name feb29_ses3 [in session_find_by_name() at session.c:128]
       DEBUG3: Listing domains found UST global domain [in cmd_list_domains() at main.c:3045]
       DEBUG1: Sending response (size: 324, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       === Domain: UST global ===
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 10 [in process_client_msg() at main.c:3166]
       DEBUG1: Getting session feb29_ses3 by name [in process_client_msg() at main.c:3217]
       DEBUG2: Trying to find session by name feb29_ses3 [in session_find_by_name() at session.c:128]
       DEBUG3: Number of UST global channels 1 [in cmd_list_channels() at main.c:3092]
       DEBUG1: Listing channels for session feb29_ses3 [in list_lttng_channels() at main.c:1973]
       DEBUG1: Sending response (size: 624, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       Channels:
       -------------
       - channel0: [enabled]
           Attributes:
             overwrite mode: 0
             subbufers size: 4096
             number of subbufers: 4
             switch timer interval: 0
             read timer interval: 200
             output: mmap()
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 12 [in process_client_msg() at main.c:3166]
       DEBUG1: Getting session feb29_ses3 by name [in process_client_msg() at main.c:3217]
       DEBUG2: Trying to find session by name feb29_ses3 [in session_find_by_name() at session.c:128]
       DEBUG1: Listing UST global events for channel channel0 [in list_lttng_ust_global_events() at main.c:2033]
       DEBUG3: Listing UST global 1 events [in list_lttng_ust_global_events() at main.c:2053]
       DEBUG1: Sending response (size: 600, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
           Events:
             com_ericsson_cba_trace:trace_domain_event (type: tracepoint) [enabled]
       SC-1:/usr/bin #    date; lttng start
       Wed Feb 29 10:34:24 EST 2012
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 16 [in process_client_msg() at main.c:3166]
       DEBUG1: Getting session feb29_ses3 by name [in process_client_msg() at main.c:3217]
       DEBUG2: Trying to find session by name feb29_ses3 [in session_find_by_name() at session.c:128]
       DEBUG1: Starting all UST traces [in ust_app_start_trace_all() at ust-app.c:2144]
       DEBUG1: Sending response (size: 16, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       Tracing started for session feb29_ses3
       SC-1:/usr/bin # lttng list
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 13 [in process_client_msg() at main.c:3166]
       DEBUG1: Counting number of available session for UID 0 GID 0 [in lttng_sessions_count() at main.c:1916]
       DEBUG1: Getting all available session for UID 0 GID 0 [in list_lttng_sessions() at main.c:1943]
       DEBUG1: Sending response (size: 4388, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       Available tracing sessions:
 ) feb29_ses3 (/tmp/tdlt/feb29_ses3) [active]
       Use lttng list <session_name> for more details
       SC-1:/usr/bin #    date; lttng stop
       Wed Feb 29 10:34:42 EST 2012
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 17 [in process_client_msg() at main.c:3166]
       DEBUG1: Getting session feb29_ses3 by name [in process_client_msg() at main.c:3217]
       DEBUG2: Trying to find session by name feb29_ses3 [in session_find_by_name() at session.c:128]
       DEBUG1: Stopping all UST traces [in ust_app_stop_trace_all() at ust-app.c:2170]
       DEBUG1: Sending response (size: 16, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       Tracing stopped for session feb29_ses3
       SC-1:/usr/bin #
       SC-1:/usr/bin # lttng listps -elf |egrep -i 'ltt|test'lttng list
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 13 [in process_client_msg() at main.c:3166]
       DEBUG1: Counting number of available session for UID 0 GID 0 [in lttng_sessions_count() at main.c:1916]
       DEBUG1: Getting all available session for UID 0 GID 0 [in list_lttng_sessions() at main.c:1943]
       DEBUG1: Sending response (size: 4388, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       Available tracing sessions:
 ) feb29_ses3 (/tmp/tdlt/feb29_ses3) [inactive]
       Use lttng list <session_name> for more details
       SC-1:/usr/bin #
       SC-1:/usr/bin # dir -R /tmp/tdlt/feb29_ses3
       /tmp/tdlt/feb29_ses3:
       total 4
       drwxrwx--- 2 root root 4096 Feb 29 10:32 ust
       /tmp/tdlt/feb29_ses3/ust:
       total 0
       SC-1:/usr/bin # lttng list -u
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 14 [in process_client_msg() at main.c:3166]
       DEBUG2: UST app list events done (0 events) [in ust_app_list_events() at ust-app.c:1443]
       DEBUG1: Sending response (size: 16, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       UST events:
       -------------
       None
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       (reverse-i-search)`': p': dir -R /tmp/tdlt/feb29_ses3s': ps -elf |egrep -i 'ltt|test'
       (reverse-i-search)`ps':
       SC-1:/usr/bin #
 S root     21550 13837  0  80   0 -  2788 wait   09:29 pts/2    00:00:00 /bin/sh /usr/bin/TestApp_type1_run_withLttng 50000 np
 S root     21551 21550  0  80   0 - 11766 -      09:29 pts/2    00:00:00 ./TestApp_type1_noLttng 50000 np
 S root     21655 13837  0  80   0 -  5696 -      09:44 pts/2    00:00:00 lttng enable-event com_ericsson_cba_trace:trace_domain_event -s feb29_ses2 -u
 S root     21657     1  0  80   0 - 17985 futex_ 09:44 pts/2    00:00:00 lttng-consumerd --quiet -u --consumerd-cmd-sock /var/run/lttng/ustconsumerd64/command --consumerd-err-sock /var/run/lttng/ustconsumerd64/error
 S root     21752 13837  0  80   0 -  5696 -      09:56 pts/2    00:00:00 lttng enable-event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB -s feb29_ses2 -u
 S root     21753     1  0  80   0 - 17985 futex_ 09:56 pts/2    00:00:00 lttng-consumerd --quiet -u --consumerd-cmd-sock /var/run/lttng/ustconsumerd64/command --consumerd-err-sock /var/run/lttng/ustconsumerd64/error
 S root     21917 13837  0  80   0 - 51359 futex_ 10:31 pts/2    00:00:00 lttng-sessiond -vvv
 S root     21936 21917  0  80   0 - 17985 futex_ 10:32 pts/2    00:00:00 lttng-consumerd --quiet -u --consumerd-cmd-sock /var/run/lttng/ustconsumerd64/command --consumerd-err-sock /var/run/lttng/ustconsumerd64/error
 S root     22012 13837  0  80   0 -   979 pipe_w 10:53 pts/2    00:00:00 egrep -i ltt|test
       SC-1:/usr/bin #
       SC-1:/usr/bin #
       SC-1:/usr/bin # dir |grep TestApp_
       -rwxr-xr-x 1 root  root      73105 Feb 28 14:32 TestApp_Fork1_StaticString
       -rwxr-xr-x 1 root  root     144142 Feb 27 22:48 TestApp_Fork1_byDXsysRoot
       -rwxr-xr-x 1 root  root      73105 Feb 27 22:36 TestApp_Fork1_byTraceEA
       -rwxr-xr-x 1 root  root      73194 Feb 28 18:27 TestApp_Fork1_fixed
       -rwxr-xr-x 1 root  root      73194 Feb 28 17:37 TestApp_Fork1_new_header
       -rwxr-xr-x 1 root  root      73194 Feb 28 17:46 TestApp_Fork1_new_header_try2
       -rwxr-xr-x 1 root  root      81132 Feb 28 13:20 TestApp_Fork1_noLttng
       -rwxr-xr-x 1 root  root      73105 Feb 28 14:38 TestApp_Fork1_noString
       -rwxr-xr-x 1 root  root      73105 Feb 28 14:41 TestApp_Fork1_noTracePoint
       -rwxr-xr-x 1 root  root        112 Feb 28 13:20 TestApp_Fork1_run_withLttng
       -rwxr-xr-x 1 root  root      73105 Feb 28 15:21 TestApp_Fork1_tp_in_bothProc
       -rwxr-xr-x 1 root  root      73105 Feb 28 14:17 TestApp_Fork1_try1
       drwxr-xr-x 2 root  root       4096 Feb 27 22:33 TestApp_previous
       -rwxr-xr-x 1 root  root      71724 Feb 28 10:41 TestApp_type1_noLttng
       -rwxr-xr-x 1 root  root         91 Feb 28 10:41 TestApp_type1_run_withLttng
       SC-1:/usr/bin #
       SC-1:/usr/bin # TestApp_Fork1_fixed 3000 np &
       [6] 22019
       SC-1:/usr/bin # DEBUG1: UST registration received with pid:22019 ppid:13837 uid:0 gid:0 sock:18 name:TestApp_Fork1_f (version 2.0) [in thread_registration_apps() at main.c:1392]
       DEBUG1: Futex n to 1 wake done [in futex_nto1_wake() at futex.c:101]
       DEBUG1: Accepting application registration [in thread_registration_apps() at main.c:1322]
       DEBUG1: Futex n to 1 wait done [in futex_nto1_wait() at futex.c:88]
       DEBUG1: Futex n to 1 prepare done [in futex_nto1_prepare() at futex.c:74]
       DEBUG1: Dispatching UST registration pid:22019 ppid:13837 uid:0 gid:0 sock:18 name:TestApp_Fork1_f (version 2.0) [in thread_dispatch_ust_registration() at main.c:1245]
       DEBUG1: Woken up but nothing in the UST command queue [in thread_dispatch_ust_registration() at main.c:1233]
       DEBUG3: Created hashtable size 4 at 0x6482c0 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG1: App registered with pid:22019 ppid:13837 uid:0 gid:0 sock:18 name:TestApp_Fork1_f (version 2.0) [in ust_app_register() at ust-app.c:1317]
       DEBUG2: UST app PID 22019 is compatible with major version 2 (supporting <= 2) [in ust_app_validate_version() at ust-app.c:2562]
       DEBUG2: UST app global update for app sock 18 for session id 1 [in ust_app_global_update() at ust-app.c:2232]
       DEBUG2: UST app pid: 22019 session id 1 not found, creating it [in create_ust_app_session() at ust-app.c:855]
       DEBUG3: Created hashtable size 4 at 0x6495c0 of type 0 [in lttng_ht_new() at hashtable.c:96]
       DEBUG2: Shadow copy of session handle -1 [in shadow_copy_session() at ust-app.c:766]
       DEBUG2: Channel channel0 not found on shadow session copy, creating it [in shadow_copy_session() at ust-app.c:795]
       DEBUG3: Created hashtable size 4 at 0x64a610 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: Created hashtable size 4 at 0x64a8b0 of type 0 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: UST app channel channel0 allocated [in alloc_ust_app_channel() at ust-app.c:281]
       DEBUG2: UST app shadow copy of channel channel0 started [in shadow_copy_channel() at ust-app.c:706]
       DEBUG2: UST event com_ericsson_cba_trace:trace_domain_event not found on shadow copy channel [in shadow_copy_channel() at ust-app.c:733]
       DEBUG3: Created hashtable size 4 at 0x64aee0 of type 1 [in lttng_ht_new() at hashtable.c:96]
       DEBUG3: UST app event com_ericsson_cba_trace:trace_domain_event allocated [in alloc_ust_app_event() at ust-app.c:316]
       DEBUG3: UST app shadow copy of channel channel0 done [in shadow_copy_channel() at ust-app.c:743]
       DEBUG2: UST app session created successfully with handle 1 [in create_ust_app_session() at ust-app.c:879]
       DEBUG2: UST app channel channel0 created successfully for pid:22019 and sock:18 [in create_ust_channel() at ust-app.c:593]
       DEBUG2: UST app event com_ericsson_cba_trace:trace_domain_event created successfully for pid:22019 [in create_ust_event() at ust-app.c:632]
       DEBUG1: Apps with sock 18 added to poll set [in thread_manage_apps() at main.c:1176]
       DEBUG1: Apps thread polling on 3 fds [in thread_manage_apps() at main.c:1098]
       SC-1:/usr/bin # lttng list -u
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Nothing recv() from client... continuing [in thread_manage_clients() at main.c:3703]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       DEBUG1: Wait for client response [in thread_manage_clients() at main.c:3664]
       DEBUG1: Receiving data from client ... [in thread_manage_clients() at main.c:3699]
       DEBUG1: Processing client command 14 [in process_client_msg() at main.c:3166]
       DEBUG2: UST app list events done (15 events) [in ust_app_list_events() at ust-app.c:1443]
       DEBUG1: Sending response (size: 8776, retcode: Success) [in thread_manage_clients() at main.c:3733]
       DEBUG1: Clean command context structure [in clean_command_ctx() at main.c:457]
       DEBUG1: Accepting client command ... [in thread_manage_clients() at main.c:3627]
       UST events:
       -------------
       PID: 22019 - Name: TestApp_Fork1_fixed
             com_ericsson_cba_testapp_fork_parent_hightraf:KiloPerSec (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_testapp_fork_parent_hightraf:HundredPerSec (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_testapp_fork_parent_lowtraf:TenPerSecB (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_testapp_fork_parent_lowtraf:TenPerSecA (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_testapp_fork_parent_lowtraf:OnePerSecB (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_testapp_fork_parent_lowtraf:OnePerSecA (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_testapp_fork_child_hightraf:KiloPerSec (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_testapp_fork_child_hightraf:HundredPerSec (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_testapp_fork_child_lowtraf:TenPerSecB (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_testapp_fork_child_lowtraf:TenPerSecA (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_testapp_fork_child_lowtraf:OnePerSecB (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_testapp_fork_child_lowtraf:OnePerSecA (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace_testapp:testapp_domain_event (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba_trace:trace_domain_event (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
             com_ericsson_cba:cba_domain_event (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint)
       SC-1:/usr/bin #

(1-1/1)

Project

General

Profile

LTTng » LTTng-tools

Feature #137 » Target_feb29.log