[SC-1:Xen43 Wed Mar 27 17:27:21/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:27:21/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:27:21/cluster/temp/log] # export TC=ses13 [SC-1:Xen43 Wed Mar 27 17:27:34/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:27:34/cluster/temp/log] # pkill TestApp lttng list -u ps -ef |egrep 'lttng' lttng-relayd -C tcp://0.0.0.0:53000 -D tcp://0.0.0.0:53001 -o /cluster/temp/log/$TC & lttng create $TC -U net://192.168.0.1:53000:53001/./ lttng list sleep 1 lttng enable-channel chan1 -u --buffers-uid [SC-1:Xen43 Wed Mar 27 17:27:34/cluster/temp/log] # lttng list -u sleep 1 lttng enable-event -s $TC -u -c chan1 com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB UST events: ------------- None [SC-1:Xen43 Wed Mar 27 17:27:34/cluster/temp/log] # ps -ef |egrep 'lttng' sleep 1 lttng list $TC sleep 1 lttng start; sleep 1 lttng list $TC sleep 1 netstat -etanp | head -n 2 ; netstat -etanp |egrep 'lttng' sleep 1 lttng list -u root 29373 1 0 17:27 ? 00:00:00 lttng-sessiond -vvv --verbose-consumer root 29442 4479 0 17:27 pts/1 00:00:00 egrep lttng [SC-1:Xen43 Wed Mar 27 17:27:34/cluster/temp/log] # lttng-relayd -C tcp://0.0.0.0:53000 -D tcp://0.0.0.0:53001 -o /cluster/temp/log/$TC & [5] 29443 [SC-1:Xen43 Wed Mar 27 17:27:34/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:27:34/cluster/temp/log] # lttng create $TC -U net://192.168.0.1:53000:53001/./ sleep 1 LTTNG_UST_DEBUG=1 /home/test_apps/TestApp_type1 4444 np & Session ses13 created. Traces will be written in net://192.168.0.1:53000:53001/./ [SC-1:Xen43 Wed Mar 27 17:27:34/cluster/temp/log] # lttng list sleep 1 lttng list -u Available tracing sessions: 1) ses13 (net://192.168.0.1:53000/./ [data: 5343]) [inactive] Use lttng list for more details dir -R /cluster/temp/log/$TC [SC-1:Xen43 Wed Mar 27 17:27:34/cluster/temp/log] # sleep 1 sleep 5 dir -R /cluster/temp/log/$TC [SC-1:Xen43 Wed Mar 27 17:27:35/cluster/temp/log] # lttng enable-channel chan1 -u --buffers-uid UST channel chan1 enabled for session ses13 [SC-1:Xen43 Wed Mar 27 17:27:36/cluster/temp/log] # sleep 1 [SC-1:Xen43 Wed Mar 27 17:27:37/cluster/temp/log] # lttng enable-event -s $TC -u -c chan1 com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB UST event com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB created in channel chan1 [SC-1:Xen43 Wed Mar 27 17:27:37/cluster/temp/log] # sleep 1 [SC-1:Xen43 Wed Mar 27 17:27:38/cluster/temp/log] # lttng list $TC Tracing session ses13: [inactive] Trace path: net://192.168.0.1:53000/./ [data: 53001] === Domain: UST global === Channels: ------------- - chan1: [enabled] Attributes: overwrite mode: 0 subbufers size: 4096 number of subbufers: 4 switch timer interval: 0 read timer interval: 200000 output: mmap() Events: com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB (type: tracepoint) [enabled] [SC-1:Xen43 Wed Mar 27 17:27:38/cluster/temp/log] # sleep 1 [SC-1:Xen43 Wed Mar 27 17:27:39/cluster/temp/log] # lttng start; Tracing started for session ses13 [SC-1:Xen43 Wed Mar 27 17:27:39/cluster/temp/log] # sleep 1 [SC-1:Xen43 Wed Mar 27 17:27:40/cluster/temp/log] # lttng list $TC Tracing session ses13: [active] Trace path: net://192.168.0.1:53000/./ [data: 53001] === Domain: UST global === Channels: ------------- - chan1: [enabled] Attributes: overwrite mode: 0 subbufers size: 4096 number of subbufers: 4 switch timer interval: 0 read timer interval: 200000 output: mmap() Events: com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB (type: tracepoint) [enabled] [SC-1:Xen43 Wed Mar 27 17:27:40/cluster/temp/log] # sleep 1 [SC-1:Xen43 Wed Mar 27 17:27:41/cluster/temp/log] # netstat -etanp | head -n 2 ; netstat -etanp |egrep 'lttng' Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State User Inode PID/Program name tcp 0 0 0.0.0.0:53000 0.0.0.0:* LISTEN 0 313032017 29443/lttng-relayd tcp 0 0 0.0.0.0:53001 0.0.0.0:* LISTEN 0 313032018 29443/lttng-relayd tcp 0 0 192.168.0.1:48226 192.168.0.1:53000 ESTABLISHED 0 313032028 29453/lttng-consume tcp 0 0 192.168.0.1:53000 192.168.0.1:48226 ESTABLISHED 0 313032029 29443/lttng-relayd tcp 0 0 192.168.0.1:53001 192.168.0.1:42933 ESTABLISHED 0 313032030 29443/lttng-relayd tcp 0 0 192.168.0.1:42933 192.168.0.1:53001 ESTABLISHED 0 313031242 29453/lttng-consume [SC-1:Xen43 Wed Mar 27 17:27:41/cluster/temp/log] # sleep 1 [SC-1:Xen43 Wed Mar 27 17:27:42/cluster/temp/log] # lttng list -u UST events: ------------- None [SC-1:Xen43 Wed Mar 27 17:27:42/cluster/temp/log] # sleep 1 [SC-1:Xen43 Wed Mar 27 17:27:43/cluster/temp/log] # LTTNG_UST_DEBUG=1 /home/test_apps/TestApp_type1 4444 np & [6] 29497 [SC-1:Xen43 Wed Mar 27 17:27:43/cluster/temp/log] # sleep 1 libust[29497/29497]: LTT : ltt ring buffer client "relay-metadata-mmap" init (in lttng_ring_buffer_metadata_client_init() at lttng-ring-buffer-metadata-client.h:313) libust[29497/29497]: LTT : ltt ring buffer client "relay-overwrite-mmap" init (in lttng_ring_buffer_client_overwrite_init() at lttng-ring-buffer-client.h:562) libust[29497/29497]: LTT : ltt ring buffer client "relay-overwrite-rt-mmap" init (in lttng_ring_buffer_client_overwrite_rt_init() at lttng-ring-buffer-client.h:562) libust[29497/29497]: LTT : ltt ring buffer client "relay-discard-mmap" init (in lttng_ring_buffer_client_discard_init() at lttng-ring-buffer-client.h:562) libust[29497/29497]: LTT : ltt ring buffer client "relay-discard-rt-mmap" init (in lttng_ring_buffer_client_discard_rt_init() at lttng-ring-buffer-client.h:562) libust[29497/29500]: Info: sessiond not accepting connections to local apps socket (in ust_listener_thread() at lttng-ust-comm.c:939) libust[29497/29499]: Message Received "Get Tracer Version", Handle "root" (0) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29500]: Waiting for local apps sessiond (in wait_for_sessiond() at lttng-ust-comm.c:849) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "Create Session", Handle "root" (0) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 1 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "Create Channel", Handle "session" (1) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: channel data received (in handle_message() at lttng-ust-comm.c:485) libust[29497/29499]: Return value: 2 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "Create Stream", Handle "channel" (2) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "Create Stream", Handle "channel" (2) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "Create Stream", Handle "channel" (2) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "Create Stream", Handle "channel" (2) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "Create Event", Handle "channel" (2) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 3 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "Enable", Handle "session" (1) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Sent register channel notification: chan_id 0, header_type 1 (in ustcomm_register_channel() at lttng-ust-comm.c:1053) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "Wait for Quiescent State", Handle "root" (0) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "Registration Done", Handle "root" (0) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29497]: adding probe com_ericsson_cba_trace_testapp_hightraf containing 3 events to lazy registration list (in lttng_probe_register() at lttng-probes.c:190) libust[29497/29497]: just registered probe com_ericsson_cba_trace_testapp_hightraf containing 3 events (in lttng_lazy_probe_register() at lttng-probes.c:116) libust[29497/29497]: Registered event probe "com_ericsson_cba_trace_testapp_hightraf:HundredPerSec" with signature "const char*, my_Time, int, OnePs , int, TenPs , int, HundredPs, float , unit_float, const char *, unit_string" (in lttng_lazy_probe_register() at lttng-probes.c:126) libust[29497/29497]: Registered event probe "com_ericsson_cba_trace_testapp_hightraf:KiloPerSec" with signature "const char*, my_Time, int, OnePs , int, TenPs , int, HundredPs, int, KiloPs, float , unit_float, const char *, unit_string" (in lttng_lazy_probe_register() at lttng-probes.c:126) libust[29497/29497]: Registered event probe "com_ericsson_cba_trace_testapp_hightraf:TenKiloPerSec" with signature "const char*, my_Time, int, OnePs , int, TenPs , int, HundredPs, int, KiloPs, int, TenKiloPs, float , unit_float, const char *, unit_string" (in lttng_lazy_probe_register() at lttng-probes.c:126) libust[29497/29497]: adding probe com_ericsson_cba_trace_testapp_lowtraf containing 4 events to lazy registration list (in lttng_probe_register() at lttng-probes.c:190) libust[29497/29497]: just registered probe com_ericsson_cba_trace_testapp_lowtraf containing 4 events (in lttng_lazy_probe_register() at lttng-probes.c:116) libust[29497/29497]: Registered event probe "com_ericsson_cba_trace_testapp_lowtraf:OnePerSecA" with signature "const char *, my_Time, int , OnePs" (in lttng_lazy_probe_register() at lttng-probes.c:126) libust[29497/29497]: Sent register event notification for name "com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB": ret_code 0, event_id 0 (in ustcomm_register_event() at lttng-ust-comm.c:948) liblttng_ust_tracepoint[29497/29497]: Registering probe to tracepoint com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB (in __tracepoint_probe_register() at tracepoint.c:429) libust[29497/29497]: Registered event probe "com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB" with signature "const char*, my_Time" (in lttng_lazy_probe_register() at lttng-probes.c:126) libust[29497/29497]: Registered event probe "com_ericsson_cba_trace_testapp_lowtraf:TenPerSecA" with signature "const char *, my_Time, int , OnePs, int , TenPs, float , unit_float, const char *, unit_string, const char *, stringAllSigns" (in lttng_lazy_probe_register() at lttng-probes.c:126) libust[29497/29497]: Registered event probe "com_ericsson_cba_trace_testapp_lowtraf:TenPerSecB" with signature "const char *, my_Time" (in lttng_lazy_probe_register() at lttng-probes.c:126) libust[29497/29497]: adding probe com_ericsson_cba containing 2 events to lazy registration list (in lttng_probe_register() at lttng-probes.c:190) libust[29497/29497]: just registered probe com_ericsson_cba containing 2 events (in lttng_lazy_probe_register() at lttng-probes.c:116) libust[29497/29497]: Registered event probe "com_ericsson_cba:cba_domain_event" with signature "const char *, my_Time, int, OnePs, const char*, my_ProgramInfo, int, incrementMe" (in lttng_lazy_probe_register() at lttng-probes.c:126) libust[29497/29497]: Registered event probe "com_ericsson_cba:AfterAllLoops" with signature "int, incrementMe" (in lttng_lazy_probe_register() at lttng-probes.c:126) libust[29497/29497]: adding probe com_ericsson_cba_trace containing 1 events to lazy registration list (in lttng_probe_register() at lttng-probes.c:190) libust[29497/29497]: just registered probe com_ericsson_cba_trace containing 1 events (in lttng_lazy_probe_register() at lttng-probes.c:116) libust[29497/29497]: Registered event probe "com_ericsson_cba_trace:trace_domain_event" with signature "const char *, my_Time, int, OnePs , const char*, my_ProgramInfo, long *, My_LongArray, size_t, ArrayLength, char *, text, size_t, TextLength" (in lttng_lazy_probe_register() at lttng-probes.c:126) libust[29497/29497]: adding probe com_ericsson_cba_trace_testapp containing 2 events to lazy registration list (in lttng_probe_register() at lttng-probes.c:190) libust[29497/29497]: just registered probe com_ericsson_cba_trace_testapp containing 2 events (in lttng_lazy_probe_register() at lttng-probes.c:116) libust[29497/29497]: Registered event probe "com_ericsson_cba_trace_testapp:testapp_domain_event" with signature "const char *, my_Time, int, OnePs , const char*, my_ProgramInfo, float, Pi_Value" (in lttng_lazy_probe_register() at lttng-probes.c:126) libust[29497/29497]: Registered event probe "com_ericsson_cba_trace_testapp:pointer_to_structure_in_tracepoint" with signature "const char *, my_Time, p_subscriber, personA" (in lttng_lazy_probe_register() at lttng-probes.c:126) [SC-1:Xen43 Wed Mar 27 17:27:44/cluster/temp/log] # lttng list -u libust[29497/29499]: Message Received "Create Tracepoint List", Handle "root" (0) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 4 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (4) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (4) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (4) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (4) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (4) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (4) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (4) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (4) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (4) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (4) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (4) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (4) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (4) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: -1025 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) UST events: ------------- PID: 29497 - Name: /home/test_apps/TestApp_type1 com_ericsson_cba_trace_testapp_hightraf:TenKiloPerSec (loglevel: TRACE_DEBUG (14)) (type: tracepoint) com_ericsson_cba_trace_testapp_hightraf:KiloPerSec (loglevel: TRACE_DEBUG (14)) (type: tracepoint) com_ericsson_cba_trace_testapp_hightraf:HundredPerSec (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint) com_ericsson_cba_trace_testapp_lowtraf:TenPerSecB (loglevel: TRACE_DEBUG_UNIT (11)) (type: tracepoint) com_ericsson_cba_trace_testapp_lowtraf:TenPerSecA (loglevel: TRACE_DEBUG_MODULE (10)) (type: tracepoint) com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB (loglevel: TRACE_DEBUG_PROCESS (9)) (type: tracepoint) com_ericsson_cba_trace_testapp_lowtraf:OnePerSecA (loglevel: TRACE_DEBUG_PROGRAM (8)) (type: tracepoint) com_ericsson_cba:AfterAllLoops (loglevel: TRACE_ERR (3)) (type: tracepoint) com_ericsson_cba:cba_domain_event (loglevel: TRACE_ERR (3)) (type: tracepoint) com_ericsson_cba_trace:trace_domain_event (loglevel: TRACE_WARNING (4)) (type: tracepoint) com_ericsson_cba_trace_testapp:pointer_to_structure_in_tracepoint (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint) com_ericsson_cba_trace_testapp:testapp_domain_event (loglevel: TRACE_NOTICE (5)) (type: tracepoint) [SC-1:Xen43 Wed Mar 27 17:27:44/cluster/temp/log] # dir -R /cluster/temp/log/$TC /cluster/temp/log/ses13: total 4 drwxr-x--- 3 root root 4096 Mar 27 17:27 SC-1 /cluster/temp/log/ses13/SC-1: total 4 drwxr-x--- 3 root root 4096 Mar 27 17:27 ust /cluster/temp/log/ses13/SC-1/ust: total 4 drwxr-x--- 3 root root 4096 Mar 27 17:27 uid /cluster/temp/log/ses13/SC-1/ust/uid: total 4 drwxr-x--- 3 root root 4096 Mar 27 17:27 0 /cluster/temp/log/ses13/SC-1/ust/uid/0: total 4 drwxr-x--- 2 root root 4096 Mar 27 17:27 64-bit /cluster/temp/log/ses13/SC-1/ust/uid/0/64-bit: total 0 -rwxr-xr-x 1 root root 0 Mar 27 17:27 metadata -rwxr-xr-x 1 root root 0 Mar 27 17:27 chan1_3 -rwxr-xr-x 1 root root 0 Mar 27 17:27 chan1_2 -rwxr-xr-x 1 root root 0 Mar 27 17:27 chan1_1 -rwxr-xr-x 1 root root 0 Mar 27 17:27 chan1_0 [SC-1:Xen43 Wed Mar 27 17:27:44/cluster/temp/log] # sleep 5 [SC-1:Xen43 Wed Mar 27 17:27:49/cluster/temp/log] # dir -R /cluster/temp/log/$TC /cluster/temp/log/ses13: total 4 drwxr-x--- 3 root root 4096 Mar 27 17:27 SC-1 /cluster/temp/log/ses13/SC-1: total 4 drwxr-x--- 3 root root 4096 Mar 27 17:27 ust /cluster/temp/log/ses13/SC-1/ust: total 4 drwxr-x--- 3 root root 4096 Mar 27 17:27 uid /cluster/temp/log/ses13/SC-1/ust/uid: total 4 drwxr-x--- 3 root root 4096 Mar 27 17:27 0 /cluster/temp/log/ses13/SC-1/ust/uid/0: total 4 drwxr-x--- 2 root root 4096 Mar 27 17:27 64-bit /cluster/temp/log/ses13/SC-1/ust/uid/0/64-bit: total 0 -rwxr-xr-x 1 root root 0 Mar 27 17:27 metadata -rwxr-xr-x 1 root root 0 Mar 27 17:27 chan1_3 -rwxr-xr-x 1 root root 0 Mar 27 17:27 chan1_2 -rwxr-xr-x 1 root root 0 Mar 27 17:27 chan1_1 -rwxr-xr-x 1 root root 0 Mar 27 17:27 chan1_0 [SC-1:Xen43 Wed Mar 27 17:27:49/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:27:52/cluster/temp/log] # lttng list -u libust[29497/29499]: Message Received "Create Tracepoint List", Handle "root" (0) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 5 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (5) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (5) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (5) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (5) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (5) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (5) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (5) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (5) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (5) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (5) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (5) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (5) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "List Next Tracepoint", Handle "tp_list" (5) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: -1025 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) UST events: ------------- PID: 29497 - Name: /home/test_apps/TestApp_type1 com_ericsson_cba_trace_testapp_hightraf:TenKiloPerSec (loglevel: TRACE_DEBUG (14)) (type: tracepoint) com_ericsson_cba_trace_testapp_hightraf:KiloPerSec (loglevel: TRACE_DEBUG (14)) (type: tracepoint) com_ericsson_cba_trace_testapp_hightraf:HundredPerSec (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint) com_ericsson_cba_trace_testapp_lowtraf:TenPerSecB (loglevel: TRACE_DEBUG_UNIT (11)) (type: tracepoint) com_ericsson_cba_trace_testapp_lowtraf:TenPerSecA (loglevel: TRACE_DEBUG_MODULE (10)) (type: tracepoint) com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB (loglevel: TRACE_DEBUG_PROCESS (9)) (type: tracepoint) com_ericsson_cba_trace_testapp_lowtraf:OnePerSecA (loglevel: TRACE_DEBUG_PROGRAM (8)) (type: tracepoint) com_ericsson_cba:AfterAllLoops (loglevel: TRACE_ERR (3)) (type: tracepoint) com_ericsson_cba:cba_domain_event (loglevel: TRACE_ERR (3)) (type: tracepoint) com_ericsson_cba_trace:trace_domain_event (loglevel: TRACE_WARNING (4)) (type: tracepoint) com_ericsson_cba_trace_testapp:pointer_to_structure_in_tracepoint (loglevel: TRACE_DEBUG_LINE (13)) (type: tracepoint) com_ericsson_cba_trace_testapp:testapp_domain_event (loglevel: TRACE_NOTICE (5)) (type: tracepoint) [SC-1:Xen43 Wed Mar 27 17:28:00/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:28:04/cluster/temp/log] # lttng list Available tracing sessions: 1) ses13 (net://192.168.0.1:53000/./ [data: 53001]) [active] Use lttng list for more details [SC-1:Xen43 Wed Mar 27 17:28:06/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:28:08/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:28:08/cluster/temp/log] # dir ses13/SC-1/ust/uid/0/64-bit/ chan1_0 chan1_1 chan1_2 chan1_3 metadata [SC-1:Xen43 Wed Mar 27 17:28:08/cluster/temp/log] # dir ses13/SC-1/ust/uid/0/64-bit/ total 0 -rwxr-xr-x 1 root root 0 Mar 27 17:27 metadata -rwxr-xr-x 1 root root 0 Mar 27 17:27 chan1_3 -rwxr-xr-x 1 root root 0 Mar 27 17:27 chan1_2 -rwxr-xr-x 1 root root 0 Mar 27 17:27 chan1_1 -rwxr-xr-x 1 root root 0 Mar 27 17:27 chan1_0 [SC-1:Xen43 Wed Mar 27 17:28:13/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:28:15/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:28:15/cluster/temp/log] # lttng stop libust[29497/29499]: Message Received "Disable", Handle "session" (1) (in print_cmd() at lttng-ust-comm.c:216) liblttng_ust_tracepoint[29497/29499]: Un-registering probe from tracepoint com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB (in __tracepoint_probe_unregister() at tracepoint.c:474) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "Wait for Quiescent State", Handle "root" (0) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "Flush Buffer", Handle "channel" (2) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) Waiting for data availability Tracing stopped for session ses13 [SC-1:Xen43 Wed Mar 27 17:28:21/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:28:42/cluster/temp/log] # lttng list Available tracing sessions: 1) ses13 (net://192.168.0.1:53000/./ [data: 53001]) [inactive] Use lttng list for more details [SC-1:Xen43 Wed Mar 27 17:28:48/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:28:49/cluster/temp/log] # net Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State User Inode PID/Program name tcp 0 0 0.0.0.0:53000 0.0.0.0:* LISTEN 0 313032017 29443/lttng-relayd tcp 0 0 0.0.0.0:53001 0.0.0.0:* LISTEN 0 313032018 29443/lttng-relayd tcp 0 0 192.168.0.1:48226 192.168.0.1:53000 ESTABLISHED 0 313032028 29453/lttng-consume tcp 0 0 192.168.0.1:53000 192.168.0.1:48226 ESTABLISHED 0 313032029 29443/lttng-relayd tcp 0 0 192.168.0.1:53001 192.168.0.1:42933 ESTABLISHED 0 313032030 29443/lttng-relayd tcp 0 0 192.168.0.1:42933 192.168.0.1:53001 ESTABLISHED 0 313031242 29453/lttng-consume [SC-1:Xen43 Wed Mar 27 17:28:56/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:28:56/cluster/temp/log] # lttng destroy libust[29497/29499]: Message Received "Release", Handle "enabler" (3) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "Release", Handle "channel" (2) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "Release", Handle "session" (1) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "Wait for Quiescent State", Handle "root" (0) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) Session ses13 destroyed [SC-1:Xen43 Wed Mar 27 17:29:01/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:29:03/cluster/temp/log] # net Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State User Inode PID/Program name tcp 0 0 0.0.0.0:53000 0.0.0.0:* LISTEN 0 313032017 29443/lttng-relayd tcp 0 0 0.0.0.0:53001 0.0.0.0:* LISTEN 0 313032018 29443/lttng-relayd [SC-1:Xen43 Wed Mar 27 17:29:05/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:29:06/cluster/temp/log] # pkill relayd [5]- Done lttng-relayd -C tcp://0.0.0.0:53000 -D tcp://0.0.0.0:53001 -o /cluster/temp/log/$TC [SC-1:Xen43 Wed Mar 27 17:29:15/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:29:16/cluster/temp/log] # net Active Internet connections (servers and established) Proto Recv-Q Send-Q Local Address Foreign Address State User Inode PID/Program name [SC-1:Xen43 Wed Mar 27 17:29:21/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:29:22/cluster/temp/log] # lttng lisy Error: Undefined command [SC-1:Xen43 Wed Mar 27 17:32:20/cluster/temp/log] # lttng list Currently no available tracing session [SC-1:Xen43 Wed Mar 27 17:32:22/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:32:23/cluster/temp/log] # dir total 64 drwxr-x--- 3 root root 4096 Mar 26 17:54 ses1 drwxr-x--- 3 root root 4096 Mar 26 17:58 ses2 -rw-r--r-- 1 root root 1982 Mar 27 11:30 ses1.tar drwxr-x--- 3 root root 4096 Mar 27 12:44 ses3 drwxr-x--- 3 root root 4096 Mar 27 12:47 ses4 drwxr-x--- 3 root root 4096 Mar 27 13:03 ses5 drwxr-x--- 3 root root 4096 Mar 27 13:12 ses6 drwxr-x--- 3 root root 4096 Mar 27 13:33 ses8 drwxr-x--- 3 root root 4096 Mar 27 13:51 ses9 drwxr-x--- 3 root root 4096 Mar 27 15:07 ses10 drwxr-x--- 3 root root 4096 Mar 27 16:05 ses100 drwxr-x--- 3 root root 4096 Mar 27 16:08 ses101 -rwxr-xr-x 1 root root 1122 Mar 27 16:11 runme drwxr-x--- 3 root root 4096 Mar 27 16:11 ses102 drwxr-xr-x 2 root root 4096 Mar 27 17:27 Mar27_sessionDVerbose drwxr-x--- 3 root root 4096 Mar 27 17:27 ses13 [SC-1:Xen43 Wed Mar 27 17:32:25/cluster/temp/log] # babeltrace ses13 [SC-1:Xen43 Wed Mar 27 17:32:31/cluster/temp/log] # babeltrace ses13/SC-1/ust/uid/ [SC-1:Xen43 Wed Mar 27 17:32:33/cluster/temp/log] # babeltrace ses13/SC-1/ust/uid/0/ [SC-1:Xen43 Wed Mar 27 17:32:35/cluster/temp/log] # dir ses13/SC-1/ust/uid/0/64-bit/ chan1_0 chan1_1 chan1_2 chan1_3 metadata [SC-1:Xen43 Wed Mar 27 17:32:35/cluster/temp/log] # dir ses13/SC-1/ust/uid/0/64-bit/ total 40 -rwxr-xr-x 1 root root 8192 Mar 27 17:29 metadata -rwxr-xr-x 1 root root 8192 Mar 27 17:29 chan1_3 -rwxr-xr-x 1 root root 8192 Mar 27 17:29 chan1_2 -rwxr-xr-x 1 root root 8192 Mar 27 17:29 chan1_1 -rwxr-xr-x 1 root root 8192 Mar 27 17:29 chan1_0 [SC-1:Xen43 Wed Mar 27 17:32:41/cluster/temp/log] # more ses13/SC-1/ust/uid/0/64-bit/metadata WÑuìèóÁÕ1³ààU X typealias integer { size = 16; align = 8; signed = false; } := uint16_t; typealias integer { size = 32; align = 8; signed = false; } := uint32_t; typealias integer { size = 64; align = 8; signed = false; } := uint64_t; typealias integer { size = 64; align = 8; signed = false; } := unsigned long; typealias integer { size = 5; align = 1; signed = false; } := uint5_t; typealias integer { size = 27; align = 1; signed = false; } := uint27_t; trace { major = 1; minor = 8; uuid = "ece8f3c1-d51b-4231-82b3-e0e0550b580b"; byte_order = le; packet.header := struct { uint32_t magic; uint8_t uuid[16]; uint32_t stream_id; }; }; env { hostname = "SC-1"; domain = "ust"; tracer_name = "lttng-ust"; tracer_major = 2; tracer_minor = 1; tracer_patchlevel = 0; vpid = 29497; procname = "TestApp_type1"; }; clock { name = monotonic; uuid = "7c002362-f7ce-4efe-a709-602ba5f131fb"; description = "Monotonic Clock"; freq = 1000000000; /* Frequency, in Hz */ /* clock value offset from Epoch is: offset * (1/freq) */ offset = 1362003185089525637; }; typealias integer { size = 27; align = 1; signed = false; map = clock.monotonic.value; } := uint27_clock_monotonic_t; typealias integer { size = 32; align = 8; signed = false; map = clock.monotonic.value; } := uint32_clock_monotonic_t; typealias integer { size = 64; align = 8; signed = false; map = clock.monotonic.value; } := uint64_clock_monotonic_t; struct packet_context { uint64_clock_monotonic_t timestamp_begin; uint64_clock_monotonic_t timestamp_end; uint64_t content_size; uint64_t packet_size; unsigned long events_discarded; uint32_t cpu_id; }; struct event_header_compact { enum : uint5_t { compact = 0 ... 30, extended = 31 } id; variant { struct { uint27_clock_monotonic_t timestamp; } compact; struct { uint32_t id; uint64_clock_monotonic_t timestamp; } extended; } v; } align(8); struct event_header_large { enum : uint16_t { compact = 0 ... 65534, extended = 65535 } id; variant { struct { uint32_clock_monotonic_t timestamp; } compact; struct { uint32_t id; uint64_clock_monotonic_t timestamp; } extended; } v; } align(8); stream { id = 0; event.header := struct event_header_compact; packet.context := struct packet_context; }; event { name = "com_ericsson_cba_trace_testapp_lowtraf:OnePerSecB"; id = 0; stream_id = 0; loglevel = 9; fields := struct { string _my_Time; }; }; [SC-1:Xen43 Wed Mar 27 17:32:54/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:32:55/cluster/temp/log] # pkill sessiond [SC-1:Xen43 Wed Mar 27 17:33:01/cluster/temp/log] # libust[29497/29499]: global lttng-sessiond has performed an orderly shutdown (in ust_listener_thread() at lttng-ust-comm.c:1032) libust[29497/29499]: Waiting for global apps sessiond (in wait_for_sessiond() at lttng-ust-comm.c:849) libust[29497/29499]: Message Received "Get Tracer Version", Handle "root" (0) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) libust[29497/29499]: Message Received "Registration Done", Handle "root" (0) (in print_cmd() at lttng-ust-comm.c:216) libust[29497/29499]: Return value: 0 (in handle_message() at lttng-ust-comm.c:589) libust[29497/29499]: message successfully sent (in send_reply() at lttng-ust-comm.c:331) [SC-1:Xen43 Wed Mar 27 17:33:11/cluster/temp/log] # pkill TestApp [SC-1:Xen43 Wed Mar 27 17:33:15/cluster/temp/log] # [6]+ Terminated LTTNG_UST_DEBUG=1 /home/test_apps/TestApp_type1 4444 np [SC-1:Xen43 Wed Mar 27 17:33:16/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:33:16/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:33:16/cluster/temp/log] # [SC-1:Xen43 Wed Mar 27 17:33:17/cluster/temp/log] # cd Mar27_sessionDVerbose/ [SC-1:Xen43 Wed Mar 27 17:33:23/cluster/temp/log/Mar27_sessionDVerbose] # dir total 8372 -rwxr-xr-x 1 root root 178 Mar 27 13:44 TimeMe -rw-r--r-- 1 root root 195232 Mar 27 13:51 combined_Wed_Mar_27_13_51_25_EDT_2013.log -rw-r--r-- 1 root root 144489 Mar 27 13:53 combined_Wed_Mar_27_13_53_54_EDT_2013.log -rw-r--r-- 1 root root 6774988 Mar 27 17:23 combined_Wed_Mar_27_17_23_47_EDT_2013.log -rw-r--r-- 1 root root 119974 Mar 27 17:27 combined_Wed_Mar_27_17_27_15_EDT_2013.log -rw-r--r-- 1 root root 1268468 Mar 27 17:33 combined_Wed_Mar_27_17_33_02_EDT_2013.log -rw-r--r-- 1 root root 20943 Mar 27 17:33 combined.log [SC-1:Xen43 Wed Mar 27 17:33:24/cluster/temp/log/Mar27_sessionDVerbose] # scp combined_Wed_Mar_27_17_33_02_EDT_2013.log lmctdlt@10.120.20175:/tmp/tdlt/ ^C[SC-1:Xen43 Wed Mar 27 17:33:55/cluster/temp/log/Mar27_sessionDVerbose] # scp combined_Wed_Mar_27_17_33_02_EDT_2013.log lmctdlt@10.120.20.175:/tmp/tdlt/ Enter NALA Windows password: combined_Wed_Mar_27_17_33_02_EDT_2013.log 100% 1239KB 1.2MB/s 00:00 [SC-1:Xen43 Wed Mar 27 17:34:07/cluster/temp/log/Mar27_sessionDVerbose] # [SC-1:Xen43 Wed Mar 27 17:34:08/cluster/temp/log/Mar27_sessionDVerbose] # [SC-1:Xen43 Wed Mar 27 17:34:08/cluster/temp/log/Mar27_sessionDVerbose] #