Project

General

Profile

Bug #764 » sessiond-logs.txt

Julien Desfossez, 04/21/2014 01:36 PM

 
DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925)
DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970)
DEBUG1 [23936/24037]: Nothing recv() from client... continuing (in thread_manage_clients() at main.c:3974)
DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675)
DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883)
DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925)
DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970)
DEBUG1 [23936/24037]: Processing client command 8 (in process_client_msg() at main.c:2704)
DEBUG1 [23936/24037]: Waiting for 1 URIs from client ... (in process_client_msg() at main.c:3305)
DEBUG2 [23936/24037]: Trying to find session by name auto-20140421-133146 (in session_find_by_name() at session.c:169)
DEBUG3 [23936/24037]: Created hashtable size 4 at 0x7ff0a8003ec0 of type 1 (in lttng_ht_new() at hashtable.c:127)
DEBUG1 [23936/24037]: Tracing session auto-20140421-133146 created with ID 1 by UID 0 GID 0 (in session_create() at session.c:276)
DEBUG2 [23936/24037]: Trying to find session by name auto-20140421-133146 (in session_find_by_name() at session.c:169)
DEBUG3 [23936/24037]: Created hashtable size 4 at 0x7ff0a8004300 of type 1 (in lttng_ht_new() at hashtable.c:127)
DEBUG2 [23936/24037]: Setting trace directory path from URI to /root/lttng-traces/auto-20140421-133146 (in add_uri_to_consumer() at cmd.c:481)
DEBUG1 [23936/24037]: Sending response (size: 16, retcode: Success) (in thread_manage_clients() at main.c:4019)
DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675)
DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883)
DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925)
DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970)
DEBUG1 [23936/24037]: Nothing recv() from client... continuing (in thread_manage_clients() at main.c:3974)
DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675)
DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883)
DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925)
DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970)
DEBUG1 [23936/24037]: Processing client command 6 (in process_client_msg() at main.c:2704)
DEBUG1 [23936/24037]: Getting session auto-20140421-133146 by name (in process_client_msg() at main.c:2785)
DEBUG2 [23936/24037]: Trying to find session by name auto-20140421-133146 (in session_find_by_name() at session.c:169)
DEBUG1 [23936/24037]: Creating UST session (in create_ust_session() at main.c:2584)
DEBUG3 [23936/24037]: Created hashtable size 4 at 0x7ff0a8004aa0 of type 0 (in lttng_ht_new() at hashtable.c:127)
DEBUG3 [23936/24037]: Created hashtable size 4 at 0x7ff0a8004ee0 of type 0 (in lttng_ht_new() at hashtable.c:127)
DEBUG3 [23936/24037]: Created hashtable size 4 at 0x7ff0a8005320 of type 1 (in lttng_ht_new() at hashtable.c:127)
DEBUG2 [23936/24037]: UST trace session create successful (in trace_ust_create_session() at trace-ust.c:263)
DEBUG3 [23936/24037]: Copying tracing session consumer output in UST session (in copy_session_consumer() at main.c:2533)
DEBUG3 [23936/24037]: Created hashtable size 4 at 0x7ff0a8005760 of type 1 (in lttng_ht_new() at hashtable.c:127)
DEBUG3 [23936/24037]: Copy session consumer subdir /ust (in copy_session_consumer() at main.c:2551)
DEBUG3 [23936/24037]: Consumer socket created (fd: 32) and added to output (in consumer_create_socket() at consumer.c:301)
DEBUG1 [23936/24037]: Setting relayd for session auto-20140421-133146 (in cmd_setup_relayd() at cmd.c:722)
DEBUG2 [23936/24037]: Trace UST channel channel0 not found by name (in trace_ust_find_channel_by_name() at trace-ust.c:162)
DEBUG1 [23936/24037]: Enabling channel for session auto-20140421-133146 (in cmd_enable_channel() at cmd.c:910)
DEBUG2 [23936/24037]: Trace UST channel channel0 not found by name (in trace_ust_find_channel_by_name() at trace-ust.c:162)
DEBUG3 [23936/24037]: Created hashtable size 4 at 0x7ff0a8006120 of type 0 (in lttng_ht_new() at hashtable.c:127)
DEBUG3 [23936/24037]: Created hashtable size 4 at 0x7ff0a8006560 of type 1 (in lttng_ht_new() at hashtable.c:127)
DEBUG2 [23936/24037]: Trace UST channel channel0 created (in trace_ust_create_channel() at trace-ust.c:331)
DEBUG2 [23936/24037]: Channel channel0 is being created for UST with buffer 1 and id 0 (in channel_ust_create() at channel.c:348)
DEBUG2 [23936/24037]: UST app adding channel channel0 to UST domain for session id 1 (in ust_app_create_channel_glb() at ust-app.c:3536)
DEBUG2 [23936/24037]: Channel channel0 created successfully (in channel_ust_create() at channel.c:383)
DEBUG2 [23936/24037]: Trace UST channel channel0 found by name (in trace_ust_find_channel_by_name() at trace-ust.c:157)
DEBUG2 [23936/24037]: Trace UST event * NOT found (in trace_ust_find_event() at trace-ust.c:198)
DEBUG2 [23936/24037]: Trace UST event *, loglevel (0,-1) created (in trace_ust_create_event() at trace-ust.c:407)
DEBUG1 [23936/24037]: UST app creating event * for all apps for session id 1 (in ust_app_create_event_glb() at ust-app.c:3687)
DEBUG1 [23936/24037]: Event UST * created in channel channel0 (in event_ust_enable_tracepoint() at event.c:474)
DEBUG1 [23936/24037]: Sending response (size: 16, retcode: Success) (in thread_manage_clients() at main.c:4019)
DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675)
DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883)
DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64)
DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925)
DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970)
DEBUG1 [23936/24037]: Nothing recv() from client... continuing (in thread_manage_clients() at main.c:3974)
DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675)
DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883)
DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925)
DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970)
DEBUG1 [23936/24037]: Processing client command 0 (in process_client_msg() at main.c:2704)
DEBUG1 [23936/24037]: Getting session auto-20140421-133146 by name (in process_client_msg() at main.c:2785)
DEBUG2 [23936/24037]: Trying to find session by name auto-20140421-133146 (in session_find_by_name() at session.c:169)
DEBUG3 [23936/24037]: Consumer socket created (fd: 32) and added to output (in consumer_create_socket() at consumer.c:301)
DEBUG1 [23936/24037]: Setting relayd for session auto-20140421-133146 (in cmd_setup_relayd() at cmd.c:722)
DEBUG1 [23936/24037]: Context UST 5 added to channel channel0 (in add_uctx_to_channel() at context.c:134)
DEBUG1 [23936/24037]: Sending response (size: 16, retcode: Success) (in thread_manage_clients() at main.c:4019)
DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675)
DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883)
DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925)
DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970)
DEBUG1 [23936/24037]: Nothing recv() from client... continuing (in thread_manage_clients() at main.c:3974)
DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675)
DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883)
DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925)
DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970)
DEBUG1 [23936/24037]: Processing client command 16 (in process_client_msg() at main.c:2704)
DEBUG1 [23936/24037]: Getting session auto-20140421-133146 by name (in process_client_msg() at main.c:2785)
DEBUG2 [23936/24037]: Trying to find session by name auto-20140421-133146 (in session_find_by_name() at session.c:169)
DEBUG1 [23936/24037]: Starting all UST traces (in ust_app_start_trace_all() at ust-app.c:4034)
DEBUG1 [23936/24037]: Sending response (size: 16, retcode: Success) (in thread_manage_clients() at main.c:4019)
DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675)
DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883)
DEBUG1 [23936/24039]: UST registration received with pid:24376 ppid:1155 uid:0 gid:0 sock:28 name:gen-ust-events (version 5.0) (in thread_registration_apps() at main.c:2013)
DEBUG1 [23936/24039]: Futex n to 1 wake done (in futex_nto1_wake() at futex.c:104)
DEBUG1 [23936/24039]: Accepting application registration (in thread_registration_apps() at main.c:1905)
DEBUG1 [23936/24038]: Futex n to 1 wait done (in futex_nto1_wait() at futex.c:90)
DEBUG1 [23936/24038]: Futex n to 1 prepare done (in futex_nto1_prepare() at futex.c:75)
DEBUG1 [23936/24038]: Dispatching UST registration pid:24376 ppid:1155 uid:0 gid:0 sock:28 name:gen-ust-events (version 5.0) (in thread_dispatch_ust_registration() at main.c:1679)
DEBUG3 [23936/24038]: UST app creating application for socket 28 (in ust_app_create() at ust-app.c:2848)
DEBUG3 [23936/24038]: Created hashtable size 4 at 0x7ff078003d20 of type 2 (in lttng_ht_new() at hashtable.c:127)
DEBUG3 [23936/24038]: Created hashtable size 4 at 0x7ff078004270 of type 1 (in lttng_ht_new() at hashtable.c:127)
DEBUG1 [23936/24038]: Woken up but nothing in the UST command queue (in thread_dispatch_ust_registration() at main.c:1667)
DEBUG1 [23936/24039]: UST registration received with pid:24376 ppid:1155 uid:0 gid:0 sock:34 name:gen-ust-events (version 5.0) (in thread_registration_apps() at main.c:2013)
DEBUG1 [23936/24039]: Futex n to 1 wake done (in futex_nto1_wake() at futex.c:104)
DEBUG1 [23936/24039]: Accepting application registration (in thread_registration_apps() at main.c:1905)
DEBUG1 [23936/24038]: Futex n to 1 wait done (in futex_nto1_wait() at futex.c:90)
DEBUG1 [23936/24038]: Futex n to 1 prepare done (in futex_nto1_prepare() at futex.c:75)
DEBUG1 [23936/24038]: Dispatching UST registration pid:24376 ppid:1155 uid:0 gid:0 sock:34 name:gen-ust-events (version 5.0) (in thread_dispatch_ust_registration() at main.c:1679)
DEBUG3 [23936/24038]: UST app notify socket 34 is set (in thread_dispatch_ust_registration() at main.c:1736)
DEBUG1 [23936/24038]: App registered with pid:24376 ppid:1155 uid:0 gid:0 sock:28 name:gen-ust-events notify_sock:34 (version 5.0) (in ust_app_add() at ust-app.c:2936)
DEBUG2 [23936/24038]: UST app global update for app sock 28 for session id 1 (in ust_app_global_update() at ust-app.c:4173)
DEBUG2 [23936/24038]: UST app pid: 24376 session id 1 not found, creating it (in create_ust_app_session() at ust-app.c:1842)
DEBUG3 [23936/24038]: Created hashtable size 4 at 0x7ff078004750 of type 0 (in lttng_ht_new() at hashtable.c:127)
DEBUG2 [23936/24038]: Shadow copy of session handle -1 (in shadow_copy_session() at ust-app.c:1598)
DEBUG2 [23936/24038]: Channel channel0 not found on shadow session copy, creating it (in shadow_copy_session() at ust-app.c:1648)
DEBUG3 [23936/24038]: Created hashtable size 4 at 0x7ff078004ca0 of type 1 (in lttng_ht_new() at hashtable.c:127)
DEBUG3 [23936/24038]: Created hashtable size 4 at 0x7ff078004fd0 of type 0 (in lttng_ht_new() at hashtable.c:127)
DEBUG3 [23936/24038]: UST app channel channel0 allocated (in alloc_ust_app_channel() at ust-app.c:882)
DEBUG2 [23936/24038]: UST app shadow copy of channel channel0 started (in shadow_copy_channel() at ust-app.c:1525)
DEBUG3 [23936/24038]: UST app context 5 allocated (in alloc_ust_app_ctx() at ust-app.c:965)
DEBUG2 [23936/24038]: UST event * not found on shadow copy channel (in shadow_copy_channel() at ust-app.c:1565)
DEBUG3 [23936/24038]: UST app event * allocated (in alloc_ust_app_event() at ust-app.c:938)
DEBUG3 [23936/24038]: UST app shadow copy of channel channel0 done (in shadow_copy_channel() at ust-app.c:1575)
DEBUG3 [23936/24038]: Buffer registry per UID find id: 1, ABI: 64, uid: 0 (in buffer_reg_uid_find() at buffer-registry.c:195)
DEBUG3 [23936/24038]: Created hashtable size 4 at 0x7ff0780036e0 of type 2 (in lttng_ht_new() at hashtable.c:127)
DEBUG3 [23936/24038]: Buffer registry per UID created id: 1, ABI: 64, uid: 0, domain: 2 (in buffer_reg_uid_create() at buffer-registry.c:144)
DEBUG3 [23936/24038]: Buffer registry per UID adding to global registry with id: 1 (in buffer_reg_uid_add() at buffer-registry.c:166)
DEBUG3 [23936/24038]: Created hashtable size 4 at 0x7ff0780019c0 of type 2 (in lttng_ht_new() at hashtable.c:127)
DEBUG3 [23936/24038]: Append to metadata: "typealias integer { size = 8; align = 8; signed = false; } := uint8_t;
typealias integer { size = 16; align = 8; signed = false; } := uint16_t;
typealias integer { size = 32; align = 8; signed = false; } := uint32_t;
typealias integer { size = 64; align = 8; signed = false; } := uint64_t;
typealias integer { size = 64; align = 8; signed = false; } := unsigned long;
typealias integer { size = 5; align = 1; signed = false; } := uint5_t;
typealias integer { size = 27; align = 1; signed = false; } := uint27_t;

trace {
major = 1;
minor = 8;
uuid = "10daa3ff-5866-4db5-9bf4-e5de1870ef48";
byte_order = le;
packet.header := struct {
uint32_t magic;
uint8_t uuid[16];
uint32_t stream_id;
};
};

" (in lttng_metadata_printf() at ust-metadata.c:151)
DEBUG3 [23936/24038]: Append to metadata: "env {
hostname = "precise1";
domain = "ust";
tracer_name = "lttng-ust";
tracer_major = 2;
tracer_minor = 4;
" (in lttng_metadata_printf() at ust-metadata.c:151)
DEBUG3 [23936/24038]: Append to metadata: "};

" (in lttng_metadata_printf() at ust-metadata.c:151)
DEBUG3 [23936/24038]: Append to metadata: "clock {
name = monotonic;
" (in lttng_metadata_printf() at ust-metadata.c:151)
DEBUG3 [23936/24041]: UST thread notify added sock 34 to pollset (in ust_thread_manage_notify() at ust-thread.c:137)
DEBUG3 [23936/24041]: [ust-thread] Manage notify polling on 3 fds (in ust_thread_manage_notify() at ust-thread.c:68)
DEBUG3 [23936/24038]: Append to metadata: " uuid = "bf9718a3-41e8-4a99-b123-18bbc75dfd74";
" (in lttng_metadata_printf() at ust-metadata.c:151)
DEBUG3 [23936/24038]: Append to metadata: " description = "Monotonic Clock";
freq = 1000000000; /* Frequency, in Hz */
/* clock value offset from Epoch is: offset * (1/freq) */
offset = 1398100962914504123;
};

" (in lttng_metadata_printf() at ust-metadata.c:151)
DEBUG3 [23936/24038]: Append to metadata: "typealias integer {
size = 27; align = 1; signed = false;
map = clock.monotonic.value;
} := uint27_clock_monotonic_t;

typealias integer {
size = 32; align = 8; signed = false;
map = clock.monotonic.value;
} := uint32_clock_monotonic_t;

typealias integer {
size = 64; align = 8; signed = false;
map = clock.monotonic.value;
} := uint64_clock_monotonic_t;

" (in lttng_metadata_printf() at ust-metadata.c:151)
DEBUG3 [23936/24038]: Append to metadata: "struct packet_context {
uint64_clock_monotonic_t timestamp_begin;
uint64_clock_monotonic_t timestamp_end;
uint64_t content_size;
uint64_t packet_size;
unsigned long events_discarded;
uint32_t cpu_id;
};

" (in lttng_metadata_printf() at ust-metadata.c:151)
DEBUG3 [23936/24038]: Append to metadata: "struct event_header_compact {
enum : uint5_t { compact = 0 ... 30, extended = 31 } id;
variant <id> {
struct {
uint27_clock_monotonic_t timestamp;
} compact;
struct {
uint32_t id;
uint64_clock_monotonic_t timestamp;
} extended;
} v;
} align(8);

struct event_header_large {
enum : uint16_t { compact = 0 ... 65534, extended = 65535 } id;
variant <id> {
struct {
uint32_clock_monotonic_t timestamp;
} compact;
struct {
uint32_t id;
uint64_clock_monotonic_t timestamp;
} extended;
} v;
} align(8);

" (in lttng_metadata_printf() at ust-metadata.c:151)
DEBUG3 [23936/24038]: UST app buffer registry per UID created successfully (in setup_buffer_reg_uid() at ust-app.c:1804)
DEBUG2 [23936/24038]: UST app session created successfully with handle 1 (in create_ust_app_session() at ust-app.c:1910)
DEBUG1 [23936/24038]: UST app creating channel channel0 with per UID buffers (in create_channel_per_uid() at ust-app.c:2437)
DEBUG3 [23936/24038]: Buffer registry per UID find id: 1, ABI: 64, uid: 0 (in buffer_reg_uid_find() at buffer-registry.c:195)
DEBUG2 [23936/24038]: UST app creating buffer registry channel for channel0 (in create_buffer_reg_channel() at ust-app.c:2290)
DEBUG3 [23936/24038]: Buffer registry channel create with key: 0 (in buffer_reg_channel_create() at buffer-registry.c:326)
DEBUG3 [23936/24038]: Created hashtable size 4 at 0x7ff078001e80 of type 0 (in lttng_ht_new() at hashtable.c:127)
DEBUG2 [23936/24038]: Asking UST consumer for channel (in ask_channel_creation() at ust-consumer.c:118)
DEBUG3 [23936/24038]: mkdir() recursive /root/lttng-traces/auto-20140421-133146/ust/uid/0/64-bit with mode 504 for uid 0 and gid 0 (in run_as_mkdir_recursive() at runas.c:308)
DEBUG1 [23936/24038]: Using run_as_clone (in run_as() at runas.c:291)
DEBUG3 [23936/24038]: UST registry channel finding key 0 (in ust_registry_channel_find() at ust-registry.c:489)
DEBUG1 [24062/24068]: Incoming command on sock (in consumer_thread_sessiond_poll() at consumer.c:3068)
DEBUG1 [24062/24068]: Allocated channel (key 2) (in consumer_allocate_channel() at consumer.c:999)
DEBUG3 [24062/24068]: Creating channel to ustctl with attr: [overwrite: 0, subbuf_size: 131072, num_subbuf: 4, switch_timer_interval: 0, read_timer_interval: 0, output: 0, type: 0 (in create_ust_channel() at ust-consumer.c:361)
DEBUG3 [24062/24068]: Allocated stream channel0_0 (key 27, chan_key 2 relayd_id 18446744073709551615, session_id 1 (in consumer_allocate_stream() at consumer.c:594)
DEBUG3 [24062/24068]: open() /root/lttng-traces/auto-20140421-133146/ust/uid/0/64-bit/channel0_0 with flags 241 mode 432 for uid 0 and gid 0 (in run_as_open() at runas.c:336)
DEBUG1 [24062/24068]: Using run_as_clone (in run_as() at runas.c:291)
DEBUG3 [24062/24068]: mkdir() /root/lttng-traces/auto-20140421-133146/ust/uid/0/64-bit/index with mode 504 for uid 0 and gid 0 (in run_as_mkdir() at runas.c:320)
DEBUG1 [24062/24068]: Using run_as_clone (in run_as() at runas.c:291)
DEBUG3 [24062/24068]: open() /root/lttng-traces/auto-20140421-133146/ust/uid/0/64-bit/index/channel0_0.idx with flags 241 mode 432 for uid 0 and gid 0 (in run_as_open() at runas.c:336)
DEBUG1 [24062/24068]: Using run_as_clone (in run_as() at runas.c:291)
DEBUG1 [24062/24068]: UST consumer add stream channel0_0 (key: 27) with relayd id 0 (in create_ust_streams() at ust-consumer.c:321)
DEBUG3 [24062/24068]: Allocated stream channel0_1 (key 31, chan_key 2 relayd_id 18446744073709551615, session_id 1 (in consumer_allocate_stream() at consumer.c:594)
DEBUG3 [24062/24068]: open() /root/lttng-traces/auto-20140421-133146/ust/uid/0/64-bit/channel0_1 with flags 241 mode 432 for uid 0 and gid 0 (in run_as_open() at runas.c:336)
DEBUG1 [24062/24068]: Using run_as_clone (in run_as() at runas.c:291)
DEBUG3 [24062/24068]: mkdir() /root/lttng-traces/auto-20140421-133146/ust/uid/0/64-bit/index with mode 504 for uid 0 and gid 0 (in run_as_mkdir() at runas.c:320)
DEBUG1 [24062/24068]: Using run_as_clone (in run_as() at runas.c:291)
DEBUG3 [24062/24068]: open() /root/lttng-traces/auto-20140421-133146/ust/uid/0/64-bit/index/channel0_1.idx with flags 241 mode 432 for uid 0 and gid 0 (in run_as_open() at runas.c:336)
DEBUG1 [24062/24068]: Using run_as_clone (in run_as() at runas.c:291)
DEBUG1 [24062/24068]: UST consumer add stream channel0_1 (key: 31) with relayd id 0 (in create_ust_streams() at ust-consumer.c:321)
DEBUG1 [24062/24068]: UST consumer channel added (key: 2) (in add_channel() at ust-consumer.c:111)
DEBUG1 [24062/24068]: received command on sock (in consumer_thread_sessiond_poll() at consumer.c:3084)
DEBUG1 [24062/24065]: Channel event catched in thread (in consumer_thread_channel_poll() at consumer.c:2759)
DEBUG1 [24062/24065]: Adding channel 21 to poll set (in consumer_thread_channel_poll() at consumer.c:2803)
DEBUG2 [23936/24038]: UST ask channel 2 successfully done with 2 stream(s) (in ask_channel_creation() at ust-consumer.c:195)
DEBUG1 [24062/24065]: Channel poll wait with 2 fd(s) (in consumer_thread_channel_poll() at consumer.c:2755)
DEBUG1 [24062/24068]: Incoming command on sock (in consumer_thread_sessiond_poll() at consumer.c:3068)
DEBUG1 [24062/24068]: UST consumer sending channel channel0 to sessiond (in send_sessiond_channel() at ust-consumer.c:418)
DEBUG1 [24062/24068]: UST consumer sending stream 27 to sessiond (in send_sessiond_stream() at ust-consumer.c:389)
DEBUG1 [24062/24068]: UST consumer sending stream 31 to sessiond (in send_sessiond_stream() at ust-consumer.c:389)
DEBUG2 [23936/24038]: UST app stream 1 received succesfully (in ust_consumer_get_channel() at ust-consumer.c:311)
DEBUG1 [24062/24068]: UST consumer NULL stream sent to sessiond (in send_sessiond_channel() at ust-consumer.c:482)
DEBUG2 [23936/24038]: UST app stream 2 received succesfully (in ust_consumer_get_channel() at ust-consumer.c:311)
DEBUG3 [23936/24038]: UST app consumer has no more stream available (in ust_consumer_get_channel() at ust-consumer.c:294)
DEBUG3 [24062/24068]: Adding consumer stream 27 (in consumer_add_data_stream() at consumer.c:620)
DEBUG3 [24062/24068]: Adding consumer stream 31 (in consumer_add_data_stream() at consumer.c:620)
DEBUG1 [24062/24068]: received command on sock (in consumer_thread_sessiond_poll() at consumer.c:3084)
DEBUG2 [23936/24038]: UST app setup buffer registry channel for channel0 (in setup_buffer_reg_channel() at ust-app.c:2338)
DEBUG2 [23936/24038]: UST app setup buffer registry stream (in setup_buffer_reg_streams() at ust-app.c:2245)
DEBUG3 [23936/24038]: Buffer registry creating stream (in buffer_reg_stream_create() at buffer-registry.c:356)
DEBUG3 [23936/24038]: Buffer registry creating stream (in buffer_reg_stream_create() at buffer-registry.c:356)
DEBUG1 [23936/24038]: UST app sending buffer registry channel to ust sock 28 (in send_channel_uid_to_ust() at ust-app.c:2374)
DEBUG2 [23936/24038]: UST app send channel to sock 28 pid 24376 (name: channel0, key: 0) (in ust_consumer_send_channel_to_ust() at ust-consumer.c:415)
DEBUG1 [24062/24067]: poll num_rdy : 1 (in consumer_thread_data_poll() at consumer.c:2445)
DEBUG1 [24062/24067]: consumer_data_pipe wake up (in consumer_thread_data_poll() at consumer.c:2469)
DEBUG2 [23936/24038]: UST consumer send stream to app 28 (in ust_consumer_send_stream_to_ust() at ust-consumer.c:380)
DEBUG2 [23936/24038]: UST consumer send stream to app 28 (in ust_consumer_send_stream_to_ust() at ust-consumer.c:380)
DEBUG1 [24062/24067]: Updating poll fd array (in update_poll_array() at consumer.c:1059)
Error: UST app create channel context failed for app (pid: 24376) with ret -1024
DEBUG3 [23936/24038]: Buffer registry per UID find id: 1, ABI: 64, uid: 0 (in buffer_reg_uid_find() at buffer-registry.c:195)
DEBUG3 [23936/24038]: UST app deleting channel channel0 (in delete_ust_app_channel() at ust-app.c:374)
DEBUG1 [24062/24067]: polling on 3 fd (in consumer_thread_data_poll() at consumer.c:2441)
DEBUG1 [24062/24067]: poll num_rdy : 1 (in consumer_thread_data_poll() at consumer.c:2445)
DEBUG1 [23936/24038]: Woken up but nothing in the UST command queue (in thread_dispatch_ust_registration() at main.c:1667)
DEBUG1 [24062/24067]: consumer_data_pipe wake up (in consumer_thread_data_poll() at consumer.c:2469)
DEBUG1 [23936/24040]: Apps with sock 28 added to poll set (in thread_manage_apps() at main.c:1449)
DEBUG1 [23936/24040]: Apps thread polling on 3 fds (in thread_manage_apps() at main.c:1388)
DEBUG1 [24062/24067]: polling on 3 fd (in consumer_thread_data_poll() at consumer.c:2441)
DEBUG1 [23936/24040]: PID 24376 unregistering with sock 28 (in ust_app_unregister() at ust-app.c:2987)
DEBUG1 [23936/24040]: Apps thread polling on 2 fds (in thread_manage_apps() at main.c:1388)
DEBUG1 [23936/24041]: UST app notify socket unregister 34 (in ust_app_notify_sock_unregister() at ust-app.c:4857)
DEBUG2 [23936/24041]: UST app find by notify sock 34 not found (in find_app_by_notify_sock() at ust-app.c:1029)
DEBUG3 [23936/24041]: [ust-thread] Manage notify polling on 2 fds (in ust_thread_manage_notify() at ust-thread.c:68)
DEBUG3 [23936/24130]: Call RCU deleting app PID 24376 (in delete_ust_app_rcu() at ust-app.c:780)
DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64)
DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64)
DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64)
DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64)
DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64)
DEBUG2 [23936/24130]: UST app pid 24376 deleted (in delete_ust_app() at ust-app.c:765)
DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925)
DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970)
DEBUG1 [23936/24037]: Nothing recv() from client... continuing (in thread_manage_clients() at main.c:3974)
DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675)
DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883)
DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925)
DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970)
DEBUG1 [23936/24037]: Processing client command 17 (in process_client_msg() at main.c:2704)
DEBUG1 [23936/24037]: Getting session auto-20140421-133146 by name (in process_client_msg() at main.c:2785)
DEBUG2 [23936/24037]: Trying to find session by name auto-20140421-133146 (in session_find_by_name() at session.c:169)
DEBUG1 [23936/24037]: Stopping all UST traces (in ust_app_stop_trace_all() at ust-app.c:4060)
DEBUG2 [23936/24037]: Consumer flush channel key 2 (in consumer_flush_channel() at consumer.c:1139)
DEBUG1 [24062/24068]: Incoming command on sock (in consumer_thread_sessiond_poll() at consumer.c:3068)
DEBUG1 [24062/24068]: UST consumer flush channel key 2 (in flush_channel() at ust-consumer.c:607)
DEBUG1 [24062/24068]: received command on sock (in consumer_thread_sessiond_poll() at consumer.c:3084)
DEBUG1 [24062/24067]: poll num_rdy : 2 (in consumer_thread_data_poll() at consumer.c:2445)
DEBUG1 [24062/24067]: Normal read on fd 31 (in consumer_thread_data_poll() at consumer.c:2531)
DEBUG1 [24062/24067]: In UST read_subbuffer (wait_fd: 31, name: channel0_1) (in lttng_ustconsumer_read_subbuffer() at ust-consumer.c:1878)
DEBUG1 [24062/24067]: Consumer mmap write() ret 4096 (len 4096) (in lttng_consumer_on_read_subbuffer_mmap() at consumer.c:1603)
DEBUG1 [24062/24067]: Normal read on fd 27 (in consumer_thread_data_poll() at consumer.c:2531)
DEBUG1 [24062/24067]: In UST read_subbuffer (wait_fd: 27, name: channel0_0) (in lttng_ustconsumer_read_subbuffer() at ust-consumer.c:1878)
DEBUG1 [24062/24067]: Consumer mmap write() ret 4096 (len 4096) (in lttng_consumer_on_read_subbuffer_mmap() at consumer.c:1603)
DEBUG1 [24062/24067]: polling on 3 fd (in consumer_thread_data_poll() at consumer.c:2441)
DEBUG1 [23936/24037]: Sending response (size: 16, retcode: Success) (in thread_manage_clients() at main.c:4019)
DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675)
DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883)
DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925)
DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970)
DEBUG1 [23936/24037]: Processing client command 24 (in process_client_msg() at main.c:2704)
DEBUG1 [23936/24037]: Getting session auto-20140421-133146 by name (in process_client_msg() at main.c:2785)
DEBUG2 [23936/24037]: Trying to find session by name auto-20140421-133146 (in session_find_by_name() at session.c:169)
DEBUG3 [23936/24037]: Consumer data pending for id 1 (in consumer_is_data_pending() at consumer.c:1083)
DEBUG1 [24062/24068]: Incoming command on sock (in consumer_thread_sessiond_poll() at consumer.c:3068)
DEBUG1 [24062/24068]: UST consumer data pending command for id 1 (in lttng_ustconsumer_recv_cmd() at ust-consumer.c:1177)
DEBUG1 [24062/24068]: Consumer data pending command on session id 1 (in consumer_data_pending() at consumer.c:3491)
DEBUG1 [24062/24068]: UST consumer checking data pending (in lttng_ustconsumer_data_pending() at ust-consumer.c:2053)
DEBUG1 [24062/24068]: UST consumer checking data pending (in lttng_ustconsumer_data_pending() at ust-consumer.c:2053)
DEBUG1 [24062/24068]: received command on sock (in consumer_thread_sessiond_poll() at consumer.c:3084)
DEBUG1 [23936/24037]: Consumer data is NOT pending for session id 1 (in consumer_is_data_pending() at consumer.c:1119)
DEBUG1 [23936/24037]: Sending response (size: 16, retcode: Unknown error code) (in thread_manage_clients() at main.c:4019)
DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675)
DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883)
DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925)
DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970)
DEBUG1 [23936/24037]: Nothing recv() from client... continuing (in thread_manage_clients() at main.c:3974)
DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675)
DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883)
DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925)
DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970)
DEBUG1 [23936/24037]: Processing client command 13 (in process_client_msg() at main.c:2704)
DEBUG1 [23936/24037]: Counting number of available session for UID 0 GID 0 (in lttng_sessions_count() at main.c:2673)
DEBUG1 [23936/24037]: Getting all available session for UID 0 GID 0 (in cmd_list_lttng_sessions() at cmd.c:2479)
DEBUG1 [23936/24037]: Sending response (size: 4392, retcode: Success) (in thread_manage_clients() at main.c:4019)
DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675)
DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883)
DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925)
DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970)
DEBUG1 [23936/24037]: Processing client command 9 (in process_client_msg() at main.c:2704)
DEBUG1 [23936/24037]: Getting session auto-20140421-133146 by name (in process_client_msg() at main.c:2785)
DEBUG2 [23936/24037]: Trying to find session by name auto-20140421-133146 (in session_find_by_name() at session.c:169)
DEBUG3 [23936/24037]: No kernel session when tearing down session (in kernel_destroy_session() at kernel.c:755)
DEBUG1 [23936/24037]: Destroy all UST traces (in ust_app_destroy_trace_all() at ust-app.c:4139)
DEBUG2 [23936/24037]: Trace UST destroy session 1 (in trace_ust_destroy_session() at trace-ust.c:719)
DEBUG3 [23936/24037]: JUL destroy domain (in jul_destroy_domain() at jul.c:859)
DEBUG3 [23936/24037]: Buffer registry per UID destroy with id: 1, ABI: 64, uid: 0 (in buffer_reg_uid_destroy() at buffer-registry.c:624)
DEBUG1 [23936/24037]: Destroying session auto-20140421-133146 (in session_destroy() at session.c:194)
DEBUG1 [23936/24037]: Sending response (size: 16, retcode: Success) (in thread_manage_clients() at main.c:4019)
DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64)
DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64)
DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64)
DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64)
DEBUG1 [23936/24043]: Updating kernel poll set (in update_kernel_poll() at main.c:756)
DEBUG1 [23936/24043]: Thread kernel polling on 2 fds (in thread_manage_kernel() at main.c:941)
DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675)
DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883)
DEBUG2 [23936/24130]: Trace destroy UST channel channel0 (in _trace_ust_destroy_channel() at trace-ust.c:630)
DEBUG3 [23936/24130]: Buffer registry session destroy (in buffer_reg_session_destroy() at buffer-registry.c:543)
DEBUG3 [23936/24130]: Buffer registry channel destroy with key 0 (in buffer_reg_channel_destroy() at buffer-registry.c:498)
DEBUG3 [23936/24130]: Buffer registry stream destroy with handle -1 (in buffer_reg_stream_destroy() at buffer-registry.c:446)
DEBUG3 [23936/24130]: Buffer registry stream destroy with handle -1 (in buffer_reg_stream_destroy() at buffer-registry.c:446)
DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64)
DEBUG1 [24062/24065]: Channel event catched in thread (in consumer_thread_channel_poll() at consumer.c:2759)
DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64)
DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64)
DEBUG1 [24062/24065]: Channel fd 21 is hup|err. (in consumer_thread_channel_poll() at consumer.c:2893)
DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64)
DEBUG1 [24062/24065]: Channel poll wait with 1 fd(s) (in consumer_thread_channel_poll() at consumer.c:2755)
DEBUG1 [24062/24067]: poll num_rdy : 2 (in consumer_thread_data_poll() at consumer.c:2445)
DEBUG1 [24062/24067]: fd 31 is hup|err|nval. Attempting flush and read. (in consumer_thread_data_poll() at consumer.c:2556)
DEBUG1 [24062/24067]: Polling fd 31 tells it has hung up. (in consumer_thread_data_poll() at consumer.c:2567)
DEBUG1 [24062/24067]: fd 27 is hup|err|nval. Attempting flush and read. (in consumer_thread_data_poll() at consumer.c:2556)
DEBUG1 [24062/24067]: Polling fd 27 tells it has hung up. (in consumer_thread_data_poll() at consumer.c:2567)
DEBUG1 [24062/24067]: polling on 3 fd (in consumer_thread_data_poll() at consumer.c:2441)
DEBUG1 [24062/24067]: poll num_rdy : 2 (in consumer_thread_data_poll() at consumer.c:2445)
DEBUG1 [24062/24067]: Normal read on fd 31 (in consumer_thread_data_poll() at consumer.c:2531)
DEBUG1 [24062/24067]: In UST read_subbuffer (wait_fd: 31, name: channel0_1) (in lttng_ustconsumer_read_subbuffer() at ust-consumer.c:1878)
DEBUG1 [24062/24067]: Consumer mmap write() ret 4096 (len 4096) (in lttng_consumer_on_read_subbuffer_mmap() at consumer.c:1603)
DEBUG1 [24062/24067]: Normal read on fd 27 (in consumer_thread_data_poll() at consumer.c:2531)
DEBUG1 [24062/24067]: In UST read_subbuffer (wait_fd: 27, name: channel0_0) (in lttng_ustconsumer_read_subbuffer() at ust-consumer.c:1878)
DEBUG1 [24062/24067]: Consumer mmap write() ret 4096 (len 4096) (in lttng_consumer_on_read_subbuffer_mmap() at consumer.c:1603)
DEBUG1 [24062/24067]: Polling fd 31 tells it has hung up. (in consumer_thread_data_poll() at consumer.c:2567)
DEBUG1 [24062/24067]: Polling fd 27 tells it has hung up. (in consumer_thread_data_poll() at consumer.c:2567)
DEBUG1 [24062/24067]: polling on 3 fd (in consumer_thread_data_poll() at consumer.c:2441)
DEBUG1 [24062/24067]: poll num_rdy : 2 (in consumer_thread_data_poll() at consumer.c:2445)
DEBUG1 [24062/24067]: Normal read on fd 31 (in consumer_thread_data_poll() at consumer.c:2531)
DEBUG1 [24062/24067]: In UST read_subbuffer (wait_fd: 31, name: channel0_1) (in lttng_ustconsumer_read_subbuffer() at ust-consumer.c:1878)
DEBUG1 [24062/24067]: Reserving sub buffer failed (everything is normal, it is due to concurrency) [ret: -11] (in lttng_ustconsumer_read_subbuffer() at ust-consumer.c:1923)
DEBUG1 [24062/24067]: Normal read on fd 27 (in consumer_thread_data_poll() at consumer.c:2531)
DEBUG1 [24062/24067]: In UST read_subbuffer (wait_fd: 27, name: channel0_0) (in lttng_ustconsumer_read_subbuffer() at ust-consumer.c:1878)
DEBUG1 [24062/24067]: Reserving sub buffer failed (everything is normal, it is due to concurrency) [ret: -11] (in lttng_ustconsumer_read_subbuffer() at ust-consumer.c:1923)
DEBUG1 [24062/24067]: Polling fd 31 tells it has hung up. (in consumer_thread_data_poll() at consumer.c:2567)
DEBUG1 [24062/24067]: Consumer stream destroy monitored key: 31 (in destroy_close_stream() at consumer-stream.c:264)
DEBUG1 [24062/24067]: Polling fd 27 tells it has hung up. (in consumer_thread_data_poll() at consumer.c:2567)
DEBUG1 [24062/24067]: Consumer stream destroy monitored key: 27 (in destroy_close_stream() at consumer-stream.c:264)
DEBUG1 [24062/24067]: Consumer delete channel key 2 (in consumer_del_channel() at consumer.c:347)
DEBUG1 [24062/24067]: Updating poll fd array (in update_poll_array() at consumer.c:1059)
DEBUG1 [24062/24067]: polling on 1 fd (in consumer_thread_data_poll() at consumer.c:2441)
DEBUG2 [23936/24130]: Trace destroy UST event * (in trace_ust_destroy_event() at trace-ust.c:579)
DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64)

(1-1/2)