DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925) DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970) DEBUG1 [23936/24037]: Nothing recv() from client... continuing (in thread_manage_clients() at main.c:3974) DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675) DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883) DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925) DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970) DEBUG1 [23936/24037]: Processing client command 8 (in process_client_msg() at main.c:2704) DEBUG1 [23936/24037]: Waiting for 1 URIs from client ... (in process_client_msg() at main.c:3305) DEBUG2 [23936/24037]: Trying to find session by name auto-20140421-133146 (in session_find_by_name() at session.c:169) DEBUG3 [23936/24037]: Created hashtable size 4 at 0x7ff0a8003ec0 of type 1 (in lttng_ht_new() at hashtable.c:127) DEBUG1 [23936/24037]: Tracing session auto-20140421-133146 created with ID 1 by UID 0 GID 0 (in session_create() at session.c:276) DEBUG2 [23936/24037]: Trying to find session by name auto-20140421-133146 (in session_find_by_name() at session.c:169) DEBUG3 [23936/24037]: Created hashtable size 4 at 0x7ff0a8004300 of type 1 (in lttng_ht_new() at hashtable.c:127) DEBUG2 [23936/24037]: Setting trace directory path from URI to /root/lttng-traces/auto-20140421-133146 (in add_uri_to_consumer() at cmd.c:481) DEBUG1 [23936/24037]: Sending response (size: 16, retcode: Success) (in thread_manage_clients() at main.c:4019) DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675) DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883) DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925) DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970) DEBUG1 [23936/24037]: Nothing recv() from client... continuing (in thread_manage_clients() at main.c:3974) DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675) DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883) DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925) DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970) DEBUG1 [23936/24037]: Processing client command 6 (in process_client_msg() at main.c:2704) DEBUG1 [23936/24037]: Getting session auto-20140421-133146 by name (in process_client_msg() at main.c:2785) DEBUG2 [23936/24037]: Trying to find session by name auto-20140421-133146 (in session_find_by_name() at session.c:169) DEBUG1 [23936/24037]: Creating UST session (in create_ust_session() at main.c:2584) DEBUG3 [23936/24037]: Created hashtable size 4 at 0x7ff0a8004aa0 of type 0 (in lttng_ht_new() at hashtable.c:127) DEBUG3 [23936/24037]: Created hashtable size 4 at 0x7ff0a8004ee0 of type 0 (in lttng_ht_new() at hashtable.c:127) DEBUG3 [23936/24037]: Created hashtable size 4 at 0x7ff0a8005320 of type 1 (in lttng_ht_new() at hashtable.c:127) DEBUG2 [23936/24037]: UST trace session create successful (in trace_ust_create_session() at trace-ust.c:263) DEBUG3 [23936/24037]: Copying tracing session consumer output in UST session (in copy_session_consumer() at main.c:2533) DEBUG3 [23936/24037]: Created hashtable size 4 at 0x7ff0a8005760 of type 1 (in lttng_ht_new() at hashtable.c:127) DEBUG3 [23936/24037]: Copy session consumer subdir /ust (in copy_session_consumer() at main.c:2551) DEBUG3 [23936/24037]: Consumer socket created (fd: 32) and added to output (in consumer_create_socket() at consumer.c:301) DEBUG1 [23936/24037]: Setting relayd for session auto-20140421-133146 (in cmd_setup_relayd() at cmd.c:722) DEBUG2 [23936/24037]: Trace UST channel channel0 not found by name (in trace_ust_find_channel_by_name() at trace-ust.c:162) DEBUG1 [23936/24037]: Enabling channel for session auto-20140421-133146 (in cmd_enable_channel() at cmd.c:910) DEBUG2 [23936/24037]: Trace UST channel channel0 not found by name (in trace_ust_find_channel_by_name() at trace-ust.c:162) DEBUG3 [23936/24037]: Created hashtable size 4 at 0x7ff0a8006120 of type 0 (in lttng_ht_new() at hashtable.c:127) DEBUG3 [23936/24037]: Created hashtable size 4 at 0x7ff0a8006560 of type 1 (in lttng_ht_new() at hashtable.c:127) DEBUG2 [23936/24037]: Trace UST channel channel0 created (in trace_ust_create_channel() at trace-ust.c:331) DEBUG2 [23936/24037]: Channel channel0 is being created for UST with buffer 1 and id 0 (in channel_ust_create() at channel.c:348) DEBUG2 [23936/24037]: UST app adding channel channel0 to UST domain for session id 1 (in ust_app_create_channel_glb() at ust-app.c:3536) DEBUG2 [23936/24037]: Channel channel0 created successfully (in channel_ust_create() at channel.c:383) DEBUG2 [23936/24037]: Trace UST channel channel0 found by name (in trace_ust_find_channel_by_name() at trace-ust.c:157) DEBUG2 [23936/24037]: Trace UST event * NOT found (in trace_ust_find_event() at trace-ust.c:198) DEBUG2 [23936/24037]: Trace UST event *, loglevel (0,-1) created (in trace_ust_create_event() at trace-ust.c:407) DEBUG1 [23936/24037]: UST app creating event * for all apps for session id 1 (in ust_app_create_event_glb() at ust-app.c:3687) DEBUG1 [23936/24037]: Event UST * created in channel channel0 (in event_ust_enable_tracepoint() at event.c:474) DEBUG1 [23936/24037]: Sending response (size: 16, retcode: Success) (in thread_manage_clients() at main.c:4019) DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675) DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883) DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64) DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925) DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970) DEBUG1 [23936/24037]: Nothing recv() from client... continuing (in thread_manage_clients() at main.c:3974) DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675) DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883) DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925) DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970) DEBUG1 [23936/24037]: Processing client command 0 (in process_client_msg() at main.c:2704) DEBUG1 [23936/24037]: Getting session auto-20140421-133146 by name (in process_client_msg() at main.c:2785) DEBUG2 [23936/24037]: Trying to find session by name auto-20140421-133146 (in session_find_by_name() at session.c:169) DEBUG3 [23936/24037]: Consumer socket created (fd: 32) and added to output (in consumer_create_socket() at consumer.c:301) DEBUG1 [23936/24037]: Setting relayd for session auto-20140421-133146 (in cmd_setup_relayd() at cmd.c:722) DEBUG1 [23936/24037]: Context UST 5 added to channel channel0 (in add_uctx_to_channel() at context.c:134) DEBUG1 [23936/24037]: Sending response (size: 16, retcode: Success) (in thread_manage_clients() at main.c:4019) DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675) DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883) DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925) DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970) DEBUG1 [23936/24037]: Nothing recv() from client... continuing (in thread_manage_clients() at main.c:3974) DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675) DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883) DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925) DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970) DEBUG1 [23936/24037]: Processing client command 16 (in process_client_msg() at main.c:2704) DEBUG1 [23936/24037]: Getting session auto-20140421-133146 by name (in process_client_msg() at main.c:2785) DEBUG2 [23936/24037]: Trying to find session by name auto-20140421-133146 (in session_find_by_name() at session.c:169) DEBUG1 [23936/24037]: Starting all UST traces (in ust_app_start_trace_all() at ust-app.c:4034) DEBUG1 [23936/24037]: Sending response (size: 16, retcode: Success) (in thread_manage_clients() at main.c:4019) DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675) DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883) DEBUG1 [23936/24039]: UST registration received with pid:24376 ppid:1155 uid:0 gid:0 sock:28 name:gen-ust-events (version 5.0) (in thread_registration_apps() at main.c:2013) DEBUG1 [23936/24039]: Futex n to 1 wake done (in futex_nto1_wake() at futex.c:104) DEBUG1 [23936/24039]: Accepting application registration (in thread_registration_apps() at main.c:1905) DEBUG1 [23936/24038]: Futex n to 1 wait done (in futex_nto1_wait() at futex.c:90) DEBUG1 [23936/24038]: Futex n to 1 prepare done (in futex_nto1_prepare() at futex.c:75) DEBUG1 [23936/24038]: Dispatching UST registration pid:24376 ppid:1155 uid:0 gid:0 sock:28 name:gen-ust-events (version 5.0) (in thread_dispatch_ust_registration() at main.c:1679) DEBUG3 [23936/24038]: UST app creating application for socket 28 (in ust_app_create() at ust-app.c:2848) DEBUG3 [23936/24038]: Created hashtable size 4 at 0x7ff078003d20 of type 2 (in lttng_ht_new() at hashtable.c:127) DEBUG3 [23936/24038]: Created hashtable size 4 at 0x7ff078004270 of type 1 (in lttng_ht_new() at hashtable.c:127) DEBUG1 [23936/24038]: Woken up but nothing in the UST command queue (in thread_dispatch_ust_registration() at main.c:1667) DEBUG1 [23936/24039]: UST registration received with pid:24376 ppid:1155 uid:0 gid:0 sock:34 name:gen-ust-events (version 5.0) (in thread_registration_apps() at main.c:2013) DEBUG1 [23936/24039]: Futex n to 1 wake done (in futex_nto1_wake() at futex.c:104) DEBUG1 [23936/24039]: Accepting application registration (in thread_registration_apps() at main.c:1905) DEBUG1 [23936/24038]: Futex n to 1 wait done (in futex_nto1_wait() at futex.c:90) DEBUG1 [23936/24038]: Futex n to 1 prepare done (in futex_nto1_prepare() at futex.c:75) DEBUG1 [23936/24038]: Dispatching UST registration pid:24376 ppid:1155 uid:0 gid:0 sock:34 name:gen-ust-events (version 5.0) (in thread_dispatch_ust_registration() at main.c:1679) DEBUG3 [23936/24038]: UST app notify socket 34 is set (in thread_dispatch_ust_registration() at main.c:1736) DEBUG1 [23936/24038]: App registered with pid:24376 ppid:1155 uid:0 gid:0 sock:28 name:gen-ust-events notify_sock:34 (version 5.0) (in ust_app_add() at ust-app.c:2936) DEBUG2 [23936/24038]: UST app global update for app sock 28 for session id 1 (in ust_app_global_update() at ust-app.c:4173) DEBUG2 [23936/24038]: UST app pid: 24376 session id 1 not found, creating it (in create_ust_app_session() at ust-app.c:1842) DEBUG3 [23936/24038]: Created hashtable size 4 at 0x7ff078004750 of type 0 (in lttng_ht_new() at hashtable.c:127) DEBUG2 [23936/24038]: Shadow copy of session handle -1 (in shadow_copy_session() at ust-app.c:1598) DEBUG2 [23936/24038]: Channel channel0 not found on shadow session copy, creating it (in shadow_copy_session() at ust-app.c:1648) DEBUG3 [23936/24038]: Created hashtable size 4 at 0x7ff078004ca0 of type 1 (in lttng_ht_new() at hashtable.c:127) DEBUG3 [23936/24038]: Created hashtable size 4 at 0x7ff078004fd0 of type 0 (in lttng_ht_new() at hashtable.c:127) DEBUG3 [23936/24038]: UST app channel channel0 allocated (in alloc_ust_app_channel() at ust-app.c:882) DEBUG2 [23936/24038]: UST app shadow copy of channel channel0 started (in shadow_copy_channel() at ust-app.c:1525) DEBUG3 [23936/24038]: UST app context 5 allocated (in alloc_ust_app_ctx() at ust-app.c:965) DEBUG2 [23936/24038]: UST event * not found on shadow copy channel (in shadow_copy_channel() at ust-app.c:1565) DEBUG3 [23936/24038]: UST app event * allocated (in alloc_ust_app_event() at ust-app.c:938) DEBUG3 [23936/24038]: UST app shadow copy of channel channel0 done (in shadow_copy_channel() at ust-app.c:1575) DEBUG3 [23936/24038]: Buffer registry per UID find id: 1, ABI: 64, uid: 0 (in buffer_reg_uid_find() at buffer-registry.c:195) DEBUG3 [23936/24038]: Created hashtable size 4 at 0x7ff0780036e0 of type 2 (in lttng_ht_new() at hashtable.c:127) DEBUG3 [23936/24038]: Buffer registry per UID created id: 1, ABI: 64, uid: 0, domain: 2 (in buffer_reg_uid_create() at buffer-registry.c:144) DEBUG3 [23936/24038]: Buffer registry per UID adding to global registry with id: 1 (in buffer_reg_uid_add() at buffer-registry.c:166) DEBUG3 [23936/24038]: Created hashtable size 4 at 0x7ff0780019c0 of type 2 (in lttng_ht_new() at hashtable.c:127) DEBUG3 [23936/24038]: Append to metadata: "typealias integer { size = 8; align = 8; signed = false; } := uint8_t; typealias integer { size = 16; align = 8; signed = false; } := uint16_t; typealias integer { size = 32; align = 8; signed = false; } := uint32_t; typealias integer { size = 64; align = 8; signed = false; } := uint64_t; typealias integer { size = 64; align = 8; signed = false; } := unsigned long; typealias integer { size = 5; align = 1; signed = false; } := uint5_t; typealias integer { size = 27; align = 1; signed = false; } := uint27_t; trace { major = 1; minor = 8; uuid = "10daa3ff-5866-4db5-9bf4-e5de1870ef48"; byte_order = le; packet.header := struct { uint32_t magic; uint8_t uuid[16]; uint32_t stream_id; }; }; " (in lttng_metadata_printf() at ust-metadata.c:151) DEBUG3 [23936/24038]: Append to metadata: "env { hostname = "precise1"; domain = "ust"; tracer_name = "lttng-ust"; tracer_major = 2; tracer_minor = 4; " (in lttng_metadata_printf() at ust-metadata.c:151) DEBUG3 [23936/24038]: Append to metadata: "}; " (in lttng_metadata_printf() at ust-metadata.c:151) DEBUG3 [23936/24038]: Append to metadata: "clock { name = monotonic; " (in lttng_metadata_printf() at ust-metadata.c:151) DEBUG3 [23936/24041]: UST thread notify added sock 34 to pollset (in ust_thread_manage_notify() at ust-thread.c:137) DEBUG3 [23936/24041]: [ust-thread] Manage notify polling on 3 fds (in ust_thread_manage_notify() at ust-thread.c:68) DEBUG3 [23936/24038]: Append to metadata: " uuid = "bf9718a3-41e8-4a99-b123-18bbc75dfd74"; " (in lttng_metadata_printf() at ust-metadata.c:151) DEBUG3 [23936/24038]: Append to metadata: " description = "Monotonic Clock"; freq = 1000000000; /* Frequency, in Hz */ /* clock value offset from Epoch is: offset * (1/freq) */ offset = 1398100962914504123; }; " (in lttng_metadata_printf() at ust-metadata.c:151) DEBUG3 [23936/24038]: Append to metadata: "typealias integer { size = 27; align = 1; signed = false; map = clock.monotonic.value; } := uint27_clock_monotonic_t; typealias integer { size = 32; align = 8; signed = false; map = clock.monotonic.value; } := uint32_clock_monotonic_t; typealias integer { size = 64; align = 8; signed = false; map = clock.monotonic.value; } := uint64_clock_monotonic_t; " (in lttng_metadata_printf() at ust-metadata.c:151) DEBUG3 [23936/24038]: Append to metadata: "struct packet_context { uint64_clock_monotonic_t timestamp_begin; uint64_clock_monotonic_t timestamp_end; uint64_t content_size; uint64_t packet_size; unsigned long events_discarded; uint32_t cpu_id; }; " (in lttng_metadata_printf() at ust-metadata.c:151) DEBUG3 [23936/24038]: Append to metadata: "struct event_header_compact { enum : uint5_t { compact = 0 ... 30, extended = 31 } id; variant { struct { uint27_clock_monotonic_t timestamp; } compact; struct { uint32_t id; uint64_clock_monotonic_t timestamp; } extended; } v; } align(8); struct event_header_large { enum : uint16_t { compact = 0 ... 65534, extended = 65535 } id; variant { struct { uint32_clock_monotonic_t timestamp; } compact; struct { uint32_t id; uint64_clock_monotonic_t timestamp; } extended; } v; } align(8); " (in lttng_metadata_printf() at ust-metadata.c:151) DEBUG3 [23936/24038]: UST app buffer registry per UID created successfully (in setup_buffer_reg_uid() at ust-app.c:1804) DEBUG2 [23936/24038]: UST app session created successfully with handle 1 (in create_ust_app_session() at ust-app.c:1910) DEBUG1 [23936/24038]: UST app creating channel channel0 with per UID buffers (in create_channel_per_uid() at ust-app.c:2437) DEBUG3 [23936/24038]: Buffer registry per UID find id: 1, ABI: 64, uid: 0 (in buffer_reg_uid_find() at buffer-registry.c:195) DEBUG2 [23936/24038]: UST app creating buffer registry channel for channel0 (in create_buffer_reg_channel() at ust-app.c:2290) DEBUG3 [23936/24038]: Buffer registry channel create with key: 0 (in buffer_reg_channel_create() at buffer-registry.c:326) DEBUG3 [23936/24038]: Created hashtable size 4 at 0x7ff078001e80 of type 0 (in lttng_ht_new() at hashtable.c:127) DEBUG2 [23936/24038]: Asking UST consumer for channel (in ask_channel_creation() at ust-consumer.c:118) DEBUG3 [23936/24038]: mkdir() recursive /root/lttng-traces/auto-20140421-133146/ust/uid/0/64-bit with mode 504 for uid 0 and gid 0 (in run_as_mkdir_recursive() at runas.c:308) DEBUG1 [23936/24038]: Using run_as_clone (in run_as() at runas.c:291) DEBUG3 [23936/24038]: UST registry channel finding key 0 (in ust_registry_channel_find() at ust-registry.c:489) DEBUG1 [24062/24068]: Incoming command on sock (in consumer_thread_sessiond_poll() at consumer.c:3068) DEBUG1 [24062/24068]: Allocated channel (key 2) (in consumer_allocate_channel() at consumer.c:999) DEBUG3 [24062/24068]: Creating channel to ustctl with attr: [overwrite: 0, subbuf_size: 131072, num_subbuf: 4, switch_timer_interval: 0, read_timer_interval: 0, output: 0, type: 0 (in create_ust_channel() at ust-consumer.c:361) DEBUG3 [24062/24068]: Allocated stream channel0_0 (key 27, chan_key 2 relayd_id 18446744073709551615, session_id 1 (in consumer_allocate_stream() at consumer.c:594) DEBUG3 [24062/24068]: open() /root/lttng-traces/auto-20140421-133146/ust/uid/0/64-bit/channel0_0 with flags 241 mode 432 for uid 0 and gid 0 (in run_as_open() at runas.c:336) DEBUG1 [24062/24068]: Using run_as_clone (in run_as() at runas.c:291) DEBUG3 [24062/24068]: mkdir() /root/lttng-traces/auto-20140421-133146/ust/uid/0/64-bit/index with mode 504 for uid 0 and gid 0 (in run_as_mkdir() at runas.c:320) DEBUG1 [24062/24068]: Using run_as_clone (in run_as() at runas.c:291) DEBUG3 [24062/24068]: open() /root/lttng-traces/auto-20140421-133146/ust/uid/0/64-bit/index/channel0_0.idx with flags 241 mode 432 for uid 0 and gid 0 (in run_as_open() at runas.c:336) DEBUG1 [24062/24068]: Using run_as_clone (in run_as() at runas.c:291) DEBUG1 [24062/24068]: UST consumer add stream channel0_0 (key: 27) with relayd id 0 (in create_ust_streams() at ust-consumer.c:321) DEBUG3 [24062/24068]: Allocated stream channel0_1 (key 31, chan_key 2 relayd_id 18446744073709551615, session_id 1 (in consumer_allocate_stream() at consumer.c:594) DEBUG3 [24062/24068]: open() /root/lttng-traces/auto-20140421-133146/ust/uid/0/64-bit/channel0_1 with flags 241 mode 432 for uid 0 and gid 0 (in run_as_open() at runas.c:336) DEBUG1 [24062/24068]: Using run_as_clone (in run_as() at runas.c:291) DEBUG3 [24062/24068]: mkdir() /root/lttng-traces/auto-20140421-133146/ust/uid/0/64-bit/index with mode 504 for uid 0 and gid 0 (in run_as_mkdir() at runas.c:320) DEBUG1 [24062/24068]: Using run_as_clone (in run_as() at runas.c:291) DEBUG3 [24062/24068]: open() /root/lttng-traces/auto-20140421-133146/ust/uid/0/64-bit/index/channel0_1.idx with flags 241 mode 432 for uid 0 and gid 0 (in run_as_open() at runas.c:336) DEBUG1 [24062/24068]: Using run_as_clone (in run_as() at runas.c:291) DEBUG1 [24062/24068]: UST consumer add stream channel0_1 (key: 31) with relayd id 0 (in create_ust_streams() at ust-consumer.c:321) DEBUG1 [24062/24068]: UST consumer channel added (key: 2) (in add_channel() at ust-consumer.c:111) DEBUG1 [24062/24068]: received command on sock (in consumer_thread_sessiond_poll() at consumer.c:3084) DEBUG1 [24062/24065]: Channel event catched in thread (in consumer_thread_channel_poll() at consumer.c:2759) DEBUG1 [24062/24065]: Adding channel 21 to poll set (in consumer_thread_channel_poll() at consumer.c:2803) DEBUG2 [23936/24038]: UST ask channel 2 successfully done with 2 stream(s) (in ask_channel_creation() at ust-consumer.c:195) DEBUG1 [24062/24065]: Channel poll wait with 2 fd(s) (in consumer_thread_channel_poll() at consumer.c:2755) DEBUG1 [24062/24068]: Incoming command on sock (in consumer_thread_sessiond_poll() at consumer.c:3068) DEBUG1 [24062/24068]: UST consumer sending channel channel0 to sessiond (in send_sessiond_channel() at ust-consumer.c:418) DEBUG1 [24062/24068]: UST consumer sending stream 27 to sessiond (in send_sessiond_stream() at ust-consumer.c:389) DEBUG1 [24062/24068]: UST consumer sending stream 31 to sessiond (in send_sessiond_stream() at ust-consumer.c:389) DEBUG2 [23936/24038]: UST app stream 1 received succesfully (in ust_consumer_get_channel() at ust-consumer.c:311) DEBUG1 [24062/24068]: UST consumer NULL stream sent to sessiond (in send_sessiond_channel() at ust-consumer.c:482) DEBUG2 [23936/24038]: UST app stream 2 received succesfully (in ust_consumer_get_channel() at ust-consumer.c:311) DEBUG3 [23936/24038]: UST app consumer has no more stream available (in ust_consumer_get_channel() at ust-consumer.c:294) DEBUG3 [24062/24068]: Adding consumer stream 27 (in consumer_add_data_stream() at consumer.c:620) DEBUG3 [24062/24068]: Adding consumer stream 31 (in consumer_add_data_stream() at consumer.c:620) DEBUG1 [24062/24068]: received command on sock (in consumer_thread_sessiond_poll() at consumer.c:3084) DEBUG2 [23936/24038]: UST app setup buffer registry channel for channel0 (in setup_buffer_reg_channel() at ust-app.c:2338) DEBUG2 [23936/24038]: UST app setup buffer registry stream (in setup_buffer_reg_streams() at ust-app.c:2245) DEBUG3 [23936/24038]: Buffer registry creating stream (in buffer_reg_stream_create() at buffer-registry.c:356) DEBUG3 [23936/24038]: Buffer registry creating stream (in buffer_reg_stream_create() at buffer-registry.c:356) DEBUG1 [23936/24038]: UST app sending buffer registry channel to ust sock 28 (in send_channel_uid_to_ust() at ust-app.c:2374) DEBUG2 [23936/24038]: UST app send channel to sock 28 pid 24376 (name: channel0, key: 0) (in ust_consumer_send_channel_to_ust() at ust-consumer.c:415) DEBUG1 [24062/24067]: poll num_rdy : 1 (in consumer_thread_data_poll() at consumer.c:2445) DEBUG1 [24062/24067]: consumer_data_pipe wake up (in consumer_thread_data_poll() at consumer.c:2469) DEBUG2 [23936/24038]: UST consumer send stream to app 28 (in ust_consumer_send_stream_to_ust() at ust-consumer.c:380) DEBUG2 [23936/24038]: UST consumer send stream to app 28 (in ust_consumer_send_stream_to_ust() at ust-consumer.c:380) DEBUG1 [24062/24067]: Updating poll fd array (in update_poll_array() at consumer.c:1059) Error: UST app create channel context failed for app (pid: 24376) with ret -1024 DEBUG3 [23936/24038]: Buffer registry per UID find id: 1, ABI: 64, uid: 0 (in buffer_reg_uid_find() at buffer-registry.c:195) DEBUG3 [23936/24038]: UST app deleting channel channel0 (in delete_ust_app_channel() at ust-app.c:374) DEBUG1 [24062/24067]: polling on 3 fd (in consumer_thread_data_poll() at consumer.c:2441) DEBUG1 [24062/24067]: poll num_rdy : 1 (in consumer_thread_data_poll() at consumer.c:2445) DEBUG1 [23936/24038]: Woken up but nothing in the UST command queue (in thread_dispatch_ust_registration() at main.c:1667) DEBUG1 [24062/24067]: consumer_data_pipe wake up (in consumer_thread_data_poll() at consumer.c:2469) DEBUG1 [23936/24040]: Apps with sock 28 added to poll set (in thread_manage_apps() at main.c:1449) DEBUG1 [23936/24040]: Apps thread polling on 3 fds (in thread_manage_apps() at main.c:1388) DEBUG1 [24062/24067]: polling on 3 fd (in consumer_thread_data_poll() at consumer.c:2441) DEBUG1 [23936/24040]: PID 24376 unregistering with sock 28 (in ust_app_unregister() at ust-app.c:2987) DEBUG1 [23936/24040]: Apps thread polling on 2 fds (in thread_manage_apps() at main.c:1388) DEBUG1 [23936/24041]: UST app notify socket unregister 34 (in ust_app_notify_sock_unregister() at ust-app.c:4857) DEBUG2 [23936/24041]: UST app find by notify sock 34 not found (in find_app_by_notify_sock() at ust-app.c:1029) DEBUG3 [23936/24041]: [ust-thread] Manage notify polling on 2 fds (in ust_thread_manage_notify() at ust-thread.c:68) DEBUG3 [23936/24130]: Call RCU deleting app PID 24376 (in delete_ust_app_rcu() at ust-app.c:780) DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64) DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64) DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64) DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64) DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64) DEBUG2 [23936/24130]: UST app pid 24376 deleted (in delete_ust_app() at ust-app.c:765) DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925) DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970) DEBUG1 [23936/24037]: Nothing recv() from client... continuing (in thread_manage_clients() at main.c:3974) DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675) DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883) DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925) DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970) DEBUG1 [23936/24037]: Processing client command 17 (in process_client_msg() at main.c:2704) DEBUG1 [23936/24037]: Getting session auto-20140421-133146 by name (in process_client_msg() at main.c:2785) DEBUG2 [23936/24037]: Trying to find session by name auto-20140421-133146 (in session_find_by_name() at session.c:169) DEBUG1 [23936/24037]: Stopping all UST traces (in ust_app_stop_trace_all() at ust-app.c:4060) DEBUG2 [23936/24037]: Consumer flush channel key 2 (in consumer_flush_channel() at consumer.c:1139) DEBUG1 [24062/24068]: Incoming command on sock (in consumer_thread_sessiond_poll() at consumer.c:3068) DEBUG1 [24062/24068]: UST consumer flush channel key 2 (in flush_channel() at ust-consumer.c:607) DEBUG1 [24062/24068]: received command on sock (in consumer_thread_sessiond_poll() at consumer.c:3084) DEBUG1 [24062/24067]: poll num_rdy : 2 (in consumer_thread_data_poll() at consumer.c:2445) DEBUG1 [24062/24067]: Normal read on fd 31 (in consumer_thread_data_poll() at consumer.c:2531) DEBUG1 [24062/24067]: In UST read_subbuffer (wait_fd: 31, name: channel0_1) (in lttng_ustconsumer_read_subbuffer() at ust-consumer.c:1878) DEBUG1 [24062/24067]: Consumer mmap write() ret 4096 (len 4096) (in lttng_consumer_on_read_subbuffer_mmap() at consumer.c:1603) DEBUG1 [24062/24067]: Normal read on fd 27 (in consumer_thread_data_poll() at consumer.c:2531) DEBUG1 [24062/24067]: In UST read_subbuffer (wait_fd: 27, name: channel0_0) (in lttng_ustconsumer_read_subbuffer() at ust-consumer.c:1878) DEBUG1 [24062/24067]: Consumer mmap write() ret 4096 (len 4096) (in lttng_consumer_on_read_subbuffer_mmap() at consumer.c:1603) DEBUG1 [24062/24067]: polling on 3 fd (in consumer_thread_data_poll() at consumer.c:2441) DEBUG1 [23936/24037]: Sending response (size: 16, retcode: Success) (in thread_manage_clients() at main.c:4019) DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675) DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883) DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925) DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970) DEBUG1 [23936/24037]: Processing client command 24 (in process_client_msg() at main.c:2704) DEBUG1 [23936/24037]: Getting session auto-20140421-133146 by name (in process_client_msg() at main.c:2785) DEBUG2 [23936/24037]: Trying to find session by name auto-20140421-133146 (in session_find_by_name() at session.c:169) DEBUG3 [23936/24037]: Consumer data pending for id 1 (in consumer_is_data_pending() at consumer.c:1083) DEBUG1 [24062/24068]: Incoming command on sock (in consumer_thread_sessiond_poll() at consumer.c:3068) DEBUG1 [24062/24068]: UST consumer data pending command for id 1 (in lttng_ustconsumer_recv_cmd() at ust-consumer.c:1177) DEBUG1 [24062/24068]: Consumer data pending command on session id 1 (in consumer_data_pending() at consumer.c:3491) DEBUG1 [24062/24068]: UST consumer checking data pending (in lttng_ustconsumer_data_pending() at ust-consumer.c:2053) DEBUG1 [24062/24068]: UST consumer checking data pending (in lttng_ustconsumer_data_pending() at ust-consumer.c:2053) DEBUG1 [24062/24068]: received command on sock (in consumer_thread_sessiond_poll() at consumer.c:3084) DEBUG1 [23936/24037]: Consumer data is NOT pending for session id 1 (in consumer_is_data_pending() at consumer.c:1119) DEBUG1 [23936/24037]: Sending response (size: 16, retcode: Unknown error code) (in thread_manage_clients() at main.c:4019) DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675) DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883) DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925) DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970) DEBUG1 [23936/24037]: Nothing recv() from client... continuing (in thread_manage_clients() at main.c:3974) DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675) DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883) DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925) DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970) DEBUG1 [23936/24037]: Processing client command 13 (in process_client_msg() at main.c:2704) DEBUG1 [23936/24037]: Counting number of available session for UID 0 GID 0 (in lttng_sessions_count() at main.c:2673) DEBUG1 [23936/24037]: Getting all available session for UID 0 GID 0 (in cmd_list_lttng_sessions() at cmd.c:2479) DEBUG1 [23936/24037]: Sending response (size: 4392, retcode: Success) (in thread_manage_clients() at main.c:4019) DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675) DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883) DEBUG1 [23936/24037]: Wait for client response (in thread_manage_clients() at main.c:3925) DEBUG1 [23936/24037]: Receiving data from client ... (in thread_manage_clients() at main.c:3970) DEBUG1 [23936/24037]: Processing client command 9 (in process_client_msg() at main.c:2704) DEBUG1 [23936/24037]: Getting session auto-20140421-133146 by name (in process_client_msg() at main.c:2785) DEBUG2 [23936/24037]: Trying to find session by name auto-20140421-133146 (in session_find_by_name() at session.c:169) DEBUG3 [23936/24037]: No kernel session when tearing down session (in kernel_destroy_session() at kernel.c:755) DEBUG1 [23936/24037]: Destroy all UST traces (in ust_app_destroy_trace_all() at ust-app.c:4139) DEBUG2 [23936/24037]: Trace UST destroy session 1 (in trace_ust_destroy_session() at trace-ust.c:719) DEBUG3 [23936/24037]: JUL destroy domain (in jul_destroy_domain() at jul.c:859) DEBUG3 [23936/24037]: Buffer registry per UID destroy with id: 1, ABI: 64, uid: 0 (in buffer_reg_uid_destroy() at buffer-registry.c:624) DEBUG1 [23936/24037]: Destroying session auto-20140421-133146 (in session_destroy() at session.c:194) DEBUG1 [23936/24037]: Sending response (size: 16, retcode: Success) (in thread_manage_clients() at main.c:4019) DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64) DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64) DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64) DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64) DEBUG1 [23936/24043]: Updating kernel poll set (in update_kernel_poll() at main.c:756) DEBUG1 [23936/24043]: Thread kernel polling on 2 fds (in thread_manage_kernel() at main.c:941) DEBUG1 [23936/24037]: Clean command context structure (in clean_command_ctx() at main.c:675) DEBUG1 [23936/24037]: Accepting client command ... (in thread_manage_clients() at main.c:3883) DEBUG2 [23936/24130]: Trace destroy UST channel channel0 (in _trace_ust_destroy_channel() at trace-ust.c:630) DEBUG3 [23936/24130]: Buffer registry session destroy (in buffer_reg_session_destroy() at buffer-registry.c:543) DEBUG3 [23936/24130]: Buffer registry channel destroy with key 0 (in buffer_reg_channel_destroy() at buffer-registry.c:498) DEBUG3 [23936/24130]: Buffer registry stream destroy with handle -1 (in buffer_reg_stream_destroy() at buffer-registry.c:446) DEBUG3 [23936/24130]: Buffer registry stream destroy with handle -1 (in buffer_reg_stream_destroy() at buffer-registry.c:446) DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64) DEBUG1 [24062/24065]: Channel event catched in thread (in consumer_thread_channel_poll() at consumer.c:2759) DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64) DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64) DEBUG1 [24062/24065]: Channel fd 21 is hup|err. (in consumer_thread_channel_poll() at consumer.c:2893) DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64) DEBUG1 [24062/24065]: Channel poll wait with 1 fd(s) (in consumer_thread_channel_poll() at consumer.c:2755) DEBUG1 [24062/24067]: poll num_rdy : 2 (in consumer_thread_data_poll() at consumer.c:2445) DEBUG1 [24062/24067]: fd 31 is hup|err|nval. Attempting flush and read. (in consumer_thread_data_poll() at consumer.c:2556) DEBUG1 [24062/24067]: Polling fd 31 tells it has hung up. (in consumer_thread_data_poll() at consumer.c:2567) DEBUG1 [24062/24067]: fd 27 is hup|err|nval. Attempting flush and read. (in consumer_thread_data_poll() at consumer.c:2556) DEBUG1 [24062/24067]: Polling fd 27 tells it has hung up. (in consumer_thread_data_poll() at consumer.c:2567) DEBUG1 [24062/24067]: polling on 3 fd (in consumer_thread_data_poll() at consumer.c:2441) DEBUG1 [24062/24067]: poll num_rdy : 2 (in consumer_thread_data_poll() at consumer.c:2445) DEBUG1 [24062/24067]: Normal read on fd 31 (in consumer_thread_data_poll() at consumer.c:2531) DEBUG1 [24062/24067]: In UST read_subbuffer (wait_fd: 31, name: channel0_1) (in lttng_ustconsumer_read_subbuffer() at ust-consumer.c:1878) DEBUG1 [24062/24067]: Consumer mmap write() ret 4096 (len 4096) (in lttng_consumer_on_read_subbuffer_mmap() at consumer.c:1603) DEBUG1 [24062/24067]: Normal read on fd 27 (in consumer_thread_data_poll() at consumer.c:2531) DEBUG1 [24062/24067]: In UST read_subbuffer (wait_fd: 27, name: channel0_0) (in lttng_ustconsumer_read_subbuffer() at ust-consumer.c:1878) DEBUG1 [24062/24067]: Consumer mmap write() ret 4096 (len 4096) (in lttng_consumer_on_read_subbuffer_mmap() at consumer.c:1603) DEBUG1 [24062/24067]: Polling fd 31 tells it has hung up. (in consumer_thread_data_poll() at consumer.c:2567) DEBUG1 [24062/24067]: Polling fd 27 tells it has hung up. (in consumer_thread_data_poll() at consumer.c:2567) DEBUG1 [24062/24067]: polling on 3 fd (in consumer_thread_data_poll() at consumer.c:2441) DEBUG1 [24062/24067]: poll num_rdy : 2 (in consumer_thread_data_poll() at consumer.c:2445) DEBUG1 [24062/24067]: Normal read on fd 31 (in consumer_thread_data_poll() at consumer.c:2531) DEBUG1 [24062/24067]: In UST read_subbuffer (wait_fd: 31, name: channel0_1) (in lttng_ustconsumer_read_subbuffer() at ust-consumer.c:1878) DEBUG1 [24062/24067]: Reserving sub buffer failed (everything is normal, it is due to concurrency) [ret: -11] (in lttng_ustconsumer_read_subbuffer() at ust-consumer.c:1923) DEBUG1 [24062/24067]: Normal read on fd 27 (in consumer_thread_data_poll() at consumer.c:2531) DEBUG1 [24062/24067]: In UST read_subbuffer (wait_fd: 27, name: channel0_0) (in lttng_ustconsumer_read_subbuffer() at ust-consumer.c:1878) DEBUG1 [24062/24067]: Reserving sub buffer failed (everything is normal, it is due to concurrency) [ret: -11] (in lttng_ustconsumer_read_subbuffer() at ust-consumer.c:1923) DEBUG1 [24062/24067]: Polling fd 31 tells it has hung up. (in consumer_thread_data_poll() at consumer.c:2567) DEBUG1 [24062/24067]: Consumer stream destroy monitored key: 31 (in destroy_close_stream() at consumer-stream.c:264) DEBUG1 [24062/24067]: Polling fd 27 tells it has hung up. (in consumer_thread_data_poll() at consumer.c:2567) DEBUG1 [24062/24067]: Consumer stream destroy monitored key: 27 (in destroy_close_stream() at consumer-stream.c:264) DEBUG1 [24062/24067]: Consumer delete channel key 2 (in consumer_del_channel() at consumer.c:347) DEBUG1 [24062/24067]: Updating poll fd array (in update_poll_array() at consumer.c:1059) DEBUG1 [24062/24067]: polling on 1 fd (in consumer_thread_data_poll() at consumer.c:2441) DEBUG2 [23936/24130]: Trace destroy UST event * (in trace_ust_destroy_event() at trace-ust.c:579) DEBUG3 [23936/24035]: [ht-thread] Polling on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:64)