LTTng bugs repository: Issueshttps://bugs.lttng.org/https://bugs.lttng.org/themes/lttng/favicon/a.ico?14249722912020-05-11T08:07:22ZLTTng bugs repository
Redmine LTTng-tools - Bug #1266 (Resolved): 2.12 fails to compile with C++ code when using session clear ...https://bugs.lttng.org/issues/12662020-05-11T08:07:22ZShuo Yang
<p>The below newly introduced header files:</p>
<ul>
<li><a class="external" href="https://github.com/lttng/lttng-tools/blob/stable-2.12/include/lttng/clear.h">https://github.com/lttng/lttng-tools/blob/stable-2.12/include/lttng/clear.h</a></li>
<li><a class="external" href="https://github.com/lttng/lttng-tools/blob/stable-2.12/include/lttng/clear-handle.h">https://github.com/lttng/lttng-tools/blob/stable-2.12/include/lttng/clear-handle.h</a></li>
</ul>
<p>miss the closing:</p>
<pre><code class="c syntaxhl" data-language="c"><span class="cp">#ifdef __cplusplus
</span><span class="err">}</span>
<span class="cp">#endif
</span></code></pre>
<p>section such that 2.12 fails to compile with C++ code when using session clear feature.</p>
<p>There might be some other headers also without the closing section that I didn't spot, please fix them altogether. Thanks!</p> LTTng-tools - Bug #1241 (Resolved): lttng_destroy_session_no_wait always return LTTNG_ERR_INVALID...https://bugs.lttng.org/issues/12412020-03-03T20:14:46ZShuo Yang
<p>The implementation of "lttng_destroy_session_no_wait" (<a class="external" href="https://github.com/lttng/lttng-tools/blob/stable-2.11/src/lib/lttng-ctl/lttng-ctl.c#L2051">https://github.com/lttng/lttng-tools/blob/stable-2.11/src/lib/lttng-ctl/lttng-ctl.c#L2051</a>) always returns "LTTNG_ERR_INVALID" in 2.11.</p>
<pre><code class="c syntaxhl" data-language="c"><span class="kt">int</span> <span class="nf">lttng_destroy_session_no_wait</span><span class="p">(</span><span class="k">const</span> <span class="kt">char</span> <span class="o">*</span><span class="n">session_name</span><span class="p">)</span>
<span class="p">{</span>
<span class="k">enum</span> <span class="n">lttng_error_code</span> <span class="n">ret_code</span><span class="p">;</span>
<span class="n">ret_code</span> <span class="o">=</span> <span class="n">lttng_destroy_session_ext</span><span class="p">(</span><span class="n">session_name</span><span class="p">,</span> <span class="nb">NULL</span><span class="p">);</span>
<span class="k">return</span> <span class="n">ret_code</span> <span class="o">==</span> <span class="n">LTTNG_OK</span> <span class="o">?</span> <span class="n">ret_code</span> <span class="o">:</span> <span class="o">-</span><span class="n">ret_code</span><span class="p">;</span>
<span class="p">}</span>
</code></pre>
<p>It calls "lttng_destroy_session_ext" with the second argument "_handle" as NULL, which causes LTTNG_ERR_INVALID to be returned. (<a class="external" href="https://github.com/lttng/lttng-tools/blob/stable-2.11/src/lib/lttng-ctl/destruction-handle.c#L407">https://github.com/lttng/lttng-tools/blob/stable-2.11/src/lib/lttng-ctl/destruction-handle.c#L407</a>)</p>
<pre><code class="c syntaxhl" data-language="c"> <span class="k">if</span> <span class="p">(</span><span class="o">!</span><span class="n">session_name</span> <span class="o">||</span> <span class="o">!</span><span class="n">_handle</span><span class="p">)</span> <span class="p">{</span>
<span class="n">ret_code</span> <span class="o">=</span> <span class="n">LTTNG_ERR_INVALID</span><span class="p">;</span>
<span class="k">goto</span> <span class="n">error</span><span class="p">;</span>
<span class="p">}</span>
</code></pre>
<p>Thus calling to "lttng_destroy_session_no_wait" won't actually destroy the session.</p> LTTng-UST - Bug #1171 (Resolved): lttng_ust_delete_fd_from_tracker: Assertion failurehttps://bugs.lttng.org/issues/11712018-11-14T18:38:17ZStefan Palade
<pre>
$> ./lttng_ust_elf_test
..lttng_ust_delete_fd_from_tracker: Assertion `IS_FD_SET(fd, lttng_fd_set)' failed.
Aborted
</pre>
<p>It seems to be introduced in 2.9.3 and 2.10.1 ( <a class="external" href="http://git.lttng.org/?p=lttng-ust.git;a=commit;h=0dd6b494078f56264600e17d93e6c980f8bc36ba">http://git.lttng.org/?p=lttng-ust.git;a=commit;h=0dd6b494078f56264600e17d93e6c980f8bc36ba</a> )</p>
<p>ANALYSIS:<br />It seems the file descriptor is initialized to 0 in lttng_ust_elf_create() and later on it is trying to clean up in error path when the file ("/home/..... (deleted)") can not be opened. Not really sure how it can be triggered from application, but the executable have of some reason been deleted at the time it tries to read ELF info.</p>
<p>Please see the attached test program for triggering.<br />We have a fix proposal but I'm inclined to see your opinion on root cause maybe these a deeper reason why this happens.</p> LTTng-tools - Bug #1119 (Resolved): Channel blocking timer is not saved (and loaded) by the lttng...https://bugs.lttng.org/issues/11192017-06-13T01:31:54ZJérémie Galarneaujeremie.galarneau@efficios.comLTTng-tools - Bug #1103 (Resolved): lttng-sessiond reports an unknown kernel channel being remove...https://bugs.lttng.org/issues/11032017-05-11T22:45:49ZJérémie Galarneaujeremie.galarneau@efficios.com
<p>Reported by Mathieu Desnoyers:</p>
<p>Reproduction steps:<br /><pre>
#lttng-sessiond -vvv (as root)
# lttng create
# lttng enable-event -k -a
Shutdown lttng-sessiond using CTRL-C (SIGINT).
</pre></p>
<p>Resulting log:<br /><pre>
root@thinkos:/home/compudj/git/lttng-tools# lttng-sessiond -vvv
DEBUG1 - 08:04:29.408641 [20546/20546]: Health check time delta in seconds set to 20 (in health_init() at health.c:73)
DEBUG3 - 08:04:29.409068 [20546/20546]: Creating LTTng run directory: /var/run/lttng (in create_lttng_rundir() at main.c:5351)
DEBUG1 - 08:04:29.409082 [20546/20547]: [ht-thread] startup. (in thread_ht_cleanup() at ht-cleanup.c:101)
DEBUG2 - 08:04:29.409212 [20546/20546]: Kernel consumer err path: /var/run/lttng/kconsumerd/error (in main() at main.c:5777)
DEBUG2 - 08:04:29.409231 [20546/20546]: Kernel consumer cmd path: /var/run/lttng/kconsumerd/command (in main() at main.c:5779)
DEBUG1 - 08:04:29.409283 [20546/20547]: epoll set max size is 1364910 (in compat_epoll_set_max_size() at compat-epoll.c:329)
DEBUG1 - 08:04:29.409356 [20546/20546]: Client socket path /var/run/lttng/client-lttng-sessiond (in main() at main.c:5872)
DEBUG1 - 08:04:29.409381 [20546/20546]: Application socket path /var/run/lttng/lttng-ust-sock-7 (in main() at main.c:5873)
DEBUG1 - 08:04:29.409385 [20546/20546]: Application wait path /lttng-ust-wait-7 (in main() at main.c:5874)
DEBUG1 - 08:04:29.409395 [20546/20546]: LTTng run directory path: /var/run/lttng (in main() at main.c:5875)
DEBUG3 - 08:04:29.409417 [20546/20547]: [ht-thread] Polling. (in thread_ht_cleanup() at ht-cleanup.c:124)
DEBUG2 - 08:04:29.409450 [20546/20546]: UST consumer 32 bits err path: /var/run/lttng/ustconsumerd32/error (in main() at main.c:5894)
DEBUG2 - 08:04:29.409458 [20546/20546]: UST consumer 32 bits cmd path: /var/run/lttng/ustconsumerd32/command (in main() at main.c:5896)
DEBUG2 - 08:04:29.409509 [20546/20546]: UST consumer 64 bits err path: /var/run/lttng/ustconsumerd64/error (in main() at main.c:5927)
DEBUG2 - 08:04:29.409523 [20546/20546]: UST consumer 64 bits cmd path: /var/run/lttng/ustconsumerd64/command (in main() at main.c:5929)
DEBUG3 - 08:04:29.409750 [20546/20546]: Created hashtable size 4 at 0x2250d90 of type 1 (in lttng_ht_new() at hashtable.c:145)
DEBUG3 - 08:04:29.409783 [20546/20546]: Created hashtable size 4 at 0x22512b0 of type 1 (in lttng_ht_new() at hashtable.c:145)
DEBUG3 - 08:04:29.409788 [20546/20546]: Created hashtable size 4 at 0x22517f0 of type 1 (in lttng_ht_new() at hashtable.c:145)
DEBUG3 - 08:04:29.409803 [20546/20546]: Created hashtable size 4 at 0x2251d30 of type 1 (in lttng_ht_new() at hashtable.c:145)
DEBUG2 - 08:04:29.409810 [20546/20546]: Creating consumer directory: /var/run/lttng/kconsumerd (in set_consumer_sockets() at main.c:5393)
DEBUG1 - 08:04:29.429306 [20546/20546]: Modprobe successfully lttng-ring-buffer-client-discard (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.431757 [20546/20546]: Modprobe successfully lttng-ring-buffer-client-overwrite (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.435722 [20546/20546]: Modprobe successfully lttng-ring-buffer-metadata-client (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.440339 [20546/20546]: Modprobe successfully lttng-ring-buffer-client-mmap-discard (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.442864 [20546/20546]: Modprobe successfully lttng-ring-buffer-client-mmap-overwrite (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.444934 [20546/20546]: Modprobe successfully lttng-ring-buffer-metadata-mmap-client (in modprobe_lttng() at modprobe.c:345)
DEBUG2 - 08:04:29.444965 [20546/20546]: Kernel tracer version validated (2.10, ABI 2.3) (in kernel_validate_version() at kernel.c:840)
DEBUG1 - 08:04:29.446845 [20546/20546]: Modprobe successfully lttng-probe-asoc (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.448808 [20546/20546]: Modprobe successfully lttng-probe-block (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.453241 [20546/20546]: Modprobe successfully lttng-probe-btrfs (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.455197 [20546/20546]: Modprobe successfully lttng-probe-compaction (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.456334 [20546/20546]: Unable to load optional module lttng-probe-ext3; continuing (in modprobe_lttng() at modprobe.c:341)
DEBUG1 - 08:04:29.458463 [20546/20546]: Modprobe successfully lttng-probe-ext4 (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.460221 [20546/20546]: Modprobe successfully lttng-probe-gpio (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.462006 [20546/20546]: Modprobe successfully lttng-probe-i2c (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.464033 [20546/20546]: Modprobe successfully lttng-probe-irq (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.465298 [20546/20546]: Unable to load optional module lttng-probe-jbd; continuing (in modprobe_lttng() at modprobe.c:341)
DEBUG1 - 08:04:29.466945 [20546/20546]: Modprobe successfully lttng-probe-jbd2 (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.468708 [20546/20546]: Modprobe successfully lttng-probe-kmem (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.470420 [20546/20546]: Modprobe successfully lttng-probe-kvm (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.475786 [20546/20546]: Modprobe successfully lttng-probe-kvm-x86 (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.477980 [20546/20546]: Modprobe successfully lttng-probe-kvm-x86-mmu (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.479066 [20546/20546]: Unable to load optional module lttng-probe-lock; continuing (in modprobe_lttng() at modprobe.c:341)
DEBUG1 - 08:04:29.480891 [20546/20546]: Modprobe successfully lttng-probe-module (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.482707 [20546/20546]: Modprobe successfully lttng-probe-napi (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.487124 [20546/20546]: Modprobe successfully lttng-probe-net (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.489084 [20546/20546]: Modprobe successfully lttng-probe-power (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.490802 [20546/20546]: Modprobe successfully lttng-probe-printk (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.492558 [20546/20546]: Modprobe successfully lttng-probe-random (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.494406 [20546/20546]: Modprobe successfully lttng-probe-rcu (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.496154 [20546/20546]: Modprobe successfully lttng-probe-regmap (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.497547 [20546/20546]: Unable to load optional module lttng-probe-regulator; continuing (in modprobe_lttng() at modprobe.c:341)
DEBUG1 - 08:04:29.498474 [20546/20546]: Unable to load optional module lttng-probe-rpm; continuing (in modprobe_lttng() at modprobe.c:341)
DEBUG1 - 08:04:29.500106 [20546/20546]: Modprobe successfully lttng-probe-sched (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.502030 [20546/20546]: Modprobe successfully lttng-probe-scsi (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.503711 [20546/20546]: Modprobe successfully lttng-probe-signal (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.505580 [20546/20546]: Modprobe successfully lttng-probe-skb (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.509012 [20546/20546]: Modprobe successfully lttng-probe-sock (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.511110 [20546/20546]: Modprobe successfully lttng-probe-statedump (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.513169 [20546/20546]: Modprobe successfully lttng-probe-sunrpc (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.514881 [20546/20546]: Modprobe successfully lttng-probe-timer (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.518393 [20546/20546]: Modprobe successfully lttng-probe-udp (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.521389 [20546/20546]: Modprobe successfully lttng-probe-vmscan (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.523189 [20546/20546]: Modprobe successfully lttng-probe-v4l2 (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.525143 [20546/20546]: Modprobe successfully lttng-probe-workqueue (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.527161 [20546/20546]: Modprobe successfully lttng-probe-writeback (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.529114 [20546/20546]: Modprobe successfully lttng-probe-x86-irq-vectors (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.531365 [20546/20546]: Modprobe successfully lttng-probe-x86-exceptions (in modprobe_lttng() at modprobe.c:345)
DEBUG1 - 08:04:29.531380 [20546/20546]: Kernel tracer fd 18 (in init_kernel_tracer() at main.c:2797)
DEBUG3 - 08:04:29.531384 [20546/20546]: Syscall init system call table (in syscall_init_table() at syscall.c:53)
DEBUG1 - 08:04:29.531625 [20546/20546]: Reallocating syscall table from 256 to 512 entries (in syscall_init_table() at syscall.c:99)
DEBUG1 - 08:04:29.531916 [20546/20546]: Reallocating syscall table from 512 to 1024 entries (in syscall_init_table() at syscall.c:99)
DEBUG2 - 08:04:29.532085 [20546/20546]: Creating consumer directory: /var/run/lttng/ustconsumerd64 (in set_consumer_sockets() at main.c:5393)
DEBUG2 - 08:04:29.532131 [20546/20546]: Creating consumer directory: /var/run/lttng/ustconsumerd32 (in set_consumer_sockets() at main.c:5393)
DEBUG3 - 08:04:29.532172 [20546/20546]: Session daemon client socket 21 and application socket 22 created (in init_daemon_socket() at main.c:5259)
DEBUG1 - 08:04:29.532192 [20546/20546]: All permissions are set (in set_permissions() at main.c:5339)
DEBUG3 - 08:04:29.532207 [20546/20546]: Created hashtable size 4 at 0x2255000 of type 2 (in lttng_ht_new() at hashtable.c:145)
DEBUG3 - 08:04:29.532211 [20546/20546]: Global buffer per UID registry initialized (in buffer_reg_init_uid_registry() at buffer-registry.c:99)
DEBUG3 - 08:04:29.532215 [20546/20546]: Created hashtable size 4 at 0x2255540 of type 2 (in lttng_ht_new() at hashtable.c:145)
DEBUG3 - 08:04:29.532217 [20546/20546]: Global buffer per PID registry initialized (in buffer_reg_init_pid_registry() at buffer-registry.c:228)
DEBUG1 - 08:04:29.532221 [20546/20546]: Command subsystem initialized (in cmd_init() at cmd.c:4074)
DEBUG1 - 08:04:29.532239 [20546/20546]: Pid 20546 written in file /var/run/lttng/lttng-sessiond.pid (in utils_create_pid_file() at utils.c:507)
DEBUG1 - 08:04:29.532250 [20546/20546]: Pid 5345 written in file /var/run/lttng/agent.port (in utils_create_pid_file() at utils.c:507)
DEBUG1 - 08:04:29.532266 [20546/20546]: TCP inet operation timeout set to 216 sec (in lttcomm_inet_init() at inet.c:547)
DEBUG1 - 08:04:29.532294 [20546/20643]: [thread] Manage health check started (in thread_manage_health() at main.c:4242)
DEBUG1 - 08:04:29.532322 [20546/20644]: [notification-thread] Started notification thread (in thread_notification() at notification-thread.c:600)
DEBUG1 - 08:04:29.532342 [20546/20645]: [thread] Manage client started (in thread_manage_clients() at main.c:4433)
DEBUG1 - 08:04:29.532361 [20546/20646]: [thread] Dispatch UST command started (in thread_dispatch_ust_registration() at main.c:1936)
DEBUG1 - 08:04:29.532416 [20546/20644]: [notification-thread] Creating notification channel UNIX socket at /var/run/lttng/sessiond-notification (in notification_channel_socket_create() at notification-thread.c:339)
DEBUG1 - 08:04:29.532418 [20546/20646]: Futex n to 1 prepare done (in futex_nto1_prepare() at futex.c:77)
DEBUG1 - 08:04:29.532435 [20546/20646]: Woken up but nothing in the UST command queue (in thread_dispatch_ust_registration() at main.c:1959)
DEBUG1 - 08:04:29.532464 [20546/20649]: [ust-thread] Manage application notify command (in ust_thread_manage_notify() at ust-thread.c:40)
DEBUG1 - 08:04:29.532442 [20546/20647]: [thread] Manage application registration started (in thread_registration_apps() at main.c:2177)
DEBUG1 - 08:04:29.532525 [20546/20643]: Health check ready (in thread_manage_health() at main.c:4304)
DEBUG1 - 08:04:29.532456 [20546/20648]: [thread] Manage application started (in thread_manage_apps() at main.c:1622)
DEBUG1 - 08:04:29.532524 [20546/20652]: [load-session-thread] Load session (in thread_load_session() at load-session-thread.c:91)
DEBUG1 - 08:04:29.532544 [20546/20648]: Apps thread polling (in thread_manage_apps() at main.c:1652)
DEBUG1 - 08:04:29.532476 [20546/20650]: [agent-thread] Manage agent application registration. (in agent_thread_manage_registration() at agent-thread.c:236)
DEBUG1 - 08:04:29.532494 [20546/20651]: [thread] Thread manage kernel started (in thread_manage_kernel() at main.c:1090)
DEBUG1 - 08:04:29.532528 [20546/20647]: Notifying applications of session daemon state: 1 (in notify_ust_apps() at main.c:841)
DEBUG3 - 08:04:29.532566 [20546/20650]: URI string: tcp://localhost (in uri_parse() at uri.c:324)
DEBUG1 - 08:04:29.532437 [20546/20645]: Accepting client command ... (in thread_manage_clients() at main.c:4480)
DEBUG1 - 08:04:29.532612 [20546/20647]: Got the wait shm fd 39 (in get_wait_shm() at shm.c:115)
DEBUG1 - 08:04:29.532633 [20546/20651]: Updating kernel poll set (in update_kernel_poll() at main.c:925)
DEBUG1 - 08:04:29.532637 [20546/20651]: Thread kernel polling (in thread_manage_kernel() at main.c:1135)
DEBUG1 - 08:04:29.532643 [20546/20647]: Futex wait update active 1 (in futex_wait_update() at futex.c:65)
DEBUG1 - 08:04:29.532645 [20546/20647]: Accepting application registration (in thread_registration_apps() at main.c:2214)
DEBUG1 - 08:04:29.532659 [20546/20644]: [notification-thread] Notification channel UNIX socket created (fd = 33) (in notification_channel_socket_create() at notification-thread.c:366)
DEBUG3 - 08:04:29.532665 [20546/20649]: [ust-thread] Manage notify polling (in ust_thread_manage_notify() at ust-thread.c:69)
DEBUG1 - 08:04:29.532685 [20546/20644]: [notification-thread] Listening on notification channel socket (in init_thread_state() at notification-thread.c:505)
DEBUG1 - 08:04:29.532698 [20546/20644]: [notification-thread] Entering poll wait (in thread_notification() at notification-thread.c:625)
DEBUG2 - 08:04:29.532749 [20546/20650]: IP address resolved to 127.0.0.1 (in set_ip_address() at uri.c:165)
DEBUG3 - 08:04:29.532752 [20546/20650]: URI dtype: 1, proto: 1, host: localhost, subdir: , ctrl: 0, data: 0 (in uri_parse() at uri.c:538)
DEBUG1 - 08:04:29.532766 [20546/20650]: [agent-thread] Listening on TCP port 5345 and socket 39 (in init_tcp_socket() at agent-thread.c:119)
DEBUG3 - 08:04:29.532770 [20546/20650]: [agent-thread] Manage agent polling (in agent_thread_manage_registration() at agent-thread.c:263)
DEBUG1 - 08:04:32.442640 [20546/20645]: Wait for client response (in thread_manage_clients() at main.c:4532)
DEBUG1 - 08:04:32.442679 [20546/20645]: Receiving data from client ... (in thread_manage_clients() at main.c:4577)
DEBUG1 - 08:04:32.442689 [20546/20645]: Nothing recv() from client... continuing (in thread_manage_clients() at main.c:4581)
DEBUG1 - 08:04:32.442698 [20546/20645]: Clean command context structure (in clean_command_ctx() at main.c:821)
DEBUG1 - 08:04:32.442702 [20546/20645]: Accepting client command ... (in thread_manage_clients() at main.c:4480)
DEBUG1 - 08:04:32.442706 [20546/20645]: Wait for client response (in thread_manage_clients() at main.c:4532)
DEBUG1 - 08:04:32.442713 [20546/20645]: Receiving data from client ... (in thread_manage_clients() at main.c:4577)
DEBUG1 - 08:04:32.442717 [20546/20645]: Nothing recv() from client... continuing (in thread_manage_clients() at main.c:4581)
DEBUG1 - 08:04:32.442720 [20546/20645]: Clean command context structure (in clean_command_ctx() at main.c:821)
DEBUG1 - 08:04:32.442722 [20546/20645]: Accepting client command ... (in thread_manage_clients() at main.c:4480)
DEBUG1 - 08:04:32.442724 [20546/20645]: Wait for client response (in thread_manage_clients() at main.c:4532)
DEBUG1 - 08:04:32.442728 [20546/20645]: Receiving data from client ... (in thread_manage_clients() at main.c:4577)
DEBUG1 - 08:04:32.442731 [20546/20645]: Nothing recv() from client... continuing (in thread_manage_clients() at main.c:4581)
DEBUG1 - 08:04:32.442734 [20546/20645]: Clean command context structure (in clean_command_ctx() at main.c:821)
DEBUG1 - 08:04:32.442736 [20546/20645]: Accepting client command ... (in thread_manage_clients() at main.c:4480)
DEBUG1 - 08:04:32.442738 [20546/20645]: Wait for client response (in thread_manage_clients() at main.c:4532)
DEBUG1 - 08:04:32.442742 [20546/20645]: Receiving data from client ... (in thread_manage_clients() at main.c:4577)
DEBUG1 - 08:04:32.442760 [20546/20645]: Processing client command 8 (in process_client_msg() at main.c:3049)
DEBUG1 - 08:04:32.442770 [20546/20645]: Waiting for 1 URIs from client ... (in process_client_msg() at main.c:3832)
DEBUG2 - 08:04:32.442775 [20546/20645]: Trying to find session by name auto-20170508-080432 (in session_find_by_name() at session.c:276)
DEBUG3 - 08:04:32.442788 [20546/20645]: Created hashtable size 4 at 0x7f92e4006f00 of type 1 (in lttng_ht_new() at hashtable.c:145)
DEBUG1 - 08:04:32.442791 [20546/20645]: Allocating ltt_sessions_ht_by_id (in ltt_sessions_ht_alloc() at session.c:153)
DEBUG3 - 08:04:32.442794 [20546/20645]: Created hashtable size 4 at 0x7f92e4007440 of type 2 (in lttng_ht_new() at hashtable.c:145)
DEBUG1 - 08:04:32.442801 [20546/20645]: Tracing session auto-20170508-080432 created with ID 0 by UID 1000 GID 1000 (in session_create() at session.c:420)
DEBUG2 - 08:04:32.442804 [20546/20645]: Trying to find session by name auto-20170508-080432 (in session_find_by_name() at session.c:276)
DEBUG3 - 08:04:32.442816 [20546/20645]: Created hashtable size 4 at 0x7f92e400c9f0 of type 1 (in lttng_ht_new() at hashtable.c:145)
DEBUG2 - 08:04:32.442818 [20546/20645]: Setting trace directory path from URI to /home/compudj/lttng-traces/auto-20170508-080432 (in add_uri_to_consumer() at cmd.c:777)
DEBUG1 - 08:04:32.442825 [20546/20645]: Sending response (size: 20, retcode: Success (10)) (in thread_manage_clients() at main.c:4627)
DEBUG1 - 08:04:32.442833 [20546/20645]: Clean command context structure (in clean_command_ctx() at main.c:821)
DEBUG1 - 08:04:32.442835 [20546/20645]: Accepting client command ... (in thread_manage_clients() at main.c:4480)
DEBUG1 - 08:04:33.509052 [20546/20645]: Wait for client response (in thread_manage_clients() at main.c:4532)
DEBUG1 - 08:04:33.509079 [20546/20645]: Receiving data from client ... (in thread_manage_clients() at main.c:4577)
DEBUG1 - 08:04:33.509086 [20546/20645]: Nothing recv() from client... continuing (in thread_manage_clients() at main.c:4581)
DEBUG1 - 08:04:33.509093 [20546/20645]: Clean command context structure (in clean_command_ctx() at main.c:821)
DEBUG1 - 08:04:33.509096 [20546/20645]: Accepting client command ... (in thread_manage_clients() at main.c:4480)
DEBUG1 - 08:04:33.509100 [20546/20645]: Wait for client response (in thread_manage_clients() at main.c:4532)
DEBUG1 - 08:04:33.509105 [20546/20645]: Receiving data from client ... (in thread_manage_clients() at main.c:4577)
DEBUG1 - 08:04:33.509117 [20546/20645]: Processing client command 6 (in process_client_msg() at main.c:3049)
DEBUG1 - 08:04:33.509123 [20546/20645]: Getting session auto-20170508-080432 by name (in process_client_msg() at main.c:3142)
DEBUG2 - 08:04:33.509129 [20546/20645]: Trying to find session by name auto-20170508-080432 (in session_find_by_name() at session.c:276)
DEBUG1 - 08:04:33.509134 [20546/20645]: Creating kernel session (in create_kernel_session() at main.c:2965)
DEBUG3 - 08:04:33.509153 [20546/20645]: Created hashtable size 4 at 0x7f92e4003d30 of type 1 (in lttng_ht_new() at hashtable.c:145)
DEBUG1 - 08:04:33.509187 [20546/20645]: Kernel session created (fd: 42) (in kernel_create_session() at kernel.c:111)
DEBUG3 - 08:04:33.509192 [20546/20645]: Copying tracing session consumer output in kernel session (in copy_session_consumer() at main.c:2847)
DEBUG3 - 08:04:33.509227 [20546/20645]: Created hashtable size 4 at 0x7f92e4004270 of type 1 (in lttng_ht_new() at hashtable.c:145)
DEBUG3 - 08:04:33.509229 [20546/20547]: [ht-thread] Returning from poll on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:128)
DEBUG3 - 08:04:33.509237 [20546/20645]: Copy session consumer subdir /kernel (in copy_session_consumer() at main.c:2885)
DEBUG3 - 08:04:33.509244 [20546/20547]: [ht-thread] Polling. (in thread_ht_cleanup() at ht-cleanup.c:124)
DEBUG3 - 08:04:33.509242 [20546/20645]: mkdir() recursive /home/compudj/lttng-traces/auto-20170508-080432 with mode 504 for uid 1000 and gid 1000 (in run_as_mkdir_recursive() at runas.c:471)
DEBUG1 - 08:04:33.509256 [20546/20645]: Using run_as without worker (in run_as() at runas.c:458)
DEBUG1 - 08:04:33.509309 [20546/20645]: Spawning consumerd (in spawn_consumerd() at main.c:2554)
DEBUG2 - 08:04:33.509495 [20546/20645]: Consumer pid 20667 (in start_consumerd() at main.c:2739)
DEBUG2 - 08:04:33.509504 [20546/20645]: Spawning consumer control thread (in start_consumerd() at main.c:2742)
DEBUG3 - 08:04:33.509534 [20667/20667]: Looking for a kernel consumer at these locations: (in spawn_consumerd() at main.c:2576)
DEBUG3 - 08:04:33.509564 [20667/20667]: 1) /usr/local/lib/lttng/libexec/lttng-consumerd (in spawn_consumerd() at main.c:2577)
DEBUG3 - 08:04:33.509567 [20667/20667]: 2) /usr/local/lib/lttng/libexec/lttng-consumerd (in spawn_consumerd() at main.c:2578)
DEBUG3 - 08:04:33.509570 [20667/20667]: 3) (in spawn_consumerd() at main.c:2579)
DEBUG3 - 08:04:33.509580 [20667/20667]: Found location #1 (in spawn_consumerd() at main.c:2581)
DEBUG1 - 08:04:33.509583 [20667/20667]: Using kernel consumer at: /usr/local/lib/lttng/libexec/lttng-consumerd (in spawn_consumerd() at main.c:2594)
DEBUG1 - 08:04:33.510569 [20546/20668]: [thread] Manage consumer started (in thread_manage_consumer() at main.c:1265)
DEBUG2 - 08:04:33.510596 [20546/20668]: Receiving code from consumer err_sock (in thread_manage_consumer() at main.c:1363)
DEBUG1 - 08:04:33.610805 [20546/20668]: Consumer command socket ready (fd: 45 (in thread_manage_consumer() at main.c:1403)
DEBUG1 - 08:04:33.610822 [20546/20668]: Consumer metadata socket ready (fd: 46) (in thread_manage_consumer() at main.c:1405)
DEBUG3 - 08:04:33.610836 [20546/20668]: Sending set_channel_monitor_pipe command to consumer (in consumer_send_channel_monitor_pipe() at consumer.c:1065)
DEBUG3 - 08:04:33.610873 [20546/20668]: Sending channel monitoring pipe 11 to consumer on socket 45 (in consumer_send_channel_monitor_pipe() at consumer.c:1072)
DEBUG2 - 08:04:33.610895 [20546/20668]: Channel monitoring pipe successfully sent (in consumer_send_channel_monitor_pipe() at consumer.c:1078)
DEBUG3 - 08:04:33.610955 [20546/20645]: Consumer socket created (fd: 45) and added to output (in consumer_create_socket() at consumer.c:301)
DEBUG1 - 08:04:33.610965 [20546/20645]: Setting relayd for session auto-20170508-080432 (in cmd_setup_relayd() at cmd.c:1026)
DEBUG1 - 08:04:33.610971 [20546/20645]: Enable event command for event '*' (in _cmd_enable_event() at cmd.c:1807)
DEBUG1 - 08:04:33.610975 [20546/20645]: Trying to find channel channel0 (in trace_kernel_get_channel_by_name() at trace-kernel.c:50)
DEBUG1 - 08:04:33.610983 [20546/20645]: Enabling channel for session auto-20170508-080432 (in cmd_enable_channel() at cmd.c:1329)
DEBUG1 - 08:04:33.610987 [20546/20645]: Trying to find channel channel0 (in trace_kernel_get_channel_by_name() at trace-kernel.c:50)
DEBUG3 - 08:04:33.610993 [20546/20645]: Kernel create channel with attr: 0, 1048576, 4, 0, 200000, 0, 0 (in kernel_create_channel() at kernel.c:145)
DEBUG1 - 08:04:33.614259 [20546/20645]: Kernel channel channel0 created (fd: 47) (in kernel_create_channel() at kernel.c:167)
DEBUG1 - 08:04:33.614319 [20546/20651]: Thread kernel return from poll on 2 fds (in thread_manage_kernel() at main.c:1142)
DEBUG1 - 08:04:33.614365 [20546/20651]: Updating kernel poll set (in update_kernel_poll() at main.c:925)
DEBUG1 - 08:04:33.614381 [20546/20645]: Kernel quiescent wait on 18 (in kernel_wait_quiescent() at kernel.c:570)
DEBUG1 - 08:04:33.632019 [20546/20645]: Trying to find channel channel0 (in trace_kernel_get_channel_by_name() at trace-kernel.c:50)
DEBUG1 - 08:04:33.632106 [20546/20645]: Found channel by name channel0 (in trace_kernel_get_channel_by_name() at trace-kernel.c:54)
DEBUG1 - 08:04:33.632189 [20546/20645]: Event * created (fd: 48) (in kernel_create_event() at kernel.c:252)
DEBUG1 - 08:04:33.632218 [20546/20645]: Event * created (fd: 49) (in kernel_create_event() at kernel.c:252)
DEBUG1 - 08:04:33.632228 [20546/20645]: Kernel quiescent wait on 18 (in kernel_wait_quiescent() at kernel.c:570)
DEBUG1 - 08:04:33.659967 [20546/20645]: Sending response (size: 20, retcode: Success (10)) (in thread_manage_clients() at main.c:4627)
DEBUG1 - 08:04:33.659994 [20546/20651]: Channel fd 47 added to kernel set (in update_kernel_poll() at main.c:943)
DEBUG1 - 08:04:33.660008 [20546/20645]: Clean command context structure (in clean_command_ctx() at main.c:821)
DEBUG1 - 08:04:33.660016 [20546/20645]: Accepting client command ... (in thread_manage_clients() at main.c:4480)
DEBUG1 - 08:04:33.660008 [20546/20651]: Thread kernel polling (in thread_manage_kernel() at main.c:1135)
DEBUG1 - 08:04:33.660030 [20546/20651]: Thread kernel return from poll on 3 fds (in thread_manage_kernel() at main.c:1142)
DEBUG1 - 08:04:33.660035 [20546/20651]: Updating kernel streams for channel fd 47 (in update_kernel_stream() at main.c:969)
DEBUG1 - 08:04:33.660038 [20546/20651]: Channel found, updating kernel streams (in update_kernel_stream() at main.c:988)
DEBUG1 - 08:04:33.660047 [20546/20651]: Kernel stream channel0_0 created (fd: 41, state: 0) (in kernel_open_channel_stream() at kernel.c:684)
DEBUG1 - 08:04:33.660051 [20546/20651]: Kernel stream channel0_1 created (fd: 50, state: 0) (in kernel_open_channel_stream() at kernel.c:684)
DEBUG1 - 08:04:33.660055 [20546/20651]: Kernel stream channel0_2 created (fd: 51, state: 0) (in kernel_open_channel_stream() at kernel.c:684)
DEBUG1 - 08:04:33.660058 [20546/20651]: Kernel stream channel0_3 created (fd: 52, state: 0) (in kernel_open_channel_stream() at kernel.c:684)
DEBUG1 - 08:04:33.660061 [20546/20651]: Thread kernel polling (in thread_manage_kernel() at main.c:1135)
^CDEBUG1 - 08:04:35.457992 [20546/20546]: SIGINT caught (in sighandler() at main.c:5455)
DEBUG1 - 08:04:35.458169 [20546/20546]: Terminating all threads (in stop_threads() at main.c:488)
DEBUG1 - 08:04:35.458440 [20546/20546]: Futex n to 1 wake done (in futex_nto1_wake() at futex.c:122)
DEBUG1 - 08:04:35.458508 [20546/20646]: Futex n to 1 wait done (in futex_nto1_wait() at futex.c:105)
DEBUG3 - 08:04:35.458575 [20546/20649]: [ust-thread] Manage notify return from poll on 2 fds (in ust_thread_manage_notify() at ust-thread.c:76)
DEBUG1 - 08:04:35.458618 [20546/20646]: Dispatch thread dying (in thread_dispatch_ust_registration() at main.c:2153)
DEBUG1 - 08:04:35.458815 [20546/20649]: Application notify communication apps thread cleanup complete (in ust_thread_manage_notify() at ust-thread.c:187)
DEBUG3 - 08:04:35.459012 [20546/20650]: [agent-thread] Manage agent return from poll on 2 fds (in agent_thread_manage_registration() at agent-thread.c:269)
DEBUG3 - 08:04:35.459077 [20546/20650]: [agent-thread] 1 fd ready (in agent_thread_manage_registration() at agent-thread.c:280)
DEBUG3 - 08:04:35.459114 [20546/20650]: [agent-thread] Destroy TCP socket on port 5345 (in destroy_tcp_socket() at agent-thread.c:137)
DEBUG1 - 08:04:35.459174 [20546/20650]: [agent-thread] is cleaning up and stopping. (in agent_thread_manage_registration() at agent-thread.c:357)
DEBUG1 - 08:04:35.459289 [20546/20648]: Apps thread return from poll on 2 fds (in thread_manage_apps() at main.c:1659)
DEBUG1 - 08:04:35.459392 [20546/20648]: Application communication apps thread cleanup complete (in thread_manage_apps() at main.c:1767)
DEBUG1 - 08:04:35.459489 [20546/20647]: Notifying applications of session daemon state: 0 (in notify_ust_apps() at main.c:841)
DEBUG1 - 08:04:35.459703 [20546/20647]: Got the wait shm fd 25 (in get_wait_shm() at shm.c:115)
DEBUG1 - 08:04:35.459826 [20546/20647]: Futex wait update active 0 (in futex_wait_update() at futex.c:65)
DEBUG1 - 08:04:35.459982 [20546/20647]: UST Registration thread cleanup complete (in thread_registration_apps() at main.c:2379)
DEBUG1 - 08:04:35.460098 [20546/20643]: Health check thread dying (in thread_manage_health() at main.c:4406)
DEBUG1 - 08:04:35.460219 [20546/20643]: Terminating all threads (in stop_threads() at main.c:488)
DEBUG1 - 08:04:35.460262 [20546/20643]: Futex n to 1 wake done (in futex_nto1_wake() at futex.c:122)
DEBUG1 - 08:04:35.460361 [20546/20651]: Thread kernel return from poll on 3 fds (in thread_manage_kernel() at main.c:1142)
DEBUG1 - 08:04:35.460450 [20546/20651]: Kernel thread dying (in thread_manage_kernel() at main.c:1226)
DEBUG1 - 08:04:35.460575 [20546/20645]: Clean command context structure (in clean_command_ctx() at main.c:821)
DEBUG1 - 08:04:35.460712 [20546/20645]: Client thread dying (in thread_manage_clients() at main.c:4674)
DEBUG1 - 08:04:35.461103 [20546/20668]: consumer thread cleanup completed (in thread_manage_consumer() at main.c:1604)
DEBUG1 - 08:04:35.999536 [20546/20546]: Cleanup sessiond (in sessiond_cleanup() at main.c:620)
DEBUG1 - 08:04:35.999840 [20546/20546]: Removing sessiond and consumerd content of directory /var/run/lttng (in sessiond_cleanup() at main.c:639)
DEBUG1 - 08:04:35.999873 [20546/20546]: Removing /var/run/lttng/lttng-sessiond.pid (in sessiond_cleanup() at main.c:645)
DEBUG1 - 08:04:35.100006 [20546/20546]: Removing /var/run/lttng/agent.port (in sessiond_cleanup() at main.c:650)
DEBUG1 - 08:04:35.100015 [20546/20546]: Removing /var/run/lttng/kconsumerd/error (in sessiond_cleanup() at main.c:657)
DEBUG1 - 08:04:35.100021 [20546/20546]: Removing directory /var/run/lttng/kconsumerd (in sessiond_cleanup() at main.c:663)
DEBUG1 - 08:04:35.100032 [20546/20546]: Removing /var/run/lttng/ustconsumerd32/error (in sessiond_cleanup() at main.c:670)
DEBUG1 - 08:04:35.100039 [20546/20546]: Removing directory /var/run/lttng/ustconsumerd32 (in sessiond_cleanup() at main.c:676)
DEBUG1 - 08:04:35.100043 [20546/20546]: Removing /var/run/lttng/ustconsumerd64/error (in sessiond_cleanup() at main.c:683)
DEBUG1 - 08:04:35.100049 [20546/20546]: Removing directory /var/run/lttng/ustconsumerd64 (in sessiond_cleanup() at main.c:689)
DEBUG1 - 08:04:35.100054 [20546/20546]: Cleaning up all sessions (in sessiond_cleanup() at main.c:692)
DEBUG1 - 08:04:35.100061 [20546/20546]: Tearing down kernel session (in kernel_destroy_session() at kernel.c:894)
DEBUG1 - 08:04:35.100067 [20546/20546]: [trace] Closing session fd 42 (in trace_kernel_destroy_session() at trace-kernel.c:570)
DEBUG1 - 08:04:35.100073 [20546/20546]: [trace] Closing channel fd 47 (in trace_kernel_destroy_channel() at trace-kernel.c:498)
DEBUG1 - 08:04:35.100077 [20546/20546]: [trace] Closing stream fd 52 (in trace_kernel_destroy_stream() at trace-kernel.c:428)
DEBUG1 - 08:04:35.100083 [20546/20546]: [trace] Closing stream fd 51 (in trace_kernel_destroy_stream() at trace-kernel.c:428)
DEBUG1 - 08:04:35.100088 [20546/20546]: [trace] Closing stream fd 50 (in trace_kernel_destroy_stream() at trace-kernel.c:428)
DEBUG1 - 08:04:35.100091 [20546/20546]: [trace] Closing stream fd 41 (in trace_kernel_destroy_stream() at trace-kernel.c:428)
DEBUG1 - 08:04:35.100094 [20546/20546]: [trace] Closing event fd 49 (in trace_kernel_destroy_event() at trace-kernel.c:454)
DEBUG1 - 08:04:35.100100 [20546/20546]: [trace] Closing event fd 48 (in trace_kernel_destroy_event() at trace-kernel.c:454)
DEBUG1 - 08:04:35.120526 [20546/20546]: Futex n to 1 prepare done (in futex_nto1_prepare() at futex.c:77)
DEBUG1 - 08:04:35.120575 [20546/20644]: [notification-thread] Poll wait returned (1) (in thread_notification() at notification-thread.c:627)
DEBUG1 - 08:04:35.120589 [20546/20644]: [notification-thread] Handling fd (29) activity (1) (in thread_notification() at notification-thread.c:645)
DEBUG1 - 08:04:35.120596 [20546/20644]: [notification-thread] Received remove channel command (in handle_notification_thread_command() at notification-thread-events.c:1090)
DEBUG1 - 08:04:35.120600 [20546/20644]: [notification-thread] Removing channel key = 47 in kernel domain (in handle_notification_thread_command_remove_channel() at notification-thread-events.c:734)
Error: [notification-thread] Channel being removed is unknown to the notification thread
DEBUG1 - 08:04:35.120623 [20546/20644]: Futex n to 1 wake done (in futex_nto1_wake() at futex.c:122)
DEBUG1 - 08:04:35.120628 [20546/20644]: [notification-thread] Entering poll wait (in thread_notification() at notification-thread.c:625)
DEBUG1 - 08:04:35.120624 [20546/20546]: Futex n to 1 wait done (in futex_nto1_wait() at futex.c:105)
DEBUG1 - 08:04:35.120679 [20546/20546]: Destroying session auto-20170508-080432 (in session_destroy() at session.c:331)
DEBUG3 - 08:04:35.120682 [20546/20547]: [ht-thread] Returning from poll on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:128)
DEBUG1 - 08:04:35.120689 [20546/20546]: Empty ltt_sessions_ht_by_id, destroying it (in del_session_ht() at session.c:240)
DEBUG3 - 08:04:35.120706 [20546/20547]: [ht-thread] Polling. (in thread_ht_cleanup() at ht-cleanup.c:124)
DEBUG1 - 08:04:35.120708 [20546/20546]: Waiting for complete teardown of consumerd (PID: 20667) (in wait_consumer() at main.c:599)
DEBUG3 - 08:04:35.120711 [20546/20547]: [ht-thread] Returning from poll on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:128)
DEBUG3 - 08:04:35.120718 [20546/20547]: [ht-thread] Polling. (in thread_ht_cleanup() at ht-cleanup.c:124)
DEBUG3 - 08:04:35.120721 [20546/20547]: [ht-thread] Returning from poll on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:128)
DEBUG3 - 08:04:35.120725 [20546/20547]: [ht-thread] Polling. (in thread_ht_cleanup() at ht-cleanup.c:124)
DEBUG3 - 08:04:35.120728 [20546/20547]: [ht-thread] Returning from poll on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:128)
DEBUG1 - 08:04:35.120730 [20546/20546]: Cleaning up all agent apps (in sessiond_cleanup() at main.c:709)
DEBUG3 - 08:04:35.120732 [20546/20547]: [ht-thread] Polling. (in thread_ht_cleanup() at ht-cleanup.c:124)
DEBUG1 - 08:04:35.120737 [20546/20546]: Closing all UST sockets (in sessiond_cleanup() at main.c:712)
DEBUG2 - 08:04:35.120740 [20546/20546]: UST app cleaning registered apps hash table (in ust_app_clean_list() at ust-app.c:3869)
DEBUG3 - 08:04:35.120749 [20546/20546]: Buffer registry destroy all registry (in buffer_reg_destroy_registries() at buffer-registry.c:753)
DEBUG3 - 08:04:35.120749 [20546/20547]: [ht-thread] Returning from poll on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:128)
DEBUG2 - 08:04:35.120752 [20546/20546]: Closing kernel fd (in sessiond_cleanup() at main.c:717)
DEBUG3 - 08:04:35.120758 [20546/20547]: [ht-thread] Polling. (in thread_ht_cleanup() at ht-cleanup.c:124)
DEBUG3 - 08:04:35.120773 [20546/20547]: [ht-thread] Returning from poll on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:128)
DEBUG1 - 08:04:35.120775 [20546/20546]: Unloading kernel modules (in sessiond_cleanup() at main.c:724)
DEBUG3 - 08:04:35.120778 [20546/20547]: [ht-thread] Polling. (in thread_ht_cleanup() at ht-cleanup.c:124)
DEBUG3 - 08:04:35.120785 [20546/20547]: [ht-thread] Returning from poll on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:128)
DEBUG3 - 08:04:35.120789 [20546/20547]: [ht-thread] Polling. (in thread_ht_cleanup() at ht-cleanup.c:124)
DEBUG3 - 08:04:35.120792 [20546/20547]: [ht-thread] Returning from poll on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:128)
DEBUG3 - 08:04:35.120797 [20546/20547]: [ht-thread] Polling. (in thread_ht_cleanup() at ht-cleanup.c:124)
DEBUG3 - 08:04:35.120800 [20546/20547]: [ht-thread] Returning from poll on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:128)
DEBUG3 - 08:04:35.120805 [20546/20547]: [ht-thread] Polling. (in thread_ht_cleanup() at ht-cleanup.c:124)
DEBUG1 - 08:04:35.152264 [20546/20546]: Modprobe removal successful lttng-probe-x86-exceptions (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.172256 [20546/20546]: Modprobe removal successful lttng-probe-x86-irq-vectors (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.204240 [20546/20546]: Modprobe removal successful lttng-probe-writeback (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.240196 [20546/20546]: Modprobe removal successful lttng-probe-workqueue (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.260140 [20546/20546]: Modprobe removal successful lttng-probe-v4l2 (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.284218 [20546/20546]: Modprobe removal successful lttng-probe-vmscan (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.312294 [20546/20546]: Modprobe removal successful lttng-probe-udp (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.328181 [20546/20546]: Modprobe removal successful lttng-probe-timer (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.352254 [20546/20546]: Modprobe removal successful lttng-probe-sunrpc (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.372394 [20546/20546]: Modprobe removal successful lttng-probe-statedump (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.388317 [20546/20546]: Modprobe removal successful lttng-probe-sock (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.412201 [20546/20546]: Modprobe removal successful lttng-probe-skb (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.432293 [20546/20546]: Modprobe removal successful lttng-probe-signal (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.448197 [20546/20546]: Modprobe removal successful lttng-probe-scsi (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.464227 [20546/20546]: Modprobe removal successful lttng-probe-sched (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.489204 [20546/20546]: Modprobe removal successful lttng-probe-regmap (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.520279 [20546/20546]: Modprobe removal successful lttng-probe-rcu (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.536278 [20546/20546]: Modprobe removal successful lttng-probe-random (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.572194 [20546/20546]: Modprobe removal successful lttng-probe-printk (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.596219 [20546/20546]: Modprobe removal successful lttng-probe-power (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.632229 [20546/20546]: Modprobe removal successful lttng-probe-net (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.648256 [20546/20546]: Modprobe removal successful lttng-probe-napi (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.668377 [20546/20546]: Modprobe removal successful lttng-probe-module (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.684227 [20546/20546]: Modprobe removal successful lttng-probe-kvm-x86-mmu (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.704238 [20546/20546]: Modprobe removal successful lttng-probe-kvm-x86 (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.724811 [20546/20546]: Modprobe removal successful lttng-probe-kvm (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.752287 [20546/20546]: Modprobe removal successful lttng-probe-kmem (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.768419 [20546/20546]: Modprobe removal successful lttng-probe-jbd2 (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.784218 [20546/20546]: Modprobe removal successful lttng-probe-irq (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.820303 [20546/20546]: Modprobe removal successful lttng-probe-i2c (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.836215 [20546/20546]: Modprobe removal successful lttng-probe-gpio (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.857306 [20546/20546]: Modprobe removal successful lttng-probe-ext4 (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.880359 [20546/20546]: Modprobe removal successful lttng-probe-compaction (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.896235 [20546/20546]: Modprobe removal successful lttng-probe-btrfs (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.920274 [20546/20546]: Modprobe removal successful lttng-probe-block (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.936227 [20546/20546]: Modprobe removal successful lttng-probe-asoc (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.952601 [20546/20546]: Modprobe removal successful lttng-ring-buffer-metadata-mmap-client (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:35.992191 [20546/20546]: Modprobe removal successful lttng-ring-buffer-client-mmap-overwrite (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:36.122833 [20546/20546]: Modprobe removal successful lttng-ring-buffer-client-mmap-discard (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:36.442196 [20546/20546]: Modprobe removal successful lttng-ring-buffer-metadata-client (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:36.682072 [20546/20546]: Modprobe removal successful lttng-ring-buffer-client-overwrite (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:36.224244 [20546/20546]: Modprobe removal successful lttng-ring-buffer-client-discard (in modprobe_remove_lttng() at modprobe.c:381)
DEBUG1 - 08:04:36.224313 [20546/20644]: [notification-thread] Poll wait returned (3) (in thread_notification() at notification-thread.c:627)
DEBUG1 - 08:04:36.224331 [20546/20644]: [notification-thread] Handling fd (10) activity (16) (in thread_notification() at notification-thread.c:645)
DEBUG1 - 08:04:36.224342 [20546/20644]: [notification-thread] Handling fd (13) activity (16) (in thread_notification() at notification-thread.c:645)
DEBUG1 - 08:04:36.224348 [20546/20644]: [notification-thread] Handling fd (15) activity (16) (in thread_notification() at notification-thread.c:645)
DEBUG1 - 08:04:36.224359 [20546/20644]: [notification-thread] Entering poll wait (in thread_notification() at notification-thread.c:625)
DEBUG1 - 08:04:36.275972 [20546/20546]: Futex n to 1 prepare done (in futex_nto1_prepare() at futex.c:77)
DEBUG1 - 08:04:36.276022 [20546/20644]: [notification-thread] Poll wait returned (1) (in thread_notification() at notification-thread.c:627)
DEBUG1 - 08:04:36.276034 [20546/20644]: [notification-thread] Handling fd (29) activity (1) (in thread_notification() at notification-thread.c:645)
DEBUG1 - 08:04:36.276041 [20546/20644]: [notification-thread] Received quit command (in handle_notification_thread_command() at notification-thread-events.c:1097)
DEBUG1 - 08:04:36.276049 [20546/20644]: Futex n to 1 wake done (in futex_nto1_wake() at futex.c:122)
DEBUG1 - 08:04:36.276086 [20546/20644]: [notification-thread] Closing all client connections (in handle_notification_thread_client_disconnect_all() at notification-thread-events.c:1275)
DEBUG1 - 08:04:36.276051 [20546/20546]: Futex n to 1 wait done (in futex_nto1_wait() at futex.c:105)
DEBUG1 - 08:04:36.276114 [20546/20644]: [notification-thread] Destroying notification channel socket (in notification_channel_socket_destroy() at notification-thread.c:316)
DEBUG3 - 08:04:36.276227 [20546/20547]: [ht-thread] Returning from poll on 2 fds. (in thread_ht_cleanup() at ht-cleanup.c:128)
DEBUG1 - 08:04:36.276238 [20546/20547]: [ht-cleanup] quit. (in thread_ht_cleanup() at ht-cleanup.c:206)
DEBUG1 - 08:04:36.276244 [20546/20547]: [ht-cleanup] Thread terminates. (in thread_ht_cleanup() at ht-cleanup.c:217)
DEBUG1 - 08:04:36.276278 [20546/20546]: Cleaning up options (in sessiond_cleanup_options() at main.c:771)
DEBUG1 - 08:04:36.276285 [20546/20546]: Destroying run_as worker (in run_as_destroy_worker() at runas.c:710)
</pre></p> LTTng-tools - Bug #1101 (Resolved): Channel position sampling should be disabled for lttng-module...https://bugs.lttng.org/issues/11012017-05-11T22:41:55ZJérémie Galarneaujeremie.galarneau@efficios.com
<p>The <code>RING_BUFFER_SNAPSHOT_SAMPLE_POSITIONS</code> kernctl command was introduced as part of the LTTng 2.10 release. It should not be used with older kernel tracer modules.</p> LTTng-tools - Bug #1099 (Resolved): Channel monitoring timer is not saved by the lttng save commandhttps://bugs.lttng.org/issues/10992017-05-05T20:06:28ZJérémie Galarneaujeremie.galarneau@efficios.comLTTng-tools - Bug #1071 (Resolved): lttng-mi XSD does not take new 2.9 override options into accounthttps://bugs.lttng.org/issues/10712016-10-26T16:38:35ZJérémie Galarneaujeremie.galarneau@efficios.com
<p>The machine interface schema of the lttng client has not been updated to reflect the new options introduced to the save/load commands.</p> LTTng-tools - Bug #1044 (Resolved): Listing the snapshot output after deleting an outputhttps://bugs.lttng.org/issues/10442016-07-11T19:35:19ZBruno Roybruno.roy@ericsson.com
<p>LTTng version : lttng (LTTng Trace Control) 2.9.0-pre - Codename TBD (I don't have the commit, but this error is present in 2.8.1 and 2.7.2 also).<br />urcu version : 0.10~pre+bzr1197+pack28+201606291832~ubuntu16.04.1</p>
<p>Here are the command I did (started with no tracing session) :<br /><code>$ lttng create foo --snapshot<br />Default snapshot output set to: /home/bruno/lttng-traces/foo-20160711-152523<br />Snapshot mode set. Every channel enabled for that session will be set to mmap output, and default to overwrite mode.<br />$ lttng snapshot list-output<br />Snapshot output list for session foo<br /> [1] snapshot-1: /home/bruno/lttng-traces/foo-20160711-152523 (max-size: 0)<br />$ lttng snapshot del-output 1<br />Snapshot output id 1 successfully deleted for session foo<br />$ lttng snapshot list-output<br />Snapshot output list for session foo<br /> None<br />$ lttng list<br />Error: No session daemon is available<br />Error: Command error</code></p>
<p>On the 2.8.1 version I also got this error message : <code>lttng-sessiond: main.c:4180: process_client_msg: Assertion `!rcu_read_ongoing()' failed.</code><br />End result : No session daemon, and the session(s) are destroyed.</p> LTTng-tools - Bug #1006 (Resolved): Enabling an application context (both JUL and log4j) results ...https://bugs.lttng.org/issues/10062016-03-17T18:52:05ZJérémie Galarneaujeremie.galarneau@efficios.com
<p>Enabling an application context in both the log4j and jul domains results in a confirmation message of the form<br /><pre>
UST context $app.myprovider:myshortcontext added to all channels
</pre></p>
<p>The domain is printed by checking opt_kernel, while the exact domain should be checked.</p> LTTng-tools - Bug #1005 (Resolved): New trace can't generate in persistent memory file systemhttps://bugs.lttng.org/issues/10052016-03-16T03:01:59Zjia fangfang.jia@windriver.com
<p>Using the new feature Recording trace data on persistent memory file systems in LTTng 2.7.</p>
<p>After the device restart due to system crash, we can read the crash log in the specific shm-path directory. When we want to trace the new log, the following debug log reported and the new data can't be traced to the specific shm-path.</p>
<p>DEBUG3 - 20:07:54.353680 [286/291]: mkdir() recursive /shm/lttng/mysession-20160302-182255/ust/uid/0/32-bit with mode 504 for uid 0 and gid 0 (in run_as_mkdir_recursive() at runas.c:468)<br />DEBUG1 - 20:07:54.353726 [286/291]: Using run_as worker (in run_as() at runas.c:449)<br />DEBUG3 - 20:07:54.354141 [286/291]: open() /shm/lttng/mysession-20160302-182255/ust/uid/0/32-bit/metadata with flags C1 mode 384 for uid 0 and gid 0 (in run_as_open() at runas.c:498)<br />DEBUG1 - 20:07:54.354202 [286/291]: Using run_as worker (in run_as() at runas.c:449)<br />PERROR - 20:07:54.354724 [286/291]: <ins><strong>Opening metadata file: File exists (in ust_registry_session_init() at ust-registry.c:606)</strong></ins><br />DEBUG3 - 20:07:54.354801 [286/291]: rmdir_recursive() /shm/lttng/mysession-20160302-182255 with for uid 0 and gid 0 (in run_as_rmdir_recursive() at runas.c:524)<br />DEBUG1 - 20:07:54.354847 [286/291]: Using run_as worker (in run_as() at runas.c:449)<br />DEBUG3 - 20:07:54.355554 [287/287]: Attempting rmdir /shm/lttng/mysession-20160302-182255 (in utils_recursive_rmdir() at utils.c:1247)<br />DEBUG3 - 20:07:54.356905 [286/291]: Buffer registry per UID destroy with id: 0, ABI: 32, uid: 0 (in buffer_reg_uid_destroy() at buffer-registry.c:641)</p>
<p>For detail info, please see my attachment.</p> LTTng-tools - Bug #1002 (Resolved): lttng snapshot on an empty tracing session results in an unkn...https://bugs.lttng.org/issues/10022016-03-14T19:22:20ZJérémie Galarneaujeremie.galarneau@efficios.com
<p>Recording a snapshot on a session which has recorded no events results in the following output in MI output mode:</p>
<pre>
$ lttng --mi=xml snapshot record | xmllint --format -
Error: Unknown error code
Error: Command error
<?xml version="1.0" encoding="UTF-8"?>
<command xmlns="http://lttng.org/xml/ns/lttng-mi" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://lttng.org/xml/ns/lttng-mi http://lttng.org/xml/schemas/lttng-mi/3/lttng-mi-3.0.xsd" schemaVersion="3.0">
<name>snapshot</name>
<output>
<snapshot_action>
<name>record</name>
<output/>
</snapshot_action>
</output>
<success>false</success>
</command>
</pre><br />(Unknown Error Code + Command error)
<p>while the human output results in the following output:<br /><pre>
$ lttng snapshot record
Warning: No data available in snapshot
</pre></p>
<p>Also, the commands should not result in an error (warning is fine) since the user has no control on whether or not applications (or the kernel) have produced any event between the start of the tracing session and the recording of the snapshot.</p> LTTng-tools - Bug #970 (Resolved): snapshot written in 2 folders if it takes more than 1 second t...https://bugs.lttng.org/issues/9702015-11-03T22:59:57ZJulien Desfossezjdesfossez@efficios.com
<p>With "lttng snapshot record" on a session with UST et kernel buffers, if the writing of one domain takes longer than 1 second, another folder is created when writing the data of the second domain.<br />Reproduced with master.</p>
<p>lttng create --snapshot<br />lttng enable-channel -k bla --subbuf-size 8M --num-subbuf 8<br />lttng enable-event -k -a -c bla<br />lttng enable-event -u -a<br />lttng start<br />... wait for the kernel ring-buffer to be full...<br />lttng snapshot record</p>
<p>If the disk takes longer than 1 second to write 64MB, the resulting snapshot looks like this:</p>
<p>ls /home/julien/lttng-traces/auto-20151103-174410<br />snapshot-1-20151103-174443-0/kernel/.....<br />snapshot-1-20151103-174446-0/ust.....</p>
<p>This is confusing because we expect all the traces of one snapshot to be in the same folder, especially when we record lots of them it becomes a mess to link the ones that belong together.</p> Userspace RCU - Bug #953 (Resolved): Run make check and regtest for master on CIhttps://bugs.lttng.org/issues/9532015-10-16T20:58:23ZJonathan Rajotte Julienjonathan.rajotte-julien@efficios.comLTTng-UST - Bug #903 (Resolved): Make distcheck failhttps://bugs.lttng.org/issues/9032015-08-10T17:50:39ZJonathan Rajotte Julienjonathan.rajotte-julien@efficios.com
<p>The make distcheck command from automake fail.</p>
<p>This is due to the make on a read only dist tarball.</p>
<pre>
make[5]: Entering directory '/home/jonathan/lttng/lttng-ust/lttng-ust-2.7.0-rc1/_build/doc/examples/easy-ust'
gcc -I. -I../../../../include/ -I../../../include/ \
-Wall -g -O2 -c -o sample.o sample.c
gcc -I. -I../../../../include/ -I../../../include/ \
-Wall -g -O2 -c -o tp.o tp.c
Assembler messages:
Fatal error: can't create sample.o: Permission denied
Makefile:34: recipe for target 'sample.o' failed
make[5]: *** [sample.o] Error 1
make[5]: *** Waiting for unfinished jobs....
Assembler messages:
Fatal error: can't create tp.o: Permission denied
Makefile:38: recipe for target 'tp.o' failed
make[5]: *** [tp.o] Error 1
make[5]: Leaving directory '/home/jonathan/lttng/lttng-ust/lttng-ust-2.7.0-rc1/_build/doc/examples/easy-ust'
Makefile:885: recipe for target 'all-local' failed
make[4]: *** [all-local] Error 1
make[4]: Leaving directory '/home/jonathan/lttng/lttng-ust/lttng-ust-2.7.0-rc1/_build/doc/examples'
Makefile:536: recipe for target 'all-recursive' failed
make[3]: *** [all-recursive] Error 1
make[3]: Leaving directory '/home/jonathan/lttng/lttng-ust/lttng-ust-2.7.0-rc1/_build/doc'
Makefile:558: recipe for target 'all-recursive' failed
make[2]: *** [all-recursive] Error 1
make[2]: Leaving directory '/home/jonathan/lttng/lttng-ust/lttng-ust-2.7.0-rc1/_build'
Makefile:433: recipe for target 'all' failed
make[1]: *** [all] Error 2
make[1]: Leaving directory '/home/jonathan/lttng/lttng-ust/lttng-ust-2.7.0-rc1/_build'
Makefile:763: recipe for target 'distcheck' failed
make: *** [distcheck] Error 1
</pre>