Bug #399
closedSessionD dies (coredumps) during session activation
100%
Description
lttng-sessiond dies during session activation and produces a core dump.
The session activation has been done using the lttng API.
The provided log was produced by running sessiond/consumerd with verbose options.
The log also shows syslog and saflog output as well as print statements from the Trace common component.
NOTE: verbose mode is only shown before sessiond dies. After it gets relaunched, it goes back to normal.
The following part of the log captures the last messages seen from sessiond/consumerd:
Error: Error ustctl create event com_ericsson_cba_trace_testapp_hightraf:HundredPerSec for app pid: 25204 with ret -1028
lttng-sessiond: ust-app.c:1277: create_ust_app_event: Assertion `ret == -LTTNG_UST_ERR_EXIST' failed.
DEBUG1: Incoming command on sock [in consumer_thread_sessiond_poll() at consumer.c:2505]
DEBUG1: Consumer received unexpected message size 0 (expects 4416) [in lttng_ustconsumer_recv_cmd() at ust-consumer.c:109]
PERROR: sendmsg: Broken pipe [in lttcomm_send_unix_sock() at unix.c:204]
DEBUG1: Communication interrupted on command socket [in consumer_thread_sessiond_poll() at consumer.c:2516]
DEBUG1: consumer_thread_receive_fds exiting [in consumer_thread_sessiond_poll() at consumer.c:2526]
DEBUG1: poll num_rdy : 1 [in consumer_thread_data_poll() at consumer.c:2251]
DEBUG1: consumer_data_pipe wake up [in consumer_thread_data_poll() at consumer.c:2275]
DEBUG1: Consumer delete flagged data stream [in validate_endpoint_status_data_stream() at consumer.c:1938]
DEBUG1: polling thread exiting [in consumer_thread_data_poll() at consumer.c:2403]
DEBUG1: Metadata event catched in thread [in consumer_thread_metadata_poll() at consumer.c:2030]
DEBUG1: Metadata thread pipe hung up [in consumer_thread_metadata_poll() at consumer.c:2051]
DEBUG1: Metadata poll thread exiting [in consumer_thread_metadata_poll() at consumer.c:2160]
PERROR: sendmsg: Broken pipe [in lttcomm_send_unix_sock() at unix.c:204]
DEBUG1: Consumer destroying it. Closing everything. [in lttng_consumer_destroy() at consumer.c:1196]
Here is the build info
CURRENT HEAD: foss/babeltrace 08ac0e0 (HEAD, origin/master, origin/HEAD) Fix SEEK_BEGIN for streams that do not contain any event
CURRENT HEAD: foss/lttng-tools da1d733 (HEAD, origin/master, origin/HEAD) Update CodingStyle
CURRENT HEAD: foss/lttng-ust dca6e79 (HEAD, origin/master, origin/HEAD) Remove LIBFORMAT config declaration, unused
CURRENT HEAD: foss/userspace-rcu f864c15 (HEAD, origin/master, origin/HEAD) urcu-qsbr: skip Q.S. reporting if already reported
Last 4 coredumps are attached as well:rw------ 1 root root 67862528 Nov 14 12:33 lttng-sessiond.25521.SC-1.corerw------ 1 root root 67731456 Nov 14 12:34 lttng-sessiond.25612.SC-1.corerw------ 1 root root 67866624 Nov 14 12:34 lttng-sessiond.25694.SC-1.corerw------ 1 root root 67731456 Nov 14 12:34 lttng-sessiond.25789.SC-1.core
Please let me know if more information is needed.
Jesus
Files
Updated by Jesus Garcia about 12 years ago
- File lttng-sessiond.25789.SC-1.core.gz lttng-sessiond.25789.SC-1.core.gz added
- File lttng-sessiond.25612.SC-1.core.gz lttng-sessiond.25612.SC-1.core.gz added
- File lttng-sessiond.25694.SC-1.core.gz lttng-sessiond.25694.SC-1.core.gz added
- File sessiond_dies_at_session_activation.txt sessiond_dies_at_session_activation.txt added
Sorry, I messed up with the attachments :-P
Adding the rest...
Updated by David Goulet about 12 years ago
- File bug399-diff.patch bug399-diff.patch added
- Status changed from New to Confirmed
- Assignee set to David Goulet
- Target version changed from 2.0.x stable to 2.1 stable
Can you try to apply the patch I've added to the ticket.
There is been a typo in commit 49c336c1679295a31b92223dca05feccfe3e3464 and this should fix at least the assert().
Thanks!
Updated by Jesus Garcia about 12 years ago
Hi David,
Sorry for the delay. The patch is good. I'm not seeing the sessiond crashes anymore.
Thanks a lot! :-)
Jesus
Updated by David Goulet about 12 years ago
- Status changed from Confirmed to Resolved
- % Done changed from 0 to 100
Applied in changeset 76f66f6356f4ad6bebc7b69b3856d2529c102106.