<html>
<body>
<div style="font-family: Verdana, Arial, Helvetica, Sans-Serif;">
<table bgcolor="#f9f3c9" width="100%" cellpadding="8" style="border: 1px #c9c399 solid;">
<tr>
<td>
This is an automatically generated e-mail. To reply, visit:
<a href="https://reviewboard.asterisk.org/r/2970/">https://reviewboard.asterisk.org/r/2970/</a>
</td>
</tr>
</table>
<br />
<table bgcolor="#fefadf" width="100%" cellspacing="0" cellpadding="8" style="background-image: url('https://reviewboard.asterisk.org/static/rb/images/review_request_box_top_bg.ab6f3b1072c9.png'); background-position: left top; background-repeat: repeat-x; border: 1px black solid;">
<tr>
<td>
<div>Review request for Asterisk Developers and David Lee.</div>
<div>By Matt Jordan.</div>
<p style="color: grey;"><i>Updated Oct. 29, 2013, 5:42 p.m.</i></p>
<h1 style="color: #575012; font-size: 10pt; margin-top: 1.5em;">Changes</h1>
<table width="100%" bgcolor="#ffffff" cellspacing="0" cellpadding="10" style="border: 1px solid #b8b5a0">
<tr>
<td>
<pre style="margin: 0; padding: 0; white-space: pre-wrap; white-space: -moz-pre-wrap; white-space: -pre-wrap; white-space: -o-pre-wrap; word-wrap: break-word;">Added a backtrace exhibiting the problem.</pre>
</td>
</tr>
</table>
<div style="margin-top: 1.5em;">
<b style="color: #575012; font-size: 10pt;">Repository: </b>
Asterisk
</div>
<h1 style="color: #575012; font-size: 10pt; margin-top: 1.5em;">Description </h1>
<table width="100%" bgcolor="#ffffff" cellspacing="0" cellpadding="10" style="border: 1px solid #b8b5a0">
<tr>
<td>
<pre style="margin: 0; padding: 0; white-space: pre-wrap; white-space: -moz-pre-wrap; white-space: -pre-wrap; white-space: -o-pre-wrap; word-wrap: break-word;">For awhile now, we've noticed continuous integration builds hanging on CentOS 6 64-bit build agents. After resolving a number of problems with symbols, strange locks, and other shenanigans, the problem has persisted. In all cases, gdb shows the Asterisk process stuck in loader.c on one of the infinite while loops that calls dlclose repeatedly until success:
Thread 1 (Thread 0xb77ae730 (LWP 20263)):
#0 0x009b6be1 in _dl_catch_error () from /lib/ld-linux.so.2
#1 0x00b6803c in _dlerror_run () from /lib/libdl.so.2
#2 0x00b67d0a in dlclose () from /lib/libdl.so.2
#3 0x082305fa in load_dynamic_module (resource_in=0xa306e40 "res_snmp.so", global_symbols_only=0, resource_heap=0xa2bd1d0) at loader.c:474
#4 0x082332ba in load_resource (resource_name=0xa306e40 "res_snmp.so", global_symbols_only=0, resource_heap=0xa2bd1d0, required=0) at loader.c:899
#5 0x0823402a in load_resource_list (load_order=0xbfb41f20, global_symbols=0, mod_count=0xbfb41f18) at loader.c:1022
#6 0x082351fc in load_modules (preload_only=0) at loader.c:1200
#7 0x080b4a69 in main (argc=8, argv=0xbfb43454) at asterisk.c:4239
The documentation of dlclose states that it returns 0 on success; any other value on error. It does not state that repeatedly calling it will eventually clear those errors. Most likely, the repeated calls to dlclose was to force a close by exhausting the references on the library; however, that will never succeed if:
(a) There is some fundamental error at work in the loaded library that precludes unloading it
(b) Some other loaded module is referencing a symbol in the currently loaded module
This results in Asterisk sitting forever. Waiting for Godot, as it were.
Since we have matching pairs of dlopen/dlclose, this path opts to only call dlclose once, and log out as an ERROR if dlclose fails to return success. If nothing else, this might help to determine why on the CentOS 6 64-bit build agent things are not closing successfully.</pre>
</td>
</tr>
</table>
<h1 style="color: #575012; font-size: 10pt; margin-top: 1.5em;">Diffs</b> </h1>
<ul style="margin-left: 3em; padding-left: 0;">
<li>/branches/1.8/main/loader.c <span style="color: grey">(402149)</span></li>
</ul>
<p><a href="https://reviewboard.asterisk.org/r/2970/diff/" style="margin-left: 3em;">View Diff</a></p>
<h1 style="color: #575012; font-size: 10pt; margin-top: 1.5em;">File Attachments (updated)</h1>
<ul>
<li><a href="https://reviewboard.asterisk.org/media/uploaded/files/2013/10/29/dlclose_loop_error_1.txt">dlclose_loop_error_1.txt</a></li>
</ul>
</td>
</tr>
</table>
</div>
</body>
</html>