[asterisk-dev] Asterisk 1.8 deadlock with Kernel 4.1

Stefan Priebe s.priebe at profihost.ag
Wed Nov 18 14:01:04 CST 2015


Am 18.11.2015 um 19:46 schrieb Matthew Jordan:
>
>
> On Wed, Nov 18, 2015 at 12:37 PM, Stefan Priebe <s.priebe at profihost.ag
> <mailto:s.priebe at profihost.ag>> wrote:
>
>     Hello,
>
>     since Upgrading our Asterisk System from Kernel 3.18.17 to 4.1.13 it
>     deadlocks every few hours (kill -9 is the only thing working). Booting
>     with 3.18 again let it run smooth again.
>
>     I've now also two gdb backtraces from two crashes:
>     http://pastebin.com/raw.php?i=yih5jNt8
>
>     http://pastebin.com/raw.php?i=kGEcvH4T
>
>     The kernel guys forwarded me to asterisk to find out where it hangs.
>
>
> Your pastebin links don't appear to be working.

Pastebin is down for raw links. It's up for the normal links.

http://pastebin.com/yih5jNt8
and
http://pastebin.com/kGEcvH4T

>
> Please either attach the backtraces, or send them along in the text of
> the e-mail. (Plus, that way we'll have them for posterity.)

Sure here it comes:
Thread 35 (Thread 0x7f295e945700 (LWP 26637)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x5d3c04 
"taskprocessor.c", lineno=310,
     func=0x5d4320 "tps_processing_function", cond_name=0x5d3f71 
"&i->poll_cond", mutex_name=0x5d3f5a "&i->taskprocessor_lock",
     cond=0x19e9ad0, t=0x19e9b08) at lock.c:565
#2  0x0000000000555e9a in tps_processing_function (data=0x19e9ac8) at 
taskprocessor.c:310
#3  0x0000000000569280 in dummy_start (data=0x19eb300) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

Thread 34 (Thread 0x7f295e8c9700 (LWP 26638)):
#0  0x00007f295de26d13 in *__GI___poll (fds=<optimized out>, 
nfds=<optimized out>, timeout=-1)
     at ../sysdeps/unix/sysv/linux/poll.c:87
#1  0x000000000043e5e4 in listener (unused=0x0) at asterisk.c:1393
#2  0x0000000000569280 in dummy_start (data=0x19ec150) at utils.c:1173
#3  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#4  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#5  0x0000000000000000 in ?? ()

Thread 33 (Thread 0x7f295e84d700 (LWP 26639)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x5bcdf4 "logger.c", 
lineno=1072, func=0x5bdc02 "logger_thread",
     cond_name=0x5bd8ae "&logcond", mutex_name=0x5bd8a0 "&logmsgs.lock", 
cond=0x826b80, t=0x80e550) at lock.c:565
#2  0x00000000004ea0fa in logger_thread (data=0x0) at logger.c:1072
#3  0x0000000000569280 in dummy_start (data=0x19ec1c0) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

Thread 32 (Thread 0x7f295c08d700 (LWP 26653)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x5ae3d4 
"devicestate.c", lineno=549, func=0x5aeb10 "do_devstate_changes",
     cond_name=0x5ae687 "&change_pending", mutex_name=0x5ae697 
"&state_changes.lock", cond=0x825ea0, t=0x80b4f0) at lock.c:565
#2  0x00000000004a0764 in do_devstate_changes (data=0x0) at 
devicestate.c:549
#3  0x0000000000569280 in dummy_start (data=0x1ed7b90) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

Thread 31 (Thread 0x7f295c011700 (LWP 26654)):
#0  0x00007f295de3287d in recvmsg () at 
../sysdeps/unix/syscall-template.S:82
#1  0x00007f295de52fcc in make_request (fd=35, pid=26631, 
seen_ipv4=<optimized out>, seen_ipv6=<optimized out>,
     in6ai=<optimized out>, in6ailen=<optimized out>) at 
../sysdeps/unix/sysv/linux/check_pf.c:119
#2  0x00007f295de5344a in __check_pf (seen_ipv4=0x7f295c00e85f, 
seen_ipv6=0x7f295c00e85e, in6ai=0x7f295c00e840,
     in6ailen=0x7f295c00e838) at ../sysdeps/unix/sysv/linux/check_pf.c:271
#3  0x00007f295de10007 in *__GI_getaddrinfo (name=0x7f295c00e8b0 
"10.12.12.55", service=0x7f295c00e8bc "2135",
     hints=0x7f295c00e910, pai=0x7f295c00e908) at 
../sysdeps/posix/getaddrinfo.c:2389
#4  0x000000000050287e in ast_sockaddr_resolve (addrs=0x7f295c00e9d0, 
str=0x7f295c00ea30 "10.12.12.55:2135", flags=0, family=2)
     at netsock2.c:268
#5  0x00007f2958963ba2 in ast_sockaddr_resolve_first_af 
(addr=0x7f29300591d8, name=0x7f295c00ea30 "10.12.12.55:2135", flag=0,
     family=2) at chan_sip.c:30689
#6  0x00007f2958963cb5 in ast_sockaddr_resolve_first_transport 
(addr=0x7f29300591d8, name=0x7f295c00ea30 "10.12.12.55:2135",
---Type <return> to continue, or q <return> to quit---
     flag=0, transport=1) at chan_sip.c:30720
#7  0x00007f29588fd3cc in set_destination (p=0x7f2930058cc8, 
uri=0x7f29300576e8 "sip:9052 at 10.12.12.55:2135;line=to7a729l")
     at chan_sip.c:10455
#8  0x00007f29588fe6e0 in reqprep (req=0x7f295c00fee0, p=0x7f2930058cc8, 
sipmethod=4, seqno=287, newbranch=1) at chan_sip.c:10778
#9  0x00007f295890a201 in transmit_state_notify (p=0x7f2930058cc8, 
state=1, full=1, timeout=0) at chan_sip.c:13259
#10 0x00007f29589141bb in cb_extensionstate (context=0x7f295c010cd0 
"hints", exten=0x7f295c010c80 "9052QS", state=1,
     data=0x7f2930058cc8) at chan_sip.c:15117
#11 0x000000000050ebf6 in handle_statechange (datap=0x7f293acef830) at 
pbx.c:4972
#12 0x0000000000555f8e in tps_processing_function (data=0x1f24f28) at 
taskprocessor.c:327
#13 0x0000000000569280 in dummy_start (data=0x1ed76f0) at utils.c:1173
#14 0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#15 0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#16 0x0000000000000000 in ?? ()

Thread 30 (Thread 0x7f295bf95700 (LWP 26655)):
#0  0x00007f295de26d13 in *__GI___poll (fds=<optimized out>, 
nfds=<optimized out>, timeout=-1)
     at ../sysdeps/unix/sysv/linux/poll.c:87
#1  0x00000000004c161d in do_parking_thread (ignore=0x0) at features.c:4975
#2  0x0000000000569280 in dummy_start (data=0x1aea3c0) at utils.c:1173
#3  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#4  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#5  0x0000000000000000 in ?? ()

Thread 29 (Thread 0x7f295bf19700 (LWP 26656)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x5ada64 "db.c", 
lineno=819, func=0x5ae330 "db_sync_thread",
     cond_name=0x5ae2d8 "&dbcond", mutex_name=0x5ada9c "&dblock", 
cond=0x825e60, t=0x80af80) at lock.c:565
#2  0x000000000049f653 in db_sync_thread (data=0x0) at db.c:819
#3  0x0000000000569280 in dummy_start (data=0x1aea3e0) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

Thread 28 (Thread 0x7f295be9d700 (LWP 26657)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x5d3c04 
"taskprocessor.c", lineno=310,
     func=0x5d4320 "tps_processing_function", cond_name=0x5d3f71 
"&i->poll_cond", mutex_name=0x5d3f5a "&i->taskprocessor_lock",
     cond=0x7f2954006c60, t=0x7f2954006c98) at lock.c:565
#2  0x0000000000555e9a in tps_processing_function (data=0x7f2954006c58) 
at taskprocessor.c:310
#3  0x0000000000569280 in dummy_start (data=0x7f2954003730) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

Thread 27 (Thread 0x7f295be21700 (LWP 26658)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x5d1144 "sched.c", 
lineno=110, func=0x5d1666 "sched_run",
     cond_name=0x5d1156 "&st->cond", mutex_name=0x5d114c "&st->lock", 
cond=0x7f29540035d0, t=0x7f2954003598) at lock.c:565
#2  0x0000000000549bd3 in sched_run (data=0x7f2954003590) at sched.c:110
#3  0x0000000000569280 in dummy_start (data=0x7f29540048e0) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

---Type <return> to continue, or q <return> to quit---
Thread 26 (Thread 0x7f295b13e700 (LWP 26663)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2941c4a3f4 
"res_timing_pthread.c", lineno=476,
     func=0x7f2941c4a7c3 "do_timing", cond_name=0x7f2941c4a434 
"&timing_thread.cond",
     mutex_name=0x7f2941c4a420 "&timing_thread.lock", 
cond=0x7f2941e4b540, t=0x7f2941e4b508) at lock.c:565
#2  0x00007f2941c4a10e in do_timing (arg=0x0) at res_timing_pthread.c:476
#3  0x0000000000569280 in dummy_start (data=0x20a3d70) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

Thread 25 (Thread 0x7f29580b2700 (LWP 26669)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x5d3c04 
"taskprocessor.c", lineno=310,
     func=0x5d4320 "tps_processing_function", cond_name=0x5d3f71 
"&i->poll_cond", mutex_name=0x5d3f5a "&i->taskprocessor_lock",
     cond=0x7f2954ce6c20, t=0x7f2954ce6c58) at lock.c:565
#2  0x0000000000555e9a in tps_processing_function (data=0x7f2954ce6c18) 
at taskprocessor.c:310
#3  0x0000000000569280 in dummy_start (data=0x7f2954ce8450) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

Thread 24 (Thread 0x7f293dc8e700 (LWP 26670)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x5d1144 "sched.c", 
lineno=110, func=0x5d1666 "sched_run",
     cond_name=0x5d1156 "&st->cond", mutex_name=0x5d114c "&st->lock", 
cond=0x7f2957fffe80, t=0x7f2957fffe48) at lock.c:565
#2  0x0000000000549bd3 in sched_run (data=0x7f2957fffe40) at sched.c:110
#3  0x0000000000569280 in dummy_start (data=0x7f2954ce8450) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

Thread 23 (Thread 0x7f293dc12700 (LWP 26671)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4 
"chan_iax2.c", lineno=11943,
     func=0x7f2959b85640 "iax2_process_thread", cond_name=0x7f2959b7e0e1 
"&thread->cond",
     mutex_name=0x7f2959b7e0d3 "&thread->lock", cond=0x7f293aa017e8, 
t=0x7f293aa017b0) at lock.c:565
#2  0x00007f2959b662b0 in iax2_process_thread (data=0x7f293aa006f0) at 
chan_iax2.c:11943
#3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

Thread 22 (Thread 0x7f293db96700 (LWP 26672)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4 
"chan_iax2.c", lineno=11943,
     func=0x7f2959b85640 "iax2_process_thread", cond_name=0x7f2959b7e0e1 
"&thread->cond",
     mutex_name=0x7f2959b7e0d3 "&thread->lock", cond=0x7f293aa04c98, 
t=0x7f293aa04c60) at lock.c:565
#2  0x00007f2959b662b0 in iax2_process_thread (data=0x7f293aa03ba0) at 
chan_iax2.c:11943
#3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

---Type <return> to continue, or q <return> to quit---
Thread 21 (Thread 0x7f293db1a700 (LWP 26673)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4 
"chan_iax2.c", lineno=11943,
     func=0x7f2959b85640 "iax2_process_thread", cond_name=0x7f2959b7e0e1 
"&thread->cond",
     mutex_name=0x7f2959b7e0d3 "&thread->lock", cond=0x7f293aa076e8, 
t=0x7f293aa076b0) at lock.c:565
#2  0x00007f2959b662b0 in iax2_process_thread (data=0x7f293aa065f0) at 
chan_iax2.c:11943
#3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

Thread 20 (Thread 0x7f293da9e700 (LWP 26674)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4 
"chan_iax2.c", lineno=11943,
     func=0x7f2959b85640 "iax2_process_thread", cond_name=0x7f2959b7e0e1 
"&thread->cond",
     mutex_name=0x7f2959b7e0d3 "&thread->lock", cond=0x7f293aa0a1a8, 
t=0x7f293aa0a170) at lock.c:565
#2  0x00007f2959b662b0 in iax2_process_thread (data=0x7f293aa090b0) at 
chan_iax2.c:11943
#3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

Thread 19 (Thread 0x7f293da22700 (LWP 26675)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4 
"chan_iax2.c", lineno=11943,
     func=0x7f2959b85640 "iax2_process_thread", cond_name=0x7f2959b7e0e1 
"&thread->cond",
     mutex_name=0x7f2959b7e0d3 "&thread->lock", cond=0x7f293aa0cc68, 
t=0x7f293aa0cc30) at lock.c:565
#2  0x00007f2959b662b0 in iax2_process_thread (data=0x7f293aa0bb70) at 
chan_iax2.c:11943
#3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

Thread 18 (Thread 0x7f293d9a6700 (LWP 26676)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4 
"chan_iax2.c", lineno=11943,
     func=0x7f2959b85640 "iax2_process_thread", cond_name=0x7f2959b7e0e1 
"&thread->cond",
     mutex_name=0x7f2959b7e0d3 "&thread->lock", cond=0x7f293aa0f728, 
t=0x7f293aa0f6f0) at lock.c:565
#2  0x00007f2959b662b0 in iax2_process_thread (data=0x7f293aa0e630) at 
chan_iax2.c:11943
#3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

Thread 17 (Thread 0x7f293d92a700 (LWP 26677)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4 
"chan_iax2.c", lineno=11943,
     func=0x7f2959b85640 "iax2_process_thread", cond_name=0x7f2959b7e0e1 
"&thread->cond",
     mutex_name=0x7f2959b7e0d3 "&thread->lock", cond=0x7f293aa121e8, 
t=0x7f293aa121b0) at lock.c:565
#2  0x00007f2959b662b0 in iax2_process_thread (data=0x7f293aa110f0) at 
chan_iax2.c:11943
#3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---

Thread 16 (Thread 0x7f293d8ae700 (LWP 26678)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4 
"chan_iax2.c", lineno=11943,
     func=0x7f2959b85640 "iax2_process_thread", cond_name=0x7f2959b7e0e1 
"&thread->cond",
     mutex_name=0x7f2959b7e0d3 "&thread->lock", cond=0x7f293aa14ca8, 
t=0x7f293aa14c70) at lock.c:565
#2  0x00007f2959b662b0 in iax2_process_thread (data=0x7f293aa13bb0) at 
chan_iax2.c:11943
#3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

Thread 15 (Thread 0x7f293d832700 (LWP 26679)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4 
"chan_iax2.c", lineno=11943,
     func=0x7f2959b85640 "iax2_process_thread", cond_name=0x7f2959b7e0e1 
"&thread->cond",
     mutex_name=0x7f2959b7e0d3 "&thread->lock", cond=0x7f293aa17768, 
t=0x7f293aa17730) at lock.c:565
#2  0x00007f2959b662b0 in iax2_process_thread (data=0x7f293aa16670) at 
chan_iax2.c:11943
#3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

Thread 14 (Thread 0x7f293d7b6700 (LWP 26680)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x7f2959b7ddf4 
"chan_iax2.c", lineno=11943,
     func=0x7f2959b85640 "iax2_process_thread", cond_name=0x7f2959b7e0e1 
"&thread->cond",
     mutex_name=0x7f2959b7e0d3 "&thread->lock", cond=0x7f293aa1a228, 
t=0x7f293aa1a1f0) at lock.c:565
#2  0x00007f2959b662b0 in iax2_process_thread (data=0x7f293aa19130) at 
chan_iax2.c:11943
#3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

Thread 13 (Thread 0x7f293d73a700 (LWP 26681)):
#0  0x00007f295de26d13 in *__GI___poll (fds=<optimized out>, 
nfds=<optimized out>, timeout=1000)
     at ../sysdeps/unix/sysv/linux/poll.c:87
#1  0x00000000004ddfbc in ast_io_wait (ioc=0x7f293a9ec060, howlong=1000) 
at io.c:279
#2  0x00007f2959b686e3 in network_thread (ignore=0x0) at chan_iax2.c:12413
#3  0x0000000000569280 in dummy_start (data=0x7f293a9fb640) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

Thread 12 (Thread 0x7f293d4b8700 (LWP 26682)):
#0  0x00007f295de26d13 in *__GI___poll (fds=<optimized out>, 
nfds=<optimized out>, timeout=1000)
     at ../sysdeps/unix/sysv/linux/poll.c:87
#1  0x00000000004ddfbc in ast_io_wait (ioc=0x7f293aa1d960, howlong=1000) 
at io.c:279
#2  0x00007f295894b24c in do_monitor (data=0x0) at chan_sip.c:26701
#3  0x0000000000569280 in dummy_start (data=0x7f293aa34210) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

---Type <return> to continue, or q <return> to quit---
Thread 11 (Thread 0x7f293cc3b700 (LWP 26684)):
#0  0x00007f295de26d13 in *__GI___poll (fds=<optimized out>, 
nfds=<optimized out>, timeout=-1)
     at ../sysdeps/unix/sysv/linux/poll.c:87
#1  0x00007f2958bb07c3 in do_monitor (data=0x0) at chan_phone.c:1086
#2  0x0000000000569280 in dummy_start (data=0x767c590) at utils.c:1173
#3  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#4  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#5  0x0000000000000000 in ?? ()

Thread 10 (Thread 0x7f293cbbf700 (LWP 26685)):
#0  0x00007f295de26d13 in *__GI___poll (fds=<optimized out>, 
nfds=<optimized out>, timeout=-1)
     at ../sysdeps/unix/sysv/linux/poll.c:87
#1  0x00007f2953dfdf99 in scan_thread (unused=0x0) at pbx_spool.c:694
#2  0x0000000000569280 in dummy_start (data=0x1f48510) at utils.c:1173
#3  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#4  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#5  0x0000000000000000 in ?? ()

Thread 9 (Thread 0x7f293cb43700 (LWP 26686)):
#0  0x00007f295de0148d in nanosleep () at 
../sysdeps/unix/syscall-template.S:82
#1  0x00007f29580b4be6 in cleanup (unused=0x0) at pbx_realtime.c:133
#2  0x0000000000569280 in dummy_start (data=0x7f293ab4eb60) at utils.c:1173
#3  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#4  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#5  0x0000000000000000 in ?? ()

Thread 8 (Thread 0x7f293cac7700 (LWP 26687)):
#0  0x00007f295de0148d in nanosleep () at 
../sysdeps/unix/syscall-template.S:82
#1  0x00007f29402c6bce in lock_broker (unused=0x0) at func_lock.c:211
#2  0x0000000000569280 in dummy_start (data=0x7f293ab4c160) at utils.c:1173
#3  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#4  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#5  0x0000000000000000 in ?? ()

Thread 7 (Thread 0x7f293ca4b700 (LWP 26688)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x5d3c04 
"taskprocessor.c", lineno=310,
     func=0x5d4320 "tps_processing_function", cond_name=0x5d3f71 
"&i->poll_cond", mutex_name=0x5d3f5a "&i->taskprocessor_lock",
     cond=0x7f293acad850, t=0x7f293acad888) at lock.c:565
#2  0x0000000000555e9a in tps_processing_function (data=0x7f293acad848) 
at taskprocessor.c:310
#3  0x0000000000569280 in dummy_start (data=0x7f293ab45d50) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

Thread 6 (Thread 0x7f293c9cf700 (LWP 26689)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x5d3c04 
"taskprocessor.c", lineno=310,
     func=0x5d4320 "tps_processing_function", cond_name=0x5d3f71 
"&i->poll_cond", mutex_name=0x5d3f5a "&i->taskprocessor_lock",
     cond=0x7f293acd4120, t=0x7f293acd4158) at lock.c:565
#2  0x0000000000555e9a in tps_processing_function (data=0x7f293acd4118) 
at taskprocessor.c:310
#3  0x0000000000569280 in dummy_start (data=0x7f293acd41e0) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
---Type <return> to continue, or q <return> to quit---
#6  0x0000000000000000 in ?? ()

Thread 5 (Thread 0x7f293c8d7700 (LWP 26933)):
#0  0x00007f295de2598d in read () at ../sysdeps/unix/syscall-template.S:82
#1  0x000000000054e352 in inotify_daemon (data=0x0) at 
stdtime/localtime.c:295
#2  0x0000000000569280 in dummy_start (data=0x7724c80) at utils.c:1173
#3  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#4  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#5  0x0000000000000000 in ?? ()

Thread 4 (Thread 0x7f293c573700 (LWP 2697)):
#0  pthread_cond_wait@@GLIBC_2.3.2 () at 
../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:162
#1  0x00000000004e51ad in __ast_cond_wait (filename=0x59c654 
"autoservice.c", lineno=102, func=0x59c7f0 "autoservice_run",
     cond_name=0x59c680 "&as_cond", mutex_name=0x59c673 "&aslist.lock", 
cond=0x825ae0, t=0x808b70) at lock.c:565
#2  0x000000000044c10e in autoservice_run (ign=0x0) at autoservice.c:102
#3  0x0000000000569280 in dummy_start (data=0x76b4060) at utils.c:1173
#4  0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#5  0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#6  0x0000000000000000 in ?? ()

Thread 3 (Thread 0x7f293c5ef700 (LWP 13169)):
#0  0x00007f295de26d13 in *__GI___poll (fds=<optimized out>, 
nfds=<optimized out>, timeout=-1)
     at ../sysdeps/unix/sysv/linux/poll.c:87
#1  0x0000000000472132 in ast_waitfor_nandfds (c=0x7f293c5e8510, n=2, 
fds=0x0, nfds=0, exception=0x0, outfd=0x0, ms=0x7f293c5e850c)
     at channel.c:3282
#2  0x00000000004725ce in ast_waitfor_n (c=0x7f293c5e8510, n=2, 
ms=0x7f293c5e850c) at channel.c:3536
#3  0x000000000047f61d in ast_generic_bridge (c0=0x7f293acfc368, 
c1=0x7a07b08, config=0x7f293c5e9e50, fo=0x7f293c5e8c88,
     rc=0x7f293c5e8c80) at channel.c:7283
#4  0x0000000000481e7a in ast_channel_bridge (c0=0x7f293acfc368, 
c1=0x7a07b08, config=0x7f293c5e9e50, fo=0x7f293c5e8c88,
     rc=0x7f293c5e8c80) at channel.c:7751
#5  0x00000000004be6cc in ast_bridge_call (chan=0x7f293acfc368, 
peer=0x7a07b08, config=0x7f293c5e9e50) at features.c:4135
#6  0x00007f29525c1092 in dial_exec_full (chan=0x7f293acfc368, 
data=0x7f293c5ec610 "SIP/9016,,wt", peerflags=0x7f293c5ea3f0,
     continue_exec=0x0) at app_dial.c:2957
#7  0x00007f29525c198e in dial_exec (chan=0x7f293acfc368, 
data=0x7f293c5ec610 "SIP/9016,,wt") at app_dial.c:3061
#8  0x0000000000503dd5 in pbx_exec (c=0x7f293acfc368, 
app=0x7f293ab56f60, data=0x7f293c5ec610 "SIP/9016,,wt") at pbx.c:1479
#9  0x000000000050e13d in pbx_extension_helper (c=0x7f293acfc368, 
con=0x0, context=0x7f293acfc8c0 "privat",
     exten=0x7f293acfc910 "9016", priority=4, label=0x0, 
callerid=0x77f1b20 "02202459352", action=E_SPAWN, found=0x7f293c5eed0c,
     combined_find_spawn=1) at pbx.c:4739
#10 0x000000000050fcc7 in ast_spawn_extension (c=0x7f293acfc368, 
context=0x7f293acfc8c0 "privat", exten=0x7f293acfc910 "9016",
     priority=4, callerid=0x77f1b20 "02202459352", found=0x7f293c5eed0c, 
combined_find_spawn=1) at pbx.c:5381
#11 0x0000000000510643 in __ast_pbx_run (c=0x7f293acfc368, args=0x0) at 
pbx.c:5484
#12 0x00000000005120d5 in pbx_thread (data=0x7f293acfc368) at pbx.c:5825
#13 0x0000000000569280 in dummy_start (data=0x7f293aca7fa0) at utils.c:1173
#14 0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#15 0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#16 0x0000000000000000 in ?? ()

Thread 2 (Thread 0x7f293c85b700 (LWP 15515)):
#0  0x00007f295de26d13 in *__GI___poll (fds=<optimized out>, 
nfds=<optimized out>, timeout=-1)
     at ../sysdeps/unix/sysv/linux/poll.c:87
#1  0x0000000000472132 in ast_waitfor_nandfds (c=0x7f293c852810, n=2, 
fds=0x0, nfds=0, exception=0x0, outfd=0x0, ms=0x7f293c85280c)
     at channel.c:3282
#2  0x00000000004725ce in ast_waitfor_n (c=0x7f293c852810, n=2, 
ms=0x7f293c85280c) at channel.c:3536
#3  0x000000000047f61d in ast_generic_bridge (c0=0x76cadc8, 
c1=0x771cd58, config=0x7f293c854b00, fo=0x7f293c852f88,
---Type <return> to continue, or q <return> to quit---
     rc=0x7f293c852f80) at channel.c:7283
#4  0x0000000000481e7a in ast_channel_bridge (c0=0x76cadc8, 
c1=0x771cd58, config=0x7f293c854b00, fo=0x7f293c852f88,
     rc=0x7f293c852f80) at channel.c:7751
#5  0x00000000004be6cc in ast_bridge_call (chan=0x76cadc8, 
peer=0x771cd58, config=0x7f293c854b00) at features.c:4135
#6  0x00007f2950161b7c in try_calling (qe=0x7f293c855180, 
options=0x7f293c8550fc "", announceoverride=0x7f293c8550fe "",
     url=0x7f293c8550fd "", tries=0x7f293c856378, 
noption=0x7f293c856374, agi=0x0, macro=0x0, gosub=0x0, ringing=0)
     at app_queue.c:5422
#7  0x00007f29501653ec in queue_exec (chan=0x76cadc8, 
data=0x7f293c858610 "q-smm1-lr,tw,,,30") at app_queue.c:6374
#8  0x0000000000503dd5 in pbx_exec (c=0x76cadc8, app=0x7f293ab5ff20, 
data=0x7f293c858610 "q-smm1-lr,tw,,,30") at pbx.c:1479
#9  0x000000000050e13d in pbx_extension_helper (c=0x76cadc8, con=0x0, 
context=0x76cb320 "add2q-default", exten=0x76cb370 "1",
     priority=7, label=0x0, callerid=0x7789650 "015143119706", 
action=E_SPAWN, found=0x7f293c85ad0c, combined_find_spawn=1)
     at pbx.c:4739
#10 0x000000000050fcc7 in ast_spawn_extension (c=0x76cadc8, 
context=0x76cb320 "add2q-default", exten=0x76cb370 "1", priority=7,
     callerid=0x7789650 "015143119706", found=0x7f293c85ad0c, 
combined_find_spawn=1) at pbx.c:5381
#11 0x0000000000510643 in __ast_pbx_run (c=0x76cadc8, args=0x0) at 
pbx.c:5484
#12 0x00000000005120d5 in pbx_thread (data=0x76cadc8) at pbx.c:5825
#13 0x0000000000569280 in dummy_start (data=0x774df20) at utils.c:1173
#14 0x00007f295d5dcb50 in start_thread (arg=<optimized out>) at 
pthread_create.c:304
#15 0x00007f295de3195d in clone () at 
../sysdeps/unix/sysv/linux/x86_64/clone.S:112
#16 0x0000000000000000 in ?? ()

Thread 1 (Thread 0x7f295e947700 (LWP 26631)):
#0  0x00007f295de26d13 in *__GI___poll (fds=<optimized out>, 
nfds=<optimized out>, timeout=-1)
     at ../sysdeps/unix/sysv/linux/poll.c:87
#1  0x0000000000444123 in monitor_sig_flags (unused=0x0) at asterisk.c:3294
#2  0x0000000000446a53 in main (argc=5, argv=0x7ffca463dfb8) at 
asterisk.c:4165

and

(gdb) thread apply all bt

Thread 34 (Thread 0x7fbeba9c7700 (LWP 2463)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000000000053c37b in tps_processing_function 
(data=data at entry=0x1e7bef8) at taskprocessor.c:310
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 33 (Thread 0x7fbeba94b700 (LWP 2464)):
#0  0x00007fbeb9ea8d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6
#1  0x000000000043f872 in listener (unused=unused at entry=0x0) at 
asterisk.c:1381
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 32 (Thread 0x7fbeba8cf700 (LWP 2465)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x00000000004dbd34 in logger_thread (data=data at entry=0x0) at 
logger.c:1072
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 31 (Thread 0x7fbeb8325700 (LWP 2508)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x0000000000498771 in do_devstate_changes (data=data at entry=0x0) at 
devicestate.c:549
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 30 (Thread 0x7fbeb82a9700 (LWP 2509)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000000000053c37b in tps_processing_function 
(data=data at entry=0x236eed8) at taskprocessor.c:310
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 29 (Thread 0x7fbeb822d700 (LWP 2510)):
#0  0x00007fbeb9ea8d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6
#1  0x00000000004b09f1 in do_parking_thread (ignore=ignore at entry=0x0) at 
features.c:4969
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 28 (Thread 0x7fbeb81b1700 (LWP 2511)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x00000000004962fe in db_sync_thread (data=data at entry=0x0) at db.c:819
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---

Thread 27 (Thread 0x7fbeb8135700 (LWP 2513)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000000000053c37b in tps_processing_function 
(data=data at entry=0x7fbeb4013c18) at taskprocessor.c:310
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 26 (Thread 0x7fbeb80b9700 (LWP 2514)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x0000000000533d44 in sched_run (data=data at entry=0x7fbeb4013df0) at 
sched.c:110
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 25 (Thread 0x7fbeb33a9700 (LWP 2647)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x00007fbe9a5b2787 in do_timing (arg=arg at entry=0x0) at 
res_timing_pthread.c:476
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 24 (Thread 0x7fbe99e75700 (LWP 2648)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000000000053c37b in tps_processing_function 
(data=data at entry=0x283ab18) at taskprocessor.c:310
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 23 (Thread 0x7fbe99df9700 (LWP 2649)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x0000000000533d44 in sched_run (data=data at entry=0x283ae00) at 
sched.c:110
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 22 (Thread 0x7fbe99d7d700 (LWP 2650)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x00007fbeb1bb0132 in iax2_process_thread 
(data=data at entry=0x2842150) at chan_iax2.c:11943
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 21 (Thread 0x7fbe99d01700 (LWP 2651)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x00007fbeb1bb0132 in iax2_process_thread 
(data=data at entry=0x28434d0) at chan_iax2.c:11943
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---

Thread 20 (Thread 0x7fbe99c85700 (LWP 2652)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x00007fbeb1bb0132 in iax2_process_thread 
(data=data at entry=0x2844870) at chan_iax2.c:11943
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 19 (Thread 0x7fbe99c09700 (LWP 2653)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x00007fbeb1bb0132 in iax2_process_thread 
(data=data at entry=0x2845c10) at chan_iax2.c:11943
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 18 (Thread 0x7fbe99b8d700 (LWP 2654)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x00007fbeb1bb0132 in iax2_process_thread 
(data=data at entry=0x2846fb0) at chan_iax2.c:11943
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 17 (Thread 0x7fbe99b11700 (LWP 2655)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x00007fbeb1bb0132 in iax2_process_thread 
(data=data at entry=0x2848350) at chan_iax2.c:11943
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 16 (Thread 0x7fbe99a95700 (LWP 2656)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x00007fbeb1bb0132 in iax2_process_thread 
(data=data at entry=0x28496f0) at chan_iax2.c:11943
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 15 (Thread 0x7fbe99a19700 (LWP 2657)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x00007fbeb1bb0132 in iax2_process_thread 
(data=data at entry=0x284aa90) at chan_iax2.c:11943
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 14 (Thread 0x7fbe9999d700 (LWP 2658)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x00007fbeb1bb0132 in iax2_process_thread 
(data=data at entry=0x284be30) at chan_iax2.c:11943
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()
---Type <return> to continue, or q <return> to quit---

Thread 13 (Thread 0x7fbe99921700 (LWP 2659)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x00007fbeb1bb0132 in iax2_process_thread 
(data=data at entry=0x284d1d0) at chan_iax2.c:11943
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 12 (Thread 0x7fbe998a5700 (LWP 2660)):
#0  0x00007fbeb9ea8d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6
#1  0x00000000004d3aab in ast_io_wait (ioc=0x283bac0, 
howlong=howlong at entry=1000) at io.c:279
#2  0x00007fbeb1b83485 in network_thread (ignore=ignore at entry=0x0) at 
chan_iax2.c:12413
#3  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#4  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#5  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#6  0x0000000000000000 in ?? ()

Thread 11 (Thread 0x7fbe99623700 (LWP 2661)):
#0  0x00007fbeb9665d5c in __lll_lock_wait () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x00007fbeb96613c4 in _L_lock_997 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#2  0x00007fbeb9661227 in pthread_mutex_lock () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#3  0x00007fbeb098cc2a in find_call (req=req at entry=0x7fbe99622310, 
addr=addr at entry=0x7fbe99622280, intended_method=8)
     at chan_sip.c:8622
#4  0x00007fbeb09bac2a in handle_request_do 
(req=req at entry=0x7fbe99622310, addr=addr at entry=0x7fbe99622280) at 
chan_sip.c:26291
#5  0x00007fbeb09bcdfa in sipsock_read (id=<optimized out>, 
fd=<optimized out>, events=<optimized out>, ignore=<optimized out>)
     at chan_sip.c:26247
#6  0x00000000004d3aff in ast_io_wait (ioc=0x285b380, howlong=<optimized 
out>) at io.c:292
#7  0x00007fbeb09ab675 in do_monitor (data=data at entry=0x0) at 
chan_sip.c:26800
#8  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#9  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#10 0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#11 0x0000000000000000 in ?? ()

Thread 10 (Thread 0x7fbe995a7700 (LWP 2662)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000000000053c37b in tps_processing_function 
(data=data at entry=0x28f6558) at taskprocessor.c:310
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 9 (Thread 0x7fbe9952b700 (LWP 2663)):
#0  0x00007fbeb9e8348d in nanosleep () from /lib/x86_64-linux-gnu/libc.so.6
#1  0x00007fbe9f7177ff in lock_broker (unused=unused at entry=0x0) at 
func_lock.c:211
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 8 (Thread 0x7fbe98cae700 (LWP 2665)):
#0  0x00007fbeb9ea8d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6
#1  0x00007fbeaff16f51 in scan_thread (unused=unused at entry=0x0) at 
pbx_spool.c:694
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
---Type <return> to continue, or q <return> to quit---
#5  0x0000000000000000 in ?? ()

Thread 7 (Thread 0x7fbe98c32700 (LWP 2666)):
#0  0x00007fbeb9e8348d in nanosleep () from /lib/x86_64-linux-gnu/libc.so.6
#1  0x00007fbeb011aa4e in cleanup (unused=unused at entry=0x0) at 
pbx_realtime.c:133
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 6 (Thread 0x7fbe98bb6700 (LWP 2669)):
#0  0x00007fbeb9ea8d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6
#1  0x00007fbeb0bfb97b in do_monitor (data=data at entry=0x0) at 
chan_phone.c:1086
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 5 (Thread 0x7fbe98b3a700 (LWP 2670)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x000000000053c37b in tps_processing_function 
(data=data at entry=0x7fbeb4096a28) at taskprocessor.c:310
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 4 (Thread 0x7fbe98a42700 (LWP 8202)):
#0  0x00007fbeb9ea798d in read () from /lib/x86_64-linux-gnu/libc.so.6
#1  0x000000000053650b in inotify_daemon (data=data at entry=0x0) at 
stdtime/localtime.c:295
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 3 (Thread 0x7fbe98abe700 (LWP 10985)):
#0  0x00007fbeb9663344 in pthread_cond_wait@@GLIBC_2.3.2 () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#1  0x0000000000447c2b in autoservice_run (ign=ign at entry=0x0) at 
autoservice.c:101
#2  0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#3  0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#4  0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#5  0x0000000000000000 in ?? ()

Thread 2 (Thread 0x7fbe989c6700 (LWP 12890)):
#0  0x00007fbeb9eb487d in recvmsg () from /lib/x86_64-linux-gnu/libc.so.6
#1  0x00007fbeb9ed4fcc in ?? () from /lib/x86_64-linux-gnu/libc.so.6
#2  0x00007fbeb9ed544a in ?? () from /lib/x86_64-linux-gnu/libc.so.6
#3  0x00007fbeb9e92007 in getaddrinfo () from 
/lib/x86_64-linux-gnu/libc.so.6
#4  0x00000000004f2e81 in ast_sockaddr_resolve 
(addrs=addrs at entry=0x7fbe989c48d8, str=<optimized out>,
     str at entry=0x7fbe989c4a80 "10.12.12.92:2052", flags=flags at entry=0, 
family=2) at netsock2.c:268
#5  0x00007fbeb095fb8b in ast_sockaddr_resolve_first_af 
(family=<optimized out>, flag=0, name=0x7fbe989c4a80 "10.12.12.92:2052",
     addr=0x7fbeb4114948) at chan_sip.c:30797
#6  ast_sockaddr_resolve_first_transport (transport=<optimized out>, 
flag=0, name=0x7fbe989c4a80 "10.12.12.92:2052",
     addr=0x7fbeb4114948) at chan_sip.c:30828
#7  set_destination (uri=<optimized out>, p=0x7fbeb4114438) at 
chan_sip.c:10602
#8  reqprep (req=req at entry=0x7fbe989c4fc0, p=p at entry=0x7fbeb4114438, 
sipmethod=sipmethod at entry=8, seqno=<optimized out>,
     seqno at entry=0, newbranch=newbranch at entry=1) at chan_sip.c:10925
---Type <return> to continue, or q <return> to quit---
#9  0x00007fbeb0969968 in transmit_request_with_auth 
(p=p at entry=0x7fbeb4114438, newbranch=1, reliable=XMIT_RELIABLE, seqno=0,
     sipmethod=8) at chan_sip.c:14296
#10 0x00007fbeb098b704 in sip_hangup (ast=<optimized out>) at 
chan_sip.c:6822
#11 0x0000000000477b55 in ast_hangup (chan=chan at entry=0x7fbeb40ef018) at 
channel.c:2887
#12 0x000000000050ce1b in __ast_pbx_run (c=c at entry=0x7fbeb40ef018, 
args=args at entry=0x0) at pbx.c:5729
#13 0x000000000050e426 in pbx_thread (data=data at entry=0x7fbeb40ef018) at 
pbx.c:5821
#14 0x0000000000548aaa in dummy_start (data=<optimized out>) at utils.c:1151
#15 0x00007fbeb965eb50 in start_thread () from 
/lib/x86_64-linux-gnu/libpthread.so.0
#16 0x00007fbeb9eb395d in clone () from /lib/x86_64-linux-gnu/libc.so.6
#17 0x0000000000000000 in ?? ()

Thread 1 (Thread 0x7fbeba9c9700 (LWP 2447)):
#0  0x00007fbeb9ea8d13 in poll () from /lib/x86_64-linux-gnu/libc.so.6
#1  0x000000000043f2af in monitor_sig_flags 
(unused=unused at entry=0x7ffdeb743e70) at asterisk.c:3281
#2  0x0000000000423eff in main (argc=<optimized out>, 
argv=0x7ffdeb7451a8) at asterisk.c:4152

Stefan


> --
> Matthew Jordan
> Digium, Inc. | Director of Technology
> 445 Jan Davis Drive NW - Huntsville, AL 35806 - USA
> Check us out at: http://digium.com & http://asterisk.org
>
>



More information about the asterisk-dev mailing list