[asterisk-bugs] [Asterisk 0015973]: Huge memory consumption after few hours of load

[Asterisk Bug Tracker]

A NOTE has been added to this issue. 
====================================================================== 
https://issues.asterisk.org/view.php?id=15973 
====================================================================== 
Reported By:                atis
Assigned To:                
====================================================================== 
Project:                    Asterisk
Issue ID:                   15973
Category:                   Core/General
Reproducibility:            always
Severity:                   major
Priority:                   normal
Status:                     feedback
Asterisk Version:           1.6.1.5 
JIRA:                        
Regression:                 No 
SVN Branch (only for SVN checkouts, not tarball releases): N/A 
SVN Revision (number only!):  
Request Review:              
====================================================================== 
Date Submitted:             2009-09-27 17:14 CDT
Last Modified:              2009-09-28 16:40 CDT
====================================================================== 
Summary:                    Huge memory consumption after few hours of load
Description: 
I'm doing load tests on Asterisk 1.6.1.5 and after few hours of load, it
takes 80% of ram (6GB installed), so it becomes unable to fork itself (when
using System() dialplan app), and creating core dump takes an hour. Core
dumps are in size of 9 Gigabytes.

Memory summary doesn't show anytingh of much usage:

80469516 bytes allocated (8800 in caches) in 71421 allocations

while top shows:

Mem:   6055876k total,  6009316k used,    46560k free,    19220k buffers
Swap:  4096564k total,  4096548k used,       16k free,   249980k cached

  PID USER      PR  NI  VIRT  RES  SHR S %CPU %MEM    TIME+  COMMAND
15870 asterisk  10 -10 9780m 4.8g 3936 S    6 83.1 505:00.32 asterisk

====================================================================== 

---------------------------------------------------------------------- 
 (0111476) atis (reporter) - 2009-09-28 16:40
 https://issues.asterisk.org/view.php?id=15973#c111476 
---------------------------------------------------------------------- 
Well, the issue is why it takes so much memory, because 1.4 tree didn't
ever used half of that amount under similar conditions. 

I can reproduce this quite often, having ~ 100 simultaneous channels, no
transcoding, Monitor, Queue, and new call every 3-5 seconds.

However, as i'm doing automated tests, it's not easy for me to detect
exact call when this starts, currently i have hanging asterisk, taking 4g
ram, eating whole cpu and not responding to any CLI commands.

Would there be any way how to detect such massive memory allocations?
Unfortunately there's no doc on memory debug inside doc/ dir. 

Issue History 
Date Modified    Username       Field                    Change               
====================================================================== 
2009-09-28 16:40 atis           Note Added: 0111476                          
======================================================================