[asterisk-app-dev] Problem when load testing Asterisk 13.7.2

Sun Mar 20 12:52:28 CDT 2016

Here you go, George. I appreciate your energy into this:
https://gist.github.com/ticklingcontest/4762a57457b73db1a170

On Sun, Mar 20, 2016 at 10:15 AM, George Joseph <george.joseph at fairview5.com
> wrote:

>
>
> On Sat, Mar 19, 2016 at 8:29 PM, Tickling Contest <
> tickling.contest at gmail.com> wrote:
>
>> Thanks again, George,
>>
>> I am running PJSIP v. 2.4.5 that is prescribed for Asterisk 13.7.2. I
>> made the changes you proposed re: --enable-epoll, recompiled PJSIP/Asterisk
>> and redid the tests.
>>
>> I am attempting a total of 100 or so connections (50 SIP/TCP callers
>> REGISTERing, INVITEing; 50 SIP/TCP callees REGISTERing, accepting calls). I
>> am afraid the latest Asterisk is not something I can try right now.
>>
>>
> How many sipp instance are you running?
> Can you share the command lines and scenario xml files?
>
>
> I am left now with an issue that I have not been able to get help
>> elsewhere re: SIPp. I hope I can ask them here, but if I can't, I am sorry
>> in advance!
>>
>> I get these errors:
>>
>> Unable to bind audio RTP socket (IP=127.0.0.1, port=6100), errno = 98
>> (Address already in use). (also get the same error but with video RTP
>> socket, but I am NOT running any video tests).
>>
>> OR
>>
>> Unable to bind main socket, errno = 98 (Address already in use).
>>
>> OR
>>
>> Unable to bind remote control socket (tried UDP ports 8888-8947): Address
>> already in use. (no idea what this is, and why this occurs)
>>
>> I tried passing the -mp parameter (for sipp, i.e.,) a random port number
>> (e.g., see
>> http://stackoverflow.com/questions/2556190/random-number-from-a-range-in-a-bash-script)
>> but I still get these issues (though they dramatically decreased the number
>> of issues I see due to port number).
>>
>> Apart from ulimit/FD_SETSIZE related changes, what else can I do?
>>
>> Where can I get information about load testing Asterisk for more than 100
>> concurrent calls (I use ARI, so I have to test my backend application too)
>> etc.?
>>
>> Thanks!
>>
>> On Sat, Mar 19, 2016 at 5:13 PM, George Joseph <
>> george.joseph at fairview5.com> wrote:
>>
>>>
>>>
>>> On Sat, Mar 19, 2016 at 1:30 PM, Tickling Contest <
>>> tickling.contest at gmail.com> wrote:
>>>
>>>> Thank you, George!
>>>>
>>>> That did solve the trouble for the most part, but I still get a few of
>>>> these (not rarely, unfortunately):
>>>>
>>>> Mar 19 15:23:06] ERROR[1981]: pjsip:0 <?>: tcpc0x7fb0083a TCP
>>>> connect() error: Connection refused [code=120111]
>>>> [Mar 19 15:23:06] WARNING[1981]: pjsip:0 <?>: tsx0x7fb00008c Failed to
>>>> send Request msg BYE/cseq=8737 (tdta0x7fb010246eb0)! err=120111 (Connection
>>>> refused)
>>>> [Mar 19 15:23:16] ERROR[1981]: pjsip:0 <?>: tcpc0x7fb0083a TCP
>>>> connect() error: Connection refused [code=120111]
>>>> [Mar 19 15:23:16] WARNING[1981]: pjsip:0 <?>: tsx0x7fb010169 Failed to
>>>> send Request msg BYE/cseq=5278 (tdta0x7fb010096950)! err=120111 (Connection
>>>> refused)
>>>>
>>>> I set the value of PJ_IOQUEUE_MAX_HANDLES to FD_SETSIZE per the link
>>>> you mentioned and ulimit for the root account, which runs asterisk is 8192.
>>>>
>>>> The Asterisk VM has been upped to 8GB memory and 4 cores now. There
>>>> cannot be network related latencies as the entire test is in the local
>>>> network.
>>>>
>>>> Any insight is deeply appreciated.
>>>>
>>>
>>>
>>> T
>>> hose errors you're seeing are outgoing connection attempts
>>>  so there a few things to check...
>>>
>>>
>>> What version of pjproject are you running?  There's an issue in 2.4.5
>>> and earlier where TCP sockets aren't being reused
>>> .  It's fixed in their trunk.  Unfortunately, you can't use their trunk
>>> with Asterisk 13.7.2 because of a new api they introduced.  You'll have to
>>> use Asterisk's current 13 branch from git.  If you 're going to do that,
>>> check out the bundled pjproject option which also has that patch.
>>>
>>>
>>> Check that sipp isn't terminating early and forcing Asterisk to open a
>>> new connection just to send the BYE.
>>> 
>>>
>>>
>>> How many connections are you attempting?
>>>
>>> If you really want to get the max connections, set the --enable-epoll
>>> option on pjproject's ./configure line (assuming you're on Linux) and set PJ_IOQUEUE_MAX_HANDLES
>>> to 5000 or something.  This won't fix the connection refused messages
>>> however.
>>>
>>>
>>>> On Sat, Mar 19, 2016 at 12:09 PM, George Joseph <
>>>> george.joseph at fairview5.com> wrote:
>>>>
>>>>> I'll bet your pjproject install still has the default value of 64
>>>>> for PJ_IOQUEUE_MAX_HANDLES.  That limits the number of simultaneous TCP
>>>>> sockets.
>>>>>
>>>>>
>>>>> https://wiki.asterisk.org/wiki/display/AST/Building+and+Installing+pjproject
>>>>>
>>>>>
>>>>>
>>>>> On Sat, Mar 19, 2016 at 9:20 AM, Tickling Contest <
>>>>> tickling.contest at gmail.com> wrote:
>>>>>
>>>>>> I am load-testing an Asterisk 13.7.2 installation with SIPp 3.5.1.
>>>>>>
>>>>>> I am running into an issue where Asterisk (core set debug 99)
>>>>>> complains about the following:
>>>>>>
>>>>>> [Mar 19 11:12:55] WARNING[13078]: pjsip:0 <?>: tsx0x7fc60840e
>>>>>> ...Failed to send Request msg INVITE/cseq=28144 (tdta0x7fc60840b590)!
>>>>>> err=70010 (Too many objects of the specified type (PJ_ETOOMANY))
>>>>>> [Mar 19 11:12:55] WARNING[13078]: pjsip:0 <?>: tsx0x7fc60841a
>>>>>> ...Failed to send Request msg INVITE/cseq=31094 (tdta0x7fc6140ebc10)!
>>>>>> err=70010 (Too many objects of the specified type (PJ_ETOOMANY))
>>>>>> [Mar 19 11:13:22] ERROR[13083]: pjsip:0 <?>: tcpc0x7fc6082b TCP
>>>>>> connect() error: Connection refused [code=120111]
>>>>>> [Mar 19 11:13:22] WARNING[13083]: pjsip:0 <?>: tsx0x7fc60822e Failed
>>>>>> to send Request msg BYE/cseq=29352 (tdta0x7fc6080e3600)! err=120111
>>>>>> (Connection refused)
>>>>>> [Mar 19 11:13:25] ERROR[13083]: pjsip:0 <?>: tcpc0x7fc6083a TCP
>>>>>> connect() error: Connection refused [code=120111]
>>>>>> [Mar 19 11:13:25] WARNING[13083]: pjsip:0 <?>: tsx0x7fc60822e Failed
>>>>>> to send Request msg BYE/cseq=13911 (tdta0x7fc6140bc200)! err=120111
>>>>>> (Connection refused)
>>>>>>
>>>>>> Any help figuring out this issue is deeply appreciated.
>>>>>>
>>>>>> Thanks!
>>>>>>
>>>>>> _______________________________________________
>>>>>> asterisk-app-dev mailing list
>>>>>> asterisk-app-dev at lists.digium.com
>>>>>> http://lists.digium.com/cgi-bin/mailman/listinfo/asterisk-app-dev
>>>>>>
>>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> asterisk-app-dev mailing list
>>>>> asterisk-app-dev at lists.digium.com
>>>>> http://lists.digium.com/cgi-bin/mailman/listinfo/asterisk-app-dev
>>>>>
>>>>>
>>>>
>>>> _______________________________________________
>>>> asterisk-app-dev mailing list
>>>> asterisk-app-dev at lists.digium.com
>>>> http://lists.digium.com/cgi-bin/mailman/listinfo/asterisk-app-dev
>>>>
>>>>
>>>
>>> _______________________________________________
>>> asterisk-app-dev mailing list
>>> asterisk-app-dev at lists.digium.com
>>> http://lists.digium.com/cgi-bin/mailman/listinfo/asterisk-app-dev
>>>
>>>
>>
>> _______________________________________________
>> asterisk-app-dev mailing list
>> asterisk-app-dev at lists.digium.com
>> http://lists.digium.com/cgi-bin/mailman/listinfo/asterisk-app-dev
>>
>>
>
> _______________________________________________
> asterisk-app-dev mailing list
> asterisk-app-dev at lists.digium.com
> http://lists.digium.com/cgi-bin/mailman/listinfo/asterisk-app-dev
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.digium.com/pipermail/asterisk-app-dev/attachments/20160320/83cf04ea/attachment.html>