[Asterisk-Users] Dual T400P, SMP, performance issues

[Jared Smith]

My dual-proc Xeon boxes didn't share IRQs across CPUs until I installed
the kernel-utils RPM and made sure the irqbalance service was
running...  Just a word to the wise!

Jared Smith

On Tue, 2003-06-10 at 09:52, asterisk at billheckel.com wrote:
> Hmmmm, I to appear to have an odd mix of interrupts.  It seems that the second CPU doesn't do much
> at all on my dual Xeon...
> 
>             CPU0       CPU1
>    0:   40652580          0    IO-APIC-edge  timer
>    1:        926          0    IO-APIC-edge  keyboard
>    2:          0          0          XT-PIC  cascade
>    6:          0          0   IO-APIC-level  usb-ohci
>    8:          1          0    IO-APIC-edge  rtc
>   12:        308          0    IO-APIC-edge  PS/2 Mouse
>   14:          2          0    IO-APIC-edge  ide0
>   20:  406481379          0   IO-APIC-level  tor2
>   24:          0          0   IO-APIC-level  tor2
>   28:    4516659          0   IO-APIC-level  eth0
>   30:     911870          0   IO-APIC-level  aacraid
> NMI:          0          0
> LOC:   40653025   40653047
> ERR:          0
> MIS:          0
> 
> I haven't enables the second card yet but will be enabling soon.  I should probably recompile * and
> zaptel for SMP though I thought I had...
> 
> Bill
> 
> 
> Martin Pycko wrote:
> > Are you sure that you compiled zaptel for __SMP__ ?
> > Edit your zaptel/Makefile.
> > 
> >   0:   75283844   75241320   75286285   75247088    IO-APIC-edge  timer
> >   1:          1          0          1          1    IO-APIC-edge  keyboard
> >   2:          0          0          0          0          XT-PIC  cascade
> >   3:          0          0          0          0   IO-APIC-level  usb-ohci
> >   8:          1          0          0          0    IO-APIC-edge  rtc
> >  15:          1          0          0          1    IO-APIC-edge  ide1
> >  16:   22134870   22120997   22135905   22122829   IO-APIC-level  eth0
> >  25:       4670       4548       4614       4518   IO-APIC-level  tor2
> > 
> > All the four CPU's should have IRQ's like in the example above.
> > 
> > Martin
> > 
> > On Mon, 9 Jun 2003, Alex Zarubin wrote:
> > 
> > 
> >>Hi,
> >>
> >>We are trying to validate Asterisk as a media gateway PRI <-> SIP with two
> >>T400P (8 T1s) per box. The first
> >>experience with BOX1 (Compaq, 2.53 GHz, 1 Gb RAM) and just one T400P was
> >>encouraging - on the load
> >>test with 3 T1s worth of calls we had on average 75% idle CPU.
> >>
> >>Not so with BOX2 (Dell, single 2.6 GHz Xeon, 1 Gb RAM, 2 T400P) and BOX3
> >>(Dell, dual 2.6 GHz Xeon,
> >>2 Gb RAM, 2 T400P, asterisk/zaptel is built with SMP support).
> >>
> >>On the similar load test (as with the BOX1) BOX2 was showing 0% idle CPU 70%
> >>of the time. Just 3 T1s
> >>out of 8.
> >>
> >>On the load test with just 2 T1s BOX3 was very close to 0% idle on CPU0,
> >>CPU1 was at 95% idle.
> >>The process ksoftirqd_CPU0 was close to the top of the 'top', with
> >>/proc/interrupts showing tor2 related
> >>numbers growing very fast. We had 2 T1s plugged into the first T400P board,
> >>with nothing going into the second,
> >>but the number of interrupts for the both boards was growing at the same
> >>pace. Here are the interrupts
> >>(after the box reboot, so they are not that big as they were) - do they look
> >>OK?
> >>
> >>
> >>            CPU0       CPU1       CPU2       CPU3
> >>  0:     122556          0          0          0    IO-APIC-edge  timer
> >>  1:          4          0          0          0    IO-APIC-edge  keyboard
> >>  2:          0          0          0          0          XT-PIC  cascade
> >>  5:          0          0          0          0   IO-APIC-level  usb-ohci
> >>  8:          1          0          0          0    IO-APIC-edge  rtc
> >> 12:         20          0          0          0    IO-APIC-edge  PS/2 Mouse
> >> 14:         23          0          2          0    IO-APIC-edge  ide0
> >> 20:     516930          0          0          0   IO-APIC-level  tor2
> >> 24:     516524          0          0          0   IO-APIC-level  tor2
> >> 28:      10600          0          0          0   IO-APIC-level  eth0
> >> 29:       4837          0          0          0   IO-APIC-level  eth1
> >> 30:      24831          0          0          0   IO-APIC-level  aacraid
> >>NMI:          0          0          0          0
> >>LOC:     122430     122429     122429     122428
> >>ERR:          0
> >>MIS:          0
> >>
> >>Not sure what went wrong. Any suggestions on how to work with 2 T400P in a
> >>box (without hurting performance)
> >>and how to get advantage of SMP for Asterisk would be appreciated.
> >>
> >>Any known Linux kernel related issues (2.4.20-13.7smp #1 SMP for BOX3 )?
> >>
> >>Thank you.
> >>
> >>Alex Zarubin
> >>
> >>
> >>
> > 
> > 
> > _______________________________________________
> > Asterisk-Users mailing list
> > Asterisk-Users at lists.digium.com
> > http://lists.digium.com/mailman/listinfo/asterisk-users
> > 
> > 
> 
> 
> _______________________________________________
> Asterisk-Users mailing list
> Asterisk-Users at lists.digium.com
> http://lists.digium.com/mailman/listinfo/asterisk-users