[asterisk-biz] Asterisk Performance Results

[Gregory Boehnlein]

> 	Ultimately a standard test suite like the one so helpfully
> published in this thread would benchmark the baseline config, then the
transcoding
> config, as this one did. But for each of the combinations of the
> various codecs. Then a benchmark adding each of various options, like
> conferencing, recording, etc. That grid would be repeated on each of
> directly comparable HW configs, like a single CPU with single core at
> x-GHz, multiple of those CPUs, the same benchmarks repeated for
> single/multiple multicore CPUs, each at increasing GHz.

This is very similar to the idea that Blitzrage and I discussed at Astricon
Dallas. We talked about using SIPP to create a standard benchmark and
testing methodology for performance metrics to create a system for
classifying the performance of various hardware. We ALSO discussed the
creation of a standard set of regression tests (using SIPP) to run Asterisk
release candidates against and tracking the historical performance between
releases. A combination of standard Dial Plan logic + SIPP scenarios could
be used to test all sorts of different aspects of Asterisk.

In my opinion, something like this should optimally be done by, or in close
cooperation with Digium to ensure consistency, but it should also be
peer-reviewed and guided by the community. Such an effort would provide a
lot of valuable information for developers as to what may have changed
between releases, as well as where Asterisk needs to be improved.