[SR-Users] New MariaDB server "limiting" Kamailio CPS

[Stephen Lokker]

Good afternoon All,

Im hoping for some advise or direction with the below. We are running a Kamailio SBC used for high call volumes and recently decided to upgrade the Database servers as the existing servers were struggling. Both the old and new databases are using MariaDB(version details all below), the problem we face is that since migrating to the new database there appears to a limitation to the amount of DB connections that can be processed or accepted. The SBC functions normally until the CPS starts to exceed around 100cps at which point the SBC stops responding to invites(in bursts which resembles flood prevention). We have checked both the Kamailio logs and the MySQL logs on the DB, both log files have no indication of errors that would cause the problem experienced(the logs attached are seen when the SBC is cut back to use the old DB, not sure they are related to the fault), the connections/processes in mysql do not drastically increase or get stuck either. The fault points to a db connection limit of some kind but all users have no limitations set. If anyone has experienced a similar problem or has any advise it would be greatly appreciated.

Some info on the Kamialio and DB versions

New DB
***@voice-jhb-db01:~# mysql --version
mysql Ver 15.1 Distrib 10.3.27-MariaDB, for debian-linux-gnu (x86_64) using readline 5.2

Old DB
[***@isadb01 ~]# mysql --version
mysql Ver 15.1 Distrib 10.0.36-MariaDB, for Linux (x86_64) using readline 5.1

Kamailio SBC
[***@sbc01 ~]# kamailio -v
version: kamailio 5.1.4 (x86_64/linux)

Kind regards,

Stephen
Voice Engineer

Tel:
2404
Fax:
3468
Email:

[David Villasmil]

Did you check the max_connections in mysql?

https://mariadb.com/docs/reference/mdb/system-variables/max_user_connections/
and
https://mariadb.com/docs/reference/mdb/system-variables/max_connections/

Also, what are you doing with the db? how are your modules configured?


Regards,

David Villasmil
email: ***@gmail.com
phone: [phone]


On Mon, May 31, 2021 at 7:20 PM Stephen Lokker <***@bitco.co.za>
wrote:

> [image: BitCo Business Broadband]
> <https://www.bitco.co.za/business-broadband-fibre-fno/>
> Good afternoon All,
>
> Im hoping for some advise or direction with the below. We are running a
> Kamailio SBC used for high call volumes and recently decided to upgrade the
> Database servers as the existing servers were struggling. Both the old and
> new databases are using MariaDB(version details all below), the problem we
> face is that since migrating to the new database there appears to a
> limitation to the amount of DB connections that can be processed or
> accepted. The SBC functions normally until the CPS starts to exceed around
> 100cps at which point the SBC stops responding to invites(in bursts which
> resembles flood prevention). We have checked both the Kamailio logs and the
> MySQL logs on the DB, both log files have no indication of errors that
> would cause the problem experienced(the logs attached are seen when the SBC
> is cut back to use the old DB, not sure they are related to the fault), the
> connections/processes in mysql do not drastically increase or get stuck
> either. The fault points to a db connection limit of some kind but all
> users have no limitations set. If anyone has experienced a similar problem
> or has any advise it would be greatly appreciated.
>
> Some info on the Kamialio and DB versions
>
> New DB
> ***@voice-jhb-db01:~# mysql --version
> mysql Ver 15.1 Distrib 10.3.27-MariaDB, for debian-linux-gnu (x86_64)
> using readline 5.2
>
> Old DB
> [***@isadb01 ~]# mysql --version
> mysql Ver 15.1 Distrib 10.0.36-MariaDB, for Linux (x86_64) using readline
> 5.1
>
> Kamailio SBC
> [***@sbc01 ~]# kamailio -v
> version: kamailio 5.1.4 (x86_64/linux)
>
> Kind regards,
>
>
> * Stephen Lokker | BitCo Telecoms*
> *Voice Engineer*
> Website: www.bitco.co.za
> Email: ***@bitco.co.za
> Telephone: [phone] | EXT: 2404
> Softphone Extension: 3468
>
> [image: BitCo Telecoms] <http://www.bitco.co.za>
>
> *Disclaimer*
>
> ‘This communication contains confidential information. All information
> contained in this email remains the intellectual property of BitCo and may
> not be used for any purpose or made available to any third party without
> the express written permission of an authorised BitCo representative.’
>
>
>
> __________________________________________________________
> Kamailio - Users Mailing List - Non Commercial Discussions
> * sr-***@lists.kamailio.org
> Important: keep the mailing list in the recipients, do not reply only to
> the sender!
> Edit mailing list options or unsubscribe:
> * https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users
>

[Henning Westerholt]

Hi Stephen,

did you already tried to get some more details e.g. with: https://www.kamailio.org/wiki/cookbooks/devel/core#latency_limit_db

Cheers,

Henning

--
Henning Westerholt – https://skalatan.de/blog/
Kamailio services – https://gilawa.com<https://gilawa.com/>

From: sr-users <sr-users-***@lists.kamailio.org> On Behalf Of Stephen Lokker
Sent: Monday, May 31, 2021 2:32 PM
To: sr-***@lists.kamailio.org
Cc: Jordan Brimer <***@bitco.co.za>
Subject: [SR-Users] New MariaDB server "limiting" Kamailio CPS

[BitCo Business Broadband]<https://www.bitco.co.za/business-broadband-fibre-fno/>

Good afternoon All,

Im hoping for some advise or direction with the below. We are running a Kamailio SBC used for high call volumes and recently decided to upgrade the Database servers as the existing servers were struggling. Both the old and new databases are using MariaDB(version details all below), the problem we face is that since migrating to the new database there appears to a limitation to the amount of DB connections that can be processed or accepted. The SBC functions normally until the CPS starts to exceed around 100cps at which point the SBC stops responding to invites(in bursts which resembles flood prevention). We have checked both the Kamailio logs and the MySQL logs on the DB, both log files have no indication of errors that would cause the problem experienced(the logs attached are seen when the SBC is cut back to use the old DB, not sure they are related to the fault), the connections/processes in mysql do not drastically increase or get stuck either. The fault points to a db connection limit of some kind but all users have no limitations set. If anyone has experienced a similar problem or has any advise it would be greatly appreciated.

Some info on the Kamialio and DB versions

New DB
***@voice-jhb-db01:~# mysql --version
mysql Ver 15.1 Distrib 10.3.27-MariaDB, for debian-linux-gnu (x86_64) using readline 5.2

Old DB
[***@isadb01 ~]# mysql --version
mysql Ver 15.1 Distrib 10.0.36-MariaDB, for Linux (x86_64) using readline 5.1

Kamailio SBC
[***@sbc01 ~]# kamailio -v
version: kamailio 5.1.4 (x86_64/linux)

Kind regards,


Stephen Lokker | BitCo Telecoms
Voice Engineer
Website: www.bitco.co.za<http://www.bitco.co.za>
Email: ***@bitco.co.za<mailto:***@bitco.co.za>
Telephone: [phone] | EXT: 2404
Softphone Extension: 3468
[BitCo Telecoms]<http://www.bitco.co.za/>


Disclaimer

‘This communication contains confidential information. All information contained in this email remains the intellectual property of BitCo and may not be used for any purpose or made available to any third party without the express written permission of an authorised BitCo representative.’

[Stephen Lokker]

Hi Henning,

I have not, and this looks useful. Thank you for the response and the information!

Kind regards,

Stephen
Voice Engineer

Tel:
2404
Fax:
3468
Email:



________________________________
From: Henning Westerholt <***@skalatan.de>
Sent: Tuesday, 01 June 2021 08:22
To: Kamailio (SER) - Users Mailing List <sr-***@lists.kamailio.org>
Cc: Jordan Brimer <***@bitco.co.za>; Stephen Lokker <***@bitco.co.za>
Subject: RE: New MariaDB server "limiting" Kamailio CPS


Hi Stephen,



did you already tried to get some more details e.g. with: https://www.kamailio.org/wiki/cookbooks/devel/core#latency_limit_db<https://www.kamailio.org/wiki/cookbooks/devel/core#latency_limit_db>



Cheers,



Henning



--

Henning Westerholt – https://skalatan.de/blog/<https://skalatan.de/blog>

Kamailio services – https://gilawa.com<https://gilawa.com>



From: sr-users <sr-users-***@lists.kamailio.org> On Behalf Of Stephen Lokker
Sent: Monday, May 31, 2021 2:32 PM
To: sr-***@lists.kamailio.org
Cc: Jordan Brimer <***@bitco.co.za>
Subject: [SR-Users] New MariaDB server "limiting" Kamailio CPS



[BitCo Business Broadband]<https://www.bitco.co.za/business-broadband-fibre-fno>



Good afternoon All,



Im hoping for some advise or direction with the below. We are running a Kamailio SBC used for high call volumes and recently decided to upgrade the Database servers as the existing servers were struggling. Both the old and new databases are using MariaDB(version details all below), the problem we face is that since migrating to the new database there appears to a limitation to the amount of DB connections that can be processed or accepted. The SBC functions normally until the CPS starts to exceed around 100cps at which point the SBC stops responding to invites(in bursts which resembles flood prevention). We have checked both the Kamailio logs and the MySQL logs on the DB, both log files have no indication of errors that would cause the problem experienced(the logs attached are seen when the SBC is cut back to use the old DB, not sure they are related to the fault), the connections/processes in mysql do not drastically increase or get stuck either. The fault points to a db connection limit of some kind but all users have no limitations set. If anyone has experienced a similar problem or has any advise it would be greatly appreciated.



Some info on the Kamialio and DB versions



New DB

***@voice-jhb-db01:~# mysql --version
mysql Ver 15.1 Distrib 10.3.27-MariaDB, for debian-linux-gnu (x86_64) using readline 5.2



Old DB

[***@isadb01 ~]# mysql --version
mysql Ver 15.1 Distrib 10.0.36-MariaDB, for Linux (x86_64) using readline 5.1



Kamailio SBC

[***@sbc01 ~]# kamailio -v
version: kamailio 5.1.4 (x86_64/linux)



Kind regards,



Stephen Lokker | BitCo Telecoms
Voice Engineer
Website: www.bitco.co.za<http://www.bitco.co.za>
Email: ***@bitco.co.za<mailto:***@bitco.co.za>
Telephone: [phone] | EXT: 2404
Softphone Extension: 3468

[BitCo Telecoms]<http://www.bitco.co.za/>



Disclaimer

‘This communication contains confidential information. All information contained in this email remains the intellectual property of BitCo and may not be used for any purpose or made available to any third party without the express written permission of an authorised BitCo representative.’