Discussion:
[SR-Users] tcp Free fragment not found
Diego Nadares
2017-05-26 19:12:51 UTC
Permalink
Hi guys!

We have four a scripts that sends dlg.list command to kamailio through
xmlrpc. They are not executed simultaneously. Sometimes, we are getting
the following errors:

fm_search_defrag(): fm_search_defrag(0x7f212c25a000, 5273984); Free
fragment not found!2017-05-26T13:54:20.438736-03:00 drwsip02
/usr/local/sbin/kamailio[19833]: ERROR: <core> [mem/f_malloc.c:498]:
fm_malloc(): fm_malloc(0x7f212c25a000, 5273984) called from core:
tcp_main.c: tcpconn_new(957), module: core; Free fragment not
found!2017-05-26T13:54:20.439101-03:00 drwsip02
/usr/local/sbin/kamailio[19833]: ERROR: <core> [tcp_main.c:959]:
tcpconn_new(): mem. allocation failure2017-05-26T13:54:20.439344-03:00
drwsip02 /usr/local/sbin/kamailio[19833]: ERROR: <core> [tcp_main.c:3985]:
handle_new_connect(): tcpconn_new failed, closing socket

I all ready increased this two variables:

tcp_conn_wq_max=30000000
tcp_rd_buf_size=5273226

How can I see how much memory xmlrpc is using?

Any advice will be appreciated.

Thanks in advance!

Diego
Diego Nadares
2018-10-03 14:37:39 UTC
Permalink
Hi guys! I hope you are doing well.

Any hint on this? I changed to json but sometimes i get the same error.

2018-10-03T10:12:11.066539-03:00 drwsip11 /usr/local/sbin/kamailio[28173]:
ERROR: <core> [mem/f_malloc.c:415]: fm_search_defrag(): fm_search_defrag(0
x7f575c4ad000, 5352056); Free fragment not found!
2018-10-03T10:12:11.067552-03:00 drwsip11 /usr/local/sbin/kamailio[28173]:
ERROR: <core> [mem/f_malloc.c:498]: fm_malloc(): fm_malloc(0x7f575c4ad000,
5352056) called from core: tcp_main.c: _wbufq_add(636), module: core; Free
fragment not found!
2018-10-03T10:12:11.068128-03:00 drwsip11 /usr/local/sbin/kamailio[28182]:
ERROR: <core> [tcp_main.c:3496]: handle_ser_child(): received CON_ERROR for
0x7f575f6a6918 (id 12638), refcnt 3, flags 0x4018
2018-10-03T10:12:11.068397-03:00 drwsip11 /usr/local/sbin/kamailio[28173]:
ERROR: sl [../../forward.h:220]: msg_send_buffer(): tcp_send failed
2018-10-03T10:12:11.068929-03:00 drwsip11 /usr/local/sbin/kamailio[28173]:
ERROR: xmlrpc [xmlrpc.c:795]: send_reply(): Error while sending reply
2018-10-03T10:12:11.092080-03:00 drwsip11 /usr/local/sbin/kamailio[28173]:
WARNING: <core> [tcp_read.c:1666]: handle_io(): F_TCPCONN connection marked
as bad: 0x7f575f6a6918 id 12638 refcnt 1

Is there any stat to see? Or any additional configuration to make?

Here is my tcp related config

tcp_connection_lifetime=3605
tcp_conn_wq_max=30000000
tcp_rd_buf_size=5273226

We are running kamilio 4.4.5

Thanks in advance!

Diego
Post by Diego Nadares
Hi guys!
We have four a scripts that sends dlg.list command to kamailio through
xmlrpc. They are not executed simultaneously. Sometimes, we are getting
fm_search_defrag(): fm_search_defrag(0x7f212c25a000, 5273984); Free
fragment not found!2017-05-26T13:54:20.438736-03:00 drwsip02
tcp_main.c: tcpconn_new(957), module: core; Free fragment not
found!2017-05-26T13:54:20.439101-03:00 drwsip02
tcpconn_new(): mem. allocation failure2017-05-26T13:54:20.439344-03:00
handle_new_connect(): tcpconn_new failed, closing socket
tcp_conn_wq_max=30000000
tcp_rd_buf_size=5273226
How can I see how much memory xmlrpc is using?
Any advice will be appreciated.
Thanks in advance!
Diego
Daniel-Constantin Mierla
2018-10-04 06:31:08 UTC
Permalink
Hello,

what are the values for -m and -M command line parameters?

Cheers,
Daniel
Post by Diego Nadares
Hi guys! I hope you are doing well.
Any hint on this? I changed to json but sometimes i get the same error. 
2018-10-03T10:12:11.066539-03:00 drwsip11
fm_search_defrag(): fm_search_defrag(0
x7f575c4ad000, 5352056); Free fragment not found!
2018-10-03T10:12:11.067552-03:00 drwsip11
fm_malloc(): fm_malloc(0x7f575c4ad000,
 5352056) called from core: tcp_main.c: _wbufq_add(636), module: core;
Free fragment not found!
2018-10-03T10:12:11.068128-03:00 drwsip11
handle_ser_child(): received CON_ERROR for 0x7f575f6a6918 (id 12638),
refcnt 3, flags 0x4018
2018-10-03T10:12:11.068397-03:00 drwsip11
msg_send_buffer(): tcp_send failed
2018-10-03T10:12:11.068929-03:00 drwsip11
send_reply(): Error while sending reply
2018-10-03T10:12:11.092080-03:00 drwsip11
handle_io(): F_TCPCONN connection marked as bad: 0x7f575f6a6918 id
12638 refcnt 1
Is there any stat to see? Or any additional configuration to make?
Here is my tcp related config
tcp_connection_lifetime=3605
tcp_conn_wq_max=30000000
tcp_rd_buf_size=5273226
We are running kamilio 4.4.5
Thanks in advance!
Diego
Hi guys!
We have four a scripts that sends dlg.list command to kamailio
through xmlrpc. They are not executed simultaneously.  Sometimes,
 fm_search_defrag(): fm_search_defrag(0x7f212c25a000, 5273984);
Free fragment not found!2017-05-26T13:54:20.438736-03:00 drwsip02
/usr/local/sbin/kamailio[19833]: ERROR: <core>
[mem/f_malloc.c:498]: fm_malloc(): fm_malloc(0x7f212c25a000,
core; Free fragment not found!2017-05-26T13:54:20.439101-03:00
drwsip02 /usr/local/sbin/kamailio[19833]: ERROR: <core>
[tcp_main.c:959]: tcpconn_new(): mem.
allocation failure2017-05-26T13:54:20.439344-03:00 drwsip02
handle_new_connect(): tcpconn_new failed, closing socket
tcp_conn_wq_max=30000000
tcp_rd_buf_size=5273226
How can I see how much memory xmlrpc is using?
Any advice will be appreciated.
Thanks in advance!
Diego
_______________________________________________
Kamailio (SER) - Users Mailing List
https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users
--
Daniel-Constantin Mierla -- www.asipto.com
www.twitter.com/miconda -- www.linkedin.com/in/miconda
Kamailio World Conference -- www.kamailioworld.com
Kamailio Advanced Training, Nov 12-14, 2018, in Berlin -- www.asipto.com
Diego Nadares
2018-10-09 12:03:34 UTC
Permalink
---------- Mensaje reenviado ---------
De: Diego Nadares <***@gmail.com>
Fecha: El vie, 5 oct. 2018 a las 15:46
Asunto: Re: [SR-Users] tcp Free fragment not found
Para: Daniel-Constantin Mierla <***@gmail.com>


Hi Daniel,

Sorry for the delay.

-M 32 -m 128

Should I increase any/both of these params?

Thanks again!

Diego



El jue., 4 oct. 2018 a las 3:31, Daniel-Constantin Mierla (<
Post by Daniel-Constantin Mierla
Hello,
what are the values for -m and -M command line parameters?
Cheers,
Daniel
Hi guys! I hope you are doing well.
Any hint on this? I changed to json but sometimes i get the same error.
ERROR: <core> [mem/f_malloc.c:415]: fm_search_defrag(): fm_search_defrag(0
x7f575c4ad000, 5352056); Free fragment not found!
ERROR: <core> [mem/f_malloc.c:498]: fm_malloc(): fm_malloc(0x7f575c4ad000,
5352056) called from core: tcp_main.c: _wbufq_add(636), module: core;
Free fragment not found!
ERROR: <core> [tcp_main.c:3496]: handle_ser_child(): received CON_ERROR for
0x7f575f6a6918 (id 12638), refcnt 3, flags 0x4018
ERROR: sl [../../forward.h:220]: msg_send_buffer(): tcp_send failed
ERROR: xmlrpc [xmlrpc.c:795]: send_reply(): Error while sending reply
WARNING: <core> [tcp_read.c:1666]: handle_io(): F_TCPCONN connection marked
as bad: 0x7f575f6a6918 id 12638 refcnt 1
Is there any stat to see? Or any additional configuration to make?
Here is my tcp related config
tcp_connection_lifetime=3605
tcp_conn_wq_max=30000000
tcp_rd_buf_size=5273226
We are running kamilio 4.4.5
Thanks in advance!
Diego
Post by Diego Nadares
Hi guys!
We have four a scripts that sends dlg.list command to kamailio through
xmlrpc. They are not executed simultaneously. Sometimes, we are getting
fm_search_defrag(): fm_search_defrag(0x7f212c25a000, 5273984); Free
fragment not found!2017-05-26T13:54:20.438736-03:00 drwsip02
tcp_main.c: tcpconn_new(957), module: core; Free fragment not
found!2017-05-26T13:54:20.439101-03:00 drwsip02
tcpconn_new(): mem. allocation failure2017-05-26T13:54:20.439344-03:00
handle_new_connect(): tcpconn_new failed, closing socket
tcp_conn_wq_max=30000000
tcp_rd_buf_size=5273226
How can I see how much memory xmlrpc is using?
Any advice will be appreciated.
Thanks in advance!
Diego
_______________________________________________
--
Daniel-Constantin Mierla -- www.asipto.comwww.twitter.com/miconda -- www.linkedin.com/in/miconda
Kamailio World Conference -- www.kamailioworld.com
Kamailio Advanced Training, Nov 12-14, 2018, in Berlin -- www.asipto.com
Diego Nadares
2018-10-17 17:15:13 UTC
Permalink
Hi guys,

Any hint?

Thanks again.

Diego.
Post by Diego Nadares
---------- Mensaje reenviado ---------
Fecha: El vie, 5 oct. 2018 a las 15:46
Asunto: Re: [SR-Users] tcp Free fragment not found
Hi Daniel,
Sorry for the delay.
-M 32 -m 128
Should I increase any/both of these params?
Thanks again!
Diego
El jue., 4 oct. 2018 a las 3:31, Daniel-Constantin Mierla (<
Post by Daniel-Constantin Mierla
Hello,
what are the values for -m and -M command line parameters?
Cheers,
Daniel
Hi guys! I hope you are doing well.
Any hint on this? I changed to json but sometimes i get the same error.
2018-10-03T10:12:11.066539-03:00 drwsip11
fm_search_defrag(): fm_search_defrag(0
x7f575c4ad000, 5352056); Free fragment not found!
2018-10-03T10:12:11.067552-03:00 drwsip11
fm_malloc(): fm_malloc(0x7f575c4ad000,
5352056) called from core: tcp_main.c: _wbufq_add(636), module: core;
Free fragment not found!
2018-10-03T10:12:11.068128-03:00 drwsip11
handle_ser_child(): received CON_ERROR for 0x7f575f6a6918 (id 12638),
refcnt 3, flags 0x4018
2018-10-03T10:12:11.068397-03:00 drwsip11
msg_send_buffer(): tcp_send failed
2018-10-03T10:12:11.068929-03:00 drwsip11
send_reply(): Error while sending reply
2018-10-03T10:12:11.092080-03:00 drwsip11
handle_io(): F_TCPCONN connection marked as bad: 0x7f575f6a6918 id 12638
refcnt 1
Is there any stat to see? Or any additional configuration to make?
Here is my tcp related config
tcp_connection_lifetime=3605
tcp_conn_wq_max=30000000
tcp_rd_buf_size=5273226
We are running kamilio 4.4.5
Thanks in advance!
Diego
Post by Diego Nadares
Hi guys!
We have four a scripts that sends dlg.list command to kamailio through
xmlrpc. They are not executed simultaneously. Sometimes, we are getting
fm_search_defrag(): fm_search_defrag(0x7f212c25a000, 5273984); Free
fragment not found!2017-05-26T13:54:20.438736-03:00 drwsip02
tcp_main.c: tcpconn_new(957), module: core; Free fragment not
found!2017-05-26T13:54:20.439101-03:00 drwsip02
tcpconn_new(): mem. allocation failure2017-05-26T13:54:20.439344-03:00
handle_new_connect(): tcpconn_new failed, closing socket
tcp_conn_wq_max=30000000
tcp_rd_buf_size=5273226
How can I see how much memory xmlrpc is using?
Any advice will be appreciated.
Thanks in advance!
Diego
_______________________________________________
--
Daniel-Constantin Mierla -- www.asipto.comwww.twitter.com/miconda -- www.linkedin.com/in/miconda
Kamailio World Conference -- www.kamailioworld.com
Kamailio Advanced Training, Nov 12-14, 2018, in Berlin -- www.asipto.com
Daniel-Constantin Mierla
2018-10-17 17:22:38 UTC
Permalink
Hello,

this got out of my sight ...

Can you try with -m 256 and also mem_join=1 as global parameter in
kamailio.cfg?

Cheers,
Daniel
Post by Diego Nadares
Hi guys,
Any hint?
Thanks again. 
Diego. 
---------- Mensaje reenviado ---------
Fecha: El vie, 5 oct. 2018 a las 15:46
Asunto: Re: [SR-Users] tcp Free fragment not found
Hi Daniel,
Sorry for the delay. 
-M 32 -m 128
Should I increase any/both of these params?
Thanks again!
Diego
El jue., 4 oct. 2018 a las 3:31, Daniel-Constantin Mierla
Hello,
what are the values for -m and -M command line parameters?
Cheers,
Daniel
Post by Diego Nadares
Hi guys! I hope you are doing well.
Any hint on this? I changed to json but sometimes i get the
same error. 
2018-10-03T10:12:11.066539-03:00 drwsip11
/usr/local/sbin/kamailio[28173]: ERROR: <core>
[mem/f_malloc.c:415]: fm_search_defrag(): fm_search_defrag(0
x7f575c4ad000, 5352056); Free fragment not found!
2018-10-03T10:12:11.067552-03:00 drwsip11
/usr/local/sbin/kamailio[28173]: ERROR: <core>
[mem/f_malloc.c:498]: fm_malloc(): fm_malloc(0x7f575c4ad000,
 5352056) called from core: tcp_main.c: _wbufq_add(636),
module: core; Free fragment not found!
2018-10-03T10:12:11.068128-03:00 drwsip11
/usr/local/sbin/kamailio[28182]: ERROR: <core>
[tcp_main.c:3496]: handle_ser_child(): received CON_ERROR for
0x7f575f6a6918 (id 12638), refcnt 3, flags 0x4018
2018-10-03T10:12:11.068397-03:00 drwsip11
/usr/local/sbin/kamailio[28173]: ERROR: sl
[../../forward.h:220]: msg_send_buffer(): tcp_send failed
2018-10-03T10:12:11.068929-03:00 drwsip11
/usr/local/sbin/kamailio[28173]: ERROR: xmlrpc
[xmlrpc.c:795]: send_reply(): Error while sending reply
2018-10-03T10:12:11.092080-03:00 drwsip11
/usr/local/sbin/kamailio[28173]: WARNING: <core>
[tcp_read.c:1666]: handle_io(): F_TCPCONN connection marked
as bad: 0x7f575f6a6918 id 12638 refcnt 1
Is there any stat to see? Or any additional configuration to make?
Here is my tcp related config
tcp_connection_lifetime=3605
tcp_conn_wq_max=30000000
tcp_rd_buf_size=5273226
We are running kamilio 4.4.5
Thanks in advance!
Diego
El vie., 26 may. 2017 a las 16:12, Diego Nadares
Hi guys!
We have four a scripts that sends dlg.list command to
kamailio through xmlrpc. They are not executed
simultaneously.  Sometimes, we are getting the following
 fm_search_defrag(): fm_search_defrag(0x7f212c25a000,
5273984); Free fragment not
found!2017-05-26T13:54:20.438736-03:00 drwsip02
/usr/local/sbin/kamailio[19833]: ERROR: <core>
tcp_main.c: tcpconn_new(957), module: core; Free fragment
not found!2017-05-26T13:54:20.439101-03:00 drwsip02
/usr/local/sbin/kamailio[19833]: ERROR: <core>
[tcp_main.c:959]: tcpconn_new(): mem.
allocation failure2017-05-26T13:54:20.439344-03:00
drwsip02 /usr/local/sbin/kamailio[19833]: ERROR: <core>
[tcp_main.c:3985]: handle_new_connect(): tcpconn_new
failed, closing socket
tcp_conn_wq_max=30000000
tcp_rd_buf_size=5273226
How can I see how much memory xmlrpc is using?
Any advice will be appreciated.
Thanks in advance!
Diego
_______________________________________________
Kamailio (SER) - Users Mailing List
https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users
--
Daniel-Constantin Mierla -- www.asipto.com <http://www.asipto.com>
www.twitter.com/miconda <http://www.twitter.com/miconda> -- www.linkedin.com/in/miconda <http://www.linkedin.com/in/miconda>
Kamailio World Conference -- www.kamailioworld.com <http://www.kamailioworld.com>
Kamailio Advanced Training, Nov 12-14, 2018, in Berlin -- www.asipto.com <http://www.asipto.com>
--
Daniel-Constantin Mierla -- www.asipto.com
www.twitter.com/miconda -- www.linkedin.com/in/miconda
Kamailio World Conference -- www.kamailioworld.com
Kamailio Advanced Training, Nov 12-14, 2018, in Berlin -- www.asipto.com
Diego Nadares
2018-10-24 15:04:21 UTC
Permalink
No problem Daniel, thanks anyway. I will try this tonight and let you know
how it was.

Cheers,

Diego

El mié., 17 oct. 2018 a las 14:22, Daniel-Constantin Mierla (<
Post by Daniel-Constantin Mierla
Hello,
this got out of my sight ...
Can you try with -m 256 and also mem_join=1 as global parameter in
kamailio.cfg?
Cheers,
Daniel
Hi guys,
Any hint?
Thanks again.
Diego.
Post by Diego Nadares
---------- Mensaje reenviado ---------
Fecha: El vie, 5 oct. 2018 a las 15:46
Asunto: Re: [SR-Users] tcp Free fragment not found
Hi Daniel,
Sorry for the delay.
-M 32 -m 128
Should I increase any/both of these params?
Thanks again!
Diego
El jue., 4 oct. 2018 a las 3:31, Daniel-Constantin Mierla (<
Post by Daniel-Constantin Mierla
Hello,
what are the values for -m and -M command line parameters?
Cheers,
Daniel
Hi guys! I hope you are doing well.
Any hint on this? I changed to json but sometimes i get the same error.
2018-10-03T10:12:11.066539-03:00 drwsip11
fm_search_defrag(): fm_search_defrag(0
x7f575c4ad000, 5352056); Free fragment not found!
2018-10-03T10:12:11.067552-03:00 drwsip11
fm_malloc(): fm_malloc(0x7f575c4ad000,
5352056) called from core: tcp_main.c: _wbufq_add(636), module: core;
Free fragment not found!
2018-10-03T10:12:11.068128-03:00 drwsip11
handle_ser_child(): received CON_ERROR for 0x7f575f6a6918 (id 12638),
refcnt 3, flags 0x4018
2018-10-03T10:12:11.068397-03:00 drwsip11
msg_send_buffer(): tcp_send failed
2018-10-03T10:12:11.068929-03:00 drwsip11
send_reply(): Error while sending reply
2018-10-03T10:12:11.092080-03:00 drwsip11
handle_io(): F_TCPCONN connection marked as bad: 0x7f575f6a6918 id 12638
refcnt 1
Is there any stat to see? Or any additional configuration to make?
Here is my tcp related config
tcp_connection_lifetime=3605
tcp_conn_wq_max=30000000
tcp_rd_buf_size=5273226
We are running kamilio 4.4.5
Thanks in advance!
Diego
Post by Diego Nadares
Hi guys!
We have four a scripts that sends dlg.list command to kamailio through
xmlrpc. They are not executed simultaneously. Sometimes, we are getting
fm_search_defrag(): fm_search_defrag(0x7f212c25a000, 5273984); Free
fragment not found!2017-05-26T13:54:20.438736-03:00 drwsip02
tcp_main.c: tcpconn_new(957), module: core; Free fragment not
found!2017-05-26T13:54:20.439101-03:00 drwsip02
tcpconn_new(): mem. allocation failure2017-05-26T13:54:20.439344-03:00
handle_new_connect(): tcpconn_new failed, closing socket
tcp_conn_wq_max=30000000
tcp_rd_buf_size=5273226
How can I see how much memory xmlrpc is using?
Any advice will be appreciated.
Thanks in advance!
Diego
_______________________________________________
--
Daniel-Constantin Mierla -- www.asipto.comwww.twitter.com/miconda -- www.linkedin.com/in/miconda
Kamailio World Conference -- www.kamailioworld.com
Kamailio Advanced Training, Nov 12-14, 2018, in Berlin -- www.asipto.com
--
Daniel-Constantin Mierla -- www.asipto.comwww.twitter.com/miconda -- www.linkedin.com/in/miconda
Kamailio World Conference -- www.kamailioworld.com
Kamailio Advanced Training, Nov 12-14, 2018, in Berlin -- www.asipto.com
Loading...