These are chat archives for Exa-Networks/exabgp

15th
Mar 2017
Justin
@JustinAzoff
Mar 15 2017 21:39
Anyone look at memory usage lately?
recently trippled the number of /32s we are using exabgp to inject and OOM'ed our box
Thomas Mangin
@thomas-mangin
Mar 15 2017 21:40
For sending out it should not be an issue
Justin
@JustinAzoff
Mar 15 2017 21:40
looks like 180k /32s to 3 peers is using 3.2G of ram or so (our boxes had 3G allocated)
Thomas Mangin
@thomas-mangin
Mar 15 2017 21:40
How many prefixes are you sending ?
Justin
@JustinAzoff
Mar 15 2017 21:41
clearly fine for 60k, not so much for 180k
Thomas Mangin
@thomas-mangin
Mar 15 2017 21:41
Whoa, never had that use case, so the routes share attributes?
S/so/do/
Justin
@JustinAzoff
Mar 15 2017 21:42
still on 3.4.9, but starting up a test with 3.4.18 is maxing out my test vm
oh yeah, they are all the same
many years back I submitted some patches that cached communities and things, but this config is a bit different
Thomas Mangin
@thomas-mangin
Mar 15 2017 21:42
Can you open an issue on GitHub with these numbers
Justin
@JustinAzoff
Mar 15 2017 21:43
it's 180k lines of
Thomas Mangin
@thomas-mangin
Mar 15 2017 21:43
I still try to save on parsing from peers but I do. It believe the same is done in the config parser
Justin
@JustinAzoff
Mar 15 2017 21:43
        route 189.243.174.115/32 next-hop self community [ 64512:666 no-export ] ;
Thomas Mangin
@thomas-mangin
Mar 15 2017 21:43
So it may be easy to fix,
Justin
@JustinAzoff
Mar 15 2017 21:44
  PID USER      PR  NI    VIRT    RES    SHR S  %CPU %MEM     TIME+ COMMAND
27143 nobody    20   0 3634992 3.380g   3660 S   0.0 87.5   3:46.65 python2.7
Thomas Mangin
@thomas-mangin
Mar 15 2017 21:44
Or not I need to look into it
Justin
@JustinAzoff
Mar 15 2017 21:44
yeah.. i mean, the text config is only 15MB
Thomas Mangin
@thomas-mangin
Mar 15 2017 21:45
17kbytes per routes looks excessive
Justin
@JustinAzoff
Mar 15 2017 21:45
i need to upgrade as it is, looks like i've been getting stuff like this in the log
WARNING  | 25658  | reactor       | Command from process not understood : no-export ]
Command from process not understood : thdraw route
that sort of thing
probably been going on for a while I just never noticed
Thomas Mangin
@thomas-mangin
Mar 15 2017 21:46
You do not need to give attributes on withdraw commands
Justin
@JustinAzoff
Mar 15 2017 21:47
oh, probably not worth it to simplify that.. but I mean it normally works
Command from process bhr-dynamic : withdraw route ...
just it seems something screwy is happening with buffering and it's getting partial commands
Thomas Mangin
@thomas-mangin
Mar 15 2017 21:48
Ok, I am going to sleep soon - long days
Justin
@JustinAzoff
Mar 15 2017 21:48
ah right, timezones :)
i'll get together some numbers and create an issue on gh
Thomas Mangin
@thomas-mangin
Mar 15 2017 21:48
Yep GMT here
Thanks - I will investigate
Justin
@JustinAzoff
Mar 15 2017 21:48
and fortunately i have years with of syslog so i can see if this is a new issue or not with the commands
nope.. old issue. probably happening more now due to the higher load