nanog mailing list archives
Mikrotik in the DFZ (Was Re: AW: AW: /27 the new /24)
From: William Waites <wwaites () tardis ed ac uk>
Date: Sat, 03 Oct 2015 09:23:49 +0100 (BST)
On Fri, 2 Oct 2015 23:11:47 +0000, Jürgen Jaritsch <jj () anexia at> said: > Regarding the words "I have a small router which handles > multiple full tables ...": push and pull a few full tables at > the same time and you'll see what's happening: the CCRs are > SLOW. And why? Because the software is not as good as it could > be: the BGP daemon uses only one core of a 36(?) core CPU. To expand on this, the problem is worse than being single-threaded. I had one of these in the lab and fed it 2x full tables. Sure it wasn't the fastest at accepting them but then I noticed that even in steady state one of the CPUs was pegged. What was happening -- and this was confirmed by Mikrotik -- was that it was recalculating the *entire* FIB for each update. The general background noise of announce / withdraw messages means it is doing this all the time. Any churn and it would have a very hard time. There are other serious bugs such as not doing recursive next hop lookup for IPv6 (it does for IPv4). This makes them unuseable as BGP routers even for partial tables with most non-trivial iBGP topologies. All of which may be fixed one day in version 7 of their operating system, which will inevitably have many bugs as any software project .0 release will, so we'll have to wait for 7.x for it to be reasonably safe to use. That said, we use a lot of Mikrotik kit for our rural networks. They're weird and quirky but you can't beat them on price, port density and power consumption. With 16 ports and 36 cores surely they should be capable of pushing several Gbps of traffic with a few full tables. I wish it were possible today to run different software on their larger boxes. If some like-minded small providers wanted to get together with us to fund a FreeBSD port to the CCR routers that would be great. Please contact me off-list if you are interested in this, I'll coordinate. As it is we don't let them anywhere near the DFZ, that's done with PCs running FreeBSD and BIRD which can easily do the job but is still an order of magnitude more expensive (and an order of magnitude less expensive than what you need if you want 10s of Gbps). -w -- William Waites <wwaites () tardis ed ac uk> | School of Informatics http://tardis.ed.ac.uk/~wwaites/ | University of Edinburgh https://hubs.net.uk/ | HUBS AS60241 The University of Edinburgh is a charitable body, registered in Scotland, with registration number SC005336.
Attachment:
_bin
Description:
Current thread:
- Re: /27 the new /24, (continued)
- Re: /27 the new /24 Josh Luthman (Oct 02)
- Re: AW: /27 the new /24 Mike Hammett (Oct 02)
- AW: AW: /27 the new /24 Jürgen Jaritsch (Oct 02)
- Re: AW: AW: /27 the new /24 Mel Beckman (Oct 02)
- Re: AW: AW: /27 the new /24 Mike Hammett (Oct 02)
- AW: AW: AW: /27 the new /24 Jürgen Jaritsch (Oct 03)
- Re: AW: AW: AW: /27 the new /24 Mike Hammett (Oct 03)
- Re: AW: AW: AW: /27 the new /24 James Jun (Oct 04)
- Re: AW: AW: AW: /27 the new /24 Jérôme Nicolle (Oct 09)
- Re: AW: AW: AW: /27 the new /24 Mike Hammett (Oct 09)
- Mikrotik in the DFZ (Was Re: AW: AW: /27 the new /24) William Waites (Oct 03)
- Re: Mikrotik in the DFZ (Was Re: AW: AW: /27 the new /24) Mike Hammett (Oct 03)
- Re: Mikrotik in the DFZ (Was Re: AW: AW: /27 the new /24) Jérôme Nicolle (Oct 09)
- Re: AW: /27 the new /24 Randy Bush (Oct 02)
- Re: AW: /27 the new /24 Mike Hammett (Oct 02)
- AW: AW: /27 the new /24 Jürgen Jaritsch (Oct 03)
- Re: /27 the new /24 Daniel Suchy (Oct 02)
- Re: /27 the new /24 Suresh Ramasubramanian (Oct 02)
- Re: /27 the new /24 William Herrin (Oct 02)
- Re: /27 the new /24 Jason Baugher (Oct 02)