Hey All. I know there are promises in ROS7 for better BGP performance but the CCR and the ever slow BGP is starting to grow very tired for me. Waiting 5-10mins everytime you change a filter or update a table is coming more than inconvenient. That being said, I see only two options available to me. 1. RouterOS on x86 and to look at a dual core system with a high clock speed in the 3Ghz range, however I have to be very careful around support/capability of disk controllers and others or I might end up with 6 machines I cant use or have to run it inside a VM. 1.a is RoS X86 still oly 32bit so limited to 4GB RAM? 1.b Anyone have any known good configurations with high CPU configs and dual power? 2. Swap to Vyatta/Brocade which is not really something I want to do, but if I have too I will. Advice/Experience appreciated. Thanks Daniel
Hi Daniel, I am running a number CCR1016-12S-1S+ with BGP and I had similar issues when taking the full table, it would take around 5-8 minutes to fully converge. What I ended up doing was having my provider provide me a default route and put a filter in inbound from the provider providing the full table to basically only pass in the default route. That way my router didn’t load the full table, just the default route plus the bgp feeds from my peers. This significantly speed BGP up for me and is working well but leaves the option open later for me if I want to handle the full table. Not sure if you can do something similar but it is worth exploring. Regards, Matthew Enger Matthew Enger | Managing Director PO Box 3279, The Pines, Victoria, 3109 T 1300 789 299 D 03 9909 3104 M 0406 532 792 F 03 8611 7946 m.enger@xi.com.au | www.xi.com.au This email message and any attachments are the property of X Integration. The contents of this email are copyright and may also be confidential and/or legally privileged. They are intended solely for the addressee and it is not intended that either confidentiality or privilege be waived or lost by mistaken delivery to you. Please notify us immediately and delete this communication if received in error. Consider the environment before printing this email. On 13/11/2015 9:24 am, "Daniel Hoffman" <daniel@hoff.id.au> wrote:
Hey All.
I know there are promises in ROS7 for better BGP performance but the CCR and the ever slow BGP is starting to grow very tired for me. Waiting 5-10mins everytime you change a filter or update a table is coming more than inconvenient.
That being said, I see only two options available to me.
1. RouterOS on x86 and to look at a dual core system with a high clock speed in the 3Ghz range, however I have to be very careful around support/capability of disk controllers and others or I might end up with 6 machines I cant use or have to run it inside a VM.
1.a is RoS X86 still oly 32bit so limited to 4GB RAM? 1.b Anyone have any known good configurations with high CPU configs and dual power?
2. Swap to Vyatta/Brocade which is not really something I want to do, but if I have too I will.
Advice/Experience appreciated.
Thanks
Daniel _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
We do similar, as we have peering running as well as two transit providers we had some issues with routing tables, we ended up just taking default route from transit providers and then the full routing table from the peering provider, well the routing table including all of their peering partners, about 35000 entries or so, and we only maintain that on our border routers facing them, all of our other internal routers just have default routes via OSPF to those border routers. Regards Paul -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Matthew Enger Sent: Friday, 13 November 2015 9:33 AM To: MikroTik Australia Public List Subject: Re: [MT-AU Public] BGP and CCR Hi Daniel, I am running a number CCR1016-12S-1S+ with BGP and I had similar issues when taking the full table, it would take around 5-8 minutes to fully converge. What I ended up doing was having my provider provide me a default route and put a filter in inbound from the provider providing the full table to basically only pass in the default route. That way my router didn’t load the full table, just the default route plus the bgp feeds from my peers. This significantly speed BGP up for me and is working well but leaves the option open later for me if I want to handle the full table. Not sure if you can do something similar but it is worth exploring. Regards, Matthew Enger Matthew Enger | Managing Director PO Box 3279, The Pines, Victoria, 3109 T 1300 789 299 D 03 9909 3104 M 0406 532 792 F 03 8611 7946 m.enger@xi.com.au | www.xi.com.au This email message and any attachments are the property of X Integration. The contents of this email are copyright and may also be confidential and/or legally privileged. They are intended solely for the addressee and it is not intended that either confidentiality or privilege be waived or lost by mistaken delivery to you. Please notify us immediately and delete this communication if received in error. Consider the environment before printing this email. On 13/11/2015 9:24 am, "Daniel Hoffman" <daniel@hoff.id.au> wrote:
Hey All.
I know there are promises in ROS7 for better BGP performance but the CCR and the ever slow BGP is starting to grow very tired for me. Waiting 5-10mins everytime you change a filter or update a table is coming more than inconvenient.
That being said, I see only two options available to me.
1. RouterOS on x86 and to look at a dual core system with a high clock speed in the 3Ghz range, however I have to be very careful around support/capability of disk controllers and others or I might end up with 6 machines I cant use or have to run it inside a VM.
1.a is RoS X86 still oly 32bit so limited to 4GB RAM? 1.b Anyone have any known good configurations with high CPU configs and dual power?
2. Swap to Vyatta/Brocade which is not really something I want to do, but if I have too I will.
Advice/Experience appreciated.
Thanks
Daniel _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.a u
Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
Question how often would you need to be making updates ? excuse my naivety. I know I played around a lot with our BGP setup (consumer not transit), but haven't touched it now in a while. I have 5 upstream feeding into 2 VM's I take full feeds, but I filter down to about 20-30k prefixes and some specific /24's A -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Friday, 13 November 2015 9:49 AM To: 'MikroTik Australia Public List' <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] BGP and CCR We do similar, as we have peering running as well as two transit providers we had some issues with routing tables, we ended up just taking default route from transit providers and then the full routing table from the peering provider, well the routing table including all of their peering partners, about 35000 entries or so, and we only maintain that on our border routers facing them, all of our other internal routers just have default routes via OSPF to those border routers. Regards Paul -----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Matthew Enger Sent: Friday, 13 November 2015 9:33 AM To: MikroTik Australia Public List Subject: Re: [MT-AU Public] BGP and CCR Hi Daniel, I am running a number CCR1016-12S-1S+ with BGP and I had similar issues when taking the full table, it would take around 5-8 minutes to fully converge. What I ended up doing was having my provider provide me a default route and put a filter in inbound from the provider providing the full table to basically only pass in the default route. That way my router didn’t load the full table, just the default route plus the bgp feeds from my peers. This significantly speed BGP up for me and is working well but leaves the option open later for me if I want to handle the full table. Not sure if you can do something similar but it is worth exploring. Regards, Matthew Enger Matthew Enger | Managing Director PO Box 3279, The Pines, Victoria, 3109 T 1300 789 299 D 03 9909 3104 M 0406 532 792 F 03 8611 7946 m.enger@xi.com.au | www.xi.com.au This email message and any attachments are the property of X Integration. The contents of this email are copyright and may also be confidential and/or legally privileged. They are intended solely for the addressee and it is not intended that either confidentiality or privilege be waived or lost by mistaken delivery to you. Please notify us immediately and delete this communication if received in error. Consider the environment before printing this email. On 13/11/2015 9:24 am, "Daniel Hoffman" <daniel@hoff.id.au> wrote:
Hey All.
I know there are promises in ROS7 for better BGP performance but the CCR and the ever slow BGP is starting to grow very tired for me. Waiting 5-10mins everytime you change a filter or update a table is coming more than inconvenient.
That being said, I see only two options available to me.
1. RouterOS on x86 and to look at a dual core system with a high clock speed in the 3Ghz range, however I have to be very careful around support/capability of disk controllers and others or I might end up with 6 machines I cant use or have to run it inside a VM.
1.a is RoS X86 still oly 32bit so limited to 4GB RAM? 1.b Anyone have any known good configurations with high CPU configs and dual power?
2. Swap to Vyatta/Brocade which is not really something I want to do, but if I have too I will.
Advice/Experience appreciated.
Thanks
Daniel _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.a u
Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
It's reasonably common to be making changes to path lengths etc when you have multiple upstreams. There are even a number of software platforms available to automate these for service providers to help ensure best latency/reachability or lowest cost path to a customer; that's more on the hosted services side but on the ISP side it's all about being able to balance inbound traffic to meet and not exceed your CIR unless necessary. There's a bunch of other users too but those are 2 of the more common reasons *why* you'd be doing frequent manual or automated updates. - Andrew On Fri, Nov 13, 2015 at 8:55 AM, Alex Samad - Yieldbroker < Alex.Samad@yieldbroker.com> wrote:
Question how often would you need to be making updates ? excuse my naivety. I know I played around a lot with our BGP setup (consumer not transit), but haven't touched it now in a while.
I have 5 upstream feeding into 2 VM's I take full feeds, but I filter down to about 20-30k prefixes and some specific /24's
A
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Paul Julian Sent: Friday, 13 November 2015 9:49 AM To: 'MikroTik Australia Public List' <public@talk.mikrotik.com.au> Subject: Re: [MT-AU Public] BGP and CCR
We do similar, as we have peering running as well as two transit providers we had some issues with routing tables, we ended up just taking default route from transit providers and then the full routing table from the peering provider, well the routing table including all of their peering partners, about 35000 entries or so, and we only maintain that on our border routers facing them, all of our other internal routers just have default routes via OSPF to those border routers.
Regards Paul
-----Original Message----- From: Public [mailto:public-bounces@talk.mikrotik.com.au] On Behalf Of Matthew Enger Sent: Friday, 13 November 2015 9:33 AM To: MikroTik Australia Public List Subject: Re: [MT-AU Public] BGP and CCR
Hi Daniel,
I am running a number CCR1016-12S-1S+ with BGP and I had similar issues when taking the full table, it would take around 5-8 minutes to fully converge.
What I ended up doing was having my provider provide me a default route and put a filter in inbound from the provider providing the full table to basically only pass in the default route. That way my router didn’t load the full table, just the default route plus the bgp feeds from my peers.
This significantly speed BGP up for me and is working well but leaves the option open later for me if I want to handle the full table.
Not sure if you can do something similar but it is worth exploring.
Regards,
Matthew Enger
Matthew Enger | Managing Director PO Box 3279, The Pines, Victoria, 3109 T 1300 789 299 D 03 9909 3104 M 0406 532 792 F 03 8611 7946 m.enger@xi.com.au | www.xi.com.au
This email message and any attachments are the property of X Integration. The contents of this email are copyright and may also be confidential and/or legally privileged. They are intended solely for the addressee and it is not intended that either confidentiality or privilege be waived or lost by mistaken delivery to you. Please notify us immediately and delete this communication if received in error. Consider the environment before printing this email. On 13/11/2015 9:24 am, "Daniel Hoffman" <daniel@hoff.id.au> wrote:
Hey All.
I know there are promises in ROS7 for better BGP performance but the CCR and the ever slow BGP is starting to grow very tired for me. Waiting 5-10mins everytime you change a filter or update a table is coming more than inconvenient.
That being said, I see only two options available to me.
1. RouterOS on x86 and to look at a dual core system with a high clock speed in the 3Ghz range, however I have to be very careful around support/capability of disk controllers and others or I might end up with 6 machines I cant use or have to run it inside a VM.
1.a is RoS X86 still oly 32bit so limited to 4GB RAM? 1.b Anyone have any known good configurations with high CPU configs and dual power?
2. Swap to Vyatta/Brocade which is not really something I want to do, but if I have too I will.
Advice/Experience appreciated.
Thanks
Daniel _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.a u
Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
_______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au _______________________________________________ Public mailing list Public@talk.mikrotik.com.au http://talk.mikrotik.com.au/mailman/listinfo/public_talk.mikrotik.com.au
participants (5)
-
Alex Samad - Yieldbroker -
Andrew Cox -
Daniel Hoffman -
Matthew Enger -
Paul Julian