Community discussions

MikroTik App
Reiney
newbie
Topic Author
Posts: 28
Joined: Sat Feb 05, 2011 7:22 am

Multiple BGP sessions to one provider

Wed Mar 15, 2017 10:21 am

Hi All,

我am trying to bring up a second BGP session on a new circuit to an existing
provider (with an existing BGP session). So, for example I have an established
session from my AS to Provider-1 over a 200 Mbps Metro-E circuit. I'm trying
to establish a second session from my AS to Provider-1 over a new 1 Gbps
Metro-E circuit. Both circuits have dedicated IP addresses for my end and theirs.

What is happening is that the second session will establish, then drop atfer 90 seconds
because the Hold Timer expired (that's the message in my log file). If I disable the first
session (/routing/bgp/peer set 0 disabled=yes) then the second session will come up,
and stay up.

How do I get both to stay up at the same time?

TIA, Reiney
Top
User avatar
ZeroByte
Forum Guru
Forum Guru
Posts: 4047
Joined: Wed May 11, 2011 6:08 pm

Re: Multiple BGP sessions to one provider

Fri Mar 17, 2017 7:55 pm

Multiple peers to the same remote ASN shouldn't give any problems like this.
你这个作为第二边界网关协议实例配置吗?我f so, then you shouldn't do it that way, it should just be two peers for the same local BGP instance.

Another thing it could be....

Are your sessions using eBGP multihop, or are you peering with the remote IP on each directly-connected WAN link? If multihop, then make sure that the new peer's IP address is static-routed via link 2, and that link 1's peer is static routed via link 1.
Top
User avatar
ScottReed
Member Candidate
Member Candidate
Posts: 114
Joined: Thu Sep 24, 2009 9:47 pm
Location:Montana / Western Massachusetts

Re: Multiple BGP sessions to one provider

Tue May 16, 2017 3:35 pm

我am having a similar issue.

CCR1072 rOS 6.37.4

Yesterday I tried to bring up a second session with Zayo for IPv6. Full routes from them and one advertisement from me. Within 3 minutes my routing table is empty and the network is completely down. My OSPF instance is also affected. I get BGP Hold Timer Expired messages for all peering sessions. I get Full to Down messages for my OSPF neighbors.

我peer with 59 other endpoints, both IPv4 and IPv6 with no issue. I am taking FULL ROUTES for IPv4 and IPv6 from Hurricane Electric. I take FULL ROUTES for IPv4 from Zayo. As stated above, trying to get FULL ROUTES for IPv6 from Zayo too. I am advertising a single /48 IPv6 block.

My gut feeling is that this is either a bug or some sort of limitation in RouterOS. First thing that comes to mind is that there is a problem with populating the IPv6 routing table with full routes from more than two peers.
Top
User avatar
ZeroByte
Forum Guru
Forum Guru
Posts: 4047
Joined: Wed May 11, 2011 6:08 pm

Re: Multiple BGP sessions to one provider

Tue May 16, 2017 11:49 pm

我wouldn't be surprised. Mikrotik has been working on a complete overhaul of the routing engine for ROSv7 (a mythical creature oft spoken of, yet never seen outside the land of Latvia) and the IPv6 features have been pretty stagnant for quite a while, except for certain bug fixes and a few enhancements. Does your IPv6 peering use link-local addressing or globally-unique (public) addressing?
我've seen some issues with link-local next hop in ROS's IPv6 BGP.
Top
faisali
Member Candidate
Member Candidate
Posts: 180
Joined: Fri Oct 08, 2010 5:11 am

Re: Multiple BGP sessions to one provider

Wed May 17, 2017 4:07 pm

我t could be something to do with CCR & 1 CPU Core for BGP .... I can tell you that is not an issue on the X86 or CHR platform...
We have multiple X86 based routers doing all kinds of BGP sessions v4 & v6 (multiple full tables etc etc) without any issues... different versions of ROS 6.32 to 6.37.4
Top
User avatar
ScottReed
Member Candidate
Member Candidate
Posts: 114
Joined: Thu Sep 24, 2009 9:47 pm
Location:Montana / Western Massachusetts

Re: Multiple BGP sessions to one provider

Wed May 17, 2017 4:25 pm

Does your IPv6 peering use link-local addressing or globally-unique (public) addressing?
我've seen some issues with link-local next hop in ROS's IPv6 BGP.
Thanks for the reply. Both my interface to the exchange and interface to Zayo have global IPv6 addresses. I'm in a /64 at the exchange and /126 with Zayo.
我t could be something to do with CCR & 1 CPU Core for BGP
我agree 100%

我'm going to be doing some early morning troubleshooting with Zayo to try and get the session up. I'm also hoping that there is just some sort of configuration issue upstream of me that is causing grief to the routing table when the session comes up.

我f I can sort anything out I will update this.
Top
User avatar
Cha0s
Forum Guru
Forum Guru
Posts: 1094
Joined: 2005年10月11日星期二下午4点

Re: Multiple BGP sessions to one provider

Sat Jun 03, 2017 5:44 pm

Check with Zayo about their hold/keepalive timers.

When the timers are not the same on both ends, Mikrotik behaves unpredictably sometimes.
Top
User avatar
shaoranrch
Member Candidate
Member Candidate
Posts: 184
Joined: Thu Feb 13, 2014 8:03 pm

Re: Multiple BGP sessions to one provider

Sun Jun 04, 2017 1:48 am

我actually had an issue like this with IPv4. Multiple peers within a router, one of them went down then up. Got a message about hold timer expired and the next thing I know is that even the OSPF adyacencies went down on this particular router, as if the routing process went down. Happened 3 times, with 6.37.4 I believe every single time was the same, then it just stopped happening.

As far I know the routing process is the same for both BGP and OSPF, and it's using a single core, if something makes it hang (be it due to an issue within BGP or OSPF) then all the routing goes down until it resets or "fix" itself.

Enviado desde mi SAMSUNG-SM-G920A mediante Tapatalk
Top
SplitHorizon
just joined
Posts: 11
Joined: Tue Feb 09, 2016 10:56 am

Re: Multiple BGP sessions to one provider

Thu Aug 03, 2017 9:08 pm

Multiple peers to the same remote ASN shouldn't give any problems like this.
你这个作为第二边界网关协议实例配置吗?我f so, then you shouldn't do it that way, it should just be two peers for the same local BGP instance.

Another thing it could be....

Are your sessions using eBGP multihop, or are you peering with the remote IP on each directly-connected WAN link? If multihop, then make sure that the new peer's IP address is static-routed via link 2, and that link 1's peer is static routed via link 1.
Hi ZeroByte,

我f you may, what are the issues associated with having two seperate BGP instances one for IPv4 and one for IPv6? I ask because i am in the process of deploying IPv6.. yes i am late to the party.. for example i am already peering with transit provider X for IPv4 and the instance is Y. My iBGP for IPv4 all runs on instance Y... What are the risks in creating a new BGP instance B solely for IPv6 BGP. i have seen people argue that with some vendor equipment you cannot establish a second BGP peer due to the Router ID which can only be changed by another Instance. Sorry for cross-posting if i am, i do apologize, its just this discussion really fits in well with what i am currently working on...
Top
User avatar
ZeroByte
Forum Guru
Forum Guru
Posts: 4047
Joined: Wed May 11, 2011 6:08 pm

Re: Multiple BGP sessions to one provider

Thu Aug 03, 2017 9:33 pm

我don't think it would be that much of a problem to run IPv4 in an instance and IPv6 in a different instance, since the two routing tables have nothing to do with each other anyway.
The problem with using different instances for different eBGP peers in the same protocol is that BGP won't be able to properly compare the paths with each other prior to choosing the best BGP route. Each instance would have one and only one route, all of which would be attempting to activate themselves in the RIB, and then you could only choose between them by setting different admin distances for each instance.

That's bad, mm-kay?

But since IPv6 routes don't have anything to do with IPv4 routes, it shouldn't be an issue (at least no issues come to my mind right now).
Top
SplitHorizon
just joined
Posts: 11
Joined: Tue Feb 09, 2016 10:56 am

Re: Multiple BGP sessions to one provider

清华2017年8月3日9:43点

我don't think it would be that much of a problem to run IPv4 in an instance and IPv6 in a different instance, since the two routing tables have nothing to do with each other anyway.
The problem with using different instances for different eBGP peers in the same protocol is that BGP won't be able to properly compare the paths with each other prior to choosing the best BGP route. Each instance would have one and only one route, all of which would be attempting to activate themselves in the RIB, and then you could only choose between them by setting different admin distances for each instance.

That's bad, mm-kay?

But since IPv6 routes don't have anything to do with IPv4 routes, it shouldn't be an issue (at least no issues come to my mind right now).
Thanks, i get what you mean in the response above.. priceless info. I will start a new post with some of the challenges i have faced deploying IPv6 hopefully you may have some input as well as the other individuals that have successfully deployed IPv6 on this forum. Africa is obviously lagging behind in IPv6 deployment at the moment but with the help of you all should be a breeze hehe... thanks again ZeroByte.
Top

Who is online

Users browsing this forum: No registered users and 1 guest