- mice-discuss - lists.micemn.net

Global Net (AS395466) - Circuit Down

by Global Net NOC

MICEMN Members - Our circuit to Cologix in Minneapolis is hard down due to a bridge collapse, train derailment and subsequent fiber cut in Columbus, MT. Our BGP sessions remain down. GLOBAL NET AS 395466 IPV4 206.108.255.97 IPV6 2001:504:27:0:6:8ca:0:1 Thanks, Global Net NOC noc(a)theglobal.net Global Net Peering peering(a)theglobal.net

June 24, 2023

Re: [External] Re: [MICE-DISCUSS] Three BGP peers

by Tom Krenn

They did mention a transport issue they are working on when I talked to them earlier today. Sounds like they are hoping for a resolution before Monday. Tom Krenn Network Architect Enterprise Architecture - Information Technology -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Steve Savoy Sent: Friday, June 23, 2023 3:18 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [External] Re: [MICE-DISCUSS] Three BGP peers CAUTION: This email was sent from outside of Hennepin County. Unless you recognize the sender and know the content, do not click links or open attachments. Has Yahoo been re-established for anyone? Thanks, Steve -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Thursday, June 22, 2023 4:42 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Three BGP peers Anyone else seeing both Yahoo peers and one Google peer down since early am? I didn't see any log messages about exceeding prefix counts or the like. Frank SiouxCity-Fibernet-Arista(s2)#sh ip bgp sum | ex Estab BGP summary information for VRF default Router identifier 207.32.15.21, local AS number 18883 Neighbor Status Codes: m - Under maintenance Neighbor V AS MsgRcvd MsgSent InQ OutQ Up/Down State PfxRcd PfxAcc 206.108.255.58 4 10310 2035987 4886675 0 0 12:23:38 Active 206.108.255.59 4 10310 2029469 4886360 0 0 12:23:41 Active 206.108.255.167 4 15169 2050148 4888984 0 0 12:23:40 Active SiouxCity-Fibernet-Arista(s2)#sh ipv6 bgp sum | ex Estab BGP summary information for VRF default Router identifier 207.32.15.21, local AS number 18883 Neighbor Status Codes: m - Under maintenance Neighbor V AS MsgRcvd MsgSent InQ OutQ Up/Down State PfxRcd PfxAcc 2001:504:27::2846:0:1 4 10310 2209610 1893247 0 0 12:23:40 Active 2001:504:27::2846:0:2 4 10310 2202613 1892818 0 0 12:23:47 Active 2001:504:27::3b41:0:2 4 15169 2043589 1894022 0 0 12:23:48 Active SiouxCity-Fibernet-Arista(s2)# Confidentiality Notice: This correspondence is the property of Winnebago Cooperative Telecom Association and is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. Disclaimer: If you are not the intended recipient of this message, please immediately notify the sender of the transmission error and then promptly permanently delete this message from your computer system.

June 23, 2023

Re: Three BGP peers

by Steve Savoy

Thank you for the update Jay. Have a great weekend everyone. -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jay Hanke Sent: Friday, June 23, 2023 3:20 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Three BGP peers Both Yahoo MICE ports are still down. 1/2 Google ports are down. On Fri, Jun 23, 2023 at 3:18 PM Steve Savoy <stevesavoy(a)wctatel.com> wrote: > > Has Yahoo been re-established for anyone? > > Thanks, > Steve > > -----Original Message----- > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk > Sent: Thursday, June 22, 2023 4:42 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: [MICE-DISCUSS] Three BGP peers > > Anyone else seeing both Yahoo peers and one Google peer down since early am? I didn't see any log messages about exceeding prefix counts or the like. > > Frank > > SiouxCity-Fibernet-Arista(s2)#sh ip bgp sum | ex Estab BGP summary information for VRF default Router identifier 207.32.15.21, local AS number 18883 Neighbor Status Codes: m - Under maintenance > Neighbor V AS MsgRcvd MsgSent InQ OutQ Up/Down State PfxRcd PfxAcc > 206.108.255.58 4 10310 2035987 4886675 0 0 12:23:38 Active > 206.108.255.59 4 10310 2029469 4886360 0 0 12:23:41 Active > 206.108.255.167 4 15169 2050148 4888984 0 0 12:23:40 Active > SiouxCity-Fibernet-Arista(s2)#sh ipv6 bgp sum | ex Estab BGP summary information for VRF default Router identifier 207.32.15.21, local AS number 18883 Neighbor Status Codes: m - Under maintenance > Neighbor V AS MsgRcvd MsgSent InQ OutQ Up/Down State PfxRcd PfxAcc > 2001:504:27::2846:0:1 4 10310 2209610 1893247 0 0 12:23:40 Active > 2001:504:27::2846:0:2 4 10310 2202613 1892818 0 0 12:23:47 Active > 2001:504:27::3b41:0:2 4 15169 2043589 1894022 0 0 12:23:48 Active > SiouxCity-Fibernet-Arista(s2)# > Confidentiality Notice: This correspondence is the property of Winnebago Cooperative Telecom Association and is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message.

June 23, 2023

Re: Three BGP peers

by Jay Hanke

Both Yahoo MICE ports are still down. 1/2 Google ports are down. On Fri, Jun 23, 2023 at 3:18 PM Steve Savoy <stevesavoy(a)wctatel.com> wrote: > > Has Yahoo been re-established for anyone? > > Thanks, > Steve > > -----Original Message----- > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk > Sent: Thursday, June 22, 2023 4:42 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: [MICE-DISCUSS] Three BGP peers > > Anyone else seeing both Yahoo peers and one Google peer down since early am? I didn't see any log messages about exceeding prefix counts or the like. > > Frank > > SiouxCity-Fibernet-Arista(s2)#sh ip bgp sum | ex Estab BGP summary information for VRF default Router identifier 207.32.15.21, local AS number 18883 Neighbor Status Codes: m - Under maintenance > Neighbor V AS MsgRcvd MsgSent InQ OutQ Up/Down State PfxRcd PfxAcc > 206.108.255.58 4 10310 2035987 4886675 0 0 12:23:38 Active > 206.108.255.59 4 10310 2029469 4886360 0 0 12:23:41 Active > 206.108.255.167 4 15169 2050148 4888984 0 0 12:23:40 Active > SiouxCity-Fibernet-Arista(s2)#sh ipv6 bgp sum | ex Estab BGP summary information for VRF default Router identifier 207.32.15.21, local AS number 18883 Neighbor Status Codes: m - Under maintenance > Neighbor V AS MsgRcvd MsgSent InQ OutQ Up/Down State PfxRcd PfxAcc > 2001:504:27::2846:0:1 4 10310 2209610 1893247 0 0 12:23:40 Active > 2001:504:27::2846:0:2 4 10310 2202613 1892818 0 0 12:23:47 Active > 2001:504:27::3b41:0:2 4 15169 2043589 1894022 0 0 12:23:48 Active > SiouxCity-Fibernet-Arista(s2)# > Confidentiality Notice: This correspondence is the property of Winnebago Cooperative Telecom Association and is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message.

June 23, 2023

Re: Three BGP peers

by Steve Savoy

Has Yahoo been re-established for anyone? Thanks, Steve -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Thursday, June 22, 2023 4:42 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Three BGP peers Anyone else seeing both Yahoo peers and one Google peer down since early am? I didn't see any log messages about exceeding prefix counts or the like. Frank SiouxCity-Fibernet-Arista(s2)#sh ip bgp sum | ex Estab BGP summary information for VRF default Router identifier 207.32.15.21, local AS number 18883 Neighbor Status Codes: m - Under maintenance Neighbor V AS MsgRcvd MsgSent InQ OutQ Up/Down State PfxRcd PfxAcc 206.108.255.58 4 10310 2035987 4886675 0 0 12:23:38 Active 206.108.255.59 4 10310 2029469 4886360 0 0 12:23:41 Active 206.108.255.167 4 15169 2050148 4888984 0 0 12:23:40 Active SiouxCity-Fibernet-Arista(s2)#sh ipv6 bgp sum | ex Estab BGP summary information for VRF default Router identifier 207.32.15.21, local AS number 18883 Neighbor Status Codes: m - Under maintenance Neighbor V AS MsgRcvd MsgSent InQ OutQ Up/Down State PfxRcd PfxAcc 2001:504:27::2846:0:1 4 10310 2209610 1893247 0 0 12:23:40 Active 2001:504:27::2846:0:2 4 10310 2202613 1892818 0 0 12:23:47 Active 2001:504:27::3b41:0:2 4 15169 2043589 1894022 0 0 12:23:48 Active SiouxCity-Fibernet-Arista(s2)# Confidentiality Notice: This correspondence is the property of Winnebago Cooperative Telecom Association and is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message.

June 23, 2023

Re: Route Server 1 - BFD not working

by Richard Laager

On 2023-06-23 10:46, Jonathan Stewart wrote: > Richard's debugging suggested it was BIRD not responding to valid BFD > packets transmitted from our Juniper router. Re: "valid". In looking at the packet capture again, I'm not sure how the discriminator values are supposed to look. So maybe that is related. > The problem for diagnosis is reproduceability. Since a session reset > fixed the problem, we can't reproduce the problem, and that makes > diagnosis impossible without additional data. > > To be clear, I don't expect any further action from MICE, as the > problem is resolved. I sent a write-up to the bird-users mailing list. We'll see if anyone there has any ideas. -- Richard

June 23, 2023

Re: Route Server 1 - BFD not working

by Jonathan Stewart

Richard's debugging suggested it was BIRD not responding to valid BFD packets transmitted from our Juniper router. But almost all BFD sessions are up, so what's wrong with this specific one--or pair in this case? There was a fibre cut which disconnected AS18451 from MICE for 1.5 days--maybe at service restoration there was packet loss for the first few seconds, so BFD handshaking failed? The problem for diagnosis is reproduceability. Since a session reset fixed the problem, we can't reproduce the problem, and that makes diagnosis impossible without additional data. To be clear, I don't expect any further action from MICE, as the problem is resolved. I'm just discussing troubleshooting and the limitations of our knowledge about this problem. Cheers, Jonathan Stewart AS18451 On Thu, 2023-06-22 3:53 p.m., Mike Horwath wrote: > On Thu, Jun 22, 2023 at 02:40:14PM -0500, Jonathan Stewart wrote: >> Disable the BGP (and thus also BFD) session, waited a minute, and >> re-enabled BGP & BFD. >> >> Came back as normal and looks fine now on both IPv4 and IPv6. >> >> Thanks for the assistance Richard. >> >> Though it's still not clear what the real cause of the problem was. > Bugs from the router vs the route-server perhaps? > > I hate magic like this. Magic sucks >

June 23, 2023

Re: [External] [MICE-DISCUSS] Three BGP peers

by Tom Krenn

Not peered with Yahoo but I do see that Google peer down. Neighbor Spk AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down St/PfxRcd 206.108.255.167 0 15169 605946 572995 0 0 0 13:06:45 Active Neighbor Spk AS MsgRcvd MsgSent TblVer InQ OutQ Up/Down St/PfxRcd 2001:504:27::3b41:0:2 0 15169 598758 572903 0 0 0 13:07:55 Active Tom Krenn Network Architect Enterprise Architecture - Information Technology -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Thursday, June 22, 2023 4:42 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [External] [MICE-DISCUSS] Three BGP peers CAUTION: This email was sent from outside of Hennepin County. Unless you recognize the sender and know the content, do not click links or open attachments. Anyone else seeing both Yahoo peers and one Google peer down since early am? I didn't see any log messages about exceeding prefix counts or the like. Frank SiouxCity-Fibernet-Arista(s2)#sh ip bgp sum | ex Estab BGP summary information for VRF default Router identifier 207.32.15.21, local AS number 18883 Neighbor Status Codes: m - Under maintenance Neighbor V AS MsgRcvd MsgSent InQ OutQ Up/Down State PfxRcd PfxAcc 206.108.255.58 4 10310 2035987 4886675 0 0 12:23:38 Active 206.108.255.59 4 10310 2029469 4886360 0 0 12:23:41 Active 206.108.255.167 4 15169 2050148 4888984 0 0 12:23:40 Active SiouxCity-Fibernet-Arista(s2)#sh ipv6 bgp sum | ex Estab BGP summary information for VRF default Router identifier 207.32.15.21, local AS number 18883 Neighbor Status Codes: m - Under maintenance Neighbor V AS MsgRcvd MsgSent InQ OutQ Up/Down State PfxRcd PfxAcc 2001:504:27::2846:0:1 4 10310 2209610 1893247 0 0 12:23:40 Active 2001:504:27::2846:0:2 4 10310 2202613 1892818 0 0 12:23:47 Active 2001:504:27::3b41:0:2 4 15169 2043589 1894022 0 0 12:23:48 Active SiouxCity-Fibernet-Arista(s2)# Disclaimer: If you are not the intended recipient of this message, please immediately notify the sender of the transmission error and then promptly permanently delete this message from your computer system.

June 22, 2023

Re: Three BGP peers

by Frank Bulk

Thanks for confirming. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Andrew Hoyos Sent: Thursday, June 22, 2023 5:03 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Three BGP peers Same, suspect fiber cut or maint. Weathermap doesn’t show any traffic on those links. [cid:image001.png@01D9A52B.A1A56C50] [cid:image002.png@01D9A52B.A1A56C50] > On Jun 22, 2023, at 4:42 PM, Frank Bulk <fbulk(a)MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> wrote: > > Anyone else seeing both Yahoo peers and one Google peer down since early am? I didn't see any log messages about exceeding prefix counts or the like. > > Frank > > SiouxCity-Fibernet-Arista(s2)#sh ip bgp sum | ex Estab > BGP summary information for VRF default > Router identifier 207.32.15.21, local AS number 18883 > Neighbor Status Codes: m - Under maintenance > Neighbor V AS MsgRcvd MsgSent InQ OutQ Up/Down State PfxRcd PfxAcc > 206.108.255.58 4 10310 2035987 4886675 0 0 12:23:38 Active > 206.108.255.59 4 10310 2029469 4886360 0 0 12:23:41 Active > 206.108.255.167 4 15169 2050148 4888984 0 0 12:23:40 Active > SiouxCity-Fibernet-Arista(s2)#sh ipv6 bgp sum | ex Estab > BGP summary information for VRF default > Router identifier 207.32.15.21, local AS number 18883 > Neighbor Status Codes: m - Under maintenance > Neighbor V AS MsgRcvd MsgSent InQ OutQ Up/Down State PfxRcd PfxAcc > 2001:504:27::2846:0:1 4 10310 2209610 1893247 0 0 12:23:40 Active > 2001:504:27::2846:0:2 4 10310 2202613 1892818 0 0 12:23:47 Active > 2001:504:27::3b41:0:2 4 15169 2043589 1894022 0 0 12:23:48 Active > SiouxCity-Fibernet-Arista(s2)#

June 22, 2023

Re: Three BGP peers

by Andrew Hoyos

Same, suspect fiber cut or maint. Weathermap doesn’t show any traffic on those links. > On Jun 22, 2023, at 4:42 PM, Frank Bulk <fbulk(a)MYPREMIERONLINE.COM> wrote: > > Anyone else seeing both Yahoo peers and one Google peer down since early am? I didn't see any log messages about exceeding prefix counts or the like. > > Frank > > SiouxCity-Fibernet-Arista(s2)#sh ip bgp sum | ex Estab > BGP summary information for VRF default > Router identifier 207.32.15.21, local AS number 18883 > Neighbor Status Codes: m - Under maintenance > Neighbor V AS MsgRcvd MsgSent InQ OutQ Up/Down State PfxRcd PfxAcc > 206.108.255.58 4 10310 2035987 4886675 0 0 12:23:38 Active > 206.108.255.59 4 10310 2029469 4886360 0 0 12:23:41 Active > 206.108.255.167 4 15169 2050148 4888984 0 0 12:23:40 Active > SiouxCity-Fibernet-Arista(s2)#sh ipv6 bgp sum | ex Estab > BGP summary information for VRF default > Router identifier 207.32.15.21, local AS number 18883 > Neighbor Status Codes: m - Under maintenance > Neighbor V AS MsgRcvd MsgSent InQ OutQ Up/Down State PfxRcd PfxAcc > 2001:504:27::2846:0:1 4 10310 2209610 1893247 0 0 12:23:40 Active > 2001:504:27::2846:0:2 4 10310 2202613 1892818 0 0 12:23:47 Active > 2001:504:27::3b41:0:2 4 15169 2043589 1894022 0 0 12:23:48 Active > SiouxCity-Fibernet-Arista(s2)#

June 22, 2023