- mice-discuss - lists.micemn.net

Re: Four BGP sessions drops with Google/YouTube (AS36040) today

by Frank Bulk

I had a little bit more dialogue with GGC support over the weekend and they were able to resolve the issue Sunday evening. They saw LACP issues from their cache(s) to their 10G/100G switch, but they didn’t initially realize that it was their switch. Jeremy provided me the necessary info to point GGC support in the right direction and just after 8 pm Central they updated me that they’ve resolved the issue, though they said they do not have full root cause for it, yet. Graph looks solid for the last 3+ hours. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Saturday, November 24, 2018 9:54 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today Thanks – today’s graphs didn’t look so good today, either. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jeremy Lumby Sent: Saturday, November 24, 2018 3:19 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today Google only has a single 100G link to MICE, and it has been up for a month. They did not originally support 100G so I believe they added a switch just to convert their existing 10X10G into a single 100G This is however their equipment, and MICE has no visibility into it. Ethernet3/2/1 is up, line protocol is up (connected) Hardware is Ethernet, address is 2899.3a54.4fdc (bia 2899.3a54.4fdc) Description: 36040 - Google Ethernet MTU 9214 bytes , BW 100000000 kbit Full-duplex, 100Gb/s, auto negotiation: off, uni-link: n/a Up 31 days, 2 hours, 55 minutes, 9 seconds Loopback Mode : None 3 link status changes since last clear Last clearing of "show interface" counters never 5 minutes input rate 41.9 Gbps (42.5% with framing overhead), 3606486 packets/sec 5 minutes output rate 1.99 Gbps (2.1% with framing overhead), 957337 packets/sec 101767257001795 packets input, 147833598676116893 bytes Received 1446585 broadcasts, 7171769 multicast 0 runts, 0 giants 0 input errors, 0 CRC, 0 alignment, 0 symbol, 0 input discards 0 PAUSE input 29025844160305 packets output, 6218148508474554 bytes Sent 655350278 broadcasts, 1990085124 multicast 0 output errors, 0 collisions 0 late collision, 0 deferred, 1 output discards 0 PAUSE output From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Frank Bulk Sent: Saturday, November 24, 2018 2:43 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today GGC shared this with me: The BGP session and aggregated interfaces seems stable now, however earlier, we've seen all interfaces on the path to 206.108.255.4 flap. We'll re-check it after some time to verify that this is no longer happening. Any log entries on the IX’s switch that give a hint as to why the links are dropping? Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jeremy Lumby Sent: Friday, November 23, 2018 11:31 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today In general you can get a little better granular control of your session if you are bilaterally peered since not all IX route servers support communities, and have different security features supported/enabled. Not all implementations of communities are as detailed as you can get bilaterally. There is also one less point of failure when not using routeservers. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Darin Steffl Sent: Friday, November 23, 2018 9:59 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today Ok I know that Google is on the route servers so is there any advantage to establishing a direct peering session with them? Their peering site says the following: Although Google connects to Internet Exchange route servers where present, Google prefers to establish direct BGP sessions for traffic exchange. On Fri, Nov 23, 2018 at 8:59 PM Jeremy Lumby <jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com>> wrote: MICE only has a cache, and the other IXes have full backbone routes. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] On Behalf Of Darin Steffl Sent: Friday, November 23, 2018 8:56 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today Sorry to go off topic a little but why isn't Google advertising their main AS 15169 on MICE? Their website shows Minneapolis being one of their Edge POPs but they're using their less common AS 36040 here. Anyone know why we're not as cool as the other IX's they're on with 15169? On Fri, Nov 23, 2018 at 8:21 PM Jeremy Lumby <jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com>> wrote: I have noticed that Google has had me redirected to their cache on The Kansas City Internet Exchange most of the day. 2602:ffaa:0:7:8d5:1b2c:f084:513c => google-mci2 : superx_isp_number: 3 (2602:ffaa::/36) From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] On Behalf Of Frank Bulk Sent: Friday, November 23, 2018 8:14 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today FYI, we saw our BGP session drop with AS36040 several times today: * 12:08:46 to 12:08:51 pm * 2:01 to 2:02 pm * ~4:02 to ~4:04 pm * ~7:36 to ~7:38 pm Graphs show some serious stability issues: Error! Filename not specified. Regards, Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Darin Steffl Minnesota WiFi www.mnwifi.com<http://www.mnwifi.com/> 507-634-WiFi [http://www.snoitulosten.com/wp-content/uploads/2010/01/facebook-small.jpg]<http://www.facebook.com/minnesotawifi> Like us on Facebook<http://www.facebook.com/minnesotawifi> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Darin Steffl Minnesota WiFi www.mnwifi.com<http://www.mnwifi.com/> 507-634-WiFi [http://www.snoitulosten.com/wp-content/uploads/2010/01/facebook-small.jpg]<http://www.facebook.com/minnesotawifi> Like us on Facebook<http://www.facebook.com/minnesotawifi> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 26, 2018

Please Welcome Fibernet Communications to MICE!

by Jay Hanke

Name: Fibernet Communications ASN: 18883 Port: Zayo Remote Switch (Premier Port) IPv4: 206.108.255.133 /24 IPv6: 2001:504:27:0:0:49c3::1 /64 Peering Contact: peering(a)fibernetcommunications.net Route Server: YES BFD Support NO Welcome Aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

Nov. 25, 2018

Re: Four BGP sessions drops with Google/YouTube (AS36040) today

by Frank Bulk

Thanks – today’s graphs didn’t look so good today, either. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Saturday, November 24, 2018 3:19 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today Google only has a single 100G link to MICE, and it has been up for a month. They did not originally support 100G so I believe they added a switch just to convert their existing 10X10G into a single 100G This is however their equipment, and MICE has no visibility into it. Ethernet3/2/1 is up, line protocol is up (connected) Hardware is Ethernet, address is 2899.3a54.4fdc (bia 2899.3a54.4fdc) Description: 36040 - Google Ethernet MTU 9214 bytes , BW 100000000 kbit Full-duplex, 100Gb/s, auto negotiation: off, uni-link: n/a Up 31 days, 2 hours, 55 minutes, 9 seconds Loopback Mode : None 3 link status changes since last clear Last clearing of "show interface" counters never 5 minutes input rate 41.9 Gbps (42.5% with framing overhead), 3606486 packets/sec 5 minutes output rate 1.99 Gbps (2.1% with framing overhead), 957337 packets/sec 101767257001795 packets input, 147833598676116893 bytes Received 1446585 broadcasts, 7171769 multicast 0 runts, 0 giants 0 input errors, 0 CRC, 0 alignment, 0 symbol, 0 input discards 0 PAUSE input 29025844160305 packets output, 6218148508474554 bytes Sent 655350278 broadcasts, 1990085124 multicast 0 output errors, 0 collisions 0 late collision, 0 deferred, 1 output discards 0 PAUSE output From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Frank Bulk Sent: Saturday, November 24, 2018 2:43 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today GGC shared this with me: The BGP session and aggregated interfaces seems stable now, however earlier, we've seen all interfaces on the path to 206.108.255.4 flap. We'll re-check it after some time to verify that this is no longer happening. Any log entries on the IX’s switch that give a hint as to why the links are dropping? Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jeremy Lumby Sent: Friday, November 23, 2018 11:31 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today In general you can get a little better granular control of your session if you are bilaterally peered since not all IX route servers support communities, and have different security features supported/enabled. Not all implementations of communities are as detailed as you can get bilaterally. There is also one less point of failure when not using routeservers. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Darin Steffl Sent: Friday, November 23, 2018 9:59 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today Ok I know that Google is on the route servers so is there any advantage to establishing a direct peering session with them? Their peering site says the following: Although Google connects to Internet Exchange route servers where present, Google prefers to establish direct BGP sessions for traffic exchange. On Fri, Nov 23, 2018 at 8:59 PM Jeremy Lumby <jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com>> wrote: MICE only has a cache, and the other IXes have full backbone routes. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] On Behalf Of Darin Steffl Sent: Friday, November 23, 2018 8:56 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today Sorry to go off topic a little but why isn't Google advertising their main AS 15169 on MICE? Their website shows Minneapolis being one of their Edge POPs but they're using their less common AS 36040 here. Anyone know why we're not as cool as the other IX's they're on with 15169? On Fri, Nov 23, 2018 at 8:21 PM Jeremy Lumby <jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com>> wrote: I have noticed that Google has had me redirected to their cache on The Kansas City Internet Exchange most of the day. 2602:ffaa:0:7:8d5:1b2c:f084:513c => google-mci2 : superx_isp_number: 3 (2602:ffaa::/36) From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] On Behalf Of Frank Bulk Sent: Friday, November 23, 2018 8:14 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today FYI, we saw our BGP session drop with AS36040 several times today: * 12:08:46 to 12:08:51 pm * 2:01 to 2:02 pm * ~4:02 to ~4:04 pm * ~7:36 to ~7:38 pm Graphs show some serious stability issues: Error! Filename not specified. Regards, Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Darin Steffl Minnesota WiFi www.mnwifi.com<http://www.mnwifi.com/> 507-634-WiFi [http://www.snoitulosten.com/wp-content/uploads/2010/01/facebook-small.jpg]<http://www.facebook.com/minnesotawifi> Like us on Facebook<http://www.facebook.com/minnesotawifi> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Darin Steffl Minnesota WiFi www.mnwifi.com<http://www.mnwifi.com/> 507-634-WiFi [http://www.snoitulosten.com/wp-content/uploads/2010/01/facebook-small.jpg]<http://www.facebook.com/minnesotawifi> Like us on Facebook<http://www.facebook.com/minnesotawifi> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 25, 2018

Re: Four BGP sessions drops with Google/YouTube (AS36040) today

by Jeremy Lumby

Google only has a single 100G link to MICE, and it has been up for a month. They did not originally support 100G so I believe they added a switch just to convert their existing 10X10G into a single 100G This is however their equipment, and MICE has no visibility into it. Ethernet3/2/1 is up, line protocol is up (connected) Hardware is Ethernet, address is 2899.3a54.4fdc (bia 2899.3a54.4fdc) Description: 36040 - Google Ethernet MTU 9214 bytes , BW 100000000 kbit Full-duplex, 100Gb/s, auto negotiation: off, uni-link: n/a Up 31 days, 2 hours, 55 minutes, 9 seconds Loopback Mode : None 3 link status changes since last clear Last clearing of "show interface" counters never 5 minutes input rate 41.9 Gbps (42.5% with framing overhead), 3606486 packets/sec 5 minutes output rate 1.99 Gbps (2.1% with framing overhead), 957337 packets/sec 101767257001795 packets input, 147833598676116893 bytes Received 1446585 broadcasts, 7171769 multicast 0 runts, 0 giants 0 input errors, 0 CRC, 0 alignment, 0 symbol, 0 input discards 0 PAUSE input 29025844160305 packets output, 6218148508474554 bytes Sent 655350278 broadcasts, 1990085124 multicast 0 output errors, 0 collisions 0 late collision, 0 deferred, 1 output discards 0 PAUSE output From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Frank Bulk Sent: Saturday, November 24, 2018 2:43 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today GGC shared this with me: The BGP session and aggregated interfaces seems stable now, however earlier, we've seen all interfaces on the path to 206.108.255.4 flap. We'll re-check it after some time to verify that this is no longer happening. Any log entries on the IX’s switch that give a hint as to why the links are dropping? Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Friday, November 23, 2018 11:31 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today In general you can get a little better granular control of your session if you are bilaterally peered since not all IX route servers support communities, and have different security features supported/enabled. Not all implementations of communities are as detailed as you can get bilaterally. There is also one less point of failure when not using routeservers. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Darin Steffl Sent: Friday, November 23, 2018 9:59 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today Ok I know that Google is on the route servers so is there any advantage to establishing a direct peering session with them? Their peering site says the following: Although Google connects to Internet Exchange route servers where present, Google prefers to establish direct BGP sessions for traffic exchange. On Fri, Nov 23, 2018 at 8:59 PM Jeremy Lumby <jlumby(a)mnvoip.com> wrote: MICE only has a cache, and the other IXes have full backbone routes. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Darin Steffl Sent: Friday, November 23, 2018 8:56 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today Sorry to go off topic a little but why isn't Google advertising their main AS 15169 on MICE? Their website shows Minneapolis being one of their Edge POPs but they're using their less common AS 36040 here. Anyone know why we're not as cool as the other IX's they're on with 15169? On Fri, Nov 23, 2018 at 8:21 PM Jeremy Lumby <jlumby(a)mnvoip.com> wrote: I have noticed that Google has had me redirected to their cache on The Kansas City Internet Exchange most of the day. 2602:ffaa:0:7:8d5:1b2c:f084:513c => google-mci2 : superx_isp_number: 3 (2602:ffaa::/36) From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Frank Bulk Sent: Friday, November 23, 2018 8:14 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today FYI, we saw our BGP session drop with AS36040 several times today: 12:08:46 to 12:08:51 pm 2:01 to 2:02 pm ~4:02 to ~4:04 pm ~7:36 to ~7:38 pm Graphs show some serious stability issues: Error! Filename not specified. Regards, Frank To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Darin Steffl Minnesota WiFi www.mnwifi.com 507-634-WiFi Like us on Facebook To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Darin Steffl Minnesota WiFi www.mnwifi.com 507-634-WiFi Like us on Facebook To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 24, 2018

Re: Four BGP sessions drops with Google/YouTube (AS36040) today

by Frank Bulk

GGC shared this with me: The BGP session and aggregated interfaces seems stable now, however earlier, we've seen all interfaces on the path to 206.108.255.4 flap. We'll re-check it after some time to verify that this is no longer happening. Any log entries on the IX’s switch that give a hint as to why the links are dropping? Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Friday, November 23, 2018 11:31 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today In general you can get a little better granular control of your session if you are bilaterally peered since not all IX route servers support communities, and have different security features supported/enabled. Not all implementations of communities are as detailed as you can get bilaterally. There is also one less point of failure when not using routeservers. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Darin Steffl Sent: Friday, November 23, 2018 9:59 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today Ok I know that Google is on the route servers so is there any advantage to establishing a direct peering session with them? Their peering site says the following: Although Google connects to Internet Exchange route servers where present, Google prefers to establish direct BGP sessions for traffic exchange. On Fri, Nov 23, 2018 at 8:59 PM Jeremy Lumby <jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com>> wrote: MICE only has a cache, and the other IXes have full backbone routes. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] On Behalf Of Darin Steffl Sent: Friday, November 23, 2018 8:56 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today Sorry to go off topic a little but why isn't Google advertising their main AS 15169 on MICE? Their website shows Minneapolis being one of their Edge POPs but they're using their less common AS 36040 here. Anyone know why we're not as cool as the other IX's they're on with 15169? On Fri, Nov 23, 2018 at 8:21 PM Jeremy Lumby <jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com>> wrote: I have noticed that Google has had me redirected to their cache on The Kansas City Internet Exchange most of the day. 2602:ffaa:0:7:8d5:1b2c:f084:513c => google-mci2 : superx_isp_number: 3 (2602:ffaa::/36) From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] On Behalf Of Frank Bulk Sent: Friday, November 23, 2018 8:14 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today FYI, we saw our BGP session drop with AS36040 several times today: * 12:08:46 to 12:08:51 pm * 2:01 to 2:02 pm * ~4:02 to ~4:04 pm * ~7:36 to ~7:38 pm Graphs show some serious stability issues: Error! Filename not specified. Regards, Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Darin Steffl Minnesota WiFi www.mnwifi.com<http://www.mnwifi.com/> 507-634-WiFi [http://www.snoitulosten.com/wp-content/uploads/2010/01/facebook-small.jpg]<http://www.facebook.com/minnesotawifi> Like us on Facebook<http://www.facebook.com/minnesotawifi> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Darin Steffl Minnesota WiFi www.mnwifi.com<http://www.mnwifi.com/> 507-634-WiFi [http://www.snoitulosten.com/wp-content/uploads/2010/01/facebook-small.jpg]<http://www.facebook.com/minnesotawifi> Like us on Facebook<http://www.facebook.com/minnesotawifi> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 24, 2018

Re: Four BGP sessions drops with Google/YouTube (AS36040) today

by Jeremy Lumby

In general you can get a little better granular control of your session if you are bilaterally peered since not all IX route servers support communities, and have different security features supported/enabled. Not all implementations of communities are as detailed as you can get bilaterally. There is also one less point of failure when not using routeservers. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Darin Steffl Sent: Friday, November 23, 2018 9:59 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today Ok I know that Google is on the route servers so is there any advantage to establishing a direct peering session with them? Their peering site says the following: Although Google connects to Internet Exchange route servers where present, Google prefers to establish direct BGP sessions for traffic exchange. On Fri, Nov 23, 2018 at 8:59 PM Jeremy Lumby <jlumby(a)mnvoip.com> wrote: MICE only has a cache, and the other IXes have full backbone routes. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Darin Steffl Sent: Friday, November 23, 2018 8:56 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today Sorry to go off topic a little but why isn't Google advertising their main AS 15169 on MICE? Their website shows Minneapolis being one of their Edge POPs but they're using their less common AS 36040 here. Anyone know why we're not as cool as the other IX's they're on with 15169? On Fri, Nov 23, 2018 at 8:21 PM Jeremy Lumby <jlumby(a)mnvoip.com> wrote: I have noticed that Google has had me redirected to their cache on The Kansas City Internet Exchange most of the day. 2602:ffaa:0:7:8d5:1b2c:f084:513c => google-mci2 : superx_isp_number: 3 (2602:ffaa::/36) From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Frank Bulk Sent: Friday, November 23, 2018 8:14 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today FYI, we saw our BGP session drop with AS36040 several times today: 12:08:46 to 12:08:51 pm 2:01 to 2:02 pm ~4:02 to ~4:04 pm ~7:36 to ~7:38 pm Graphs show some serious stability issues: Error! Filename not specified. Regards, Frank To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Darin Steffl Minnesota WiFi www.mnwifi.com 507-634-WiFi Like us on Facebook To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Darin Steffl Minnesota WiFi www.mnwifi.com 507-634-WiFi Like us on Facebook To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 24, 2018

Re: Four BGP sessions drops with Google/YouTube (AS36040) today

by Darin Steffl

Ok I know that Google is on the route servers so is there any advantage to establishing a direct peering session with them? Their peering site says the following: Although Google connects to Internet Exchange route servers where present, Google prefers to establish direct BGP sessions for traffic exchange. On Fri, Nov 23, 2018 at 8:59 PM Jeremy Lumby <jlumby(a)mnvoip.com> wrote: > MICE only has a cache, and the other IXes have full backbone routes. > > > > *From:* MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] *On Behalf > Of *Darin Steffl > *Sent:* Friday, November 23, 2018 8:56 PM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube > (AS36040) today > > > > Sorry to go off topic a little but why isn't Google advertising their main > AS 15169 on MICE? Their website shows Minneapolis being one of their Edge > POPs but they're using their less common AS 36040 here. > > > > Anyone know why we're not as cool as the other IX's they're on with 15169? > > > > On Fri, Nov 23, 2018 at 8:21 PM Jeremy Lumby <jlumby(a)mnvoip.com> wrote: > > I have noticed that Google has had me redirected to their cache on The > Kansas City Internet Exchange most of the day. > > 2602:ffaa:0:7:8d5:1b2c:f084:513c => google-mci2 : superx_isp_number: 3 > (2602:ffaa::/36) > > > > > > > > *From:* MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] *On Behalf > Of *Frank Bulk > *Sent:* Friday, November 23, 2018 8:14 PM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube > (AS36040) today > > > > FYI, we saw our BGP session drop with AS36040 several times today: > > - 12:08:46 to 12:08:51 pm > - 2:01 to 2:02 pm > - ~4:02 to ~4:04 pm > - ~7:36 to ~7:38 pm > > > > Graphs show some serious stability issues: > > > > > > Regards, > > > > Frank > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > > > -- > > Darin Steffl > > Minnesota WiFi > > www.mnwifi.com > > 507-634-WiFi > > <http://www.facebook.com/minnesotawifi> Like us on Facebook > <http://www.facebook.com/minnesotawifi> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > -- Darin Steffl Minnesota WiFi www.mnwifi.com 507-634-WiFi <http://www.facebook.com/minnesotawifi> Like us on Facebook <http://www.facebook.com/minnesotawifi>

Nov. 24, 2018

Re: Four BGP sessions drops with Google/YouTube (AS36040) today

by Jeremy Lumby

MICE only has a cache, and the other IXes have full backbone routes. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Darin Steffl Sent: Friday, November 23, 2018 8:56 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today Sorry to go off topic a little but why isn't Google advertising their main AS 15169 on MICE? Their website shows Minneapolis being one of their Edge POPs but they're using their less common AS 36040 here. Anyone know why we're not as cool as the other IX's they're on with 15169? On Fri, Nov 23, 2018 at 8:21 PM Jeremy Lumby <jlumby(a)mnvoip.com> wrote: I have noticed that Google has had me redirected to their cache on The Kansas City Internet Exchange most of the day. 2602:ffaa:0:7:8d5:1b2c:f084:513c => google-mci2 : superx_isp_number: 3 (2602:ffaa::/36) From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Frank Bulk Sent: Friday, November 23, 2018 8:14 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today FYI, we saw our BGP session drop with AS36040 several times today: 12:08:46 to 12:08:51 pm 2:01 to 2:02 pm ~4:02 to ~4:04 pm ~7:36 to ~7:38 pm Graphs show some serious stability issues: Regards, Frank To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Darin Steffl Minnesota WiFi www.mnwifi.com 507-634-WiFi Like us on Facebook To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 24, 2018

Re: Four BGP sessions drops with Google/YouTube (AS36040) today

by Darin Steffl

Sorry to go off topic a little but why isn't Google advertising their main AS 15169 on MICE? Their website shows Minneapolis being one of their Edge POPs but they're using their less common AS 36040 here. Anyone know why we're not as cool as the other IX's they're on with 15169? On Fri, Nov 23, 2018 at 8:21 PM Jeremy Lumby <jlumby(a)mnvoip.com> wrote: > I have noticed that Google has had me redirected to their cache on The > Kansas City Internet Exchange most of the day. > > 2602:ffaa:0:7:8d5:1b2c:f084:513c => google-mci2 : superx_isp_number: 3 > (2602:ffaa::/36) > > > > > > > > *From:* MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] *On Behalf > Of *Frank Bulk > *Sent:* Friday, November 23, 2018 8:14 PM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube > (AS36040) today > > > > FYI, we saw our BGP session drop with AS36040 several times today: > > - 12:08:46 to 12:08:51 pm > - 2:01 to 2:02 pm > - ~4:02 to ~4:04 pm > - ~7:36 to ~7:38 pm > > > > Graphs show some serious stability issues: > > > > > > Regards, > > > > Frank > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > -- Darin Steffl Minnesota WiFi www.mnwifi.com 507-634-WiFi <http://www.facebook.com/minnesotawifi> Like us on Facebook <http://www.facebook.com/minnesotawifi>

Nov. 24, 2018

Re: Four BGP sessions drops with Google/YouTube (AS36040) today

by Jeremy Lumby

I have noticed that Google has had me redirected to their cache on The Kansas City Internet Exchange most of the day. 2602:ffaa:0:7:8d5:1b2c:f084:513c => google-mci2 : superx_isp_number: 3 (2602:ffaa::/36) From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Frank Bulk Sent: Friday, November 23, 2018 8:14 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Four BGP sessions drops with Google/YouTube (AS36040) today FYI, we saw our BGP session drop with AS36040 several times today: 12:08:46 to 12:08:51 pm 2:01 to 2:02 pm ~4:02 to ~4:04 pm ~7:36 to ~7:38 pm Graphs show some serious stability issues: Regards, Frank To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 24, 2018

Four BGP sessions drops with Google/YouTube (AS36040) today

by Frank Bulk

FYI, we saw our BGP session drop with AS36040 several times today: * 12:08:46 to 12:08:51 pm * 2:01 to 2:02 pm * ~4:02 to ~4:04 pm * ~7:36 to ~7:38 pm Graphs show some serious stability issues: [cid:image001.png@01D48368.C4C26A60] Regards, Frank

Nov. 24, 2018

Re: Please Welcome Facebook to MICE!

by Jeremy Lumby

The ports are programmed, and ready on the main switch. The first LAG is port-channel 24, and the second is port-channel 25 -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Jay Hanke Sent: Tuesday, November 13, 2018 7:55 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Please Welcome Facebook to MICE! Name: Facebook ASN: 32934 Ports: 2x2x10G First LAG: Ethernet4/27 Ethernet4/28 Second LAG: Ethernet5/27 Ethernet5/28 IPv4: 206.108.255.116/24 206.108.255.117/24 IPv6: 2001:504:27:0:0:80a6::1/64 2001:504:27:0:0:80a6::2/64 Peering contact: peering(a)fb.com Route Server: NO BFD Support: NO Note: These port assignments contain ports that were previously in use. Welcome aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

Nov. 14, 2018

MICE Congestion

by Jay Hanke

We are seeing very heavy traffic on several ports tonight: Amazon TDS Jaguar WIN -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

Nov. 14, 2018

Please Welcome Facebook to MICE!

by Jay Hanke

Name: Facebook ASN: 32934 Ports: 2x2x10G First LAG: Ethernet4/27 Ethernet4/28 Second LAG: Ethernet5/27 Ethernet5/28 IPv4: 206.108.255.116/24 206.108.255.117/24 IPv6: 2001:504:27:0:0:80a6::1/64 2001:504:27:0:0:80a6::2/64 Peering contact: peering(a)fb.com Route Server: NO BFD Support: NO Note: These port assignments contain ports that were previously in use. Welcome aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

Nov. 14, 2018

Arvig 100G upgrade

by Jay Hanke

Arvig is upgrading their MICE connection to 100G. The new port is Ethernet 3/8/1 on the main switch. Arvig will be turning down their existing connections to ports Ethernet 4/7 and Ethernet 5/9 as part of the migration. All IP Addressing information will remain the same. Thanks! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

Nov. 13, 2018

Re: Please welcome Ostra LLC to MICE!

by Richard Laager

On 11/1/18 8:45 AM, Jay Hanke wrote: > Name: Ostra LLC ... > BFD: NO > Route Server: NO FYI: Ostra said they will be using the route servers and supporting BFD. Doug has configured the route servers and I have updated the website. -- Richard

Nov. 2, 2018

Re: Please welcome Ostra LLC to MICE!

by Jeremy Lumby

They will be port E 9 connecting at 10G From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Jay Hanke Sent: Thursday, November 01, 2018 8:46 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Please welcome Ostra LLC to MICE! Name: Ostra LLC Port: MN VoIP Remote ASN: 26446 IPv4: 206.108.255.98/24 IPv6: 2001:504:27:0:0:674e::1/64 Peering Contact: patrick(a)ostrainc.net BFD: NO Route Server: NO Whois: https://bgp.he.net/AS26446#_whois Please join the MICE mailing lists for technical and governance information at http://micemn.net/contact.html. Welcome Aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 1, 2018

Please welcome Ostra LLC to MICE!

by Jay Hanke

Name: Ostra LLC Port: MN VoIP Remote ASN: 26446 IPv4: 206.108.255.98/24 IPv6: 2001:504:27:0:0:674e::1/64 Peering Contact: patrick(a)ostrainc.net BFD: NO Route Server: NO Whois: https://bgp.he.net/AS26446#_whois Please join the MICE mailing lists for technical and governance information at http://micemn.net/contact.html. Welcome Aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

Nov. 1, 2018

Re: MICE peering down for us since ~10:29 am

by Frank Bulk

Back up again around 9:04 pm Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Friday, October 26, 2018 7:15 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am It was up for a bit, and then down again. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Krejci Sent: Friday, October 26, 2018 1:35 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am My most recent update from Zayo The latest update is as follows: Crews are on site at the damage location. The damage appears to be caused by a large 20 foot mower. Crews are working on pulling slack at this point. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of Jeremy Schmeichel <Jeremy.Schmeichel(a)VASTBROADBAND.COM<mailto:Jeremy.Schmeichel@VASTBROADBAND.COM>> Sent: Friday, October 26, 2018 12:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am We also lost our 10G links between Belle Plaine and 511, confirmed Zayo issue. Waiting on ETTR. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Tim Smith Sent: Friday, October 26, 2018 10:18 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I know that my 10G interface that went to Neutralpath that connects to MICE is up, but my bgp peer is down. However the 10G wave I have from belle plains directly to Cologix is down hard. Thanks Tim Smith | Network Architect 3900 NW 12th St ∙ Suite 100 ∙ Lincoln, NE 68521 402.817.0418 Office ∙ 402.540-9107 Mobile tim.smith(a)NebraskaLink.com<mailto:tim.smith@NebraskaLink.com> [cid:image001.jpg@01D20ABE.D77070A0] [MEF-CECP - Small] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Friday, October 26, 2018 11:13 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I don't see a "link down" on our L2, but graph of Belle Plaine shows no traffic moving. Anyone have visibility to where it's down? Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2018

Re: MICE peering down for us since ~10:29 am

by Frank Bulk

It was up for a bit, and then down again. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Justin Krejci Sent: Friday, October 26, 2018 1:35 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am My most recent update from Zayo The latest update is as follows: Crews are on site at the damage location. The damage appears to be caused by a large 20 foot mower. Crews are working on pulling slack at this point. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of Jeremy Schmeichel <Jeremy.Schmeichel(a)VASTBROADBAND.COM<mailto:Jeremy.Schmeichel@VASTBROADBAND.COM>> Sent: Friday, October 26, 2018 12:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am We also lost our 10G links between Belle Plaine and 511, confirmed Zayo issue. Waiting on ETTR. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Tim Smith Sent: Friday, October 26, 2018 10:18 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I know that my 10G interface that went to Neutralpath that connects to MICE is up, but my bgp peer is down. However the 10G wave I have from belle plains directly to Cologix is down hard. Thanks Tim Smith | Network Architect 3900 NW 12th St ∙ Suite 100 ∙ Lincoln, NE 68521 402.817.0418 Office ∙ 402.540-9107 Mobile tim.smith(a)NebraskaLink.com<mailto:tim.smith@NebraskaLink.com> [cid:image001.jpg@01D20ABE.D77070A0] [MEF-CECP - Small] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Friday, October 26, 2018 11:13 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I don’t see a “link down” on our L2, but graph of Belle Plaine shows no traffic moving. Anyone have visibility to where it’s down? Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2018

Re: MICE peering down for us since ~10:29 am

by Frank Bulk

Aerial fiber? Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Justin Krejci Sent: Friday, October 26, 2018 1:35 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am My most recent update from Zayo The latest update is as follows: Crews are on site at the damage location. The damage appears to be caused by a large 20 foot mower. Crews are working on pulling slack at this point. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of Jeremy Schmeichel <Jeremy.Schmeichel(a)VASTBROADBAND.COM<mailto:Jeremy.Schmeichel@VASTBROADBAND.COM>> Sent: Friday, October 26, 2018 12:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am We also lost our 10G links between Belle Plaine and 511, confirmed Zayo issue. Waiting on ETTR. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Tim Smith Sent: Friday, October 26, 2018 10:18 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I know that my 10G interface that went to Neutralpath that connects to MICE is up, but my bgp peer is down. However the 10G wave I have from belle plains directly to Cologix is down hard. Thanks Tim Smith | Network Architect 3900 NW 12th St ∙ Suite 100 ∙ Lincoln, NE 68521 402.817.0418 Office ∙ 402.540-9107 Mobile tim.smith(a)NebraskaLink.com<mailto:tim.smith@NebraskaLink.com> [cid:image001.jpg@01D20ABE.D77070A0] [MEF-CECP - Small] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Friday, October 26, 2018 11:13 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I don’t see a “link down” on our L2, but graph of Belle Plaine shows no traffic moving. Anyone have visibility to where it’s down? Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 26, 2018

Re: MICE peering down for us since ~10:29 am

by Justin Krejci

My most recent update from Zayo The latest update is as follows: Crews are on site at the damage location. The damage appears to be caused by a large 20 foot mower. Crews are working on pulling slack at this point. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Jeremy Schmeichel <Jeremy.Schmeichel(a)VASTBROADBAND.COM> Sent: Friday, October 26, 2018 12:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am We also lost our 10G links between Belle Plaine and 511, confirmed Zayo issue. Waiting on ETTR. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Tim Smith Sent: Friday, October 26, 2018 10:18 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I know that my 10G interface that went to Neutralpath that connects to MICE is up, but my bgp peer is down. However the 10G wave I have from belle plains directly to Cologix is down hard. Thanks Tim Smith | Network Architect 3900 NW 12th St ? Suite 100 ? Lincoln, NE 68521 402.817.0418 Office ? 402.540-9107 Mobile tim.smith(a)NebraskaLink.com<mailto:tim.smith@NebraskaLink.com> [cid:image001.jpg@01D20ABE.D77070A0] [MEF-CECP - Small] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Friday, October 26, 2018 11:13 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I don't see a "link down" on our L2, but graph of Belle Plaine shows no traffic moving. Anyone have visibility to where it's down? Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 26, 2018

Re: MICE peering down for us since ~10:29 am

by Jeremy Schmeichel

We also lost our 10G links between Belle Plaine and 511, confirmed Zayo issue. Waiting on ETTR. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Tim Smith Sent: Friday, October 26, 2018 10:18 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I know that my 10G interface that went to Neutralpath that connects to MICE is up, but my bgp peer is down. However the 10G wave I have from belle plains directly to Cologix is down hard. Thanks Tim Smith | Network Architect 3900 NW 12th St ∙ Suite 100 ∙ Lincoln, NE 68521 402.817.0418 Office ∙ 402.540-9107 Mobile tim.smith(a)NebraskaLink.com<mailto:tim.smith@NebraskaLink.com> [cid:image001.jpg@01D20ABE.D77070A0] [MEF-CECP - Small] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Friday, October 26, 2018 11:13 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I don’t see a “link down” on our L2, but graph of Belle Plaine shows no traffic moving. Anyone have visibility to where it’s down? Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 26, 2018

Re: MICE peering down for us since ~10:29 am

by Tim Smith

I know that my 10G interface that went to Neutralpath that connects to MICE is up, but my bgp peer is down. However the 10G wave I have from belle plains directly to Cologix is down hard. Thanks Tim Smith | Network Architect 3900 NW 12th St ∙ Suite 100 ∙ Lincoln, NE 68521 402.817.0418 Office ∙ 402.540-9107 Mobile tim.smith(a)NebraskaLink.com<mailto:tim.smith@NebraskaLink.com> [cid:image001.jpg@01D20ABE.D77070A0] [MEF-CECP - Small] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Friday, October 26, 2018 11:13 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I don’t see a “link down” on our L2, but graph of Belle Plaine shows no traffic moving. Anyone have visibility to where it’s down? Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 26, 2018

Re: MICE peering down for us since ~10:29 am

by Justin Krejci

Yes, Zayo definitely has an outage between Minneapolis and Belle Plaine, MN. We have multiple circuits that are hard down (no light). ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Frank Bulk <fbulk(a)MYPREMIERONLINE.COM> Sent: Friday, October 26, 2018 11:13 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I don't see a "link down" on our L2, but graph of Belle Plaine shows no traffic moving. Anyone have visibility to where it's down? Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 26, 2018