October 2018 - mice-discuss - lists.micemn.net

Re: MICE peering down for us since ~10:29 am

by Frank Bulk

Back up again around 9:04 pm Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Friday, October 26, 2018 7:15 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am It was up for a bit, and then down again. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Krejci Sent: Friday, October 26, 2018 1:35 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am My most recent update from Zayo The latest update is as follows: Crews are on site at the damage location. The damage appears to be caused by a large 20 foot mower. Crews are working on pulling slack at this point. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of Jeremy Schmeichel <Jeremy.Schmeichel(a)VASTBROADBAND.COM<mailto:Jeremy.Schmeichel@VASTBROADBAND.COM>> Sent: Friday, October 26, 2018 12:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am We also lost our 10G links between Belle Plaine and 511, confirmed Zayo issue. Waiting on ETTR. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Tim Smith Sent: Friday, October 26, 2018 10:18 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I know that my 10G interface that went to Neutralpath that connects to MICE is up, but my bgp peer is down. However the 10G wave I have from belle plains directly to Cologix is down hard. Thanks Tim Smith | Network Architect 3900 NW 12th St ∙ Suite 100 ∙ Lincoln, NE 68521 402.817.0418 Office ∙ 402.540-9107 Mobile tim.smith(a)NebraskaLink.com<mailto:tim.smith@NebraskaLink.com> [cid:image001.jpg@01D20ABE.D77070A0] [MEF-CECP - Small] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Friday, October 26, 2018 11:13 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I don't see a "link down" on our L2, but graph of Belle Plaine shows no traffic moving. Anyone have visibility to where it's down? Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2018

Re: MICE peering down for us since ~10:29 am

by Frank Bulk

It was up for a bit, and then down again. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Justin Krejci Sent: Friday, October 26, 2018 1:35 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am My most recent update from Zayo The latest update is as follows: Crews are on site at the damage location. The damage appears to be caused by a large 20 foot mower. Crews are working on pulling slack at this point. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of Jeremy Schmeichel <Jeremy.Schmeichel(a)VASTBROADBAND.COM<mailto:Jeremy.Schmeichel@VASTBROADBAND.COM>> Sent: Friday, October 26, 2018 12:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am We also lost our 10G links between Belle Plaine and 511, confirmed Zayo issue. Waiting on ETTR. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Tim Smith Sent: Friday, October 26, 2018 10:18 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I know that my 10G interface that went to Neutralpath that connects to MICE is up, but my bgp peer is down. However the 10G wave I have from belle plains directly to Cologix is down hard. Thanks Tim Smith | Network Architect 3900 NW 12th St ∙ Suite 100 ∙ Lincoln, NE 68521 402.817.0418 Office ∙ 402.540-9107 Mobile tim.smith(a)NebraskaLink.com<mailto:tim.smith@NebraskaLink.com> [cid:image001.jpg@01D20ABE.D77070A0] [MEF-CECP - Small] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Friday, October 26, 2018 11:13 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I don’t see a “link down” on our L2, but graph of Belle Plaine shows no traffic moving. Anyone have visibility to where it’s down? Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2018

Re: MICE peering down for us since ~10:29 am

by Frank Bulk

Aerial fiber? Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Justin Krejci Sent: Friday, October 26, 2018 1:35 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am My most recent update from Zayo The latest update is as follows: Crews are on site at the damage location. The damage appears to be caused by a large 20 foot mower. Crews are working on pulling slack at this point. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of Jeremy Schmeichel <Jeremy.Schmeichel(a)VASTBROADBAND.COM<mailto:Jeremy.Schmeichel@VASTBROADBAND.COM>> Sent: Friday, October 26, 2018 12:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am We also lost our 10G links between Belle Plaine and 511, confirmed Zayo issue. Waiting on ETTR. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Tim Smith Sent: Friday, October 26, 2018 10:18 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I know that my 10G interface that went to Neutralpath that connects to MICE is up, but my bgp peer is down. However the 10G wave I have from belle plains directly to Cologix is down hard. Thanks Tim Smith | Network Architect 3900 NW 12th St ∙ Suite 100 ∙ Lincoln, NE 68521 402.817.0418 Office ∙ 402.540-9107 Mobile tim.smith(a)NebraskaLink.com<mailto:tim.smith@NebraskaLink.com> [cid:image001.jpg@01D20ABE.D77070A0] [MEF-CECP - Small] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Friday, October 26, 2018 11:13 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I don’t see a “link down” on our L2, but graph of Belle Plaine shows no traffic moving. Anyone have visibility to where it’s down? Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 26, 2018

Re: MICE peering down for us since ~10:29 am

by Justin Krejci

My most recent update from Zayo The latest update is as follows: Crews are on site at the damage location. The damage appears to be caused by a large 20 foot mower. Crews are working on pulling slack at this point. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Jeremy Schmeichel <Jeremy.Schmeichel(a)VASTBROADBAND.COM> Sent: Friday, October 26, 2018 12:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am We also lost our 10G links between Belle Plaine and 511, confirmed Zayo issue. Waiting on ETTR. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Tim Smith Sent: Friday, October 26, 2018 10:18 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I know that my 10G interface that went to Neutralpath that connects to MICE is up, but my bgp peer is down. However the 10G wave I have from belle plains directly to Cologix is down hard. Thanks Tim Smith | Network Architect 3900 NW 12th St ? Suite 100 ? Lincoln, NE 68521 402.817.0418 Office ? 402.540-9107 Mobile tim.smith(a)NebraskaLink.com<mailto:tim.smith@NebraskaLink.com> [cid:image001.jpg@01D20ABE.D77070A0] [MEF-CECP - Small] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Friday, October 26, 2018 11:13 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I don't see a "link down" on our L2, but graph of Belle Plaine shows no traffic moving. Anyone have visibility to where it's down? Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 26, 2018

Re: MICE peering down for us since ~10:29 am

by Jeremy Schmeichel

We also lost our 10G links between Belle Plaine and 511, confirmed Zayo issue. Waiting on ETTR. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Tim Smith Sent: Friday, October 26, 2018 10:18 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I know that my 10G interface that went to Neutralpath that connects to MICE is up, but my bgp peer is down. However the 10G wave I have from belle plains directly to Cologix is down hard. Thanks Tim Smith | Network Architect 3900 NW 12th St ∙ Suite 100 ∙ Lincoln, NE 68521 402.817.0418 Office ∙ 402.540-9107 Mobile tim.smith(a)NebraskaLink.com<mailto:tim.smith@NebraskaLink.com> [cid:image001.jpg@01D20ABE.D77070A0] [MEF-CECP - Small] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Friday, October 26, 2018 11:13 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I don’t see a “link down” on our L2, but graph of Belle Plaine shows no traffic moving. Anyone have visibility to where it’s down? Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 26, 2018

Re: MICE peering down for us since ~10:29 am

by Tim Smith

I know that my 10G interface that went to Neutralpath that connects to MICE is up, but my bgp peer is down. However the 10G wave I have from belle plains directly to Cologix is down hard. Thanks Tim Smith | Network Architect 3900 NW 12th St ∙ Suite 100 ∙ Lincoln, NE 68521 402.817.0418 Office ∙ 402.540-9107 Mobile tim.smith(a)NebraskaLink.com<mailto:tim.smith@NebraskaLink.com> [cid:image001.jpg@01D20ABE.D77070A0] [MEF-CECP - Small] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Friday, October 26, 2018 11:13 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I don’t see a “link down” on our L2, but graph of Belle Plaine shows no traffic moving. Anyone have visibility to where it’s down? Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 26, 2018

Re: MICE peering down for us since ~10:29 am

by Justin Krejci

Yes, Zayo definitely has an outage between Minneapolis and Belle Plaine, MN. We have multiple circuits that are hard down (no light). ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Frank Bulk <fbulk(a)MYPREMIERONLINE.COM> Sent: Friday, October 26, 2018 11:13 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] MICE peering down for us since ~10:29 am I don't see a "link down" on our L2, but graph of Belle Plaine shows no traffic moving. Anyone have visibility to where it's down? Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 26, 2018

MICE peering down for us since ~10:29 am

by Frank Bulk

I don't see a "link down" on our L2, but graph of Belle Plaine shows no traffic moving. Anyone have visibility to where it's down? Frank

Oct. 26, 2018

Re: Random Outages

by Jeremy Lumby

I believe Zayo has a fiber issue between 511 and Belle Plaine. It has taken out the Zayo MICE extension switch in Belle Plaine, and my VPLS service to Belle Plaine took a blip, and then came back with 32ms of latency (normal is 1ms) telling me that it is taking the longer path around the MPLS network. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington, MN 55425 Main: 612-355-7740 x211 Direct: 612-392-6814 EFax: 952-873-7425 jlumby(a)mnvoip.com From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Jay Hanke Sent: Friday, October 26, 2018 11:08 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Random Outages Did something get cut somewhere? I'm seeing multiple services from multiple carriers dropping out south of Minneapolis about 15 minutes ago. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 26, 2018

Re: Random Outages

by Tim Smith

I lost connectivity from Belle Plains to Cologix a while ago. Tim Smith | Network Architect 3900 NW 12th St ∙ Suite 100 ∙ Lincoln, NE 68521 402.817.0418 Office ∙ 402.540-9107 Mobile tim.smith(a)NebraskaLink.com<mailto:tim.smith@NebraskaLink.com> [cid:image001.jpg@01D20ABE.D77070A0] [MEF-CECP - Small] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jay Hanke Sent: Friday, October 26, 2018 11:08 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Random Outages Did something get cut somewhere? I'm seeing multiple services from multiple carriers dropping out south of Minneapolis about 15 minutes ago. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io<mailto:jayhanke@southfront.io> Phone 612-204-0000 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 26, 2018