Neutral Path link issue between Belle Plaine and MICE
I woke up this morning to see emails about our BGP sessions with MICE to be down. Look at alarms and graphs I see that the link from Belle Plaine to MICE is down since about 12:39 am. According to the NeutralPath NOC (operated by WINS?), something about how a temporary fiber fix for emergency fiber work failed? I wasn't even aware of any emergency fiber work. The NOC said that a tech was dispatched and he was hoping they would be able to fix it in the next few hours. Frank
It looked like the river was quite high when I was through Belle Plaine yesterday, if that’s the location of the trouble I bet the crews are having to work around that huge mess. Sent from my iPhone On May 5, 2018, at 6:34 AM, Frank Bulk <fbulk@MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> wrote: I woke up this morning to see emails about our BGP sessions with MICE to be down. Look at alarms and graphs I see that the link from Belle Plaine to MICE is down since about 12:39 am. According to the NeutralPath NOC (operated by WINS?), something about how a temporary fiber fix for emergency fiber work failed? I wasn’t even aware of any emergency fiber work. The NOC said that a tech was dispatched and he was hoping they would be able to fix it in the next few hours. Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
Also, Neutral Path is now wholly owned by Zayo, FYI. :( -----Original Message----- From: anthonyanderberg@nu-telecom.net [anthonyanderberg@NU-TELECOM.NET] Received: Saturday, 05 May 2018, 11:42AM To: MICE-DISCUSS@LISTS.IPHOUSE.NET [MICE-DISCUSS@LISTS.IPHOUSE.NET] Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE It looked like the river was quite high when I was through Belle Plaine yesterday, if that’s the location of the trouble I bet the crews are having to work around that huge mess. Sent from my iPhone On May 5, 2018, at 6:34 AM, Frank Bulk <fbulk@MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> wrote: I woke up this morning to see emails about our BGP sessions with MICE to be down. Look at alarms and graphs I see that the link from Belle Plaine to MICE is down since about 12:39 am. According to the NeutralPath NOC (operated by WINS?), something about how a temporary fiber fix for emergency fiber work failed? I wasn’t even aware of any emergency fiber work. The NOC said that a tech was dispatched and he was hoping they would be able to fix it in the next few hours. Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
☹ indeed. I just got off the phone with them, about an hour ago they determined the fiber across the river is completely compromised and they are working to get a temporary drop across the river to restore services. James Urwiller Network Architect Stealth Broadband james.urwiller@stealthbroadband.com [image: stealth300] *From:* MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET> *On Behalf Of *Justin Krejci *Sent:* Saturday, May 5, 2018 13:01 *To:* MICE-DISCUSS@LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Also, Neutral Path is now wholly owned by Zayo, FYI. :( -----Original Message----- *From:* anthonyanderberg@nu-telecom.net [anthonyanderberg@NU-TELECOM.NET] *Received:* Saturday, 05 May 2018, 11:42AM *To:* MICE-DISCUSS@LISTS.IPHOUSE.NET [MICE-DISCUSS@LISTS.IPHOUSE.NET] *Subject:* Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE It looked like the river was quite high when I was through Belle Plaine yesterday, if that’s the location of the trouble I bet the crews are having to work around that huge mess. Sent from my iPhone On May 5, 2018, at 6:34 AM, Frank Bulk <fbulk@MYPREMIERONLINE.COM> wrote: I woke up this morning to see emails about our BGP sessions with MICE to be down. Look at alarms and graphs I see that the link from Belle Plaine to MICE is down since about 12:39 am. According to the NeutralPath NOC (operated by WINS?), something about how a temporary fiber fix for emergency fiber work failed? I wasn’t even aware of any emergency fiber work. The NOC said that a tech was dispatched and he was hoping they would be able to fix it in the next few hours. Frank ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
Last two updates from the NOC: 2:05 pm: Crews now have cable materials in-hand and should arrive at the site at approximately 3:30 pm central. It is estimated that the cable install will take at least 3.5 hours. Splicing will follow the install. Once splicing begins, an ETR might be available. 2:45 pm: Crews with the materials anticipate arriving at site in approximately 30 minutes. Is this the river crossing? https://www.google.com/maps/place/44%C2%B037'59.5%22N+93%C2%B045'56.7%22W/@44.6331841,-93.7745168,3083m/data=!3m2!1e3!4b1!4m14!1m7!3m6!1s0x87f5dfb93721879d:0x24b9fe962f7ae1fb!2sBelle+Plaine,+MN!3b1!8m2!3d44.6230409!4d-93.7684042!3m5!1s0x0:0x0!7e2!8m2!3d44.6331854!4d-93.7657624 Frank From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET> On Behalf Of James Urwiller Sent: Saturday, May 5, 2018 1:05 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE ☹ indeed. I just got off the phone with them, about an hour ago they determined the fiber across the river is completely compromised and they are working to get a temporary drop across the river to restore services. James Urwiller Network Architect Stealth Broadband james.urwiller@stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Krejci Sent: Saturday, May 5, 2018 13:01 To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Also, Neutral Path is now wholly owned by Zayo, FYI. :( -----Original Message----- From: anthonyanderberg@nu-telecom.net<mailto:anthonyanderberg@nu-telecom.net> [anthonyanderberg@NU-TELECOM.NET<mailto:anthonyanderberg@NU-TELECOM.NET>] Received: Saturday, 05 May 2018, 11:42AM To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> [MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE It looked like the river was quite high when I was through Belle Plaine yesterday, if that’s the location of the trouble I bet the crews are having to work around that huge mess. Sent from my iPhone On May 5, 2018, at 6:34 AM, Frank Bulk <fbulk@MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> wrote: I woke up this morning to see emails about our BGP sessions with MICE to be down. Look at alarms and graphs I see that the link from Belle Plaine to MICE is down since about 12:39 am. According to the NeutralPath NOC (operated by WINS?), something about how a temporary fiber fix for emergency fiber work failed? I wasn’t even aware of any emergency fiber work. The NOC said that a tech was dispatched and he was hoping they would be able to fix it in the next few hours. Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
Update received a few minutes ago: The splicing crew is now on site and are beginning to install the new cable. No ETR at this time. Frank From: Frank Bulk Sent: Saturday, May 5, 2018 2:59 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET Subject: RE: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Last two updates from the NOC: 2:05 pm: Crews now have cable materials in-hand and should arrive at the site at approximately 3:30 pm central. It is estimated that the cable install will take at least 3.5 hours. Splicing will follow the install. Once splicing begins, an ETR might be available. 2:45 pm: Crews with the materials anticipate arriving at site in approximately 30 minutes. Is this the river crossing? https://www.google.com/maps/place/44%C2%B037'59.5%22N+93%C2%B045'56.7%22W/@44.6331841,-93.7745168,3083m/data=!3m2!1e3!4b1!4m14!1m7!3m6!1s0x87f5dfb93721879d:0x24b9fe962f7ae1fb!2sBelle+Plaine,+MN!3b1!8m2!3d44.6230409!4d-93.7684042!3m5!1s0x0:0x0!7e2!8m2!3d44.6331854!4d-93.7657624 Frank From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Saturday, May 5, 2018 1:05 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE ☹ indeed. I just got off the phone with them, about an hour ago they determined the fiber across the river is completely compromised and they are working to get a temporary drop across the river to restore services. James Urwiller Network Architect Stealth Broadband james.urwiller@stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Krejci Sent: Saturday, May 5, 2018 13:01 To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Also, Neutral Path is now wholly owned by Zayo, FYI. :( -----Original Message----- From: anthonyanderberg@nu-telecom.net<mailto:anthonyanderberg@nu-telecom.net> [anthonyanderberg@NU-TELECOM.NET<mailto:anthonyanderberg@NU-TELECOM.NET>] Received: Saturday, 05 May 2018, 11:42AM To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> [MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE It looked like the river was quite high when I was through Belle Plaine yesterday, if that’s the location of the trouble I bet the crews are having to work around that huge mess. Sent from my iPhone On May 5, 2018, at 6:34 AM, Frank Bulk <fbulk@MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> wrote: I woke up this morning to see emails about our BGP sessions with MICE to be down. Look at alarms and graphs I see that the link from Belle Plaine to MICE is down since about 12:39 am. According to the NeutralPath NOC (operated by WINS?), something about how a temporary fiber fix for emergency fiber work failed? I wasn’t even aware of any emergency fiber work. The NOC said that a tech was dispatched and he was hoping they would be able to fix it in the next few hours. Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
Update received a few minutes ago: The splice crew is still in the process of installing the new cable. If everything goes according to plan, splicing will begin in about an hour. No ETR at this time, but we will continue to provide updates as they become available. Frank From: Frank Bulk Sent: Saturday, May 5, 2018 4:45 PM To: 'MICE Discuss' <MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Update received a few minutes ago: The splicing crew is now on site and are beginning to install the new cable. No ETR at this time. Frank From: Frank Bulk Sent: Saturday, May 5, 2018 2:59 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Last two updates from the NOC: 2:05 pm: Crews now have cable materials in-hand and should arrive at the site at approximately 3:30 pm central. It is estimated that the cable install will take at least 3.5 hours. Splicing will follow the install. Once splicing begins, an ETR might be available. 2:45 pm: Crews with the materials anticipate arriving at site in approximately 30 minutes. Is this the river crossing? https://www.google.com/maps/place/44%C2%B037'59.5%22N+93%C2%B045'56.7%22W/@44.6331841,-93.7745168,3083m/data=!3m2!1e3!4b1!4m14!1m7!3m6!1s0x87f5dfb93721879d:0x24b9fe962f7ae1fb!2sBelle+Plaine,+MN!3b1!8m2!3d44.6230409!4d-93.7684042!3m5!1s0x0:0x0!7e2!8m2!3d44.6331854!4d-93.7657624 Frank From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Saturday, May 5, 2018 1:05 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE ☹ indeed. I just got off the phone with them, about an hour ago they determined the fiber across the river is completely compromised and they are working to get a temporary drop across the river to restore services. James Urwiller Network Architect Stealth Broadband james.urwiller@stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Krejci Sent: Saturday, May 5, 2018 13:01 To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Also, Neutral Path is now wholly owned by Zayo, FYI. :( -----Original Message----- From: anthonyanderberg@nu-telecom.net<mailto:anthonyanderberg@nu-telecom.net> [anthonyanderberg@NU-TELECOM.NET<mailto:anthonyanderberg@NU-TELECOM.NET>] Received: Saturday, 05 May 2018, 11:42AM To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> [MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE It looked like the river was quite high when I was through Belle Plaine yesterday, if that’s the location of the trouble I bet the crews are having to work around that huge mess. Sent from my iPhone On May 5, 2018, at 6:34 AM, Frank Bulk <fbulk@MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> wrote: I woke up this morning to see emails about our BGP sessions with MICE to be down. Look at alarms and graphs I see that the link from Belle Plaine to MICE is down since about 12:39 am. According to the NeutralPath NOC (operated by WINS?), something about how a temporary fiber fix for emergency fiber work failed? I wasn’t even aware of any emergency fiber work. The NOC said that a tech was dispatched and he was hoping they would be able to fix it in the next few hours. Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
I’m seeing BGP sessions restored and routes learned! Frank From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Saturday, May 5, 2018 6:27 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Update received a few minutes ago: The splice crew is still in the process of installing the new cable. If everything goes according to plan, splicing will begin in about an hour. No ETR at this time, but we will continue to provide updates as they become available. Frank From: Frank Bulk Sent: Saturday, May 5, 2018 4:45 PM To: 'MICE Discuss' <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Update received a few minutes ago: The splicing crew is now on site and are beginning to install the new cable. No ETR at this time. Frank From: Frank Bulk Sent: Saturday, May 5, 2018 2:59 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Last two updates from the NOC: 2:05 pm: Crews now have cable materials in-hand and should arrive at the site at approximately 3:30 pm central. It is estimated that the cable install will take at least 3.5 hours. Splicing will follow the install. Once splicing begins, an ETR might be available. 2:45 pm: Crews with the materials anticipate arriving at site in approximately 30 minutes. Is this the river crossing? https://www.google.com/maps/place/44%C2%B037'59.5%22N+93%C2%B045'56.7%22W/@44.6331841,-93.7745168,3083m/data=!3m2!1e3!4b1!4m14!1m7!3m6!1s0x87f5dfb93721879d:0x24b9fe962f7ae1fb!2sBelle+Plaine,+MN!3b1!8m2!3d44.6230409!4d-93.7684042!3m5!1s0x0:0x0!7e2!8m2!3d44.6331854!4d-93.7657624 Frank From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Saturday, May 5, 2018 1:05 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE ☹ indeed. I just got off the phone with them, about an hour ago they determined the fiber across the river is completely compromised and they are working to get a temporary drop across the river to restore services. James Urwiller Network Architect Stealth Broadband james.urwiller@stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Krejci Sent: Saturday, May 5, 2018 13:01 To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Also, Neutral Path is now wholly owned by Zayo, FYI. :( -----Original Message----- From: anthonyanderberg@nu-telecom.net<mailto:anthonyanderberg@nu-telecom.net> [anthonyanderberg@NU-TELECOM.NET<mailto:anthonyanderberg@NU-TELECOM.NET>] Received: Saturday, 05 May 2018, 11:42AM To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> [MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE It looked like the river was quite high when I was through Belle Plaine yesterday, if that’s the location of the trouble I bet the crews are having to work around that huge mess. Sent from my iPhone On May 5, 2018, at 6:34 AM, Frank Bulk <fbulk@MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> wrote: I woke up this morning to see emails about our BGP sessions with MICE to be down. Look at alarms and graphs I see that the link from Belle Plaine to MICE is down since about 12:39 am. According to the NeutralPath NOC (operated by WINS?), something about how a temporary fiber fix for emergency fiber work failed? I wasn’t even aware of any emergency fiber work. The NOC said that a tech was dispatched and he was hoping they would be able to fix it in the next few hours. Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
Splicing complete and NP is hands off for now, I’m sure a permanent repair will be done at a later date. From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Saturday, May 05, 2018 5:35 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE I’m seeing BGP sessions restored and routes learned! Frank From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Saturday, May 5, 2018 6:27 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Update received a few minutes ago: The splice crew is still in the process of installing the new cable. If everything goes according to plan, splicing will begin in about an hour. No ETR at this time, but we will continue to provide updates as they become available. Frank From: Frank Bulk Sent: Saturday, May 5, 2018 4:45 PM To: 'MICE Discuss' <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Update received a few minutes ago: The splicing crew is now on site and are beginning to install the new cable. No ETR at this time. Frank From: Frank Bulk Sent: Saturday, May 5, 2018 2:59 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Last two updates from the NOC: 2:05 pm: Crews now have cable materials in-hand and should arrive at the site at approximately 3:30 pm central. It is estimated that the cable install will take at least 3.5 hours. Splicing will follow the install. Once splicing begins, an ETR might be available. 2:45 pm: Crews with the materials anticipate arriving at site in approximately 30 minutes. Is this the river crossing? https://www.google.com/maps/place/44%C2%B037'59.5%22N+93%C2%B045'56.7%22W/@44.6331841,-93.7745168,3083m/data=!3m2!1e3!4b1!4m14!1m7!3m6!1s0x87f5dfb93721879d:0x24b9fe962f7ae1fb!2sBelle+Plaine,+MN!3b1!8m2!3d44.6230409!4d-93.7684042!3m5!1s0x0:0x0!7e2!8m2!3d44.6331854!4d-93.7657624 Frank From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Saturday, May 5, 2018 1:05 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE ☹ indeed. I just got off the phone with them, about an hour ago they determined the fiber across the river is completely compromised and they are working to get a temporary drop across the river to restore services. James Urwiller Network Architect Stealth Broadband james.urwiller@stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Krejci Sent: Saturday, May 5, 2018 13:01 To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Also, Neutral Path is now wholly owned by Zayo, FYI. :( -----Original Message----- From: anthonyanderberg@nu-telecom.net<mailto:anthonyanderberg@nu-telecom.net> [anthonyanderberg@NU-TELECOM.NET<mailto:anthonyanderberg@NU-TELECOM.NET>] Received: Saturday, 05 May 2018, 11:42AM To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> [MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE It looked like the river was quite high when I was through Belle Plaine yesterday, if that’s the location of the trouble I bet the crews are having to work around that huge mess. Sent from my iPhone On May 5, 2018, at 6:34 AM, Frank Bulk <fbulk@MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> wrote: I woke up this morning to see emails about our BGP sessions with MICE to be down. Look at alarms and graphs I see that the link from Belle Plaine to MICE is down since about 12:39 am. According to the NeutralPath NOC (operated by WINS?), something about how a temporary fiber fix for emergency fiber work failed? I wasn’t even aware of any emergency fiber work. The NOC said that a tech was dispatched and he was hoping they would be able to fix it in the next few hours. Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
Fortunately, the NeutralPath NOC (operated by WINS) is still operating and not yet subsumed by Zayo. Last work from NOC: The original fiber bundle only had 10 functional fibers, so a temporary cable is being installed as of approximately 11:30 am central. After the install, splicing will occur which should then restore your service. No ETR is available yet. Frank From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET> On Behalf Of Justin Krejci Sent: Saturday, May 5, 2018 1:01 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Also, Neutral Path is now wholly owned by Zayo, FYI. :( -----Original Message----- From: anthonyanderberg@nu-telecom.net<mailto:anthonyanderberg@nu-telecom.net> [anthonyanderberg@NU-TELECOM.NET] Received: Saturday, 05 May 2018, 11:42AM To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> [MICE-DISCUSS@LISTS.IPHOUSE.NET] Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE It looked like the river was quite high when I was through Belle Plaine yesterday, if that's the location of the trouble I bet the crews are having to work around that huge mess. Sent from my iPhone On May 5, 2018, at 6:34 AM, Frank Bulk <fbulk@MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> wrote: I woke up this morning to see emails about our BGP sessions with MICE to be down. Look at alarms and graphs I see that the link from Belle Plaine to MICE is down since about 12:39 am. According to the NeutralPath NOC (operated by WINS?), something about how a temporary fiber fix for emergency fiber work failed? I wasn't even aware of any emergency fiber work. The NOC said that a tech was dispatched and he was hoping they would be able to fix it in the next few hours. Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
participants (5)
-
anthonyanderberg＠nu-telecom.net -
Frank Bulk -
James Urwiller -
Jeremy Schmeichel -
Justin Krejci