- mice-discuss - lists.micemn.net

Re: lost MICE

by David Farmer

A bit of trivia, the fiber cut is right near the highest point in Iowa, Hawkeye Point, just east of the intersection of 130th St and Hy60. It's all downhill from there. :) https://en.wikipedia.org/wiki/Hawkeye_Point On Tue, Jun 11, 2019 at 1:40 PM Frank Bulk <fbulk(a)mypremieronline.com> wrote: > And RFO: > > Reason for Outage Summary: A fiber cut was reported in Sibley IA. Zayo > crews were dispatched out to > > 130th and 140th along highway 60 and repaired the damaged fiber which was > caused by a Drain tile contractor trenched through the cable. All > > Repairs were completed at 1:00 PM CDT. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> * On Behalf Of *Frank > Bulk > *Sent:* Tuesday, June 11, 2019 11:38 AM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > 11:30 am: OSP reported that splicing is complete. Please verify that your > Services have restored. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Tuesday, June 11, 2019 10:44 AM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > 10:33 am: OSP has reported that splicing on the north case is complete. > Splicers working on South case. You should start to see service restore as > splicing continues. A rough ETR is 1 hour. More updates to follow. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Tuesday, June 11, 2019 10:05 AM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > My own link alarm cleared at 9:52 am, so just a hair under 26.5 hours. > > > > From what I heard from our field staff, the issue wasn’t that bad – > looking through the update, it just took Zayo’s staff and/or contractors a > long time to get on site and perform the work. It seems like they had just > one fiber splicing crew, so they didn’t prep and splice on both sides at > the same time. We’ve had similar cuts many times before and we would likely > have this resolved in 6 to 8 hours. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *James > Urwiller > *Sent:* Tuesday, June 11, 2019 9:43 AM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > I would like to Thank Frank for reporting all this info. He is keeping up > with the Zayo ticket responses very well! > > You mentioned this was cut near your area.. was it really that bad to > warrant 24+ hrs? seems like they are pretty slow with these repairs? > > > > James Urwiller > > Network Architect > > Stealth Broadband > > james.urwiller(a)stealthbroadband.com > > [image: stealth300] > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Tuesday, June 11, 2019 07:58 > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > 11:04 pm: Excavation is currently underway at this time. Techs are > trenching out the 200 feet of cable required to make repairs. > > 12:58 am: Underground crews have completed the trench on one side of the > break. OSP splicers have the cable exposed on that side and are prepping > the old cable and the new for repairs. The Underground crew is working to > excavate on the opposite end at this time. No ETTR at this time. > > 2:22 am: OSP crews are still continuing to work at this time. Excavation > crews are continuing to work to expose the remaining fiber to prep for > splicing. No ETTR at this time. > > 3:20 am: At this time the underground crew has completed excavation and > the cable is fully exposed for repairs. Prep work is still ongoing on both > sides. Splicers expect to be splicing on one end of the cable in about 1 > hour. The other side will be spliced once prep work is complete. No ETR at > this time. > > 5:04 am: OSP splicers are continuing the splice at this time. Techs are > prioritizing the active fibers to speed up restoration. No ETTR at this > time. > > 5:57 am: OSP splicers are continue to finish up the splicing on the North > side of the cut. Once complete crews will move to the South side to > complete prep work and begin splicing. We have a tentative ETTR of 10 CST > today. > > 7:07 am: OSP splicers onsite advised they have been a bit delayed on the > splicing at the North side of the cut. Splicers are nearly complete on the > North side, and will be moving to the South to complete prep work and > repairs. Crews have revised the tentative ETTR for 12 CST. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Monday, June 10, 2019 10:47 PM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > 9:26 pm: Emergency locates are nearly complete so the underground > construction crew will be able to start major excavations soon. The crew > will need to trench along 200 feet of the cable path to add in a new > section of fiber. No ETTR at this time. > > > > Frank > > > > *From:* Frank Bulk > *Sent:* Monday, June 10, 2019 9:09 PM > *To:* 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> > *Subject:* RE: [MICE-DISCUSS] lost MICE > > > > 8:19 pm: OSP has reported that Underground crew has arrived on site. They > will begin excavation within the next few minutes. There is no ETTR at this > time. More updates to follow. > > > > Frank > > > > *From:* Frank Bulk > *Sent:* Monday, June 10, 2019 7:15 PM > *To:* 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> > *Subject:* RE: [MICE-DISCUSS] lost MICE > > > > 6:58 pm: No Change in Update. OSP has located the damage between 130th and > 140th along highway 60 in Sibley IA. Looks like land owner or contractor > trenched through the cable. Cable is completely severed. Underground crew > is in route and are trying to get around flooded roads. ETA is 30 mins. > More updates to follow as we receive them. > > > > Frank > > > > *From:* Frank Bulk > *Sent:* Monday, June 10, 2019 6:00 PM > *To:* 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> > *Subject:* RE: [MICE-DISCUSS] lost MICE > > > > 4:47 pm: No Change in Update. OSP has located the damage between 130th and > 140th along highway 60 in Sibley IA. Looks like land owner or contractor > trenched through the cable. Cable is completely severed. Underground crew > is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive > them. > > > > 5:51 pm: No Change in Update. OSP has located the damage between 130th and > 140th along highway 60 in Sibley IA. Looks like land owner or contractor > trenched through the cable. Cable is completely severed. Underground crew > is in route with ETA of 30-45 mins. More updates to follow as we receive > them. > > > > Frank > > > > *From:* Frank Bulk > *Sent:* Monday, June 10, 2019 2:56 PM > *To:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> > *Subject:* RE: [MICE-DISCUSS] lost MICE > > > > 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 > mins. More updates to follow. > > > > Note that the location listed in the ticket is incorrect – I’ve > communicated the correct address (130th and Hwy 60) to Zayo’s NCC and > they’ve acknowledged receipt of that. > > > > If they do get onsite by 3:15 pm it will have been about 10 hours since > the initial cut. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Monday, June 10, 2019 1:24 PM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > 12:35 pm: OSP reported they are trying to get resources to the damage > location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA > or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More > updates to follow. > > 12:43 pm: OSP reported Splicer is in route to the damage location right > off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More > updates to follow. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Monday, June 10, 2019 10:35 AM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > Another update from Zayo: > > > > 10:30 OSP reported they are trying to get resources to the damage > location. Damage appears to be right off of I60 and 170th in Sibley IA. > Currently there is no ETA for techs. More updates to follow. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Monday, June 10, 2019 10:27 AM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > First two updates from Zayo: > > > > 9:48 am: Your case has been associated with a higher level outage ticket, > your ticket number will remain the same. The latest update is as follows: > Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN > affecting multiple customers. The appropriate resources have been engaged > for repairs. At this time, OSP is en route to the suspected trouble > location to begin investigating. No ETA available as of yet. > > > > 10:21 am: Our OSP crews are en route to begin investigations. More updates > to follow. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Monday, June 10, 2019 8:53 AM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy > 60 ( > https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U… > <https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) > in Sibley, Iowa. The tiler called one of our techs and the farmer called > another one of our techs, inquiring if it was our fiber or not (it’s not). > The tiler reported hitting a line below the tape. > > > > I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and > haven’t yet received an acknowledgement, but once I do I will inform them > of the location. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Monday, June 10, 2019 8:06 AM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I > assume it’s an issue between Sioux City and Belle Plaine. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *James > Urwiller > *Sent:* Monday, June 10, 2019 7:58 AM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* [MICE-DISCUSS] lost MICE > > > > I lost MICE again over ZAYO about 30 minutes ago.. anyone else? > > > > James Urwiller > > Network Architect > > Stealth Broadband > > james.urwiller(a)stealthbroadband.com > > [image: stealth300] > > > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

June 11, 2019

Re: lost MICE

by Frank Bulk

And RFO: Reason for Outage Summary: A fiber cut was reported in Sibley IA. Zayo crews were dispatched out to 130th and 140th along highway 60 and repaired the damaged fiber which was caused by a Drain tile contractor trenched through the cable. All Repairs were completed at 1:00 PM CDT. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Tuesday, June 11, 2019 11:38 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost MICE 11:30 am: OSP reported that splicing is complete. Please verify that your Services have restored. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Tuesday, June 11, 2019 10:44 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 10:33 am: OSP has reported that splicing on the north case is complete. Splicers working on South case. You should start to see service restore as splicing continues. A rough ETR is 1 hour. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Tuesday, June 11, 2019 10:05 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE My own link alarm cleared at 9:52 am, so just a hair under 26.5 hours. From what I heard from our field staff, the issue wasn’t that bad – looking through the update, it just took Zayo’s staff and/or contractors a long time to get on site and perform the work. It seems like they had just one fiber splicing crew, so they didn’t prep and splice on both sides at the same time. We’ve had similar cuts many times before and we would likely have this resolved in 6 to 8 hours. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Tuesday, June 11, 2019 9:43 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE I would like to Thank Frank for reporting all this info. He is keeping up with the Zayo ticket responses very well! You mentioned this was cut near your area.. was it really that bad to warrant 24+ hrs? seems like they are pretty slow with these repairs? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Tuesday, June 11, 2019 07:58 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 11:04 pm: Excavation is currently underway at this time. Techs are trenching out the 200 feet of cable required to make repairs. 12:58 am: Underground crews have completed the trench on one side of the break. OSP splicers have the cable exposed on that side and are prepping the old cable and the new for repairs. The Underground crew is working to excavate on the opposite end at this time. No ETTR at this time. 2:22 am: OSP crews are still continuing to work at this time. Excavation crews are continuing to work to expose the remaining fiber to prep for splicing. No ETTR at this time. 3:20 am: At this time the underground crew has completed excavation and the cable is fully exposed for repairs. Prep work is still ongoing on both sides. Splicers expect to be splicing on one end of the cable in about 1 hour. The other side will be spliced once prep work is complete. No ETR at this time. 5:04 am: OSP splicers are continuing the splice at this time. Techs are prioritizing the active fibers to speed up restoration. No ETTR at this time. 5:57 am: OSP splicers are continue to finish up the splicing on the North side of the cut. Once complete crews will move to the South side to complete prep work and begin splicing. We have a tentative ETTR of 10 CST today. 7:07 am: OSP splicers onsite advised they have been a bit delayed on the splicing at the North side of the cut. Splicers are nearly complete on the North side, and will be moving to the South to complete prep work and repairs. Crews have revised the tentative ETTR for 12 CST. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:47 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 9:26 pm: Emergency locates are nearly complete so the underground construction crew will be able to start major excavations soon. The crew will need to trench along 200 feet of the cable path to add in a new section of fiber. No ETTR at this time. Frank From: Frank Bulk Sent: Monday, June 10, 2019 9:09 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 8:19 pm: OSP has reported that Underground crew has arrived on site. They will begin excavation within the next few minutes. There is no ETTR at this time. More updates to follow. Frank From: Frank Bulk Sent: Monday, June 10, 2019 7:15 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 6:00 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 2:56 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 1:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 11, 2019

Re: lost MICE

by Frank Bulk

11:30 am: OSP reported that splicing is complete. Please verify that your Services have restored. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Tuesday, June 11, 2019 10:44 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost MICE 10:33 am: OSP has reported that splicing on the north case is complete. Splicers working on South case. You should start to see service restore as splicing continues. A rough ETR is 1 hour. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Tuesday, June 11, 2019 10:05 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE My own link alarm cleared at 9:52 am, so just a hair under 26.5 hours. From what I heard from our field staff, the issue wasn’t that bad – looking through the update, it just took Zayo’s staff and/or contractors a long time to get on site and perform the work. It seems like they had just one fiber splicing crew, so they didn’t prep and splice on both sides at the same time. We’ve had similar cuts many times before and we would likely have this resolved in 6 to 8 hours. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Tuesday, June 11, 2019 9:43 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE I would like to Thank Frank for reporting all this info. He is keeping up with the Zayo ticket responses very well! You mentioned this was cut near your area.. was it really that bad to warrant 24+ hrs? seems like they are pretty slow with these repairs? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Tuesday, June 11, 2019 07:58 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 11:04 pm: Excavation is currently underway at this time. Techs are trenching out the 200 feet of cable required to make repairs. 12:58 am: Underground crews have completed the trench on one side of the break. OSP splicers have the cable exposed on that side and are prepping the old cable and the new for repairs. The Underground crew is working to excavate on the opposite end at this time. No ETTR at this time. 2:22 am: OSP crews are still continuing to work at this time. Excavation crews are continuing to work to expose the remaining fiber to prep for splicing. No ETTR at this time. 3:20 am: At this time the underground crew has completed excavation and the cable is fully exposed for repairs. Prep work is still ongoing on both sides. Splicers expect to be splicing on one end of the cable in about 1 hour. The other side will be spliced once prep work is complete. No ETR at this time. 5:04 am: OSP splicers are continuing the splice at this time. Techs are prioritizing the active fibers to speed up restoration. No ETTR at this time. 5:57 am: OSP splicers are continue to finish up the splicing on the North side of the cut. Once complete crews will move to the South side to complete prep work and begin splicing. We have a tentative ETTR of 10 CST today. 7:07 am: OSP splicers onsite advised they have been a bit delayed on the splicing at the North side of the cut. Splicers are nearly complete on the North side, and will be moving to the South to complete prep work and repairs. Crews have revised the tentative ETTR for 12 CST. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:47 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 9:26 pm: Emergency locates are nearly complete so the underground construction crew will be able to start major excavations soon. The crew will need to trench along 200 feet of the cable path to add in a new section of fiber. No ETTR at this time. Frank From: Frank Bulk Sent: Monday, June 10, 2019 9:09 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 8:19 pm: OSP has reported that Underground crew has arrived on site. They will begin excavation within the next few minutes. There is no ETTR at this time. More updates to follow. Frank From: Frank Bulk Sent: Monday, June 10, 2019 7:15 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 6:00 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 2:56 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 1:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 11, 2019

Re: lost MICE

by Frank Bulk

10:33 am: OSP has reported that splicing on the north case is complete. Splicers working on South case. You should start to see service restore as splicing continues. A rough ETR is 1 hour. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Tuesday, June 11, 2019 10:05 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost MICE My own link alarm cleared at 9:52 am, so just a hair under 26.5 hours. From what I heard from our field staff, the issue wasn’t that bad – looking through the update, it just took Zayo’s staff and/or contractors a long time to get on site and perform the work. It seems like they had just one fiber splicing crew, so they didn’t prep and splice on both sides at the same time. We’ve had similar cuts many times before and we would likely have this resolved in 6 to 8 hours. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Tuesday, June 11, 2019 9:43 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE I would like to Thank Frank for reporting all this info. He is keeping up with the Zayo ticket responses very well! You mentioned this was cut near your area.. was it really that bad to warrant 24+ hrs? seems like they are pretty slow with these repairs? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Tuesday, June 11, 2019 07:58 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 11:04 pm: Excavation is currently underway at this time. Techs are trenching out the 200 feet of cable required to make repairs. 12:58 am: Underground crews have completed the trench on one side of the break. OSP splicers have the cable exposed on that side and are prepping the old cable and the new for repairs. The Underground crew is working to excavate on the opposite end at this time. No ETTR at this time. 2:22 am: OSP crews are still continuing to work at this time. Excavation crews are continuing to work to expose the remaining fiber to prep for splicing. No ETTR at this time. 3:20 am: At this time the underground crew has completed excavation and the cable is fully exposed for repairs. Prep work is still ongoing on both sides. Splicers expect to be splicing on one end of the cable in about 1 hour. The other side will be spliced once prep work is complete. No ETR at this time. 5:04 am: OSP splicers are continuing the splice at this time. Techs are prioritizing the active fibers to speed up restoration. No ETTR at this time. 5:57 am: OSP splicers are continue to finish up the splicing on the North side of the cut. Once complete crews will move to the South side to complete prep work and begin splicing. We have a tentative ETTR of 10 CST today. 7:07 am: OSP splicers onsite advised they have been a bit delayed on the splicing at the North side of the cut. Splicers are nearly complete on the North side, and will be moving to the South to complete prep work and repairs. Crews have revised the tentative ETTR for 12 CST. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:47 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 9:26 pm: Emergency locates are nearly complete so the underground construction crew will be able to start major excavations soon. The crew will need to trench along 200 feet of the cable path to add in a new section of fiber. No ETTR at this time. Frank From: Frank Bulk Sent: Monday, June 10, 2019 9:09 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 8:19 pm: OSP has reported that Underground crew has arrived on site. They will begin excavation within the next few minutes. There is no ETTR at this time. More updates to follow. Frank From: Frank Bulk Sent: Monday, June 10, 2019 7:15 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 6:00 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 2:56 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 1:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 11, 2019

Re: lost MICE

by Aaron Clark

We have experienced extremely poor responsiveness and very uninformed call center reps on recent fiber outages with Zayo as well. Our circuits were previously part of Neutral Path so I don’t have any previous experience with Zayo to compare to. Thank you Aaron Clark | Vice President – COO *Future Technologies* *www.futuretech.net <www.futuretech.net>* *Office: 402.817.2682x121* *Mobile: 402.770.9251* [image: cid:image001.png@01D36053.05503150] *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Tuesday, June 11, 2019 10:05 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE My own link alarm cleared at 9:52 am, so just a hair under 26.5 hours. >From what I heard from our field staff, the issue wasn’t that bad – looking through the update, it just took Zayo’s staff and/or contractors a long time to get on site and perform the work. It seems like they had just one fiber splicing crew, so they didn’t prep and splice on both sides at the same time. We’ve had similar cuts many times before and we would likely have this resolved in 6 to 8 hours. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *James Urwiller *Sent:* Tuesday, June 11, 2019 9:43 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE I would like to Thank Frank for reporting all this info. He is keeping up with the Zayo ticket responses very well! You mentioned this was cut near your area.. was it really that bad to warrant 24+ hrs? seems like they are pretty slow with these repairs? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Tuesday, June 11, 2019 07:58 *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE 11:04 pm: Excavation is currently underway at this time. Techs are trenching out the 200 feet of cable required to make repairs. 12:58 am: Underground crews have completed the trench on one side of the break. OSP splicers have the cable exposed on that side and are prepping the old cable and the new for repairs. The Underground crew is working to excavate on the opposite end at this time. No ETTR at this time. 2:22 am: OSP crews are still continuing to work at this time. Excavation crews are continuing to work to expose the remaining fiber to prep for splicing. No ETTR at this time. 3:20 am: At this time the underground crew has completed excavation and the cable is fully exposed for repairs. Prep work is still ongoing on both sides. Splicers expect to be splicing on one end of the cable in about 1 hour. The other side will be spliced once prep work is complete. No ETR at this time. 5:04 am: OSP splicers are continuing the splice at this time. Techs are prioritizing the active fibers to speed up restoration. No ETTR at this time. 5:57 am: OSP splicers are continue to finish up the splicing on the North side of the cut. Once complete crews will move to the South side to complete prep work and begin splicing. We have a tentative ETTR of 10 CST today. 7:07 am: OSP splicers onsite advised they have been a bit delayed on the splicing at the North side of the cut. Splicers are nearly complete on the North side, and will be moving to the South to complete prep work and repairs. Crews have revised the tentative ETTR for 12 CST. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 10:47 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE 9:26 pm: Emergency locates are nearly complete so the underground construction crew will be able to start major excavations soon. The crew will need to trench along 200 feet of the cable path to add in a new section of fiber. No ETTR at this time. Frank *From:* Frank Bulk *Sent:* Monday, June 10, 2019 9:09 PM *To:* 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Subject:* RE: [MICE-DISCUSS] lost MICE 8:19 pm: OSP has reported that Underground crew has arrived on site. They will begin excavation within the next few minutes. There is no ETTR at this time. More updates to follow. Frank *From:* Frank Bulk *Sent:* Monday, June 10, 2019 7:15 PM *To:* 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Subject:* RE: [MICE-DISCUSS] lost MICE 6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them. Frank *From:* Frank Bulk *Sent:* Monday, June 10, 2019 6:00 PM *To:* 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Subject:* RE: [MICE-DISCUSS] lost MICE 4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank *From:* Frank Bulk *Sent:* Monday, June 10, 2019 2:56 PM *To:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Subject:* RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 1:24 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 10:35 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 10:27 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 8:53 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 ( https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U… <https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 8:06 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *James Urwiller *Sent:* Monday, June 10, 2019 7:58 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

June 11, 2019

Re: lost MICE

by Frank Bulk

My own link alarm cleared at 9:52 am, so just a hair under 26.5 hours. From what I heard from our field staff, the issue wasn’t that bad – looking through the update, it just took Zayo’s staff and/or contractors a long time to get on site and perform the work. It seems like they had just one fiber splicing crew, so they didn’t prep and splice on both sides at the same time. We’ve had similar cuts many times before and we would likely have this resolved in 6 to 8 hours. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of James Urwiller Sent: Tuesday, June 11, 2019 9:43 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost MICE I would like to Thank Frank for reporting all this info. He is keeping up with the Zayo ticket responses very well! You mentioned this was cut near your area.. was it really that bad to warrant 24+ hrs? seems like they are pretty slow with these repairs? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Tuesday, June 11, 2019 07:58 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 11:04 pm: Excavation is currently underway at this time. Techs are trenching out the 200 feet of cable required to make repairs. 12:58 am: Underground crews have completed the trench on one side of the break. OSP splicers have the cable exposed on that side and are prepping the old cable and the new for repairs. The Underground crew is working to excavate on the opposite end at this time. No ETTR at this time. 2:22 am: OSP crews are still continuing to work at this time. Excavation crews are continuing to work to expose the remaining fiber to prep for splicing. No ETTR at this time. 3:20 am: At this time the underground crew has completed excavation and the cable is fully exposed for repairs. Prep work is still ongoing on both sides. Splicers expect to be splicing on one end of the cable in about 1 hour. The other side will be spliced once prep work is complete. No ETR at this time. 5:04 am: OSP splicers are continuing the splice at this time. Techs are prioritizing the active fibers to speed up restoration. No ETTR at this time. 5:57 am: OSP splicers are continue to finish up the splicing on the North side of the cut. Once complete crews will move to the South side to complete prep work and begin splicing. We have a tentative ETTR of 10 CST today. 7:07 am: OSP splicers onsite advised they have been a bit delayed on the splicing at the North side of the cut. Splicers are nearly complete on the North side, and will be moving to the South to complete prep work and repairs. Crews have revised the tentative ETTR for 12 CST. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:47 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 9:26 pm: Emergency locates are nearly complete so the underground construction crew will be able to start major excavations soon. The crew will need to trench along 200 feet of the cable path to add in a new section of fiber. No ETTR at this time. Frank From: Frank Bulk Sent: Monday, June 10, 2019 9:09 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 8:19 pm: OSP has reported that Underground crew has arrived on site. They will begin excavation within the next few minutes. There is no ETTR at this time. More updates to follow. Frank From: Frank Bulk Sent: Monday, June 10, 2019 7:15 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 6:00 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 2:56 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 1:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 11, 2019

Re: lost MICE

by James Urwiller

I would like to Thank Frank for reporting all this info. He is keeping up with the Zayo ticket responses very well! You mentioned this was cut near your area.. was it really that bad to warrant 24+ hrs? seems like they are pretty slow with these repairs? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Tuesday, June 11, 2019 07:58 *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE 11:04 pm: Excavation is currently underway at this time. Techs are trenching out the 200 feet of cable required to make repairs. 12:58 am: Underground crews have completed the trench on one side of the break. OSP splicers have the cable exposed on that side and are prepping the old cable and the new for repairs. The Underground crew is working to excavate on the opposite end at this time. No ETTR at this time. 2:22 am: OSP crews are still continuing to work at this time. Excavation crews are continuing to work to expose the remaining fiber to prep for splicing. No ETTR at this time. 3:20 am: At this time the underground crew has completed excavation and the cable is fully exposed for repairs. Prep work is still ongoing on both sides. Splicers expect to be splicing on one end of the cable in about 1 hour. The other side will be spliced once prep work is complete. No ETR at this time. 5:04 am: OSP splicers are continuing the splice at this time. Techs are prioritizing the active fibers to speed up restoration. No ETTR at this time. 5:57 am: OSP splicers are continue to finish up the splicing on the North side of the cut. Once complete crews will move to the South side to complete prep work and begin splicing. We have a tentative ETTR of 10 CST today. 7:07 am: OSP splicers onsite advised they have been a bit delayed on the splicing at the North side of the cut. Splicers are nearly complete on the North side, and will be moving to the South to complete prep work and repairs. Crews have revised the tentative ETTR for 12 CST. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 10:47 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE 9:26 pm: Emergency locates are nearly complete so the underground construction crew will be able to start major excavations soon. The crew will need to trench along 200 feet of the cable path to add in a new section of fiber. No ETTR at this time. Frank *From:* Frank Bulk *Sent:* Monday, June 10, 2019 9:09 PM *To:* 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Subject:* RE: [MICE-DISCUSS] lost MICE 8:19 pm: OSP has reported that Underground crew has arrived on site. They will begin excavation within the next few minutes. There is no ETTR at this time. More updates to follow. Frank *From:* Frank Bulk *Sent:* Monday, June 10, 2019 7:15 PM *To:* 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Subject:* RE: [MICE-DISCUSS] lost MICE 6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them. Frank *From:* Frank Bulk *Sent:* Monday, June 10, 2019 6:00 PM *To:* 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Subject:* RE: [MICE-DISCUSS] lost MICE 4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank *From:* Frank Bulk *Sent:* Monday, June 10, 2019 2:56 PM *To:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Subject:* RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 1:24 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 10:35 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 10:27 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 8:53 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 ( https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U… <https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 8:06 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *James Urwiller *Sent:* Monday, June 10, 2019 7:58 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

June 11, 2019

Re: lost MICE

by Frank Bulk

11:04 pm: Excavation is currently underway at this time. Techs are trenching out the 200 feet of cable required to make repairs. 12:58 am: Underground crews have completed the trench on one side of the break. OSP splicers have the cable exposed on that side and are prepping the old cable and the new for repairs. The Underground crew is working to excavate on the opposite end at this time. No ETTR at this time. 2:22 am: OSP crews are still continuing to work at this time. Excavation crews are continuing to work to expose the remaining fiber to prep for splicing. No ETTR at this time. 3:20 am: At this time the underground crew has completed excavation and the cable is fully exposed for repairs. Prep work is still ongoing on both sides. Splicers expect to be splicing on one end of the cable in about 1 hour. The other side will be spliced once prep work is complete. No ETR at this time. 5:04 am: OSP splicers are continuing the splice at this time. Techs are prioritizing the active fibers to speed up restoration. No ETTR at this time. 5:57 am: OSP splicers are continue to finish up the splicing on the North side of the cut. Once complete crews will move to the South side to complete prep work and begin splicing. We have a tentative ETTR of 10 CST today. 7:07 am: OSP splicers onsite advised they have been a bit delayed on the splicing at the North side of the cut. Splicers are nearly complete on the North side, and will be moving to the South to complete prep work and repairs. Crews have revised the tentative ETTR for 12 CST. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:47 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost MICE 9:26 pm: Emergency locates are nearly complete so the underground construction crew will be able to start major excavations soon. The crew will need to trench along 200 feet of the cable path to add in a new section of fiber. No ETTR at this time. Frank From: Frank Bulk Sent: Monday, June 10, 2019 9:09 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 8:19 pm: OSP has reported that Underground crew has arrived on site. They will begin excavation within the next few minutes. There is no ETTR at this time. More updates to follow. Frank From: Frank Bulk Sent: Monday, June 10, 2019 7:15 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 6:00 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 2:56 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 1:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 11, 2019

Re: lost MICE

by Frank Bulk

9:26 pm: Emergency locates are nearly complete so the underground construction crew will be able to start major excavations soon. The crew will need to trench along 200 feet of the cable path to add in a new section of fiber. No ETTR at this time. Frank From: Frank Bulk Sent: Monday, June 10, 2019 9:09 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] lost MICE 8:19 pm: OSP has reported that Underground crew has arrived on site. They will begin excavation within the next few minutes. There is no ETTR at this time. More updates to follow. Frank From: Frank Bulk Sent: Monday, June 10, 2019 7:15 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 6:00 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 2:56 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 1:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 11, 2019

Re: lost MICE

by Frank Bulk

8:19 pm: OSP has reported that Underground crew has arrived on site. They will begin excavation within the next few minutes. There is no ETTR at this time. More updates to follow. Frank From: Frank Bulk Sent: Monday, June 10, 2019 7:15 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] lost MICE 6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 6:00 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 2:56 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 1:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 11, 2019

Re: lost MICE

by Frank Bulk

6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 6:00 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] lost MICE 4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 2:56 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 1:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 11, 2019

Re: lost MICE

by Frank Bulk

4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 2:56 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 1:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 10, 2019

Re: lost MICE

by Frank Bulk

2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 1:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 10, 2019

Re: lost MICE

by Frank Bulk

12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 10, 2019

Re: lost MICE

by Frank Bulk

Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 10, 2019

Re: lost MICE

by Frank Bulk

First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 10, 2019

Re: lost MICE

by Frank Bulk

Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 10, 2019

Re: lost MICE

by Frank Bulk

Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 10, 2019

lost MICE

by James Urwiller

I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300]

June 10, 2019

Re: MAC address limit

by Jeremy Lumby

I am not proposing it for the core, and do not have plans of proposing it in the future. However if someone else wants to propose it, I would definitely be in favor of it. The main reason for the proposal with respect to my extension switch is to standardize it with all of the other internet exchanges that I offer, and I wanted to make sure that MICE would not have an issue with my extension being more restrictive then the core is (and therefore not matching the MICE standards). It also is partially because it makes me sleep better at night knowing that my extension switch is a little less likely to participate in accidentally dumping a bunch of garbage traffic onto the exchange causing problems for everyone else. To me that is much more important than the little additional effort that is required when someone swaps a router out. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: Richard Laager <rlaager(a)WIKTEL.COM> Date: 6/8/19 7:25 PM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MAC address limit _____ >From : Richard Laager [rlaager(a)WIKTEL.COM] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Saturday, June 8 2019 19:28:11 On 6/8/19 11:03 AM, Jeremy Lumby wrote: > With that being said, I would like to start a discussion about lowering > the maximum MAC address limit to 1 with respect to the MICE extension > switch that I operate. That seems perfectly reasonable to me. Is this a trial run for eventually proposing the same change MICE-wide? I don't have strong feelings, but that seems fine too. -- Richard

June 9, 2019

Re: MAC address limit

by Richard Laager

On 6/8/19 11:03 AM, Jeremy Lumby wrote: > With that being said, I would like to start a discussion about lowering > the maximum MAC address limit to 1 with respect to the MICE extension > switch that I operate. That seems perfectly reasonable to me. Is this a trial run for eventually proposing the same change MICE-wide? I don't have strong feelings, but that seems fine too. -- Richard

June 9, 2019

Re: MAC address limit

by Jeff Wilde

I agree with this also Jdw Please excuse typos as this was sent from smart phone -------- Original message -------- From: Andrew Hoyos <hoyosa(a)GMAIL.COM> Date: 6/8/19 12:17 PM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MAC address limit I’m a fan of 1 per port unless documented exception. -- Andrew Hoyos hoyosa(a)gmail.com<mailto:hoyosa@gmail.com> On Jun 8, 2019, at 11:03 AM, Jeremy Lumby <jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com>> wrote: I wanted to start a discussion about the MAC address limit that MICE has as a standard limit of 5 per port. If I remember correctly, the history behind it ended up being that 5 MAC addresses was chosen as a happy middle ground to make router swaps by end users much easier on the end user, as well as the MICE tech committee. As someone that runs extension switches for 3 exchanges in addition to MICE, all of the other IXes have a 1 MAC address limit per port. I have found that maintaining these was not nearly as difficult as the original concern that was expressed at the MICE UG that lead to a limit of 5. With that being said, I would like to start a discussion about lowering the maximum MAC address limit to 1 with respect to the MICE extension switch that I operate. I feel that the benefits outnumber the risks, and with the experiences from the other 3 IXes, I do not think that the extra effort I will need to put in would be significant. Just to state the obvious, the South Front extension switch uplink that is connected to my extension would be a permanent exception, and short term exceptions would be permitted ahead of a router swap. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

June 8, 2019

Re: MAC address limit

by Andrew Hoyos

I’m a fan of 1 per port unless documented exception. -- Andrew Hoyos hoyosa(a)gmail.com > On Jun 8, 2019, at 11:03 AM, Jeremy Lumby <jlumby(a)mnvoip.com> wrote: > > I wanted to start a discussion about the MAC address limit that MICE has as a standard limit of 5 per port. If I remember correctly, the history behind it ended up being that 5 MAC addresses was chosen as a happy middle ground to make router swaps by end users much easier on the end user, as well as the MICE tech committee. As someone that runs extension switches for 3 exchanges in addition to MICE, all of the other IXes have a 1 MAC address limit per port. I have found that maintaining these was not nearly as difficult as the original concern that was expressed at the MICE UG that lead to a limit of 5. With that being said, I would like to start a discussion about lowering the maximum MAC address limit to 1 with respect to the MICE extension switch that I operate. I feel that the benefits outnumber the risks, and with the experiences from the other 3 IXes, I do not think that the extra effort I will need to put in would be significant. Just to state the obvious, the South Front extension switch uplink that is connected to my extension would be a permanent exception, and short term exceptions would be permitted ahead of a router swap. > > Jeremy Lumby > Minnesota VoIP > 9217 17th Ave S #216 > Bloomington, MN 55425 > M: 612-355-7740 > D: 612-392-6814 > F: 952-873-7425 > jlumby(a)mnvoip.com > > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

June 8, 2019

MAC address limit

by Jeremy Lumby

I wanted to start a discussion about the MAC address limit that MICE has as a standard limit of 5 per port. If I remember correctly, the history behind it ended up being that 5 MAC addresses was chosen as a happy middle ground to make router swaps by end users much easier on the end user, as well as the MICE tech committee. As someone that runs extension switches for 3 exchanges in addition to MICE, all of the other IXes have a 1 MAC address limit per port. I have found that maintaining these was not nearly as difficult as the original concern that was expressed at the MICE UG that lead to a limit of 5. With that being said, I would like to start a discussion about lowering the maximum MAC address limit to 1 with respect to the MICE extension switch that I operate. I feel that the benefits outnumber the risks, and with the experiences from the other 3 IXes, I do not think that the extra effort I will need to put in would be significant. Just to state the obvious, the South Front extension switch uplink that is connected to my extension would be a permanent exception, and short term exceptions would be permitted ahead of a router swap. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com

June 8, 2019

FW: Fiber cut possibly along I-90/94 corridor in WI

by Frank Bulk

FYI From: Outages <outages-bounces(a)outages.org> On Behalf Of Jeremy Charles via Outages Sent: Wednesday, June 05, 2019 10:36 AM To: outages(a)outages.org Subject: [outages] Fiber cut possibly along I-90/94 corridor in WI We lost a couple (unprotected) circuits with Wisconsin Independent Network at about 9:50 CDT this morning, running from Verona WI to Rochester MN and MSP. One of our team members called WIN's NMC and the tech who answered said his phones just started lighting up like Christmas trees and their network engineers were beginning the troubleshooting process. I'm pretty sure our two circuits are groomed along the I-90/94 corridor between Madison and Tomah, and then they split to follow 90 and 94 separately. If this is a fiber cut in that area, it's likely to impact a number of carriers. Obviously, it was too early for WIN to give us a diagnosis and ETR at this point. They're pretty good about sending updates when they've got info to share. Anyone else seeing impact? == Jeremy Charles Epic's Computer and Technology Services Division (CatNet) jcharles(a)epic.com<mailto:jcharles@epic.com> 608-271-9000

June 5, 2019

Re: AS47096 Maintenance on May 29, 2019

by Ryan Nelson

Hello All, This work has been completed. Ryan Nelson | Network Infrastructure Architect Compudyne | 306 W Michigan Street - Suite 200 | Duluth, MN 55802 rnelson@compudyne.<mailto:rnelson@compudyne.net>com | 218.336.2220 | compudyne.<http://www.compudyne.net/>com From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Ryan Nelson Sent: Tuesday, May 28, 2019 12:50 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] AS47096 Maintenance on May 29, 2019 Hello MICE members, Compudyne AS47096 will be doing maintenance on our MICE connection tomorrow, May 29, 2019. We will be turning down our peering sessions (on 206.108.255.10 and 2001:504:27:0:0:b7f8::1 ) and migrating to our new connection on our 511 remote switch tomorrow starting at 1000 CDT. Thanks, Ryan Nelson | Network Infrastructure Architect Compudyne | 306 W Michigan Street - Suite 200 | Duluth, MN 55802 rnelson(a)compudyne.com<mailto:rnelson@compudyne.com> | 218.336.2220 | compudyne.com<http://www.compudyne.com/> Duluth | Hibbing | Saint Paul | Marquette | Houghton ________________________________ [cid:image002.png@01D0BA36.584BB020] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 29, 2019

AS47096 Maintenance on May 29, 2019

by Ryan Nelson

Hello MICE members, Compudyne AS47096 will be doing maintenance on our MICE connection tomorrow, May 29, 2019. We will be turning down our peering sessions (on 206.108.255.10 and 2001:504:27:0:0:b7f8::1 ) and migrating to our new connection on our 511 remote switch tomorrow starting at 1000 CDT. Thanks, Ryan Nelson | Network Infrastructure Architect Compudyne | 306 W Michigan Street - Suite 200 | Duluth, MN 55802 rnelson(a)compudyne.com<mailto:rnelson@compudyne.com> | 218.336.2220 | compudyne.com<http://www.compudyne.com/> Duluth | Hibbing | Saint Paul | Marquette | Houghton ________________________________ [cid:image002.png@01D0BA36.584BB020]

May 28, 2019

SFN Albert Lea Remote Switch Outage

by Jay Hanke

We're having issues with the back haul circuit between Albert Lea and Minneapolis. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

May 24, 2019

Re: zayo again anyone?

by Justin Krejci

As of 8:30am I heard the current full ETR is noon today. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Shannon Sykes <shannons(a)CHRISCOMCO.NET> Sent: Thursday, May 23, 2019 10:04 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] zayo again anyone? Here is the last update I received from Zayo. current Update: OSP has advised that the duct repair is complete, and the western half of the cable pull. They are awaiting emergency locates to clear, so they can move the east splice case 100' east due to the cable damage. The eastern cable pull completion is looking like it will be completed around 10-11 pm CST. Full repair ETR is 8:00 AM CST Sent from my iPhone On May 23, 2019, at 10:02 PM, Corey Hauer <coreyhauer(a)gmail.com<mailto:coreyhauer@gmail.com>> wrote: Anyone know an ETR yet? Our Mankato and Windom bandwidth is being impacted. On Thu, May 23, 2019 at 2:36 PM Justin Krejci <JKrejci(a)usinternet.com<mailto:JKrejci@usinternet.com>> wrote: Indeed. No ETR yet. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of Jay Hanke <jayhanke(a)SOUTHFRONT.IO<mailto:jayhanke@SOUTHFRONT.IO>> Sent: Thursday, May 23, 2019 4:06 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] zayo again anyone? That's a good sized cable. Is there an ETA on repair? On Thu, May 23, 2019 at 3:31 PM Justin Krejci <JKrejci(a)usinternet.com<mailto:JKrejci@usinternet.com>> wrote: > > I-35W construction crews in Minneapolis hit the fiber. Last I heard Zayo and their fiber contractor were on site assessing the situation. > > > > ________________________________ > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of Jeremy Schmeichel <Jeremy.Schmeichel(a)VASTBROADBAND.COM<mailto:Jeremy.Schmeichel@VASTBROADBAND.COM>> > Sent: Thursday, May 23, 2019 1:51 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> > Subject: Re: [MICE-DISCUSS] zayo again anyone? > > > Been a rough few months for belle plaine... > > > > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Corey Hauer > Sent: Thursday, May 23, 2019 12:33 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> > Subject: Re: [MICE-DISCUSS] zayo again anyone? > > > > Happily, our Mankato and Windom feeds (zayo) are still up. Maybe Zayo fixed the protect for Mankato? > > > > > > On Thu, May 23, 2019 at 11:29 AM Jay Hanke <jayhanke(a)southfront.io<mailto:jayhanke@southfront.io>> wrote: > > I believe there is a cut somewhere just south of 511. > > On Thu, May 23, 2019 at 1:25 PM James Urwiller > <james.urwiller(a)turnkey-telecom.com<mailto:james.urwiller@turnkey-telecom.com>> wrote: > > > > we lost belle plaine again, anyone else? > > > > Sent from my iPhone 7 > > > > -- > Jay Hanke, President > South Front Networks > jayhanke(a)southfront.io<mailto:jayhanke@southfront.io> > Phone 612-204-0000 > > > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io<mailto:jayhanke@southfront.io> Phone 612-204-0000 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 24, 2019

Re: zayo again anyone?

by Shannon Sykes

Here is the last update I received from Zayo. current Update: OSP has advised that the duct repair is complete, and the western half of the cable pull. They are awaiting emergency locates to clear, so they can move the east splice case 100' east due to the cable damage. The eastern cable pull completion is looking like it will be completed around 10-11 pm CST<x-apple-data-detectors://2>. Full repair ETR is 8:00 AM CST<x-apple-data-detectors://3> Sent from my iPhone On May 23, 2019, at 10:02 PM, Corey Hauer <coreyhauer(a)gmail.com<mailto:coreyhauer@gmail.com>> wrote: Anyone know an ETR yet? Our Mankato and Windom bandwidth is being impacted. On Thu, May 23, 2019 at 2:36 PM Justin Krejci <JKrejci(a)usinternet.com<mailto:JKrejci@usinternet.com>> wrote: Indeed. No ETR yet. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of Jay Hanke <jayhanke(a)SOUTHFRONT.IO<mailto:jayhanke@SOUTHFRONT.IO>> Sent: Thursday, May 23, 2019 4:06 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] zayo again anyone? That's a good sized cable. Is there an ETA on repair? On Thu, May 23, 2019 at 3:31 PM Justin Krejci <JKrejci(a)usinternet.com<mailto:JKrejci@usinternet.com>> wrote: > > I-35W construction crews in Minneapolis hit the fiber. Last I heard Zayo and their fiber contractor were on site assessing the situation. > > > > ________________________________ > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of Jeremy Schmeichel <Jeremy.Schmeichel(a)VASTBROADBAND.COM<mailto:Jeremy.Schmeichel@VASTBROADBAND.COM>> > Sent: Thursday, May 23, 2019 1:51 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> > Subject: Re: [MICE-DISCUSS] zayo again anyone? > > > Been a rough few months for belle plaine… > > > > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Corey Hauer > Sent: Thursday, May 23, 2019 12:33 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> > Subject: Re: [MICE-DISCUSS] zayo again anyone? > > > > Happily, our Mankato and Windom feeds (zayo) are still up. Maybe Zayo fixed the protect for Mankato? > > > > > > On Thu, May 23, 2019 at 11:29 AM Jay Hanke <jayhanke(a)southfront.io<mailto:jayhanke@southfront.io>> wrote: > > I believe there is a cut somewhere just south of 511. > > On Thu, May 23, 2019 at 1:25 PM James Urwiller > <james.urwiller(a)turnkey-telecom.com<mailto:james.urwiller@turnkey-telecom.com>> wrote: > > > > we lost belle plaine again, anyone else? > > > > Sent from my iPhone 7 > > > > -- > Jay Hanke, President > South Front Networks > jayhanke(a)southfront.io<mailto:jayhanke@southfront.io> > Phone 612-204-0000 > > > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io<mailto:jayhanke@southfront.io> Phone 612-204-0000 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 24, 2019

Re: zayo again anyone?

by Corey Hauer

Anyone know an ETR yet? Our Mankato and Windom bandwidth is being impacted. On Thu, May 23, 2019 at 2:36 PM Justin Krejci <JKrejci(a)usinternet.com> wrote: > Indeed. No ETR yet. > > > > > ------------------------------ > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Jay > Hanke <jayhanke(a)SOUTHFRONT.IO> > *Sent:* Thursday, May 23, 2019 4:06 PM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] zayo again anyone? > > That's a good sized cable. Is there an ETA on repair? > > On Thu, May 23, 2019 at 3:31 PM Justin Krejci <JKrejci(a)usinternet.com> > wrote: > > > > I-35W construction crews in Minneapolis hit the fiber. Last I heard Zayo > and their fiber contractor were on site assessing the situation. > > > > > > > > ________________________________ > > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Jeremy > Schmeichel <Jeremy.Schmeichel(a)VASTBROADBAND.COM> > > Sent: Thursday, May 23, 2019 1:51 PM > > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > > Subject: Re: [MICE-DISCUSS] zayo again anyone? > > > > > > Been a rough few months for belle plaine… > > > > > > > > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Corey > Hauer > > Sent: Thursday, May 23, 2019 12:33 PM > > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > > Subject: Re: [MICE-DISCUSS] zayo again anyone? > > > > > > > > Happily, our Mankato and Windom feeds (zayo) are still up. Maybe Zayo > fixed the protect for Mankato? > > > > > > > > > > > > On Thu, May 23, 2019 at 11:29 AM Jay Hanke <jayhanke(a)southfront.io> > wrote: > > > > I believe there is a cut somewhere just south of 511. > > > > On Thu, May 23, 2019 at 1:25 PM James Urwiller > > <james.urwiller(a)turnkey-telecom.com> wrote: > > > > > > we lost belle plaine again, anyone else? > > > > > > Sent from my iPhone 7 > > > > > > > > -- > > Jay Hanke, President > > South Front Networks > > jayhanke(a)southfront.io > > Phone 612-204-0000 > > > > > > > > ________________________________ > > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > > > > ________________________________ > > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > > > > ________________________________ > > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > > -- > Jay Hanke, President > South Front Networks > jayhanke(a)southfront.io > Phone 612-204-0000 > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >

May 24, 2019

Re: zayo again anyone?

by Justin Krejci

Indeed. No ETR yet. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Jay Hanke <jayhanke(a)SOUTHFRONT.IO> Sent: Thursday, May 23, 2019 4:06 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] zayo again anyone? That's a good sized cable. Is there an ETA on repair? On Thu, May 23, 2019 at 3:31 PM Justin Krejci <JKrejci(a)usinternet.com> wrote: > > I-35W construction crews in Minneapolis hit the fiber. Last I heard Zayo and their fiber contractor were on site assessing the situation. > > > > ________________________________ > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Jeremy Schmeichel <Jeremy.Schmeichel(a)VASTBROADBAND.COM> > Sent: Thursday, May 23, 2019 1:51 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] zayo again anyone? > > > Been a rough few months for belle plaine... > > > > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Corey Hauer > Sent: Thursday, May 23, 2019 12:33 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] zayo again anyone? > > > > Happily, our Mankato and Windom feeds (zayo) are still up. Maybe Zayo fixed the protect for Mankato? > > > > > > On Thu, May 23, 2019 at 11:29 AM Jay Hanke <jayhanke(a)southfront.io> wrote: > > I believe there is a cut somewhere just south of 511. > > On Thu, May 23, 2019 at 1:25 PM James Urwiller > <james.urwiller(a)turnkey-telecom.com> wrote: > > > > we lost belle plaine again, anyone else? > > > > Sent from my iPhone 7 > > > > -- > Jay Hanke, President > South Front Networks > jayhanke(a)southfront.io > Phone 612-204-0000 > > > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

May 23, 2019

Re: zayo again anyone?

by Jay Hanke

That's a good sized cable. Is there an ETA on repair? On Thu, May 23, 2019 at 3:31 PM Justin Krejci <JKrejci(a)usinternet.com> wrote: > > I-35W construction crews in Minneapolis hit the fiber. Last I heard Zayo and their fiber contractor were on site assessing the situation. > > > > ________________________________ > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Jeremy Schmeichel <Jeremy.Schmeichel(a)VASTBROADBAND.COM> > Sent: Thursday, May 23, 2019 1:51 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] zayo again anyone? > > > Been a rough few months for belle plaine… > > > > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Corey Hauer > Sent: Thursday, May 23, 2019 12:33 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] zayo again anyone? > > > > Happily, our Mankato and Windom feeds (zayo) are still up. Maybe Zayo fixed the protect for Mankato? > > > > > > On Thu, May 23, 2019 at 11:29 AM Jay Hanke <jayhanke(a)southfront.io> wrote: > > I believe there is a cut somewhere just south of 511. > > On Thu, May 23, 2019 at 1:25 PM James Urwiller > <james.urwiller(a)turnkey-telecom.com> wrote: > > > > we lost belle plaine again, anyone else? > > > > Sent from my iPhone 7 > > > > -- > Jay Hanke, President > South Front Networks > jayhanke(a)southfront.io > Phone 612-204-0000 > > > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

May 23, 2019

Re: zayo again anyone?

by Justin Krejci

I-35W construction crews in Minneapolis hit the fiber. Last I heard Zayo and their fiber contractor were on site assessing the situation. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Jeremy Schmeichel <Jeremy.Schmeichel(a)VASTBROADBAND.COM> Sent: Thursday, May 23, 2019 1:51 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] zayo again anyone? Been a rough few months for belle plaine... From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Corey Hauer Sent: Thursday, May 23, 2019 12:33 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] zayo again anyone? Happily, our Mankato and Windom feeds (zayo) are still up. Maybe Zayo fixed the protect for Mankato? On Thu, May 23, 2019 at 11:29 AM Jay Hanke <jayhanke(a)southfront.io<mailto:jayhanke@southfront.io>> wrote: I believe there is a cut somewhere just south of 511. On Thu, May 23, 2019 at 1:25 PM James Urwiller <james.urwiller(a)turnkey-telecom.com<mailto:james.urwiller@turnkey-telecom.com>> wrote: > > we lost belle plaine again, anyone else? > > Sent from my iPhone 7 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io<mailto:jayhanke@southfront.io> Phone 612-204-0000 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 23, 2019

Re: zayo again anyone?

by Jeremy Schmeichel

Been a rough few months for belle plaine… From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Corey Hauer Sent: Thursday, May 23, 2019 12:33 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] zayo again anyone? Happily, our Mankato and Windom feeds (zayo) are still up. Maybe Zayo fixed the protect for Mankato? On Thu, May 23, 2019 at 11:29 AM Jay Hanke <jayhanke(a)southfront.io<mailto:jayhanke@southfront.io>> wrote: I believe there is a cut somewhere just south of 511. On Thu, May 23, 2019 at 1:25 PM James Urwiller <james.urwiller(a)turnkey-telecom.com<mailto:james.urwiller@turnkey-telecom.com>> wrote: > > we lost belle plaine again, anyone else? > > Sent from my iPhone 7 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io<mailto:jayhanke@southfront.io> Phone 612-204-0000 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 23, 2019

Re: zayo again anyone?

by Corey Hauer

Happily, our Mankato and Windom feeds (zayo) are still up. Maybe Zayo fixed the protect for Mankato? On Thu, May 23, 2019 at 11:29 AM Jay Hanke <jayhanke(a)southfront.io> wrote: > I believe there is a cut somewhere just south of 511. > > On Thu, May 23, 2019 at 1:25 PM James Urwiller > <james.urwiller(a)turnkey-telecom.com> wrote: > > > > we lost belle plaine again, anyone else? > > > > Sent from my iPhone 7 > > > > -- > Jay Hanke, President > South Front Networks > jayhanke(a)southfront.io > Phone 612-204-0000 >

May 23, 2019

Re: zayo again anyone?

by Jay Hanke

I believe there is a cut somewhere just south of 511. On Thu, May 23, 2019 at 1:25 PM James Urwiller <james.urwiller(a)turnkey-telecom.com> wrote: > > we lost belle plaine again, anyone else? > > Sent from my iPhone 7 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

May 23, 2019

zayo again anyone?

by James Urwiller

we lost belle plaine again, anyone else? Sent from my iPhone 7

May 23, 2019

Re: Please welcome CarverLink to MICE!

by Doug McIntyre

On Wed, May 22, 2019 at 12:10:47PM -0500, Jay Hanke wrote: >Name: CarverLink (Carver County) >Port: Ethernet 5/29 Main Switch >ASN: 55216 >IPv4: 206.108.255.140/24 >IPv6: 2001:504:27:0:0:d780::1/64 >Peering Contact: rlehs(a)carverlink.com >Route Servers- YES >BFD: NO The route servers are all set for them now as well. Welcome! -- Doug McIntyre <merlyn(a)iphouse.net> ~.~ ipHouse ~.~ Network Engineer/Provisioning/Jack of all Trades

May 22, 2019

NorthernLights Gigapop upgrades 5/25/19 5 am to 5 pm CST

by Colin Murphy

This Saturday 5/25/2019, Gigapop engineers will be performing software and hardware upgrades starting at 5 am and should be complete no later than 5 pm. The software upgrades will happen between 5 am and 7 am. The hardware upgrades will begin around 8 am. During these upgrades, if you have redundant connections to multiple Gigapop routers you should have little to no disruption. If you're single homed, you can expect two, 10 to 15 minute outages. If you have any issues past 5 pm on Saturday, please send an email to help(a)umn.edu with "Gigapop maintenance issues" in the subject line. Thanks, Colin Murphy Sr. Network Engineer Office of Information Technology University of Minnesota Northern Lights Gigapop Desk: 612-626-0870

May 22, 2019

Please welcome CarverLink to MICE!

by Jay Hanke

Name: CarverLink (Carver County) Port: Ethernet 5/29 Main Switch ASN: 55216 IPv4: 206.108.255.140/24 IPv6: 2001:504:27:0:0:d780::1/64 Peering Contact: rlehs(a)carverlink.com Route Servers- YES BFD: NO Please provide your optic to either a tech committee member (Jeremy) or to Cologix when you place your cross connect order! Also, if you haven't already please join the MICE mailing lists at micemn.net Welcome aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

May 22, 2019

Looking for 2 post kits for Arista 7504 and 7508.

by Brandon Mulligan

Greetings MICE, I'm looking for 2 post kits for Arista 7504 and 7508. Asking for a friend. Looking for: 3x 7504 Kits 2x 7508 Kits Contact me off list. Thanks! -- Brandon Mulligan Kansas City Internet eXchange http://kcix.net

May 21, 2019

Re: lost connection

by Frank Bulk

The link I’m using from Belle Plaine to 511 is over MNVoIP’ VPLS link, and so perhaps that did benefit from some redundancy. I did see one more BGP session bounce from 4:40 to ~4:43 am, so I suspect the staggered nature of our different service restoration reflect the fibers and services that were operating over these fibers. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Schmeichel Sent: Wednesday, May 15, 2019 9:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost connection We restored a little after 5AM. Guess it must’ve been a beast of a cut. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Wednesday, May 15, 2019 6:50 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection Mine didn’t till around 5:49, but all is well since then. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Wednesday, May 15, 2019 02:20 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection My BGP sessions came up just before 2:10 am. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jeremy Lumby Sent: Tuesday, May 14, 2019 10:29 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection The latest update from Zayo is: Current update: Construction crews are onsite and prepping to excavate. The general area they have isolated the damage down to shows signs of fresh construction and boring. They have no ETTR at this time but we will provide more information as it becomes available. From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Tuesday, May 14, 2019 7:44 PM To: MICE Discuss Subject: Re: [MICE-DISCUSS] lost connection The latest update I have on my ticket is that Zayo is investigating possible damage to fiber in Eden Prairie. It looks like Justin will get to keep his money that Anthony was betting with. Zayo now has the additional tasks of figuring out why my vpls service did not fail over properly. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com> -------- Original message -------- From: Jeremy Lumby <jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com>> Date: 5/14/19 4:22 PM (GMT-06:00) To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: Re: [MICE-DISCUSS] lost connection ________________________________ From : Jeremy Lumby [jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com>] To : MICE Discuss [MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] Date : Tuesday, May 14 2019 16:22:00 Latest update on my Zayo ticket is that techs are dispatched, and are 1.5 hours away. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Tuesday, May 14, 2019 3:46 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection Probably power then like it was 2 months ago.. man.. 3 outages in 3 months is getting annoying 😉 Thanks for the visibility from your end!! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jay Hanke Sent: Tuesday, May 14, 2019 15:43 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection The whole Zayo remote switch appears to be down. On Tue, May 14, 2019 at 3:42 PM James Urwiller <james.urwiller(a)turnkey-telecom.com<mailto:james.urwiller@turnkey-telecom.com>> wrote: I lost MICE through ZAYO again to belle plain around 15:18 CST. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io<mailto:jayhanke@southfront.io> Phone 612-204-0000 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 15, 2019

Re: lost connection

by Jeremy Lumby

One ticket update said it was a 96 strand cable. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Jeremy Schmeichel Sent: Wednesday, May 15, 2019 9:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost connection We restored a little after 5AM. Guess it must’ve been a beast of a cut. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of James Urwiller Sent: Wednesday, May 15, 2019 6:50 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost connection Mine didn’t till around 5:49, but all is well since then. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Wednesday, May 15, 2019 02:20 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost connection My BGP sessions came up just before 2:10 am. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Tuesday, May 14, 2019 10:29 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost connection The latest update from Zayo is: Current update: Construction crews are onsite and prepping to excavate. The general area they have isolated the damage down to shows signs of fresh construction and boring. They have no ETTR at this time but we will provide more information as it becomes available. From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Tuesday, May 14, 2019 7:44 PM To: MICE Discuss Subject: Re: [MICE-DISCUSS] lost connection The latest update I have on my ticket is that Zayo is investigating possible damage to fiber in Eden Prairie. It looks like Justin will get to keep his money that Anthony was betting with. Zayo now has the additional tasks of figuring out why my vpls service did not fail over properly. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: Jeremy Lumby <jlumby(a)mnvoip.com> Date: 5/14/19 4:22 PM (GMT-06:00) To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection >From : Jeremy Lumby [jlumby(a)mnvoip.com] To : MICE Discuss [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Tuesday, May 14 2019 16:22:00 Latest update on my Zayo ticket is that techs are dispatched, and are 1.5 hours away. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Tuesday, May 14, 2019 3:46 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost connection Probably power then like it was 2 months ago.. man.. 3 outages in 3 months is getting annoying 😉 Thanks for the visibility from your end!! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jay Hanke Sent: Tuesday, May 14, 2019 15:43 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost connection The whole Zayo remote switch appears to be down. On Tue, May 14, 2019 at 3:42 PM James Urwiller <james.urwiller(a)turnkey-telecom.com> wrote: I lost MICE through ZAYO again to belle plain around 15:18 CST. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 15, 2019

Re: lost connection

by Jeremy Schmeichel

We restored a little after 5AM. Guess it must’ve been a beast of a cut. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of James Urwiller Sent: Wednesday, May 15, 2019 6:50 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost connection Mine didn’t till around 5:49, but all is well since then. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Wednesday, May 15, 2019 02:20 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection My BGP sessions came up just before 2:10 am. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jeremy Lumby Sent: Tuesday, May 14, 2019 10:29 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection The latest update from Zayo is: Current update: Construction crews are onsite and prepping to excavate. The general area they have isolated the damage down to shows signs of fresh construction and boring. They have no ETTR at this time but we will provide more information as it becomes available. From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Tuesday, May 14, 2019 7:44 PM To: MICE Discuss Subject: Re: [MICE-DISCUSS] lost connection The latest update I have on my ticket is that Zayo is investigating possible damage to fiber in Eden Prairie. It looks like Justin will get to keep his money that Anthony was betting with. Zayo now has the additional tasks of figuring out why my vpls service did not fail over properly. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com> -------- Original message -------- From: Jeremy Lumby <jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com>> Date: 5/14/19 4:22 PM (GMT-06:00) To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: Re: [MICE-DISCUSS] lost connection ________________________________ From : Jeremy Lumby [jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com>] To : MICE Discuss [MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] Date : Tuesday, May 14 2019 16:22:00 Latest update on my Zayo ticket is that techs are dispatched, and are 1.5 hours away. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Tuesday, May 14, 2019 3:46 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection Probably power then like it was 2 months ago.. man.. 3 outages in 3 months is getting annoying 😉 Thanks for the visibility from your end!! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jay Hanke Sent: Tuesday, May 14, 2019 15:43 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection The whole Zayo remote switch appears to be down. On Tue, May 14, 2019 at 3:42 PM James Urwiller <james.urwiller(a)turnkey-telecom.com<mailto:james.urwiller@turnkey-telecom.com>> wrote: I lost MICE through ZAYO again to belle plain around 15:18 CST. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io<mailto:jayhanke@southfront.io> Phone 612-204-0000 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 15, 2019

Re: lost connection

by James Urwiller

Mine didn’t till around 5:49, but all is well since then. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Wednesday, May 15, 2019 02:20 *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost connection My BGP sessions came up just before 2:10 am. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Jeremy Lumby *Sent:* Tuesday, May 14, 2019 10:29 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost connection The latest update from Zayo is: Current update: Construction crews are onsite and prepping to excavate. The general area they have isolated the damage down to shows signs of fresh construction and boring. They have no ETTR at this time but we will provide more information as it becomes available. *From:* Jeremy Lumby [mailto:jlumby@mnvoip.com <jlumby(a)mnvoip.com>] *Sent:* Tuesday, May 14, 2019 7:44 PM *To:* MICE Discuss *Subject:* Re: [MICE-DISCUSS] lost connection The latest update I have on my ticket is that Zayo is investigating possible damage to fiber in Eden Prairie. It looks like Justin will get to keep his money that Anthony was betting with. Zayo now has the additional tasks of figuring out why my vpls service did not fail over properly. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: Jeremy Lumby <jlumby(a)mnvoip.com> Date: 5/14/19 4:22 PM (GMT-06:00) To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection ------------------------------ *From* : Jeremy Lumby [jlumby(a)mnvoip.com] *To* : MICE Discuss [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] *Date* : Tuesday, May 14 2019 16:22:00 Latest update on my Zayo ticket is that techs are dispatched, and are 1.5 hours away. *From:* MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET <MICE-DISCUSS(a)LISTS.IPHOUSE.NET>] *On Behalf Of *James Urwiller *Sent:* Tuesday, May 14, 2019 3:46 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost connection Probably power then like it was 2 months ago.. man.. 3 outages in 3 months is getting annoying 😉 Thanks for the visibility from your end!! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Jay Hanke *Sent:* Tuesday, May 14, 2019 15:43 *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost connection The whole Zayo remote switch appears to be down. On Tue, May 14, 2019 at 3:42 PM James Urwiller < james.urwiller(a)turnkey-telecom.com> wrote: I lost MICE through ZAYO again to belle plain around 15:18 CST. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000 ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 15, 2019

Re: lost connection

by Frank Bulk

My BGP sessions came up just before 2:10 am. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Tuesday, May 14, 2019 10:29 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost connection The latest update from Zayo is: Current update: Construction crews are onsite and prepping to excavate. The general area they have isolated the damage down to shows signs of fresh construction and boring. They have no ETTR at this time but we will provide more information as it becomes available. From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Tuesday, May 14, 2019 7:44 PM To: MICE Discuss Subject: Re: [MICE-DISCUSS] lost connection The latest update I have on my ticket is that Zayo is investigating possible damage to fiber in Eden Prairie. It looks like Justin will get to keep his money that Anthony was betting with. Zayo now has the additional tasks of figuring out why my vpls service did not fail over properly. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com> -------- Original message -------- From: Jeremy Lumby <jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com>> Date: 5/14/19 4:22 PM (GMT-06:00) To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: Re: [MICE-DISCUSS] lost connection ________________________________ From : Jeremy Lumby [jlumby(a)mnvoip.com] To : MICE Discuss [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Tuesday, May 14 2019 16:22:00 Latest update on my Zayo ticket is that techs are dispatched, and are 1.5 hours away. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Tuesday, May 14, 2019 3:46 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection Probably power then like it was 2 months ago.. man.. 3 outages in 3 months is getting annoying 😉 Thanks for the visibility from your end!! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jay Hanke Sent: Tuesday, May 14, 2019 15:43 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection The whole Zayo remote switch appears to be down. On Tue, May 14, 2019 at 3:42 PM James Urwiller <james.urwiller(a)turnkey-telecom.com<mailto:james.urwiller@turnkey-telecom.com>> wrote: I lost MICE through ZAYO again to belle plain around 15:18 CST. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io<mailto:jayhanke@southfront.io> Phone 612-204-0000 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 15, 2019

Re: lost connection

by Jeremy Lumby

The latest update from Zayo is: Current update: Construction crews are onsite and prepping to excavate. The general area they have isolated the damage down to shows signs of fresh construction and boring. They have no ETTR at this time but we will provide more information as it becomes available. From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Tuesday, May 14, 2019 7:44 PM To: MICE Discuss Subject: Re: [MICE-DISCUSS] lost connection The latest update I have on my ticket is that Zayo is investigating possible damage to fiber in Eden Prairie. It looks like Justin will get to keep his money that Anthony was betting with. Zayo now has the additional tasks of figuring out why my vpls service did not fail over properly. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: Jeremy Lumby <jlumby(a)mnvoip.com> Date: 5/14/19 4:22 PM (GMT-06:00) To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection >From : Jeremy Lumby [jlumby(a)mnvoip.com] To : MICE Discuss [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Tuesday, May 14 2019 16:22:00 Latest update on my Zayo ticket is that techs are dispatched, and are 1.5 hours away. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Tuesday, May 14, 2019 3:46 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost connection Probably power then like it was 2 months ago.. man.. 3 outages in 3 months is getting annoying 😉 Thanks for the visibility from your end!! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jay Hanke Sent: Tuesday, May 14, 2019 15:43 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost connection The whole Zayo remote switch appears to be down. On Tue, May 14, 2019 at 3:42 PM James Urwiller <james.urwiller(a)turnkey-telecom.com> wrote: I lost MICE through ZAYO again to belle plain around 15:18 CST. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 15, 2019

Re: lost connection

by Jeremy Lumby

The latest update I have on my ticket is that Zayo is investigating possible damage to fiber in Eden Prairie. It looks like Justin will get to keep his money that Anthony was betting with. Zayo now has the additional tasks of figuring out why my vpls service did not fail over properly. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: Jeremy Lumby <jlumby(a)mnvoip.com> Date: 5/14/19 4:22 PM (GMT-06:00) To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection _____ >From : Jeremy Lumby [jlumby(a)mnvoip.com] To : MICE Discuss [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Tuesday, May 14 2019 16:22:00 Latest update on my Zayo ticket is that techs are dispatched, and are 1.5 hours away. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Tuesday, May 14, 2019 3:46 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost connection Probably power then like it was 2 months ago.. man.. 3 outages in 3 months is getting annoying 😉 Thanks for the visibility from your end!! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com <mailto:james.urwiller@stealthbroadband.com> stealth300 From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jay Hanke Sent: Tuesday, May 14, 2019 15:43 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost connection The whole Zayo remote switch appears to be down. On Tue, May 14, 2019 at 3:42 PM James Urwiller <james.urwiller(a)turnkey-telecom.com> wrote: I lost MICE through ZAYO again to belle plain around 15:18 CST. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com <mailto:james.urwiller@stealthbroadband.com> stealth300 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 15, 2019

Re: lost connection

by Justin Krejci

Our path from Minneapolis to Belle Plaine is hard down. Our path from Omaha to Belle Plaine is operating fine. -----Original Message----- From: Jeremy Lumby [jlumby(a)MNVOIP.COM] Received: Tuesday, 14 May 2019, 4:11PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Subject: Re: [MICE-DISCUSS] lost connection Justin, Last time the issue was power related @ 511 with Zayo's rack in suite 200, does your connection go through 511? Also I did get an update on my Zayo ticket acknowledging that it is related to a larger outage. Jeremy From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Justin Krejci Sent: Tuesday, May 14, 2019 4:04 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost connection We have equipment in Zayo's Belle Plaine hut that is not down so I think it is likely a fiber cut or similar issue between Belle Plaine and Minneapolis. -----Original Message----- From: Jeremy Lumby [jlumby(a)MNVOIP.COM] Received: Tuesday, 14 May 2019, 3:50PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Subject: Re: [MICE-DISCUSS] lost connection I agree with the possibility that it is a power issue. I have VPLS to the location, and it is down as well. Based on the way it is built it would take a power issue on either of the endpoints to cause it to go down. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Tuesday, May 14, 2019 3:46 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost connection Probably power then like it was 2 months ago.. man.. 3 outages in 3 months is getting annoying ? Thanks for the visibility from your end!! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jay Hanke Sent: Tuesday, May 14, 2019 15:43 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection The whole Zayo remote switch appears to be down. On Tue, May 14, 2019 at 3:42 PM James Urwiller <james.urwiller(a)turnkey-telecom.com<mailto:james.urwiller@turnkey-telecom.com>> wrote: I lost MICE through ZAYO again to belle plain around 15:18 CST. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io<mailto:jayhanke@southfront.io> Phone 612-204-0000 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 14, 2019