- mice-discuss - lists.micemn.net

Re: lost MICE

by David Farmer

A bit of trivia, the fiber cut is right near the highest point in Iowa, Hawkeye Point, just east of the intersection of 130th St and Hy60. It's all downhill from there. :) https://en.wikipedia.org/wiki/Hawkeye_Point On Tue, Jun 11, 2019 at 1:40 PM Frank Bulk <fbulk(a)mypremieronline.com> wrote: > And RFO: > > Reason for Outage Summary: A fiber cut was reported in Sibley IA. Zayo > crews were dispatched out to > > 130th and 140th along highway 60 and repaired the damaged fiber which was > caused by a Drain tile contractor trenched through the cable. All > > Repairs were completed at 1:00 PM CDT. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> * On Behalf Of *Frank > Bulk > *Sent:* Tuesday, June 11, 2019 11:38 AM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > 11:30 am: OSP reported that splicing is complete. Please verify that your > Services have restored. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Tuesday, June 11, 2019 10:44 AM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > 10:33 am: OSP has reported that splicing on the north case is complete. > Splicers working on South case. You should start to see service restore as > splicing continues. A rough ETR is 1 hour. More updates to follow. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Tuesday, June 11, 2019 10:05 AM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > My own link alarm cleared at 9:52 am, so just a hair under 26.5 hours. > > > > From what I heard from our field staff, the issue wasn’t that bad – > looking through the update, it just took Zayo’s staff and/or contractors a > long time to get on site and perform the work. It seems like they had just > one fiber splicing crew, so they didn’t prep and splice on both sides at > the same time. We’ve had similar cuts many times before and we would likely > have this resolved in 6 to 8 hours. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *James > Urwiller > *Sent:* Tuesday, June 11, 2019 9:43 AM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > I would like to Thank Frank for reporting all this info. He is keeping up > with the Zayo ticket responses very well! > > You mentioned this was cut near your area.. was it really that bad to > warrant 24+ hrs? seems like they are pretty slow with these repairs? > > > > James Urwiller > > Network Architect > > Stealth Broadband > > james.urwiller(a)stealthbroadband.com > > [image: stealth300] > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Tuesday, June 11, 2019 07:58 > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > 11:04 pm: Excavation is currently underway at this time. Techs are > trenching out the 200 feet of cable required to make repairs. > > 12:58 am: Underground crews have completed the trench on one side of the > break. OSP splicers have the cable exposed on that side and are prepping > the old cable and the new for repairs. The Underground crew is working to > excavate on the opposite end at this time. No ETTR at this time. > > 2:22 am: OSP crews are still continuing to work at this time. Excavation > crews are continuing to work to expose the remaining fiber to prep for > splicing. No ETTR at this time. > > 3:20 am: At this time the underground crew has completed excavation and > the cable is fully exposed for repairs. Prep work is still ongoing on both > sides. Splicers expect to be splicing on one end of the cable in about 1 > hour. The other side will be spliced once prep work is complete. No ETR at > this time. > > 5:04 am: OSP splicers are continuing the splice at this time. Techs are > prioritizing the active fibers to speed up restoration. No ETTR at this > time. > > 5:57 am: OSP splicers are continue to finish up the splicing on the North > side of the cut. Once complete crews will move to the South side to > complete prep work and begin splicing. We have a tentative ETTR of 10 CST > today. > > 7:07 am: OSP splicers onsite advised they have been a bit delayed on the > splicing at the North side of the cut. Splicers are nearly complete on the > North side, and will be moving to the South to complete prep work and > repairs. Crews have revised the tentative ETTR for 12 CST. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Monday, June 10, 2019 10:47 PM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > 9:26 pm: Emergency locates are nearly complete so the underground > construction crew will be able to start major excavations soon. The crew > will need to trench along 200 feet of the cable path to add in a new > section of fiber. No ETTR at this time. > > > > Frank > > > > *From:* Frank Bulk > *Sent:* Monday, June 10, 2019 9:09 PM > *To:* 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> > *Subject:* RE: [MICE-DISCUSS] lost MICE > > > > 8:19 pm: OSP has reported that Underground crew has arrived on site. They > will begin excavation within the next few minutes. There is no ETTR at this > time. More updates to follow. > > > > Frank > > > > *From:* Frank Bulk > *Sent:* Monday, June 10, 2019 7:15 PM > *To:* 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> > *Subject:* RE: [MICE-DISCUSS] lost MICE > > > > 6:58 pm: No Change in Update. OSP has located the damage between 130th and > 140th along highway 60 in Sibley IA. Looks like land owner or contractor > trenched through the cable. Cable is completely severed. Underground crew > is in route and are trying to get around flooded roads. ETA is 30 mins. > More updates to follow as we receive them. > > > > Frank > > > > *From:* Frank Bulk > *Sent:* Monday, June 10, 2019 6:00 PM > *To:* 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> > *Subject:* RE: [MICE-DISCUSS] lost MICE > > > > 4:47 pm: No Change in Update. OSP has located the damage between 130th and > 140th along highway 60 in Sibley IA. Looks like land owner or contractor > trenched through the cable. Cable is completely severed. Underground crew > is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive > them. > > > > 5:51 pm: No Change in Update. OSP has located the damage between 130th and > 140th along highway 60 in Sibley IA. Looks like land owner or contractor > trenched through the cable. Cable is completely severed. Underground crew > is in route with ETA of 30-45 mins. More updates to follow as we receive > them. > > > > Frank > > > > *From:* Frank Bulk > *Sent:* Monday, June 10, 2019 2:56 PM > *To:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> > *Subject:* RE: [MICE-DISCUSS] lost MICE > > > > 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 > mins. More updates to follow. > > > > Note that the location listed in the ticket is incorrect – I’ve > communicated the correct address (130th and Hwy 60) to Zayo’s NCC and > they’ve acknowledged receipt of that. > > > > If they do get onsite by 3:15 pm it will have been about 10 hours since > the initial cut. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Monday, June 10, 2019 1:24 PM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > 12:35 pm: OSP reported they are trying to get resources to the damage > location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA > or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More > updates to follow. > > 12:43 pm: OSP reported Splicer is in route to the damage location right > off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More > updates to follow. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Monday, June 10, 2019 10:35 AM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > Another update from Zayo: > > > > 10:30 OSP reported they are trying to get resources to the damage > location. Damage appears to be right off of I60 and 170th in Sibley IA. > Currently there is no ETA for techs. More updates to follow. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Monday, June 10, 2019 10:27 AM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > First two updates from Zayo: > > > > 9:48 am: Your case has been associated with a higher level outage ticket, > your ticket number will remain the same. The latest update is as follows: > Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN > affecting multiple customers. The appropriate resources have been engaged > for repairs. At this time, OSP is en route to the suspected trouble > location to begin investigating. No ETA available as of yet. > > > > 10:21 am: Our OSP crews are en route to begin investigations. More updates > to follow. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Monday, June 10, 2019 8:53 AM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy > 60 ( > https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U… > <https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) > in Sibley, Iowa. The tiler called one of our techs and the farmer called > another one of our techs, inquiring if it was our fiber or not (it’s not). > The tiler reported hitting a line below the tape. > > > > I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and > haven’t yet received an acknowledgement, but once I do I will inform them > of the location. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Monday, June 10, 2019 8:06 AM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] lost MICE > > > > Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I > assume it’s an issue between Sioux City and Belle Plaine. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *James > Urwiller > *Sent:* Monday, June 10, 2019 7:58 AM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* [MICE-DISCUSS] lost MICE > > > > I lost MICE again over ZAYO about 30 minutes ago.. anyone else? > > > > James Urwiller > > Network Architect > > Stealth Broadband > > james.urwiller(a)stealthbroadband.com > > [image: stealth300] > > > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

June 11, 2019

Re: lost MICE

by Frank Bulk

And RFO: Reason for Outage Summary: A fiber cut was reported in Sibley IA. Zayo crews were dispatched out to 130th and 140th along highway 60 and repaired the damaged fiber which was caused by a Drain tile contractor trenched through the cable. All Repairs were completed at 1:00 PM CDT. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Tuesday, June 11, 2019 11:38 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost MICE 11:30 am: OSP reported that splicing is complete. Please verify that your Services have restored. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Tuesday, June 11, 2019 10:44 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 10:33 am: OSP has reported that splicing on the north case is complete. Splicers working on South case. You should start to see service restore as splicing continues. A rough ETR is 1 hour. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Tuesday, June 11, 2019 10:05 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE My own link alarm cleared at 9:52 am, so just a hair under 26.5 hours. From what I heard from our field staff, the issue wasn’t that bad – looking through the update, it just took Zayo’s staff and/or contractors a long time to get on site and perform the work. It seems like they had just one fiber splicing crew, so they didn’t prep and splice on both sides at the same time. We’ve had similar cuts many times before and we would likely have this resolved in 6 to 8 hours. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Tuesday, June 11, 2019 9:43 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE I would like to Thank Frank for reporting all this info. He is keeping up with the Zayo ticket responses very well! You mentioned this was cut near your area.. was it really that bad to warrant 24+ hrs? seems like they are pretty slow with these repairs? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Tuesday, June 11, 2019 07:58 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 11:04 pm: Excavation is currently underway at this time. Techs are trenching out the 200 feet of cable required to make repairs. 12:58 am: Underground crews have completed the trench on one side of the break. OSP splicers have the cable exposed on that side and are prepping the old cable and the new for repairs. The Underground crew is working to excavate on the opposite end at this time. No ETTR at this time. 2:22 am: OSP crews are still continuing to work at this time. Excavation crews are continuing to work to expose the remaining fiber to prep for splicing. No ETTR at this time. 3:20 am: At this time the underground crew has completed excavation and the cable is fully exposed for repairs. Prep work is still ongoing on both sides. Splicers expect to be splicing on one end of the cable in about 1 hour. The other side will be spliced once prep work is complete. No ETR at this time. 5:04 am: OSP splicers are continuing the splice at this time. Techs are prioritizing the active fibers to speed up restoration. No ETTR at this time. 5:57 am: OSP splicers are continue to finish up the splicing on the North side of the cut. Once complete crews will move to the South side to complete prep work and begin splicing. We have a tentative ETTR of 10 CST today. 7:07 am: OSP splicers onsite advised they have been a bit delayed on the splicing at the North side of the cut. Splicers are nearly complete on the North side, and will be moving to the South to complete prep work and repairs. Crews have revised the tentative ETTR for 12 CST. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:47 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 9:26 pm: Emergency locates are nearly complete so the underground construction crew will be able to start major excavations soon. The crew will need to trench along 200 feet of the cable path to add in a new section of fiber. No ETTR at this time. Frank From: Frank Bulk Sent: Monday, June 10, 2019 9:09 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 8:19 pm: OSP has reported that Underground crew has arrived on site. They will begin excavation within the next few minutes. There is no ETTR at this time. More updates to follow. Frank From: Frank Bulk Sent: Monday, June 10, 2019 7:15 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 6:00 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 2:56 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 1:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 11, 2019

Re: lost MICE

by Frank Bulk

11:30 am: OSP reported that splicing is complete. Please verify that your Services have restored. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Tuesday, June 11, 2019 10:44 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost MICE 10:33 am: OSP has reported that splicing on the north case is complete. Splicers working on South case. You should start to see service restore as splicing continues. A rough ETR is 1 hour. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Tuesday, June 11, 2019 10:05 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE My own link alarm cleared at 9:52 am, so just a hair under 26.5 hours. From what I heard from our field staff, the issue wasn’t that bad – looking through the update, it just took Zayo’s staff and/or contractors a long time to get on site and perform the work. It seems like they had just one fiber splicing crew, so they didn’t prep and splice on both sides at the same time. We’ve had similar cuts many times before and we would likely have this resolved in 6 to 8 hours. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Tuesday, June 11, 2019 9:43 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE I would like to Thank Frank for reporting all this info. He is keeping up with the Zayo ticket responses very well! You mentioned this was cut near your area.. was it really that bad to warrant 24+ hrs? seems like they are pretty slow with these repairs? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Tuesday, June 11, 2019 07:58 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 11:04 pm: Excavation is currently underway at this time. Techs are trenching out the 200 feet of cable required to make repairs. 12:58 am: Underground crews have completed the trench on one side of the break. OSP splicers have the cable exposed on that side and are prepping the old cable and the new for repairs. The Underground crew is working to excavate on the opposite end at this time. No ETTR at this time. 2:22 am: OSP crews are still continuing to work at this time. Excavation crews are continuing to work to expose the remaining fiber to prep for splicing. No ETTR at this time. 3:20 am: At this time the underground crew has completed excavation and the cable is fully exposed for repairs. Prep work is still ongoing on both sides. Splicers expect to be splicing on one end of the cable in about 1 hour. The other side will be spliced once prep work is complete. No ETR at this time. 5:04 am: OSP splicers are continuing the splice at this time. Techs are prioritizing the active fibers to speed up restoration. No ETTR at this time. 5:57 am: OSP splicers are continue to finish up the splicing on the North side of the cut. Once complete crews will move to the South side to complete prep work and begin splicing. We have a tentative ETTR of 10 CST today. 7:07 am: OSP splicers onsite advised they have been a bit delayed on the splicing at the North side of the cut. Splicers are nearly complete on the North side, and will be moving to the South to complete prep work and repairs. Crews have revised the tentative ETTR for 12 CST. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:47 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 9:26 pm: Emergency locates are nearly complete so the underground construction crew will be able to start major excavations soon. The crew will need to trench along 200 feet of the cable path to add in a new section of fiber. No ETTR at this time. Frank From: Frank Bulk Sent: Monday, June 10, 2019 9:09 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 8:19 pm: OSP has reported that Underground crew has arrived on site. They will begin excavation within the next few minutes. There is no ETTR at this time. More updates to follow. Frank From: Frank Bulk Sent: Monday, June 10, 2019 7:15 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 6:00 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 2:56 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 1:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 11, 2019

Re: lost MICE

by Frank Bulk

10:33 am: OSP has reported that splicing on the north case is complete. Splicers working on South case. You should start to see service restore as splicing continues. A rough ETR is 1 hour. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Tuesday, June 11, 2019 10:05 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost MICE My own link alarm cleared at 9:52 am, so just a hair under 26.5 hours. From what I heard from our field staff, the issue wasn’t that bad – looking through the update, it just took Zayo’s staff and/or contractors a long time to get on site and perform the work. It seems like they had just one fiber splicing crew, so they didn’t prep and splice on both sides at the same time. We’ve had similar cuts many times before and we would likely have this resolved in 6 to 8 hours. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Tuesday, June 11, 2019 9:43 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE I would like to Thank Frank for reporting all this info. He is keeping up with the Zayo ticket responses very well! You mentioned this was cut near your area.. was it really that bad to warrant 24+ hrs? seems like they are pretty slow with these repairs? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Tuesday, June 11, 2019 07:58 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 11:04 pm: Excavation is currently underway at this time. Techs are trenching out the 200 feet of cable required to make repairs. 12:58 am: Underground crews have completed the trench on one side of the break. OSP splicers have the cable exposed on that side and are prepping the old cable and the new for repairs. The Underground crew is working to excavate on the opposite end at this time. No ETTR at this time. 2:22 am: OSP crews are still continuing to work at this time. Excavation crews are continuing to work to expose the remaining fiber to prep for splicing. No ETTR at this time. 3:20 am: At this time the underground crew has completed excavation and the cable is fully exposed for repairs. Prep work is still ongoing on both sides. Splicers expect to be splicing on one end of the cable in about 1 hour. The other side will be spliced once prep work is complete. No ETR at this time. 5:04 am: OSP splicers are continuing the splice at this time. Techs are prioritizing the active fibers to speed up restoration. No ETTR at this time. 5:57 am: OSP splicers are continue to finish up the splicing on the North side of the cut. Once complete crews will move to the South side to complete prep work and begin splicing. We have a tentative ETTR of 10 CST today. 7:07 am: OSP splicers onsite advised they have been a bit delayed on the splicing at the North side of the cut. Splicers are nearly complete on the North side, and will be moving to the South to complete prep work and repairs. Crews have revised the tentative ETTR for 12 CST. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:47 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 9:26 pm: Emergency locates are nearly complete so the underground construction crew will be able to start major excavations soon. The crew will need to trench along 200 feet of the cable path to add in a new section of fiber. No ETTR at this time. Frank From: Frank Bulk Sent: Monday, June 10, 2019 9:09 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 8:19 pm: OSP has reported that Underground crew has arrived on site. They will begin excavation within the next few minutes. There is no ETTR at this time. More updates to follow. Frank From: Frank Bulk Sent: Monday, June 10, 2019 7:15 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 6:00 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 2:56 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 1:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 11, 2019

Re: lost MICE

by Aaron Clark

We have experienced extremely poor responsiveness and very uninformed call center reps on recent fiber outages with Zayo as well. Our circuits were previously part of Neutral Path so I don’t have any previous experience with Zayo to compare to. Thank you Aaron Clark | Vice President – COO *Future Technologies* *www.futuretech.net <www.futuretech.net>* *Office: 402.817.2682x121* *Mobile: 402.770.9251* [image: cid:image001.png@01D36053.05503150] *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Tuesday, June 11, 2019 10:05 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE My own link alarm cleared at 9:52 am, so just a hair under 26.5 hours. >From what I heard from our field staff, the issue wasn’t that bad – looking through the update, it just took Zayo’s staff and/or contractors a long time to get on site and perform the work. It seems like they had just one fiber splicing crew, so they didn’t prep and splice on both sides at the same time. We’ve had similar cuts many times before and we would likely have this resolved in 6 to 8 hours. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *James Urwiller *Sent:* Tuesday, June 11, 2019 9:43 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE I would like to Thank Frank for reporting all this info. He is keeping up with the Zayo ticket responses very well! You mentioned this was cut near your area.. was it really that bad to warrant 24+ hrs? seems like they are pretty slow with these repairs? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Tuesday, June 11, 2019 07:58 *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE 11:04 pm: Excavation is currently underway at this time. Techs are trenching out the 200 feet of cable required to make repairs. 12:58 am: Underground crews have completed the trench on one side of the break. OSP splicers have the cable exposed on that side and are prepping the old cable and the new for repairs. The Underground crew is working to excavate on the opposite end at this time. No ETTR at this time. 2:22 am: OSP crews are still continuing to work at this time. Excavation crews are continuing to work to expose the remaining fiber to prep for splicing. No ETTR at this time. 3:20 am: At this time the underground crew has completed excavation and the cable is fully exposed for repairs. Prep work is still ongoing on both sides. Splicers expect to be splicing on one end of the cable in about 1 hour. The other side will be spliced once prep work is complete. No ETR at this time. 5:04 am: OSP splicers are continuing the splice at this time. Techs are prioritizing the active fibers to speed up restoration. No ETTR at this time. 5:57 am: OSP splicers are continue to finish up the splicing on the North side of the cut. Once complete crews will move to the South side to complete prep work and begin splicing. We have a tentative ETTR of 10 CST today. 7:07 am: OSP splicers onsite advised they have been a bit delayed on the splicing at the North side of the cut. Splicers are nearly complete on the North side, and will be moving to the South to complete prep work and repairs. Crews have revised the tentative ETTR for 12 CST. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 10:47 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE 9:26 pm: Emergency locates are nearly complete so the underground construction crew will be able to start major excavations soon. The crew will need to trench along 200 feet of the cable path to add in a new section of fiber. No ETTR at this time. Frank *From:* Frank Bulk *Sent:* Monday, June 10, 2019 9:09 PM *To:* 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Subject:* RE: [MICE-DISCUSS] lost MICE 8:19 pm: OSP has reported that Underground crew has arrived on site. They will begin excavation within the next few minutes. There is no ETTR at this time. More updates to follow. Frank *From:* Frank Bulk *Sent:* Monday, June 10, 2019 7:15 PM *To:* 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Subject:* RE: [MICE-DISCUSS] lost MICE 6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them. Frank *From:* Frank Bulk *Sent:* Monday, June 10, 2019 6:00 PM *To:* 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Subject:* RE: [MICE-DISCUSS] lost MICE 4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank *From:* Frank Bulk *Sent:* Monday, June 10, 2019 2:56 PM *To:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Subject:* RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 1:24 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 10:35 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 10:27 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 8:53 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 ( https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U… <https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 8:06 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *James Urwiller *Sent:* Monday, June 10, 2019 7:58 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

June 11, 2019

Re: lost MICE

by Frank Bulk

My own link alarm cleared at 9:52 am, so just a hair under 26.5 hours. From what I heard from our field staff, the issue wasn’t that bad – looking through the update, it just took Zayo’s staff and/or contractors a long time to get on site and perform the work. It seems like they had just one fiber splicing crew, so they didn’t prep and splice on both sides at the same time. We’ve had similar cuts many times before and we would likely have this resolved in 6 to 8 hours. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of James Urwiller Sent: Tuesday, June 11, 2019 9:43 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost MICE I would like to Thank Frank for reporting all this info. He is keeping up with the Zayo ticket responses very well! You mentioned this was cut near your area.. was it really that bad to warrant 24+ hrs? seems like they are pretty slow with these repairs? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Tuesday, June 11, 2019 07:58 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 11:04 pm: Excavation is currently underway at this time. Techs are trenching out the 200 feet of cable required to make repairs. 12:58 am: Underground crews have completed the trench on one side of the break. OSP splicers have the cable exposed on that side and are prepping the old cable and the new for repairs. The Underground crew is working to excavate on the opposite end at this time. No ETTR at this time. 2:22 am: OSP crews are still continuing to work at this time. Excavation crews are continuing to work to expose the remaining fiber to prep for splicing. No ETTR at this time. 3:20 am: At this time the underground crew has completed excavation and the cable is fully exposed for repairs. Prep work is still ongoing on both sides. Splicers expect to be splicing on one end of the cable in about 1 hour. The other side will be spliced once prep work is complete. No ETR at this time. 5:04 am: OSP splicers are continuing the splice at this time. Techs are prioritizing the active fibers to speed up restoration. No ETTR at this time. 5:57 am: OSP splicers are continue to finish up the splicing on the North side of the cut. Once complete crews will move to the South side to complete prep work and begin splicing. We have a tentative ETTR of 10 CST today. 7:07 am: OSP splicers onsite advised they have been a bit delayed on the splicing at the North side of the cut. Splicers are nearly complete on the North side, and will be moving to the South to complete prep work and repairs. Crews have revised the tentative ETTR for 12 CST. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:47 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 9:26 pm: Emergency locates are nearly complete so the underground construction crew will be able to start major excavations soon. The crew will need to trench along 200 feet of the cable path to add in a new section of fiber. No ETTR at this time. Frank From: Frank Bulk Sent: Monday, June 10, 2019 9:09 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 8:19 pm: OSP has reported that Underground crew has arrived on site. They will begin excavation within the next few minutes. There is no ETTR at this time. More updates to follow. Frank From: Frank Bulk Sent: Monday, June 10, 2019 7:15 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 6:00 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 2:56 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 1:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 11, 2019

Re: lost MICE

by James Urwiller

I would like to Thank Frank for reporting all this info. He is keeping up with the Zayo ticket responses very well! You mentioned this was cut near your area.. was it really that bad to warrant 24+ hrs? seems like they are pretty slow with these repairs? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Tuesday, June 11, 2019 07:58 *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE 11:04 pm: Excavation is currently underway at this time. Techs are trenching out the 200 feet of cable required to make repairs. 12:58 am: Underground crews have completed the trench on one side of the break. OSP splicers have the cable exposed on that side and are prepping the old cable and the new for repairs. The Underground crew is working to excavate on the opposite end at this time. No ETTR at this time. 2:22 am: OSP crews are still continuing to work at this time. Excavation crews are continuing to work to expose the remaining fiber to prep for splicing. No ETTR at this time. 3:20 am: At this time the underground crew has completed excavation and the cable is fully exposed for repairs. Prep work is still ongoing on both sides. Splicers expect to be splicing on one end of the cable in about 1 hour. The other side will be spliced once prep work is complete. No ETR at this time. 5:04 am: OSP splicers are continuing the splice at this time. Techs are prioritizing the active fibers to speed up restoration. No ETTR at this time. 5:57 am: OSP splicers are continue to finish up the splicing on the North side of the cut. Once complete crews will move to the South side to complete prep work and begin splicing. We have a tentative ETTR of 10 CST today. 7:07 am: OSP splicers onsite advised they have been a bit delayed on the splicing at the North side of the cut. Splicers are nearly complete on the North side, and will be moving to the South to complete prep work and repairs. Crews have revised the tentative ETTR for 12 CST. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 10:47 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE 9:26 pm: Emergency locates are nearly complete so the underground construction crew will be able to start major excavations soon. The crew will need to trench along 200 feet of the cable path to add in a new section of fiber. No ETTR at this time. Frank *From:* Frank Bulk *Sent:* Monday, June 10, 2019 9:09 PM *To:* 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Subject:* RE: [MICE-DISCUSS] lost MICE 8:19 pm: OSP has reported that Underground crew has arrived on site. They will begin excavation within the next few minutes. There is no ETTR at this time. More updates to follow. Frank *From:* Frank Bulk *Sent:* Monday, June 10, 2019 7:15 PM *To:* 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Subject:* RE: [MICE-DISCUSS] lost MICE 6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them. Frank *From:* Frank Bulk *Sent:* Monday, June 10, 2019 6:00 PM *To:* 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Subject:* RE: [MICE-DISCUSS] lost MICE 4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank *From:* Frank Bulk *Sent:* Monday, June 10, 2019 2:56 PM *To:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Subject:* RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 1:24 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 10:35 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 10:27 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 8:53 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 ( https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U… <https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, June 10, 2019 8:06 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *James Urwiller *Sent:* Monday, June 10, 2019 7:58 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

June 11, 2019

Re: lost MICE

by Frank Bulk

11:04 pm: Excavation is currently underway at this time. Techs are trenching out the 200 feet of cable required to make repairs. 12:58 am: Underground crews have completed the trench on one side of the break. OSP splicers have the cable exposed on that side and are prepping the old cable and the new for repairs. The Underground crew is working to excavate on the opposite end at this time. No ETTR at this time. 2:22 am: OSP crews are still continuing to work at this time. Excavation crews are continuing to work to expose the remaining fiber to prep for splicing. No ETTR at this time. 3:20 am: At this time the underground crew has completed excavation and the cable is fully exposed for repairs. Prep work is still ongoing on both sides. Splicers expect to be splicing on one end of the cable in about 1 hour. The other side will be spliced once prep work is complete. No ETR at this time. 5:04 am: OSP splicers are continuing the splice at this time. Techs are prioritizing the active fibers to speed up restoration. No ETTR at this time. 5:57 am: OSP splicers are continue to finish up the splicing on the North side of the cut. Once complete crews will move to the South side to complete prep work and begin splicing. We have a tentative ETTR of 10 CST today. 7:07 am: OSP splicers onsite advised they have been a bit delayed on the splicing at the North side of the cut. Splicers are nearly complete on the North side, and will be moving to the South to complete prep work and repairs. Crews have revised the tentative ETTR for 12 CST. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:47 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost MICE 9:26 pm: Emergency locates are nearly complete so the underground construction crew will be able to start major excavations soon. The crew will need to trench along 200 feet of the cable path to add in a new section of fiber. No ETTR at this time. Frank From: Frank Bulk Sent: Monday, June 10, 2019 9:09 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 8:19 pm: OSP has reported that Underground crew has arrived on site. They will begin excavation within the next few minutes. There is no ETTR at this time. More updates to follow. Frank From: Frank Bulk Sent: Monday, June 10, 2019 7:15 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 6:00 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 2:56 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 1:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 11, 2019

Re: lost MICE

by Frank Bulk

9:26 pm: Emergency locates are nearly complete so the underground construction crew will be able to start major excavations soon. The crew will need to trench along 200 feet of the cable path to add in a new section of fiber. No ETTR at this time. Frank From: Frank Bulk Sent: Monday, June 10, 2019 9:09 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] lost MICE 8:19 pm: OSP has reported that Underground crew has arrived on site. They will begin excavation within the next few minutes. There is no ETTR at this time. More updates to follow. Frank From: Frank Bulk Sent: Monday, June 10, 2019 7:15 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 6:00 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 2:56 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 1:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 11, 2019

Re: lost MICE

by Frank Bulk

8:19 pm: OSP has reported that Underground crew has arrived on site. They will begin excavation within the next few minutes. There is no ETTR at this time. More updates to follow. Frank From: Frank Bulk Sent: Monday, June 10, 2019 7:15 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] lost MICE 6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 6:00 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 2:56 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 1:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 11, 2019

Re: lost MICE

by Frank Bulk

6:58 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route and are trying to get around flooded roads. ETA is 30 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 6:00 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] lost MICE 4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 2:56 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 1:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 11, 2019

Re: lost MICE

by Frank Bulk

4:47 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 2 - 2.5 hours. More updates to follow as we receive them. 5:51 pm: No Change in Update. OSP has located the damage between 130th and 140th along highway 60 in Sibley IA. Looks like land owner or contractor trenched through the cable. Cable is completely severed. Underground crew is in route with ETA of 30-45 mins. More updates to follow as we receive them. Frank From: Frank Bulk Sent: Monday, June 10, 2019 2:56 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] lost MICE 2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 1:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 10, 2019

Re: lost MICE

by Frank Bulk

2:42 pm: OSP has reported that splicer is in route and has a ETA of 30 mins. More updates to follow. Note that the location listed in the ticket is incorrect – I’ve communicated the correct address (130th and Hwy 60) to Zayo’s NCC and they’ve acknowledged receipt of that. If they do get onsite by 3:15 pm it will have been about 10 hours since the initial cut. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 1:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost MICE 12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 10, 2019

Re: lost MICE

by Frank Bulk

12:35 pm: OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. ETA or 2.5 hours at 10:58 AM CDT, so splicers should be on-site shortly. More updates to follow. 12:43 pm: OSP reported Splicer is in route to the damage location right off of I60 and 170th in Sibley IA. ETA is approximately 1.5 hrs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:35 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost MICE Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 10, 2019

Re: lost MICE

by Frank Bulk

Another update from Zayo: 10:30 OSP reported they are trying to get resources to the damage location. Damage appears to be right off of I60 and 170th in Sibley IA. Currently there is no ETA for techs. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 10:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost MICE First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 10, 2019

Re: lost MICE

by Frank Bulk

First two updates from Zayo: 9:48 am: Your case has been associated with a higher level outage ticket, your ticket number will remain the same. The latest update is as follows: Zayo is experiencing a network event between SIOUX CITY, IA and MANKATO MN affecting multiple customers. The appropriate resources have been engaged for repairs. At this time, OSP is en route to the suspected trouble location to begin investigating. No ETA available as of yet. 10:21 am: Our OSP crews are en route to begin investigations. More updates to follow. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost MICE Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…<https://urldefense.proofpoint.com/v2/url?u=https-3A__www.google.com_maps-3F…>) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 10, 2019

Re: lost MICE

by Frank Bulk

Turns out that the fiber got hit by a tiler in our area, by 130th and Hwy 60 (https://www.google.com/maps?q=hwy+60+and+130th,+sibley&rlz=1C1GCEU_enUS814U…) in Sibley, Iowa. The tiler called one of our techs and the farmer called another one of our techs, inquiring if it was our fiber or not (it’s not). The tiler reported hitting a line below the tape. I opened a ticket with Zayo’s NCC email address about 35 minutes ago, and haven’t yet received an acknowledgement, but once I do I will inform them of the location. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, June 10, 2019 8:06 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost MICE Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 10, 2019

Re: lost MICE

by Frank Bulk

Yes, same thing, between 7:25 and 7:26 am our 10G link went down. I assume it’s an issue between Sioux City and Belle Plaine. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of James Urwiller Sent: Monday, June 10, 2019 7:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] lost MICE I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

June 10, 2019

lost MICE

by James Urwiller

I lost MICE again over ZAYO about 30 minutes ago.. anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300]

June 10, 2019

Re: MAC address limit

by Jeremy Lumby

I am not proposing it for the core, and do not have plans of proposing it in the future. However if someone else wants to propose it, I would definitely be in favor of it. The main reason for the proposal with respect to my extension switch is to standardize it with all of the other internet exchanges that I offer, and I wanted to make sure that MICE would not have an issue with my extension being more restrictive then the core is (and therefore not matching the MICE standards). It also is partially because it makes me sleep better at night knowing that my extension switch is a little less likely to participate in accidentally dumping a bunch of garbage traffic onto the exchange causing problems for everyone else. To me that is much more important than the little additional effort that is required when someone swaps a router out. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: Richard Laager <rlaager(a)WIKTEL.COM> Date: 6/8/19 7:25 PM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MAC address limit _____ >From : Richard Laager [rlaager(a)WIKTEL.COM] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Saturday, June 8 2019 19:28:11 On 6/8/19 11:03 AM, Jeremy Lumby wrote: > With that being said, I would like to start a discussion about lowering > the maximum MAC address limit to 1 with respect to the MICE extension > switch that I operate. That seems perfectly reasonable to me. Is this a trial run for eventually proposing the same change MICE-wide? I don't have strong feelings, but that seems fine too. -- Richard

June 9, 2019

Re: MAC address limit

by Richard Laager

On 6/8/19 11:03 AM, Jeremy Lumby wrote: > With that being said, I would like to start a discussion about lowering > the maximum MAC address limit to 1 with respect to the MICE extension > switch that I operate. That seems perfectly reasonable to me. Is this a trial run for eventually proposing the same change MICE-wide? I don't have strong feelings, but that seems fine too. -- Richard

June 9, 2019

Re: MAC address limit

by Jeff Wilde

I agree with this also Jdw Please excuse typos as this was sent from smart phone -------- Original message -------- From: Andrew Hoyos <hoyosa(a)GMAIL.COM> Date: 6/8/19 12:17 PM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MAC address limit I’m a fan of 1 per port unless documented exception. -- Andrew Hoyos hoyosa(a)gmail.com<mailto:hoyosa@gmail.com> On Jun 8, 2019, at 11:03 AM, Jeremy Lumby <jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com>> wrote: I wanted to start a discussion about the MAC address limit that MICE has as a standard limit of 5 per port. If I remember correctly, the history behind it ended up being that 5 MAC addresses was chosen as a happy middle ground to make router swaps by end users much easier on the end user, as well as the MICE tech committee. As someone that runs extension switches for 3 exchanges in addition to MICE, all of the other IXes have a 1 MAC address limit per port. I have found that maintaining these was not nearly as difficult as the original concern that was expressed at the MICE UG that lead to a limit of 5. With that being said, I would like to start a discussion about lowering the maximum MAC address limit to 1 with respect to the MICE extension switch that I operate. I feel that the benefits outnumber the risks, and with the experiences from the other 3 IXes, I do not think that the extra effort I will need to put in would be significant. Just to state the obvious, the South Front extension switch uplink that is connected to my extension would be a permanent exception, and short term exceptions would be permitted ahead of a router swap. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

June 8, 2019

Re: MAC address limit

by Andrew Hoyos

I’m a fan of 1 per port unless documented exception. -- Andrew Hoyos hoyosa(a)gmail.com > On Jun 8, 2019, at 11:03 AM, Jeremy Lumby <jlumby(a)mnvoip.com> wrote: > > I wanted to start a discussion about the MAC address limit that MICE has as a standard limit of 5 per port. If I remember correctly, the history behind it ended up being that 5 MAC addresses was chosen as a happy middle ground to make router swaps by end users much easier on the end user, as well as the MICE tech committee. As someone that runs extension switches for 3 exchanges in addition to MICE, all of the other IXes have a 1 MAC address limit per port. I have found that maintaining these was not nearly as difficult as the original concern that was expressed at the MICE UG that lead to a limit of 5. With that being said, I would like to start a discussion about lowering the maximum MAC address limit to 1 with respect to the MICE extension switch that I operate. I feel that the benefits outnumber the risks, and with the experiences from the other 3 IXes, I do not think that the extra effort I will need to put in would be significant. Just to state the obvious, the South Front extension switch uplink that is connected to my extension would be a permanent exception, and short term exceptions would be permitted ahead of a router swap. > > Jeremy Lumby > Minnesota VoIP > 9217 17th Ave S #216 > Bloomington, MN 55425 > M: 612-355-7740 > D: 612-392-6814 > F: 952-873-7425 > jlumby(a)mnvoip.com > > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

June 8, 2019

MAC address limit

by Jeremy Lumby

I wanted to start a discussion about the MAC address limit that MICE has as a standard limit of 5 per port. If I remember correctly, the history behind it ended up being that 5 MAC addresses was chosen as a happy middle ground to make router swaps by end users much easier on the end user, as well as the MICE tech committee. As someone that runs extension switches for 3 exchanges in addition to MICE, all of the other IXes have a 1 MAC address limit per port. I have found that maintaining these was not nearly as difficult as the original concern that was expressed at the MICE UG that lead to a limit of 5. With that being said, I would like to start a discussion about lowering the maximum MAC address limit to 1 with respect to the MICE extension switch that I operate. I feel that the benefits outnumber the risks, and with the experiences from the other 3 IXes, I do not think that the extra effort I will need to put in would be significant. Just to state the obvious, the South Front extension switch uplink that is connected to my extension would be a permanent exception, and short term exceptions would be permitted ahead of a router swap. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com

June 8, 2019

FW: Fiber cut possibly along I-90/94 corridor in WI

by Frank Bulk

FYI From: Outages <outages-bounces(a)outages.org> On Behalf Of Jeremy Charles via Outages Sent: Wednesday, June 05, 2019 10:36 AM To: outages(a)outages.org Subject: [outages] Fiber cut possibly along I-90/94 corridor in WI We lost a couple (unprotected) circuits with Wisconsin Independent Network at about 9:50 CDT this morning, running from Verona WI to Rochester MN and MSP. One of our team members called WIN's NMC and the tech who answered said his phones just started lighting up like Christmas trees and their network engineers were beginning the troubleshooting process. I'm pretty sure our two circuits are groomed along the I-90/94 corridor between Madison and Tomah, and then they split to follow 90 and 94 separately. If this is a fiber cut in that area, it's likely to impact a number of carriers. Obviously, it was too early for WIN to give us a diagnosis and ETR at this point. They're pretty good about sending updates when they've got info to share. Anyone else seeing impact? == Jeremy Charles Epic's Computer and Technology Services Division (CatNet) jcharles(a)epic.com<mailto:jcharles@epic.com> 608-271-9000

June 5, 2019