- mice-discuss - lists.micemn.net

Re: Anyone else see their Zayo-based link to MICE go down?

by Justin Krejci

Does Zayo just not mark their fibers? This seems like an overly excessive amount of cut Zayo fibers over the last 24 months. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Jeff Dahna <jeff.dahna(a)WINDOMMN.COM> Sent: Wednesday, September 25, 2019 1:52 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else see their Zayo-based link to MICE go down? Zayo ticket update: Wed 9/25/2019 1:31 PM Current update, Zayo OSP is on site searching for the damage, Splicers will be on site in 1 hour, Underground construction team is on site with dig equipment and Trailer with conduit and fiber expected in 90 minutes We apologize for any inconveniences and delays along the way and will continue to work towards resolution and provide updates as they are available. Regards Joshua Johnson NCC Technician (Fiber & Facilities) | Zayo Group

Sept. 25, 2019

Re: Anyone else see their Zayo-based link to MICE go down?

by Jeff Dahna

Zayo ticket update: Wed 9/25/2019 1:31 PM Current update, Zayo OSP is on site searching for the damage, Splicers will be on site in 1 hour, Underground construction team is on site with dig equipment and Trailer with conduit and fiber expected in 90 minutes We apologize for any inconveniences and delays along the way and will continue to work towards resolution and provide updates as they are available. Regards Joshua Johnson NCC Technician (Fiber & Facilities) | Zayo Group

Sept. 25, 2019

Re: Anyone else see their Zayo-based link to MICE go down?

by Frank Bulk

Interesting, mine was slightly different and less specific. 11:51 am Current Update: ZAYO is currently investigating a possible fiber cut near Worthington, MN. Zayo OSP and Splice crews are currently dispatching to Worthington, MN as this looks to be the location of the cut. We apologize for this inconvenience and ZAYO will continue to provide updates throughout resolution. 1:31 pm Current update, Zayo OSP is on site searching for the damage, Splicers will be on site in 1 hour, Underground construction team is on site with dig equipment and Trailer with conduit and fiber expected in 90 minutes We apologize for any inconveniences and delays along the way and will continue to work towards resolution and provide updates as they are available. -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeff Dahna Sent: Wednesday, September 25, 2019 11:44 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else see their Zayo-based link to MICE go down? Zayo Ticket update:Current update, Zayo crews are currently dispatching to County Rd 35 near Roberts Ave Worthington, MN as this looks to be the location of the cut, OSP is en route and splice teams are also being dispatched. We apologize for any inconveniences and delays along the way and will continue to work towards resolution and provide updates as they are available. Regards Joshua Johnson NCC Technician (Fiber & Facilities) | Zayo Group

Sept. 25, 2019

Re: Anyone else see their Zayo-based link to MICE go down?

by Jeff Dahna

Zayo Ticket update:Current update, Zayo crews are currently dispatching to County Rd 35 near Roberts Ave Worthington, MN as this looks to be the location of the cut, OSP is en route and splice teams are also being dispatched. We apologize for any inconveniences and delays along the way and will continue to work towards resolution and provide updates as they are available. Regards Joshua Johnson NCC Technician (Fiber & Facilities) | Zayo Group

Sept. 25, 2019

Re: Anyone else see their Zayo-based link to MICE go down?

by Jeff Dahna

Our Zayo ticket case comments from Zayo: Wed 9/25/2019 9:51AM Your case has been associated to a higher level outage in the Zayo network affecting MN please standby for further updates Wed 9/25/2019 10:51AM Issues are still currently under investigation with our field teams

Sept. 25, 2019

Re: Anyone else see their Zayo-based link to MICE go down?

by Darin Steffl

Why do they take so long to look at the ticket? Can't you open the ticket then immediately call them and get it escalated right away? On Wed, Sep 25, 2019, 11:11 AM Frank Bulk <fbulk(a)mypremieronline.com> wrote: > Just received acknowledgement of the ticket at 10:56 am. > > Frank > > -----Original Message----- > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank > Bulk > Sent: Wednesday, September 25, 2019 9:55 AM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] Anyone else see their Zayo-based link to MICE > go down? > > That's very generous of you, Jeff. > > I've had no response from Zayo on the ticket I've submitted. > > Frank > > -----Original Message----- > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeff > Dahna > Sent: Wednesday, September 25, 2019 9:16 AM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] Anyone else see their Zayo-based link to MICE > go down? > > We show on graphing that Zayo is down hard to Omaha from Windom at 8:10am. > Put a ticket in with Zayo and offered to OTDR from Windom south towards > Omaha. > > Jeff Dahna > Windomnet > >

Sept. 25, 2019

Re: Anyone else see their Zayo-based link to MICE go down?

by Frank Bulk

Just received acknowledgement of the ticket at 10:56 am. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Wednesday, September 25, 2019 9:55 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else see their Zayo-based link to MICE go down? That's very generous of you, Jeff. I've had no response from Zayo on the ticket I've submitted. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeff Dahna Sent: Wednesday, September 25, 2019 9:16 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else see their Zayo-based link to MICE go down? We show on graphing that Zayo is down hard to Omaha from Windom at 8:10am. Put a ticket in with Zayo and offered to OTDR from Windom south towards Omaha. Jeff Dahna Windomnet

Sept. 25, 2019

Re: Anyone else see their Zayo-based link to MICE go down?

by Jeff Dahna

I received word from another company on the Zayo Omaha route, that Zayo thinks it is a possible fiber cut in the Worthington, MN area. Zayo fiber crew going to investigate.

Sept. 25, 2019

Re: Anyone else see their Zayo-based link to MICE go down?

by Jeff Dahna

We cannot see the port at Bigelow, MN Zayo hut. So I'd say it is between Windom and Bigelow. Fiber cut or equipment failure/fat finger. Jeff Dahna Windomnet

Sept. 25, 2019

Re: Anyone else see their Zayo-based link to MICE go down?

by Frank Bulk

That's very generous of you, Jeff. I've had no response from Zayo on the ticket I've submitted. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeff Dahna Sent: Wednesday, September 25, 2019 9:16 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else see their Zayo-based link to MICE go down? We show on graphing that Zayo is down hard to Omaha from Windom at 8:10am. Put a ticket in with Zayo and offered to OTDR from Windom south towards Omaha. Jeff Dahna Windomnet

Sept. 25, 2019

Re: Anyone else see their Zayo-based link to MICE go down?

by Jeff Dahna

We show on graphing that Zayo is down hard to Omaha from Windom at 8:10am. Put a ticket in with Zayo and offered to OTDR from Windom south towards Omaha. Jeff Dahna Windomnet

Sept. 25, 2019

Re: Anyone else see their Zayo-based link to MICE go down?

by James Urwiller

Yes I am down here as well. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Wednesday, September 25, 2019 08:26 *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] Anyone else see their Zayo-based link to MICE go down? Jeremy sees my link to him in Belle Plaine being down, so likely something between Belle Plaine and northwest Iowa. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Wednesday, September 25, 2019 8:16 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* [MICE-DISCUSS] Anyone else see their Zayo-based link to MICE go down? Our 10G dropped at 8:10 am. Frank ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Sept. 25, 2019

Re: Anyone else see their Zayo-based link to MICE go down?

by Frank Bulk

Jeremy sees my link to him in Belle Plaine being down, so likely something between Belle Plaine and northwest Iowa. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Wednesday, September 25, 2019 8:16 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Anyone else see their Zayo-based link to MICE go down? Our 10G dropped at 8:10 am. Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

Sept. 25, 2019

Re: Anyone else see their Zayo-based link to MICE go down?

by Eric Gengler

Same here. Eric From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Wednesday, September 25, 2019 8:16 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: ADV: [MICE-DISCUSS] Anyone else see their Zayo-based link to MICE go down? Our 10G dropped at 8:10 am. Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Sept. 25, 2019

Re: Anyone else see their Zayo-based link to MICE go down?

by Mike Horwath

On Wed, Sep 25, 2019 at 08:17:58AM -0500, Dean Bahls wrote: > Based on past performance, I predict an 8:15pm restoration of services. which day? > (Sorry, couldn't resist) me either. I'm just bad.. -- Mike Horwath, reachable via drechsau(a)Geeks.ORG

Sept. 25, 2019

Re: Anyone else see their Zayo-based link to MICE go down?

by Tim Fjeld

Our link from Windom to Omaha IX is down at 8:10 Tim Fjeld City of Windom Telecom From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Wednesday, September 25, 2019 8:16 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: ADV: [MICE-DISCUSS] Anyone else see their Zayo-based link to MICE go down? Our 10G dropped at 8:10 am. Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Sept. 25, 2019

Re: Anyone else see their Zayo-based link to MICE go down?

by Dean Bahls

Based on past performance, I predict an 8:15pm restoration of services. (Sorry, couldn't resist) Dean From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Wednesday, September 25, 2019 8:16 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Anyone else see their Zayo-based link to MICE go down? Our 10G dropped at 8:10 am. Frank _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> &A=1

Sept. 25, 2019

Anyone else see their Zayo-based link to MICE go down?

by Frank Bulk

Our 10G dropped at 8:10 am. Frank

Sept. 25, 2019

Re: Anyone else down to Belle Plain since 3:45 pm?

by Jeremy Lumby

Sounds like my experiences with Zayo. I wonder if any smaller network that does not have a dedicated legal team, or does tons of business with Zayo to have significant leverage ever gets anything out of them. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Monday, September 23, 2019 10:29 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Frank, I made a list of 2019 outages and showed how I only had a single clean month (July) and they are taking their time with it, at least you got a response 😉 James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, September 23, 2019 21:54 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? My credit request to Zayo for the September 9 event was rejected – they claimed force majeure. I’m ask again. =) Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Darin Steffl Sent: Tuesday, September 10, 2019 9:18 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? That's pretty sad. So they already had a fiber crew on site and it still took many hours to fix it. Maybe they didn't have a splicer there but it's still bad to see how long it took when they knew the exact location of the cut since they caused it. On Tue, Sep 10, 2019, 9:15 AM Frank Bulk <fbulk(a)mypremieronline.com> wrote: >From our OSP supervisor: …this was cut by Zayo’s own contractor who was working on moving their fiber. Frank From: Frank Bulk Sent: Tuesday, September 10, 2019 8:17 AM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? >From our field tech: I think the contractor Zayo hired to move the fiber for the Hwy. 75 reconstruction hit the fiber. I'm assuming Vannguard's locates were off. Frank From: Frank Bulk Sent: Tuesday, September 10, 2019 7:28 AM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? My own link was up at 1:41 am Last update I received from Zayo was at 3:46 am: Current Update: OSP techs have completed splicing on all active fibers at this time. All services should be restored. Please advise if you are still experiencing issues. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 11:43 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Another update at 11:25pm: Current Update: Replacement fiber and splicers are onsite at this time. Techs will be prepping the cables for splicing soon. ETR at this time is 5 hours. More updates to follow. So basically it should be up by 5 am or so. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 10:18 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Another update at 10:09 pm: Current Update: Our OSP reported that the repair crew are running a little behind the 2 hour ETA provided earlier and have noted the are still about 50 minutes from the damage area. So they will arrive around 11 pm, about 7h 15m from the start of the outage. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 8:30 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? More detail in Zayo’s last update at 8:08 pm We apologize for the delayed update. We've spoken with our OSP PM and have been advised that the splice crew's ETA to the site is still about 1 to 1.5 hours and the ETTR is 4.5 to 5 hours. The damage was caused by a construction crew and the damage area is south of Hinton, IA around County Rd 60 and Iowa State Rd 75. Additional information to follow once the splice crew is on site. So it does seem related to the Hwy 75 re-construction project. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Justin Krejci Sent: Monday, September 9, 2019 6:13 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? I heard it is out somewhere between Sioux City and Alton, so it definitely could be that IDOT construction zone. We don't have growing pains we have Zayo pains. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Frank Bulk <fbulk(a)MYPREMIERONLINE.COM> Sent: Monday, September 9, 2019 4:37 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Could be part of the Hwy 75 project: https://siouxcityjournal.com/news/local/idot-to-close-us-highway-during-nig… Our OSP staff said that Zayo was the laggard on the required moves. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of AnthonyAnderberg(a)nuvera.net Sent: Monday, September 09, 2019 4:21 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? We've got a link in NW Iowa down as well, we're on the same (former Neutral Path) link as you guys to Sioux City - so it's someplace between Sioux City, IA and Windom, MN. On 9/9/19, 4:02 PM, "MICE Discuss on behalf of James Urwiller" <MICE-DISCUSS(a)LISTS.IPHOUSE.NET on behalf of james.urwiller(a)TURNKEY-TELECOM.COM> wrote: YES SIR! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 16:02 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Bounce and then down. Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine via WIT for MICE Frank To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Sept. 24, 2019

Re: Anyone else down to Belle Plain since 3:45 pm?

by James Urwiller

Frank, I made a list of 2019 outages and showed how I only had a single clean month (July) and they are taking their time with it, at least you got a response 😉 James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, September 23, 2019 21:54 *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? My credit request to Zayo for the September 9 event was rejected – they claimed force majeure. I’m ask again. =) Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Darin Steffl *Sent:* Tuesday, September 10, 2019 9:18 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? That's pretty sad. So they already had a fiber crew on site and it still took many hours to fix it. Maybe they didn't have a splicer there but it's still bad to see how long it took when they knew the exact location of the cut since they caused it. On Tue, Sep 10, 2019, 9:15 AM Frank Bulk <fbulk(a)mypremieronline.com> wrote: >From our OSP supervisor: *…this was cut by Zayo’s own contractor who was working on moving their fiber.* Frank *From:* Frank Bulk *Sent:* Tuesday, September 10, 2019 8:17 AM *To:* 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Subject:* RE: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? >From our field tech: *I think the contractor Zayo hired to move the fiber for the Hwy. 75 reconstruction hit the fiber. I'm assuming Vannguard's locates were off.* Frank *From:* Frank Bulk *Sent:* Tuesday, September 10, 2019 7:28 AM *To:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Subject:* RE: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? My own link was up at 1:41 am Last update I received from Zayo was at 3:46 am: *Current Update: OSP techs have completed splicing on all active fibers at this time. All services should be restored. Please advise if you are still experiencing issues.* Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, September 9, 2019 11:43 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Another update at 11:25pm: *Current Update: Replacement fiber and splicers are onsite at this time. Techs will be prepping the cables for splicing soon. ETR at this time is 5 hours. More updates to follow.* So basically it should be up by 5 am or so. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, September 9, 2019 10:18 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Another update at 10:09 pm: *Current Update: Our OSP reported that the repair crew are running a little behind the 2 hour ETA provided earlier and have noted the are still about 50 minutes from the damage area.* So they will arrive around 11 pm, about 7h 15m from the start of the outage. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, September 9, 2019 8:30 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? More detail in Zayo’s last update at 8:08 pm *We apologize for the delayed update. We've spoken with our OSP PM and have been advised that the splice crew's ETA to the site is still about 1 to 1.5 hours and the ETTR is 4.5 to 5 hours. The damage was caused by a construction crew and the damage area is south of Hinton, IA around County Rd 60 and Iowa State Rd 75. Additional information to follow once the splice crew is on site.* So it does seem related to the Hwy 75 re-construction project. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Justin Krejci *Sent:* Monday, September 9, 2019 6:13 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? I heard it is out somewhere between Sioux City and Alton, so it definitely could be that IDOT construction zone. We don't have growing pains we have Zayo pains. ------------------------------ *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Frank Bulk <fbulk(a)MYPREMIERONLINE.COM> *Sent:* Monday, September 9, 2019 4:37 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Could be part of the Hwy 75 project: https://siouxcityjournal.com/news/local/idot-to-close-us-highway-during-nig… <https://urldefense.proofpoint.com/v2/url?u=https-3A__siouxcityjournal.com_n…> Our OSP staff said that Zayo was the laggard on the required moves. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of AnthonyAnderberg(a)nuvera.net Sent: Monday, September 09, 2019 4:21 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? We've got a link in NW Iowa down as well, we're on the same (former Neutral Path) link as you guys to Sioux City - so it's someplace between Sioux City, IA and Windom, MN. On 9/9/19, 4:02 PM, "MICE Discuss on behalf of James Urwiller" <MICE-DISCUSS(a)LISTS.IPHOUSE.NET on behalf of james.urwiller(a)TURNKEY-TELECOM.COM> wrote: YES SIR! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 16:02 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Bounce and then down. Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine via WIT for MICE Frank ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Sept. 24, 2019

Re: Anyone else down to Belle Plain since 3:45 pm?

by Frank Bulk

My credit request to Zayo for the September 9 event was rejected – they claimed force majeure. I’m ask again. =) Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Darin Steffl Sent: Tuesday, September 10, 2019 9:18 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? That's pretty sad. So they already had a fiber crew on site and it still took many hours to fix it. Maybe they didn't have a splicer there but it's still bad to see how long it took when they knew the exact location of the cut since they caused it. On Tue, Sep 10, 2019, 9:15 AM Frank Bulk <fbulk(a)mypremieronline.com<mailto:fbulk@mypremieronline.com>> wrote: From our OSP supervisor: …this was cut by Zayo’s own contractor who was working on moving their fiber. Frank From: Frank Bulk Sent: Tuesday, September 10, 2019 8:17 AM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? From our field tech: I think the contractor Zayo hired to move the fiber for the Hwy. 75 reconstruction hit the fiber. I'm assuming Vannguard's locates were off. Frank From: Frank Bulk Sent: Tuesday, September 10, 2019 7:28 AM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? My own link was up at 1:41 am Last update I received from Zayo was at 3:46 am: Current Update: OSP techs have completed splicing on all active fibers at this time. All services should be restored. Please advise if you are still experiencing issues. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 11:43 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Another update at 11:25pm: Current Update: Replacement fiber and splicers are onsite at this time. Techs will be prepping the cables for splicing soon. ETR at this time is 5 hours. More updates to follow. So basically it should be up by 5 am or so. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 10:18 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Another update at 10:09 pm: Current Update: Our OSP reported that the repair crew are running a little behind the 2 hour ETA provided earlier and have noted the are still about 50 minutes from the damage area. So they will arrive around 11 pm, about 7h 15m from the start of the outage. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 8:30 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? More detail in Zayo’s last update at 8:08 pm We apologize for the delayed update. We've spoken with our OSP PM and have been advised that the splice crew's ETA to the site is still about 1 to 1.5 hours and the ETTR is 4.5 to 5 hours. The damage was caused by a construction crew and the damage area is south of Hinton, IA around County Rd 60 and Iowa State Rd 75. Additional information to follow once the splice crew is on site. So it does seem related to the Hwy 75 re-construction project. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Krejci Sent: Monday, September 9, 2019 6:13 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? I heard it is out somewhere between Sioux City and Alton, so it definitely could be that IDOT construction zone. We don't have growing pains we have Zayo pains. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of Frank Bulk <fbulk(a)MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> Sent: Monday, September 9, 2019 4:37 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Could be part of the Hwy 75 project: https://siouxcityjournal.com/news/local/idot-to-close-us-highway-during-nig…<https://urldefense.proofpoint.com/v2/url?u=https-3A__siouxcityjournal.com_n…> Our OSP staff said that Zayo was the laggard on the required moves. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of AnthonyAnderberg(a)nuvera.net<mailto:AnthonyAnderberg@nuvera.net> Sent: Monday, September 09, 2019 4:21 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? We've got a link in NW Iowa down as well, we're on the same (former Neutral Path) link as you guys to Sioux City - so it's someplace between Sioux City, IA and Windom, MN. On 9/9/19, 4:02 PM, "MICE Discuss on behalf of James Urwiller" <MICE-DISCUSS(a)LISTS.IPHOUSE.NET on behalf of james.urwiller(a)TURNKEY-TELECOM.COM<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET%20on%20behalf%20of%20james.urwiller@TURNKEY-TELECOM.COM>> wrote: YES SIR! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 16:02 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Bounce and then down. Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine via WIT for MICE Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

Sept. 24, 2019

Zayo Bell Plaine

by Jeremy Lumby

Just an FYI, I have received temperature alarms from the Zayo hut in Belle Plaine again. A ticket has been opened with Zayo Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com

Sept. 20, 2019

Re: BGP Optimizers

by Jeffrey Anderson

We run across these a lot on our customer endpoints… I have found that these hinge on the single assumption BGP best practices have been followed end-to-end. Also, end user education about how they function is a serious issue. IRR is the more serious concern/project for us at this juncture to insure global reachability. +2 on the IRR! -Sparky. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of David Farmer Sent: Wednesday, September 18, 2019 4:43 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] BGP Optimizers I found an interesting article in my LinkedIn feed last night on BGP Optimizers; https://www.itnews.com.au/news/bgp-optimisers-seem-a-good-idea-until-they-b… I'd be interesting if anyone in the MICE community is using a BGP Optimizer? Especially one that generates more specific prefixes in BGP. I don't want to expose anyone to ridicule, so please don't go there if anyone fesses up, even in jest, this needs to be treated seriously. However, if anyone is using a BGP Optimizer, especially one generating more specific prefixes, I think it would behoove the MICE community to put in extra defenses against propagating these more specific prefixes through the exchange and out to the Internet in general or even our own downstream customers. For example we could create a MICE-DROP BGP Community that we can tag any routes that should be dropped if they are (accidentally) announced to the MICE route server or to other MICE peers, such as these more specific routes created by a BGP Optimizer. Basically we would each add something to our routing policy, and on the MICE route servers too, looking for that BGP Community and immediately dropping any routes tag with it. Also, if anyone is using a BGP Optimizer in our community that would be a very good reason to accelerate IRR based router filtering for our exchange. Thanks. -- =============================================== David Farmer Email:farmer@umn.edu<mailto:Email%3Afarmer@umn.edu> Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 =============================================== ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Sept. 19, 2019

Re: BGP Optimizers

by David Farmer

Well we can't necessarily trust them to attach the BGP Community or filter properly, this is why if there are people using BGP Optimizers, I would want us to accelerate IRR filtering for MICE, but even that isn't perfect. However, the idea around a MICE-DROP BGP Community is to develop a robust approach, belt and suspenders so to speak. For example, let's say they are filtering but they make a mistake editing their filter, or they load new code on their router and a bug allows routes to leak. If in a different part of their configuration, or maybe on the BGP Optimizer itself, they set the MICE-DROP community, then their mistake or bug still won't propagate through MICE, because the other MICE participants or the MICE route servers would know to drop the routes with that tag anyway. It's also why we all need to enforce max prefix counts on our peers and on peers to the route servers, it helps catch the unexpected mistake or bug. Robust systems have multiple layers of protection. The break system on your car probably has power assist of some kind, but your breaks are designed to work even if the power assist fails, you still have manual, unassisted, hydraulics through the break pedal, and if the hydraulic system completely fails, you have a emergency break with a cable attached to a lever that can use to engage the breaks. Something like a MICE-DROP BGP Community allows responsible peers to implemnet robust filtering of their routes, where even if something fails on their side, maybe something our our side can catch the failure and prevent it being propagated. Thanks. On Wed, Sep 18, 2019 at 5:14 PM Brandon Mulligan <brandon(a)kcix.net> wrote: > David, > > Do the MICE route servers not have explicit route filters on each BGP > session? If you can't trust a network to advertise only their IPs then how > can you trust them to attach a community to their "optimized routes"? > > Also, Could one simply use 0:53679 on their "optimized routes" to achieve > the same effect? > > Thanks. > On 9/18/2019 4:43 PM, David Farmer wrote: > > I found an interesting article in my LinkedIn feed last night on BGP > Optimizers; > > > https://www.itnews.com.au/news/bgp-optimisers-seem-a-good-idea-until-they-b… > ? > > I'd be interesting if anyone in the MICE community is using a BGP > Optimizer? Especially one that generates more specific prefixes in BGP. > > I don't want to expose anyone to ridicule, so please don't go there if > anyone fesses up, even in jest, this needs to be treated seriously. > > However, if anyone is using a BGP Optimizer, especially one generating > more specific prefixes, I think it would behoove the MICE community to put > in extra defenses against propagating these more specific prefixes through > the exchange and out to the Internet in general or even our own downstream > customers. > > For example we could create a MICE-DROP BGP Community that we can tag any > routes that should be dropped if they are (accidentally) announced to the > MICE route server or to other MICE peers, such as these more specific > routes created by a BGP Optimizer. Basically we would each add something to > our routing policy, and on the MICE route servers too, looking for that BGP > Community and immediately dropping any routes tag with it. > > Also, if anyone is using a BGP Optimizer in our community that would be a > very good reason to accelerate IRR based router filtering for our exchange. > > Thanks. > -- > =============================================== > David Farmer Email:farmer@umn.edu > Networking & Telecommunication Services > Office of Information Technology > University of Minnesota > 2218 University Ave SE Phone: 612-626-0815 > Minneapolis, MN 55414-3029 Cell: 612-812-9952 > =============================================== > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > -- > Brandon Mulligan > Kansas City Internet eXchangehttp://kcix.net > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

Sept. 18, 2019

Re: BGP Optimizers

by Brady Kittel

Noction does their installs themselves normally so arguably none of their settings are default and are subject to the specific build of software they initially install and how their engineer lays down the base config. RE: The specific instance referenced in the article was the result of several companies failing to follow best practice with regard to their network management from what I recall and noction just amplified the issue. The article above is glazing over a lot of details. On Wed, Sep 18, 2019, 5:22 PM Andrew Hoyos <hoyosa(a)gmail.com> wrote: > Folks using route-optimizer things like Noction and such *SHOULD* be > setting no-export on any prefixes it generates... > As we’ve seen in history over the last years, that doesn’t always happen. > I think they recently (last-year ish?) made that a default, instead of a > manual setting. > > > On Sep 18, 2019, at 5:14 PM, Brandon Mulligan <brandon(a)KCIX.NET> wrote: > > David, > > Do the MICE route servers not have explicit route filters on each BGP > session? If you can't trust a network to advertise only their IPs then how > can you trust them to attach a community to their "optimized routes"? > > Also, Could one simply use 0:53679 on their "optimized routes" to achieve > the same effect? > > Thanks. > On 9/18/2019 4:43 PM, David Farmer wrote: > > I found an interesting article in my LinkedIn feed last night on BGP > Optimizers; > > > https://www.itnews.com.au/news/bgp-optimisers-seem-a-good-idea-until-they-b… > ? > > I'd be interesting if anyone in the MICE community is using a BGP > Optimizer? Especially one that generates more specific prefixes in BGP. > > I don't want to expose anyone to ridicule, so please don't go there if > anyone fesses up, even in jest, this needs to be treated seriously. > > However, if anyone is using a BGP Optimizer, especially one generating > more specific prefixes, I think it would behoove the MICE community to put > in extra defenses against propagating these more specific prefixes through > the exchange and out to the Internet in general or even our own downstream > customers. > > For example we could create a MICE-DROP BGP Community that we can tag any > routes that should be dropped if they are (accidentally) announced to the > MICE route server or to other MICE peers, such as these more specific > routes created by a BGP Optimizer. Basically we would each add something to > our routing policy, and on the MICE route servers too, looking for that BGP > Community and immediately dropping any routes tag with it. > > Also, if anyone is using a BGP Optimizer in our community that would be a > very good reason to accelerate IRR based router filtering for our exchange. > > Thanks. > -- > =============================================== > David Farmer Email:farmer@umn.edu > Networking & Telecommunication Services > Office of Information Technology > University of Minnesota > 2218 University Ave SE Phone: 612-626-0815 > Minneapolis, MN 55414-3029 Cell: 612-812-9952 > =============================================== > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > -- > Brandon Mulligan > Kansas City Internet eXchangehttp://kcix.net > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >

Sept. 18, 2019

Re: BGP Optimizers

by Andrew Hoyos

and +1 on accelerating IRR based filtering on the route servers… > On Sep 18, 2019, at 5:14 PM, Brandon Mulligan <brandon(a)KCIX.NET> wrote: > >> Also, if anyone is using a BGP Optimizer in our community that would be a very good reason to accelerate IRR based router filtering for our exchange. >

Sept. 18, 2019

Re: BGP Optimizers

by Andrew Hoyos

Folks using route-optimizer things like Noction and such *SHOULD* be setting no-export on any prefixes it generates... As we’ve seen in history over the last years, that doesn’t always happen. I think they recently (last-year ish?) made that a default, instead of a manual setting. > On Sep 18, 2019, at 5:14 PM, Brandon Mulligan <brandon(a)KCIX.NET> wrote: > > David, > > Do the MICE route servers not have explicit route filters on each BGP session? If you can't trust a network to advertise only their IPs then how can you trust them to attach a community to their "optimized routes"? > > Also, Could one simply use 0:53679 on their "optimized routes" to achieve the same effect? > > Thanks. > > On 9/18/2019 4:43 PM, David Farmer wrote: >> I found an interesting article in my LinkedIn feed last night on BGP Optimizers; >> >> https://www.itnews.com.au/news/bgp-optimisers-seem-a-good-idea-until-they-b… <https://www.itnews.com.au/news/bgp-optimisers-seem-a-good-idea-until-they-b…>? >> >> I'd be interesting if anyone in the MICE community is using a BGP Optimizer? Especially one that generates more specific prefixes in BGP. >> >> I don't want to expose anyone to ridicule, so please don't go there if anyone fesses up, even in jest, this needs to be treated seriously. >> >> However, if anyone is using a BGP Optimizer, especially one generating more specific prefixes, I think it would behoove the MICE community to put in extra defenses against propagating these more specific prefixes through the exchange and out to the Internet in general or even our own downstream customers. >> >> For example we could create a MICE-DROP BGP Community that we can tag any routes that should be dropped if they are (accidentally) announced to the MICE route server or to other MICE peers, such as these more specific routes created by a BGP Optimizer. Basically we would each add something to our routing policy, and on the MICE route servers too, looking for that BGP Community and immediately dropping any routes tag with it. >> >> Also, if anyone is using a BGP Optimizer in our community that would be a very good reason to accelerate IRR based router filtering for our exchange. >> >> Thanks. >> -- >> =============================================== >> David Farmer Email:farmer@umn.edu <mailto:Email%3Afarmer@umn.edu> >> Networking & Telecommunication Services >> Office of Information Technology >> University of Minnesota >> 2218 University Ave SE Phone: 612-626-0815 >> Minneapolis, MN 55414-3029 Cell: 612-812-9952 >> =============================================== >> >> To unsubscribe from the MICE-DISCUSS list, click the following link: >> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1>-- > Brandon Mulligan > Kansas City Internet eXchange > http://kcix.net <http://kcix.net/> > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1>

Sept. 18, 2019

Re: BGP Optimizers

by Brandon Mulligan

David, Do the MICE route servers not have explicit route filters on each BGP session? If you can't trust a network to advertise only their IPs then how can you trust them to attach a community to their "optimized routes"? Also, Could one simply use 0:53679 on their "optimized routes" to achieve the same effect? Thanks. On 9/18/2019 4:43 PM, David Farmer wrote: > I found an interesting article in my LinkedIn feed last night on BGP Optimizers; > > https://www.itnews.com.au/news/bgp-optimisers-seem-a-good-idea-until-they-b… > > I'd be interesting if anyone in the MICE community is using a BGP Optimizer? Especially one that generates more specific prefixes in BGP. > > I don't want to expose anyone to ridicule, so please don't go there if anyone fesses up, even in jest, this needs to be treated seriously. > > However, if anyone is using a BGP Optimizer, especially one generating more specific prefixes, I think it would behoove the MICE community to put in extra defenses against propagating these more specific prefixes through the exchange and out to the Internet in general or even our own downstream customers. > > For example we could create a MICE-DROP BGP Community that we can tag any routes that should be dropped if they are (accidentally) announced to the MICE route server or to other MICE peers, such as these more specific routes created by a BGP Optimizer. Basically we would each add something to our routing policy, and on the MICE route servers too, looking for that BGP Community and immediately dropping any routes tag with it. > > Also, if anyone is using a BGP Optimizer in our community that would be a very good reason to accelerate IRR based router filtering for our exchange. > > Thanks. > -- > =============================================== > David Farmer Email:farmer@umn.edu <mailto:Email%3Afarmer@umn.edu> > Networking & Telecommunication Services > Office of Information Technology > University of Minnesota > 2218 University Ave SE Phone: 612-626-0815 > Minneapolis, MN 55414-3029 Cell: 612-812-9952 > =============================================== > > ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > -- Brandon Mulligan Kansas City Internet eXchange http://kcix.net

Sept. 18, 2019

BGP Optimizers

by David Farmer

I found an interesting article in my LinkedIn feed last night on BGP Optimizers; https://www.itnews.com.au/news/bgp-optimisers-seem-a-good-idea-until-they-b… ? I'd be interesting if anyone in the MICE community is using a BGP Optimizer? Especially one that generates more specific prefixes in BGP. I don't want to expose anyone to ridicule, so please don't go there if anyone fesses up, even in jest, this needs to be treated seriously. However, if anyone is using a BGP Optimizer, especially one generating more specific prefixes, I think it would behoove the MICE community to put in extra defenses against propagating these more specific prefixes through the exchange and out to the Internet in general or even our own downstream customers. For example we could create a MICE-DROP BGP Community that we can tag any routes that should be dropped if they are (accidentally) announced to the MICE route server or to other MICE peers, such as these more specific routes created by a BGP Optimizer. Basically we would each add something to our routing policy, and on the MICE route servers too, looking for that BGP Community and immediately dropping any routes tag with it. Also, if anyone is using a BGP Optimizer in our community that would be a very good reason to accelerate IRR based router filtering for our exchange. Thanks. -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

Sept. 18, 2019

Re: Anyone else down to Belle Plain since 3:45 pm?

by Dean Bahls

Those thing happen. But a cut at 3:45PM should never take till 1:15AM to restore. They won’t change the glacial speed at which they operate until it affects their bottom line. Time to start disconnecting circuits I guess. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Tuesday, September 10, 2019 9:15 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? >From our OSP supervisor: …this was cut by Zayo’s own contractor who was working on moving their fiber. Frank From: Frank Bulk Sent: Tuesday, September 10, 2019 8:17 AM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> > Subject: RE: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? >From our field tech: I think the contractor Zayo hired to move the fiber for the Hwy. 75 reconstruction hit the fiber. I'm assuming Vannguard's locates were off. Frank From: Frank Bulk Sent: Tuesday, September 10, 2019 7:28 AM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? My own link was up at 1:41 am Last update I received from Zayo was at 3:46 am: Current Update: OSP techs have completed splicing on all active fibers at this time. All services should be restored. Please advise if you are still experiencing issues. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> > On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 11:43 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Another update at 11:25pm: Current Update: Replacement fiber and splicers are onsite at this time. Techs will be prepping the cables for splicing soon. ETR at this time is 5 hours. More updates to follow. So basically it should be up by 5 am or so. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> > On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 10:18 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Another update at 10:09 pm: Current Update: Our OSP reported that the repair crew are running a little behind the 2 hour ETA provided earlier and have noted the are still about 50 minutes from the damage area. So they will arrive around 11 pm, about 7h 15m from the start of the outage. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> > On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 8:30 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? More detail in Zayo’s last update at 8:08 pm We apologize for the delayed update. We've spoken with our OSP PM and have been advised that the splice crew's ETA to the site is still about 1 to 1.5 hours and the ETTR is 4.5 to 5 hours. The damage was caused by a construction crew and the damage area is south of Hinton, IA around County Rd 60 and Iowa State Rd 75. Additional information to follow once the splice crew is on site. So it does seem related to the Hwy 75 re-construction project. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> > On Behalf Of Justin Krejci Sent: Monday, September 9, 2019 6:13 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? I heard it is out somewhere between Sioux City and Alton, so it definitely could be that IDOT construction zone. We don't have growing pains we have Zayo pains. _____ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> > on behalf of Frank Bulk <fbulk(a)MYPREMIERONLINE.COM <mailto:fbulk@MYPREMIERONLINE.COM> > Sent: Monday, September 9, 2019 4:37 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Could be part of the Hwy 75 project: <https://urldefense.proofpoint.com/v2/url?u=https-3A__siouxcityjournal.com_n…> https://siouxcityjournal.com/news/local/idot-to-close-us-highway-during-nig… Our OSP staff said that Zayo was the laggard on the required moves. Frank -----Original Message----- From: MICE Discuss < <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of <mailto:AnthonyAnderberg@nuvera.net> AnthonyAnderberg(a)nuvera.net Sent: Monday, September 09, 2019 4:21 PM To: <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? We've got a link in NW Iowa down as well, we're on the same (former Neutral Path) link as you guys to Sioux City - so it's someplace between Sioux City, IA and Windom, MN. On 9/9/19, 4:02 PM, "MICE Discuss on behalf of James Urwiller" < <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET%20on%20behalf%20of%20james.urwiller@TURNKEY-TELECOM.COM> MICE-DISCUSS(a)LISTS.IPHOUSE.NET on behalf of james.urwiller(a)TURNKEY-TELECOM.COM> wrote: YES SIR! James Urwiller Network Architect Stealth Broadband <mailto:james.urwiller@stealthbroadband.com> james.urwiller(a)stealthbroadband.com -----Original Message----- From: MICE Discuss < <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 16:02 To: <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Bounce and then down. Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine via WIT for MICE Frank _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> &A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> &A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> &A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> &A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> &A=1

Sept. 10, 2019

Re: Anyone else down to Belle Plain since 3:45 pm?

by Darin Steffl

That's pretty sad. So they already had a fiber crew on site and it still took many hours to fix it. Maybe they didn't have a splicer there but it's still bad to see how long it took when they knew the exact location of the cut since they caused it. On Tue, Sep 10, 2019, 9:15 AM Frank Bulk <fbulk(a)mypremieronline.com> wrote: > From our OSP supervisor: > > *…this was cut by Zayo’s own contractor who was working on moving their > fiber.* > > > > Frank > > > > *From:* Frank Bulk > *Sent:* Tuesday, September 10, 2019 8:17 AM > *To:* 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> > *Subject:* RE: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 > pm? > > > > From our field tech: > > *I think the contractor Zayo hired to move the fiber for the Hwy. 75 > reconstruction hit the fiber. I'm assuming Vannguard's locates were off.* > > > > Frank > > > > *From:* Frank Bulk > *Sent:* Tuesday, September 10, 2019 7:28 AM > *To:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> > *Subject:* RE: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 > pm? > > > > My own link was up at 1:41 am > > > > Last update I received from Zayo was at 3:46 am: > > *Current Update: OSP techs have completed splicing on all active fibers at > this time. All services should be restored. Please advise if you are still > experiencing issues.* > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Monday, September 9, 2019 11:43 PM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 > pm? > > > > Another update at 11:25pm: > > *Current Update: Replacement fiber and splicers are onsite at this time. > Techs will be prepping the cables for splicing soon. ETR at this time is 5 > hours. More updates to follow.* > > > > So basically it should be up by 5 am or so. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Monday, September 9, 2019 10:18 PM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 > pm? > > > > Another update at 10:09 pm: > > *Current Update: Our OSP reported that the repair crew are running a > little behind the 2 hour ETA provided earlier and have noted the are still > about 50 minutes from the damage area.* > > > > So they will arrive around 11 pm, about 7h 15m from the start of the > outage. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank > Bulk > *Sent:* Monday, September 9, 2019 8:30 PM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 > pm? > > > > More detail in Zayo’s last update at 8:08 pm > > *We apologize for the delayed update. We've spoken with our OSP PM and > have been advised that the splice crew's ETA to the site is still about 1 > to 1.5 hours and the ETTR is 4.5 to 5 hours. The damage was caused by a > construction crew and the damage area is south of Hinton, IA around County > Rd 60 and Iowa State Rd 75. Additional information to follow once the > splice crew is on site.* > > > > So it does seem related to the Hwy 75 re-construction project. > > > > Frank > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Justin > Krejci > *Sent:* Monday, September 9, 2019 6:13 PM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 > pm? > > > > I heard it is out somewhere between Sioux City and Alton, so it definitely > could be that IDOT construction zone. > > > > We don't have growing pains we have Zayo pains. > > > ------------------------------ > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Frank > Bulk <fbulk(a)MYPREMIERONLINE.COM> > *Sent:* Monday, September 9, 2019 4:37 PM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 > pm? > > > > Could be part of the Hwy 75 project: > > https://siouxcityjournal.com/news/local/idot-to-close-us-highway-during-nig… > <https://urldefense.proofpoint.com/v2/url?u=https-3A__siouxcityjournal.com_n…> > Our OSP staff said that Zayo was the laggard on the required moves. > > Frank > > -----Original Message----- > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of > AnthonyAnderberg(a)nuvera.net > Sent: Monday, September 09, 2019 4:21 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? > > We've got a link in NW Iowa down as well, we're on the same (former > Neutral Path) link as you guys to Sioux City - so it's someplace between > Sioux City, IA and Windom, MN. > > > > On 9/9/19, 4:02 PM, "MICE Discuss on behalf of James Urwiller" <MICE-DISCUSS(a)LISTS.IPHOUSE.NET > on behalf of james.urwiller(a)TURNKEY-TELECOM.COM> wrote: > > YES SIR! > > James Urwiller > Network Architect > Stealth Broadband > james.urwiller(a)stealthbroadband.com > > > -----Original Message----- > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank > Bulk > Sent: Monday, September 9, 2019 16:02 > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? > > Bounce and then down. > > Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical > (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), > to > Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet > Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, > 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 > 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), > Link > (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine > via > WIT for MICE > > Frank > > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >

Sept. 10, 2019

Re: Anyone else down to Belle Plain since 3:45 pm?

by Frank Bulk

From our OSP supervisor: …this was cut by Zayo’s own contractor who was working on moving their fiber. Frank From: Frank Bulk Sent: Tuesday, September 10, 2019 8:17 AM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? From our field tech: I think the contractor Zayo hired to move the fiber for the Hwy. 75 reconstruction hit the fiber. I'm assuming Vannguard's locates were off. Frank From: Frank Bulk Sent: Tuesday, September 10, 2019 7:28 AM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? My own link was up at 1:41 am Last update I received from Zayo was at 3:46 am: Current Update: OSP techs have completed splicing on all active fibers at this time. All services should be restored. Please advise if you are still experiencing issues. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 11:43 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Another update at 11:25pm: Current Update: Replacement fiber and splicers are onsite at this time. Techs will be prepping the cables for splicing soon. ETR at this time is 5 hours. More updates to follow. So basically it should be up by 5 am or so. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 10:18 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Another update at 10:09 pm: Current Update: Our OSP reported that the repair crew are running a little behind the 2 hour ETA provided earlier and have noted the are still about 50 minutes from the damage area. So they will arrive around 11 pm, about 7h 15m from the start of the outage. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 8:30 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? More detail in Zayo’s last update at 8:08 pm We apologize for the delayed update. We've spoken with our OSP PM and have been advised that the splice crew's ETA to the site is still about 1 to 1.5 hours and the ETTR is 4.5 to 5 hours. The damage was caused by a construction crew and the damage area is south of Hinton, IA around County Rd 60 and Iowa State Rd 75. Additional information to follow once the splice crew is on site. So it does seem related to the Hwy 75 re-construction project. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Krejci Sent: Monday, September 9, 2019 6:13 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? I heard it is out somewhere between Sioux City and Alton, so it definitely could be that IDOT construction zone. We don't have growing pains we have Zayo pains. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of Frank Bulk <fbulk(a)MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> Sent: Monday, September 9, 2019 4:37 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Could be part of the Hwy 75 project: https://siouxcityjournal.com/news/local/idot-to-close-us-highway-during-nig…<https://urldefense.proofpoint.com/v2/url?u=https-3A__siouxcityjournal.com_n…> Our OSP staff said that Zayo was the laggard on the required moves. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of AnthonyAnderberg(a)nuvera.net<mailto:AnthonyAnderberg@nuvera.net> Sent: Monday, September 09, 2019 4:21 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? We've got a link in NW Iowa down as well, we're on the same (former Neutral Path) link as you guys to Sioux City - so it's someplace between Sioux City, IA and Windom, MN. On 9/9/19, 4:02 PM, "MICE Discuss on behalf of James Urwiller" <MICE-DISCUSS(a)LISTS.IPHOUSE.NET on behalf of james.urwiller(a)TURNKEY-TELECOM.COM<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET%20on%20behalf%20of%20james.urwiller@TURNKEY-TELECOM.COM>> wrote: YES SIR! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 16:02 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Bounce and then down. Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine via WIT for MICE Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

Sept. 10, 2019

Re: Anyone else down to Belle Plain since 3:45 pm?

by Frank Bulk

From our field tech: I think the contractor Zayo hired to move the fiber for the Hwy. 75 reconstruction hit the fiber. I'm assuming Vannguard's locates were off. Frank From: Frank Bulk Sent: Tuesday, September 10, 2019 7:28 AM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? My own link was up at 1:41 am Last update I received from Zayo was at 3:46 am: Current Update: OSP techs have completed splicing on all active fibers at this time. All services should be restored. Please advise if you are still experiencing issues. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 11:43 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Another update at 11:25pm: Current Update: Replacement fiber and splicers are onsite at this time. Techs will be prepping the cables for splicing soon. ETR at this time is 5 hours. More updates to follow. So basically it should be up by 5 am or so. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 10:18 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Another update at 10:09 pm: Current Update: Our OSP reported that the repair crew are running a little behind the 2 hour ETA provided earlier and have noted the are still about 50 minutes from the damage area. So they will arrive around 11 pm, about 7h 15m from the start of the outage. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 8:30 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? More detail in Zayo’s last update at 8:08 pm We apologize for the delayed update. We've spoken with our OSP PM and have been advised that the splice crew's ETA to the site is still about 1 to 1.5 hours and the ETTR is 4.5 to 5 hours. The damage was caused by a construction crew and the damage area is south of Hinton, IA around County Rd 60 and Iowa State Rd 75. Additional information to follow once the splice crew is on site. So it does seem related to the Hwy 75 re-construction project. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Krejci Sent: Monday, September 9, 2019 6:13 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? I heard it is out somewhere between Sioux City and Alton, so it definitely could be that IDOT construction zone. We don't have growing pains we have Zayo pains. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of Frank Bulk <fbulk(a)MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> Sent: Monday, September 9, 2019 4:37 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Could be part of the Hwy 75 project: https://siouxcityjournal.com/news/local/idot-to-close-us-highway-during-nig…<https://urldefense.proofpoint.com/v2/url?u=https-3A__siouxcityjournal.com_n…> Our OSP staff said that Zayo was the laggard on the required moves. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of AnthonyAnderberg(a)nuvera.net<mailto:AnthonyAnderberg@nuvera.net> Sent: Monday, September 09, 2019 4:21 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? We've got a link in NW Iowa down as well, we're on the same (former Neutral Path) link as you guys to Sioux City - so it's someplace between Sioux City, IA and Windom, MN. On 9/9/19, 4:02 PM, "MICE Discuss on behalf of James Urwiller" <MICE-DISCUSS(a)LISTS.IPHOUSE.NET on behalf of james.urwiller(a)TURNKEY-TELECOM.COM<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET%20on%20behalf%20of%20james.urwiller@TURNKEY-TELECOM.COM>> wrote: YES SIR! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 16:02 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Bounce and then down. Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine via WIT for MICE Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

Sept. 10, 2019

Re: Anyone else down to Belle Plain since 3:45 pm?

by Frank Bulk

My own link was up at 1:41 am Last update I received from Zayo was at 3:46 am: Current Update: OSP techs have completed splicing on all active fibers at this time. All services should be restored. Please advise if you are still experiencing issues. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 11:43 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Another update at 11:25pm: Current Update: Replacement fiber and splicers are onsite at this time. Techs will be prepping the cables for splicing soon. ETR at this time is 5 hours. More updates to follow. So basically it should be up by 5 am or so. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 10:18 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Another update at 10:09 pm: Current Update: Our OSP reported that the repair crew are running a little behind the 2 hour ETA provided earlier and have noted the are still about 50 minutes from the damage area. So they will arrive around 11 pm, about 7h 15m from the start of the outage. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 8:30 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? More detail in Zayo’s last update at 8:08 pm We apologize for the delayed update. We've spoken with our OSP PM and have been advised that the splice crew's ETA to the site is still about 1 to 1.5 hours and the ETTR is 4.5 to 5 hours. The damage was caused by a construction crew and the damage area is south of Hinton, IA around County Rd 60 and Iowa State Rd 75. Additional information to follow once the splice crew is on site. So it does seem related to the Hwy 75 re-construction project. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Krejci Sent: Monday, September 9, 2019 6:13 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? I heard it is out somewhere between Sioux City and Alton, so it definitely could be that IDOT construction zone. We don't have growing pains we have Zayo pains. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of Frank Bulk <fbulk(a)MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> Sent: Monday, September 9, 2019 4:37 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Could be part of the Hwy 75 project: https://siouxcityjournal.com/news/local/idot-to-close-us-highway-during-nig…<https://urldefense.proofpoint.com/v2/url?u=https-3A__siouxcityjournal.com_n…> Our OSP staff said that Zayo was the laggard on the required moves. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of AnthonyAnderberg(a)nuvera.net<mailto:AnthonyAnderberg@nuvera.net> Sent: Monday, September 09, 2019 4:21 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? We've got a link in NW Iowa down as well, we're on the same (former Neutral Path) link as you guys to Sioux City - so it's someplace between Sioux City, IA and Windom, MN. On 9/9/19, 4:02 PM, "MICE Discuss on behalf of James Urwiller" <MICE-DISCUSS(a)LISTS.IPHOUSE.NET on behalf of james.urwiller(a)TURNKEY-TELECOM.COM<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET%20on%20behalf%20of%20james.urwiller@TURNKEY-TELECOM.COM>> wrote: YES SIR! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 16:02 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Bounce and then down. Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine via WIT for MICE Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

Sept. 10, 2019

Re: Anyone else down to Belle Plain since 3:45 pm?

by Frank Bulk

Another update at 11:25pm: Current Update: Replacement fiber and splicers are onsite at this time. Techs will be prepping the cables for splicing soon. ETR at this time is 5 hours. More updates to follow. So basically it should be up by 5 am or so. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 10:18 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Another update at 10:09 pm: Current Update: Our OSP reported that the repair crew are running a little behind the 2 hour ETA provided earlier and have noted the are still about 50 minutes from the damage area. So they will arrive around 11 pm, about 7h 15m from the start of the outage. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 8:30 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? More detail in Zayo’s last update at 8:08 pm We apologize for the delayed update. We've spoken with our OSP PM and have been advised that the splice crew's ETA to the site is still about 1 to 1.5 hours and the ETTR is 4.5 to 5 hours. The damage was caused by a construction crew and the damage area is south of Hinton, IA around County Rd 60 and Iowa State Rd 75. Additional information to follow once the splice crew is on site. So it does seem related to the Hwy 75 re-construction project. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Krejci Sent: Monday, September 9, 2019 6:13 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? I heard it is out somewhere between Sioux City and Alton, so it definitely could be that IDOT construction zone. We don't have growing pains we have Zayo pains. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of Frank Bulk <fbulk(a)MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> Sent: Monday, September 9, 2019 4:37 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Could be part of the Hwy 75 project: https://siouxcityjournal.com/news/local/idot-to-close-us-highway-during-nig…<https://urldefense.proofpoint.com/v2/url?u=https-3A__siouxcityjournal.com_n…> Our OSP staff said that Zayo was the laggard on the required moves. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of AnthonyAnderberg(a)nuvera.net<mailto:AnthonyAnderberg@nuvera.net> Sent: Monday, September 09, 2019 4:21 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? We've got a link in NW Iowa down as well, we're on the same (former Neutral Path) link as you guys to Sioux City - so it's someplace between Sioux City, IA and Windom, MN. On 9/9/19, 4:02 PM, "MICE Discuss on behalf of James Urwiller" <MICE-DISCUSS(a)LISTS.IPHOUSE.NET on behalf of james.urwiller(a)TURNKEY-TELECOM.COM<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET%20on%20behalf%20of%20james.urwiller@TURNKEY-TELECOM.COM>> wrote: YES SIR! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 16:02 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Bounce and then down. Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine via WIT for MICE Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

Sept. 10, 2019

Re: Anyone else down to Belle Plain since 3:45 pm?

by Frank Bulk

Another update at 10:09 pm: Current Update: Our OSP reported that the repair crew are running a little behind the 2 hour ETA provided earlier and have noted the are still about 50 minutes from the damage area. So they will arrive around 11 pm, about 7h 15m from the start of the outage. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 8:30 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? More detail in Zayo’s last update at 8:08 pm We apologize for the delayed update. We've spoken with our OSP PM and have been advised that the splice crew's ETA to the site is still about 1 to 1.5 hours and the ETTR is 4.5 to 5 hours. The damage was caused by a construction crew and the damage area is south of Hinton, IA around County Rd 60 and Iowa State Rd 75. Additional information to follow once the splice crew is on site. So it does seem related to the Hwy 75 re-construction project. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Krejci Sent: Monday, September 9, 2019 6:13 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? I heard it is out somewhere between Sioux City and Alton, so it definitely could be that IDOT construction zone. We don't have growing pains we have Zayo pains. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of Frank Bulk <fbulk(a)MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> Sent: Monday, September 9, 2019 4:37 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Could be part of the Hwy 75 project: https://siouxcityjournal.com/news/local/idot-to-close-us-highway-during-nig…<https://urldefense.proofpoint.com/v2/url?u=https-3A__siouxcityjournal.com_n…> Our OSP staff said that Zayo was the laggard on the required moves. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of AnthonyAnderberg(a)nuvera.net<mailto:AnthonyAnderberg@nuvera.net> Sent: Monday, September 09, 2019 4:21 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? We've got a link in NW Iowa down as well, we're on the same (former Neutral Path) link as you guys to Sioux City - so it's someplace between Sioux City, IA and Windom, MN. On 9/9/19, 4:02 PM, "MICE Discuss on behalf of James Urwiller" <MICE-DISCUSS(a)LISTS.IPHOUSE.NET on behalf of james.urwiller(a)TURNKEY-TELECOM.COM<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET%20on%20behalf%20of%20james.urwiller@TURNKEY-TELECOM.COM>> wrote: YES SIR! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 16:02 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Bounce and then down. Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine via WIT for MICE Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

Sept. 10, 2019

Re: Anyone else down to Belle Plain since 3:45 pm?

by Andrew Hoyos

Do we need to create a ‘zayo-outages’ list for this sort of thing? :) — Andrew Hoyos hoyosa(a)gmail.com > On Sep 9, 2019, at 9:49 PM, Frank Bulk <fbulk(a)MYPREMIERONLINE.COM> wrote: > > I’ve asked our OSP if he had any local knowledge, but he’s not aware. > > I will alert our Hinton field tech just in case he hears anything about it. > > Frank > > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller > Sent: Monday, September 9, 2019 8:33 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> > Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? > > So is it common for IA/MN construction to hit things all willy nilly without locates? Or is this another botched locate job? > > James Urwiller > Network Architect > Stealth Broadband > james.urwiller(a)stealthbroadband.com <mailto:james.urwiller@stealthbroadband.com> > <image001.jpg> > > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk > Sent: Monday, September 9, 2019 20:30 > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> > Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? > > More detail in Zayo’s last update at 8:08 pm > We apologize for the delayed update. We've spoken with our OSP PM and have been advised that the splice crew's ETA to the site is still about 1 to 1.5 hours and the ETTR is 4.5 to 5 hours. The damage was caused by a construction crew and the damage area is south of Hinton, IA around County Rd 60 and Iowa State Rd 75. Additional information to follow once the splice crew is on site. > > So it does seem related to the Hwy 75 re-construction project. > > Frank > > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Krejci > Sent: Monday, September 9, 2019 6:13 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> > Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? > > I heard it is out somewhere between Sioux City and Alton, so it definitely could be that IDOT construction zone. > > > > We don't have growing pains we have Zayo pains. > > > > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of Frank Bulk <fbulk(a)MYPREMIERONLINE.COM <mailto:fbulk@MYPREMIERONLINE.COM>> > Sent: Monday, September 9, 2019 4:37 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> > Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? > > Could be part of the Hwy 75 project: > https://siouxcityjournal.com/news/local/idot-to-close-us-highway-during-nig… <https://urldefense.proofpoint.com/v2/url?u=https-3A__siouxcityjournal.com_n…> > Our OSP staff said that Zayo was the laggard on the required moves. > > Frank > > -----Original Message----- > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of AnthonyAnderberg(a)nuvera.net <mailto:AnthonyAnderberg@nuvera.net> > Sent: Monday, September 09, 2019 4:21 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> > Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? > > We've got a link in NW Iowa down as well, we're on the same (former Neutral Path) link as you guys to Sioux City - so it's someplace between Sioux City, IA and Windom, MN. > > > > On 9/9/19, 4:02 PM, "MICE Discuss on behalf of James Urwiller" <MICE-DISCUSS(a)LISTS.IPHOUSE.NET on behalf of james.urwiller(a)TURNKEY-TELECOM.COM <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET%20on%20behalf%20of%20james.urwiller@TURNKEY-TELECOM.COM>> wrote: > > YES SIR! > > James Urwiller > Network Architect > Stealth Broadband > james.urwiller(a)stealthbroadband.com <mailto:james.urwiller@stealthbroadband.com> > > > -----Original Message----- > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank > Bulk > Sent: Monday, September 9, 2019 16:02 > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> > Subject: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? > > Bounce and then down. > > Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical > (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), to > Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet > Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, > 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 > 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link > (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine via > WIT for MICE > > Frank > > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1>

Sept. 10, 2019

Re: Anyone else down to Belle Plain since 3:45 pm?

by Frank Bulk

I’ve asked our OSP if he had any local knowledge, but he’s not aware. I will alert our Hinton field tech just in case he hears anything about it. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of James Urwiller Sent: Monday, September 9, 2019 8:33 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? So is it common for IA/MN construction to hit things all willy nilly without locates? Or is this another botched locate job? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 20:30 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? More detail in Zayo’s last update at 8:08 pm We apologize for the delayed update. We've spoken with our OSP PM and have been advised that the splice crew's ETA to the site is still about 1 to 1.5 hours and the ETTR is 4.5 to 5 hours. The damage was caused by a construction crew and the damage area is south of Hinton, IA around County Rd 60 and Iowa State Rd 75. Additional information to follow once the splice crew is on site. So it does seem related to the Hwy 75 re-construction project. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Krejci Sent: Monday, September 9, 2019 6:13 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? I heard it is out somewhere between Sioux City and Alton, so it definitely could be that IDOT construction zone. We don't have growing pains we have Zayo pains. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of Frank Bulk <fbulk(a)MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> Sent: Monday, September 9, 2019 4:37 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Could be part of the Hwy 75 project: https://siouxcityjournal.com/news/local/idot-to-close-us-highway-during-nig…<https://urldefense.proofpoint.com/v2/url?u=https-3A__siouxcityjournal.com_n…> Our OSP staff said that Zayo was the laggard on the required moves. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of AnthonyAnderberg(a)nuvera.net<mailto:AnthonyAnderberg@nuvera.net> Sent: Monday, September 09, 2019 4:21 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? We've got a link in NW Iowa down as well, we're on the same (former Neutral Path) link as you guys to Sioux City - so it's someplace between Sioux City, IA and Windom, MN. On 9/9/19, 4:02 PM, "MICE Discuss on behalf of James Urwiller" <MICE-DISCUSS(a)LISTS.IPHOUSE.NET on behalf of james.urwiller(a)TURNKEY-TELECOM.COM<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET%20on%20behalf%20of%20james.urwiller@TURNKEY-TELECOM.COM>> wrote: YES SIR! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 16:02 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Bounce and then down. Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine via WIT for MICE Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

Sept. 10, 2019

Re: Anyone else down to Belle Plain since 3:45 pm?

by James Urwiller

So is it common for IA/MN construction to hit things all willy nilly without locates? Or is this another botched locate job? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Frank Bulk *Sent:* Monday, September 9, 2019 20:30 *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? More detail in Zayo’s last update at 8:08 pm *We apologize for the delayed update. We've spoken with our OSP PM and have been advised that the splice crew's ETA to the site is still about 1 to 1.5 hours and the ETTR is 4.5 to 5 hours. The damage was caused by a construction crew and the damage area is south of Hinton, IA around County Rd 60 and Iowa State Rd 75. Additional information to follow once the splice crew is on site.* So it does seem related to the Hwy 75 re-construction project. Frank *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Justin Krejci *Sent:* Monday, September 9, 2019 6:13 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? I heard it is out somewhere between Sioux City and Alton, so it definitely could be that IDOT construction zone. We don't have growing pains we have Zayo pains. ------------------------------ *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Frank Bulk <fbulk(a)MYPREMIERONLINE.COM> *Sent:* Monday, September 9, 2019 4:37 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Could be part of the Hwy 75 project: https://siouxcityjournal.com/news/local/idot-to-close-us-highway-during-nig… <https://urldefense.proofpoint.com/v2/url?u=https-3A__siouxcityjournal.com_n…> Our OSP staff said that Zayo was the laggard on the required moves. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of AnthonyAnderberg(a)nuvera.net Sent: Monday, September 09, 2019 4:21 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? We've got a link in NW Iowa down as well, we're on the same (former Neutral Path) link as you guys to Sioux City - so it's someplace between Sioux City, IA and Windom, MN. On 9/9/19, 4:02 PM, "MICE Discuss on behalf of James Urwiller" <MICE-DISCUSS(a)LISTS.IPHOUSE.NET on behalf of james.urwiller(a)TURNKEY-TELECOM.COM> wrote: YES SIR! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 16:02 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Bounce and then down. Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine via WIT for MICE Frank ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Sept. 10, 2019

Re: Anyone else down to Belle Plain since 3:45 pm?

by Frank Bulk

More detail in Zayo’s last update at 8:08 pm We apologize for the delayed update. We've spoken with our OSP PM and have been advised that the splice crew's ETA to the site is still about 1 to 1.5 hours and the ETTR is 4.5 to 5 hours. The damage was caused by a construction crew and the damage area is south of Hinton, IA around County Rd 60 and Iowa State Rd 75. Additional information to follow once the splice crew is on site. So it does seem related to the Hwy 75 re-construction project. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Justin Krejci Sent: Monday, September 9, 2019 6:13 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? I heard it is out somewhere between Sioux City and Alton, so it definitely could be that IDOT construction zone. We don't have growing pains we have Zayo pains. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of Frank Bulk <fbulk(a)MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> Sent: Monday, September 9, 2019 4:37 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Could be part of the Hwy 75 project: https://siouxcityjournal.com/news/local/idot-to-close-us-highway-during-nig…<https://urldefense.proofpoint.com/v2/url?u=https-3A__siouxcityjournal.com_n…> Our OSP staff said that Zayo was the laggard on the required moves. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of AnthonyAnderberg(a)nuvera.net<mailto:AnthonyAnderberg@nuvera.net> Sent: Monday, September 09, 2019 4:21 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? We've got a link in NW Iowa down as well, we're on the same (former Neutral Path) link as you guys to Sioux City - so it's someplace between Sioux City, IA and Windom, MN. On 9/9/19, 4:02 PM, "MICE Discuss on behalf of James Urwiller" <MICE-DISCUSS(a)LISTS.IPHOUSE.NET on behalf of james.urwiller(a)TURNKEY-TELECOM.COM<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET%20on%20behalf%20of%20james.urwiller@TURNKEY-TELECOM.COM>> wrote: YES SIR! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 16:02 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Bounce and then down. Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine via WIT for MICE Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

Sept. 10, 2019

Re: Anyone else down to Belle Plain since 3:45 pm?

by James Urwiller

Anyone that can provide transport from Fremont to Omaha NOT on Zayo? I’m ready to jump ship James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Justin Krejci *Sent:* Monday, September 9, 2019 18:13 *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? I heard it is out somewhere between Sioux City and Alton, so it definitely could be that IDOT construction zone. We don't have growing pains we have Zayo pains. ------------------------------ *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Frank Bulk <fbulk(a)MYPREMIERONLINE.COM> *Sent:* Monday, September 9, 2019 4:37 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Could be part of the Hwy 75 project: https://siouxcityjournal.com/news/local/idot-to-close-us-highway-during-nig… Our OSP staff said that Zayo was the laggard on the required moves. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of AnthonyAnderberg(a)nuvera.net Sent: Monday, September 09, 2019 4:21 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? We've got a link in NW Iowa down as well, we're on the same (former Neutral Path) link as you guys to Sioux City - so it's someplace between Sioux City, IA and Windom, MN. On 9/9/19, 4:02 PM, "MICE Discuss on behalf of James Urwiller" <MICE-DISCUSS(a)LISTS.IPHOUSE.NET on behalf of james.urwiller(a)TURNKEY-TELECOM.COM> wrote: YES SIR! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 16:02 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Bounce and then down. Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine via WIT for MICE Frank ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Sept. 9, 2019

Re: Anyone else down to Belle Plain since 3:45 pm?

by Justin Krejci

I heard it is out somewhere between Sioux City and Alton, so it definitely could be that IDOT construction zone. We don't have growing pains we have Zayo pains. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Frank Bulk <fbulk(a)MYPREMIERONLINE.COM> Sent: Monday, September 9, 2019 4:37 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Could be part of the Hwy 75 project: https://siouxcityjournal.com/news/local/idot-to-close-us-highway-during-nig… Our OSP staff said that Zayo was the laggard on the required moves. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of AnthonyAnderberg(a)nuvera.net Sent: Monday, September 09, 2019 4:21 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? We've got a link in NW Iowa down as well, we're on the same (former Neutral Path) link as you guys to Sioux City - so it's someplace between Sioux City, IA and Windom, MN. ?On 9/9/19, 4:02 PM, "MICE Discuss on behalf of James Urwiller" <MICE-DISCUSS(a)LISTS.IPHOUSE.NET on behalf of james.urwiller(a)TURNKEY-TELECOM.COM> wrote: YES SIR! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 16:02 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Bounce and then down. Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine via WIT for MICE Frank

Sept. 9, 2019

Re: Anyone else down to Belle Plain since 3:45 pm?

by Frank Bulk

Could be part of the Hwy 75 project: https://siouxcityjournal.com/news/local/idot-to-close-us-highway-during-nig… Our OSP staff said that Zayo was the laggard on the required moves. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of AnthonyAnderberg(a)nuvera.net Sent: Monday, September 09, 2019 4:21 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? We've got a link in NW Iowa down as well, we're on the same (former Neutral Path) link as you guys to Sioux City - so it's someplace between Sioux City, IA and Windom, MN. On 9/9/19, 4:02 PM, "MICE Discuss on behalf of James Urwiller" <MICE-DISCUSS(a)LISTS.IPHOUSE.NET on behalf of james.urwiller(a)TURNKEY-TELECOM.COM> wrote: YES SIR! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 16:02 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Bounce and then down. Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine via WIT for MICE Frank

Sept. 9, 2019

Re: Anyone else down to Belle Plain since 3:45 pm?

by AnthonyAnderberg＠nuvera.net

We've got a link in NW Iowa down as well, we're on the same (former Neutral Path) link as you guys to Sioux City - so it's someplace between Sioux City, IA and Windom, MN. On 9/9/19, 4:02 PM, "MICE Discuss on behalf of James Urwiller" <MICE-DISCUSS(a)LISTS.IPHOUSE.NET on behalf of james.urwiller(a)TURNKEY-TELECOM.COM> wrote: YES SIR! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 16:02 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Bounce and then down. Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine via WIT for MICE Frank

Sept. 9, 2019

Re: Anyone else down to Belle Plain since 3:45 pm?

by James Urwiller

YES SIR! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, September 9, 2019 16:02 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Anyone else down to Belle Plain since 3:45 pm? Bounce and then down. Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine via WIT for MICE Frank

Sept. 9, 2019

Anyone else down to Belle Plain since 3:45 pm?

by Frank Bulk

Bounce and then down. Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine via WIT for MICE Frank

Sept. 9, 2019

Re: Could I have a MICE admin look at the route reflectors?

by Frank Bulk

Good news -- Jeremy identified an issue in his transport that looks very similar to a Zayo issue he worked through in another link a few months ago, so he's opened up a ticket with Zayo. Thanks, Doug and Jeremy, for your help! Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Monday, September 09, 2019 8:33 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Could I have a MICE admin look at the route reflectors? Thanks, I will try to turn one of the two route-reflector sessions up this morning. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Doug McIntyre Sent: Sunday, September 08, 2019 11:32 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Could I have a MICE admin look at the route reflectors? Sure, I have commented out AS53347 for you now. Both IPv4 and IPv6 sessions. On Mon, Sep 09, 2019 at 02:15:18AM +0000, Frank Bulk wrote: >Doug, > >Thanks. We have been transitioning from AS53347 to AS18883 .... so if you can remove the AS55347 configuration on MICE's RR's, that would be great. > >Frank > >-----Original Message----- >From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Doug McIntyre >Sent: Saturday, September 7, 2019 4:15 PM >To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET >Subject: Re: [MICE-DISCUSS] Could I have a MICE admin look at the route reflectors? > >On Fri, Sep 06, 2019 at 11:51:41PM +0000, Frank Bulk wrote: >>For some reason at 5:38 pm we (AS18883, FiberNet) lost IPv4 and IPv6 peering with both of MICE RR's and Hurricane Electric and it's been unstable since then. >> >>All our other peers with MICE are fine. >> >>I didn't change any configuration, even though the "bad AS number" note in some of the error messages would suggest that. > > >We've been getting a lot of these.. > >Sep 3 18:02:14 micemn-01 bird6: NASN_18883: Received: Connection collision resolution >Sep 3 18:02:18 micemn-01 bird6: NASN_18883: Received: Connection collision resolution >Sep 3 18:02:23 micemn-01 bird6: NASN_18883: Received: Connection collision resolution >Sep 3 18:02:28 micemn-01 bird6: NASN_18883: Received: Connection collision resolution > > >And these > >2019-09-07 16:08:15 <RMT> NASN_53347: Error: Bad peer AS: 18883 > >As well as I suppose the expected > >2019-09-07 16:08:16 <RMT> NASN_18883: Received: Administrative shutdown >2019-09-07 16:08:20 <RMT> NASN_18883: Received: Administrative shutdown >2019-09-07 16:08:24 <RMT> NASN_18883: Received: Administrative shutdown > >If you have 18883 link shutdown. > >But with the first and second errors, I see you have two AS's, and two >IPs coming across Eth10 on the switch. The middle error message seems >to imply that the configuration we have setup for AS 53347 on >206.108.255.67 is receiving a peer attempt for 18883 which is >configured to talk on 206.108.255.133 on our side. > >Could these two be mixed up at all? > > > > >-- >Doug McIntyre <merlyn(a)iphouse.net> > ~.~ ipHouse ~.~ > Network Engineer/Provisioning/Jack of all Trades > -- Doug McIntyre <merlyn(a)iphouse.net> ~.~ ipHouse ~.~ Network Engineer/Provisioning/Jack of all Trades

Sept. 9, 2019

Re: Could I have a MICE admin look at the route reflectors?

by Frank Bulk

Thanks, I will try to turn one of the two route-reflector sessions up this morning. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Doug McIntyre Sent: Sunday, September 08, 2019 11:32 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Could I have a MICE admin look at the route reflectors? Sure, I have commented out AS53347 for you now. Both IPv4 and IPv6 sessions. On Mon, Sep 09, 2019 at 02:15:18AM +0000, Frank Bulk wrote: >Doug, > >Thanks. We have been transitioning from AS53347 to AS18883 .... so if you can remove the AS55347 configuration on MICE's RR's, that would be great. > >Frank > >-----Original Message----- >From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Doug McIntyre >Sent: Saturday, September 7, 2019 4:15 PM >To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET >Subject: Re: [MICE-DISCUSS] Could I have a MICE admin look at the route reflectors? > >On Fri, Sep 06, 2019 at 11:51:41PM +0000, Frank Bulk wrote: >>For some reason at 5:38 pm we (AS18883, FiberNet) lost IPv4 and IPv6 peering with both of MICE RR's and Hurricane Electric and it's been unstable since then. >> >>All our other peers with MICE are fine. >> >>I didn't change any configuration, even though the "bad AS number" note in some of the error messages would suggest that. > > >We've been getting a lot of these.. > >Sep 3 18:02:14 micemn-01 bird6: NASN_18883: Received: Connection collision resolution >Sep 3 18:02:18 micemn-01 bird6: NASN_18883: Received: Connection collision resolution >Sep 3 18:02:23 micemn-01 bird6: NASN_18883: Received: Connection collision resolution >Sep 3 18:02:28 micemn-01 bird6: NASN_18883: Received: Connection collision resolution > > >And these > >2019-09-07 16:08:15 <RMT> NASN_53347: Error: Bad peer AS: 18883 > >As well as I suppose the expected > >2019-09-07 16:08:16 <RMT> NASN_18883: Received: Administrative shutdown >2019-09-07 16:08:20 <RMT> NASN_18883: Received: Administrative shutdown >2019-09-07 16:08:24 <RMT> NASN_18883: Received: Administrative shutdown > >If you have 18883 link shutdown. > >But with the first and second errors, I see you have two AS's, and two >IPs coming across Eth10 on the switch. The middle error message seems >to imply that the configuration we have setup for AS 53347 on >206.108.255.67 is receiving a peer attempt for 18883 which is >configured to talk on 206.108.255.133 on our side. > >Could these two be mixed up at all? > > > > >-- >Doug McIntyre <merlyn(a)iphouse.net> > ~.~ ipHouse ~.~ > Network Engineer/Provisioning/Jack of all Trades > -- Doug McIntyre <merlyn(a)iphouse.net> ~.~ ipHouse ~.~ Network Engineer/Provisioning/Jack of all Trades

Sept. 9, 2019

Re: Could I have a MICE admin look at the route reflectors?

by Doug McIntyre

Sure, I have commented out AS53347 for you now. Both IPv4 and IPv6 sessions. On Mon, Sep 09, 2019 at 02:15:18AM +0000, Frank Bulk wrote: >Doug, > >Thanks. We have been transitioning from AS53347 to AS18883 .... so if you can remove the AS55347 configuration on MICE's RR's, that would be great. > >Frank > >-----Original Message----- >From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Doug McIntyre >Sent: Saturday, September 7, 2019 4:15 PM >To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET >Subject: Re: [MICE-DISCUSS] Could I have a MICE admin look at the route reflectors? > >On Fri, Sep 06, 2019 at 11:51:41PM +0000, Frank Bulk wrote: >>For some reason at 5:38 pm we (AS18883, FiberNet) lost IPv4 and IPv6 peering with both of MICE RR's and Hurricane Electric and it's been unstable since then. >> >>All our other peers with MICE are fine. >> >>I didn't change any configuration, even though the "bad AS number" note in some of the error messages would suggest that. > > >We've been getting a lot of these.. > >Sep 3 18:02:14 micemn-01 bird6: NASN_18883: Received: Connection collision resolution >Sep 3 18:02:18 micemn-01 bird6: NASN_18883: Received: Connection collision resolution >Sep 3 18:02:23 micemn-01 bird6: NASN_18883: Received: Connection collision resolution >Sep 3 18:02:28 micemn-01 bird6: NASN_18883: Received: Connection collision resolution > > >And these > >2019-09-07 16:08:15 <RMT> NASN_53347: Error: Bad peer AS: 18883 > >As well as I suppose the expected > >2019-09-07 16:08:16 <RMT> NASN_18883: Received: Administrative shutdown >2019-09-07 16:08:20 <RMT> NASN_18883: Received: Administrative shutdown >2019-09-07 16:08:24 <RMT> NASN_18883: Received: Administrative shutdown > >If you have 18883 link shutdown. > >But with the first and second errors, I see you have two AS's, and two >IPs coming across Eth10 on the switch. The middle error message seems >to imply that the configuration we have setup for AS 53347 on >206.108.255.67 is receiving a peer attempt for 18883 which is >configured to talk on 206.108.255.133 on our side. > >Could these two be mixed up at all? > > > > >-- >Doug McIntyre <merlyn(a)iphouse.net> > ~.~ ipHouse ~.~ > Network Engineer/Provisioning/Jack of all Trades > -- Doug McIntyre <merlyn(a)iphouse.net> ~.~ ipHouse ~.~ Network Engineer/Provisioning/Jack of all Trades

Sept. 9, 2019

Re: Could I have a MICE admin look at the route reflectors?

by Frank Bulk

Doug, Thanks. We have been transitioning from AS53347 to AS18883 .... so if you can remove the AS55347 configuration on MICE's RR's, that would be great. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Doug McIntyre Sent: Saturday, September 7, 2019 4:15 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Could I have a MICE admin look at the route reflectors? On Fri, Sep 06, 2019 at 11:51:41PM +0000, Frank Bulk wrote: >For some reason at 5:38 pm we (AS18883, FiberNet) lost IPv4 and IPv6 peering with both of MICE RR's and Hurricane Electric and it's been unstable since then. > >All our other peers with MICE are fine. > >I didn't change any configuration, even though the "bad AS number" note in some of the error messages would suggest that. We've been getting a lot of these.. Sep 3 18:02:14 micemn-01 bird6: NASN_18883: Received: Connection collision resolution Sep 3 18:02:18 micemn-01 bird6: NASN_18883: Received: Connection collision resolution Sep 3 18:02:23 micemn-01 bird6: NASN_18883: Received: Connection collision resolution Sep 3 18:02:28 micemn-01 bird6: NASN_18883: Received: Connection collision resolution And these 2019-09-07 16:08:15 <RMT> NASN_53347: Error: Bad peer AS: 18883 As well as I suppose the expected 2019-09-07 16:08:16 <RMT> NASN_18883: Received: Administrative shutdown 2019-09-07 16:08:20 <RMT> NASN_18883: Received: Administrative shutdown 2019-09-07 16:08:24 <RMT> NASN_18883: Received: Administrative shutdown If you have 18883 link shutdown. But with the first and second errors, I see you have two AS's, and two IPs coming across Eth10 on the switch. The middle error message seems to imply that the configuration we have setup for AS 53347 on 206.108.255.67 is receiving a peer attempt for 18883 which is configured to talk on 206.108.255.133 on our side. Could these two be mixed up at all? -- Doug McIntyre <merlyn(a)iphouse.net> ~.~ ipHouse ~.~ Network Engineer/Provisioning/Jack of all Trades

Sept. 9, 2019