- mice-discuss - lists.micemn.net

Re: Anyone else see their Zayo-based link to MICE go down?
by Jeff Dahna Sept. 25, 2019

Sept. 25, 2019

Zayo Ticket update:Current update, Zayo crews are currently dispatching to County Rd 35 near Roberts Ave Worthington, MN as this looks to be the location of the cut, OSP is en route and splice teams are also being dispatched. We apologize for any inconveniences and delays along the way and will continue to work towards resolution and provide updates as they are available. Regards Joshua Johnson NCC Technician (Fiber & Facilities) | Zayo Group

2 1

Re: Anyone else see their Zayo-based link to MICE go down?
by Jeff Dahna Sept. 25, 2019

Sept. 25, 2019

Our Zayo ticket case comments from Zayo: Wed 9/25/2019 9:51AM Your case has been associated to a higher level outage in the Zayo network affecting MN please standby for further updates Wed 9/25/2019 10:51AM Issues are still currently under investigation with our field teams

1 0

Re: Anyone else see their Zayo-based link to MICE go down?
by Jeff Dahna Sept. 25, 2019

Sept. 25, 2019

We show on graphing that Zayo is down hard to Omaha from Windom at 8:10am. Put a ticket in with Zayo and offered to OTDR from Windom south towards Omaha. Jeff Dahna Windomnet

3 3

Re: Anyone else see their Zayo-based link to MICE go down?
by Jeff Dahna Sept. 25, 2019

Sept. 25, 2019

I received word from another company on the Zayo Omaha route, that Zayo thinks it is a possible fiber cut in the Worthington, MN area. Zayo fiber crew going to investigate.

1 0

Re: Anyone else see their Zayo-based link to MICE go down?
by Jeff Dahna Sept. 25, 2019

Sept. 25, 2019

We cannot see the port at Bigelow, MN Zayo hut. So I'd say it is between Windom and Bigelow. Fiber cut or equipment failure/fat finger. Jeff Dahna Windomnet

1 0

Anyone else see their Zayo-based link to MICE go down?
by Frank Bulk Sept. 25, 2019

Sept. 25, 2019

Our 10G dropped at 8:10 am. Frank

6 6

Anyone else down to Belle Plain since 3:45 pm?
by Frank Bulk Sept. 24, 2019

Sept. 24, 2019

Bounce and then down. Sep 9 15:45:21 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:19 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:37 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Cleared), Link (Failure), Link failure, 2019-09-09 08:45:27 PM (GMT), to Belle Plaine via WIT for MICE Sep 9 15:45:52 Fibercomm, 10G Ethernet Term. ETH-1-1-4, Critical (Raised), Link (Failure), Link failure, 2019-09-09 08:45:49 PM (GMT), to Belle Plaine via WIT for MICE Frank

8 19

Zayo Bell Plaine
by Jeremy Lumby Sept. 20, 2019

Sept. 20, 2019

Just an FYI, I have received temperature alarms from the Zayo hut in Belle Plaine again. A ticket has been opened with Zayo Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com

1 0

BGP Optimizers
by David Farmer Sept. 19, 2019

Sept. 19, 2019

I found an interesting article in my LinkedIn feed last night on BGP Optimizers; https://www.itnews.com.au/news/bgp-optimisers-seem-a-good-idea-until-they-b… ? I'd be interesting if anyone in the MICE community is using a BGP Optimizer? Especially one that generates more specific prefixes in BGP. I don't want to expose anyone to ridicule, so please don't go there if anyone fesses up, even in jest, this needs to be treated seriously. However, if anyone is using a BGP Optimizer, especially one generating more specific prefixes, I think it would behoove the MICE community to put in extra defenses against propagating these more specific prefixes through the exchange and out to the Internet in general or even our own downstream customers. For example we could create a MICE-DROP BGP Community that we can tag any routes that should be dropped if they are (accidentally) announced to the MICE route server or to other MICE peers, such as these more specific routes created by a BGP Optimizer. Basically we would each add something to our routing policy, and on the MICE route servers too, looking for that BGP Community and immediately dropping any routes tag with it. Also, if anyone is using a BGP Optimizer in our community that would be a very good reason to accelerate IRR based router filtering for our exchange. Thanks. -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

5 6

Could I have a MICE admin look at the route reflectors?
by Frank Bulk Sept. 9, 2019

Sept. 9, 2019

For some reason at 5:38 pm we (AS18883, FiberNet) lost IPv4 and IPv6 peering with both of MICE RR's and Hurricane Electric and it's been unstable since then. All our other peers with MICE are fine. I didn't change any configuration, even though the "bad AS number" note in some of the error messages would suggest that. Any hints would be welcomed. I've shutdown those six sessions for now. Frank Sep 6 17:38:49 207.32.15.28 Rib: %BGP-3-NOTIFICATION: received from neighbor 2001:504:27::d1af:0:1 (AS 53679) 4/0 (Hold Timer Expired Error/Unspecified) 0 bytes Sep 6 17:38:49 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::d1af:0:1 (AS 53679) old state Established event RecvNotify new state Idle Sep 6 17:39:21 207.32.15.28 Rib: %BGP-3-NOTIFICATION: received from neighbor 2001:504:27::d1af:0:2 (AS 53679) 4/0 (Hold Timer Expired Error/Unspecified) 0 bytes Sep 6 17:39:21 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::d1af:0:2 (AS 53679) old state Established event RecvNotify new state Idle Sep 6 17:39:28 207.32.15.28 Rib: %BGP-3-NOTIFICATION: received from neighbor 206.108.255.1 (AS 53679) 4/0 (Hold Timer Expired Error/Unspecified) 0 bytes Sep 6 17:39:28 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.1 (AS 53679) old state Established event RecvNotify new state Idle Sep 6 17:39:28 207.32.15.28 Rib: %BGP-3-NOTIFICATION: received from neighbor 206.108.255.1 (AS 53679) 2/2 (Open Message Error/bad AS number) 4 bytes 0x000049c3 Sep 6 17:39:33 207.32.15.28 Rib: %BGP-3-NOTIFICATION: received from neighbor 206.108.255.2 (AS 53679) 4/0 (Hold Timer Expired Error/Unspecified) 0 bytes Sep 6 17:39:33 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.2 (AS 53679) old state Established event RecvNotify new state Idle Sep 6 17:39:36 207.32.15.28 Rib: %BGP-3-NOTIFICATION: received from neighbor 206.108.255.2 (AS 53679) 2/2 (Open Message Error/bad AS number) 4 bytes 0x000049c3 Sep 6 17:39:39 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::d1af:0:1 (AS 53679) old state OpenConfirm event RecvKeepAlive new state Established Sep 6 17:40:02 207.32.15.28 Rib: %BGP-3-NOTIFICATION: received from neighbor 2001:504:27::d1af:0:1 (AS 53679) 4/0 (Hold Timer Expired Error/Unspecified) 0 bytes Sep 6 17:40:02 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::d1af:0:1 (AS 53679) old state Established event RecvNotify new state Idle Sep 6 17:40:06 207.32.15.28 Rib: %BGP-3-NOTIFICATION: received from neighbor 2001:504:27::d1af:0:1 (AS 53679) 2/2 (Open Message Error/bad AS number) 4 bytes 0x0000d063 Sep 6 17:40:22 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.1 (AS 53679) old state OpenConfirm event RecvKeepAlive new state Established Sep 6 17:40:28 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.2 (AS 53679) old state OpenConfirm event RecvKeepAlive new state Established Sep 6 17:40:48 207.32.15.28 Rib: %BGP-3-NOTIFICATION: received from neighbor 206.108.255.1 (AS 53679) 4/0 (Hold Timer Expired Error/Unspecified) 0 bytes Sep 6 17:40:48 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.1 (AS 53679) old state Established event RecvNotify new state Idle Sep 6 17:41:46 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::d1af:0:1 (AS 53679) old state OpenConfirm event RecvKeepAlive new state Established Sep 6 17:41:51 207.32.15.28 Rib: %BGP-3-NOTIFICATION: received from neighbor 2001:504:27::d1af:0:2 (AS 53679) 4/0 (Hold Timer Expired Error/Unspecified) 0 bytes Sep 6 17:41:51 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::d1af:0:2 (AS 53679) old state Established event RecvNotify new state Idle Sep 6 17:42:00 207.32.15.28 Rib: %BGP-3-NOTIFICATION: received from neighbor 2001:504:27::d1af:0:2 (AS 53679) 2/2 (Open Message Error/bad AS number) 4 bytes 0x0000d063 Sep 6 17:42:33 207.32.15.28 Rib: %BGP-3-NOTIFICATION: received from neighbor 206.108.255.1 (AS 53679) 2/2 (Open Message Error/bad AS number) 4 bytes 0x000049c3 Sep 6 17:42:34 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.1 (AS 53679) old state OpenConfirm event RecvKeepAlive new state Established Sep 6 17:42:44 207.32.15.28 Rib: %BGP-3-NOTIFICATION: received from neighbor 2001:504:27::d1af:0:1 (AS 53679) 4/0 (Hold Timer Expired Error/Unspecified) 0 bytes Sep 6 17:42:44 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::d1af:0:1 (AS 53679) old state Established event RecvNotify new state Idle Sep 6 17:42:44 207.32.15.28 Rib: %BGP-3-NOTIFICATION: received from neighbor 2001:504:27::d1af:0:1 (AS 53679) 2/2 (Open Message Error/bad AS number) 4 bytes 0x0000d063 Sep 6 17:43:46 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::d1af:0:2 (AS 53679) old state OpenConfirm event RecvKeepAlive new state Established Sep 6 17:44:36 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.2 (AS 53679) old state OpenConfirm event RecvKeepAlive new state Established ... Sep 6 17:44:34 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::1b1b:0:1 (AS 6939) old state Established event RecvNotify new state Idle Sep 6 17:44:39 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::1b1b:0:1 (AS 6939) old state OpenConfirm event RecvKeepAlive new state Established Sep 6 17:46:15 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::1b1b:0:1 (AS 6939) old state Established event RecvNotify new state Idle Sep 6 17:50:54 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::1b1b:0:1 (AS 6939) old state Established event RecvNotify new state Idle Sep 6 17:50:57 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::1b1b:0:1 (AS 6939) old state OpenConfirm event RecvKeepAlive new state Established Sep 6 18:00:44 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.52 (AS 6939) old state Established event RecvNotify new state Idle Sep 6 18:00:49 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.52 (AS 6939) old state OpenConfirm event RecvKeepAlive new state Established Sep 6 18:04:53 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.52 (AS 6939) old state OpenConfirm event RecvKeepAlive new state Established Sep 6 18:11:03 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::1b1b:0:1 (AS 6939) old state Established event RecvNotify new state Idle Sep 6 18:11:06 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::1b1b:0:1 (AS 6939) old state OpenConfirm event RecvKeepAlive new state Established Sep 6 18:13:05 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::1b1b:0:1 (AS 6939) old state Established event RecvNotify new state Idle Sep 6 18:13:13 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::1b1b:0:1 (AS 6939) old state OpenConfirm event RecvKeepAlive new state Established Sep 6 18:14:37 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.52 (AS 6939) old state Established event RecvNotify new state Idle Sep 6 18:14:41 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.52 (AS 6939) old state OpenConfirm event RecvKeepAlive new state Established Sep 6 18:15:35 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::1b1b:0:1 (AS 6939) old state OpenConfirm event RecvKeepAlive new state Established Sep 6 18:23:11 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.52 (AS 6939) old state Established event RecvNotify new state Idle Sep 6 18:23:16 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.52 (AS 6939) old state OpenConfirm event RecvKeepAlive new state Established Sep 6 18:26:58 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.52 (AS 6939) old state OpenConfirm event RecvKeepAlive new state Established Sep 6 18:27:46 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::1b1b:0:1 (AS 6939) old state Established event RecvNotify new state Idle Sep 6 18:27:48 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::1b1b:0:1 (AS 6939) old state OpenConfirm event RecvKeepAlive new state Established Sep 6 18:33:58 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.52 (AS 6939) old state Established event RecvNotify new state Idle Sep 6 18:34:07 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.52 (AS 6939) old state OpenConfirm event RecvKeepAlive new state Established

3 7

zayo again?
by James Urwiller Sept. 6, 2019

Sept. 6, 2019

been seeing BGP seesion bounces sine around midnight. anyone else zayo2belleplaine??? Sent from my iPhone 7

4 6

US Internet - AS 10242 - Router Replacement
by Justin Krejci Sept. 6, 2019

Sept. 6, 2019

MICE, US Internet is shutting down BGP sessions for a few minutes to migrate the MICE connection onto a new router. BGP sessions will be re-established within a few minutes. This will be happening in the next few minutes after this email. Justin Krejci 952-253-3200 ? 1-800-US-INTERNET 12450 Wayzata Blvd. Suite 315 ? Minnetonka, MN 55305 [http://www.usinternet.com/img/usi-signature.png]

1 0

Of minor note
by Frank Bulk Aug. 27, 2019

Aug. 27, 2019

Our route logged these two items Monday morning with MICE's AS: Aug 19 10:35:41 207.32.15.28 Rib: mpbgp_recv_mpreach: peer 2001:504:27::d1af:0:2 (AS 53679) link-local next hop fe80::e2ac:f1ef:fe4b:d93b%10000 improper, ignoring this next-hop Aug 19 11:08:50 207.32.15.28 Rib: mpbgp_recv_mpreach: peer 2001:504:27::d1af:0:2 (AS 53679) link-local next hop fe80::e2ac:f1ef:fe4b:d93b%10000 improper, ignoring this next-hop Not sure what that was about. Frank

4 4

Can a PTR be created for Google IP?
by Frank Bulk Aug. 23, 2019

Aug. 23, 2019

Can a PTR be created for this IP: 206.108.255.141 (AS 15169: Google LLC, US) Frank

2 1

Saturated ports
by Darin Steffl Aug. 22, 2019

Aug. 22, 2019

Hey guys, Is there any policy in place for peers that let their ports saturate at 100% for an extended period of time? DCN looks like they could use an upgrade to their 10G port and not sure if anyone proactively reaches out to members when saturation occurs. Thanks http://micelg.usinternet.com/cacti/graph.php?rra_id=all&local_graph_id=582 -- Darin Steffl Minnesota WiFi www.mnwifi.com 507-634-WiFi <http://www.facebook.com/minnesotawifi> Like us on Facebook <http://www.facebook.com/minnesotawifi>

10 19

Re: 10G to MICE down
by Jeremy Lumby Aug. 21, 2019

Aug. 21, 2019

Since I was not getting straight answers from Zayo, I drove out to the Belle Plaine. The air conditioning has failed, and the temperature was over 110 degrees inside. There is a technician out here who is waiting on a HVAC repair company to come and fix the issue, and doing the best he can to ventilate until then Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> Date: 8/20/19 8:37 PM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 10G to MICE down _____ >From : James Urwiller [james.urwiller(a)TURNKEY-TELECOM.COM] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Tuesday, August 20 2019 20:37:47 my circuit just went down 7 minutes ago, was fine prior to 20:30 cst Sent from my iPhone 7 On Aug 20, 2019, at 20:01, Jeremy Lumby <jlumby(a)mnvoip.com> wrote: It is looking like it is something specific to Belle Plaine. I have a diverse back door in to there that is down as well. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Corey Hauer Sent: Tuesday, August 20, 2019 7:58 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 10G to MICE down Oddly, our 511 to Mankato 10 gig transit is on that route - and it up and running. Possibly Zayo restored the protect path we had been getting from Neutral Path after I complained they took away our protect when they re-groomed us onto Zayo's native network? Corey Hauer LTD Broadband On Tue, Aug 20, 2019 at 5:21 PM Frank Bulk <fbulk(a)mypremieronline.com> wrote: Thanks, Jeremy. Frank On Tue, Aug 20, 2019 at 6:21 PM -0500, "Jeremy Lumby" <jlumby(a)MNVOIP.COM> wrote: I lost all of my connectivity between 511 and and Belle Plaine, I have opened a ticket with zayo Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: Frank Bulk <fbulk(a)MYPREMIERONLINE.COM> Date: 8/20/19 6:13 PM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] 10G to MICE down _____ From : Frank Bulk [fbulk(a)MYPREMIERONLINE.COM] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Tuesday, August 20 2019 18:13:03 We saw our 10 gig to MICE go down around 6:00 p.m. my guess is somewhere between northwest Iowa and Belle Plaine? Frank _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_c gi-2Dbin_wa-3FSUBED1-3DMICE-2DDISCUSS-26A-3D1&d=DwMFaQ&c=euGZstcaTDllvim EN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=xqx0yD1kWOETi5_MVFlMPPxb5us_12870MpQFRgCE ns&m=wM8knctRo0vFYL_fdkMcJwcNyRsBtk8UgjHz2Nw-nxs&s=loEQf5Yrju3p5Ls-hg31L fqrXDNlukdtNG4i_QylD0o&e=> _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

5 8

Re: ADV: Re: [MICE-DISCUSS] 10G to MICE down
by Jeff Dahna Aug. 21, 2019

Aug. 21, 2019

It's a hut. I believe it has two units. Probably a double failure of the units. Jeff Dahna General Manager | City of Windom Telecom Dept-Windomnet On Aug 20, 2019 21:28, "Bahls, Dean" <dean.bahls(a)COOPERATIVE-NETWORKS.COM> wrote: They don’t have redundancy at that hut? Or is it just a cabinet? Dean On Tue, Aug 20, 2019 at 9:25 PM Jeremy Lumby <jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com>> wrote: Since I was not getting straight answers from Zayo, I drove out to the Belle Plaine. The air conditioning has failed, and the temperature was over 110 degrees inside. There is a technician out here who is waiting on a HVAC repair company to come and fix the issue, and doing the best he can to ventilate until then Jeremy Lumby Minnesota VoIP 9217 17th Ave S<https://www.google.com/maps/search/9217+17th+Ave+S+Suite+216+Bloomington+MN…> Suite 216<https://www.google.com/maps/search/9217+17th+Ave+S+Suite+216+Bloomington+MN…> Bloomington MN 55425<https://www.google.com/maps/search/9217+17th+Ave+S+Suite+216+Bloomington+MN…> Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com> -------- Original message -------- From: James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM<mailto:james.urwiller@TURNKEY-TELECOM.COM>> Date: 8/20/19 8:37 PM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] 10G to MICE down ________________________________ From : James Urwiller [james.urwiller(a)TURNKEY-TELECOM.COM<mailto:james.urwiller@TURNKEY-TELECOM.COM>] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> [MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] Date : Tuesday, August 20 2019 20:37:47 my circuit just went down 7 minutes ago, was fine prior to 20:30 cst Sent from my iPhone 7 On Aug 20, 2019, at 20:01, Jeremy Lumby <jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com>> wrote: It is looking like it is something specific to Belle Plaine. I have a diverse back door in to there that is down as well. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Corey Hauer Sent: Tuesday, August 20, 2019 7:58 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] 10G to MICE down Oddly, our 511 to Mankato 10 gig transit is on that route - and it up and running. Possibly Zayo restored the protect path we had been getting from Neutral Path after I complained they took away our protect when they re-groomed us onto Zayo's native network? Corey Hauer LTD Broadband On Tue, Aug 20, 2019 at 5:21 PM Frank Bulk <fbulk(a)mypremieronline.com<mailto:fbulk@mypremieronline.com>> wrote: Thanks, Jeremy. Frank On Tue, Aug 20, 2019 at 6:21 PM -0500, "Jeremy Lumby" <jlumby(a)MNVOIP.COM<mailto:jlumby@MNVOIP.COM>> wrote: I lost all of my connectivity between 511 and and Belle Plaine, I have opened a ticket with zayo Jeremy Lumby Minnesota VoIP 9217 17th Ave S<https://www.google.com/maps/search/9217+17th+Ave+S+Suite+216+Bloomington+MN…> Suite 216<https://www.google.com/maps/search/9217+17th+Ave+S+Suite+216+Bloomington+MN…> Bloomington MN 55425<https://www.google.com/maps/search/9217+17th+Ave+S+Suite+216+Bloomington+MN…> Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com> -------- Original message -------- From: Frank Bulk <fbulk(a)MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> Date: 8/20/19 6:13 PM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] 10G to MICE down ________________________________ From : Frank Bulk [fbulk(a)MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> [MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] Date : Tuesday, August 20 2019 18:13:03 We saw our 10 gig to MICE go down around 6:00 p.m. my guess is somewhere between northwest Iowa and Belle Plaine? Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Dean Bahls Network Services Manager | Cooperative Network Services, LLC 14 Main St SW | P.O. Box J | Menahga, MN 56464 218.346.3635<http://218.346.3635> (Direct) | 218.564.3000<http://218.564.3000> (Main Office) dean.bahls(a)cooperative-networks.com<mailto:dean.bahls@cooperative-networks.com> [https://static.wixstatic.com/media/aee650_abad25e810ca4ee2a5f8908ac604fe4f~…] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

1 0

Re: 10G to MICE down
by Jeremy Lumby Aug. 21, 2019

Aug. 21, 2019

There are two air conditioners, and my guess was that no one was monitoring to see that one had failed a while ago Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: "Bahls, Dean" <dean.bahls(a)COOPERATIVE-NETWORKS.COM> Date: 8/20/19 9:27 PM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 10G to MICE down _____ >From : Bahls, Dean [dean.bahls(a)COOPERATIVE-NETWORKS.COM] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Tuesday, August 20 2019 21:27:41 They don’t have redundancy at that hut? Or is it just a cabinet? Dean On Tue, Aug 20, 2019 at 9:25 PM Jeremy Lumby <jlumby(a)mnvoip.com> wrote: Since I was not getting straight answers from Zayo, I drove out to the Belle Plaine. The air conditioning has failed, and the temperature was over 110 degrees inside. There is a technician out here who is waiting on a HVAC repair company to come and fix the issue, and doing the best he can to ventilate until then Jeremy Lumby Minnesota VoIP 9217 17th Ave S <https://www.google.com/maps/search/9217+17th+Ave+S+Suite+216+Bloomingto n+MN+55425?entry=gmail&source=g> Suite 216 <https://www.google.com/maps/search/9217+17th+Ave+S+Suite+216+Bloomingto n+MN+55425?entry=gmail&source=g> Bloomington MN 55425 <https://www.google.com/maps/search/9217+17th+Ave+S+Suite+216+Bloomingto n+MN+55425?entry=gmail&source=g> Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> Date: 8/20/19 8:37 PM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 10G to MICE down _____ From : James Urwiller [james.urwiller(a)TURNKEY-TELECOM.COM] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Tuesday, August 20 2019 20:37:47 my circuit just went down 7 minutes ago, was fine prior to 20:30 cst Sent from my iPhone 7 On Aug 20, 2019, at 20:01, Jeremy Lumby <jlumby(a)mnvoip.com> wrote: It is looking like it is something specific to Belle Plaine. I have a diverse back door in to there that is down as well. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Corey Hauer Sent: Tuesday, August 20, 2019 7:58 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 10G to MICE down Oddly, our 511 to Mankato 10 gig transit is on that route - and it up and running. Possibly Zayo restored the protect path we had been getting from Neutral Path after I complained they took away our protect when they re-groomed us onto Zayo's native network? Corey Hauer LTD Broadband On Tue, Aug 20, 2019 at 5:21 PM Frank Bulk <fbulk(a)mypremieronline.com> wrote: Thanks, Jeremy. Frank On Tue, Aug 20, 2019 at 6:21 PM -0500, "Jeremy Lumby" <jlumby(a)MNVOIP.COM> wrote: I lost all of my connectivity between 511 and and Belle Plaine, I have opened a ticket with zayo Jeremy Lumby Minnesota VoIP 9217 17th Ave S <https://www.google.com/maps/search/9217+17th+Ave+S+Suite+216+Bloomingto n+MN+55425?entry=gmail&source=g> Suite 216 <https://www.google.com/maps/search/9217+17th+Ave+S+Suite+216+Bloomingto n+MN+55425?entry=gmail&source=g> Bloomington MN 55425 <https://www.google.com/maps/search/9217+17th+Ave+S+Suite+216+Bloomingto n+MN+55425?entry=gmail&source=g> Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: Frank Bulk <fbulk(a)MYPREMIERONLINE.COM> Date: 8/20/19 6:13 PM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] 10G to MICE down _____ From : Frank Bulk [fbulk(a)MYPREMIERONLINE.COM] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Tuesday, August 20 2019 18:13:03 We saw our 10 gig to MICE go down around 6:00 p.m. my guess is somewhere between northwest Iowa and Belle Plaine? Frank _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_c gi-2Dbin_wa-3FSUBED1-3DMICE-2DDISCUSS-26A-3D1&d=DwMFaQ&c=euGZstcaTDllvim EN8b7jXrwqOf-v5A_CdpgnVfiiMM&r=xqx0yD1kWOETi5_MVFlMPPxb5us_12870MpQFRgCE ns&m=wM8knctRo0vFYL_fdkMcJwcNyRsBtk8UgjHz2Nw-nxs&s=loEQf5Yrju3p5Ls-hg31L fqrXDNlukdtNG4i_QylD0o&e=> _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Dean Bahls Network Services Manager | Cooperative Network Services, LLC 14 Main St SW | P.O. Box J | Menahga, MN 56464 218.346.3635 (Direct) | 218.564.3000 (Main Office) dean.bahls(a)cooperative-networks.com <https://static.wixstatic.com/media/aee650_abad25e810ca4ee2a5f8908ac604f e4f~mv2.png/v1/fill/w_461,h_83,al_c,usm_0.66_1.00_0.01/aee650_abad25e810 ca4ee2a5f8908ac604fe4f~mv2.png> _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

1 0

Re: 10G to MICE down
by Jeremy Lumby Aug. 21, 2019

Aug. 21, 2019

I lost all of my connectivity between 511 and and Belle Plaine, I have opened a ticket with zayo Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: Frank Bulk <fbulk(a)MYPREMIERONLINE.COM> Date: 8/20/19 6:13 PM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] 10G to MICE down _____ >From : Frank Bulk [fbulk(a)MYPREMIERONLINE.COM] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Tuesday, August 20 2019 18:13:03 We saw our 10 gig to MICE go down around 6:00 p.m. my guess is somewhere between northwest Iowa and Belle Plaine? Frank

4 4

10G to MICE down
by Frank Bulk Aug. 21, 2019

Aug. 21, 2019

We saw our 10 gig to MICE go down around 6:00 p.m. my guess is somewhere between northwest Iowa and Belle Plaine? Frank

3 3

MICE Google Cache Disconnected
by Jay Hanke Aug. 20, 2019

Aug. 20, 2019

Google has moved all cache traffic off of the cache and onto their new backbone links. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

1 0

Another Zayo fiber cut?
by Frank Bulk Aug. 17, 2019

Aug. 17, 2019

I don't see any alarms, but I did receive notification from Zayo about an outage. I also saw some BGP activity for NebraskaLink and notification on facebook about Long Lines having lost one of their links. Frank

8 9

SFN MICE Remote
by Jay Hanke Aug. 13, 2019

Aug. 13, 2019

There is a fiber cut between Owatonna and Rochester affecting the MICE remote switch. No ETA yet on repair. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

4 7

Google AS15169 at MICE is up
by Dave Schwartz Aug. 12, 2019

Aug. 12, 2019

Hi MICE Participants, Our 100G link from AS15169 to MICE is now live. We are peered and announcing/accepting routes from the route server. We welcome you to request public peering with us. Public peering with Google is encouraged as we do not announce all prefixes to our route server, only summary routes. We do however announce all Google prefixes on our direct IX peering sessions. When you peer with us you also will be able to obtain access to the Google ISP Portal where you can manage your traffic, view your networks YouTube performance, among other features. There are two ways to request public peering. 1. If you already have access to the Google ISP Portal please visit tickets --> request new IX interconnection and submit your details on your ASN and IP. 2. If you do not have access to the ISP Portal please visit isp.google.com/iwantpeering . On the form select Peering --> IX Peering and select Minneapolis from the dropdown. In the comments section please notate that you are part of MICE. While we have paused IX peering due to IRR validation we will be reviewing MICE requests on a case by case basis for approval since we are changing ASNs. Please send me a direct message should you have any specific questions or concerns on your request. Thanks, Dave -- Dave Schwartz Peering & Content Distribution Google AS15169 daveschwartz(a)google.com +1-650-253-7615 +44 20 3820 9224

4 6

Re: Google AS15169 at MICE is up
by Jeremy Lumby Aug. 8, 2019

Aug. 8, 2019

Google is removing the cache from Minneapolis, so Chicago is your next best bet since 36040 is going away from Minneapolis Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: Darin Steffl <darin.steffl(a)MNWIFI.COM> Date: 8/8/19 6:33 PM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Google AS15169 at MICE is up _____ >From : Darin Steffl [darin.steffl(a)MNWIFI.COM] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Thursday, August 8 2019 18:33:18 Question on how this changes where YouTube traffic comes from... When we peered with 36040 before, it was mostly just YouTube traffic and it came from Google Cache nodes in MSP. Now that we turned down that peer and turned up 15169, it appears all traffic is now coming from Chicago instead of YouTube traffic staying local to MSP. I would expect YouTube to still come from local cache servers and other stuff like Gmail, Google Drive, etc. to come from Chicago. Is this expected behavior as I was hoping we didn't lose the performance benefit of having video traffic coming direct from MSP instead of CHI. Is there any benefit to continuing to peer with 36040 for YouTube out of MSP? Thanks On Wed, Aug 7, 2019 at 8:47 PM AnthonyAnderberg(a)nuvera.net <AnthonyAnderberg(a)nuvera.net> wrote: The interface was already graphing but I’ve just updated the weathermap now. Thanks for the reminder, anthony signature_522626184 From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Darin Steffl <darin.steffl(a)MNWIFI.COM> Reply-To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Date: Wednesday, August 7, 2019 at 5:32 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Google AS15169 at MICE is up Thanks for getting this turned up! I've submitted our request to migrate from 36040 to 15169. I checked the traffic graphs and I don't see the 15169 port in there yet, just the existing 36040. Is this supposed to be setup yet or does that typically follow a few days after the port is active? Thanks On Wed, Aug 7, 2019 at 4:56 PM Dave Schwartz <0000000aaf163ccf-dmarc-request(a)lists.iphouse.net> wrote: Hi MICE Participants, Our 100G link from AS15169 to MICE is now live. We are peered and announcing/accepting routes from the route server. We welcome you to request public peering with us. Public peering with Google is encouraged as we do not announce all prefixes to our route server, only summary routes. We do however announce all Google prefixes on our direct IX peering sessions. When you peer with us you also will be able to obtain access to the Google ISP Portal where you can manage your traffic, view your networks YouTube performance, among other features. There are two ways to request public peering. 1. If you already have access to the Google ISP Portal please visit tickets --> request new IX interconnection and submit your details on your ASN and IP. 2. If you do not have access to the ISP Portal please visit isp.google.com/iwantpeering <http://isp.google.com/iwantpeering> . On the form select Peering --> IX Peering and select Minneapolis from the dropdown. In the comments section please notate that you are part of MICE. While we have paused IX peering due to IRR validation we will be reviewing MICE requests on a case by case basis for approval since we are changing ASNs. Please send me a direct message should you have any specific questions or concerns on your request. Thanks, Dave -- Dave Schwartz Peering & Content Distribution Google AS15169 daveschwartz(a)google.com +1-650-253-7615 +44 20 3820 9224 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Darin Steffl Minnesota WiFi www.mnwifi.com <http://www.mnwifi.com/> 507-634-WiFi Image removed by sender. <http://www.facebook.com/minnesotawifi> Like us on Facebook <http://www.facebook.com/minnesotawifi> _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Darin Steffl Minnesota WiFi www.mnwifi.com <http://www.mnwifi.com/> 507-634-WiFi <http://www.facebook.com/minnesotawifi> Like us on Facebook <http://www.facebook.com/minnesotawifi> _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

1 0