- mice-discuss - lists.micemn.net

Re: RFC: Remote Switch in Duluth

by Justin Krejci

This message is one-part "no opposition" to this request as long as standard expectations and policies are adhered to. This message is also one-part "pulse check" as the list has been rather silent the last few weeks. Hopefully that just means no problems and everyone is busy taking care of their respective business. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Abhi Devireddy <abhi(a)DEVIREDDY.COM> Sent: Friday, May 11, 2018 5:30 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] RFC: Remote Switch in Duluth Good evening, I represent 2 different networks in different capacities, AS53740 (optbit, personal research and education) and AS3789 (Essentia Health, https://www.essentiahealth.org/about/) Both networks are based out of Duluth and neither of them are current members of MICE. A remote switch in Duluth would lower the barrier to entry for a number of organizations that provide regional content and resources. For AS3789, it would mean providing better access to telehealth resources in a traditionally underserved region where high latencies and low bandwidth have caused slow adoption. I would be in favor of a remote switch in Duluth. Thanks, Abhi -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Richard Laager Sent: Friday, May 11, 2018 2:52 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] RFC: Remote Switch in Duluth The following is from Ryan Goldberg of Compudyne: ---- Compudyne/AS47096 is interested in operating a MICE remote switch in Duluth. We have two 10G paths from 511 to Duluth (one on Charter, one on Enventis) in a ring of 5 Juniper MX boxes (2 at 511, 3 in Duluth - the 3 in Duluth are interconnected over dark fiber). We hit a little over 5G on 5min averages in total between the two 511<->Duluth legs. Latency is 4-5ms. We currently participate in MICE via MNVoip's extension, mainly because it makes more overall sense to pick up MICE + SIX + Denver + KC all on one interface (for now). We'd probable leave it like that for a while. For the proposed extension switch we'd do a two site VPLS config on the MXes, with on a fresh, dedicated 10gig port at 511 and corresponding 10gig port in Duluth. We'd start with an EX4200-24F in Duluth, and run the usual Juniper-y stuff (from http://micemn.net/technical.html) Initial participants would only be on 1gig ports on the 4200. As for location, we're currently leaning toward "the Missabe Building" at 227 W 1st St, Duluth, MN - this is our primary downtown Duluth POP, and aside from our fiber, and there's high-count fiber from at least 5 other carriers in the building. The space has dual AC and is backed by generator power. Upgrade path is 100G 511<->Duluth, at least on one leg. If business drives it, we'll just do it. Otherwise it's budgeted for next year. As for the switch, we'd move to a ex4550. ---- Without taking any position on this here yet, I'd like to highlight a couple of facts: The proposed transport is over a VPLS link (i.e. shared with other traffic, not a dedicated wave). In the past, and quite possibly still, we have had participants connected over shared links, but not entire remote switches. -- Richard

May 31, 2018

Re: RFC: Remote Switch in Duluth

by Abhi Devireddy

Good evening, I represent 2 different networks in different capacities, AS53740 (optbit, personal research and education) and AS3789 (Essentia Health, https://www.essentiahealth.org/about/) Both networks are based out of Duluth and neither of them are current members of MICE. A remote switch in Duluth would lower the barrier to entry for a number of organizations that provide regional content and resources. For AS3789, it would mean providing better access to telehealth resources in a traditionally underserved region where high latencies and low bandwidth have caused slow adoption. I would be in favor of a remote switch in Duluth. Thanks, Abhi -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Richard Laager Sent: Friday, May 11, 2018 2:52 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] RFC: Remote Switch in Duluth The following is from Ryan Goldberg of Compudyne: ---- Compudyne/AS47096 is interested in operating a MICE remote switch in Duluth. We have two 10G paths from 511 to Duluth (one on Charter, one on Enventis) in a ring of 5 Juniper MX boxes (2 at 511, 3 in Duluth – the 3 in Duluth are interconnected over dark fiber). We hit a little over 5G on 5min averages in total between the two 511<->Duluth legs. Latency is 4-5ms. We currently participate in MICE via MNVoip’s extension, mainly because it makes more overall sense to pick up MICE + SIX + Denver + KC all on one interface (for now). We’d probable leave it like that for a while. For the proposed extension switch we’d do a two site VPLS config on the MXes, with on a fresh, dedicated 10gig port at 511 and corresponding 10gig port in Duluth. We’d start with an EX4200-24F in Duluth, and run the usual Juniper-y stuff (from http://micemn.net/technical.html) Initial participants would only be on 1gig ports on the 4200. As for location, we’re currently leaning toward “the Missabe Building” at 227 W 1st St, Duluth, MN – this is our primary downtown Duluth POP, and aside from our fiber, and there’s high-count fiber from at least 5 other carriers in the building. The space has dual AC and is backed by generator power. Upgrade path is 100G 511<->Duluth, at least on one leg. If business drives it, we’ll just do it. Otherwise it’s budgeted for next year. As for the switch, we’d move to a ex4550. ---- Without taking any position on this here yet, I'd like to highlight a couple of facts: The proposed transport is over a VPLS link (i.e. shared with other traffic, not a dedicated wave). In the past, and quite possibly still, we have had participants connected over shared links, but not entire remote switches. -- Richard

May 11, 2018

RFC: Remote Switch in Duluth

by Richard Laager

The following is from Ryan Goldberg of Compudyne: ---- Compudyne/AS47096 is interested in operating a MICE remote switch in Duluth. We have two 10G paths from 511 to Duluth (one on Charter, one on Enventis) in a ring of 5 Juniper MX boxes (2 at 511, 3 in Duluth – the 3 in Duluth are interconnected over dark fiber). We hit a little over 5G on 5min averages in total between the two 511<->Duluth legs. Latency is 4-5ms. We currently participate in MICE via MNVoip’s extension, mainly because it makes more overall sense to pick up MICE + SIX + Denver + KC all on one interface (for now). We’d probable leave it like that for a while. For the proposed extension switch we’d do a two site VPLS config on the MXes, with on a fresh, dedicated 10gig port at 511 and corresponding 10gig port in Duluth. We’d start with an EX4200-24F in Duluth, and run the usual Juniper-y stuff (from http://micemn.net/technical.html) Initial participants would only be on 1gig ports on the 4200. As for location, we’re currently leaning toward “the Missabe Building” at 227 W 1st St, Duluth, MN – this is our primary downtown Duluth POP, and aside from our fiber, and there’s high-count fiber from at least 5 other carriers in the building. The space has dual AC and is backed by generator power. Upgrade path is 100G 511<->Duluth, at least on one leg. If business drives it, we’ll just do it. Otherwise it’s budgeted for next year. As for the switch, we’d move to a ex4550. ---- Without taking any position on this here yet, I'd like to highlight a couple of facts: The proposed transport is over a VPLS link (i.e. shared with other traffic, not a dedicated wave). In the past, and quite possibly still, we have had participants connected over shared links, but not entire remote switches. -- Richard

May 11, 2018

Re: Neutral Path link issue between Belle Plaine and MICE

by Jeremy Schmeichel

Splicing complete and NP is hands off for now, I’m sure a permanent repair will be done at a later date. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Saturday, May 05, 2018 5:35 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE I’m seeing BGP sessions restored and routes learned! Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Saturday, May 5, 2018 6:27 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Update received a few minutes ago: The splice crew is still in the process of installing the new cable. If everything goes according to plan, splicing will begin in about an hour. No ETR at this time, but we will continue to provide updates as they become available. Frank From: Frank Bulk Sent: Saturday, May 5, 2018 4:45 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Update received a few minutes ago: The splicing crew is now on site and are beginning to install the new cable. No ETR at this time. Frank From: Frank Bulk Sent: Saturday, May 5, 2018 2:59 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Last two updates from the NOC: 2:05 pm: Crews now have cable materials in-hand and should arrive at the site at approximately 3:30 pm central. It is estimated that the cable install will take at least 3.5 hours. Splicing will follow the install. Once splicing begins, an ETR might be available. 2:45 pm: Crews with the materials anticipate arriving at site in approximately 30 minutes. Is this the river crossing? https://www.google.com/maps/place/44%C2%B037'59.5%22N+93%C2%B045'56.7%22W/@44.6331841,-93.7745168,3083m/data=!3m2!1e3!4b1!4m14!1m7!3m6!1s0x87f5dfb93721879d:0x24b9fe962f7ae1fb!2sBelle+Plaine,+MN!3b1!8m2!3d44.6230409!4d-93.7684042!3m5!1s0x0:0x0!7e2!8m2!3d44.6331854!4d-93.7657624 Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Saturday, May 5, 2018 1:05 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE ☹ indeed. I just got off the phone with them, about an hour ago they determined the fiber across the river is completely compromised and they are working to get a temporary drop across the river to restore services. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Krejci Sent: Saturday, May 5, 2018 13:01 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Also, Neutral Path is now wholly owned by Zayo, FYI. :( -----Original Message----- From: anthonyanderberg(a)nu-telecom.net<mailto:anthonyanderberg@nu-telecom.net> [anthonyanderberg(a)NU-TELECOM.NET<mailto:anthonyanderberg@NU-TELECOM.NET>] Received: Saturday, 05 May 2018, 11:42AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> [MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE It looked like the river was quite high when I was through Belle Plaine yesterday, if that’s the location of the trouble I bet the crews are having to work around that huge mess. Sent from my iPhone On May 5, 2018, at 6:34 AM, Frank Bulk <fbulk(a)MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> wrote: I woke up this morning to see emails about our BGP sessions with MICE to be down. Look at alarms and graphs I see that the link from Belle Plaine to MICE is down since about 12:39 am. According to the NeutralPath NOC (operated by WINS?), something about how a temporary fiber fix for emergency fiber work failed? I wasn’t even aware of any emergency fiber work. The NOC said that a tech was dispatched and he was hoping they would be able to fix it in the next few hours. Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 6, 2018

Re: Neutral Path link issue between Belle Plaine and MICE

by Frank Bulk

I’m seeing BGP sessions restored and routes learned! Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Saturday, May 5, 2018 6:27 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Update received a few minutes ago: The splice crew is still in the process of installing the new cable. If everything goes according to plan, splicing will begin in about an hour. No ETR at this time, but we will continue to provide updates as they become available. Frank From: Frank Bulk Sent: Saturday, May 5, 2018 4:45 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: RE: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Update received a few minutes ago: The splicing crew is now on site and are beginning to install the new cable. No ETR at this time. Frank From: Frank Bulk Sent: Saturday, May 5, 2018 2:59 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Last two updates from the NOC: 2:05 pm: Crews now have cable materials in-hand and should arrive at the site at approximately 3:30 pm central. It is estimated that the cable install will take at least 3.5 hours. Splicing will follow the install. Once splicing begins, an ETR might be available. 2:45 pm: Crews with the materials anticipate arriving at site in approximately 30 minutes. Is this the river crossing? https://www.google.com/maps/place/44%C2%B037'59.5%22N+93%C2%B045'56.7%22W/@44.6331841,-93.7745168,3083m/data=!3m2!1e3!4b1!4m14!1m7!3m6!1s0x87f5dfb93721879d:0x24b9fe962f7ae1fb!2sBelle+Plaine,+MN!3b1!8m2!3d44.6230409!4d-93.7684042!3m5!1s0x0:0x0!7e2!8m2!3d44.6331854!4d-93.7657624 Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Saturday, May 5, 2018 1:05 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE ☹ indeed. I just got off the phone with them, about an hour ago they determined the fiber across the river is completely compromised and they are working to get a temporary drop across the river to restore services. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Krejci Sent: Saturday, May 5, 2018 13:01 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Also, Neutral Path is now wholly owned by Zayo, FYI. :( -----Original Message----- From: anthonyanderberg(a)nu-telecom.net<mailto:anthonyanderberg@nu-telecom.net> [anthonyanderberg(a)NU-TELECOM.NET<mailto:anthonyanderberg@NU-TELECOM.NET>] Received: Saturday, 05 May 2018, 11:42AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> [MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE It looked like the river was quite high when I was through Belle Plaine yesterday, if that’s the location of the trouble I bet the crews are having to work around that huge mess. Sent from my iPhone On May 5, 2018, at 6:34 AM, Frank Bulk <fbulk(a)MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> wrote: I woke up this morning to see emails about our BGP sessions with MICE to be down. Look at alarms and graphs I see that the link from Belle Plaine to MICE is down since about 12:39 am. According to the NeutralPath NOC (operated by WINS?), something about how a temporary fiber fix for emergency fiber work failed? I wasn’t even aware of any emergency fiber work. The NOC said that a tech was dispatched and he was hoping they would be able to fix it in the next few hours. Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 5, 2018

Re: Neutral Path link issue between Belle Plaine and MICE

by Frank Bulk

Update received a few minutes ago: The splice crew is still in the process of installing the new cable. If everything goes according to plan, splicing will begin in about an hour. No ETR at this time, but we will continue to provide updates as they become available. Frank From: Frank Bulk Sent: Saturday, May 5, 2018 4:45 PM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Update received a few minutes ago: The splicing crew is now on site and are beginning to install the new cable. No ETR at this time. Frank From: Frank Bulk Sent: Saturday, May 5, 2018 2:59 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: RE: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Last two updates from the NOC: 2:05 pm: Crews now have cable materials in-hand and should arrive at the site at approximately 3:30 pm central. It is estimated that the cable install will take at least 3.5 hours. Splicing will follow the install. Once splicing begins, an ETR might be available. 2:45 pm: Crews with the materials anticipate arriving at site in approximately 30 minutes. Is this the river crossing? https://www.google.com/maps/place/44%C2%B037'59.5%22N+93%C2%B045'56.7%22W/@44.6331841,-93.7745168,3083m/data=!3m2!1e3!4b1!4m14!1m7!3m6!1s0x87f5dfb93721879d:0x24b9fe962f7ae1fb!2sBelle+Plaine,+MN!3b1!8m2!3d44.6230409!4d-93.7684042!3m5!1s0x0:0x0!7e2!8m2!3d44.6331854!4d-93.7657624 Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Saturday, May 5, 2018 1:05 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE ☹ indeed. I just got off the phone with them, about an hour ago they determined the fiber across the river is completely compromised and they are working to get a temporary drop across the river to restore services. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Krejci Sent: Saturday, May 5, 2018 13:01 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Also, Neutral Path is now wholly owned by Zayo, FYI. :( -----Original Message----- From: anthonyanderberg(a)nu-telecom.net<mailto:anthonyanderberg@nu-telecom.net> [anthonyanderberg(a)NU-TELECOM.NET<mailto:anthonyanderberg@NU-TELECOM.NET>] Received: Saturday, 05 May 2018, 11:42AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> [MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE It looked like the river was quite high when I was through Belle Plaine yesterday, if that’s the location of the trouble I bet the crews are having to work around that huge mess. Sent from my iPhone On May 5, 2018, at 6:34 AM, Frank Bulk <fbulk(a)MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> wrote: I woke up this morning to see emails about our BGP sessions with MICE to be down. Look at alarms and graphs I see that the link from Belle Plaine to MICE is down since about 12:39 am. According to the NeutralPath NOC (operated by WINS?), something about how a temporary fiber fix for emergency fiber work failed? I wasn’t even aware of any emergency fiber work. The NOC said that a tech was dispatched and he was hoping they would be able to fix it in the next few hours. Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 5, 2018

Re: Neutral Path link issue between Belle Plaine and MICE

by Frank Bulk

Update received a few minutes ago: The splicing crew is now on site and are beginning to install the new cable. No ETR at this time. Frank From: Frank Bulk Sent: Saturday, May 5, 2018 2:59 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: RE: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Last two updates from the NOC: 2:05 pm: Crews now have cable materials in-hand and should arrive at the site at approximately 3:30 pm central. It is estimated that the cable install will take at least 3.5 hours. Splicing will follow the install. Once splicing begins, an ETR might be available. 2:45 pm: Crews with the materials anticipate arriving at site in approximately 30 minutes. Is this the river crossing? https://www.google.com/maps/place/44%C2%B037'59.5%22N+93%C2%B045'56.7%22W/@44.6331841,-93.7745168,3083m/data=!3m2!1e3!4b1!4m14!1m7!3m6!1s0x87f5dfb93721879d:0x24b9fe962f7ae1fb!2sBelle+Plaine,+MN!3b1!8m2!3d44.6230409!4d-93.7684042!3m5!1s0x0:0x0!7e2!8m2!3d44.6331854!4d-93.7657624 Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Saturday, May 5, 2018 1:05 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE ☹ indeed. I just got off the phone with them, about an hour ago they determined the fiber across the river is completely compromised and they are working to get a temporary drop across the river to restore services. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Krejci Sent: Saturday, May 5, 2018 13:01 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Also, Neutral Path is now wholly owned by Zayo, FYI. :( -----Original Message----- From: anthonyanderberg(a)nu-telecom.net<mailto:anthonyanderberg@nu-telecom.net> [anthonyanderberg(a)NU-TELECOM.NET<mailto:anthonyanderberg@NU-TELECOM.NET>] Received: Saturday, 05 May 2018, 11:42AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> [MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE It looked like the river was quite high when I was through Belle Plaine yesterday, if that’s the location of the trouble I bet the crews are having to work around that huge mess. Sent from my iPhone On May 5, 2018, at 6:34 AM, Frank Bulk <fbulk(a)MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> wrote: I woke up this morning to see emails about our BGP sessions with MICE to be down. Look at alarms and graphs I see that the link from Belle Plaine to MICE is down since about 12:39 am. According to the NeutralPath NOC (operated by WINS?), something about how a temporary fiber fix for emergency fiber work failed? I wasn’t even aware of any emergency fiber work. The NOC said that a tech was dispatched and he was hoping they would be able to fix it in the next few hours. Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 5, 2018

Re: Neutral Path link issue between Belle Plaine and MICE

by Frank Bulk

Last two updates from the NOC: 2:05 pm: Crews now have cable materials in-hand and should arrive at the site at approximately 3:30 pm central. It is estimated that the cable install will take at least 3.5 hours. Splicing will follow the install. Once splicing begins, an ETR might be available. 2:45 pm: Crews with the materials anticipate arriving at site in approximately 30 minutes. Is this the river crossing? https://www.google.com/maps/place/44%C2%B037'59.5%22N+93%C2%B045'56.7%22W/@44.6331841,-93.7745168,3083m/data=!3m2!1e3!4b1!4m14!1m7!3m6!1s0x87f5dfb93721879d:0x24b9fe962f7ae1fb!2sBelle+Plaine,+MN!3b1!8m2!3d44.6230409!4d-93.7684042!3m5!1s0x0:0x0!7e2!8m2!3d44.6331854!4d-93.7657624 Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of James Urwiller Sent: Saturday, May 5, 2018 1:05 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE ☹ indeed. I just got off the phone with them, about an hour ago they determined the fiber across the river is completely compromised and they are working to get a temporary drop across the river to restore services. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Krejci Sent: Saturday, May 5, 2018 13:01 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Also, Neutral Path is now wholly owned by Zayo, FYI. :( -----Original Message----- From: anthonyanderberg(a)nu-telecom.net<mailto:anthonyanderberg@nu-telecom.net> [anthonyanderberg(a)NU-TELECOM.NET<mailto:anthonyanderberg@NU-TELECOM.NET>] Received: Saturday, 05 May 2018, 11:42AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> [MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE It looked like the river was quite high when I was through Belle Plaine yesterday, if that’s the location of the trouble I bet the crews are having to work around that huge mess. Sent from my iPhone On May 5, 2018, at 6:34 AM, Frank Bulk <fbulk(a)MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> wrote: I woke up this morning to see emails about our BGP sessions with MICE to be down. Look at alarms and graphs I see that the link from Belle Plaine to MICE is down since about 12:39 am. According to the NeutralPath NOC (operated by WINS?), something about how a temporary fiber fix for emergency fiber work failed? I wasn’t even aware of any emergency fiber work. The NOC said that a tech was dispatched and he was hoping they would be able to fix it in the next few hours. Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 5, 2018

Re: Neutral Path link issue between Belle Plaine and MICE

by Frank Bulk

Fortunately, the NeutralPath NOC (operated by WINS) is still operating and not yet subsumed by Zayo. Last work from NOC: The original fiber bundle only had 10 functional fibers, so a temporary cable is being installed as of approximately 11:30 am central. After the install, splicing will occur which should then restore your service. No ETR is available yet. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Justin Krejci Sent: Saturday, May 5, 2018 1:01 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Also, Neutral Path is now wholly owned by Zayo, FYI. :( -----Original Message----- From: anthonyanderberg(a)nu-telecom.net<mailto:anthonyanderberg@nu-telecom.net> [anthonyanderberg(a)NU-TELECOM.NET] Received: Saturday, 05 May 2018, 11:42AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE It looked like the river was quite high when I was through Belle Plaine yesterday, if that's the location of the trouble I bet the crews are having to work around that huge mess. Sent from my iPhone On May 5, 2018, at 6:34 AM, Frank Bulk <fbulk(a)MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> wrote: I woke up this morning to see emails about our BGP sessions with MICE to be down. Look at alarms and graphs I see that the link from Belle Plaine to MICE is down since about 12:39 am. According to the NeutralPath NOC (operated by WINS?), something about how a temporary fiber fix for emergency fiber work failed? I wasn't even aware of any emergency fiber work. The NOC said that a tech was dispatched and he was hoping they would be able to fix it in the next few hours. Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 5, 2018

Re: Neutral Path link issue between Belle Plaine and MICE

by James Urwiller

☹ indeed. I just got off the phone with them, about an hour ago they determined the fiber across the river is completely compromised and they are working to get a temporary drop across the river to restore services. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Justin Krejci *Sent:* Saturday, May 5, 2018 13:01 *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE Also, Neutral Path is now wholly owned by Zayo, FYI. :( -----Original Message----- *From:* anthonyanderberg(a)nu-telecom.net [anthonyanderberg(a)NU-TELECOM.NET] *Received:* Saturday, 05 May 2018, 11:42AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] *Subject:* Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE It looked like the river was quite high when I was through Belle Plaine yesterday, if that’s the location of the trouble I bet the crews are having to work around that huge mess. Sent from my iPhone On May 5, 2018, at 6:34 AM, Frank Bulk <fbulk(a)MYPREMIERONLINE.COM> wrote: I woke up this morning to see emails about our BGP sessions with MICE to be down. Look at alarms and graphs I see that the link from Belle Plaine to MICE is down since about 12:39 am. According to the NeutralPath NOC (operated by WINS?), something about how a temporary fiber fix for emergency fiber work failed? I wasn’t even aware of any emergency fiber work. The NOC said that a tech was dispatched and he was hoping they would be able to fix it in the next few hours. Frank ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 5, 2018

Re: Neutral Path link issue between Belle Plaine and MICE

by Justin Krejci

Also, Neutral Path is now wholly owned by Zayo, FYI. :( -----Original Message----- From: anthonyanderberg(a)nu-telecom.net [anthonyanderberg(a)NU-TELECOM.NET] Received: Saturday, 05 May 2018, 11:42AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Subject: Re: [MICE-DISCUSS] Neutral Path link issue between Belle Plaine and MICE It looked like the river was quite high when I was through Belle Plaine yesterday, if that’s the location of the trouble I bet the crews are having to work around that huge mess. Sent from my iPhone On May 5, 2018, at 6:34 AM, Frank Bulk <fbulk(a)MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> wrote: I woke up this morning to see emails about our BGP sessions with MICE to be down. Look at alarms and graphs I see that the link from Belle Plaine to MICE is down since about 12:39 am. According to the NeutralPath NOC (operated by WINS?), something about how a temporary fiber fix for emergency fiber work failed? I wasn’t even aware of any emergency fiber work. The NOC said that a tech was dispatched and he was hoping they would be able to fix it in the next few hours. Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 5, 2018

Re: Neutral Path link issue between Belle Plaine and MICE

by anthonyanderberg＠nu-telecom.net

It looked like the river was quite high when I was through Belle Plaine yesterday, if that’s the location of the trouble I bet the crews are having to work around that huge mess. Sent from my iPhone On May 5, 2018, at 6:34 AM, Frank Bulk <fbulk(a)MYPREMIERONLINE.COM<mailto:fbulk@MYPREMIERONLINE.COM>> wrote: I woke up this morning to see emails about our BGP sessions with MICE to be down. Look at alarms and graphs I see that the link from Belle Plaine to MICE is down since about 12:39 am. According to the NeutralPath NOC (operated by WINS?), something about how a temporary fiber fix for emergency fiber work failed? I wasn’t even aware of any emergency fiber work. The NOC said that a tech was dispatched and he was hoping they would be able to fix it in the next few hours. Frank ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 5, 2018

Neutral Path link issue between Belle Plaine and MICE

by Frank Bulk

I woke up this morning to see emails about our BGP sessions with MICE to be down. Look at alarms and graphs I see that the link from Belle Plaine to MICE is down since about 12:39 am. According to the NeutralPath NOC (operated by WINS?), something about how a temporary fiber fix for emergency fiber work failed? I wasn't even aware of any emergency fiber work. The NOC said that a tech was dispatched and he was hoping they would be able to fix it in the next few hours. Frank

May 5, 2018

Re: MANRS IXP

by anthonyanderberg＠nu-telecom.net

I called into one of their presentations/discussions earlier in the spring - agree that they have many good ideas, and that although we’ve implemented some of their best practices many of the remaining ones will take effort - both collectively and individually by members. Anthony Anderberg Sr. Systems Analyst [NUtel_email_logo_1] 320-234-5239 anthonyanderberg(a)nu-telecom.net<mailto:anthonyanderberg@nu-telecom.net> www.nutelecom.net<http://www.nutelecom.net> From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of David Farmer Sent: Friday, April 27, 2018 8:28 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] MANRS IXP I would like to strongly encourage MICE's participation, but I believe we have work to do to make it happen. https://www.internetsociety.org/blog/2018/04/introducing-a-new-manrs-ixp-pr… https://www.manrs.org/participants/ixp/ Thanks -- =============================================== David Farmer Email:farmer@umn.edu<mailto:Email%3Afarmer@umn.edu> Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 =============================================== ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

April 27, 2018

MANRS IXP

by David Farmer

I would like to strongly encourage MICE's participation, but I believe we have work to do to make it happen. https://www.internetsociety.org/blog/2018/04/introducing-a-new-manrs-ixp-pr… https://www.manrs.org/participants/ixp/ Thanks -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

April 27, 2018

Re: CNS Satellite Cutover

by Dean Bahls

Good morning! The new CNS satellite has been cut into service. Traffic seems to be flowing normally. Holler if you see potential issues that we might have caused. Thanks, Dean From: Dean Bahls <dean.bahls(a)cooperative-networks.com> Sent: Wednesday, April 11, 2018 6:39 AM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: CNS Satellite Cutover Good morning MICEers! Sorry for the short notice, but CNS will be cutting to a new switch tomorrow morning (4/12/18) at around 10:00am. Yes, that seems like an odd time to do maintenance, but with all of the Netflix caching going on between 2:00am and 9:00am, this is about the slowest part of the day anymore. If you have questions, please feel free to contact me. Thank you! Dean Dean Bahls Network Services Manager | Cooperative Network Services, LLC 14 Main St SW | PO Box J | Menahga, MN 56464 218.346.3635 (Direct) | 218.564.3000 (Main Office) dean.bahls(a)cooperative-networks.com <mailto:dean.bahls@cooperative-networks.com>

April 12, 2018

CNS Satellite Cutover

by Dean Bahls

Good morning MICEers! Sorry for the short notice, but CNS will be cutting to a new switch tomorrow morning (4/12/18) at around 10:00am. Yes, that seems like an odd time to do maintenance, but with all of the Netflix caching going on between 2:00am and 9:00am, this is about the slowest part of the day anymore. If you have questions, please feel free to contact me. Thank you! Dean Dean Bahls Network Services Manager | Cooperative Network Services, LLC 14 Main St SW | PO Box J | Menahga, MN 56464 218.346.3635 (Direct) | 218.564.3000 (Main Office) dean.bahls(a)cooperative-networks.com <mailto:dean.bahls@cooperative-networks.com>

April 11, 2018

Re: Old MICE Traffic Levels

by Jason Hanke

The CNS Remote is has more traffic than MICE in 2013! :) On Tue, Apr 10, 2018 at 9:22 AM, Dean Bahls < dean.bahls(a)cooperative-networks.com> wrote: > CNS was quite a player back in the day, providing connections to Hurricane > Electric and the GigaPop! > > Dean > > > -----Original Message----- > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy > Lumby > Sent: Tuesday, April 10, 2018 9:17 AM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: [MICE-DISCUSS] Old MICE Traffic Levels > > I took the MICE display that was next to the Cologix Suite 200 entry in > order to update it. When I opened it I was surprised that on the back was > a previous version from when the MICE traffic was under 10G. It was a > great surprise, so I attached a picture for your appreciation of how far we > have come. I plan on keeping all previous versions on the back of the > frame to preserve some history. > > > Jeremy Lumby > Minnesota VoIP > 9217 17th Ave S > Suite 216 > Bloomington MN 55425 > Main 612-355-7740 > Direct 612-392-6814 > EFax 952-873-7425 > jlumby(a)mnvoip.com > -- Jay Hanke Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke@ <jayhanke(a)neutralpath.net>cneutral.net www.neutralpath.net

April 10, 2018

Re: Old MICE Traffic Levels

by Dean Bahls

CNS was quite a player back in the day, providing connections to Hurricane Electric and the GigaPop! Dean -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Tuesday, April 10, 2018 9:17 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Old MICE Traffic Levels I took the MICE display that was next to the Cologix Suite 200 entry in order to update it. When I opened it I was surprised that on the back was a previous version from when the MICE traffic was under 10G. It was a great surprise, so I attached a picture for your appreciation of how far we have come. I plan on keeping all previous versions on the back of the frame to preserve some history. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com

April 10, 2018

Re: Old MICE Traffic Levels

by Mike Horwath

On Tue, Apr 10, 2018 at 09:17:00AM -0500, Jeremy Lumby wrote: > I took the MICE display that was next to the Cologix Suite 200 entry > in order to update it. When I opened it I was surprised that on the > back was a previous version from when the MICE traffic was under > 10G. It was a great surprise, so I attached a picture for your > appreciation of how far we have come. I plan on keeping all > previous versions on the back of the frame to preserve some history. Awesome! -- Mike Horwath, reachable via drechsau(a)Geeks.ORG

April 10, 2018

Old MICE Traffic Levels

by Jeremy Lumby

I took the MICE display that was next to the Cologix Suite 200 entry in order to update it. When I opened it I was surprised that on the back was a previous version from when the MICE traffic was under 10G. It was a great surprise, so I attached a picture for your appreciation of how far we have come. I plan on keeping all previous versions on the back of the frame to preserve some history. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com

April 10, 2018

MN VoIP Extension switch link upgrade

by Jeremy Lumby

This maintenance has completed successfully. Let me know if anyone is experiencing any issues. -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Monday, April 02, 2018 2:32 PM To: MICE Discuss Subject: MN VoIP Extension switch link upgrade On Saturday 4/7/2018 at approx 2pm MN VoIP will be cutting the link to their MICE extension switch from 10G to 40G. BGP will be blocked ahead of time to allow traffic to gracefully reroute. The estimated downtime will be less than 5 minutes. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington, MN 55425 Main: 612-355-7740 x211 Direct: 612-392-6814 EFax: 952-873-7425 jlumby(a)mnvoip.com

April 7, 2018

Re: MICE Google Global cache issues?

by Frank Bulk

Yes, I’ve had the exact same issue on my Android smartphone – ad plays fine, but video does not. But these are mostly YT videos that are inline to a web page. If I opened up the video in YT itself it would play just fine. I’m also an IPv6 user. Just saw our peer with the GGC bounce. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Colin Murphy Sent: Wednesday, April 04, 2018 9:16 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] MICE Google Global cache issues? Hi, Since Monday we've been having issues with mobile devices accessing YouTube and Google Play store via IPv6. Our symptoms with YouTube app is mostly with Apple IOS devices. When a user loads a video, the ads will play fine and then the video will start and play for 5 seconds and stop. Browsing youtube via a web browser on the IOS devices seems fine. With Android devices, users can't download apps from the play store. Is anyone else experiencing these issues with their peering with the Google Global Cache at MICE? Thanks, Colin Murphy Sr. Network Engineer Office of Information Technology University of Minnesota Northern Lights Gigapop Desk: 612-626-0870 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

April 6, 2018

Re: MICE Google Global cache issues?

by Jeremy Lumby

I noticed my Google v6 traffic shifted to IX-Denver. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of David Farmer Sent: Thursday, April 05, 2018 10:33 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE Google Global cache issues? A heads up; We asked Google for an update on our ticket this evening. IPv6 problems for the MICE GGC seem to have returned today, based I our graphs probably around 10:00 am. Therefore, Google has temporarily redirected IPv6 traffic away from the MICE GGC, to Chicago in our case and I suspect most cases. Also, Google has escalated the issue internally, and with their switch vendor. We have some reports of IPv6 packet loss possibly in Chicago and probably earlier today. We'll be keeping an eye on this tomorrow. Also, I went back and looked at graphs for IPv6 traffic from the MICE GGC to us and this problem probably started last Wednesday. In most cases, I think Happy Eye Balls glossed over this, but if applications or OSes didn't do Happy Eye Balls then things probably broke. The saga continues... On Wed, Apr 4, 2018 at 12:17 PM, Colin Murphy <murphy(a)umn.edu> wrote: I saw that as well and we can now use YouTube and google play store. Thanks. Thanks, Colin Murphy Sr. Network Engineer Office of Information Technology University of Minnesota Northern Lights Gigapop Desk: 612-626-0870 On Wed, Apr 4, 2018 at 12:15 PM, Jeremy Lumby <jlumby(a)mnvoip.com> wrote: While I have not heard anything back from Google yet, I saw BGP to Google bounce, and I can now download app updates from the Google Play Store. From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Wednesday, April 04, 2018 9:32 AM To: MICE Discuss Subject: RE: [MICE-DISCUSS] MICE Google Global cache issues? I am seeing the same things. I just shot off an email to my contacts at Google From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Colin Murphy Sent: Wednesday, April 04, 2018 9:16 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] MICE Google Global cache issues? Hi, Since Monday we've been having issues with mobile devices accessing YouTube and Google Play store via IPv6. Our symptoms with YouTube app is mostly with Apple IOS devices. When a user loads a video, the ads will play fine and then the video will start and play for 5 seconds and stop. Browsing youtube via a web browser on the IOS devices seems fine. With Android devices, users can't download apps from the play store. Is anyone else experiencing these issues with their peering with the Google Global Cache at MICE? Thanks, Colin Murphy Sr. Network Engineer Office of Information Technology University of Minnesota Northern Lights Gigapop Desk: 612-626-0870 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 =============================================== To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

April 6, 2018

Re: MICE Google Global cache issues?

by David Farmer

A heads up; We asked Google for an update on our ticket this evening. IPv6 problems for the MICE GGC seem to have returned today, based I our graphs probably around 10:00 am. Therefore, Google has temporarily redirected IPv6 traffic away from the MICE GGC, to Chicago in our case and I suspect most cases. Also, Google has escalated the issue internally, and with their switch vendor. We have some reports of IPv6 packet loss possibly in Chicago and probably earlier today. We'll be keeping an eye on this tomorrow. Also, I went back and looked at graphs for IPv6 traffic from the MICE GGC to us and this problem probably started last Wednesday. In most cases, I think Happy Eye Balls glossed over this, but if applications or OSes didn't do Happy Eye Balls then things probably broke. The saga continues... On Wed, Apr 4, 2018 at 12:17 PM, Colin Murphy <murphy(a)umn.edu> wrote: > I saw that as well and we can now use YouTube and google play store. > Thanks. > > > Thanks, > > Colin Murphy > Sr. Network Engineer > Office of Information Technology > University of Minnesota > Northern Lights Gigapop > Desk: 612-626-0870 > > On Wed, Apr 4, 2018 at 12:15 PM, Jeremy Lumby <jlumby(a)mnvoip.com> wrote: > >> While I have not heard anything back from Google yet, I saw BGP to Google >> bounce, and I can now download app updates from the Google Play Store. >> >> >> >> *From:* Jeremy Lumby [mailto:jlumby@mnvoip.com] >> *Sent:* Wednesday, April 04, 2018 9:32 AM >> *To:* MICE Discuss >> *Subject:* RE: [MICE-DISCUSS] MICE Google Global cache issues? >> >> >> >> I am seeing the same things. I just shot off an email to my contacts at >> Google >> >> >> >> *From:* MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET >> <MICE-DISCUSS(a)LISTS.IPHOUSE.NET>] *On Behalf Of *Colin Murphy >> *Sent:* Wednesday, April 04, 2018 9:16 AM >> *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET >> *Subject:* [MICE-DISCUSS] MICE Google Global cache issues? >> >> >> >> Hi, >> >> Since Monday we've been having issues with mobile devices accessing >> YouTube and Google Play store via IPv6. Our symptoms with YouTube app is >> mostly with Apple IOS devices. When a user loads a video, the ads will >> play fine and then the video will start and play for 5 seconds and stop. >> Browsing youtube via a web browser on the IOS devices seems fine. >> >> >> >> With Android devices, users can't download apps from the play store. >> >> >> >> Is anyone else experiencing these issues with their peering with the >> Google Global Cache at MICE? >> >> >> >> >> Thanks, >> >> Colin Murphy >> Sr. Network Engineer >> Office of Information Technology >> University of Minnesota >> Northern Lights Gigapop >> Desk: 612-626-0870 >> >> >> ------------------------------ >> >> To unsubscribe from the MICE-DISCUSS list, click the following link: >> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >> >> ------------------------------ >> >> To unsubscribe from the MICE-DISCUSS list, click the following link: >> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

April 6, 2018