My BGP sessions came up just before 2:10 am. Frank From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Tuesday, May 14, 2019 10:29 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost connection The latest update from Zayo is: Current update: Construction crews are onsite and prepping to excavate. The general area they have isolated the damage down to shows signs of fresh construction and boring. They have no ETTR at this time but we will provide more information as it becomes available. From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Tuesday, May 14, 2019 7:44 PM To: MICE Discuss Subject: Re: [MICE-DISCUSS] lost connection The latest update I have on my ticket is that Zayo is investigating possible damage to fiber in Eden Prairie. It looks like Justin will get to keep his money that Anthony was betting with. Zayo now has the additional tasks of figuring out why my vpls service did not fail over properly. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby@mnvoip.com<mailto:jlumby@mnvoip.com> -------- Original message -------- From: Jeremy Lumby <jlumby@mnvoip.com<mailto:jlumby@mnvoip.com>> Date: 5/14/19 4:22 PM (GMT-06:00) To: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: Re: [MICE-DISCUSS] lost connection ________________________________ From : Jeremy Lumby [jlumby@mnvoip.com] To : MICE Discuss [MICE-DISCUSS@LISTS.IPHOUSE.NET] Date : Tuesday, May 14 2019 16:22:00 Latest update on my Zayo ticket is that techs are dispatched, and are 1.5 hours away. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Tuesday, May 14, 2019 3:46 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection Probably power then like it was 2 months ago.. man.. 3 outages in 3 months is getting annoying 😉 Thanks for the visibility from your end!! James Urwiller Network Architect Stealth Broadband james.urwiller@stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jay Hanke Sent: Tuesday, May 14, 2019 15:43 To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection The whole Zayo remote switch appears to be down. On Tue, May 14, 2019 at 3:42 PM James Urwiller <james.urwiller@turnkey-telecom.com<mailto:james.urwiller@turnkey-telecom.com>> wrote: I lost MICE through ZAYO again to belle plain around 15:18 CST. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller@stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke, President South Front Networks jayhanke@southfront.io<mailto:jayhanke@southfront.io> Phone 612-204-0000 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

We restored a little after 5AM. Guess it must’ve been a beast of a cut. From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET> On Behalf Of James Urwiller Sent: Wednesday, May 15, 2019 6:50 AM To: MICE-DISCUSS@LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost connection Mine didn’t till around 5:49, but all is well since then. James Urwiller Network Architect Stealth Broadband james.urwiller@stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Wednesday, May 15, 2019 02:20 To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection My BGP sessions came up just before 2:10 am. Frank From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jeremy Lumby Sent: Tuesday, May 14, 2019 10:29 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection The latest update from Zayo is: Current update: Construction crews are onsite and prepping to excavate. The general area they have isolated the damage down to shows signs of fresh construction and boring. They have no ETTR at this time but we will provide more information as it becomes available. From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Tuesday, May 14, 2019 7:44 PM To: MICE Discuss Subject: Re: [MICE-DISCUSS] lost connection The latest update I have on my ticket is that Zayo is investigating possible damage to fiber in Eden Prairie. It looks like Justin will get to keep his money that Anthony was betting with. Zayo now has the additional tasks of figuring out why my vpls service did not fail over properly. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby@mnvoip.com<mailto:jlumby@mnvoip.com> -------- Original message -------- From: Jeremy Lumby <jlumby@mnvoip.com<mailto:jlumby@mnvoip.com>> Date: 5/14/19 4:22 PM (GMT-06:00) To: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: Re: [MICE-DISCUSS] lost connection ________________________________ From : Jeremy Lumby [jlumby@mnvoip.com<mailto:jlumby@mnvoip.com>] To : MICE Discuss [MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] Date : Tuesday, May 14 2019 16:22:00 Latest update on my Zayo ticket is that techs are dispatched, and are 1.5 hours away. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Tuesday, May 14, 2019 3:46 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection Probably power then like it was 2 months ago.. man.. 3 outages in 3 months is getting annoying 😉 Thanks for the visibility from your end!! James Urwiller Network Architect Stealth Broadband james.urwiller@stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jay Hanke Sent: Tuesday, May 14, 2019 15:43 To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection The whole Zayo remote switch appears to be down. On Tue, May 14, 2019 at 3:42 PM James Urwiller <james.urwiller@turnkey-telecom.com<mailto:james.urwiller@turnkey-telecom.com>> wrote: I lost MICE through ZAYO again to belle plain around 15:18 CST. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller@stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke, President South Front Networks jayhanke@southfront.io<mailto:jayhanke@southfront.io> Phone 612-204-0000 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

I wanted to start a discussion about the MAC address limit that MICE has as a standard limit of 5 per port. If I remember correctly, the history behind it ended up being that 5 MAC addresses was chosen as a happy middle ground to make router swaps by end users much easier on the end user, as well as the MICE tech committee. As someone that runs extension switches for 3 exchanges in addition to MICE, all of the other IXes have a 1 MAC address limit per port. I have found that maintaining these was not nearly as difficult as the original concern that was expressed at the MICE UG that lead to a limit of 5. With that being said, I would like to start a discussion about lowering the maximum MAC address limit to 1 with respect to the MICE extension switch that I operate. I feel that the benefits outnumber the risks, and with the experiences from the other 3 IXes, I do not think that the extra effort I will need to put in would be significant. Just to state the obvious, the South Front extension switch uplink that is connected to my extension would be a permanent exception, and short term exceptions would be permitted ahead of a router swap. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby@mnvoip.com

I agree with this also Jdw Please excuse typos as this was sent from smart phone -------- Original message -------- From: Andrew Hoyos <hoyosa@GMAIL.COM> Date: 6/8/19 12:17 PM (GMT-06:00) To: MICE-DISCUSS@LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MAC address limit I’m a fan of 1 per port unless documented exception. -- Andrew Hoyos hoyosa@gmail.com<mailto:hoyosa@gmail.com> On Jun 8, 2019, at 11:03 AM, Jeremy Lumby <jlumby@mnvoip.com<mailto:jlumby@mnvoip.com>> wrote: I wanted to start a discussion about the MAC address limit that MICE has as a standard limit of 5 per port. If I remember correctly, the history behind it ended up being that 5 MAC addresses was chosen as a happy middle ground to make router swaps by end users much easier on the end user, as well as the MICE tech committee. As someone that runs extension switches for 3 exchanges in addition to MICE, all of the other IXes have a 1 MAC address limit per port. I have found that maintaining these was not nearly as difficult as the original concern that was expressed at the MICE UG that lead to a limit of 5. With that being said, I would like to start a discussion about lowering the maximum MAC address limit to 1 with respect to the MICE extension switch that I operate. I feel that the benefits outnumber the risks, and with the experiences from the other 3 IXes, I do not think that the extra effort I will need to put in would be significant. Just to state the obvious, the South Front extension switch uplink that is connected to my extension would be a permanent exception, and short term exceptions would be permitted ahead of a router swap. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby@mnvoip.com<mailto:jlumby@mnvoip.com> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

The link I’m using from Belle Plaine to 511 is over MNVoIP’ VPLS link, and so perhaps that did benefit from some redundancy. I did see one more BGP session bounce from 4:40 to ~4:43 am, so I suspect the staggered nature of our different service restoration reflect the fibers and services that were operating over these fibers. Frank From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET> On Behalf Of Jeremy Schmeichel Sent: Wednesday, May 15, 2019 9:06 AM To: MICE-DISCUSS@LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] lost connection We restored a little after 5AM. Guess it must’ve been a beast of a cut. From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of James Urwiller Sent: Wednesday, May 15, 2019 6:50 AM To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection Mine didn’t till around 5:49, but all is well since then. James Urwiller Network Architect Stealth Broadband james.urwiller@stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Wednesday, May 15, 2019 02:20 To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection My BGP sessions came up just before 2:10 am. Frank From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jeremy Lumby Sent: Tuesday, May 14, 2019 10:29 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection The latest update from Zayo is: Current update: Construction crews are onsite and prepping to excavate. The general area they have isolated the damage down to shows signs of fresh construction and boring. They have no ETTR at this time but we will provide more information as it becomes available. From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Tuesday, May 14, 2019 7:44 PM To: MICE Discuss Subject: Re: [MICE-DISCUSS] lost connection The latest update I have on my ticket is that Zayo is investigating possible damage to fiber in Eden Prairie. It looks like Justin will get to keep his money that Anthony was betting with. Zayo now has the additional tasks of figuring out why my vpls service did not fail over properly. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby@mnvoip.com<mailto:jlumby@mnvoip.com> -------- Original message -------- From: Jeremy Lumby <jlumby@mnvoip.com<mailto:jlumby@mnvoip.com>> Date: 5/14/19 4:22 PM (GMT-06:00) To: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: Re: [MICE-DISCUSS] lost connection ________________________________ From : Jeremy Lumby [jlumby@mnvoip.com<mailto:jlumby@mnvoip.com>] To : MICE Discuss [MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] Date : Tuesday, May 14 2019 16:22:00 Latest update on my Zayo ticket is that techs are dispatched, and are 1.5 hours away. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Tuesday, May 14, 2019 3:46 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection Probably power then like it was 2 months ago.. man.. 3 outages in 3 months is getting annoying 😉 Thanks for the visibility from your end!! James Urwiller Network Architect Stealth Broadband james.urwiller@stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jay Hanke Sent: Tuesday, May 14, 2019 15:43 To: MICE-DISCUSS@LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] lost connection The whole Zayo remote switch appears to be down. On Tue, May 14, 2019 at 3:42 PM James Urwiller <james.urwiller@turnkey-telecom.com<mailto:james.urwiller@turnkey-telecom.com>> wrote: I lost MICE through ZAYO again to belle plain around 15:18 CST. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller@stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke, President South Front Networks jayhanke@southfront.io<mailto:jayhanke@southfront.io> Phone 612-204-0000 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1