- mice-discuss - lists.micemn.net

Loss of connectivity to MICE

by Josh Hoppes

We just saw connectivity to MICE go down as well as our Hurricane Electric transit circuit. Are there any known issues at Cologix Minneapolis? Josh Hoppes Network Engineer II Cedar Falls Utilities Office 319 268 5227 Cell 319 610 5332 www.cfu.net

Aug. 6, 2026

Please welcome Cloudflare to MICE!

by Jeremy Lumby

Name: Cloudflare Switch: MICE Core 511-400G 7508 Ports: E 4/20/1 in portchannel 13 for a total of 2x1x100G ASN: 13335 IPv4: 206.108.255.13/24 IPv6: 2001:504:27::3417:0:2/64 Peering Contact: noc(a)cloudflare.com Route Servers: Partial Cloudflare is adding a second router to MICE Welcome Aboard Again! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

Aug. 6, 2026

Please welcome Megaport to MICE!

by Jeremy Lumby

Name: Megaport Switch: MICE Core 511-400G 7508 Ports: E 3/28/1 ASN: 49915 IPv4: All IP info stays the same. This is a port upgrade from 100G to 400G IPv6: Peering Contact: as49915-peering(a)megaport.com Route Servers: NO Welcome Aboard Again! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

Aug. 5, 2026

Please welcome Megaport to MICE!

by Jeremy Lumby

Name: Megaport Switch: MICE Core 511-100G 7504 Ports: E 6/11/1 ASN: 49915 IPv4: 206.108.255.28/24 IPv6: 2001:504:27:0:0:c2fb::1/64 Peering Contact: as49915-peering(a)megaport.com Route Servers: NO Welcome Aboard! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

June 15, 2026

RE: Graphing

by Jeremy Lumby

Thanks, I will work with Richard behind the scenes on a replacement. From: Justin Krejci <JKrejci(a)usinternet.com> Sent: Wednesday, April 29, 2026 4:49 PM To: Jeremy Lumby <jlumby(a)mnvoip.com>; 'Steve Savoy' <stevesavoy(a)wctatel.com>; 'MICE Discuss' <mice-discuss(a)lists.micemn.net> Subject: Re: Graphing It sounds like the firewall power supply must be dead. Our tech said there are no lights on the firewall. He checked the power cable which looks good. He moved the power cable to another port on the PDU and the firewall will not power on still. _____ From: Jeremy Lumby <jlumby(a)mnvoip.com <mailto:jlumby@mnvoip.com> > Sent: Wednesday, April 29, 2026 2:44 PM To: Justin Krejci <Justin.Krejci(a)metronet.com <mailto:Justin.Krejci@metronet.com> >; 'Steve Savoy' <stevesavoy(a)wctatel.com <mailto:stevesavoy@wctatel.com> >; 'MICE Discuss' <mice-discuss(a)lists.micemn.net <mailto:mice-discuss@lists.micemn.net> > Subject: RE: Graphing WARNING: This mail is from an external source WARNING: This mail is from an external source Justin, That would be great if you could check he basics like you mentioned since tomorrow is the fastest I could get out there. Jeremy From: Justin Krejci <Justin.Krejci(a)metronet.com <mailto:Justin.Krejci@metronet.com> > Sent: Wednesday, April 29, 2026 1:20 PM To: Steve Savoy <stevesavoy(a)wctatel.com <mailto:stevesavoy@wctatel.com> >; Jeremy Lumby <jlumby(a)mnvoip.com <mailto:jlumby@mnvoip.com> >; 'MICE Discuss' <mice-discuss(a)lists.micemn.net <mailto:mice-discuss@lists.micemn.net> > Subject: Re: Graphing My router interface appears to have gone down at 2026-04-28T23:32:32.537203-05:00 The interface optic on my side is not receiving light currently from the MICE firewall. I can see about getting someone to go verify the cable is not disconnected and then power cycle the firewall. _____ From: Steve Savoy <stevesavoy(a)wctatel.com <mailto:stevesavoy@wctatel.com> > Sent: Wednesday, April 29, 2026 1:10 PM To: Jeremy Lumby <jlumby(a)mnvoip.com <mailto:jlumby@mnvoip.com> >; 'MICE Discuss' <mice-discuss(a)lists.micemn.net <mailto:mice-discuss@lists.micemn.net> > Subject: RE: Graphing WARNING: This mail is from an external source WARNING: This mail is from an external source Thanks Jeremy!! Steve From: Jeremy Lumby <jlumby(a)mnvoip.com <mailto:jlumby@mnvoip.com> > Sent: Wednesday, April 29, 2026 11:06 AM To: 'MICE Discuss' <mice-discuss(a)lists.micemn.net <mailto:mice-discuss@lists.micemn.net> > Subject: RE: Graphing The correlation is that they go through the firewall/internet connection that is at the Ridgeview datacenter. I am digging into it. From: Dean Bahls <dean.bahls(a)fiberminnesota.com <mailto:dean.bahls@fiberminnesota.com> > Sent: Wednesday, April 29, 2026 6:41 AM To: Steve Savoy <stevesavoy(a)wctatel.com <mailto:stevesavoy@wctatel.com> >; 'MICE Discuss' <mice-discuss(a)lists.micemn.net <mailto:mice-discuss@lists.micemn.net> > Subject: RE: Graphing Seems strange that some ports/devices are graphing fine but others are not. Looks like about 20% of ports are not working. And I'm too ignorant to know the correlation between those that are and those that aren't. Dean From: Steve Savoy <stevesavoy(a)wctatel.com <mailto:stevesavoy@wctatel.com> > Sent: Wednesday, April 29, 2026 6:18 AM To: 'MICE Discuss' <mice-discuss(a)lists.micemn.net <mailto:mice-discuss@lists.micemn.net> > Subject: Graphing Good morning, Anyone else seeing their graphing not working this am? Thank you, Steve Savoy WCTA Confidentiality Notice: This correspondence is the property of Winnebago Cooperative Telecom Association and is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. CAUTION: This email originated outside the organization. Do not click links or open attachments unless you recognize the sender.

April 29, 2026

Re: Graphing

by Justin Krejci

It sounds like the firewall power supply must be dead. Our tech said there are no lights on the firewall. He checked the power cable which looks good. He moved the power cable to another port on the PDU and the firewall will not power on still. ________________________________ From: Jeremy Lumby <jlumby(a)mnvoip.com> Sent: Wednesday, April 29, 2026 2:44 PM To: Justin Krejci <Justin.Krejci(a)metronet.com>; 'Steve Savoy' <stevesavoy(a)wctatel.com>; 'MICE Discuss' <mice-discuss(a)lists.micemn.net> Subject: RE: Graphing WARNING: This mail is from an external source WARNING: This mail is from an external source Justin, That would be great if you could check he basics like you mentioned since tomorrow is the fastest I could get out there. Jeremy From: Justin Krejci <Justin.Krejci(a)metronet.com> Sent: Wednesday, April 29, 2026 1:20 PM To: Steve Savoy <stevesavoy(a)wctatel.com>; Jeremy Lumby <jlumby(a)mnvoip.com>; 'MICE Discuss' <mice-discuss(a)lists.micemn.net> Subject: Re: Graphing My router interface appears to have gone down at 2026-04-28T23:32:32.537203-05:00 The interface optic on my side is not receiving light currently from the MICE firewall. I can see about getting someone to go verify the cable is not disconnected and then power cycle the firewall. ________________________________ From: Steve Savoy <stevesavoy(a)wctatel.com<mailto:stevesavoy@wctatel.com>> Sent: Wednesday, April 29, 2026 1:10 PM To: Jeremy Lumby <jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com>>; 'MICE Discuss' <mice-discuss(a)lists.micemn.net<mailto:mice-discuss@lists.micemn.net>> Subject: RE: Graphing WARNING: This mail is from an external source WARNING: This mail is from an external source Thanks Jeremy!! Steve From: Jeremy Lumby <jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com>> Sent: Wednesday, April 29, 2026 11:06 AM To: 'MICE Discuss' <mice-discuss(a)lists.micemn.net<mailto:mice-discuss@lists.micemn.net>> Subject: RE: Graphing The correlation is that they go through the firewall/internet connection that is at the Ridgeview datacenter. I am digging into it. From: Dean Bahls <dean.bahls(a)fiberminnesota.com<mailto:dean.bahls@fiberminnesota.com>> Sent: Wednesday, April 29, 2026 6:41 AM To: Steve Savoy <stevesavoy(a)wctatel.com<mailto:stevesavoy@wctatel.com>>; 'MICE Discuss' <mice-discuss(a)lists.micemn.net<mailto:mice-discuss@lists.micemn.net>> Subject: RE: Graphing Seems strange that some ports/devices are graphing fine but others are not. Looks like about 20% of ports are not working. And I’m too ignorant to know the correlation between those that are and those that aren’t. Dean From: Steve Savoy <stevesavoy(a)wctatel.com<mailto:stevesavoy@wctatel.com>> Sent: Wednesday, April 29, 2026 6:18 AM To: 'MICE Discuss' <mice-discuss(a)lists.micemn.net<mailto:mice-discuss@lists.micemn.net>> Subject: Graphing Good morning, Anyone else seeing their graphing not working this am? [cid:image001.png@01DCD7E6.A8AC8240] Thank you, Steve Savoy WCTA Confidentiality Notice: This correspondence is the property of Winnebago Cooperative Telecom Association and is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. CAUTION: This email originated outside the organization. Do not click links or open attachments unless you recognize the sender.

April 29, 2026

RE: Graphing

by Jeremy Lumby

Justin, That would be great if you could check he basics like you mentioned since tomorrow is the fastest I could get out there. Jeremy From: Justin Krejci <Justin.Krejci(a)metronet.com> Sent: Wednesday, April 29, 2026 1:20 PM To: Steve Savoy <stevesavoy(a)wctatel.com>; Jeremy Lumby <jlumby(a)mnvoip.com>; 'MICE Discuss' <mice-discuss(a)lists.micemn.net> Subject: Re: Graphing My router interface appears to have gone down at 2026-04-28T23:32:32.537203-05:00 The interface optic on my side is not receiving light currently from the MICE firewall. I can see about getting someone to go verify the cable is not disconnected and then power cycle the firewall. _____ From: Steve Savoy <stevesavoy(a)wctatel.com <mailto:stevesavoy@wctatel.com> > Sent: Wednesday, April 29, 2026 1:10 PM To: Jeremy Lumby <jlumby(a)mnvoip.com <mailto:jlumby@mnvoip.com> >; 'MICE Discuss' <mice-discuss(a)lists.micemn.net <mailto:mice-discuss@lists.micemn.net> > Subject: RE: Graphing WARNING: This mail is from an external source WARNING: This mail is from an external source Thanks Jeremy!! Steve From: Jeremy Lumby <jlumby(a)mnvoip.com <mailto:jlumby@mnvoip.com> > Sent: Wednesday, April 29, 2026 11:06 AM To: 'MICE Discuss' <mice-discuss(a)lists.micemn.net <mailto:mice-discuss@lists.micemn.net> > Subject: RE: Graphing The correlation is that they go through the firewall/internet connection that is at the Ridgeview datacenter. I am digging into it. From: Dean Bahls <dean.bahls(a)fiberminnesota.com <mailto:dean.bahls@fiberminnesota.com> > Sent: Wednesday, April 29, 2026 6:41 AM To: Steve Savoy <stevesavoy(a)wctatel.com <mailto:stevesavoy@wctatel.com> >; 'MICE Discuss' <mice-discuss(a)lists.micemn.net <mailto:mice-discuss@lists.micemn.net> > Subject: RE: Graphing Seems strange that some ports/devices are graphing fine but others are not. Looks like about 20% of ports are not working. And I'm too ignorant to know the correlation between those that are and those that aren't. Dean From: Steve Savoy <stevesavoy(a)wctatel.com <mailto:stevesavoy@wctatel.com> > Sent: Wednesday, April 29, 2026 6:18 AM To: 'MICE Discuss' <mice-discuss(a)lists.micemn.net <mailto:mice-discuss@lists.micemn.net> > Subject: Graphing Good morning, Anyone else seeing their graphing not working this am? Thank you, Steve Savoy WCTA Confidentiality Notice: This correspondence is the property of Winnebago Cooperative Telecom Association and is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. CAUTION: This email originated outside the organization. Do not click links or open attachments unless you recognize the sender.

April 29, 2026

RE: Graphing

by Steve Savoy

Thanks Jeremy!! Steve From: Jeremy Lumby <jlumby(a)mnvoip.com> Sent: Wednesday, April 29, 2026 11:06 AM To: 'MICE Discuss' <mice-discuss(a)lists.micemn.net> Subject: RE: Graphing The correlation is that they go through the firewall/internet connection that is at the Ridgeview datacenter. I am digging into it. From: Dean Bahls <dean.bahls(a)fiberminnesota.com<mailto:dean.bahls@fiberminnesota.com>> Sent: Wednesday, April 29, 2026 6:41 AM To: Steve Savoy <stevesavoy(a)wctatel.com<mailto:stevesavoy@wctatel.com>>; 'MICE Discuss' <mice-discuss(a)lists.micemn.net<mailto:mice-discuss@lists.micemn.net>> Subject: RE: Graphing Seems strange that some ports/devices are graphing fine but others are not. Looks like about 20% of ports are not working. And I'm too ignorant to know the correlation between those that are and those that aren't. Dean From: Steve Savoy <stevesavoy(a)wctatel.com<mailto:stevesavoy@wctatel.com>> Sent: Wednesday, April 29, 2026 6:18 AM To: 'MICE Discuss' <mice-discuss(a)lists.micemn.net<mailto:mice-discuss@lists.micemn.net>> Subject: Graphing Good morning, Anyone else seeing their graphing not working this am? [cid:image001.png@01DCD7D9.96951520] Thank you, Steve Savoy WCTA Confidentiality Notice: This correspondence is the property of Winnebago Cooperative Telecom Association and is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. CAUTION: This email originated outside the organization. Do not click links or open attachments unless you recognize the sender.

April 29, 2026

RE: Graphing

by Jeremy Lumby

The correlation is that they go through the firewall/internet connection that is at the Ridgeview datacenter. I am digging into it. From: Dean Bahls <dean.bahls(a)fiberminnesota.com> Sent: Wednesday, April 29, 2026 6:41 AM To: Steve Savoy <stevesavoy(a)wctatel.com>; 'MICE Discuss' <mice-discuss(a)lists.micemn.net> Subject: RE: Graphing Seems strange that some ports/devices are graphing fine but others are not. Looks like about 20% of ports are not working. And I'm too ignorant to know the correlation between those that are and those that aren't. Dean From: Steve Savoy <stevesavoy(a)wctatel.com <mailto:stevesavoy@wctatel.com> > Sent: Wednesday, April 29, 2026 6:18 AM To: 'MICE Discuss' <mice-discuss(a)lists.micemn.net <mailto:mice-discuss@lists.micemn.net> > Subject: Graphing Good morning, Anyone else seeing their graphing not working this am? Thank you, Steve Savoy WCTA Confidentiality Notice: This correspondence is the property of Winnebago Cooperative Telecom Association and is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. CAUTION: This email originated outside the organization. Do not click links or open attachments unless you recognize the sender.

April 29, 2026

RE: Graphing

by Dean Bahls

Seems strange that some ports/devices are graphing fine but others are not. Looks like about 20% of ports are not working. And I'm too ignorant to know the correlation between those that are and those that aren't. Dean From: Steve Savoy <stevesavoy(a)wctatel.com> Sent: Wednesday, April 29, 2026 6:18 AM To: 'MICE Discuss' <mice-discuss(a)lists.micemn.net> Subject: Graphing Good morning, Anyone else seeing their graphing not working this am? [cid:image001.png@01DCD7A3.31FB5BF0] Thank you, Steve Savoy WCTA Confidentiality Notice: This correspondence is the property of Winnebago Cooperative Telecom Association and is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. CAUTION: This email originated outside the organization. Do not click links or open attachments unless you recognize the sender.

April 29, 2026