- mice-discuss - lists.micemn.net

RE: [EXTERNAL] Re: Loss of connectivity to MICE

by Jeremy Lumby

I had to request it in the portal and then I was able to get one Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: Justin Huffman via mice-discuss <mice-discuss(a)lists.micemn.net> Date: 8/21/26 4:08 PM (GMT-06:00) To: Brady Farver <bfarver(a)truestreamfiber.com>, mice-discuss(a)lists.micemn.net Subject: Re: [EXTERNAL] Re: Loss of connectivity to MICE _____ From : Justin Huffman via mice-discuss [mice-discuss(a)lists.micemn.net] To : Brady Farver [bfarver(a)truestreamfiber.com] mice-discuss(a)lists.micemn.net [mice-discuss(a)lists.micemn.net] Date : Friday, August 21 2026 16:06:03 Has anyone received a formal RFO yet from Cologix on the outage? Thanks, Justin Long Lines Broadband _____ From: Brady Farver via mice-discuss <mice-discuss(a)lists.micemn.net> Sent: Thursday, August 6, 2026 3:24:00 PM To: mice-discuss(a)lists.micemn.net <mice-discuss(a)lists.micemn.net> Subject: RE: [EXTERNAL] Re: Loss of connectivity to MICE WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. Response from the Cologix support portal: --- Dear Valued Customer, We are aware of a communication issue affecting certain Facility monitoring systems and are actively working to resolve it. At this time, we are investigating an issue affecting one of the Facility's UPS systems. Our Operations Team is actively monitoring the electrical infrastructure and environmental conditions while the issue is being investigated. We will provide additional updates as more information becomes available. Our Operations Team is actively monitoring the environment while the communication issue is being investigated and resolved. Thank you for your patience and understanding. --- Brady Farver Truestream - Network Operations bfarver(a)truestreamfiber.com <mailto:bfarver@truestreamfiber.com> From: Ryan Gunther via mice-discuss <mice-discuss(a)lists.micemn.net> Sent: Thursday, August 6, 2026 15:21 To: mice-discuss(a)lists.micemn.net Subject: RE: [EXTERNAL] Re: Loss of connectivity to MICE Same with us. Loss connectivity to MICE and Cogent at 511. signature divider Ryan Gunther Network & Switching Engineer CCNA, MEF-CECP, A+, ABCP (406) 234-7458 105 N Montana Ave., Miles City, MT 59301 www.midrivers.com <https://www.midrivers.com/> logo <https://www.midrivers.com/> divider facebook <https://facebook.com/midrivers> instagram <https://www.instagram.com/midriverscommunications/> linkedin <https://www.linkedin.com/company/mid-rivers-communications/> Review Us on Google <http://www.google.com/search?q=Mid-Rivers+Communications,1101%20Main%20 St.,%20Miles%20City,%20MT%2059301> From: Abhi Devireddy <abhi(a)devireddy.com> Sent: Thursday, August 6, 2026 1:09 PM To: Josh Hoppes <Josh.Hoppes(a)cfunet.net>; mice-discuss(a)lists.micemn.net <mailto:mice-discuss@lists.micemn.net> Subject: [EXTERNAL] Re: Loss of connectivity to MICE CAUTION: This email originated from outside of Mid-Rivers or its subsidiaries. Do not click links or open attachments unless you recognize the sender and know the content is safe. We did as well. Lost all outbound connectivity w/ MICE and Cogent. Abhi From: Josh Hoppes <Josh.Hoppes(a)cfunet.net> Date: Thursday, August 6, 2026 at 2:06 PM To: mice-discuss(a)lists.micemn.net <mice-discuss(a)lists.micemn.net> Subject: Loss of connectivity to MICE We just saw connectivity to MICE go down as well as our Hurricane Electric transit circuit. Are there any known issues at Cologix Minneapolis? Josh Hoppes Network Engineer II Cedar Falls Utilities Office 319 268 5227 Cell 319 610 5332 www.cfu.net <http://www.cfu.net/> _______________________________________________ mice-discuss mailing list -- mice-discuss(a)lists.micemn.net <mailto:mice-discuss@lists.micemn.net> To unsubscribe send an email to mice-discuss-leave(a)lists.micemn.net <mailto:mice-discuss-leave@lists.micemn.net> _____ </

Aug. 21, 2026

Re: [EXTERNAL] Re: Loss of connectivity to MICE

by Brady Farver

Hello, We received the attached RFO. Brady Farver Truestream | Network Operations bfarver(a)truestreamfiber.com ________________________________ From: Justin Huffman <jhuffman(a)longlines.biz> Sent: Friday, August 21, 2026 17:06 To: Brady Farver <bfarver(a)truestreamfiber.com>; mice-discuss(a)lists.micemn.net <mice-discuss(a)lists.micemn.net> Subject: Re: [EXTERNAL] Re: Loss of connectivity to MICE Has anyone received a formal RFO yet from Cologix on the outage? Thanks, Justin Long Lines Broadband ________________________________ From: Brady Farver via mice-discuss <mice-discuss(a)lists.micemn.net> Sent: Thursday, August 6, 2026 3:24:00 PM To: mice-discuss(a)lists.micemn.net <mice-discuss(a)lists.micemn.net> Subject: RE: [EXTERNAL] Re: Loss of connectivity to MICE WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. Response from the Cologix support portal: --- Dear Valued Customer, We are aware of a communication issue affecting certain Facility monitoring systems and are actively working to resolve it. At this time, we are investigating an issue affecting one of the Facility's UPS systems. Our Operations Team is actively monitoring the electrical infrastructure and environmental conditions while the issue is being investigated. We will provide additional updates as more information becomes available. Our Operations Team is actively monitoring the environment while the communication issue is being investigated and resolved. Thank you for your patience and understanding. --- Brady Farver Truestream - Network Operations bfarver(a)truestreamfiber.com<mailto:bfarver@truestreamfiber.com> From: Ryan Gunther via mice-discuss <mice-discuss(a)lists.micemn.net> Sent: Thursday, August 6, 2026 15:21 To: mice-discuss(a)lists.micemn.net Subject: RE: [EXTERNAL] Re: Loss of connectivity to MICE Same with us. Loss connectivity to MICE and Cogent at 511. [signature] Ryan Gunther Network & Switching Engineer CCNA, MEF-CECP, A+, ABCP (406) 234-7458 105 N Montana Ave., Miles City, MT 59301 www.midrivers.com<https://www.midrivers.com/> [logo]<https://www.midrivers.com/> [facebook] <https://facebook.com/midrivers> [instagram] <https://www.instagram.com/midriverscommunications/> [linkedin] <https://www.linkedin.com/company/mid-rivers-communications/> Review Us on Google<http://www.google.com/search?q=Mid-Rivers+Communications,1101%20Main%20St.,…> From: Abhi Devireddy <abhi(a)devireddy.com<mailto:abhi@devireddy.com>> Sent: Thursday, August 6, 2026 1:09 PM To: Josh Hoppes <Josh.Hoppes(a)cfunet.net<mailto:Josh.Hoppes@cfunet.net>>; mice-discuss(a)lists.micemn.net<mailto:mice-discuss@lists.micemn.net> Subject: [EXTERNAL] Re: Loss of connectivity to MICE CAUTION: This email originated from outside of Mid-Rivers or its subsidiaries. Do not click links or open attachments unless you recognize the sender and know the content is safe. We did as well. Lost all outbound connectivity w/ MICE and Cogent. Abhi From: Josh Hoppes <Josh.Hoppes(a)cfunet.net<mailto:Josh.Hoppes@cfunet.net>> Date: Thursday, August 6, 2026 at 2:06 PM To: mice-discuss(a)lists.micemn.net<mailto:mice-discuss@lists.micemn.net> <mice-discuss(a)lists.micemn.net<mailto:mice-discuss@lists.micemn.net>> Subject: Loss of connectivity to MICE We just saw connectivity to MICE go down as well as our Hurricane Electric transit circuit. Are there any known issues at Cologix Minneapolis? Josh Hoppes Network Engineer II Cedar Falls Utilities Office 319 268 5227 Cell 319 610 5332 www.cfu.net<http://www.cfu.net/> _______________________________________________ mice-discuss mailing list -- mice-discuss(a)lists.micemn.net<mailto:mice-discuss@lists.micemn.net> To unsubscribe send an email to mice-discuss-leave(a)lists.micemn.net<mailto:mice-discuss-leave@lists.micemn.net> ________________________________

Aug. 21, 2026

Re: [EXTERNAL] Re: Loss of connectivity to MICE

by Justin Huffman

Has anyone received a formal RFO yet from Cologix on the outage? Thanks, Justin Long Lines Broadband ________________________________ From: Brady Farver via mice-discuss <mice-discuss(a)lists.micemn.net> Sent: Thursday, August 6, 2026 3:24:00 PM To: mice-discuss(a)lists.micemn.net <mice-discuss(a)lists.micemn.net> Subject: RE: [EXTERNAL] Re: Loss of connectivity to MICE WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. Response from the Cologix support portal: --- Dear Valued Customer, We are aware of a communication issue affecting certain Facility monitoring systems and are actively working to resolve it. At this time, we are investigating an issue affecting one of the Facility's UPS systems. Our Operations Team is actively monitoring the electrical infrastructure and environmental conditions while the issue is being investigated. We will provide additional updates as more information becomes available. Our Operations Team is actively monitoring the environment while the communication issue is being investigated and resolved. Thank you for your patience and understanding. --- Brady Farver Truestream - Network Operations bfarver(a)truestreamfiber.com<mailto:bfarver@truestreamfiber.com> From: Ryan Gunther via mice-discuss <mice-discuss(a)lists.micemn.net> Sent: Thursday, August 6, 2026 15:21 To: mice-discuss(a)lists.micemn.net Subject: RE: [EXTERNAL] Re: Loss of connectivity to MICE Same with us. Loss connectivity to MICE and Cogent at 511. [signature] Ryan Gunther Network & Switching Engineer CCNA, MEF-CECP, A+, ABCP (406) 234-7458 105 N Montana Ave., Miles City, MT 59301 www.midrivers.com<https://www.midrivers.com/> [logo]<https://www.midrivers.com/> [facebook] <https://facebook.com/midrivers> [instagram] <https://www.instagram.com/midriverscommunications/> [linkedin] <https://www.linkedin.com/company/mid-rivers-communications/> Review Us on Google<http://www.google.com/search?q=Mid-Rivers+Communications,1101%20Main%20St.,…> From: Abhi Devireddy <abhi(a)devireddy.com<mailto:abhi@devireddy.com>> Sent: Thursday, August 6, 2026 1:09 PM To: Josh Hoppes <Josh.Hoppes(a)cfunet.net<mailto:Josh.Hoppes@cfunet.net>>; mice-discuss(a)lists.micemn.net<mailto:mice-discuss@lists.micemn.net> Subject: [EXTERNAL] Re: Loss of connectivity to MICE CAUTION: This email originated from outside of Mid-Rivers or its subsidiaries. Do not click links or open attachments unless you recognize the sender and know the content is safe. We did as well. Lost all outbound connectivity w/ MICE and Cogent. Abhi From: Josh Hoppes <Josh.Hoppes(a)cfunet.net<mailto:Josh.Hoppes@cfunet.net>> Date: Thursday, August 6, 2026 at 2:06 PM To: mice-discuss(a)lists.micemn.net<mailto:mice-discuss@lists.micemn.net> <mice-discuss(a)lists.micemn.net<mailto:mice-discuss@lists.micemn.net>> Subject: Loss of connectivity to MICE We just saw connectivity to MICE go down as well as our Hurricane Electric transit circuit. Are there any known issues at Cologix Minneapolis? Josh Hoppes Network Engineer II Cedar Falls Utilities Office 319 268 5227 Cell 319 610 5332 www.cfu.net<http://www.cfu.net/> _______________________________________________ mice-discuss mailing list -- mice-discuss(a)lists.micemn.net<mailto:mice-discuss@lists.micemn.net> To unsubscribe send an email to mice-discuss-leave(a)lists.micemn.net<mailto:mice-discuss-leave@lists.micemn.net> ________________________________

Aug. 21, 2026

Re: MICE Server Updates

by Cameron Skappel

The second round of updates, including Route Server 2, has been completed. On 8/19/26 13:33, Cameron Skappel wrote: > The first round of updates, including Route Server 1, has been completed. > > On 8/17/26 16:25, Cameron Skappel wrote: >> I plan to update the MICE servers on Wednesday, August 19th, at 13:00 >> Central and Thursday, August 20th, at 13:00 Central. I will update >> one route server per day. >> -- Cameron Skappel Wikstrom Telephone Company 218-436-5226

Aug. 20, 2026

Re: MICE Server Updates

by Cameron Skappel

The first round of updates, including Route Server 1, has been completed. On 8/17/26 16:25, Cameron Skappel wrote: > I plan to update the MICE servers on Wednesday, August 19th, at 13:00 > Central and Thursday, August 20th, at 13:00 Central. I will update one > route server per day. > -- Cameron Skappel Wikstrom Telephone Company 218-436-5226

Aug. 19, 2026

Please welcome The Constant Company to MICE!

by Jeremy Lumby

Name: The Constant Company Switch: MICE Core 511-100G 7504 Ports: E 6/12/1 ASN: 20473 IPv4: 206.108.255.15/24 IPv6: 2001:504:27:0:0:4ff9::1/64 Peering Contact: peering(a)vultr.com Route Servers: YES Welcome Aboard! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

Aug. 19, 2026

MICE Server Updates

by Cameron Skappel

I plan to update the MICE servers on Wednesday, August 19th, at 13:00 Central and Thursday, August 20th, at 13:00 Central. I will update one route server per day. -- Cameron Skappel Wikstrom Telephone Company 218-436-5226

Aug. 17, 2026

Re: Discussion / Issues Distro List

by Michael Horwath

On Fri, Aug 07, 2026 at 11:52:26AM +0000, Jerry Spaight wrote: > Hi - Could you please add Shaun Krug (SKrug(a)atccomm.net<mailto:SKrug@atccomm.net>) to the distribution list? Or send them (you had CCed so my instructions work directly as well) to https://lists.micemn.net/postorius/lists/ and subscribe to one or both. -- Michael Horwath, reachable via drechsau(a)Geeks.ORG

Aug. 7, 2026

Discussion / Issues Distro List

by Jerry Spaight

Hi - Could you please add Shaun Krug (SKrug(a)atccomm.net<mailto:SKrug@atccomm.net>) to the distribution list? Thanks in advance for your help! Jerry Spaight General Manager [ATC-Com[C]] 85 Main Ave Atkins, IA 52206 Now Offering 2.5 & 5.0 Gigabit Fiber WWW.ATCCOMM.NET<http://www.atccomm.net/> 319-446-0500 - Direct / Desk (Preferred) 319-521-4366 - Mobile 319-446-9100 - Fax

Aug. 7, 2026

Re: 511 Power Issues

by Richard Laager

When the switch came back, there was some traffic flooding. Unknown unicast flooding, I assume. Jeremy cleared the MAC table, which made the switch happy. (I suppose that caused it to re-learn in hardware or something?) It's been stable since 3:33 PM or so. You should be able to re-enable things now. On 2026-08-06 15:33, Gartley, Dakota S via mice-discuss wrote: > We’re seeing this weird traffic spike on one of our MICE interfaces > towards our Elk River datacenter. I also see it towards other > customers when I look at the MICE cacti instance. Anyone else notice > this? We’ve shutdown our connection in Elk River for the time being. > > image.png > > image.png > > *____________________________* > > *Dakota Gartley | Optum Technology* > Director, Information Security > Data, Internet Security and Connectivity Operations (DISCO) > Network, Security and Internet Services (NSIS) > > T _+1 763-732-6405_ <tel:+17637326405> > _dakota(a)optum.com_ <mailto:dakota@optum.com> > > optum-logo-ora-rgb.png > * > * > *From: *Jay Hanke via mice-discuss <mice-discuss(a)lists.micemn.net> > *Date: *Thursday, August 6, 2026 at 3:28 PM > *To: *MICE Discuss <mice-discuss(a)lists.micemn.net> > *Subject: *511 Power Issues > > *Caution: External email.** Do not open attachments or click on links > if you do not recognize the sender.* > > > There are currently power issues in the 511 building affecting the > MICE infrastructure there. > > The MICE Ridgeview switch and route server are still operational. > > -- > Jay Hanke, President > South Front Networks > jayhanke(a)southfront.io > Phone 507-327-2398 > https://southfront.io/ > <https://urldefense.com/v3/__https://southfront.io/path.html__;!!IqUcNYopQPk…> > > > This e-mail, including attachments, may include confidential and/or > proprietary information, and may be used only by the person or entity > to which it is addressed. If the reader of this e-mail is not the intended > recipient or intended recipient’s authorized agent, the reader is hereby > notified that any dissemination, distribution or copying of this e-mail is > prohibited. If you have received this e-mail in error, please notify the > sender by replying to this message and delete this e-mail immediately. > > _______________________________________________ > mice-discuss mailing list --mice-discuss(a)lists.micemn.net > To unsubscribe send an email tomice-discuss-leave(a)lists.micemn.net -- Richard Laager Chief Manager, Director Midwest Internet Cooperative Exchange LLC

Aug. 6, 2026