- mice-discuss - lists.micemn.net

Please welcome BIFIV Intrepid OpCo, LLC to MICE!

by Jeremy Lumby

Name: BIFIV Intrepid OpCo, LLC Switch: MN VoIP 100G Port: E 12/1 ASN: 394056 IPv4: This is a port upgrade to 100G all IP info stays the same. IPv6: Peering Contact: peering(a)intrepidfiber.com Route Servers: NO Welcome Aboard Again! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

May 9, 2025

Please welcome Fort Dodge Fiber to MICE!

by Jeremy Lumby

Name: City of Fort Dodge dba Fort Dodge Fiber Switch: SouthFront Networks 10G Ports: Adding E2 for a total of 2x10G ASN: 400405 IPv4: This is a port addition, all IP info stays the same IPv6: Peering Contact: noc(a)fortdodgefiber.net Route Servers: YES Welcome Aboard! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

May 9, 2025

RE: MICE connectivity issues / elevated multicast traffic

by Jeremy Lumby

Can I ask why port security did not trip on your MICE extension switch? From: Dean Bahls <dean.bahls(a)fiberminnesota.com> Sent: Thursday, May 1, 2025 7:18 AM To: Richard Laager <rlaager(a)micemn.net>; mice-discuss(a)lists.micemn.net Cc: Andrew Lambertson <andrew.lambertson(a)fiberminnesota.com> Subject: RE: MICE connectivity issues / elevated multicast traffic Oh man, we were definitely the cause of this. We were troubleshooting a transponder card and put it into loopback without thinking about MICE consequences. We will make sure that doesn’t happen in the future. Please accept our sincere apologies for causing havoc. Dean From: Richard Laager <rlaager(a)micemn.net <mailto:rlaager@micemn.net> > Sent: Wednesday, April 30, 2025 9:04 PM To: mice-discuss(a)lists.micemn.net <mailto:mice-discuss@lists.micemn.net> Subject: Re: MICE connectivity issues / elevated multicast traffic It sounds like we had a loop of some kind on the Fiber Minnesota extension switch. It was almost certainly, in some way, related to work they were doing. They are going to investigate further in the morning to try to understand what, specifically, happened. -- Richard Laager Chief Manager, Director Midwest Internet Cooperative Exchange LLC

May 1, 2025

RE: MICE connectivity issues / elevated multicast traffic

by Dean Bahls

Oh man, we were definitely the cause of this. We were troubleshooting a transponder card and put it into loopback without thinking about MICE consequences. We will make sure that doesn’t happen in the future. Please accept our sincere apologies for causing havoc. Dean From: Richard Laager <rlaager(a)micemn.net> Sent: Wednesday, April 30, 2025 9:04 PM To: mice-discuss(a)lists.micemn.net Subject: Re: MICE connectivity issues / elevated multicast traffic It sounds like we had a loop of some kind on the Fiber Minnesota extension switch. It was almost certainly, in some way, related to work they were doing. They are going to investigate further in the morning to try to understand what, specifically, happened. -- Richard Laager Chief Manager, Director Midwest Internet Cooperative Exchange LLC

May 1, 2025

Re: MICE connectivity issues / elevated multicast traffic

by Richard Laager

It sounds like we had a loop of some kind on the Fiber Minnesota extension switch. It was almost certainly, in some way, related to work they were doing. They are going to investigate further in the morning to try to understand what, specifically, happened. -- Richard Laager Chief Manager, Director Midwest Internet Cooperative Exchange LLC

May 1, 2025

Re: MICE connectivity issues / elevated multicast traffic

by Anthony Anderberg

Andrew’s theory about uplinks is correct: Ridgeview 3/35 and Po1 are part of its link to 511-7804 And 511-7504 po11 and 6/36 are part of its link to 511-7804 I don’t have any theories but spent a little time looking around, my notes so far: The usual background of non-unicast packets jumped from ~100/sec to ~250/sec rom 14:10 to 15:01 They were egressing lots of ports but po4 (Charter) is the only ingress port I’ve found so far - but I don’t think it’s volume accounts for it all. A number of members had traffic volumes change but the only ones who stopped all together that I see are: Integris and Hoyos on your remote WiscNet on their remote Conversely Xcel Entergy had a spike in traffic at around that time. And then we had trouble graphing NOCIX remote ports during that time too, which is odd. From: Andrew Hoyos <hoyosa(a)gmail.com> Date: Wednesday, April 30, 2025 at 4:08 PM To: Jay Hanke <jayhanke(a)southfront.io> Cc: Sergii Polishchuk <sergi(a)infotec.ca>, Ryan Nelson <ryan.nelson(a)integrisit.com>, "mice-discuss(a)lists.micemn.net" <mice-discuss(a)lists.micemn.net> Subject: Re: MICE connectivity issues / elevated multicast traffic We are, but saw issues to all peers (non BFD peers as well) There was definitely some uptick in non-unicast traffic in a few spots. I’m sure some are switch to switch links... 7804 - 3/2/1 -> ridgeview http://micelg.usinternet.com/cacti/graph.php?action=view&local_graph_id=402… -> Ridgeview 3/35/1 + po1 7504 - po11 + 6/36/1 http://micelg.usinternet.com/cacti/graph.php?action=view&local_graph_id=185… Andrew Hoyos hoyosa(a)gmail.com On Apr 30, 2025, at 15:52, Jay Hanke via mice-discuss <mice-discuss(a)lists.micemn.net> wrote: Is everyone with issues running BFD? On Wed, Apr 30, 2025 at 3:48 PM Sergii Polishchuk <sergi(a)infotec.ca<mailto:sergi@infotec.ca>> wrote: We lost connection with both route-servers for a minute and direct peering with some members (but not all): Apr 30 14:02:18: %BGP-5-NBR_RESET: Neighbor 206.108.255.2 reset (BFD adjacency down) Apr 30 14:02:19: %BGP-5-ADJCHANGE: neighbor 206.108.255.2 Down BFD adjacency down Apr 30 14:02:19: %BGP_SESSION-5-ADJCHANGE: neighbor 206.108.255.2 IPv4 Unicast topology base removed from session BFD adjacency down Apr 30 14:02:35: %BGP-5-NBR_RESET: Neighbor 206.108.255.2 active reset (Peer closed the session) Apr 30 14:03:13: %BGP-5-ADJCHANGE: neighbor 206.108.255.2 Up Ping to AS42: <image009.png> Ping to AS6939: <image010.png> <image002.png><https://www.facebook.com/InfotecManitoba> <image003.png><https://twitter.com/InfotecManitoba> <image004.png><https://www.linkedin.com/in/sergip/> <image005.png> Sergi Infotec Manitoba <image006.png> (844) 777-3744 <tel:(844)%20777-3744> <image007.png> sergi(a)infotec.ca<mailto:sergi@infotec.ca> <image008.png> https://infotec.ca<https://infotec.ca/> From: Ryan Nelson via mice-discuss <mice-discuss(a)lists.micemn.net<mailto:mice-discuss@lists.micemn.net>> Sent: April 30, 2025 15:02 To: mice-discuss(a)lists.micemn.net<mailto:mice-discuss@lists.micemn.net> Subject: MICE connectivity issues / elevated multicast traffic Anyone else seeing some connectivity issues over MICE coinciding with an uptick in multicast traffic coming from the core starting at around 2:10pm CDT? Ryan Nelson Architect, Platform Services Office: (218) 336-2220<tel:(218)%20336-2220> ryan.nelson(a)integrisit.com<mailto:ryan.nelson@integrisit.com> <image001.png><https://integrisit.com/> Integris Engage<https://integrisit.com/resources/>: Check out upcoming Education, Training & Networking _______________________________________________ mice-discuss mailing list -- mice-discuss(a)lists.micemn.net<mailto:mice-discuss@lists.micemn.net> To unsubscribe send an email to mice-discuss-leave(a)lists.micemn.net<mailto:mice-discuss-leave@lists.micemn.net> _______________________________________________ mice-discuss mailing list -- mice-discuss(a)lists.micemn.net To unsubscribe send an email to mice-discuss-leave(a)lists.micemn.net

April 30, 2025

RE: MICE connectivity issues / elevated multicast traffic

by Jeremy Lumby

I have not been able to dig into a too deeply yet but there does appear to be a large amount of ARP and neighbor Discovery traffic coming from a handful of Networks Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: Ryan Nelson via mice-discuss <mice-discuss(a)lists.micemn.net> Date: 4/30/25 3:02 PM (GMT-06:00) To: mice-discuss(a)lists.micemn.net Subject: MICE connectivity issues / elevated multicast traffic _____ From : Ryan Nelson via mice-discuss [mice-discuss(a)lists.micemn.net] To : mice-discuss(a)lists.micemn.net [mice-discuss(a)lists.micemn.net] Date : Wednesday, April 30 2025 15:01:33 Anyone else seeing some connectivity issues over MICE coinciding with an uptick in multicast traffic coming from the core starting at around 2:10pm CDT? Ryan Nelson Architect, Platform Services Office: (218) 336-2220 <tel:(218)%20336-2220> ryan.nelson(a)integrisit.com <https://integrisit.com/> Integris Engage <https://integrisit.com/resources/> : Check out upcoming Education, Training & Networking

April 30, 2025

Re: MICE connectivity issues / elevated multicast traffic

by Andrew Hoyos

We are, but saw issues to all peers (non BFD peers as well) There was definitely some uptick in non-unicast traffic in a few spots. I’m sure some are switch to switch links... 7804 - 3/2/1 -> ridgeview http://micelg.usinternet.com/cacti/graph.php?action=view&local_graph_id=402… -> Ridgeview 3/35/1 + po1 7504 - po11 + 6/36/1 http://micelg.usinternet.com/cacti/graph.php?action=view&local_graph_id=185… Andrew Hoyos hoyosa(a)gmail.com > On Apr 30, 2025, at 15:52, Jay Hanke via mice-discuss <mice-discuss(a)lists.micemn.net> wrote: > > Is everyone with issues running BFD? > > On Wed, Apr 30, 2025 at 3:48 PM Sergii Polishchuk <sergi(a)infotec.ca <mailto:sergi@infotec.ca>> wrote: >> We lost connection with both route-servers for a minute and direct peering with some members (but not all): >> >> >> >> Apr 30 14:02:18: %BGP-5-NBR_RESET: Neighbor 206.108.255.2 reset (BFD adjacency down) >> >> Apr 30 14:02:19: %BGP-5-ADJCHANGE: neighbor 206.108.255.2 Down BFD adjacency down >> >> Apr 30 14:02:19: %BGP_SESSION-5-ADJCHANGE: neighbor 206.108.255.2 IPv4 Unicast topology base removed from session BFD adjacency down >> >> Apr 30 14:02:35: %BGP-5-NBR_RESET: Neighbor 206.108.255.2 active reset (Peer closed the session) >> >> Apr 30 14:03:13: %BGP-5-ADJCHANGE: neighbor 206.108.255.2 Up >> >> >> >> Ping to AS42: >> >> >> >> <image009.png> >> >> >> >> Ping to AS6939: >> >> >> >> <image010.png> >> >> >> >> <image002.png> <https://www.facebook.com/InfotecManitoba> >> <image003.png> <https://twitter.com/InfotecManitoba> >> <image004.png> <https://www.linkedin.com/in/sergip/> >> >> >> <image005.png> >> >> Sergi >> >> Infotec Manitoba >> >> <image006.png> >> >> (844) 777-3744 <tel:(844)%20777-3744> >> <image007.png> >> >> sergi(a)infotec.ca <mailto:sergi@infotec.ca> >> <image008.png> >> >> https://infotec.ca <https://infotec.ca/> >> >> >> >> >> >> >> >> >> From: Ryan Nelson via mice-discuss <mice-discuss(a)lists.micemn.net <mailto:mice-discuss@lists.micemn.net>> >> Sent: April 30, 2025 15:02 >> To: mice-discuss(a)lists.micemn.net <mailto:mice-discuss@lists.micemn.net> >> Subject: MICE connectivity issues / elevated multicast traffic >> >> >> >> Anyone else seeing some connectivity issues over MICE coinciding with an uptick in multicast traffic coming from the core starting at around 2:10pm CDT? >> >> Ryan Nelson >> >> Architect, Platform Services >> >> Office: (218) 336-2220 <tel:(218)%20336-2220> >> ryan.nelson(a)integrisit.com <mailto:ryan.nelson@integrisit.com> >> <image001.png> <https://integrisit.com/> >> Integris Engage <https://integrisit.com/resources/>: Check out upcoming Education, Training & Networking >> >> >> >> >> _______________________________________________ >> mice-discuss mailing list -- mice-discuss(a)lists.micemn.net <mailto:mice-discuss@lists.micemn.net> >> To unsubscribe send an email to mice-discuss-leave(a)lists.micemn.net <mailto:mice-discuss-leave@lists.micemn.net> > _______________________________________________ > mice-discuss mailing list -- mice-discuss(a)lists.micemn.net > To unsubscribe send an email to mice-discuss-leave(a)lists.micemn.net

April 30, 2025

Re: MICE connectivity issues / elevated multicast traffic

by Ryan Nelson

Jay, We are running BFD. Ryan Nelson Architect, Platform Services Office: (218) 336-2220<tel:(218)%20336-2220> ryan.nelson(a)integrisit.com<mailto:ryan.nelson@integrisit.com> [cid:image933818.png]<https://integrisit.com/> Integris Engage<https://integrisit.com/resources/>: Check out upcoming Education, Training & Networking From: Jay Hanke <jayhanke(a)southfront.io> Date: Wednesday, April 30, 2025 at 3:52 PM To: Sergii Polishchuk <sergi(a)infotec.ca> Cc: Ryan Nelson <ryan.nelson(a)integrisit.com>, mice-discuss(a)lists.micemn.net <mice-discuss(a)lists.micemn.net> Subject: Re: MICE connectivity issues / elevated multicast traffic EXTERNAL MESSAGE Is everyone with issues running BFD? On Wed, Apr 30, 2025 at 3:48 PM Sergii Polishchuk <sergi(a)infotec.ca<mailto:sergi@infotec.ca>> wrote: We lost connection with both route-servers for a minute and direct peering with some members (but not all): Apr 30 14:02:18: %BGP-5-NBR_RESET: Neighbor 206.108.255.2 reset (BFD adjacency down) Apr 30 14:02:19: %BGP-5-ADJCHANGE: neighbor 206.108.255.2 Down BFD adjacency down Apr 30 14:02:19: %BGP_SESSION-5-ADJCHANGE: neighbor 206.108.255.2 IPv4 Unicast topology base removed from session BFD adjacency down Apr 30 14:02:35: %BGP-5-NBR_RESET: Neighbor 206.108.255.2 active reset (Peer closed the session) Apr 30 14:03:13: %BGP-5-ADJCHANGE: neighbor 206.108.255.2 Up Ping to AS42: [cid:ii_1968878db2dbdbb399] Ping to AS6939: [cid:ii_1968878db2d1f3c04fa] [facebook]<https://www.facebook.com/InfotecManitoba> [twitter]<https://twitter.com/InfotecManitoba> [linkedin]<https://www.linkedin.com/in/sergip/> [cid:ii_1968878db2d855d355] Sergi Infotec Manitoba [cid:ii_1968878db2d9374b66] (844) 777-3744<tel:(844)%20777-3744> [cid:ii_1968878db2da18c377] sergi(a)infotec.ca<mailto:sergi@infotec.ca> [cid:ii_1968878db2dafa3b88] https://infotec.ca<https://infotec.ca/> From: Ryan Nelson via mice-discuss <mice-discuss(a)lists.micemn.net<mailto:mice-discuss@lists.micemn.net>> Sent: April 30, 2025 15:02 To: mice-discuss(a)lists.micemn.net<mailto:mice-discuss@lists.micemn.net> Subject: MICE connectivity issues / elevated multicast traffic Anyone else seeing some connectivity issues over MICE coinciding with an uptick in multicast traffic coming from the core starting at around 2:10pm CDT? Ryan Nelson Architect, Platform Services Office: (218) 336-2220<tel:(218)%20336-2220> ryan.nelson(a)integrisit.com<mailto:ryan.nelson@integrisit.com> [cid:ii_1968878db2c4cff311]<https://integrisit.com/> Integris Engage<https://integrisit.com/resources/>: Check out upcoming Education, Training & Networking _______________________________________________ mice-discuss mailing list -- mice-discuss(a)lists.micemn.net<mailto:mice-discuss@lists.micemn.net> To unsubscribe send an email to mice-discuss-leave(a)lists.micemn.net<mailto:mice-discuss-leave@lists.micemn.net>

April 30, 2025

Re: MICE connectivity issues / elevated multicast traffic

by Jay Hanke

Is everyone with issues running BFD? On Wed, Apr 30, 2025 at 3:48 PM Sergii Polishchuk <sergi(a)infotec.ca> wrote: > We lost connection with both route-servers for a minute and direct peering > with some members (but not all): > > > > Apr 30 14:02:18: %BGP-5-NBR_RESET: Neighbor 206.108.255.2 reset (BFD > adjacency down) > > Apr 30 14:02:19: %BGP-5-ADJCHANGE: neighbor 206.108.255.2 Down BFD > adjacency down > > Apr 30 14:02:19: %BGP_SESSION-5-ADJCHANGE: neighbor 206.108.255.2 IPv4 > Unicast topology base removed from session BFD adjacency down > > Apr 30 14:02:35: %BGP-5-NBR_RESET: Neighbor 206.108.255.2 active reset > (Peer closed the session) > > Apr 30 14:03:13: %BGP-5-ADJCHANGE: neighbor 206.108.255.2 Up > > > > Ping to AS42: > > > > > > Ping to AS6939: > > > > > > [image: facebook] <https://www.facebook.com/InfotecManitoba> > > [image: twitter] <https://twitter.com/InfotecManitoba> > > [image: linkedin] <https://www.linkedin.com/in/sergip/> > > > > *Sergi * > > Infotec Manitoba > > > > (844) 777-3744 > > sergi(a)infotec.ca > > https://infotec.ca > > > > > > > > > > > > *From:* Ryan Nelson via mice-discuss <mice-discuss(a)lists.micemn.net> > *Sent:* April 30, 2025 15:02 > *To:* mice-discuss(a)lists.micemn.net > *Subject:* MICE connectivity issues / elevated multicast traffic > > > > Anyone else seeing some connectivity issues over MICE coinciding with an > uptick in multicast traffic coming from the core starting at around 2:10pm > CDT? > > *Ryan Nelson* > > *Architect, Platform Services* > > *Office:* (218) 336-2220 <(218)%20336-2220> > > ryan.nelson(a)integrisit.com > > <https://integrisit.com/> > > Integris Engage <https://integrisit.com/resources/> > : Check out upcoming Education, Training & Networking > > > _______________________________________________ > mice-discuss mailing list -- mice-discuss(a)lists.micemn.net > To unsubscribe send an email to mice-discuss-leave(a)lists.micemn.net >

April 30, 2025