- mice-discuss - lists.micemn.net

Re: T-Mobile Traffic Changes

by Richard Laager

FYI: This was caught in moderation because of the message size. I bumped the message size limit to 1 MiB. I'm not sure how people feel about this. If you disagree with "larger" messages on this list, please let me know. -- Richard

Aug. 1, 2025

T-Mobile Traffic Changes

by David Farmer

Last Night, around midnight, our traffic going to T-Mobile stopped going through MiCE. [image: image.png] [image: image.png] [image: image.png] It looks like they migrated traffic to their new MICE port. But we are no longer receiving any IPv4 routes from T-Mobile via MICE, but are receiving 5 IPv6 routes. We have also had instability (packet loss) with our IPv6 traffic from them for several weeks. Anyone else seeing this? Do you have any good contacts to get it resolved? Unfortunately, our contact with their NOC has not been returned or acknowledged. Thanks -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

Aug. 1, 2025

Please welcome Charter Communications to MICE!

by Jeremy Lumby

Name: Charter Communications Switch: MICE 511 7504R Ports: E 6/4/1 in portchannel 7 ASN: 20115 IPv4: All IP info stays the same. Upgrading from 2x10G to 1x100G IPv6: Peering Contact: peering(a)charter.com Route Servers: NO Welcome Aboard Again! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

July 29, 2025

Please welcome UnitedHealth Group to MICE!

by Jeremy Lumby

Name: UnitedHealth Group Switch: MICE 511 (both switches) Ports: Adding 3/2/1 in Portchannel 5 to 6/21/1 on the 7504 (100G Switch - 206.108.255.200) Adding 3/9/1 in Portchannel 20 to 4/9/1 on the 7804 (400G Switch - 206.108.255.198) ASN: 10879 IPv4: All IP info stays the same. Adding ports for switch diversity as well as capacity of 2x2x100G IPv6: Peering Contact: inet_ops(a)uhc.com Route Servers: YES Welcome Aboard Again! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

July 28, 2025

Please welcome Macarne to MICE!

by Jeremy Lumby

Name: Macarne Switch: NOCIX Ports: E 5/21 ASN: 64289 IPv4: 206.108.255.23/24 IPv6: 2001:504:27:0:0:FB21::1/64 Peering Contact: peering(a)macarne.com Route Servers: YES Welcome Aboard! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

July 20, 2025

WiscNet AS2381 Router Maintenance

by Joshua Gorton

Heads up that WiscNet AS2381 will be performing router maintenance tonight at 10pm that will impact our MICE BGP peering sessions. Cheers, Josh

July 16, 2025

Please welcome Nova86 to MICE!

by Jeremy Lumby

Name: Nova86 LLC Switch: NOCIX Ports: E 5/22 ASN: 401538 IPv4: 206.108.255.22/24 IPv6: 2001:504:27:0:6:2082::1/64 Peering Contact: peering(a)nova86.net Route Servers: YES Welcome Aboard! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

June 25, 2025

Please welcome ServerForge to MICE!

by Jeremy Lumby

Name: ServerForge LLC Switch: NOCIX Ports: E 5/21 ASN: 23428 IPv4: 206.108.255.21/24 IPv6: 2001:504:27:0:0:5b84::1/64 Peering Contact: noc(a)serverforge.org Route Servers: YES Welcome Aboard! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

June 16, 2025

Please welcome Flexnetworks to MICE!

by Jeremy Lumby

Name: Flexnetworks Switch: MICE Core 511 Arista 7504-100G Port: E 4/22 ASN: 19523 IPv4: IP address info stays the same this is a port addition to a total of 2x10G in Po2 IPv6: Peering Contact: jay.mcmaster(a)flexnetworks.ca Route Servers: YES Welcome Aboard Again! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

June 16, 2025

WiscNet router maintenance

by Chris Wopat

WiscNet is performing maintenance on our router that peers on MICE - we've disabled peering until this completes around 1pm. Cheers, --Chris

June 14, 2025

RE: Yahoo peering down

by Jeremy Lumby

I have not heard anything, but I can confirm that the MICE switch is not receiving light. From: Frank Bulk <fbulk(a)mypremieronline.com> Sent: Tuesday, June 10, 2025 3:03 PM To: mice-discuss(a)lists.micemn.net Subject: Yahoo peering down Our peering sessions with Yahoo went down around 4 am, which matches with the graph here: http://micelg.usinternet.com/cacti/graph_view.php?action=tree <http://micelg.usinternet.com/cacti/graph_view.php?action=tree&tree_id=1&lea f_id=58> &tree_id=1&leaf_id=58 Anyone happen to know what's up? Frank Frank Bulk Chief Technology Officer / Chief Operating Officer 339 1st Ave NE | Sioux Center, IA 51250 | <https://www.facebook.com/PremierCommunicationsSiouxCenter> Find us on Facebook phone: 712.722.3451 web: mypremieronline.com <https://www.mypremieronline.com/> direct: (712) 722-7152 cell: (712) 441-6049

June 10, 2025

Yahoo peering down

by Frank Bulk

Our peering sessions with Yahoo went down around 4 am, which matches with the graph here: http://micelg.usinternet.com/cacti/graph_view.php?action=tree&tree_id=1&lea… Anyone happen to know what's up? Frank [cid:a1ff5d57-4afc-4ec0-be61-51708bf94a4e.png] Frank Bulk Chief Technology Officer / Chief Operating Officer [cid:premiercomm_logo_cmyk_1388ffcb-8ec0-4842-9e40-a0e598482e7d.png] 339 1st Ave NE | Sioux Center, IA 51250 | Find us on Facebook<https://www.facebook.com/PremierCommunicationsSiouxCenter> phone: 712.722.3451 web: mypremieronline.com<https://www.mypremieronline.com/> direct: (712) 722-7152 cell: (712) 441-6049

June 10, 2025

Please welcome JTN Communications to MICE!

by Jeremy Lumby

Name: JTN Communications Switch: MICE Core Ridgeview-100G 7504 Port: Ethernet 3/32/4 (1x10G total) ASN: 398200 IPv4: 206.108.255.16/24 IPv6: 2001:504:27:0:6:1378::1/64 Peering Contact: info(a)jtncommunications.com Route Servers: NO Welcome Aboard! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

June 9, 2025

RE: [EXTERNAL] - Re: IRR import and router update processes

by Miles McCredie

Things now look the way I expect. Thank you [http://images.midcocomm.com/ES_MidcoLogo.png] Miles McCredie Principal Network Engineer II-Core IP Office: 6052755192 Miles.McCredie(a)midco.com Midco.com Let's go beyond. From: Richard Laager via mice-discuss <mice-discuss(a)lists.micemn.net> Sent: Tuesday, June 3, 2025 9:09 PM To: mice-discuss(a)lists.micemn.net Subject: [EXTERNAL] - Re: IRR import and router update processes CAUTION: This email originated from outside of MIDCO. Do not click links or open attachments unless you recognize the sender and know the content is safe. On 2025-06-03 14:38, Miles McCredie wrote: Are the IRR import and router update processes running as expected? No. Thanks for letting me know! The IXP Manager scheduler, and more specifically bgp4, seems to have failed in a "stuck running" way, as opposed to exiting with a failure status. bgpq4 was blocked on a read(). I don't know more than that, as I didn't have debug symbols for it, and it was a custom build to backport in a feature we needed. https://github.com/bgp/bgpq4/pull/90 if you're curious. This has been broken for some time, so there were a LOT of changes. Asking because I'm seeing some announcements being IRRd filtered that I don't expect. Can you check now, please? If it's still a problem, please let me know (on or off list) more specifically which prefix(es) are involved. Also, could you confirm which sources are being used? There are also some announcements with valid objects in NTTCOM that are being filtered. ARIN,RIPE,LACNIC,APNIC,AFRINIC,RADB,ALTDB,NTTCOM,LEVEL3,BELL -- Richard

June 4, 2025

Re: IRR import and router update processes

by Richard Laager

On 2025-06-03 14:38, Miles McCredie wrote: > > Are the IRR import and router update processes running as expected? > No. Thanks for letting me know! The IXP Manager scheduler, and more specifically bgp4, seems to have failed in a "stuck running" way, as opposed to exiting with a failure status. bgpq4 was blocked on a read(). I don't know more than that, as I didn't have debug symbols for it, and it was a custom build to backport in a feature we needed. https://github.com/bgp/bgpq4/pull/90 if you're curious. This has been broken for some time, so there were a LOT of changes. > Asking because I’m seeing some announcements being IRRd filtered that > I don’t expect. > Can you check now, please? If it's still a problem, please let me know (on or off list) more specifically which prefix(es) are involved. > Also, could you confirm which sources are being used? There are also > some announcements with valid objects in NTTCOM that are being filtered. > ARIN,RIPE,LACNIC,APNIC,AFRINIC,RADB,ALTDB,NTTCOM,LEVEL3,BELL -- Richard

June 4, 2025

IRR import and router update processes

by Miles McCredie

Are the IRR import and router update processes running as expected? Asking because I'm seeing some announcements being IRRd filtered that I don't expect. Also, could you confirm which sources are being used? There are also some announcements with valid objects in NTTCOM that are being filtered. Thanks [http://images.midcocomm.com/ES_MidcoLogo.png] Miles McCredie Principal Network Engineer II-Core IP Office: 6052755192 Miles.McCredie(a)midco.com Midco.com Let's go beyond.

June 3, 2025

Liberty Communications Disconnect

by Jay Hanke

Liberty Communications [AS26725] has disconnected from MICE as of 6/1/2025. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 507-327-2398 https://southfront.io/ MWPS 2025 https://www.eventcreate.com/e/mwps2025

June 2, 2025

RE: Non-MICE/perhaps dumb question

by Frank Bulk

Thanks for everyone's input and feedback. I ended up having a call with Cologix to get a better understanding of AWS' product and how it works. I shared this with our customer and have not yet received a response. Frank Frank Bulk -----Original Message----- From: Mike Horwath <drechsau(a)geeks.org> Sent: Saturday, April 26, 2025 9:30 AM To: Frank Bulk <fbulk(a)mypremieronline.com> Cc: mice-discuss(a)lists.micemn.net Subject: Re: Non-MICE/perhaps dumb question On Fri, Apr 25, 2025 at 08:53:28PM +0000, Frank Bulk wrote: > Is that just the reality of it, or is there a broader product (other > than direct peering with Amazon) that would improve AWS performance > for all our customers? Is your customer willing to cover costs for direct connect? In my experience, this is very performant (depending on link speed you choose). Are they pushing into S3, some API endpoint, custom app, over SSH or FTP or another protocol? From home (over the comcastic networkz) I can saturate my upload (~350Mbps) without issue, and lab environment (~500Mbps, Atomic Data) can also hit the peak. This is over SSH (into instances) or S3 endpoints. -- Mike Horwath, reachable via drechsau(a)Geeks.ORG

May 29, 2025

Please welcome Microsoft to MICE!

by Jeremy Lumby

Name: Microsoft Location: MICE Core 511 Ports: adding E3/1/1 to portchannel 35 (Arista 7504R) and adding E 3/8/1 to portchannel 11 (Arista 7804 R3)for a total of 2x2x100G ASN: 8075 IPv4: All IP info remains the same, this is a 2x100G port addition IPv6: Peering Contact: peering(a)microsoft.com Route Servers: NO Welcome Aboard Again! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

May 15, 2025

Please welcome Accuris Technologies to MICE!

by Jeremy Lumby

Name: Accuris Technologies Ltd. Switch: NOCIX Port: Ethernet 5/19 (10G) ASN: 52210 IPv4: 206.108.255.12/24 IPv6: 2001:504:27:0:0:CBF2::1/64 Peering Contact: domainsupport(a)accur.is Route Servers: YES Welcome Aboard! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

May 9, 2025

Please welcome BIFIV Intrepid OpCo, LLC to MICE!

by Jeremy Lumby

Name: BIFIV Intrepid OpCo, LLC Switch: MN VoIP 100G Port: E 12/1 ASN: 394056 IPv4: This is a port upgrade to 100G all IP info stays the same. IPv6: Peering Contact: peering(a)intrepidfiber.com Route Servers: NO Welcome Aboard Again! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

May 9, 2025

Please welcome Fort Dodge Fiber to MICE!

by Jeremy Lumby

Name: City of Fort Dodge dba Fort Dodge Fiber Switch: SouthFront Networks 10G Ports: Adding E2 for a total of 2x10G ASN: 400405 IPv4: This is a port addition, all IP info stays the same IPv6: Peering Contact: noc(a)fortdodgefiber.net Route Servers: YES Welcome Aboard! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

May 9, 2025

RE: MICE connectivity issues / elevated multicast traffic

by Jeremy Lumby

Can I ask why port security did not trip on your MICE extension switch? From: Dean Bahls <dean.bahls(a)fiberminnesota.com> Sent: Thursday, May 1, 2025 7:18 AM To: Richard Laager <rlaager(a)micemn.net>; mice-discuss(a)lists.micemn.net Cc: Andrew Lambertson <andrew.lambertson(a)fiberminnesota.com> Subject: RE: MICE connectivity issues / elevated multicast traffic Oh man, we were definitely the cause of this. We were troubleshooting a transponder card and put it into loopback without thinking about MICE consequences. We will make sure that doesn’t happen in the future. Please accept our sincere apologies for causing havoc. Dean From: Richard Laager <rlaager(a)micemn.net <mailto:rlaager@micemn.net> > Sent: Wednesday, April 30, 2025 9:04 PM To: mice-discuss(a)lists.micemn.net <mailto:mice-discuss@lists.micemn.net> Subject: Re: MICE connectivity issues / elevated multicast traffic It sounds like we had a loop of some kind on the Fiber Minnesota extension switch. It was almost certainly, in some way, related to work they were doing. They are going to investigate further in the morning to try to understand what, specifically, happened. -- Richard Laager Chief Manager, Director Midwest Internet Cooperative Exchange LLC

May 1, 2025

RE: MICE connectivity issues / elevated multicast traffic

by Dean Bahls

Oh man, we were definitely the cause of this. We were troubleshooting a transponder card and put it into loopback without thinking about MICE consequences. We will make sure that doesn’t happen in the future. Please accept our sincere apologies for causing havoc. Dean From: Richard Laager <rlaager(a)micemn.net> Sent: Wednesday, April 30, 2025 9:04 PM To: mice-discuss(a)lists.micemn.net Subject: Re: MICE connectivity issues / elevated multicast traffic It sounds like we had a loop of some kind on the Fiber Minnesota extension switch. It was almost certainly, in some way, related to work they were doing. They are going to investigate further in the morning to try to understand what, specifically, happened. -- Richard Laager Chief Manager, Director Midwest Internet Cooperative Exchange LLC

May 1, 2025

Re: MICE connectivity issues / elevated multicast traffic

by Richard Laager

It sounds like we had a loop of some kind on the Fiber Minnesota extension switch. It was almost certainly, in some way, related to work they were doing. They are going to investigate further in the morning to try to understand what, specifically, happened. -- Richard Laager Chief Manager, Director Midwest Internet Cooperative Exchange LLC

May 1, 2025