- mice-discuss - lists.micemn.net

Re: v6 on rs1/rs2 fubar?

by Richard Laager

The errors in the logs are: Received: Malformed attribute list and Received: Malformed attribute list: f0230400025a94000000000000000000 Most do NOT have the ": ..." part. Only one particular AS has that additional information. It's not clear to me if that indicates that particular AS is originating the malformed data or not. That AS is not connected to all of the affected IXes, so that may be a red-herring. I'm intentionally not naming the particular AS at this time, to avoid publicly shaming them in case it's nothing they are doing. We are reaching out to them directly, though. -- Richard Laager Chief Manager, Director Midwest Internet Cooperative Exchange LLC

Oct. 7, 2025

RE: v6 on rs1/rs2 fubar?

by Mark Kane

FWIW, we saw this from rs1/rs2 on a Cisco: Oct 7 14:49:10 CDT: bgp[1087]: %ROUTING-BGP-3-MALFORM_UPDATE : Malformed UPDATE message received from neighbor 2001:504:27::d1af:0:2 (VRF: default) - message length 171 bytes, error flags 0x00000100, action taken "TreatAsWdr". Error details: "Error 0x00000100, Field "Attr-length", Attribute 35 (Flags 0xe0, Length 1024), Data [f0230400]". NLRIs: [IPv6 Unicast] 2402:2de0::/32 Oct 7 15:18:11 CDT: bgp[1087]: %ROUTING-BGP-3-MALFORM_UPDATE : Malformed UPDATE message received from neighbor 2001:504:27::d1af:0:1 (VRF: default) - message length 171 bytes, error flags 0x00000100, action taken "TreatAsWdr". Error details: "Error 0x00000100, Field "Attr-length", Attribute 35 (Flags 0xe0, Length 1024), Data [f0230400]". NLRIs: [IPv6 Unicast] 2402:2de0::/32 Both sessions have remained up and appear normal. > -----Original Message----- > From: Jay Hanke via mice-discuss <mice-discuss(a)lists.micemn.net> > Sent: October 7, 2025 15:34 > To: Jonathan Stewart <jonathan(a)les.net> > Cc: mice-discuss(a)lists.micemn.net > Subject: Re: v6 on rs1/rs2 fubar? > > Confirmed at FLIX/CIX-ATL/PIT-IX so far. > > All juniper but not all junipers affected > > If someone affected can you send me a trace it would be helpful. > > On Tue, Oct 7, 2025 at 3:32 PM Jonathan Stewart <jonathan(a)les.net> wrote: > > > > I've seen BGP sessions resetting this afternoon on Juniper. > > > > What more do we know from the global community? > > > > Jonathan Stewart > > Network Engineer > > LES.NET - AS18451 > > Desk: 1-204-666-6191 > > Mobile: 1-204-990-2120 > > 130 Portage Avenue E > > Winnipeg, MB R3C 0A1 > > CANADA > > > > On Tue, 2025-10-07 3:11 p.m., Jay Hanke via mice-discuss wrote: > > > Looks like it might be a worldwide issue. > > > > > > Running Juniper? > > > > > > On Tue, Oct 7, 2025 at 3:07 PM Andrew Hoyos <hoyosa(a)gmail.com> > wrote: > > >> Hi folks, > > >> > > >> We dropped v6 to rs1/rs2. Spot checked a few other members we > manage, and same deal. > > >> Any work taking place on route servers at the moment? > > >> > > >> > > >> Andrew Hoyos > > >> hoyosa(a)gmail.com > > >> > > >> > > >> > > >> _______________________________________________ > > >> mice-discuss mailing list -- mice-discuss(a)lists.micemn.net > > >> To unsubscribe send an email to mice-discuss-leave(a)lists.micemn.net > > > _______________________________________________ > > > mice-discuss mailing list -- mice-discuss(a)lists.micemn.net > > > To unsubscribe send an email to mice-discuss-leave(a)lists.micemn.net > > _______________________________________________ > > mice-discuss mailing list -- mice-discuss(a)lists.micemn.net > > To unsubscribe send an email to mice-discuss-leave(a)lists.micemn.net > _______________________________________________ > mice-discuss mailing list -- mice-discuss(a)lists.micemn.net > To unsubscribe send an email to mice-discuss-leave(a)lists.micemn.net

Oct. 7, 2025

Re: v6 on rs1/rs2 fubar?

by Jay Hanke

Confirmed at FLIX/CIX-ATL/PIT-IX so far. All juniper but not all junipers affected If someone affected can you send me a trace it would be helpful. On Tue, Oct 7, 2025 at 3:32 PM Jonathan Stewart <jonathan(a)les.net> wrote: > > I've seen BGP sessions resetting this afternoon on Juniper. > > What more do we know from the global community? > > Jonathan Stewart > Network Engineer > LES.NET - AS18451 > Desk: 1-204-666-6191 > Mobile: 1-204-990-2120 > 130 Portage Avenue E > Winnipeg, MB R3C 0A1 > CANADA > > On Tue, 2025-10-07 3:11 p.m., Jay Hanke via mice-discuss wrote: > > Looks like it might be a worldwide issue. > > > > Running Juniper? > > > > On Tue, Oct 7, 2025 at 3:07 PM Andrew Hoyos <hoyosa(a)gmail.com> wrote: > >> Hi folks, > >> > >> We dropped v6 to rs1/rs2. Spot checked a few other members we manage, and same deal. > >> Any work taking place on route servers at the moment? > >> > >> > >> Andrew Hoyos > >> hoyosa(a)gmail.com > >> > >> > >> > >> _______________________________________________ > >> mice-discuss mailing list -- mice-discuss(a)lists.micemn.net > >> To unsubscribe send an email to mice-discuss-leave(a)lists.micemn.net > > _______________________________________________ > > mice-discuss mailing list -- mice-discuss(a)lists.micemn.net > > To unsubscribe send an email to mice-discuss-leave(a)lists.micemn.net > _______________________________________________ > mice-discuss mailing list -- mice-discuss(a)lists.micemn.net > To unsubscribe send an email to mice-discuss-leave(a)lists.micemn.net

Oct. 7, 2025

Re: v6 on rs1/rs2 fubar?

by Jonathan Stewart

I've seen BGP sessions resetting this afternoon on Juniper. What more do we know from the global community? Jonathan Stewart Network Engineer LES.NET - AS18451 Desk: 1-204-666-6191 Mobile: 1-204-990-2120 130 Portage Avenue E Winnipeg, MB R3C 0A1 CANADA On Tue, 2025-10-07 3:11 p.m., Jay Hanke via mice-discuss wrote: > Looks like it might be a worldwide issue. > > Running Juniper? > > On Tue, Oct 7, 2025 at 3:07 PM Andrew Hoyos <hoyosa(a)gmail.com> wrote: >> Hi folks, >> >> We dropped v6 to rs1/rs2. Spot checked a few other members we manage, and same deal. >> Any work taking place on route servers at the moment? >> >> >> Andrew Hoyos >> hoyosa(a)gmail.com >> >> >> >> _______________________________________________ >> mice-discuss mailing list -- mice-discuss(a)lists.micemn.net >> To unsubscribe send an email to mice-discuss-leave(a)lists.micemn.net > _______________________________________________ > mice-discuss mailing list -- mice-discuss(a)lists.micemn.net > To unsubscribe send an email to mice-discuss-leave(a)lists.micemn.net

Oct. 7, 2025

Re: v6 on rs1/rs2 fubar?

by Jay Hanke

Looks like it might be a worldwide issue. Running Juniper? On Tue, Oct 7, 2025 at 3:07 PM Andrew Hoyos <hoyosa(a)gmail.com> wrote: > > Hi folks, > > We dropped v6 to rs1/rs2. Spot checked a few other members we manage, and same deal. > Any work taking place on route servers at the moment? > > > Andrew Hoyos > hoyosa(a)gmail.com > > > > _______________________________________________ > mice-discuss mailing list -- mice-discuss(a)lists.micemn.net > To unsubscribe send an email to mice-discuss-leave(a)lists.micemn.net

Oct. 7, 2025

v6 on rs1/rs2 fubar?

by Andrew Hoyos

Hi folks, We dropped v6 to rs1/rs2. Spot checked a few other members we manage, and same deal. Any work taking place on route servers at the moment? Andrew Hoyos hoyosa(a)gmail.com

Oct. 7, 2025

Please welcome Americom Networks to MICE!

by Jeremy Lumby

Name: Americom Networks LLC Switch: NOCIX Ports: E 5/22 ASN: 399503 IPv4: 206.108.255.68/24 IPv6: 2001:504:27:0:6:188F::1/64 Peering Contact: support(a)americomnetworks.com Route Servers: YES Welcome Aboard! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

Sept. 30, 2025

Please welcome Northeast Service Cooperative to MICE!

by Jeremy Lumby

Name: Northeast Service Cooperative Switch: MICE Core Ridgeview-100G 7504 Port: Ethernet 3/12/1 (1x100G total) ASN: 21873 IPv4: 206.108.255.67/24 IPv6: 2001:504:27:0:0:5571::1/64 Peering Contact: gpeterson(a)nescmn.net Route Servers: YES Welcome Aboard! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

Sept. 30, 2025

Re: UG 48 Meeting & Election

by Richard Laager

On 2025-09-23 13:44, Reid Fishler via mice-discuss wrote: > Seconded, if required. Responding with my MICE hat on for the procedural question... Seconds are not required for director nominations. Our practice has been that anyone can nominate themselves. If someone was to nominate a third-party, then we'd need to confirm with that person that they accepted (i.e. were willing to run & serve). -- Richard Laager Chief Manager, Director Midwest Internet Cooperative Exchange LLC

Sept. 23, 2025

Re: UG 48 Meeting & Election

by Reid Fishler

Seconded, if required. Reid On Tue, Sep 23, 2025 at 12:24 PM Richard Laager via mice-discuss < mice-discuss(a)lists.micemn.net> wrote: > I nominate myself (Richard Laager). I am pleased to run again and would > appreciate your support! > > On 2025-09-23 10:59, Richard Laager wrote: > > Here is your reminder email about the board election nomination period. > > On 2025-08-30 00:11, Richard Laager wrote: > > The MICE UG 48 meeting will be held Wednesday, October 8, 3:00 pm at UMN > and via Zoom. > > > *Nominations* > > We will be holding an election for a board seat. The board consists of > three seats with staggered terms, such that one seat comes up for > re-election each year (at the fall meeting). This year, I (Richard Laager) > am up for election. > > As in the past, we will close nominations in advance of the meeting so > people have a chance to instruct a proxy appropriately. *Nominations will > be open for two weeks, September 22 - October 5. *I plan to send reminder > emails approximately at the start of and just after the nomination period. > > -- > Richard > > _______________________________________________ > mice-discuss mailing list -- mice-discuss(a)lists.micemn.net > To unsubscribe send an email to mice-discuss-leave(a)lists.micemn.net > -- Reid Fishler Senior Director Hurricane Electric +1-510-580-4178

Sept. 23, 2025

Re: UG 48 Meeting & Election

by Richard Laager

I nominate myself (Richard Laager). I am pleased to run again and would appreciate your support! On 2025-09-23 10:59, Richard Laager wrote: > Here is your reminder email about the board election nomination period. > > On 2025-08-30 00:11, Richard Laager wrote: >> >> The MICE UG 48 meeting will be held Wednesday, October 8, 3:00 pm at >> UMN and via Zoom. >> >> >> *Nominations* >> >> We will be holding an election for a board seat. The board consists >> of three seats with staggered terms, such that one seat comes up for >> re-election each year (at the fall meeting). This year, I (Richard >> Laager) am up for election. >> >> As in the past, we will close nominations in advance of the meeting >> so people have a chance to instruct a proxy appropriately. >> *Nominations will be open for two weeks, September 22 - October 5. *I >> plan to send reminder emails approximately at the start of and just >> after the nomination period. >> -- Richard

Sept. 23, 2025

Re: UG 48 Meeting & Election

by Richard Laager

Here is your reminder email about the board election nomination period. On 2025-08-30 00:11, Richard Laager wrote: > > The MICE UG 48 meeting will be held Wednesday, October 8, 3:00 pm at > UMN and via Zoom. > > > *Nominations* > > We will be holding an election for a board seat. The board consists of > three seats with staggered terms, such that one seat comes up for > re-election each year (at the fall meeting). This year, I (Richard > Laager) am up for election. > > As in the past, we will close nominations in advance of the meeting so > people have a chance to instruct a proxy appropriately. *Nominations > will be open for two weeks, September 22 - October 5. *I plan to send > reminder emails approximately at the start of and just after the > nomination period. > -- Richard Laager Chief Manager, Director Midwest Internet Cooperative Exchange LLC

Sept. 23, 2025

RE: MICE has broken 2T

by Jeff Wilde

Impressive. [A picture containing icon Description automatically generated] Jeff Wilde • Network Engineer • Park Region Office 218.826.6161 • Direct 218.826.8330 • Fax 218.826.6298 From: David Farmer via mice-discuss <mice-discuss(a)lists.micemn.net> Sent: Monday, September 8, 2025 11:12 PM To: mice-discuss(a)lists.micemn.net Subject: Re: MICE has broken 2T Caution: External Sender. Please do not click on links or open attachments from senders you do not trust. WOOPS, Thursday and Sunday. On Mon, Sep 8, 2025 at 10:42 PM David Farmer <farmer(a)umn.edu<mailto:farmer@umn.edu>> wrote: MICE has broken 2T twice in the last week, on Tuesday and Sunday. [cid:image002.png@01DC2159.B7853A80] -- =============================================== David Farmer Email:farmer@umn.edu<mailto:Email%3Afarmer@umn.edu> Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 =============================================== -- =============================================== David Farmer Email:farmer@umn.edu<mailto:Email%3Afarmer@umn.edu> Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

Sept. 9, 2025

Re: MICE has broken 2T

by David Farmer

WOOPS, Thursday and Sunday. On Mon, Sep 8, 2025 at 10:42 PM David Farmer <farmer(a)umn.edu> wrote: > MICE has broken 2T twice in the last week, on Tuesday and Sunday. > > [image: image.png] > > -- > =============================================== > David Farmer Email:farmer@umn.edu > Networking & Telecommunication Services > Office of Information Technology > University of Minnesota > 2218 University Ave SE Phone: 612-626-0815 > Minneapolis, MN 55414-3029 Cell: 612-812-9952 > =============================================== > -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

Sept. 9, 2025

MICE has broken 2T

by David Farmer

MICE has broken 2T twice in the last week, on Tuesday and Sunday. [image: image.png] -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

Sept. 9, 2025

UG 48 Meeting & Election

by Richard Laager

The MICE UG 48 meeting will be held Wednesday, October 8, 3:00 pm at UMN and via Zoom. *Nominations* We will be holding an election for a board seat. The board consists of three seats with staggered terms, such that one seat comes up for re-election each year (at the fall meeting). This year, I (Richard Laager) am up for election. As in the past, we will close nominations in advance of the meeting so people have a chance to instruct a proxy appropriately. *Nominations will be open for two weeks, September 22 - October 5. *I plan to send reminder emails approximately at the start of and just after the nomination period. In the event that the election is uncontested, our practice is to elect by acclimation at the meeting. Proxies are unnecessary in that situation, assuming that the meeting makes quorum. *Proxies * The bylaws state that you send proxies to the Chief Manager (me, Richard Laager), and electronic means are acceptable. So a simple email is sufficient: rlaager(a)micemn.net or chiefmanager(a)micemn.net. Since it is my seat up for election this time, if you wish, you may alternatively send proxies to Anthony Anderberg: ant(a)micemn.net. If you send a /vote/ by email (e.g. "We vote for <X>."), we will treat it as an a proxy appointment, appointing me (or Anthony, if sent to him) to vote on your behalf, but restricted to /only/ the election item and to /only/ vote for the candidate you expressed. If you send a proxy with different instructions (e.g. "We appoint <Y> to vote for us."), obviously that will be honored as written. *UMN Details* (from David Farmer) [The meeting] will be held at the University’s Information Technology Building, 2218 University Ave SE, Minneapolis, MN 55414, Room 185. It is across University Ave SE from Huntington Bank Stadium (Formerly TCF Bank Stadium). See the link to the Campus Map below. This room has a video room system, and remote access will be made available via Zoom video or phone audio, see Zoom details below. Please enter the building through the middle of three doors on the Ontario St SE side of the building. It will be open after 2:30 and will have a sign on it. If not, please knock hard, or call my cell phone (612-812-9952). This door is right outside the meeting room, this avoids everyone traipsing through the building. The Stadium Village Green Line Light Rail Station is less than a block east of the building, kitty-corner at the intersection of University Ave SE and Huron Blvd SE. See the link below for the station's info page. Limited Street Parking is available on Ontario St SE and Beacon St SE. Otherwise, public parking is available in the Oak St and University Ave Ramps, each a little over two blocks away. Also, the Maroon lot is a little further on the north side of the Stadium. See the link below for more parking details. DO NOT park in University Parking Lot 70 on the north of the building, by the front door, between University Ave SE and the building, or Parking Lot 71 near the loading dock to the east of the building, they are contract parking only, and you be ticketed. Also, DO NOT park in the private parking lot to the south of the building; you will likely be tagged, booted, and towed from that parking lot. https://campusmaps.umn.edu/information-technology https://www.metrotransit.org/stadium-village-station https://pts.umn.edu/Park/Basic-Parking-Information/Parking-Facilities * * *Zoom Details* https://umn.zoom.us/j/94150849014?pwd=KLBvs9gAlRyobV2T5oTKyHcWpnUpKq.1 ID: 98593962100, passcode: 9txWv0 301-715-8592, meeting ID 98593962100, passcode 820959 -- Richard Laager Chief Manager, Director Midwest Internet Cooperative Exchange LLC

Aug. 30, 2025

Please welcome Solarus to MICE!

by Jeremy Lumby

Name: Solarus Switch: MICE Core 511-100G 7504 Ports: E 6/5/1 ASN: 10352 IPv4: 206.108.255.39/24 IPv6: 2001:504:27:0:0:2870::1/64 Peering Contact: ipadmin(a)solarus.org Route Servers: Yes Welcome Aboard! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

Aug. 23, 2025

Please welcome WCCTA to MICE!

by Jeremy Lumby

Name: Webster-Calhoun Cooperative Telephone Association Switch: SouthFront 10G Ports: E 6 ASN: 20273 IPv4: 206.108.255.37/24 IPv6: 2001:504:27:0:0:4F31::1/64 Peering Contact: closeke(a)wccta.com Route Servers: YES Welcome Aboard! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

Aug. 23, 2025

UnitedHealth Group Maintenance

by Gartley, Dakota S

UHG (AS10879) will be performing maintenance tonight starting at 9PM Central. At this time, our peering will go down and will be brought back up once maintenance is completed. ____________________________ Dakota Gartley | Optum Technology Senior Manager, Network Engineering Edge & Customer Connectivity (ECC) Network, Security and Internet Services (NSIS) T +1 763-732-6405<tel:+17637326405> dakota(a)optum.com<mailto:dakota@optum.com> [A picture containing text, clipart Description automatically generated] This e-mail, including attachments, may include confidential and/or proprietary information, and may be used only by the person or entity to which it is addressed. If the reader of this e-mail is not the intended recipient or intended recipient’s authorized agent, the reader is hereby notified that any dissemination, distribution or copying of this e-mail is prohibited. If you have received this e-mail in error, please notify the sender by replying to this message and delete this e-mail immediately.

Aug. 21, 2025

Please welcome Meta to MICE!

by Jeremy Lumby

Name: Meta Platforms, INC Switch: MICE Core 511-400G 7804 Ports: 3/25/1 in portchannel 21 and 4/25/1 in portchannel 22 for a total of 2x1x400G ASN: 32934 IPv4: All IP info remains the same, this is an upgrade to 2x400G IPv6: Peering Contact: peering(a)meta.com Route Servers: Yes Welcome Aboard Again! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

Aug. 13, 2025

Re: WiscNet MICE remote switch maintenance 2025-08-12 5pm

by Chris Wopat

On 8/11/25 18:49, Chris Wopat wrote: > WiscNet is performing maintenance on our MICE remote switch on Tue Aug > 12th at 5pm. > > Time window is 5p-7p but expect ~30minutes downtime. > Completed successfully. Let us know if you see any issues with peers on WiscNet remote switch. -- Chris Wopat Network Engineer, WiscNet wopat(a)wiscnet.net 608-210-3965

Aug. 12, 2025

WiscNet MICE remote switch maintenance 2025-08-12 5pm

by Chris Wopat

WiscNet is performing maintenance on our MICE remote switch on Tue Aug 12th at 5pm. Time window is 5p-7p but expect ~30minutes downtime. We're doing Junos updates and will cull BGP sessions during the maintenance. This will affect all peers though this switch: * AS2381 - WiscNet * AS3128 - University of Wisconsin System * AS11317 - Great Planes Network Cheers, -- Chris Wopat Network Engineer, WiscNet wopat(a)wiscnet.net 608-210-3965

Aug. 11, 2025

Please welcome Nuvera to MICE!

by Jeremy Lumby

Name: Nuvera Communications Switch: MICE Core Ridgeview-100G 7504 Port: Ethernet 3/11/1 Strands 25-26 (100G at this location, and 100G @511) ASN: 23465 IPv4: 206.108.255.34/24 IPv6: 2001:504:27:0:0:64FC::2/64 Peering Contact: NOC(a)nuvera.net Route Servers: Yes Nuvera is adding a second diverse connection at Ridgeview Welcome Aboard Again! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

Aug. 8, 2025

CS Tech Port Move

by Jay Hanke

CS Tech LAG has been moved to: SFN MN-AlbertLeaSFN-Remote-10G :: Ethernet4 SFN MN-AlbertLeaSFN-Remote-10G :: Ethernet5 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 507-327-2398 https://southfront.io/ MWPS 2025 https://www.eventcreate.com/e/mwps2025

Aug. 7, 2025

Please welcome MTC Technologies to MICE!

by Jeremy Lumby

Name: Mediapolis Telephone Company dba MTC Technologies Switch: SouthFront 10G Ports: E 3 ASN: 18519 IPv4: 206.108.255.26/24 IPv6: 2001:504:27:0:0:4857::1/64 Peering Contact: noc(a)mtctech.net Route Servers: YES Welcome Aboard! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

Aug. 1, 2025