- mice-discuss - lists.micemn.net

[OT] Calix GigaSpire RG Failures
by Richard Laager Nov. 5, 2023

Nov. 5, 2023

"Critical: EXOS – GigaSpire RG Systems May Display Amber LED and Be Unreachable" https://community.calix.com/s/feed/0D54u0000A5ugVA "We have confirmed today that *only releases 23.2 and 23.3 are impacted*. EXOS Release 23.3.0.3.57 is now available for use in workflows within Calix Cloud, or for local download from theCalix Software Center <https://www.calix.com/my-calix/software-center.html#>.Please find the release notes for this build here <https://www.calix.com/content/dam/calix/doc-library/systems/prem/support/ex…>, and please reviewService Bulletin SB-23-005 <https://www.calix.com/bin/calix/servlets/docdownload?fileId=/content/dam/ca…>for additional technical detail regarding this matter. With the new release now available,*_we strongly recommend any systems running 23.2 or 23.3 be upgraded to this new release immediately_*. Systems running 23.1 or lower should upgrade to the 23.4 release when it becomes available later this month." -- Richard

1 0

Amazon TNF Bitrate/Stream
by Ben Wiechman Nov. 2, 2023

Nov. 2, 2023

Has anyone spent any time studying the bitrate per stream this year? What are you seeing on your networks? Our Qwilt cache is reporting 25Mbps/stream average, which doesn't seem realistic by other measures. Ben Wiechman Director of Network Strategy and Engineering 320.247.3224 | ben.wiechman(a)arvig.com Arvig | 224 East Main Street | Melrose, MN 56352 | arvig.com

4 7

Google to stop advertising to MICE Route Servers
by Jay Hanke Oct. 23, 2023

Oct. 23, 2023

We have received notice that Google AS15159 will stop sending and receiving routes from the MICE route servers on November 8th, 2023. Google has asked us to share the following notice. Google will keep current BGP bilateral with individual peers on MICE. Google invites other networks that rely on Route-Servers to request a bilateral session. Bilateral session request can be done at: https://isp.google.com/iwantpeering Thanks! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 507-327-2398 https://southfront.io/

2 2

AS57 (NorthernLights/UofM) Maintenance Complete
by Colin Murphy Oct. 14, 2023

Oct. 14, 2023

University of Minnesota Engineers have completed the software upgrades on the NorthernLights Gigapop routers. Thanks, Colin Murphy Sr. Network Engineer Office of Information Technology University of Minnesota Northern Lights Gigapop Desk: 612-626-0870

1 0

AS57 (NorthernLights/UofM) Maintenance
by Colin Murphy Oct. 12, 2023

Oct. 12, 2023

University of Minnesota Engineers will be upgrading the software on the NorthernLights Gigapop routers. The expected outage for each router will be approximately 2 hours. BGP sessions will be shutdown prior to the software upgrades. Please let us know if you have any questions. Change window: 10/14/2023 4 AM to 5 PM CDT. Thanks, Colin Murphy Sr. Network Engineer Office of Information Technology University of Minnesota Northern Lights Gigapop Desk: 612-626-0870

1 0

AS11796 Maintenance
by Charles Monson Sept. 26, 2023

Sept. 26, 2023

AS11796/WIN Technology will be disabling all BGP sessions over the MICE exchange tonight after 2300 (Central) in preparation for maintenance. Please keep your BGP sessions with us active to avoid unnecessary troubleshooting once the link is back up. Thank you, Charles Monson WIN Technology (AS11796/AS26652)

1 0

UG 44 Meeting & Election
by Richard Laager Sept. 25, 2023

Sept. 25, 2023

The MICE UG 44 meeting will be held Wednesday, October 25, 3:00 pm at UMN. Here are the details (parking, etc.) from last time: https://lists.iphouse.net/cgi-bin/wa?A2=MICE-DISCUSS;2c503e19.2209 An updated Zoom link will be coming. *Nominations* We will be holding an election for a board seat. The board consists of three seats with staggered terms, such that one seat comes up for re-election each year (at the fall meeting). This year, Anthony's seat is up for election. As in the past, we will close nominations in advance of the meeting so people have a chance to instruct a proxy appropriately. *Nominations will be open for two weeks (so until the end of October 7).* * * *Proxies * The bylaws state that you send proxies to the Chief Manager (me, Richard Laager), and electronic means are acceptable. So a simple email is sufficient: rlaager(a)wiktel.com or chiefmanager(a)micemn.net. If you send me a /vote/ by email (e.g. "We vote for <X>."), I will treat it as an a proxy appointment, appointing me to vote on your behalf, but restricted to /only/ the election item and to /only/ vote for the candidate you expressed. If you send me a proxy with different instructions (e.g. "We appoint <Y> to vote for us."), obviously that will be honored as written. -- Richard

2 1

Gateway Fiber ribbon cutting
by Michael Horwath Sept. 14, 2023

Sept. 14, 2023

They had that this moring at 1000 hours in Blaine. I made a joke to my friend that I wonder how many of 3 of us will be there. Well, I got a surprise as there were at least 8 folks who were not affilitated with the event. Talking to a couple of folks - would like to have customers up by end of year in Blaine - my area (Coon Rapids) would come afterwards but could not get them to commit or ‘about 6 months’ - GPON for delivery - using Comlink Solutions for the pulls - 511 is on their radar - mentioned expanding south from Blaine into SLP, Mounds View - mentioned expanding north-west into Andover I mentioned MICE and gave el-presidente my email address to contact me, and the website URL And I did not get a pic of their pricing flyer! But 2Gbps bidirectional is $150/month but I cannot remember the lower speeds cause I didn’t care :) -- Mike Horwath, reachable via drechsau(a)Geeks.ORG

3 2

Global Net (AS395466) - Down
by Global Net NOC Sept. 12, 2023

Sept. 12, 2023

MICEMN Members - Our circuit to Cologix in Minneapolis is hard down due to an upstream provider issue. Our BGP sessions remain down. GLOBAL NET AS 395466 IPV4 206.108.255.97 IPV6 2001:504:27:0:6:8ca:0:1 Thanks, Global Net NOC noc(a)theglobal.net Global Net Peering Peering peering(a)theglobal.net

1 0

Route Server 2
by Tom Krenn Sept. 8, 2023

Sept. 8, 2023

Hi all, Anyone else noticing the route server at 206.108.255.2 / 2001:504:27::d1af:0:2 dropping out for a second or so the last few days? I'm seeing similar from both of my routers. LC/0/0/CPU0:Sep 8 07:29:45.717 CDT: bfd_agent[173]: %L2-BFD-6-SESSION_STATE_DOWN : BFD session to neighbor 2001:504:27::d1af:0:2 on interface HundredGigE0/0/0/20 has gone down. Reason: Control timer expired RP/0/RSP0/CPU0:Sep 8 07:29:45.718 CDT: bgp[1065]: %ROUTING-BGP-5-ADJCHANGE : neighbor 2001:504:27::d1af:0:2 Down - BFD (Bidirectional forwarding detection) session down (VRF: default) (AS: 53679) LC/0/0/CPU0:Sep 8 07:29:45.795 CDT: bfd_agent[173]: %L2-BFD-6-SESSION_STATE_DOWN : BFD session to neighbor 206.108.255.2 on interface HundredGigE0/0/0/20 has gone down. Reason: Control timer expired RP/0/RSP0/CPU0:Sep 8 07:29:45.797 CDT: bgp[1065]: %ROUTING-BGP-5-ADJCHANGE : neighbor 206.108.255.2 Down - BFD (Bidirectional forwarding detection) session down (VRF: default) (AS: 53679) LC/0/0/CPU0:Sep 8 07:29:50.384 CDT: bfd_agent[173]: %L2-BFD-6-SESSION_STATE_UP : BFD session to neighbor 2001:504:27::d1af:0:2 on interface HundredGigE0/0/0/20 is up LC/0/0/CPU0:Sep 8 07:29:50.384 CDT: bfd_agent[173]: %L2-BFD-6-SESSION_STATE_UP : BFD session to neighbor 206.108.255.2 on interface HundredGigE0/0/0/20 is up RP/0/RSP0/CPU0:Sep 8 07:30:58.517 CDT: bgp[1065]: %ROUTING-BGP-5-ADJCHANGE : neighbor 206.108.255.2 Up (VRF: default) (AS: 53679) RP/0/RSP0/CPU0:Sep 8 07:31:01.850 CDT: bgp[1065]: %ROUTING-BGP-5-ADJCHANGE : neighbor 2001:504:27::d1af:0:2 Up (VRF: default) (AS: 53679) Tom Krenn Network Architect Enterprise Architecture - Information Technology Office: 612-596-8994 tom.krenn(a)hennepin.us<mailto:tom.krenn@hennepin.us> | hennepin.us<https://hennepin.us/> Hennepin County Government Center 300 South 6th Street, A-190 Minneapolis, MN, 55487 [Hennepin County logo] Connect: Facebook<https://www.facebook.com/hennepin> | Twitter<https://twitter.com/Hennepin> | YouTube<https://www.youtube.com/user/HennepinMN> | LinkedIn<https://www.linkedin.com/company/hennepin-county> | Instagram<https://www.instagram.com/hennepincounty> Disclaimer: If you are not the intended recipient of this message, please immediately notify the sender of the transmission error and then promptly permanently delete this message from your computer system.

4 4

Please welcome G-Core Labs S.A. to MICE!
by Jeremy Lumby Sept. 7, 2023

Sept. 7, 2023

Name: G-Core Labs S.A. Switch: MICE Core Port: E 4/7 ASN: 199524 IPv4: 206.108.255.191/24 IPv6: 2001:504:27:0:3:0B64::1/64 Peering Contact: noc(a)gcore.lu Route Servers: YES BFD: No Welcome Aboard! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

2 3

Global Net (AS395466) - Circuit Restored
by Global Net NOC Aug. 30, 2023

Aug. 30, 2023

MICEMN Members - Our carrier has resolved their power issue to restore our circuit and we have connectivity into Minneapolis again. I will begin to restore BGP sessions with our peers this morning. GLOBAL NET AS 395466 IPv4 206.108.255.97 IPv6 2001:504:27:0:6:8ca:0:1 Thanks, Scott Reed Global Net NOC noc(a)theglobal.net Global Net Peering Peering peering(a)theglobal.net

1 0

Global Net (AS395466) - Carrier Outage / Carrier Maintenance
by Global Net NOC Aug. 28, 2023

Aug. 28, 2023

MICEMN Members - Our carrier experienced a DC power plant failure on Saturday, August 26th @ 1356 MDT at which time our circuit between Bozeman, MT and Minneapolis, MN went down. This circuit was restored this morning at 0301 MDT, but via a temporary power supply. We are being told that the carrier will be replacing the failed DC power plant tomorrow around noon MDT with an expected impact of 90 minutes to our circuit. Our port to the MICE is currently down but I have all BGP sessions disabled for manual and graceful restart once service is fully restored. I would like to wait until the temporary power supply is replaced before bringing sessions back up. GLOBAL NET AS 395466 IPv4 206.108.255.97 IPv6 2001:504:27:0:6:8ca:0:1 Thanks, Scott Reed Global Net NOC noc(a)theglobal.net<mailto:noc@theglobal.net> Global Net Peering Peering peering(a)theglobal.net<mailto:peering@theglobal.net>

1 0

Network Nerd Thoughts?
by Michael Horwath Aug. 21, 2023

Aug. 21, 2023

ObOnTopic: Anyone have a contact there to see if they are willing to join MICE? ObOffTopic: everything else https://www.prnewswire.com/news-releases/gateway-fiber-bringing-100-fiber-o… I moved into CR July 2020 and .. connectivity options are not really options. Greenbutthole (you know, Centurylink, Lumen, some name that starts with Q) loves to say high speed, every address in a 4 block area around me is only capable of 10Mbps down. Comcast? I mean, it works, for a small value of works. Anyone dealt with these folks in the past in other areas? Will they come through? Are there any gotchas? I wish we had more choice. I mean, we had over 200 choices back in the late 90s and early-mid 2000s but they are all gone now. -- Mike Horwath, reachable via drechsau(a)Geeks.ORG

1 0

OT: Blast from the past!
by Jay Hanke Aug. 14, 2023

Aug. 14, 2023

[image: 20180410_090819.jpg] -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000 https://southfront.io/path.html

2 1

Ridgeview Traffic
by Jay Hanke Aug. 7, 2023

Aug. 7, 2023

Looks like a successful weekend at the new Ridgeview. This is the uplink traffic measured at the 511 end. [image: image.png]

3 2

Give Aways
by Justin Krejci Aug. 4, 2023

Aug. 4, 2023

I have a few items to give away: first responding, first served. Must either pick up in Minnetonka, MN or possibly nearby area. 4x Fiber SMF duplex jumpers * SC to LC blue connectors (not green APC) * 5m fiber jumper with thicker outdoor jacket * The last 12 inches or so at each end are the standard yellow jacket. * Condition: New/unused 8x (could be 9 or 10) standard RJ45 patch panels * 48 ports * 2RU height * 19" width post * Model: unknown * Includes cable management clips that fasten onto the front side * Wire bars on the rear side for tying rear side cables * Condition: New/unused 2x 40G QSFPs * Model: Robofiber QSFP-4010-PLR4-A * Condition: Light or no use 2x 40G QSFPs * Model: Robofiber QSFP-4010-LR4-A * Condition: Light or no use 6x 40G QSFP AOCs * 1m length * Model: Robofiber QSFP-40G-01AOC-A * Condition: Light use, no damage, no visible wear and tear If anyone wants pictures of any of these let me know and I can send you some. -Justin

1 0

MICE Ridgeview Traffic
by Jay Hanke Aug. 3, 2023

Aug. 3, 2023

Running about 18G of traffic on the new MICE Ridgeview switch! Jay

5 9

Fiber cut?
by Frank Bulk July 25, 2023

July 25, 2023

Did anyone notice a fiber cut on Zayo's network between Le Mars and Sioux City around 2:45 pm? Our staff saw some damage south to their fiber of NIPCO, but it's possible that Zayo abandoned that stretch of fiber due to an earlier Hwy 75 road project. Regards, Frank

3 2

Re: FW: [EXTERNAL] - [MICE-DISCUSS] MICE Participants List
by Richard Laager June 28, 2023

June 28, 2023

It turns out that I had the route server links wrong. There is a database ID that gets put into the BIRD protocol. I thought it was the customer (participant) ID. But it turns out it is the VLAN Interface ID. I corrected this, and now the links work correctly. On 2023-06-28 06:26, Miles McCredie wrote: > > FWIW, the looking glass links generate the following message > -- Richard

1 0

MICE Participants List
by Richard Laager June 28, 2023

June 28, 2023

The MICE participants list is now built from IXP Manager: https://micemn.net/participants.html If there is something wrong about your entry, please let me or Jeremy know. See below about port discrepancies, first. I want to specifically thank Dustin Frandle of South Front Networks. He started this effort with JavaScript code to convert a standard IX-F JSON export into a participants table. While I ended up going a different direction (for reasons discussed below), he got the ball rolling. Jeremy and I wanted to retain the contact addresses, which IXP Manager only outputs in the IX-F export if you are logged in. (And, despite my request, they remain firm in that position and refuse to allow customization.) Additionally, I wanted to retain the ports, since our current process has Cologix using the website as the LOA/CFA. (We may want to move to a more standard approach on that, but I didn't want to put that change into the critical path of getting the participants list automated.) Unfortunately, despite a previous request and my re-request for it, the IXP Manager maintainer has taken a firm position that the IX-F JSON export should not be customizable. So I cannot easily tweak the template to output emails when unauthenticated or add additional information for ports. IXP Manager does support the idea of a custom member export, and INEX (the exchange primarily behind IXP Manager development) does use that for a custom JSON output. However, that requires building the desired output from scratch. I figured if I was going to do that, I might as well just output HTML directly. That way, I only have one thing in one language (PHP) to worry about, rather than two things (PHP + JavaScript). Granted, there are some cons too. I'm not 100% happy about any of this. But, ultimately I had to make some decision to get it done, and that's where I landed. I did the best I could with the responsive design. There are a couple of pre-existing bugs on edge cases (e.g. when your size falls at 991.xx so it's not <= 991 but also not >= 992, which is maybe only possible on HiDPI displays) that affect the whole site. This page in particular is not ideal on mobile, but I did what I could. If you've got better ideas, please let me know. ---- There are a couple port discrepancies that I've asked Jeremy to review: 702 Communications * Bluepeak Broadband Visions * G-Core Labs * HBC * LTD Broadband Omnitel * Paul Bunyan South Front Truestream * US Internet * I'm pretty sure these were wrong/outdated on the old list and correct in IXP Manager / on the new list. -- Richard

3 2

WiscNet router maintenance Thursday, June 29, 4pm
by Chris Wopat June 27, 2023

June 27, 2023

WiscNet will be replacing a router this coming Thursday at 4pm local time. Our MICE connection will be down during this transition. Expect it down for 15mins or so, maintenance should be complete by 7pm. Cheers, -- Chris Wopat Network Engineer, WiscNet wopat(a)wiscnet.net 608-210-3965

1 0

Three BGP peers
by Frank Bulk June 24, 2023

June 24, 2023

Anyone else seeing both Yahoo peers and one Google peer down since early am? I didn't see any log messages about exceeding prefix counts or the like. Frank SiouxCity-Fibernet-Arista(s2)#sh ip bgp sum | ex Estab BGP summary information for VRF default Router identifier 207.32.15.21, local AS number 18883 Neighbor Status Codes: m - Under maintenance Neighbor V AS MsgRcvd MsgSent InQ OutQ Up/Down State PfxRcd PfxAcc 206.108.255.58 4 10310 2035987 4886675 0 0 12:23:38 Active 206.108.255.59 4 10310 2029469 4886360 0 0 12:23:41 Active 206.108.255.167 4 15169 2050148 4888984 0 0 12:23:40 Active SiouxCity-Fibernet-Arista(s2)#sh ipv6 bgp sum | ex Estab BGP summary information for VRF default Router identifier 207.32.15.21, local AS number 18883 Neighbor Status Codes: m - Under maintenance Neighbor V AS MsgRcvd MsgSent InQ OutQ Up/Down State PfxRcd PfxAcc 2001:504:27::2846:0:1 4 10310 2209610 1893247 0 0 12:23:40 Active 2001:504:27::2846:0:2 4 10310 2202613 1892818 0 0 12:23:47 Active 2001:504:27::3b41:0:2 4 15169 2043589 1894022 0 0 12:23:48 Active SiouxCity-Fibernet-Arista(s2)#

6 8

Global Net (AS395466) - Circuit Down
by Global Net NOC June 24, 2023

June 24, 2023

MICEMN Members - Our circuit to Cologix in Minneapolis is hard down due to a bridge collapse, train derailment and subsequent fiber cut in Columbus, MT. Our BGP sessions remain down. GLOBAL NET AS 395466 IPV4 206.108.255.97 IPV6 2001:504:27:0:6:8ca:0:1 Thanks, Global Net NOC noc(a)theglobal.net Global Net Peering peering(a)theglobal.net

1 0

Route Server 1 - BFD not working
by Jonathan Stewart June 23, 2023

June 23, 2023

Hi MICE, We are AS18451. On our BGP session to Route Server 1 (206.108.225.1 & 2001:504:27::d1af:0:1) i have lost the BFD session. My Juniper router shows the state as "Down". Is this intentional? An accident of the upgrades? Is my configuration wrong? Anyone else noticing this? My configuration is an interval of 1000 ms, multiplier 3. RS 2 is configured the same and BFD is up. Thanks, Jonathan -- Jonathan Stewart Network Engineer LES.NET - AS18451 Desk: 1-204-666-6191 Mobile: 1-204-990-2120 130 Portage Avenue E Winnipeg, MB R3C 0A1 CANADA

4 7