- mice-discuss - lists.micemn.net

Global Net - AS395466 Maintenance
by Global Net NOC Feb. 22, 2024

Feb. 22, 2024

MICEMN Members - Our upstream provider, Zayo, will be undergoing a forced relocation at our datacenter in Montana. Expect our BGP sessions to drop during this time. 2/22 2200 – 2/23 0500 MST GLOBAL NET AS 395466 IPV4 206.108.255.97 IPV6 2001:504:27:0:6:8ca:0:1 Thanks, Global Net NOC noc(a)theglobal.net<mailto:noc@theglobal.net> Global Net Peering peering(a)theglobal.net<mailto:peering@theglobal.net>

1 0

UG 45 Meeting
by Richard Laager Feb. 22, 2024

Feb. 22, 2024

The MICE UG 45 meeting will be held Wednesday, March 20, 3:00 pm at UMN. Parking, etc. details same as before: https://lists.iphouse.net/cgi-bin/wa?A2=MICE-DISCUSS;2c503e19.2209 Zoom Details: https://umn.zoom.us/j/94910223662?pwd=RUluTERkODlsdU93eHlQejR4eFVRdz09 ID: 94910223662, passcode: XdrNr3 651-372-8299 (passcode: 988007) -- Richard

1 1

MICE Server Updates
by Cameron Skappel Feb. 9, 2024

Feb. 9, 2024

This evening I applied server updates to some of the MICE servers including Router Server 2. Let me know if there are issues. -- Cameron

1 1

MICE BFD Errors
by Richard Laager Feb. 8, 2024

Feb. 8, 2024

BIRD is complaining that various peers are sending BFD packets with an unknown session id. Anyone have thoughts on this? The logs look like this: 2024-02-07 23:44:14 <RMT> bfd1: Bad packet from YOUR_IP - unknown session id (SOME_INTEGER) Those marked with an asterisk were doing this yesterday, so prior to the reboot of rs2. rs1: Inteliquent (Neutral Tandem) 206.108.255.137 * rs2: les.net 2001:504:27::4813:0:1 Savage Communications 206.108.255.17 * 2001:504:27::5adc:0:1 * Stellar Association 206.108.255.53 2001:504:27::8e16:0:1 * Hoyos Consulting 2001:504:27::d15d:0:1 Eastern Iowa Data Group 206.108.255.168 * 2001:504:27::f7a2:0:1 * Omnitel Communications 206.108.255.148 Here is for the entire month of January: rlaager@rs1:~$ rg "^2024-01-.*Bad packet from" /var/log/bird/rs1-ipv*.1 | awk '{print $8}' | sort | uniq -c 9 2001:504:27::3823:0:2 2 2001:504:27::8252:0:1 1183836 2001:504:27::b7f8:0:1 4 2001:504:27::d15d:0:1 1183834 206.108.255.101 7498 206.108.255.119 380 206.108.255.121 1463099 206.108.255.137 3 206.108.255.176 3 206.108.255.185 root@rs2:~# rg "^2024-01-.*Bad packet from" /var/log/bird/rs2-ipv*.1 | awk '{print $8}' | sort | uniq -c 12 2001:504:27::1e49:0:1 1 2001:504:27::3823:0:2 1 2001:504:27::39:0:1 1457433 2001:504:27::5adc:0:1 3 2001:504:27::6478:0:1 1457369 2001:504:27::8e16:0:1 1 2001:504:27::9dbe:0:1 5 2001:504:27::9dbe:0:2 1179733 2001:504:27::b7f8:0:1 1176975 2001:504:27::d15d:0:1 4 2001:504:27::e4f:0:1 1 2001:504:27::f756:0:1 1331747 2001:504:27::f7a2:0:1 1179735 206.108.255.101 7494 206.108.255.119 1954 206.108.255.120 3 206.108.255.137 3 206.108.255.161 1331745 206.108.255.168 1457437 206.108.255.17 2 206.108.255.176 8 206.108.255.185 11 206.108.255.3 6 206.108.255.46 1457345 206.108.255.53 4 206.108.255.92 -- Richard

2 1

MICE Core Switch Card Upgrade
by Richard Laager Feb. 8, 2024

Feb. 8, 2024

Date & Time Wednesday, February 14 at 15:00 US/Central Description Jeremy will swap a (now unused) 10G line card for a 100G line card in the Arista core switch at 511. There is no expected impact for most participants. In the (relatively unlikely) event that a fiber cable is physically in the way and he has to unplug it to remove/install the card, he will disable BGP for that participant first and wait (unless the port is part of a LAG with sufficient excess capacity at that time of day). The Fiber Minnesota and Minnesota VoIP remote switches are connected by 3x100G LAG. Jeremy will move one port from each LAG from card 6 to the new card. Rollback Plan If there is some problem, the new 100G card can be removed. The ports in the Fiber Minnesota and Minnesota VoIP remote switches can be moved back to card 6. -- Richard

1 0

MICE Core Switch EOS Upgrade
by Richard Laager Feb. 7, 2024

Feb. 7, 2024

Date & Time Wednesday, January 31 at 06:00 US/Central Description Jeremy will upgrade software on the Arista core switch at 511. This is necessary to be able to install the (newer) 100G card into the switch. Rollback Plan The previous software image will be available to revert. -- Richard

3 5

Addresses on the list...
by Mike Horwath Jan. 31, 2024

Jan. 31, 2024

Calling out: From: Tritan Internet LLC (AS393577) <noc(a)as393577.net> Subject: TD#937 - Acknowledgement from Tritan Internet NOC Please subscribe either a user to the list or update things so that autoresponses do not occur. LISTSERV picked it up and did the right thing, thankfully. -- Mike Horwath, reachable via drechsau(a)Geeks.ORG

1 0

BGP ADD-PATH capability
by Richard Laager Jan. 24, 2024

Jan. 24, 2024

I propose that MICE enable BGP ADD-PATH capability (RFC 7911) on the route servers (in TX mode only). This is negotiated BGP capability, so we do not need any per-participant setting for it. ADD-PATH is useful if the best path route is being filtered but another route would not be. We discussed adding this at a UG meeting years ago. There are other IXPs that have this enabled. For example, this one: https://www.bcix.de/ixp/content/0/route-servers In terms of timeline, I propose something like this: * January 9: Enable it on Route Server 1. * January 16: Enable it on Route Server 2. The actual change looks like this for the RS1-only piece, and then the conditional would be removed when we want to deploy to RS2: --- a/roles/ixpmanager/files/mice/api/v4/router/server/bird2/neighbors.foil.php +++ b/roles/ixpmanager/files/mice/api/v4/router/server/bird2/neighbors.foil.php @@ -315,6 +315,9 @@ protocol bgp pb_<?= $int['fvliid'] ?>_as<?= $int['autsys'] ?> from tb_rsclient { import filter f_import_as<?= $int['autsys'] ?>; table t_<?= $int['fvliid'] ?>_as<?= $int['autsys'] ?>; export filter f_export_as<?= $int['autsys'] ?>; +<?php if( $t->router->router_id == "206.108.255.1" ): ?> + add paths tx; +<?php endif; ?> }; <?php if( $int['bgpmd5secret'] && !$t->router->skip_md5 ): ?> password "<?= $int['bgpmd5secret'] ?>"; -- Richard

6 11

MICE Maintenance 2024-01-18 & 2024-01-19
by Richard Laager Jan. 9, 2024

Jan. 9, 2024

Date & Time January 18, 00:00 - 05:00 US/Central January 19, 00:00 - 05:00 US/Central Description Our underlying fiber provider will be doing maintenance on the connection from 511 to Ridgeview. They are attempting to repair some other fiber issues. We may or may not go down. If we did go down, participants on the 511 side would see a loss of BGP to Route Server 2. -- Richard

1 0

Route servers?
by Miles McCredie Jan. 3, 2024

Jan. 3, 2024

FWIW, the AS11232 sessions to route server 2 have been active for about 25 minutes. https://ixpmgr.micemn.net/lg/rs2-ipv4 and https://ixpmgr.micemn.net/lg/rs2-ipv6 <https://ixpmgr.micemn.net/lg/rs2-ipv6%20show%20that%20AS11232> show quite a few other ASNs that are not established. https://ixpmgr.micemn.net/lg/rs1-ipv4 and https://ixpmgr.micemn.net/lg/rs1-ipv6 show more not-established sessions than I would expect but fewer than rs2. I haven't looked more closely at the impact to routing yet. Any details about the work in progress? Thanks [http://images.midcocomm.com/ES_MidcoLogo.png] Miles McCredie Principal Network Engineer II-Core IP Office: 6052755192 Miles.McCredie(a)midco.com Midco.com

4 6

Strange Cacti graphs
by Dean Bahls Dec. 21, 2023

Dec. 21, 2023

Anyone notice the strange spikes/valleys on the Cacti graphs lately? Looks like a heartbeat every hour on the hour. Thanks, Dean Dean Bahls COO | Fiber Minnesota 14 Main St SW | PO Box J | Menahga, MN 56464 218.564-1321 (Direct) | 218.564.3000 (Main Office) dean.bahls(a)fiberminnesota.com<mailto:dean.bahls@fiberminnesota.com> [cid:image001.png@01DA3298.4466DA60] [cid:image002.png@01DA3298.4466DA60]

2 1

MICE almost hit 2T
by David Farmer Dec. 5, 2023

Dec. 5, 2023

We had a 1.96T burst last night. [image: image.png] The extra Fortnite Chapter 5 Season 1 release traffic over the weekend can be seen. [image: image.png] -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

5 5

micelg.usinternet.com
by Jeremy Lumby Nov. 28, 2023

Nov. 28, 2023

I no longer seem to be able to connect to http://micelg.usinternet.com via IPv4 or IPv6 Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington MN 55425 Main 612-355-7740 x211 Direct 612-392-6814 Fax 952-873-7425 jlumby(a)mnvoip.com

5 6

OmniTech (AS54821) has disconnected from MICE
by Jay Hanke Nov. 27, 2023

Nov. 27, 2023

OmniTech AS54821 has disconnected from MICE. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 507-327-2398 https://southfront.io/ <https://southfront.io/path.html>

1 0

Thursday night Prime Football
by Steve Savoy Nov. 22, 2023

Nov. 22, 2023

Hello everyone, Just curious if anyone else has customers complaining about Prime football on Thursday nights being extremely 'grainy' - like the old VHS days........ Thank you, Steve Savoy Confidentiality Notice: This correspondence is the property of Winnebago Cooperative Telecom Association and is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message.

8 8

Global Net (AS395466) - Upcoming Maintenance 11/15/2023
by Global Net NOC Nov. 18, 2023

Nov. 18, 2023

MICEMN Members - We have a maintenance window scheduled for Wednesday, November 15th. BGP sessions will go down during the window. Start: 11/15/23 0701 UTC (00:01 MST) End: 11/15/23 1300 UTC (06:00 MST) GLOBAL NET AS 395466 IPV4 206.108.255.97 IPV6 2001:504:27:0:6:8ca:0:1 Thanks, Global Net NOC noc(a)theglobal.net Global Net Peering peering(a)theglobal.net

1 1

AS394330 LTD Broadband/GigFire Port Move
by Jay Hanke Nov. 8, 2023

Nov. 8, 2023

LTD Broadband/GigFire has moved from the MN VoIP Remote to port eth9/1 on the SFN remote switch. The MN VoIP port has been disabled. All IP information remains the same. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 507-327-2398 https://southfront.io/ <https://southfront.io/path.html>

1 0

[OT] Calix GigaSpire RG Failures
by Richard Laager Nov. 5, 2023

Nov. 5, 2023

"Critical: EXOS – GigaSpire RG Systems May Display Amber LED and Be Unreachable" https://community.calix.com/s/feed/0D54u0000A5ugVA "We have confirmed today that *only releases 23.2 and 23.3 are impacted*. EXOS Release 23.3.0.3.57 is now available for use in workflows within Calix Cloud, or for local download from theCalix Software Center <https://www.calix.com/my-calix/software-center.html#>.Please find the release notes for this build here <https://www.calix.com/content/dam/calix/doc-library/systems/prem/support/ex…>, and please reviewService Bulletin SB-23-005 <https://www.calix.com/bin/calix/servlets/docdownload?fileId=/content/dam/ca…>for additional technical detail regarding this matter. With the new release now available,*_we strongly recommend any systems running 23.2 or 23.3 be upgraded to this new release immediately_*. Systems running 23.1 or lower should upgrade to the 23.4 release when it becomes available later this month." -- Richard

1 0

Amazon TNF Bitrate/Stream
by Ben Wiechman Nov. 2, 2023

Nov. 2, 2023

Has anyone spent any time studying the bitrate per stream this year? What are you seeing on your networks? Our Qwilt cache is reporting 25Mbps/stream average, which doesn't seem realistic by other measures. Ben Wiechman Director of Network Strategy and Engineering 320.247.3224 | ben.wiechman(a)arvig.com Arvig | 224 East Main Street | Melrose, MN 56352 | arvig.com

4 7

Google to stop advertising to MICE Route Servers
by Jay Hanke Oct. 23, 2023

Oct. 23, 2023

We have received notice that Google AS15159 will stop sending and receiving routes from the MICE route servers on November 8th, 2023. Google has asked us to share the following notice. Google will keep current BGP bilateral with individual peers on MICE. Google invites other networks that rely on Route-Servers to request a bilateral session. Bilateral session request can be done at: https://isp.google.com/iwantpeering Thanks! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 507-327-2398 https://southfront.io/

2 2

AS57 (NorthernLights/UofM) Maintenance Complete
by Colin Murphy Oct. 14, 2023

Oct. 14, 2023

University of Minnesota Engineers have completed the software upgrades on the NorthernLights Gigapop routers. Thanks, Colin Murphy Sr. Network Engineer Office of Information Technology University of Minnesota Northern Lights Gigapop Desk: 612-626-0870

1 0

AS57 (NorthernLights/UofM) Maintenance
by Colin Murphy Oct. 12, 2023

Oct. 12, 2023

University of Minnesota Engineers will be upgrading the software on the NorthernLights Gigapop routers. The expected outage for each router will be approximately 2 hours. BGP sessions will be shutdown prior to the software upgrades. Please let us know if you have any questions. Change window: 10/14/2023 4 AM to 5 PM CDT. Thanks, Colin Murphy Sr. Network Engineer Office of Information Technology University of Minnesota Northern Lights Gigapop Desk: 612-626-0870

1 0

AS11796 Maintenance
by Charles Monson Sept. 26, 2023

Sept. 26, 2023

AS11796/WIN Technology will be disabling all BGP sessions over the MICE exchange tonight after 2300 (Central) in preparation for maintenance. Please keep your BGP sessions with us active to avoid unnecessary troubleshooting once the link is back up. Thank you, Charles Monson WIN Technology (AS11796/AS26652)

1 0

UG 44 Meeting & Election
by Richard Laager Sept. 25, 2023

Sept. 25, 2023

The MICE UG 44 meeting will be held Wednesday, October 25, 3:00 pm at UMN. Here are the details (parking, etc.) from last time: https://lists.iphouse.net/cgi-bin/wa?A2=MICE-DISCUSS;2c503e19.2209 An updated Zoom link will be coming. *Nominations* We will be holding an election for a board seat. The board consists of three seats with staggered terms, such that one seat comes up for re-election each year (at the fall meeting). This year, Anthony's seat is up for election. As in the past, we will close nominations in advance of the meeting so people have a chance to instruct a proxy appropriately. *Nominations will be open for two weeks (so until the end of October 7).* * * *Proxies * The bylaws state that you send proxies to the Chief Manager (me, Richard Laager), and electronic means are acceptable. So a simple email is sufficient: rlaager(a)wiktel.com or chiefmanager(a)micemn.net. If you send me a /vote/ by email (e.g. "We vote for <X>."), I will treat it as an a proxy appointment, appointing me to vote on your behalf, but restricted to /only/ the election item and to /only/ vote for the candidate you expressed. If you send me a proxy with different instructions (e.g. "We appoint <Y> to vote for us."), obviously that will be honored as written. -- Richard

2 1

Gateway Fiber ribbon cutting
by Michael Horwath Sept. 14, 2023

Sept. 14, 2023

They had that this moring at 1000 hours in Blaine. I made a joke to my friend that I wonder how many of 3 of us will be there. Well, I got a surprise as there were at least 8 folks who were not affilitated with the event. Talking to a couple of folks - would like to have customers up by end of year in Blaine - my area (Coon Rapids) would come afterwards but could not get them to commit or ‘about 6 months’ - GPON for delivery - using Comlink Solutions for the pulls - 511 is on their radar - mentioned expanding south from Blaine into SLP, Mounds View - mentioned expanding north-west into Andover I mentioned MICE and gave el-presidente my email address to contact me, and the website URL And I did not get a pic of their pricing flyer! But 2Gbps bidirectional is $150/month but I cannot remember the lower speeds cause I didn’t care :) -- Mike Horwath, reachable via drechsau(a)Geeks.ORG

3 2

Global Net (AS395466) - Down
by Global Net NOC Sept. 12, 2023

Sept. 12, 2023

MICEMN Members - Our circuit to Cologix in Minneapolis is hard down due to an upstream provider issue. Our BGP sessions remain down. GLOBAL NET AS 395466 IPV4 206.108.255.97 IPV6 2001:504:27:0:6:8ca:0:1 Thanks, Global Net NOC noc(a)theglobal.net Global Net Peering Peering peering(a)theglobal.net

1 0

Route Server 2
by Tom Krenn Sept. 8, 2023

Sept. 8, 2023

Hi all, Anyone else noticing the route server at 206.108.255.2 / 2001:504:27::d1af:0:2 dropping out for a second or so the last few days? I'm seeing similar from both of my routers. LC/0/0/CPU0:Sep 8 07:29:45.717 CDT: bfd_agent[173]: %L2-BFD-6-SESSION_STATE_DOWN : BFD session to neighbor 2001:504:27::d1af:0:2 on interface HundredGigE0/0/0/20 has gone down. Reason: Control timer expired RP/0/RSP0/CPU0:Sep 8 07:29:45.718 CDT: bgp[1065]: %ROUTING-BGP-5-ADJCHANGE : neighbor 2001:504:27::d1af:0:2 Down - BFD (Bidirectional forwarding detection) session down (VRF: default) (AS: 53679) LC/0/0/CPU0:Sep 8 07:29:45.795 CDT: bfd_agent[173]: %L2-BFD-6-SESSION_STATE_DOWN : BFD session to neighbor 206.108.255.2 on interface HundredGigE0/0/0/20 has gone down. Reason: Control timer expired RP/0/RSP0/CPU0:Sep 8 07:29:45.797 CDT: bgp[1065]: %ROUTING-BGP-5-ADJCHANGE : neighbor 206.108.255.2 Down - BFD (Bidirectional forwarding detection) session down (VRF: default) (AS: 53679) LC/0/0/CPU0:Sep 8 07:29:50.384 CDT: bfd_agent[173]: %L2-BFD-6-SESSION_STATE_UP : BFD session to neighbor 2001:504:27::d1af:0:2 on interface HundredGigE0/0/0/20 is up LC/0/0/CPU0:Sep 8 07:29:50.384 CDT: bfd_agent[173]: %L2-BFD-6-SESSION_STATE_UP : BFD session to neighbor 206.108.255.2 on interface HundredGigE0/0/0/20 is up RP/0/RSP0/CPU0:Sep 8 07:30:58.517 CDT: bgp[1065]: %ROUTING-BGP-5-ADJCHANGE : neighbor 206.108.255.2 Up (VRF: default) (AS: 53679) RP/0/RSP0/CPU0:Sep 8 07:31:01.850 CDT: bgp[1065]: %ROUTING-BGP-5-ADJCHANGE : neighbor 2001:504:27::d1af:0:2 Up (VRF: default) (AS: 53679) Tom Krenn Network Architect Enterprise Architecture - Information Technology Office: 612-596-8994 tom.krenn(a)hennepin.us<mailto:tom.krenn@hennepin.us> | hennepin.us<https://hennepin.us/> Hennepin County Government Center 300 South 6th Street, A-190 Minneapolis, MN, 55487 [Hennepin County logo] Connect: Facebook<https://www.facebook.com/hennepin> | Twitter<https://twitter.com/Hennepin> | YouTube<https://www.youtube.com/user/HennepinMN> | LinkedIn<https://www.linkedin.com/company/hennepin-county> | Instagram<https://www.instagram.com/hennepincounty> Disclaimer: If you are not the intended recipient of this message, please immediately notify the sender of the transmission error and then promptly permanently delete this message from your computer system.

4 4

Please welcome G-Core Labs S.A. to MICE!
by Jeremy Lumby Sept. 7, 2023

Sept. 7, 2023

Name: G-Core Labs S.A. Switch: MICE Core Port: E 4/7 ASN: 199524 IPv4: 206.108.255.191/24 IPv6: 2001:504:27:0:3:0B64::1/64 Peering Contact: noc(a)gcore.lu Route Servers: YES BFD: No Welcome Aboard! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

2 3

Global Net (AS395466) - Circuit Restored
by Global Net NOC Aug. 30, 2023

Aug. 30, 2023

MICEMN Members - Our carrier has resolved their power issue to restore our circuit and we have connectivity into Minneapolis again. I will begin to restore BGP sessions with our peers this morning. GLOBAL NET AS 395466 IPv4 206.108.255.97 IPv6 2001:504:27:0:6:8ca:0:1 Thanks, Scott Reed Global Net NOC noc(a)theglobal.net Global Net Peering Peering peering(a)theglobal.net

1 0

Global Net (AS395466) - Carrier Outage / Carrier Maintenance
by Global Net NOC Aug. 28, 2023

Aug. 28, 2023

MICEMN Members - Our carrier experienced a DC power plant failure on Saturday, August 26th @ 1356 MDT at which time our circuit between Bozeman, MT and Minneapolis, MN went down. This circuit was restored this morning at 0301 MDT, but via a temporary power supply. We are being told that the carrier will be replacing the failed DC power plant tomorrow around noon MDT with an expected impact of 90 minutes to our circuit. Our port to the MICE is currently down but I have all BGP sessions disabled for manual and graceful restart once service is fully restored. I would like to wait until the temporary power supply is replaced before bringing sessions back up. GLOBAL NET AS 395466 IPv4 206.108.255.97 IPv6 2001:504:27:0:6:8ca:0:1 Thanks, Scott Reed Global Net NOC noc(a)theglobal.net<mailto:noc@theglobal.net> Global Net Peering Peering peering(a)theglobal.net<mailto:peering@theglobal.net>

1 0

Network Nerd Thoughts?
by Michael Horwath Aug. 21, 2023

Aug. 21, 2023

ObOnTopic: Anyone have a contact there to see if they are willing to join MICE? ObOffTopic: everything else https://www.prnewswire.com/news-releases/gateway-fiber-bringing-100-fiber-o… I moved into CR July 2020 and .. connectivity options are not really options. Greenbutthole (you know, Centurylink, Lumen, some name that starts with Q) loves to say high speed, every address in a 4 block area around me is only capable of 10Mbps down. Comcast? I mean, it works, for a small value of works. Anyone dealt with these folks in the past in other areas? Will they come through? Are there any gotchas? I wish we had more choice. I mean, we had over 200 choices back in the late 90s and early-mid 2000s but they are all gone now. -- Mike Horwath, reachable via drechsau(a)Geeks.ORG

1 0

OT: Blast from the past!
by Jay Hanke Aug. 14, 2023

Aug. 14, 2023

[image: 20180410_090819.jpg] -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000 https://southfront.io/path.html

2 1

Ridgeview Traffic
by Jay Hanke Aug. 7, 2023

Aug. 7, 2023

Looks like a successful weekend at the new Ridgeview. This is the uplink traffic measured at the 511 end. [image: image.png]

3 2

Give Aways
by Justin Krejci Aug. 4, 2023

Aug. 4, 2023

I have a few items to give away: first responding, first served. Must either pick up in Minnetonka, MN or possibly nearby area. 4x Fiber SMF duplex jumpers * SC to LC blue connectors (not green APC) * 5m fiber jumper with thicker outdoor jacket * The last 12 inches or so at each end are the standard yellow jacket. * Condition: New/unused 8x (could be 9 or 10) standard RJ45 patch panels * 48 ports * 2RU height * 19" width post * Model: unknown * Includes cable management clips that fasten onto the front side * Wire bars on the rear side for tying rear side cables * Condition: New/unused 2x 40G QSFPs * Model: Robofiber QSFP-4010-PLR4-A * Condition: Light or no use 2x 40G QSFPs * Model: Robofiber QSFP-4010-LR4-A * Condition: Light or no use 6x 40G QSFP AOCs * 1m length * Model: Robofiber QSFP-40G-01AOC-A * Condition: Light use, no damage, no visible wear and tear If anyone wants pictures of any of these let me know and I can send you some. -Justin

1 0

MICE Ridgeview Traffic
by Jay Hanke Aug. 3, 2023

Aug. 3, 2023

Running about 18G of traffic on the new MICE Ridgeview switch! Jay

5 9

Fiber cut?
by Frank Bulk July 25, 2023

July 25, 2023

Did anyone notice a fiber cut on Zayo's network between Le Mars and Sioux City around 2:45 pm? Our staff saw some damage south to their fiber of NIPCO, but it's possible that Zayo abandoned that stretch of fiber due to an earlier Hwy 75 road project. Regards, Frank

3 2

Re: FW: [EXTERNAL] - [MICE-DISCUSS] MICE Participants List
by Richard Laager June 28, 2023

June 28, 2023

It turns out that I had the route server links wrong. There is a database ID that gets put into the BIRD protocol. I thought it was the customer (participant) ID. But it turns out it is the VLAN Interface ID. I corrected this, and now the links work correctly. On 2023-06-28 06:26, Miles McCredie wrote: > > FWIW, the looking glass links generate the following message > -- Richard

1 0

MICE Participants List
by Richard Laager June 28, 2023

June 28, 2023

The MICE participants list is now built from IXP Manager: https://micemn.net/participants.html If there is something wrong about your entry, please let me or Jeremy know. See below about port discrepancies, first. I want to specifically thank Dustin Frandle of South Front Networks. He started this effort with JavaScript code to convert a standard IX-F JSON export into a participants table. While I ended up going a different direction (for reasons discussed below), he got the ball rolling. Jeremy and I wanted to retain the contact addresses, which IXP Manager only outputs in the IX-F export if you are logged in. (And, despite my request, they remain firm in that position and refuse to allow customization.) Additionally, I wanted to retain the ports, since our current process has Cologix using the website as the LOA/CFA. (We may want to move to a more standard approach on that, but I didn't want to put that change into the critical path of getting the participants list automated.) Unfortunately, despite a previous request and my re-request for it, the IXP Manager maintainer has taken a firm position that the IX-F JSON export should not be customizable. So I cannot easily tweak the template to output emails when unauthenticated or add additional information for ports. IXP Manager does support the idea of a custom member export, and INEX (the exchange primarily behind IXP Manager development) does use that for a custom JSON output. However, that requires building the desired output from scratch. I figured if I was going to do that, I might as well just output HTML directly. That way, I only have one thing in one language (PHP) to worry about, rather than two things (PHP + JavaScript). Granted, there are some cons too. I'm not 100% happy about any of this. But, ultimately I had to make some decision to get it done, and that's where I landed. I did the best I could with the responsive design. There are a couple of pre-existing bugs on edge cases (e.g. when your size falls at 991.xx so it's not <= 991 but also not >= 992, which is maybe only possible on HiDPI displays) that affect the whole site. This page in particular is not ideal on mobile, but I did what I could. If you've got better ideas, please let me know. ---- There are a couple port discrepancies that I've asked Jeremy to review: 702 Communications * Bluepeak Broadband Visions * G-Core Labs * HBC * LTD Broadband Omnitel * Paul Bunyan South Front Truestream * US Internet * I'm pretty sure these were wrong/outdated on the old list and correct in IXP Manager / on the new list. -- Richard

3 2

WiscNet router maintenance Thursday, June 29, 4pm
by Chris Wopat June 27, 2023

June 27, 2023

WiscNet will be replacing a router this coming Thursday at 4pm local time. Our MICE connection will be down during this transition. Expect it down for 15mins or so, maintenance should be complete by 7pm. Cheers, -- Chris Wopat Network Engineer, WiscNet wopat(a)wiscnet.net 608-210-3965

1 0

Three BGP peers
by Frank Bulk June 24, 2023

June 24, 2023

Anyone else seeing both Yahoo peers and one Google peer down since early am? I didn't see any log messages about exceeding prefix counts or the like. Frank SiouxCity-Fibernet-Arista(s2)#sh ip bgp sum | ex Estab BGP summary information for VRF default Router identifier 207.32.15.21, local AS number 18883 Neighbor Status Codes: m - Under maintenance Neighbor V AS MsgRcvd MsgSent InQ OutQ Up/Down State PfxRcd PfxAcc 206.108.255.58 4 10310 2035987 4886675 0 0 12:23:38 Active 206.108.255.59 4 10310 2029469 4886360 0 0 12:23:41 Active 206.108.255.167 4 15169 2050148 4888984 0 0 12:23:40 Active SiouxCity-Fibernet-Arista(s2)#sh ipv6 bgp sum | ex Estab BGP summary information for VRF default Router identifier 207.32.15.21, local AS number 18883 Neighbor Status Codes: m - Under maintenance Neighbor V AS MsgRcvd MsgSent InQ OutQ Up/Down State PfxRcd PfxAcc 2001:504:27::2846:0:1 4 10310 2209610 1893247 0 0 12:23:40 Active 2001:504:27::2846:0:2 4 10310 2202613 1892818 0 0 12:23:47 Active 2001:504:27::3b41:0:2 4 15169 2043589 1894022 0 0 12:23:48 Active SiouxCity-Fibernet-Arista(s2)#

6 8

Global Net (AS395466) - Circuit Down
by Global Net NOC June 24, 2023

June 24, 2023

MICEMN Members - Our circuit to Cologix in Minneapolis is hard down due to a bridge collapse, train derailment and subsequent fiber cut in Columbus, MT. Our BGP sessions remain down. GLOBAL NET AS 395466 IPV4 206.108.255.97 IPV6 2001:504:27:0:6:8ca:0:1 Thanks, Global Net NOC noc(a)theglobal.net Global Net Peering peering(a)theglobal.net

1 0

Route Server 1 - BFD not working
by Jonathan Stewart June 23, 2023

June 23, 2023

Hi MICE, We are AS18451. On our BGP session to Route Server 1 (206.108.225.1 & 2001:504:27::d1af:0:1) i have lost the BFD session. My Juniper router shows the state as "Down". Is this intentional? An accident of the upgrades? Is my configuration wrong? Anyone else noticing this? My configuration is an interval of 1000 ms, multiplier 3. RS 2 is configured the same and BFD is up. Thanks, Jonathan -- Jonathan Stewart Network Engineer LES.NET - AS18451 Desk: 1-204-666-6191 Mobile: 1-204-990-2120 130 Portage Avenue E Winnipeg, MB R3C 0A1 CANADA

4 7

Re: FW: Thursday Night Football from Amazon Prime Video - Network Questionnaire
by Justin Krejci June 16, 2023

June 16, 2023

I stumbled across this thread again while looking for something else and thought I'd add a small update that we did get our Qwilt server deployed on-net for us a while back and it did indeed serve a relatively large burst of traffic volume during the live streaming episodes of Thursday Night Football. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Justin Krejci <JKrejci(a)USINTERNET.COM> Sent: Wednesday, February 16, 2022 1:08 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] FW: Thursday Night Football from Amazon Prime Video - Network Questionnaire I believe it is just simpler for everyone involved when you are an NCTC member but I don't think it is a requirement necessarily. As Frank suggests, if you're interested in their services you should just reach out to them directly and they can tell you what they can and will do for you given your network and usage numbers. In my experience so far Qwilt are decent folks: I am still working through their process to get a deployment for our network and they have been competent and reasonable to work with so far. To contrast the email subject, because they are in the open caching market, they do not carry only Amazon content. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Frank Bulk <fbulk(a)MYPREMIERONLINE.COM> Sent: Wednesday, February 16, 2022 12:09 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] FW: Thursday Night Football from Amazon Prime Video - Network Questionnaire I don’t know if it’s exclusive to the NCTC or not – you could reach out to Qwilt and just ask them what options they have for you. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Ryan Malek Sent: Wednesday, February 16, 2022 11:28 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] FW: Thursday Night Football from Amazon Prime Video - Network Questionnaire Is this offering going to be available to non NCTC members at a cost? (Is this maybe part of Qwilts default offering? ) TLDR: Is the Qwilt platform worth it outside of being an NCTC Member? :) ________________________________ Ryan Malek - Router12 Networks LLC Internet, Phone, and Hosted Services Ph. 641.420.7180 On 2/16/2022 11:08 AM, Frank Bulk wrote: If you’re an NCTC member there’s an opportunity to avoid transit costs and IX bandwidth concerns by serving the traffic from your own network using an “open” CDN: https://www.qwilt.com/nctc-and-qwilt-launch-joint-initiative-to-upgrade-nct…<https://url-shield.securence.com/?p=1.0&r=jkrejci@usinternet.com&sid=164503…> There’s no cost to NCTC members (just your own rack space, power, cooling, ports, and time). Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET><mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> On Behalf Of Justin Krejci Sent: Tuesday, January 18, 2022 10:56 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] FW: Thursday Night Football from Amazon Prime Video - Network Questionnaire Definitely legit and definitely worth pursuing additional connectivity with Amazon and CDNs that Amazon will use to distribute their NFL streaming content. We have peering active with Amazon at four IX locations (including MICE) and are trying to get some PNIs with them now too. https://aws.amazon.com/peering/locations/ This page lists Cologix Minneapolis as a site where interconnection can happen. If you have a lot of eyeballs on your network, you should definitely pursue adding/augmenting connectivity to Amazon. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of Steve Savoy <stevesavoy(a)WCTATEL.COM<mailto:stevesavoy@WCTATEL.COM>> Sent: Tuesday, January 18, 2022 8:55 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] FW: Thursday Night Football from Amazon Prime Video - Network Questionnaire Thanks Jeremy! I'll give it another try. Steve -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jeremy Lumby Sent: Tuesday, January 18, 2022 8:49 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] FW: Thursday Night Football from Amazon Prime Video - Network Questionnaire Steve, Amazon can be notoriously difficult to get to respond, and when they finally do it can often take a couple months. They have recently moved to regional peering addresses, and it is worth sending the request to peering-amer(a)amazon.com<mailto:peering-amer@amazon.com> if you have not already. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com> From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Steve Savoy Sent: Tuesday, January 18, 2022 8:01 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] FW: Thursday Night Football from Amazon Prime Video - Network Questionnaire I’m just jealous that you are able to peer with Amazon. Been trying for 2 years now and nothing but ‘crickets’………… 😉 Steve From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Dean Bahls Sent: Tuesday, January 18, 2022 6:28 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] FW: Thursday Night Football from Amazon Prime Video - Network Questionnaire While I haven’t gotten that specific email from them, I’ve gotten several Telegeography emails since 2012. They are referenced by Light Reading Daily quite a bit. They *seem* to be a legit research firm contracted by multiple companies. The Amazon / TNF partnership is a real deal….and MICE needs to be prepared for a potential uptick in traffic on Thursdays. Dean From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of AnthonyAnderberg(a)NUVERA.NET<mailto:AnthonyAnderberg@NUVERA.NET> Sent: Tuesday, January 18, 2022 1:27 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] FW: Thursday Night Football from Amazon Prime Video - Network Questionnaire Has anyone else gotten an email like this? On the surface it seems legit, and I always like the opportunity to talk about MICE, but I’m not sure how I feel about sharing such info... Thanks in advance, Anthony On Thu, Dec 16, 2021 at 1:29 PM Nataliya Coll <ncoll(a)telegeography.com<mailto:ncoll@telegeography.com>> wrote: Hi David and Anthony, I am a telecoms analyst with TeleGeography in Washington, DC. We have been contracted by Amazon Prime Video (APV) to survey ISPs across the country in preparation for Prime Video’s exclusive presentation of NFL Thursday Night Football (TNF) starting with the 2022 NFL season. The attached letter from Amazon Prime Video provides more detail about their network planning initiative. To help avoid congestion on your network during upcoming games, Amazon is asking us to query you so that they may better understand your network point(s) of contact, service coverage area, CDN provider(s), IP Transit provider(s), etc. Are you the correct contact person within your network operations team to respond to these questions? If not, can you please direct me to the right person within your network operations team? If you have any questions, feel free to contact me via email or let me know if you would like to set up a call with me. Thank you so much for your cooperation. Nataliya Coll Research Analyst, Europe & Eurasia TeleGeography, a Division of PriMetrica, Inc. One Thomas Circle, NW, Suite 360 Washington, DC 20005 USA www.telegeography.com<https://url-shield.securence.com/?p=1.0&r=jkrejci@usinternet.com&sid=164503…> +1 (202) 741-0066 ________________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://url-shield.securence.com/?p=1.0&r=jkrejci@usinternet.com&sid=164503…> ________________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://url-shield.securence.com/?p=1.0&r=jkrejci@usinternet.com&sid=164503…> Confidentiality Notice: This correspondence is the property of Winnebago Cooperative Telecom Association and is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. ________________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://url-shield.securence.com/?p=1.0&r=jkrejci@usinternet.com&sid=164503…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://url-shield.securence.com/?p=1.0&r=jkrejci@usinternet.com&sid=164503…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://url-shield.securence.com/?p=1.0&r=jkrejci@usinternet.com&sid=164503…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://url-shield.securence.com/?p=1.0&r=jkrejci@usinternet.com&sid=164503…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://url-shield.securence.com/?p=1.0&r=jkrejci@usinternet.com&sid=164503…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://url-shield.securence.com/?p=1.0&r=jkrejci@usinternet.com&sid=164503…>

5 6

RPKI ROAs
by Richard Laager June 14, 2023

June 14, 2023

In the ARIN web UI, it looks like a ROA can have multiple prefixes. For an end network such as myself (Wiktel hat on), what is the best practice... one ROA per prefix, or list multiple prefixes in the same ROA? With my MICE hat on, should MICE publish a ROA for the peering network space? The theoretical advantage would be some amount of hijacking protection. Though since it's not supposed to be announced, it probably doesn't matter much either way? As far as I can see, there's no explicit way to say "do not announce" in a ROA. But listing something with an origin AS of "0" seems to be a thing that is done for at least one deliberately invalid ROA (CloudFlare's 103.21.244.0/23). So, if I were to create a ROA for MICE, would that be an Origin AS of 53679 or 0? -- Richard

5 8

OT: MIDCO Noc #
by Jay Hanke June 12, 2023

June 12, 2023

Does anyone have the 24x7 Midco NOC number? Jay

3 3

Call for Help: Web Design
by Richard Laager June 2, 2023

June 2, 2023

Anyone know a web developer who could do some/all of the following? 1. The website uses Bootstrap 3.0.3, which is using jQuery 1.10.2. Update to modern versions of that, fixing what breaks. 2. At medium screen widths, the navigation comes off the navigation area and shows further down on the page. Fix that. 3. At small screen widths (including but not limited to mobile), the hamburger menu doesn't work quite right. The links show up, but they are mixed in with the page text. Fix that. The code is on GitHub here: https://github.com/micemn/mice-website -- Richard

2 3

MICE RS1 Route Server Cleanup
by Jay Hanke May 31, 2023

May 31, 2023

We are going through a process to clean up the configurations on the new RS1 server located in 511. The config is now automated and IRR/RPKI filtering is in place. We're currently working on the IPv4 sessions. There are several networks that have Route Server sessions that are currently not up. AS13737 - INCX Global, LLC AS22768 - Synergy Fiber AS22822 - Limelight Networks Global AS26794 - Dakota Carrier Network (206.108.255.60 Route Limit Exceeded) AS29762 - Emergent Networks AS30110 - Advanced Communications Technology (Route Limit Exceeded) AS31939 - GigaMonster AS32029 - Lakana AS32097 - Wholesale Internet, Inc. AS32867 - Long Lines Communications AS397324 - Celerity Networks Max Prefixes (used for Route Limit) are pulled from Peeringdb.com. Networks can check their status on the new looking glass (Thanks Richard!): https://ixpmgr.micemn.net/lg/rs1-ipv4 If your network is no longer utilizing the route servers please email peering(a)micemn.net so we can update your configuration. Thanks! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000 https://southfront.io/path.html http://peeringsummit.com <--- Des Moines July 17-18, 2023

2 1

Route Server Session Cleanup
by Jay Hanke May 28, 2023

May 28, 2023

Following the migration to the route server last week we have a number of members with down or misconfigured BGP sessions. We have reached out to each member via email and will be disabling the route server sessions to RS1 of the following members on Thursday June 1st, 2023 if we do not get a response or resolution. AS13737 - INCX Global, LLC AS29762 - Emergent Networks AS30110 - Advanced Communications Technology AS31939 - GigaMonster AS32029 - Lakana, a division of Nexstar Broadcasting -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000 https://southfront.io/path.html http://peeringsummit.com <--- Des Moines July 17-18, 2023

2 2

Limelight Networks Removed from MICE Route Server Config
by Jay Hanke May 25, 2023

May 25, 2023

Limelight Networks is no longer utilizing the MICE route servers. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000 https://southfront.io/path.html http://peeringsummit.com <--- Des Moines July 17-18, 2023

1 0

Land O Lakes left MICE
by Jay Hanke May 24, 2023

May 24, 2023

Land O Lakes has disconnected from MICE. IXP Manager has been updated. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000 https://southfront.io/path.html http://peeringsummit.com <--- Des Moines July 17-18, 2023

1 0