- mice-discuss - lists.micemn.net

Re: Anyone lose peering with CloudFlare this morning at 4:13 am?

by Steve Savoy

Thanks for the link David! Steve From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of David Farmer Sent: Wednesday, October 12, 2022 11:59 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Anyone lose peering with CloudFlare this morning at 4:13 am? If you check Cloudflare’s status page you will see Minneapolis is in “Re-routed” state. https://www.cloudflarestatus.com On Wed, Oct 12, 2022 at 10:45 Steve Savoy <stevesavoy(a)wctatel.com<mailto:stevesavoy@wctatel.com>> wrote: Yes – ours went down at the same time. Steve From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Frank Bulk Sent: Wednesday, October 12, 2022 10:42 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] Anyone lose peering with CloudFlare this morning at 4:13 am? Both IPv4 and IPv6. I didn’t see any exceeding of prefix limits. Frank Oct 12 04:13:10 207.32.15.14 (sxct-north-2.sxcy.fbnt.netins.net<http://sxct-north-2.sxcy.fbnt.netins.net>) SiouxCity-Fibernet-Arista Rib: %BGP-5-ADJCHANGE: peer 206.108.255.45 (AS13335.micemn.net<http://AS13335.micemn.net>) (AS 13335 CLOUDFLARENET, US) old state Established event HoldTime new state Idle Oct 12 04:13:10 207.32.15.14 (sxct-north-2.sxcy.fbnt.netins.net<http://sxct-north-2.sxcy.fbnt.netins.net>) SiouxCity-Fibernet-Arista Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::3417:0:1 (AS13335.micemn.net<http://AS13335.micemn.net>) (AS 13335 CLOUDFLARENET, US) old state Established event HoldTime new state Idle ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 Confidentiality Notice: This correspondence is the property of Winnebago Cooperative Telecom Association and is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message. ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- =============================================== David Farmer Email:farmer@umn.edu<mailto:Email%3Afarmer@umn.edu> Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 =============================================== ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 12, 2022

Re: Anyone lose peering with CloudFlare this morning at 4:13 am?

by David Farmer

If you check Cloudflare’s status page you will see Minneapolis is in “Re-routed” state. https://www.cloudflarestatus.com On Wed, Oct 12, 2022 at 10:45 Steve Savoy <stevesavoy(a)wctatel.com> wrote: > Yes – ours went down at the same time. > > > > Steve > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> * On Behalf Of *Frank > Bulk > *Sent:* Wednesday, October 12, 2022 10:42 AM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* [MICE-DISCUSS] Anyone lose peering with CloudFlare this > morning at 4:13 am? > > > > Both IPv4 and IPv6. I didn’t see any exceeding of prefix limits. > > > > Frank > > > > Oct 12 04:13:10 207.32.15.14 (sxct-north-2.sxcy.fbnt.netins.net) > SiouxCity-Fibernet-Arista Rib: %BGP-5-ADJCHANGE: peer 206.108.255.45 ( > AS13335.micemn.net) (AS 13335 CLOUDFLARENET, US) old state Established > event HoldTime new state Idle > > Oct 12 04:13:10 207.32.15.14 (sxct-north-2.sxcy.fbnt.netins.net) > SiouxCity-Fibernet-Arista Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::3417:0:1 > (AS13335.micemn.net) (AS 13335 CLOUDFLARENET, US) old state Established > event HoldTime new state Idle > > > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > Confidentiality Notice: This correspondence is the property of Winnebago > Cooperative Telecom Association and is for the sole use of the intended > recipient(s) and may contain confidential and privileged information. Any > unauthorized review, use, disclosure or distribution is prohibited. If you > are not the intended recipient, please contact the sender by reply email > and destroy all copies of the original message. > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

Oct. 12, 2022

Re: Anyone lose peering with CloudFlare this morning at 4:13 am?

by Steve Savoy

Yes - ours went down at the same time. Steve From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Frank Bulk Sent: Wednesday, October 12, 2022 10:42 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Anyone lose peering with CloudFlare this morning at 4:13 am? Both IPv4 and IPv6. I didn't see any exceeding of prefix limits. Frank Oct 12 04:13:10 207.32.15.14 (sxct-north-2.sxcy.fbnt.netins.net) SiouxCity-Fibernet-Arista Rib: %BGP-5-ADJCHANGE: peer 206.108.255.45 (AS13335.micemn.net) (AS 13335 CLOUDFLARENET, US) old state Established event HoldTime new state Idle Oct 12 04:13:10 207.32.15.14 (sxct-north-2.sxcy.fbnt.netins.net) SiouxCity-Fibernet-Arista Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::3417:0:1 (AS13335.micemn.net) (AS 13335 CLOUDFLARENET, US) old state Established event HoldTime new state Idle ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 Confidentiality Notice: This correspondence is the property of Winnebago Cooperative Telecom Association and is for the sole use of the intended recipient(s) and may contain confidential and privileged information. Any unauthorized review, use, disclosure or distribution is prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message.

Oct. 12, 2022

Anyone lose peering with CloudFlare this morning at 4:13 am?

by Frank Bulk

Both IPv4 and IPv6. I didn't see any exceeding of prefix limits. Frank Oct 12 04:13:10 207.32.15.14 (sxct-north-2.sxcy.fbnt.netins.net) SiouxCity-Fibernet-Arista Rib: %BGP-5-ADJCHANGE: peer 206.108.255.45 (AS13335.micemn.net) (AS 13335 CLOUDFLARENET, US) old state Established event HoldTime new state Idle Oct 12 04:13:10 207.32.15.14 (sxct-north-2.sxcy.fbnt.netins.net) SiouxCity-Fibernet-Arista Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::3417:0:1 (AS13335.micemn.net) (AS 13335 CLOUDFLARENET, US) old state Established event HoldTime new state Idle

Oct. 12, 2022

Please welcome TDS Telecommunications to MICE!

by Jeremy Lumby

Name: TDS Telecommunications Switch: MICE Core Port: E6/27/1 ASN: 4181 IPv4: This is a port upgrade, all IP info remains the same. The new connection will be 100G IPv6: Peering Contact: peering(a)tdstelecom.com Route Servers: No BFD: No Welcome Aboard Again! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

Oct. 3, 2022

Re: Amazon changes

by Andrew Hoyos

https://www.peeringdb.com/net/1418 NOC Technical Operations peering-to(a)amazon.com Operational issues: If you experience connectivity issues to Amazon, please first visit: http://ec2-reachability.amazonaws.com/. When contacting our Operational alias below, please include trace/debug information (source and destination address) and details for the affected prefixes. This will reduce troubleshooting time. Please do not contact policy addresses for operational support. — Andrew Hoyos hoyosa(a)gmail.com > On Sep 30, 2022, at 10:04 AM, Justin Huffman <jhuffman(a)LONGLINES.BIZ> wrote: > > Does anyone know of any BGP changes that were done last night around 9 or 9:30 that would have affected AWS or Amazon? We have 1 customer that we advertise their entire block via BGP and they cannot access several AWS sites. Does anyone have a good Amazon contact? > > Thanks, > > Justin Huffman > Long Lines Broadband > 712-271-5902 (W) > jhuffman(a)longlines.biz > > <image001.jpg> <image002.png> > > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >

Sept. 30, 2022

Amazon changes

by Justin Huffman

Does anyone know of any BGP changes that were done last night around 9 or 9:30 that would have affected AWS or Amazon? We have 1 customer that we advertise their entire block via BGP and they cannot access several AWS sites. Does anyone have a good Amazon contact? Thanks, Justin Huffman Long Lines Broadband 712-271-5902 (W) jhuffman(a)longlines.biz<mailto:jhuffman@longlines.biz> [LL new] [cid:image002.png@01D8D4B4.02AA59F0]

Sept. 30, 2022

Please welcome FiberNet Communications to MICE!

by Jeremy Lumby

Name: FiberNet Communications Switch: MN VoIP - 100G Port: E8/1 ASN: 18883 IPv4: This is a port upgrade, all IP info remains the same. The new connection will be 100G IPv6: Peering Contact: peering(a)fibernetcommunications.net Route Servers: Yes BFD: No Welcome Aboard Again! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

Sept. 20, 2022

MICE UG 41 at 3:00 PM

by Richard Laager

MICE UG 41 is at 3:00 PM at UMN: https://lists.iphouse.net/cgi-bin/wa?A2=MICE-DISCUSS;2c503e19.2209 or via Zoom: https://umn.zoom.us/j/98411644091?pwd=QUxiM3hyaldYeDd5SnJFNC9rd2I5dz09 Meeting ID: 984 1164 4091 Passcode: MDQp15 One tap mobile +16513728299,,98411644091#,,,,*686853# US (Minnesota) +13126266799,,98411644091#,,,,*686853# US (Chicago) For the election, the only nomination was me (Richard Laager), so I am running unopposed. As has been our practice, we will still hold the vote for procedural reasons, even though the result is known. -- Richard

Sept. 20, 2022

Re: Remote access details for tomorrow's meeting?

by David Farmer

Sorry, no, that won't work, below is updated Remote Access Information for tomorrow. MICE UG 41 will be held at the University’s Information Technology Building, 2218 University Ave SE, Minneapolis, MN 55414, Room 185. It is across University Ave SE from Huntington Bank Stadium (Formerly TCF Bank Stadium). See the link to the Campus Map below. This room has a video room system, and remote access will be made available via Zoom video or phone audio, see Zoom details below. Please enter the building through the middle of three doors on the Ontario St SE side of the building. It will be open after 2:30 and will have a sign on it. If not, please knock hard, or call my cell phone (612-812-9952). This door is right outside the meeting room, this avoids everyone traipsing through the building. The Stadium Village Green Line Light Rail Station is less than a block east of the building, kitty-corner at the intersection of University Ave SE and Huron Blvd SE. See the link below for the station's info page. Limited Street Parking is available on Ontario St SE and Beacon St SE. Otherwise, public parking is available in the Oak St and University Ave Ramps, each a little over two blocks away. Also, the Maroon lot is a little further on the north side of the Stadium. See the link below for more parking details. DO NOT park in University Parking Lot 70 on the north of the building, by the front door, between University Ave SE and the building, or Parking Lot 71 near the loading dock to the east of the building, they are contract parking only, and you be ticketed. Also, DO NOT park in the private parking lot to the south of the building; you will likely be tagged, booted, and towed from that parking lot. https://campusmaps.umn.edu/information-technology https://www.metrotransit.org/stadium-village-station https://pts.umn.edu/Park/Basic-Parking-Information/Parking-Facilities ---------- David E Farmer III is inviting you to a scheduled Zoom meeting. Join Zoom Meeting https://umn.zoom.us/j/98411644091?pwd=QUxiM3hyaldYeDd5SnJFNC9rd2I5dz09 Meeting ID: 984 1164 4091 Passcode: MDQp15 One tap mobile +16513728299,,98411644091#,,,,*686853# US (Minnesota) +13126266799,,98411644091#,,,,*686853# US (Chicago) Dial by your location +1 651 372 8299 US (Minnesota) +1 312 626 6799 US (Chicago) +1 646 558 8656 US (New York) +1 301 715 8592 US (Washington DC) +1 346 248 7799 US (Houston) +1 669 900 6833 US (San Jose) +1 253 215 8782 US (Tacoma) Meeting ID: 984 1164 4091 Passcode: 686853 Find your local number: https://umn.zoom.us/u/adbNJkGc6V Join by SIP 98411644091(a)zoomcrc.com Join by H.323 162.255.37.11 (US West) 162.255.36.11 (US East) 221.122.88.195 (China) 115.114.131.7 (India Mumbai) 115.114.115.7 (India Hyderabad) 213.19.144.110 (Amsterdam Netherlands) 213.244.140.110 (Germany) 103.122.166.55 (Australia Sydney) 103.122.167.55 (Australia Melbourne) 209.9.211.110 (Hong Kong SAR) 149.137.40.110 (Singapore) 64.211.144.160 (Brazil) 69.174.57.160 (Canada Toronto) 65.39.152.160 (Canada Vancouver) 207.226.132.110 (Japan Tokyo) 149.137.24.110 (Japan Osaka) Meeting ID: 984 1164 4091 Passcode: 686853 On Mon, Sep 19, 2022 at 3:37 PM Miles McCredie <Miles.McCredie(a)midco.com> wrote: > Are the remote access details at > http://lists.iphouse.net/cgi-bin/wa?A2=MICE-DISCUSS;28135c9a.2107 > accurate for tomorrow’s meeting? (They are from July and mention UG39 so > thought I would check.) > > > > Thanks > > > > > > *Miles McCredie * > Principal Network Engineer I-Core IP > > Office: 6052755192 > Miles.McCredie(a)midco.com > > *Midco.com* > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

Sept. 20, 2022

Re: Remote access details for tomorrow's meeting?

by Richard Laager

Anthony will confirm tomorrow morning. On 9/19/22 15:37, Miles McCredie wrote: > > Are the remote access details at > http://lists.iphouse.net/cgi-bin/wa?A2=MICE-DISCUSS;28135c9a.2107 > accurate for tomorrow’s meeting? (They are from July and mention UG39 > so thought I would check.) > -- Richard

Sept. 20, 2022

Remote access details for tomorrow's meeting?

by Miles McCredie

Are the remote access details at http://lists.iphouse.net/cgi-bin/wa?A2=MICE-DISCUSS;28135c9a.2107 accurate for tomorrow's meeting? (They are from July and mention UG39 so thought I would check.) Thanks [http://images.midcocomm.com/ES_MidcoLogo.png] Miles McCredie Principal Network Engineer I-Core IP Office: 6052755192 Miles.McCredie(a)midco.com Midco.com

Sept. 19, 2022

Re: RST Hurricane Congestion

by Darin Steffl

Thanks for the info Reid. I'm not sure if you're referencing Zayo or not. They seem to have plenty of fiber issues near the metro. It seems reconvergence takes longer than it should when there's a cut too. We see 2-4 minutes of slow speeds or lost routes/downtime when I assume there's a cut on a path feeding into RST. At one point, a software update was done and it got much better but now it seems to be troublesome again. Congestion is usually bad when there's a cut and I have reported many events over the life of our account. Hopefully you guys have good luck improving things into RST. Thank you On Sat, Sep 17, 2022, 12:28 AM Reid Fishler < 0000000c9d62e487-dmarc-request(a)lists.iphouse.net> wrote: > Just to be clear, this was a fiber on some...legacy RST fiber. It has > multiple 100s for us, so the reroute wasn't as pretty as it should be. We > are actively working on making things a bit better between RST and the MSP > area, but its a work in progress. Sorry for any issues, but I think many of > us know the problematic history of this run of fiber. > > Reid > > > On Fri, Sep 16, 2022 at 12:54 PM Ben Wiechman <ben.wiechman(a)arvig.com> > wrote: > >> We didn't have anything down in that area in our maintenance/outage list. >> Another carrier has been fighting a cut between Winona and Wabasha in a >> difficult location. Maybe HE has some services through them as well? It >> seems out of the way, but... >> >> Ben Wiechman >> >> Director of Network Strategy and Engineering >> >> 320.247.3224 | ben.wiechman(a)arvig.com >> >> Arvig | 224 East Main Street | Melrose, MN 56352 | arvig.com >> >> >> >> >> On Thu, Sep 15, 2022 at 9:46 PM Darin Steffl <darin.steffl(a)mnwifi.com> >> wrote: >> >>> It's not football killing us tonight! They finally responded after I >>> called them twice and waited 1 hour, 51 mins for a ticket reply. They said >>> several circuits are down to Rochester and they're trying to balance >>> traffic on the remaining links. It's slowly getting better but we're still >>> down 25% from our normal peak at this time of night. It's better than being >>> down 50% of normal. >>> >>> This seems to be happening more frequently the last 2-3 years or there's >>> more capacity sold, being used, in RST compared to years past when there's >>> been fiber cuts. The slow performance is very noticeable. Less than 2 Mbps >>> download and 10-20% packetloss anywhere outside of RST. >>> >>> Ben, are there any Arvig cuts between RST and Belle Plaine/MSP? I'm >>> pretty sure they have some 100G paths from you guys. >>> >>> On Thu, Sep 15, 2022 at 9:41 PM Ben Wiechman <ben.wiechman(a)arvig.com> >>> wrote: >>> >>>> Thu night football killing the link? >>>> >>>> >>>> Ben Wiechman >>>> Director of IP Strategy and Engineering >>>> Direct: 320.256.0184 >>>> Cell: 320.247.3224 >>>> ben.wiechman(a)arvig.com >>>> 150 Second Street SW | Perham, MN 56573 | arvig.com >>>> >>>> On Thu, Sep 15, 2022, 20:16 Darin Steffl <darin.steffl(a)mnwifi.com> >>>> wrote: >>>> >>>>> Anyone else connected to Hurricane's RST router noticing major >>>>> congestion? It looks like the RST-BLP-MSP path is down and traffic is being >>>>> diverted to CHI first or DVN-OMA. >>>>> >>>>> Any speedtests to ISP's like MiBroadband or KMTelecom that are >>>>> connected to RST are fine but any tests outside of that like to US Internet >>>>> or Carleton College, I'm seeing under 2 Mbps download speeds and 20% packet >>>>> loss. >>>>> >>>>> I reported it to Hurricane at 7:39pm but it's been ongoing longer than >>>>> that. I called 10 minutes after I emailed their NOC and the lady there >>>>> wouldn't transfer me to an engineer and just said they'd reply to my ticket >>>>> after they looked. I stressed the urgency since our traffic levels are only >>>>> 50% of what they should be right now. >>>>> >>>>> -- >>>>> Darin Steffl >>>>> Minnesota WiFi >>>>> www.mnwifi.com >>>>> 507-634-WiFi >>>>> Like us on Facebook <http://www.facebook.com/minnesotawifi> >>>>> >>>>> ------------------------------ >>>>> >>>>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>>>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>>> >>>> >>>> ------------------------------ >>>> >>>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>> >>> >>> >>> -- >>> Darin Steffl >>> Minnesota WiFi >>> www.mnwifi.com >>> 507-634-WiFi >>> Like us on Facebook <http://www.facebook.com/minnesotawifi> >>> >>> ------------------------------ >>> >>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>> >> >> ------------------------------ >> >> To unsubscribe from the MICE-DISCUSS list, click the following link: >> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >> > > > -- > Reid Fishler > Senior Director > Hurricane Electric > +1-510-580-4178 > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >

Sept. 17, 2022

Re: RST Hurricane Congestion

by Reid Fishler

Just to be clear, this was a fiber on some...legacy RST fiber. It has multiple 100s for us, so the reroute wasn't as pretty as it should be. We are actively working on making things a bit better between RST and the MSP area, but its a work in progress. Sorry for any issues, but I think many of us know the problematic history of this run of fiber. Reid On Fri, Sep 16, 2022 at 12:54 PM Ben Wiechman <ben.wiechman(a)arvig.com> wrote: > We didn't have anything down in that area in our maintenance/outage list. > Another carrier has been fighting a cut between Winona and Wabasha in a > difficult location. Maybe HE has some services through them as well? It > seems out of the way, but... > > Ben Wiechman > > Director of Network Strategy and Engineering > > 320.247.3224 | ben.wiechman(a)arvig.com > > Arvig | 224 East Main Street | Melrose, MN 56352 | arvig.com > > > > > On Thu, Sep 15, 2022 at 9:46 PM Darin Steffl <darin.steffl(a)mnwifi.com> > wrote: > >> It's not football killing us tonight! They finally responded after I >> called them twice and waited 1 hour, 51 mins for a ticket reply. They said >> several circuits are down to Rochester and they're trying to balance >> traffic on the remaining links. It's slowly getting better but we're still >> down 25% from our normal peak at this time of night. It's better than being >> down 50% of normal. >> >> This seems to be happening more frequently the last 2-3 years or there's >> more capacity sold, being used, in RST compared to years past when there's >> been fiber cuts. The slow performance is very noticeable. Less than 2 Mbps >> download and 10-20% packetloss anywhere outside of RST. >> >> Ben, are there any Arvig cuts between RST and Belle Plaine/MSP? I'm >> pretty sure they have some 100G paths from you guys. >> >> On Thu, Sep 15, 2022 at 9:41 PM Ben Wiechman <ben.wiechman(a)arvig.com> >> wrote: >> >>> Thu night football killing the link? >>> >>> >>> Ben Wiechman >>> Director of IP Strategy and Engineering >>> Direct: 320.256.0184 >>> Cell: 320.247.3224 >>> ben.wiechman(a)arvig.com >>> 150 Second Street SW | Perham, MN 56573 | arvig.com >>> >>> On Thu, Sep 15, 2022, 20:16 Darin Steffl <darin.steffl(a)mnwifi.com> >>> wrote: >>> >>>> Anyone else connected to Hurricane's RST router noticing major >>>> congestion? It looks like the RST-BLP-MSP path is down and traffic is being >>>> diverted to CHI first or DVN-OMA. >>>> >>>> Any speedtests to ISP's like MiBroadband or KMTelecom that are >>>> connected to RST are fine but any tests outside of that like to US Internet >>>> or Carleton College, I'm seeing under 2 Mbps download speeds and 20% packet >>>> loss. >>>> >>>> I reported it to Hurricane at 7:39pm but it's been ongoing longer than >>>> that. I called 10 minutes after I emailed their NOC and the lady there >>>> wouldn't transfer me to an engineer and just said they'd reply to my ticket >>>> after they looked. I stressed the urgency since our traffic levels are only >>>> 50% of what they should be right now. >>>> >>>> -- >>>> Darin Steffl >>>> Minnesota WiFi >>>> www.mnwifi.com >>>> 507-634-WiFi >>>> Like us on Facebook <http://www.facebook.com/minnesotawifi> >>>> >>>> ------------------------------ >>>> >>>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>> >>> >>> ------------------------------ >>> >>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>> >> >> >> -- >> Darin Steffl >> Minnesota WiFi >> www.mnwifi.com >> 507-634-WiFi >> Like us on Facebook <http://www.facebook.com/minnesotawifi> >> >> ------------------------------ >> >> To unsubscribe from the MICE-DISCUSS list, click the following link: >> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >> > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > -- Reid Fishler Senior Director Hurricane Electric +1-510-580-4178

Sept. 17, 2022

Re: RST Hurricane Congestion

by Jay Hanke

> We didn't have anything down in that area in our maintenance/outage list. > Another carrier has been fighting a cut between Winona and Wabasha in a difficult location. Maybe HE has some services through them as well? It seems out of the way, but... There's only so many viable hops out of RST that go someplace useful for peering. The stuff heading towards Chicago gets horribly congested during network events. If that cut is on the CP rail between Winona and Wabasha that would remove a good chunk of capacity between MN and Chicago. MICE can help quite a bit with the Chicago problem...

Sept. 16, 2022

Re: RST Hurricane Congestion

by Ben Wiechman

We didn't have anything down in that area in our maintenance/outage list. Another carrier has been fighting a cut between Winona and Wabasha in a difficult location. Maybe HE has some services through them as well? It seems out of the way, but... Ben Wiechman Director of Network Strategy and Engineering 320.247.3224 | ben.wiechman(a)arvig.com Arvig | 224 East Main Street | Melrose, MN 56352 | arvig.com On Thu, Sep 15, 2022 at 9:46 PM Darin Steffl <darin.steffl(a)mnwifi.com> wrote: > It's not football killing us tonight! They finally responded after I > called them twice and waited 1 hour, 51 mins for a ticket reply. They said > several circuits are down to Rochester and they're trying to balance > traffic on the remaining links. It's slowly getting better but we're still > down 25% from our normal peak at this time of night. It's better than being > down 50% of normal. > > This seems to be happening more frequently the last 2-3 years or there's > more capacity sold, being used, in RST compared to years past when there's > been fiber cuts. The slow performance is very noticeable. Less than 2 Mbps > download and 10-20% packetloss anywhere outside of RST. > > Ben, are there any Arvig cuts between RST and Belle Plaine/MSP? I'm pretty > sure they have some 100G paths from you guys. > > On Thu, Sep 15, 2022 at 9:41 PM Ben Wiechman <ben.wiechman(a)arvig.com> > wrote: > >> Thu night football killing the link? >> >> >> Ben Wiechman >> Director of IP Strategy and Engineering >> Direct: 320.256.0184 >> Cell: 320.247.3224 >> ben.wiechman(a)arvig.com >> 150 Second Street SW | Perham, MN 56573 | arvig.com >> >> On Thu, Sep 15, 2022, 20:16 Darin Steffl <darin.steffl(a)mnwifi.com> wrote: >> >>> Anyone else connected to Hurricane's RST router noticing major >>> congestion? It looks like the RST-BLP-MSP path is down and traffic is being >>> diverted to CHI first or DVN-OMA. >>> >>> Any speedtests to ISP's like MiBroadband or KMTelecom that are connected >>> to RST are fine but any tests outside of that like to US Internet or >>> Carleton College, I'm seeing under 2 Mbps download speeds and 20% packet >>> loss. >>> >>> I reported it to Hurricane at 7:39pm but it's been ongoing longer than >>> that. I called 10 minutes after I emailed their NOC and the lady there >>> wouldn't transfer me to an engineer and just said they'd reply to my ticket >>> after they looked. I stressed the urgency since our traffic levels are only >>> 50% of what they should be right now. >>> >>> -- >>> Darin Steffl >>> Minnesota WiFi >>> www.mnwifi.com >>> 507-634-WiFi >>> Like us on Facebook <http://www.facebook.com/minnesotawifi> >>> >>> ------------------------------ >>> >>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>> >> >> ------------------------------ >> >> To unsubscribe from the MICE-DISCUSS list, click the following link: >> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >> > > > -- > Darin Steffl > Minnesota WiFi > www.mnwifi.com > 507-634-WiFi > Like us on Facebook <http://www.facebook.com/minnesotawifi> > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >

Sept. 16, 2022

Re: RST Hurricane Congestion

by Darin Steffl

It's not football killing us tonight! They finally responded after I called them twice and waited 1 hour, 51 mins for a ticket reply. They said several circuits are down to Rochester and they're trying to balance traffic on the remaining links. It's slowly getting better but we're still down 25% from our normal peak at this time of night. It's better than being down 50% of normal. This seems to be happening more frequently the last 2-3 years or there's more capacity sold, being used, in RST compared to years past when there's been fiber cuts. The slow performance is very noticeable. Less than 2 Mbps download and 10-20% packetloss anywhere outside of RST. Ben, are there any Arvig cuts between RST and Belle Plaine/MSP? I'm pretty sure they have some 100G paths from you guys. On Thu, Sep 15, 2022 at 9:41 PM Ben Wiechman <ben.wiechman(a)arvig.com> wrote: > Thu night football killing the link? > > > Ben Wiechman > Director of IP Strategy and Engineering > Direct: 320.256.0184 > Cell: 320.247.3224 > ben.wiechman(a)arvig.com > 150 Second Street SW | Perham, MN 56573 | arvig.com > > On Thu, Sep 15, 2022, 20:16 Darin Steffl <darin.steffl(a)mnwifi.com> wrote: > >> Anyone else connected to Hurricane's RST router noticing major >> congestion? It looks like the RST-BLP-MSP path is down and traffic is being >> diverted to CHI first or DVN-OMA. >> >> Any speedtests to ISP's like MiBroadband or KMTelecom that are connected >> to RST are fine but any tests outside of that like to US Internet or >> Carleton College, I'm seeing under 2 Mbps download speeds and 20% packet >> loss. >> >> I reported it to Hurricane at 7:39pm but it's been ongoing longer than >> that. I called 10 minutes after I emailed their NOC and the lady there >> wouldn't transfer me to an engineer and just said they'd reply to my ticket >> after they looked. I stressed the urgency since our traffic levels are only >> 50% of what they should be right now. >> >> -- >> Darin Steffl >> Minnesota WiFi >> www.mnwifi.com >> 507-634-WiFi >> Like us on Facebook <http://www.facebook.com/minnesotawifi> >> >> ------------------------------ >> >> To unsubscribe from the MICE-DISCUSS list, click the following link: >> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >> > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > -- Darin Steffl Minnesota WiFi www.mnwifi.com 507-634-WiFi Like us on Facebook <http://www.facebook.com/minnesotawifi>

Sept. 16, 2022

Re: RST Hurricane Congestion

by Ben Wiechman

Thu night football killing the link? Ben Wiechman Director of IP Strategy and Engineering Direct: 320.256.0184 Cell: 320.247.3224 ben.wiechman(a)arvig.com 150 Second Street SW | Perham, MN 56573 | arvig.com On Thu, Sep 15, 2022, 20:16 Darin Steffl <darin.steffl(a)mnwifi.com> wrote: > Anyone else connected to Hurricane's RST router noticing major congestion? > It looks like the RST-BLP-MSP path is down and traffic is being diverted to > CHI first or DVN-OMA. > > Any speedtests to ISP's like MiBroadband or KMTelecom that are connected > to RST are fine but any tests outside of that like to US Internet or > Carleton College, I'm seeing under 2 Mbps download speeds and 20% packet > loss. > > I reported it to Hurricane at 7:39pm but it's been ongoing longer than > that. I called 10 minutes after I emailed their NOC and the lady there > wouldn't transfer me to an engineer and just said they'd reply to my ticket > after they looked. I stressed the urgency since our traffic levels are only > 50% of what they should be right now. > > -- > Darin Steffl > Minnesota WiFi > www.mnwifi.com > 507-634-WiFi > Like us on Facebook <http://www.facebook.com/minnesotawifi> > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >

Sept. 16, 2022

RST Hurricane Congestion

by Darin Steffl

Anyone else connected to Hurricane's RST router noticing major congestion? It looks like the RST-BLP-MSP path is down and traffic is being diverted to CHI first or DVN-OMA. Any speedtests to ISP's like MiBroadband or KMTelecom that are connected to RST are fine but any tests outside of that like to US Internet or Carleton College, I'm seeing under 2 Mbps download speeds and 20% packet loss. I reported it to Hurricane at 7:39pm but it's been ongoing longer than that. I called 10 minutes after I emailed their NOC and the lady there wouldn't transfer me to an engineer and just said they'd reply to my ticket after they looked. I stressed the urgency since our traffic levels are only 50% of what they should be right now. -- Darin Steffl Minnesota WiFi www.mnwifi.com 507-634-WiFi Like us on Facebook <http://www.facebook.com/minnesotawifi>

Sept. 16, 2022

Please welcome Hennepin County to MICE!

by Jeremy Lumby

Name: Hennepin County Switch: MICE Core Port: E 3/29 & E 6/25 (This is an upgrade from 1x10G to 2x1x100G (no LACP)) ASN: 40382 IPv4: 206.108.255.193/24 (existing) & 206.108.255.201/24 (new) IPv6: 2001:504:27:0:0:9DBE::1/64 (existing) & 2001:504:27:0:0:9DBE::2/64 (new) Peering Contact: peering(a)hennepin.us Route Servers: YES BFD: YES Welcome Aboard Again! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

Sept. 13, 2022

Re: AS112 Server at MICE/511

by Isaiah Olson

Jeremy was able to fix the AS112 node this afternoon and all peering sessions should be re-established. Apparently, one of the DC power leads was pulled loose from the distribution block. Thanks again for taking a look at this for us, Jeremy! _____ Isaiah Olson Network and Systems Administrator 1831 Anne St NW Bemidji, MN 56601 Email: <mailto:iolson@paulbunyan.net> iolson(a)paulbunyan.net P: (218) 444-4638 _____ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Isaiah Olson Sent: Thursday, September 08, 2022 2:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] AS112 Server at MICE/511 Hello, Our AS112 node serving the MICE community has experienced an unknown failure. BGP sessions to 206.108.255.138 and 2001:504:27::70:0:1 would have dropped last night around 12:40 AM. Jeremy will be on-site tomorrow to take a look at the server and we will repair/replace it once the issue has been identified. Thanks, Isaiah _____ Isaiah Olson Network and Systems Administrator 1831 Anne St NW Bemidji, MN 56601 Email: <mailto:iolson@paulbunyan.net> iolson(a)paulbunyan.net P: (218) 444-4638 _____ _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> &A=1

Sept. 9, 2022

AS112 Server at MICE/511

by Isaiah Olson

Hello, Our AS112 node serving the MICE community has experienced an unknown failure. BGP sessions to 206.108.255.138 and 2001:504:27::70:0:1 would have dropped last night around 12:40 AM. Jeremy will be on-site tomorrow to take a look at the server and we will repair/replace it once the issue has been identified. Thanks, Isaiah _____ Isaiah Olson Network and Systems Administrator 1831 Anne St NW Bemidji, MN 56601 Email: <mailto:iolson@paulbunyan.net> iolson(a)paulbunyan.net P: (218) 444-4638 _____

Sept. 8, 2022

Re: MICE UG41 and Fall Election

by AnthonyAnderberg＠nuvera.net

The nomination period for the MICE board of directors is now closed, the only nomination I've seen is Richard Laager - let me know if I've missed any others. Either way, the formal election will occur during the September 20th UG41 meeting, as noted below. Thanks everyone, anthony From: Anthony Anderberg <AnthonyAnderberg(a)nuvera.net> Date: Wednesday, August 10, 2022 at 4:18 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: MICE UG41 and Fall Election The MICE Users Group Meeting #41 will be held Tuesday September 20th at 3pm at the University of Minnesota’s video conference center in 2218 University Ave SE, Minneapolis. Parking and video/audio bridge details will be sent out beforehand. At this meeting we will be holding an election for a board seat - this year the seat held by Richard is up for election. The board consists of three seats with staggered terms, such that one seat comes up for re-election each year (at the fall meeting). Nominations can be posted to MICE-Discuss publicly or sent to me privately and will be accepted from now until September 1st, after the 1st I’ll publish the list of nominated candidates to give people time to choose and arrange proxy voters before the meeting if needed. For proxy voting you can either send your choice to me and during the meeting I’ll list who I’m voting on behalf of, or you may inform me that you are appointing another individual to vote on your behalf and those wishes will be honored during the election. The agenda and draft UG 40 minutes are here for everyone’s review: http://www.micemn.net/files/MICE%20UG%2040%20-%20Minutes.pdf Cheers, Anthony Anderberg MICE Secretary/Treasurer

Sept. 1, 2022

Please welcome Metronet (Jaguar Communications) to MICE!

by Jeremy Lumby

Name: Metronet (Jaguar Communications) Switch: MICE Core Port: E5/5 ASN: 15011 IPv4: IPs remain the same. This is a port addition bringing capacity to 40G on portchannel 20 IPv6: Peering Contact: peering(a)metronet.com Route Servers: BFD: Welcome Aboard Again! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

Aug. 26, 2022

Re: Please welcome Hiawatha Broadband Communications to MICE!

by Jeremy Lumby

The LOA is public onhttp://micemn.net/participants.html Cologix knows to look it up there. The website will be updated with your new port info shortly. From: Dennis Vasquez [mailto:dvasquez@exchange.hbci.com] Sent: Friday, August 26, 2022 11:12 AM To: Jeremy Lumby; MICE Discuss (MICE-DISCUSS(a)LISTS.IPHOUSE.NET) Subject: Re: Please welcome Hiawatha Broadband Communications to MICE! Hi Jeremy, Could you also forward the LOA so I can get the cross connect ordered through cologix? Thanks, Dennis Vasquez Network Administrator E: dvasquez(a)exchange.hbci.com O: (507) 474-5833 www.hbci.com <http://www.hbci.com/> | (888) 474-9995 ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- From: Jeremy Lumby <jlumby(a)mnvoip.com> Sent: Friday, August 26, 2022 11:08:00 AM To: MICE Discuss (MICE-DISCUSS(a)LISTS.IPHOUSE.NET) <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: Please welcome Hiawatha Broadband Communications to MICE! WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. Name: Hiawatha Broadband Communications Switch: MICE Core Port: E5/41 ASN: 14828 IPv4: IPs remain the same. This is a port addition bringing capacity to 40G on portchannel 32 IPv6: Peering Contact: noc(a)hbci.com Route Servers: YES BFD: YES Welcome Aboard Again! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

Aug. 26, 2022

Please welcome Hiawatha Broadband Communications to MICE!

by Jeremy Lumby

Name: Hiawatha Broadband Communications Switch: MICE Core Port: E5/41 ASN: 14828 IPv4: IPs remain the same. This is a port addition bringing capacity to 40G on portchannel 32 IPv6: Peering Contact: noc(a)hbci.com Route Servers: YES BFD: YES Welcome Aboard Again! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

Aug. 26, 2022

Re: Port down

by Todd Mueller

Thanks much Jeremy. That is a MAC of a downstream transit switch with no SVI on the VLAN, I'm not sure why it would have originated any traffic yet ... I will see what I can figure out. Todd From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Wednesday, August 10, 2022 7:06 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Port down Todd, I have cleared the port security for you: Aug 10 18:16:06 core-sw0 PortSec: %PORTSECURITY-2-PSECURE_VIOLATION: Security violation occurred, caused by MAC address 64:9e:f3:ec:b9:73 on vlan 1 interface Ethernet4/21. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com <mailto:jlumby@mnvoip.com> From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Todd Mueller Sent: Wednesday, August 10, 2022 6:52 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] Port down Our (Velocity Telephone) MICE port at 511 went down at 6:16P tonight and remains down, any known issues? Thanks, Todd _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> &A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> &A=1

Aug. 11, 2022

Re: Port down

by Jeremy Lumby

Todd, I have cleared the port security for you: Aug 10 18:16:06 core-sw0 PortSec: %PORTSECURITY-2-PSECURE_VIOLATION: Security violation occurred, caused by MAC address 64:9e:f3:ec:b9:73 on vlan 1 interface Ethernet4/21. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Todd Mueller Sent: Wednesday, August 10, 2022 6:52 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Port down Our (Velocity Telephone) MICE port at 511 went down at 6:16P tonight and remains down, any known issues? Thanks, Todd ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Aug. 11, 2022

Port down

by Todd Mueller

Our (Velocity Telephone) MICE port at 511 went down at 6:16P tonight and remains down, any known issues? Thanks, Todd

Aug. 10, 2022

MICE UG41 and Fall Election

by AnthonyAnderberg＠nuvera.net

The MICE Users Group Meeting #41 will be held Tuesday September 20th at 3pm at the University of Minnesota’s video conference center in 2218 University Ave SE, Minneapolis. Parking and video/audio bridge details will be sent out beforehand. At this meeting we will be holding an election for a board seat - this year the seat held by Richard is up for election. The board consists of three seats with staggered terms, such that one seat comes up for re-election each year (at the fall meeting). Nominations can be posted to MICE-Discuss publicly or sent to me privately and will be accepted from now until September 1st, after the 1st I’ll publish the list of nominated candidates to give people time to choose and arrange proxy voters before the meeting if needed. For proxy voting you can either send your choice to me and during the meeting I’ll list who I’m voting on behalf of, or you may inform me that you are appointing another individual to vote on your behalf and those wishes will be honored during the election. The agenda and draft UG 40 minutes are here for everyone’s review: http://www.micemn.net/files/MICE%20UG%2040%20-%20Minutes.pdf Cheers, Anthony Anderberg MICE Secretary/Treasurer

Aug. 10, 2022

Please welcome Fiber Minnesota to MICE!

by Jeremy Lumby

Name: Fiber Minnesota Switch: MICE Core Port: E6/26/1 (Core) <-> Hu1/0/30 (FM Switch) ASN: IPv4: This is a port addition bringing the uplink capacity to 300G on portchannel 22 IPv6: Peering Contact: peering(a)paulbunyan.net Route Servers: BFD: Welcome Aboard Again! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

Aug. 9, 2022

Please welcome UnitedHealth Group to MICE!

by Jeremy Lumby

UnitedHealth Group is being converted to 2 individual 100G links with separate IPs instead of a single port channel. Name: UnitedHealth Group Switch: MICE Main Ports: 3/28/1 & 6/24/1 ASN: 10879 IPv4: 206.108.255.198/24 and 206.108.255.200/24 IPv6: 2001:504:27:0:0:2A7F::1/64 and 2001:504:27:0:0:2A7F::2/64 Peering Contact: inet_ops(a)uhc.com Route Servers: YES BFD: YES Welcome Aboard Again! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

Aug. 6, 2022

Router Maintenance

by Travis Fincham

Good Morning, Key Cooperative will be doing router maintenance on Tuesday August 2nd, beginning at 10PM CST. This will affect BGP Sessions to MICE. Thanks, Travis [Text Description automatically generated] ________________________________ NOTICE: This message (including attachments) is covered by the Electronic Communications Privacy Act, 18 U.S.C. § 2510-2521, is CONFIDENTIAL, and is intended only for the individual to whom it is addressed. If you are not the named addressee or an employee or agent responsible for delivering this message to the named addressee, you are hereby notified that you have received this message in error and that any review, retention, dissemination, distribution, copying or use of this communication is strictly prohibited. Please reply to the sender that you received this message in error and then delete it.

Aug. 1, 2022

Re: Zayo Belle Plaine Remote

by Frank Bulk

If this was the same 288 that SDN was reporting about yesterday, splicing started around 1:00 Central, they were mostly done splicing by 3:20 pm, and they were hands off by 5:05 pm. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jesse DuPont Sent: Tuesday, July 26, 2022 8:53 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Zayo Belle Plaine Remote I have a Wavelength from South Dakota to Cologix in MSP and my circuit went down yesterday the same time as the Belle Plaine remote started having issues (10:39 AM CDT). Mine never came back up. I'm told the damaged location as found early this morning (to a 288 count) and construction crew is finally onsite to begin excavation and repairs. Jesse DuPont General Manager, Celerity Internet email: jesse.dupont(a)celeritycorp.net<mailto:jesse.dupont@celeritycorp.net> On 7/26/22 7:29 AM, Shannon Sykes wrote: I am also down from Madelia, MN to Belle Plaine as of 0755. Shannon Sykes Technology Manager (507) 642-5519 shannons(a)chriscomco.net<mailto:shannons@chriscomco.net> [CCC-w_text-horizontal_color] 104 West Main Street Madelia, MN 56062 (507) 642-5555 www.chriscomco.net From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET><mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> On Behalf Of James Urwiller Sent: Tuesday, July 26, 2022 8:24 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Zayo Belle Plaine Remote Much like yesterday, but earlier and more permanent.. I am currently down from Fremont, ne to belle plaine, mn. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [cid:image002.jpg@01D8A1AA.7F58ADE0] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jeremy Lumby Sent: Monday, July 25, 2022 13:30 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Zayo Belle Plaine Remote I experienced the same thing on my path to Belle Plaine From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of AnthonyAnderberg(a)nuvera.net<mailto:AnthonyAnderberg@nuvera.net> Sent: Monday, July 25, 2022 1:26 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] Zayo Belle Plaine Remote It looks like the link to the Zayo Belle Plaine remote MICE switch had issues this morning, we’ve seen problems with fibers on the same path starting around 10:40am. It feels like a partial hit or someone fumbling in a splice case so there may be more to come... [Chart, line chart Description automatically generated] Thanks, Anthony ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

July 27, 2022

Re: Zayo Belle Plaine Remote

by Jesse DuPont

July 26, 2022

Re: Zayo Belle Plaine Remote

by Shannon Sykes

I am also down from Madelia, MN to Belle Plaine as of 0755. Shannon Sykes Technology Manager (507) 642-5519 shannons(a)chriscomco.net<mailto:shannons@chriscomco.net> [CCC-w_text-horizontal_color] 104 West Main Street Madelia, MN 56062 (507) 642-5555 www.chriscomco.net From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of James Urwiller Sent: Tuesday, July 26, 2022 8:24 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Zayo Belle Plaine Remote Much like yesterday, but earlier and more permanent.. I am currently down from Fremont, ne to belle plaine, mn. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [cid:image004.jpg@01D8A0C9.DA7B1640] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jeremy Lumby Sent: Monday, July 25, 2022 13:30 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Zayo Belle Plaine Remote I experienced the same thing on my path to Belle Plaine From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of AnthonyAnderberg(a)nuvera.net<mailto:AnthonyAnderberg@nuvera.net> Sent: Monday, July 25, 2022 1:26 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] Zayo Belle Plaine Remote It looks like the link to the Zayo Belle Plaine remote MICE switch had issues this morning, we’ve seen problems with fibers on the same path starting around 10:40am. It feels like a partial hit or someone fumbling in a splice case so there may be more to come... [Chart, line chart Description automatically generated] Thanks, Anthony ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

July 26, 2022

Re: Zayo Belle Plaine Remote

by James Urwiller

Much like yesterday, but earlier and more permanent.. I am currently down from Fremont, ne to belle plaine, mn. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Jeremy Lumby *Sent:* Monday, July 25, 2022 13:30 *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] Zayo Belle Plaine Remote I experienced the same thing on my path to Belle Plaine *From:* MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET <MICE-DISCUSS(a)LISTS.IPHOUSE.NET>] *On Behalf Of *AnthonyAnderberg(a)nuvera.net *Sent:* Monday, July 25, 2022 1:26 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* [MICE-DISCUSS] Zayo Belle Plaine Remote It looks like the link to the Zayo Belle Plaine remote MICE switch had issues this morning, we’ve seen problems with fibers on the same path starting around 10:40am. It feels like a partial hit or someone fumbling in a splice case so there may be more to come... [image: Chart, line chart Description automatically generated] Thanks, Anthony ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

July 26, 2022

Re: Zayo Belle Plaine Remote

by Jeremy Lumby

I experienced the same thing on my path to Belle Plaine From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of AnthonyAnderberg(a)nuvera.net Sent: Monday, July 25, 2022 1:26 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Zayo Belle Plaine Remote It looks like the link to the Zayo Belle Plaine remote MICE switch had issues this morning, we’ve seen problems with fibers on the same path starting around 10:40am. It feels like a partial hit or someone fumbling in a splice case so there may be more to come... Thanks, Anthony ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

July 25, 2022

Zayo Belle Plaine Remote

by AnthonyAnderberg＠nuvera.net

It looks like the link to the Zayo Belle Plaine remote MICE switch had issues this morning, we’ve seen problems with fibers on the same path starting around 10:40am. It feels like a partial hit or someone fumbling in a splice case so there may be more to come... [Chart, line chart Description automatically generated] Thanks, Anthony

July 25, 2022

WiscNet AS2381 Maintenance 2022-07-25

by Joshua Gorton

Hello MICE participants, WiscNet will be performing router maintenance tonight between 10pm-midnight local time. This will not impact the remote switch WiscNet maintains. We’re: AS2381 206.108.255.125/24 2001:504:27:0:0:094d::1/64 https://www.peeringdb.com/net/386 Thanks, Josh -- Josh Gorton Platform Engineer, WiscNet (608) 210-3949 joshg(a)wiscnet.net<mailto:joshg@wiscnet.net>

July 25, 2022

Re: Please welcome AcenTek (MI) to MICE!

by Doug McIntyre

On Thu, Jul 21, 2022 at 07:22:00PM -0500, Jeremy Lumby wrote: >Name: AcenTek (Michigan) >Switch: Fiber Minnesota >Ports: Hu1/0/3/3 (10G Breakout) >ASN: 11904 >IPv4: 206.108.255.199/24 >IPv6: 2001:504:27:0:0:2E80::1/64 >Peering Contact: peering(a)acentek.net >Route Servers: YES >BFD: NO Added into the RR's. Welcome!

July 22, 2022

US Internet (AS 10242) - Router Maintenance

by Justin Krejci

US Internet will be dropping IX BGP sessions to complete a router reboot for software updates. BGP sessions will be re-established after reboot is completed. The maintenance window of time for this starts this evening 11pm central time. US Internet at MICE ASN: 10242 206.108.255.19 2001:504:27::2802:0:1 Justin Krejci Network Engineer 952.253.3200 12450 Wayzata Blvd. Suite 320 | Minnetonka, MN 55305 [1616694896307]

July 22, 2022

Please welcome AcenTek (MI) to MICE!

by Jeremy Lumby

Name: AcenTek (Michigan) Switch: Fiber Minnesota Ports: Hu1/0/3/3 (10G Breakout) ASN: 11904 IPv4: 206.108.255.199/24 IPv6: 2001:504:27:0:0:2E80::1/64 Peering Contact: peering(a)acentek.net Route Servers: YES BFD: NO Welcome Aboard! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

July 22, 2022

Re: Customer reports on Netflix issues

by Frank Bulk

Our own issue is internal network routing related. =) Still, I find it interesting that MICE's volumes are significantly down compared to 24 hours ago. Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Sent: Thursday, July 21, 2022 8:36 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [External GPC] [MICE-DISCUSS] Customer reports on Netflix issues Last night and into this morning we've received several customer reports about being unable to watch Netflix video. Our own Netflix cache shows some kind of event Wednesday at ~4:20 pm U.S. Central where IPv6 traffic to it dropped to zero and there was a huge drop in IPv4 traffic. Currently traffic volume this morning is just under half of normal. Interestingly enough, MICE's own two port channels to Netflix (image attached) are showing ~57% of yesterday's volume at this time (29.3 Gbps rather than 51.15 Gbps). I opened a ticket with Netflix through the Netflix cache administration portal, but wondering if anyone is receiving similar reports from customers or is aware of anything else? Regards, Frank Bulk FiberNet Communications ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

July 21, 2022

Customer reports on Netflix issues

by Frank Bulk

Last night and into this morning we've received several customer reports about being unable to watch Netflix video. Our own Netflix cache shows some kind of event Wednesday at ~4:20 pm U.S. Central where IPv6 traffic to it dropped to zero and there was a huge drop in IPv4 traffic. Currently traffic volume this morning is just under half of normal. Interestingly enough, MICE's own two port channels to Netflix (image attached) are showing ~57% of yesterday's volume at this time (29.3 Gbps rather than 51.15 Gbps). I opened a ticket with Netflix through the Netflix cache administration portal, but wondering if anyone is receiving similar reports from customers or is aware of anything else? Regards, Frank Bulk FiberNet Communications

July 21, 2022

4/18/2022 and 5/24/2022 Board Meetings

by AnthonyAnderberg＠nuvera.net

As promised here are my notes from the last two MICE board meetings, combined since the topics were the same for both. 4/18/2022 and 5/24/2022 MICE Board Meetings Conducted via Phone Bridges, Directors in Attendance: Richard Laager, Anthony Anderberg, Reid Fishler Capital Credits and other Co-op Items We are a 501.c12 entity instead of the more typical 501.c6 so several members accrued capital credits for 2012-2016 because of their contributions. We're under no obligation to pay them. When determining how to handle the retroactive 501c12 years, Richard and Kayla previously combined 2012-2016 as if they were one year for capital credit purposes. The accountants disagreed with that approach. They said we have to recalculate it year-by-year, with different treatment of the years with losses. The accountants would prefer a large correction in the 2021 books instead of re-opening 2012-2020 books. Richard proposed that we pay out capital credits for all of the years prior to 2017 to close those years out completely. The year 2017 was when we started collecting port fees. More recent donations and donations going forward are accounted as good will, and the board discussed that we would probably be better off re-opening the books for the years 2012-2016 and reclassifying donations in those years as good-will also. This would be extra work for the accountants but would solve the capital credit pay-out issue - additionally it was felt that paying out capital credits would harm our case should we ever need to go back to the IRS in an effort to be reclassified as a 501.c3 organization. The board also talked about the possibility of needing to notify members each year of their capital credit status/amount. We also discussed the best way to pay out capital credits, either as separate checks or as credits on annual bills. After some discussion it was felt that the benefit of less-paperwork was off-set by the effort required to explain variable annual bills, additionally 1099 statements would likely be required in either case. Research on all of the above continues. Epik / IP Volume Non-Pay Disconnect The board decided to expel Epik as a member for 1) non-payment, and 2) failure to ever provide updated corporate information for their IP Volume entity. They were given notice as required by the bylaws, that notice period has now expired, and they have been disconnected. KC Remote Switch Proposal The board discussed the proposal for a remote switch in Kansas City, with most of the specific pros and cons also being discussed and well documented on the MICE-DISCUSS list. It was agreed that this is an evolving topic that will need more discussion and thought by the community as a whole. After the inclusion of expected members the revised proposal was approved with directors Anderberg and Fishler voting yes and director Laager voting no. The board also discussed several other items that will be made public at a later date. Respectfully Submitted, Anthony Anderberg MICE Treasurer/Secretary

July 19, 2022

Re: Please welcome UnitedHealth Group to MICE!

by Doug McIntyre

On Sun, Jul 17, 2022 at 02:03:00PM -0500, Jeremy Lumby wrote: >Name: UnitedHealth Group >Switch: MICE Main >Ports: 3/28/1 & 6/24/1 (200G Po 12) >ASN: 10879 >IPv4: 206.108.255.198/24 >IPv6: 2001:504:27:0:0:2A7F::1/64 >Peering Contact: inet_ops(a)uhc.com >Route Servers: YES >BFD: YES Added into the RR's. Welcome!

July 18, 2022

Please welcome UnitedHealth Group to MICE!

by Jeremy Lumby

Name: UnitedHealth Group Switch: MICE Main Ports: 3/28/1 & 6/24/1 (200G Po 12) ASN: 10879 IPv4: 206.108.255.198/24 IPv6: 2001:504:27:0:0:2A7F::1/64 Peering Contact: inet_ops(a)uhc.com Route Servers: YES BFD: YES Welcome Aboard! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

July 17, 2022

Re: Last day for free MWPS 2022 registration

by Justin Huffman

I’m trying to register, however, it is saying it is closed. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jay Hanke Sent: Friday, July 15, 2022 8:44 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Last day for free MWPS 2022 registration WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. Today is the last day of free attendee registration for the Midwest Peering Summit. After today, the registration will be $40 per person either in advance or at the door. We currently have over 160 registered attendees making it the largest MICE meeting ever! Our room block at the hotel has sold out but there are a handful of rooms left at the hotel. We have a good mix of CDN, Eyeball, Vendors, R&E and IX operators attending. https://www.eventcreate.com/e/mwps2022 Special thanks to our sponsors! 1623 Farnam Arista Aureon616 Bluebird Datacenters NocIX South Front Networks -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io<mailto:jayhanke@southfront.io> Phone 612-204-0000 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

July 15, 2022

Last day for free MWPS 2022 registration

by Jay Hanke

Today is the last day of free attendee registration for the Midwest Peering Summit. After today, the registration will be $40 per person either in advance or at the door. We currently have over 160 registered attendees making it the largest MICE meeting ever! Our room block at the hotel has sold out but there are a handful of rooms left at the hotel. We have a good mix of CDN, Eyeball, Vendors, R&E and IX operators attending. https://www.eventcreate.com/e/mwps2022 Special thanks to our sponsors! 1623 Farnam Arista Aureon616 Bluebird Datacenters NocIX South Front Networks -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

July 15, 2022