- mice-discuss - lists.micemn.net

Traffic from Minneapolis to Seattle
by Jeremy Lumby Feb. 3, 2021

Feb. 3, 2021

If anyone has large amounts of traffic that they are primarily moving from Minneapolis to Seattle please reach out to me off list. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com

1 0

SFN 20G LAG Upgrade
by Jay Hanke Feb. 2, 2021

Feb. 2, 2021

Please allocate Eth14 on the SFN Remote Switch to South Front Networks Eth14 and Eth2 will be LAGed to create a 20G port channel. The new port channel interface will be Po1 on the remote. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

1 0

US Internet Maintenance - February 22/23
by Justin Krejci Jan. 28, 2021

Jan. 28, 2021

US Internet (AS10242) will be performing some network maintenance (primarily router reboots for updates) that will cause our IX connection and all router BGP sessions to drop. We intend to shift traffic away beforehand to be as graceful as possible. The event should be between FROM: Monday, February 22th at 11pm (CST) TO: Tuesday, February 23th at 6am (CST) We've reserved the following day (same times) as a backup date as well. FROM: Tuesday, February 23th at 11pm (CST) TO: Wednesday, February 24th at 6am (CST) Justin Krejci Network Engineer 952.253.3200 12450 Wayzata Blvd. Suite 320 | Minnetonka, MN 55305

1 0

eBGP- Google AS15169 v4+v6 peers
by Nick Twite Jan. 28, 2021

Jan. 28, 2021

Good afternoon, I am reaching out because we had a our Google peerings drop this afternoon approximately 1:45pm to 2:10 CST. They have since re-established and routes are again being shared. Just looking if anyone else experienced the same or has any details to share I would appreciate it. RP/0/RSP0/CPU0:Jan 28 13:43:59.242 CST: bgp[1020]: %ROUTING-BGP-5-ADJCHANGE_DETAIL : neighbor 206.108.255.141 Down - BGP Notification sent, hold time expired (VRF: default; AFI/SAFI: 1/1) (AS: 15169) RP/0/RSP0/CPU0:Jan 28 13:44:11.705 CST: bgp[1020]: %ROUTING-BGP-5-ADJCHANGE_DETAIL : neighbor 2001:504:27::3b41:0:1 Down - BGP Notification sent, hold time expired (VRF: default; AFI/SAFI: 2/1) (AS: 15169) RP/0/RSP0/CPU0:Jan 28 14:10:39.427 CST: bgp[1020]: %ROUTING-BGP-5-ADJCHANGE_DETAIL : neighbor 206.108.255.141 Up (VRF: default; AFI/SAFI: 1/1) (AS: 15169) RP/0/RSP0/CPU0:Jan 28 14:10:48.019 CST: bgp[1020]: %ROUTING-BGP-5-ADJCHANGE_DETAIL : neighbor 2001:504:27::3b41:0:1 Up (VRF: default; AFI/SAFI: 2/1) (AS: 15169) Thanks Nick Twite Network Operations Specialist [cid:image001.png@01D6F584.3D31CB50] 507-429-0135 Work Cell 507-896-6229 Desk ntwite(a)AcenTek.net<mailto:ntwite@AcenTek.net> www.AcenTek.net

3 3

Router12 MICE Port Move
by Jay Hanke Jan. 27, 2021

Jan. 27, 2021

Router12 has moved to port Ethernet13 on the SFN remote. All IP address information remains the same. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

1 0

CS Tech Upgrade 1x10G to 2x10G
by Jay Hanke Jan. 19, 2021

Jan. 19, 2021

CS Tech has completed an upgrade to 2x10G LAG on the SFN Albert Lea Remote Port Channel 3 members -Ethernet7 -Ethernet11 All IP information remains the same. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

1 0

Fibernet Port Augment
by Jay Hanke Jan. 15, 2021

Jan. 15, 2021

Please add port Ethernet24 to the existing Fibernet LAG. Thanks! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

1 0

Please welcome Key Cooperative to MICE!
by Jay Hanke Jan. 13, 2021

Jan. 13, 2021

Name: Key Cooperative Port: MN VoIP 10G Ethernet25 ASN: 40350 IPv4: 206.108.255.172/24 IPv6: 2001:504:27::9d9e:0:1/64 Peering Contact: dl-peering(a)keycoop.com Route Servers- YES BFD: No Welcome aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

2 1

Google MICE Issues
by Jay Hanke Jan. 12, 2021

Jan. 12, 2021

Google is currently having issues with their circuit to MICE from Chicago and has disabled traffic during troubleshooting. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

1 0

Iowa Fiber Cut
by Jay Hanke Jan. 11, 2021

Jan. 11, 2021

There is a third party fiber cut in Cedar Rapids, IA affecting several members MICE connections. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

1 0

Google Ports to MICE
by Dave Schwartz Jan. 11, 2021

Jan. 11, 2021

Hello MICE Members I hope this message finds you well. We have heard from a number of MICE members about congestion on Google's port to MICE so I wanted to provide a brief update to our peers on what our plans are. We are aware of the congestion on our current 100G port to MICE and started planning for a 2nd 100G port back in Q3 of 2020. For those of you not aware, the Google router that is connected to MICE is located in Chicago and we use a third party vendor to reach the MICE switch. We have been experiencing long delays with our vendor for our 2nd 100G wave and currently plan to have the 2nd 100G up at MICE in early February. This 2nd 100G link will be on a diverse Google router with a separate IP and plan to peer with the route server on this new link. While our port is congested you may see traffic inbound to your network on indirect paths. While we attempt to deliver all traffic directly, we can't offer any guarantee on where traffic will come from during congestion. If you happen to experience quality problems with any Google service over MICE during this congestion please do report these product specific issues to noc(a)google.com so we can investigate. Our CDN is normally able to handle congestion so we would like to be aware if any members are experiencing any degradation of Google services. Many Thanks, Dave -- Dave Schwartz Customer Engineering Manager Network Specialist Team Google Cloud Platform daveschwartz(a)google.com +1-424-625-9129

2 1

FW: [outages] High packet loss on Spectrum in Southern Minnesota
by Frank Bulk Jan. 6, 2021

Jan. 6, 2021

Cross-posting as this may interest some in this group. Frank From: Outages <outages-bounces(a)outages.org> On Behalf Of Abhi Devireddy via Outages Sent: Wednesday, January 6, 2021 3:46 PM To: Outages(a)outages.org; Goli, Matthew W. <Matthew.Goli(a)waupacafoundry.com> Subject: Re: [outages] High packet loss on Spectrum in Southern Minnesota Update: It's a backbone fiber between MN and WI that was impacted in Mazomanie, WI and Duluth, MN. Teams were dispatched and one's arrived on site. Still no confirmed ETR. Abhi ________________________________ From: Outages <outages-bounces(a)outages.org<mailto:outages-bounces@outages.org>> on behalf of Goli, Matthew W. via Outages <outages(a)outages.org<mailto:outages@outages.org>> Sent: Wednesday, January 6, 2021 2:36 PM To: Outages(a)outages.org<mailto:Outages@outages.org> <Outages(a)outages.org<mailto:Outages@outages.org>> Subject: Re: [outages] High packet loss on Spectrum in Southern Minnesota Hello, We're in central Wisconsin and we're impacted by this outage. Just received communication from Spectrum stating there is a confirmed fiber cut. Fiber recovery teams have been engaged but there is no ETR at this time. From: Outages <outages-bounces(a)outages.org<mailto:outages-bounces@outages.org>> On Behalf Of John Knutson via Outages Sent: Wednesday, January 6, 2021 2:29 PM To: Abhi Devireddy <abhi(a)devireddy.com<mailto:abhi@devireddy.com>> Cc: outages(a)outages.org<mailto:outages@outages.org> Subject: Re: [outages] High packet loss on Spectrum in Southern Minnesota CAUTION!! This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe. I've got a coworker in Elk River, MN who has no connectivity. I am on Spectrum in Dayton, MN about 10 miles south of that and mine has been working fine so far. Both are residential cable connections. On Wed, Jan 6, 2021 at 1:36 PM Abhi Devireddy via Outages <outages(a)outages.org<mailto:outages@outages.org>> wrote: No v4/v6 connectivity in Northern MN. Looks like our peering traffic with them dropped to zero as well. Abhi ________________________________ From: Outages <outages-bounces(a)outages.org<mailto:outages-bounces@outages.org>> on behalf of Nathan Engelhardt via Outages <outages(a)outages.org<mailto:outages@outages.org>> Sent: Wednesday, January 6, 2021 12:56 PM To: outages(a)outages.org<mailto:outages@outages.org> <outages(a)outages.org<mailto:outages@outages.org>> Subject: Re: [outages] High packet loss on Spectrum in Southern Minnesota Update/additional info: Losses are only occurring over IPv4. IPv6 is performing normally, for what it's worth. From: Outages <outages-bounces(a)outages.org<mailto:outages-bounces@outages.org>> On Behalf Of Nathan Engelhardt via Outages Sent: Wednesday, January 6, 2021 12:45 PM To: outages(a)outages.org<mailto:outages@outages.org> Subject: [outages] High packet loss on Spectrum in Southern Minnesota A few of my coworkers and I, all WFH and on Spectrum, are seeing high packet loss. South-Central Minnesota. _______________________________________________ Outages mailing list Outages(a)outages.org<mailto:Outages@outages.org> https://puck.nether.net/mailman/listinfo/outages [puck.nether.net]<https://urldefense.proofpoint.com/v2/url?u=https-3A__puck.nether.net_mailma…> CONFIDENTIALITY AND LEGAL NOTICE This electronic mail transmission is confidential, may be privileged and should be read or retained only by the intended recipient. If the reader of this transmission is not the intended recipient, you are hereby notified that any distribution or copying hereof is strictly prohibited. If you have received this transmission in error, please immediately notify the sender and remove it from your system. E-mail is not necessarily a secure communication method, therefore the sender shall not be responsible for any changes that occur during its transfer. All e-mails are scanned for viruses, however, files attached to this e-mail may contain viruses that could harm the systems of the recipient. Any opinions expressed in this email must be confirmed in writing and signed by the sender to have legal validity.

1 0

config assistance?
by James Urwiller Dec. 30, 2020

Dec. 30, 2020

Greetings all, Last night I cutover to a new Arista for BGP services facing MICE and a few other peers. All my other peers are up and functioning properly, but I cannot reach any of the MICE peers. Since I am connected to the Zayo remote switch in Belle Plaine, I had Zayo bounce my port thinking it was a mac-limit issue. Even before they did this, I can see MICE peers in ARP and in the MAC-Table, but I cant ping any of them, like the traffic is filtered in one direction. Zayo’s port bouncing had no effect. Any ideas Arista/MICE guru’s? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com

4 9

Global Net (AS395466) - Upcoming Maintenance 12/28/20
by Global Net NOC Dec. 22, 2020

Dec. 22, 2020

MICEMN Members - We have a maintenance window scheduled for Monday, December 28th to replace our MICE facing router. BGP sessions will be gracefully shutdown prior to the work. In the event of a failed swap we will be reverting to our current hardware. Start: 12/28/20 1115 GMT End: 12/28/20 1300 GMT ASN: 395466 Speed: 10G IPv4: 206.108.255.97 IPv6: 2001:504:27:0:6:08ca::1 Thanks, Global Net NOC noc(a)theglobal.net Global Net Peering peering(a)theglobal.net

1 0

SFN MICE Remote Switch work
by Jay Hanke Dec. 5, 2020

Dec. 5, 2020

We will be upgrading the backhaul of the SFN remote switch to 100G at Midnight. There may be some brief packet loss when we disable the existing LAG group. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

1 0

OmniTech (AS54821) MICE Port Move
by Jay Hanke Dec. 4, 2020

Dec. 4, 2020

OmniTech has been moved from the Zayo Remote switch to SFN Remote switch port Ethernet10. All IP/ASN information remains the same. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

1 0

AS34962 AS Change
by Austin Gillmann Dec. 2, 2020

Dec. 2, 2020

Hi all, We recently decided to split our hosting into a subsidiary known as IP Volume to better market our hosting services. All sessions including the IX route server have been updated to the new AS and we are awaiting your connection. If you have any questions feel free to contact me. We appreciate your continued support and wish you all the best!

2 2

RS3 Route server
by Jay Hanke Dec. 1, 2020

Dec. 1, 2020

Connectivity to the MICE test route server (RS3) took a 5 minute hit about 2110 hrs. Connectivity has been restored. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

1 0

MICE Blackhole IP Allocation
by Jay Hanke Nov. 22, 2020

Nov. 22, 2020

The following IP addresses have been allocated for the upcoming blackhole project on the MICE Internet Exchange. MICE-BH IPv4: 206.108.255.228/24 IPv6: 2001:504:27::6666:dead:beef/64 We will be using 66:66:de:ad:be:ef as the mac-address and inject the arp entry from a virtual machine on the SFN-Remote until a permanent solution on the main switch is worked out. Thanks! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

2 3

Update PTR
by Frank Bulk Nov. 20, 2020

Nov. 20, 2020

Premier is no longer a part of MICE. Can the PTR for 206.108.255.67 be updated so that it doesn't list AS53347.micemn.net? Thanks, Frank

2 2

PeeringDB Audit Emails
by Jay Hanke Nov. 18, 2020

Nov. 18, 2020

I've gotten several emails from MICE members about IX-F export issues on PeeringDB. MICE provides a list of port/peering information to PeeringDB in JSON format and they started auditing against what users have entered into the site. The export is generated from our IXP Manager platform we deployed a couple months ago. The most common mismatch is the user not having the IPv6 address loaded in PeeringDB. MICE allocates an IPv6 address with every IPv4 allocation. [insert ipv6 pitch here] Members on the Zayo Remote switch in Belle Plaine are currently not currently included in the export. There is an issue with loading the ports into IXP manager and we need an admin at Zayo to make a couple of routing/snmp changes. All of the other switches were completed and loaded several months ago. If someone has a good contact at Zayo for this please let me know. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

2 3

IPv6 BGP Peering to Netflix bouncing 60+ days
by Jesse Reed Nov. 18, 2020

Nov. 18, 2020

All: We have been tracking our IPv6 peering via our MICE path to Netflix and noticed it bouncing consistently since at least September (probably longer). All other peerings on this path (both v4 and v6) have been stable and are not experiencing these drops. Is anyone else in the group experiencing similar drops to their IPv6 only peerings w/Netflix? The peer that we see this occurring w/is: 2001:504:27::b5a:0:1 Thanks so much ahead of time, Jesse

1 0

SFN Remote Switch Backhaul Upgrade
by Jay Hanke Nov. 13, 2020

Nov. 13, 2020

Please allocate Ethernet1/1 on the MN VoIP 100G remote switch for a new SFN remote uplink. When completed the link from the SFN Remote switch will increase from 40G to 100G. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

1 0

Nuvera Upgrade to 1x4x10G
by Jay Hanke Nov. 12, 2020

Nov. 12, 2020

Please allocate and add the following ports to the existing Nuvera LAG group. Ethernet4/14 Ethernet5/14 The new group will be 4x10G -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

2 1

MN VoIP Remote Switch Upgrade
by Jay Hanke Oct. 27, 2020

Oct. 27, 2020

Port Ethernet6/6/1 on the main switch has been allocated to MN VoIP. The port will be in a LAG configuration with their existing 100G port for a total of 2x100G IP addresses will remain the same. Welcome aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

1 0