- mice-discuss - lists.micemn.net

Re: 100G Linecard EMERGENCY MAINTENANCE
by Jeremy Lumby April 16, 2020

April 16, 2020

Everything should be back to normal now Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> Date: 4/16/20 6:02 PM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE _____ >From : James Urwiller [james.urwiller(a)TURNKEY-TELECOM.COM] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Thursday, April 16 2020 17:22:43 Hows it lookin? Looks like my peers are back up. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com -----Original Message----- From: MICE Discuss On Behalf Of Jeremy Lumby Sent: Thursday, April 16, 2020 16:14 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE Sorry guys, I am running a bit behind, so this will end up being closer to 5PM anyway... -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Thursday, April 16, 2020 11:10 AM To: MICE Discuss Subject: RE: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE It is the MICE core. I would be willing to move it to 5PM CDT, however I would want the board to give their blessing since it was already announced for 4PM -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Thursday, April 16, 2020 11:07 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE This is on the mice core? Or the USInternet switch.. are they one in the same? Im confused. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com -----Original Message----- From: MICE Discuss On Behalf Of Jeremy Lumby Sent: Thursday, April 16, 2020 11:01 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE Correct, any port number starting with 3/ is on the card. -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Gary Glissendorf Sent: Thursday, April 16, 2020 10:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE Jermey which card is the 100G. is it slot 3 Gary Glissendorf | Network Architect gary.glissendorf(a)sdncommunications.com -----Original Message----- From: MICE Discuss On Behalf Of Jeremy Lumby Sent: Wednesday, April 15, 2020 5:56 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE CAUTION: This email originated from outside of SDN Communications. Exercise caution when opening attachments or clicking links, especially from unknown senders. In troubleshooting the 100G line card, Arista has requested that the line card be power cycled. Being that there is a possibility that the line card would not recover from a restart, I am working with Dave @ the UofM to have a spare available in the event that the card fails to restart. I plan on blocking BGP to all ports on the card before restarting the card. Based on the current state of the card, I am unsure that it will block BGP properly. I plan on restarting the card tomorrow at 4PM CDT. In the past I have noticed that the 100G cards take a long time to boot up, so I would anticipate a minimum of 15 minutes of downtime if everything goes perfectly. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Wednesday, April 15, 2020 4:18 PM To: MICE Discuss Subject: 100G Linecard I wanted to let everyone know that we are experiencing an issue with the 100G linecard on the MICE Arista core switch. The card is currently outputting errors and not detecting new optics. I am currently working with Arista to troubleshoot the issue. At the moment any 100G upgrades would need to be on hold until the issue is resolved. All established connections seem to be working fine. I will report back as soon as I have more information. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com ***This message and any attachments are solely for the intended recipient. If you are not the intended recipient, disclosure, copying, use or distribution of the information included in this message is prohibited -- Please immediately and permanently delete.***

1 0

Savage Communications Upgrade
by Jay Hanke April 16, 2020

April 16, 2020

Savage Communications is upgrading from 1x10G to 2x10G LAG. Please allocate Ethernet 5/33 on the Main switch. This will require a new LAG and then their existing port (4/33) will be migrated into the LAG. Welcome Aboard (again). -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

4 3

SDN Upgrade
by Jay Hanke April 15, 2020

April 15, 2020

SDN will be upgrading their existing LAG configuration to 1x100G. The new port assignment on the main switch is Ethernet3/23/1. Welcome aboard again! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

1 0

Port was down
by Todd Mueller April 14, 2020

April 14, 2020

Our (Velocity Telephone) MICE port physically went down at 10:06A and came back up at 2:31P today. Anyone aware of maintenance or anything else? Thanks! Todd

2 2

Giga Pop Additional MICE Connection
by Jay Hanke April 7, 2020

April 7, 2020

The UofM Gigapop will be adding an additional connection to MICE via the new WiscNet Remote Switch. Name: University of Minnesota Port: WiscNet Remote Switch ASN: 57 IPv4: 206.108.255.162/24 IPv6: 2001:504:27:0:0:0039::3/64 Route Server: Yes BFD: Yes Please report back the port assignments for our records. Welcome aboard again! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

1 0

Blackhole IP if needed?
by Frank Bulk April 6, 2020

April 6, 2020

One our IPs, 96.31.13.225, was on the receiving end of a volumetric DoS attack for about 20 minutes and some of the incoming traffic was going over our MICE link. Do the MICE admins have a way to blackhole our IP, if needed? Frank Premier Communications (AS53347) FiberNet Communications (AS18883)

3 6

Zayo outage in the metro?
by Dean Bahls April 4, 2020

April 4, 2020

Anyone know of an outage that Zayo has been experiencing in the Metro area since about 10:30pm last night? We've found that it was a planned maintenance that nobody had been notified about. I don't know if it affects other systems (like Ethernet or dark fiber), but toll services using Intelliquent (Onvoy) have been down since that time and nobody has gotten any updates about this thing. Thanks for any info you can share! Dean Dean Bahls Network Services Manager | Cooperative Network Services, LLC 14 Main St SW | PO Box J | Menahga, MN 56464 218.346.3635 (Direct) | 218.564.3000 (Main Office) dean.bahls(a)cooperative-networks.com <mailto:dean.bahls@cooperative-networks.com>

2 1

Wiscnet Remote Switch
by Jay Hanke April 3, 2020

April 3, 2020

Please allocate port Ethernet 3/22/1 on the Main Switch for the new Wiscnet Remote switch. Please configure the port as a single member LAG group and the port security settings for a remote switch. Welcome Aboard Again! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

3 2

BGP alerts about AS 53740 (OPTBIT)
by Frank Bulk March 30, 2020

March 30, 2020

Curious if anyone can make sense of this alert from QRator. Are they suggesting OPTBIT is advertising MICE's /24? I've seen this come and go since Sunday night at 10:09 pm Central. Frank From: Radar by Qrator <no-reply(a)qrator.net> Sent: Monday, March 30, 2020 2:49 AM Subject: [BGP ALERT] [HIGH] <AS18883> Created Hijacks Time: 30.03.2020 07:42:00 UTC Created Hijacks New IPv4 incidents: Target Prefix Target ASN Affected prefix Affected ASN Severity Propagation 206.108.255.0/24<https://radar.qrator.net/as18883/graph#206.108.255.0/24> 18883 (FIBERNET-NETWORK-OPERATIONS-CENTER)<https://radar.qrator.net/as18883> 206.108.255.0/24<https://radar.qrator.net/as53740/graph#206.108.255.0/24> 53740 (OPTBIT)<https://radar.qrator.net/as53740> High 1 AS Names involved in the incident: AS18883 (FIBERNET-NETWORK-OPERATIONS-CENTER), AS53740 (OPTBIT) Active IPv4 incident count: 16 Radar by Qrator<https://radar.qrator.net>

5 6

Cloudflare Route Server Update
by Jay Hanke March 27, 2020

March 27, 2020

Please update Cloudflare's Route Server entry to Partial on the MICE participants page. Per Cloudflare anycast routes are not available via the route servers and require a bilateral connection. Thanks! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

2 1