April 2020 - mice-discuss - lists.micemn.net

Thanks, Cloudflare!

by Mike Horwath

Without further comment: https://arstechnica.com/?p=1669279 -- Mike Horwath, reachable via drechsau(a)Geeks.ORG

April 19, 2020

OneNetGlobal 10G Upgrade

by Jay Hanke

OneNet Global is upgrading their 1G Connection to 10G. The new 10G port is Ethernet4/27 on the main switch. Welcome aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

April 18, 2020

Fwd: [arin-announce] Upcoming Web-Based Internet Routing Registry Deployment

by David Farmer

FYI, This should simplify things for many of you to get your prefixes into the IRR. ---------- Forwarded message --------- From: ARIN <info(a)arin.net> Date: Fri, Apr 17, 2020 at 1:31 PM Subject: [arin-announce] Upcoming Web-Based Internet Routing Registry Deployment To: <arin-announce(a)arin.net> On 17 March 2020, we notified our community via a blog post on TeamARIN that we were in the process of developing a new web-based Internet Routing Registry (IRR). That blog post can be read at the following link: https://teamarin.net/2020/03/17/making-progress-on-arins-new-web-based-irr/ Now, we are pleased to announce that the initial deployment of this new web-based IRR will occur on or around 10 June 2020. This deployment will provide core functionality to create, edit, and delete IRR objects via ARIN Online. The existing IRR-email interface will continue to function; however, when your organization begins using the web-based IRR, you will lose access to the email interface. For that reason, if your organization would like to retain access to the email interface, please do not make any changes to IRR objects using ARIN Online. As part of this deployment, ARIN will analyze data in the current IRR before migration and objects will be placed into two categories: * Objects that were created by the authorized organization and meet all ARIN requirements will be migrated to the new system and placed in an authorized dataset (“ARIN-AUTH”). They can be managed in either ARIN Online or via email templates. (Note that using ARIN Online the first time to manage these objects will permanently disallow future changes using email templates.) * Objects that cannot be verified will still be migrated, but placed into a non-authorized (“ARIN-NONAUTH”) dataset. These objects can be managed only by using email templates or by creating a Help Desk Ticket using the Ask ARIN feature in ARIN Online. Users who get routing data from ARIN’s IRR will need to make some changes when connecting to our two Near Real Time Monitoring (NRTM) streams: ARIN-AUTH and ARIN-NONAUTH. Port 43 whois queries to rr.arin.net will still be accepted and return both authorized and unauthorized objects. More information will be provided in later updates. Best regards, John Sweeting Chief Customer Officer American Registry for Internet Numbers (ARIN) _______________________________________________ ARIN-Announce You are receiving this message because you are subscribed to the ARIN Announce Mailing List (ARIN-announce(a)arin.net) Unsubscribe or manage your mailing list subscription at: https://lists.arin.net/mailman/listinfo/arin-announce Please contact info(a)arin.net if you experience any issues. -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

April 17, 2020

Re: 100G Linecard EMERGENCY MAINTENANCE

by Jeremy Lumby

We did not have any evidence of established traffic being impacted by the line card issue. The issue was more that it had problems that were filling up the storage, and it would not detect new optics. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Jeff Wilde Sent: Thursday, April 16, 2020 6:20 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE Could this possibly have caused traffic anomalies? I’m talking about the bad card, but I’m guessing not. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Thursday, April 16, 2020 5:47 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE The main reason is because mice is 100% volunteer and it is difficult to get volunteers to come in in the middle of the night Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: Ryan Malek <rmalek(a)ROUTER12.NET> Date: 4/16/20 5:43 PM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE >From : Ryan Malek [rmalek(a)ROUTER12.NET] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Thursday, April 16 2020 17:43:42 I hope this isn't a stupid question... but why was this done at 5PM? I found out in a very brutal manner that something is wrong with my BGP set up... Ryan Malek - Router12 Networks LLC Internet, Phone, and Hosted Services Ph. 641.420.7180 On 4/16/2020 5:29 PM, Jeremy Lumby wrote: The maintenance has completed, and everything appears to be returning to normal. -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Thursday, April 16, 2020 4:14 PM To: MICE Discuss Subject: RE: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE Sorry guys, I am running a bit behind, so this will end up being closer to 5PM anyway... -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Thursday, April 16, 2020 11:10 AM To: MICE Discuss Subject: RE: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE It is the MICE core. I would be willing to move it to 5PM CDT, however I would want the board to give their blessing since it was already announced for 4PM -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Thursday, April 16, 2020 11:07 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE This is on the mice core? Or the USInternet switch.. are they one in the same? Im confused. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Thursday, April 16, 2020 11:01 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE Correct, any port number starting with 3/ is on the card. -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Gary Glissendorf Sent: Thursday, April 16, 2020 10:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE Jermey which card is the 100G. is it slot 3 Gary Glissendorf | Network Architect gary.glissendorf(a)sdncommunications.com -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Wednesday, April 15, 2020 5:56 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE <table style="border:1px; border-style:solid; border-color:#ac6337; background-color:#ffeb9c"><tr><td><font size=2 face=calibri>CAUTION: This email originated from outside of SDN Communications. Exercise caution when opening attachments or clicking links, especially from unknown senders.</font></td></tr></table><br> In troubleshooting the 100G line card, Arista has requested that the line card be power cycled. Being that there is a possibility that the line card would not recover from a restart, I am working with Dave @ the UofM to have a spare available in the event that the card fails to restart. I plan on blocking BGP to all ports on the card before restarting the card. Based on the current state of the card, I am unsure that it will block BGP properly. I plan on restarting the card tomorrow at 4PM CDT. In the past I have noticed that the 100G cards take a long time to boot up, so I would anticipate a minimum of 15 minutes of downtime if everything goes perfectly. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Wednesday, April 15, 2020 4:18 PM To: MICE Discuss Subject: 100G Linecard I wanted to let everyone know that we are experiencing an issue with the 100G linecard on the MICE Arista core switch. The card is currently outputting errors and not detecting new optics. I am currently working with Arista to troubleshoot the issue. At the moment any 100G upgrades would need to be on hold until the issue is resolved. All established connections seem to be working fine. I will report back as soon as I have more information. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com ***This message and any attachments are solely for the intended recipient. If you are not the intended recipient, disclosure, copying, use or distribution of the information included in this message is prohibited -- Please immediately and permanently delete.*** To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

April 17, 2020

Re: 100G Linecard EMERGENCY MAINTENANCE

by Jeff Wilde

Could this possibly have caused traffic anomalies? I’m talking about the bad card, but I’m guessing not. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Thursday, April 16, 2020 5:47 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE The main reason is because mice is 100% volunteer and it is difficult to get volunteers to come in in the middle of the night Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com> -------- Original message -------- From: Ryan Malek <rmalek(a)ROUTER12.NET<mailto:rmalek@ROUTER12.NET>> Date: 4/16/20 5:43 PM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE ________________________________ From : Ryan Malek [rmalek(a)ROUTER12.NET] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Thursday, April 16 2020 17:43:42 I hope this isn't a stupid question... but why was this done at 5PM? I found out in a very brutal manner that something is wrong with my BGP set up... ________________________________ Ryan Malek - Router12 Networks LLC Internet, Phone, and Hosted Services Ph. 641.420.7180 On 4/16/2020 5:29 PM, Jeremy Lumby wrote: The maintenance has completed, and everything appears to be returning to normal. -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Thursday, April 16, 2020 4:14 PM To: MICE Discuss Subject: RE: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE Sorry guys, I am running a bit behind, so this will end up being closer to 5PM anyway... -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Thursday, April 16, 2020 11:10 AM To: MICE Discuss Subject: RE: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE It is the MICE core. I would be willing to move it to 5PM CDT, however I would want the board to give their blessing since it was already announced for 4PM -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Thursday, April 16, 2020 11:07 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE This is on the mice core? Or the USInternet switch.. are they one in the same? Im confused. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET><mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Thursday, April 16, 2020 11:01 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE Correct, any port number starting with 3/ is on the card. -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Gary Glissendorf Sent: Thursday, April 16, 2020 10:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE Jermey which card is the 100G. is it slot 3 Gary Glissendorf | Network Architect gary.glissendorf(a)sdncommunications.com<mailto:gary.glissendorf@sdncommunications.com> -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET><mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Wednesday, April 15, 2020 5:56 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE <table style="border:1px; border-style:solid; border-color:#ac6337; background-color:#ffeb9c"><tr><td><font size=2 face=calibri>CAUTION: This email originated from outside of SDN Communications. Exercise caution when opening attachments or clicking links, especially from unknown senders.</font></td></tr></table><br> In troubleshooting the 100G line card, Arista has requested that the line card be power cycled. Being that there is a possibility that the line card would not recover from a restart, I am working with Dave @ the UofM to have a spare available in the event that the card fails to restart. I plan on blocking BGP to all ports on the card before restarting the card. Based on the current state of the card, I am unsure that it will block BGP properly. I plan on restarting the card tomorrow at 4PM CDT. In the past I have noticed that the 100G cards take a long time to boot up, so I would anticipate a minimum of 15 minutes of downtime if everything goes perfectly. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com> -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Wednesday, April 15, 2020 4:18 PM To: MICE Discuss Subject: 100G Linecard I wanted to let everyone know that we are experiencing an issue with the 100G linecard on the MICE Arista core switch. The card is currently outputting errors and not detecting new optics. I am currently working with Arista to troubleshoot the issue. At the moment any 100G upgrades would need to be on hold until the issue is resolved. All established connections seem to be working fine. I will report back as soon as I have more information. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com> ***This message and any attachments are solely for the intended recipient. If you are not the intended recipient, disclosure, copying, use or distribution of the information included in this message is prohibited -- Please immediately and permanently delete.*** ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

April 16, 2020

Re: 100G Linecard EMERGENCY MAINTENANCE

by David Farmer

The GigaPoP and the University are in good shape, I shutdown our peers down about 4:00 and brought them back about 5:40. Traffic levels are back to about where they should be for this time of day. Thanks On Thu, Apr 16, 2020 at 6:03 PM James Urwiller < james.urwiller(a)turnkey-telecom.com> wrote: > Hows it lookin? Looks like my peers are back up. > > James Urwiller > Network Architect > Stealth Broadband > james.urwiller(a)stealthbroadband.com > > > -----Original Message----- > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy > Lumby > Sent: Thursday, April 16, 2020 16:14 > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE > > Sorry guys, I am running a bit behind, so this will end up being closer to > 5PM anyway... > > -----Original Message----- > From: Jeremy Lumby [mailto:jlumby@mnvoip.com] > Sent: Thursday, April 16, 2020 11:10 AM > To: MICE Discuss > Subject: RE: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE > > It is the MICE core. I would be willing to move it to 5PM CDT, however I > would want the board to give their blessing since it was already announced > for 4PM > > -----Original Message----- > From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of > James Urwiller > Sent: Thursday, April 16, 2020 11:07 AM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE > > This is on the mice core? Or the USInternet switch.. are they one in the > same? Im confused. > > James Urwiller > Network Architect > Stealth Broadband > james.urwiller(a)stealthbroadband.com > > > -----Original Message----- > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy > Lumby > Sent: Thursday, April 16, 2020 11:01 > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE > > Correct, any port number starting with 3/ is on the card. > > -----Original Message----- > From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of > Gary > Glissendorf > Sent: Thursday, April 16, 2020 10:58 AM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE > > Jermey which card is the 100G. is it slot 3 > > > Gary Glissendorf | Network Architect > gary.glissendorf(a)sdncommunications.com > > -----Original Message----- > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy > Lumby > Sent: Wednesday, April 15, 2020 5:56 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE > > <table style="border:1px; border-style:solid; border-color:#ac6337; > background-color:#ffeb9c"><tr><td><font size=2 face=calibri>CAUTION: This > email originated from outside of SDN Communications. Exercise caution when > opening attachments or clicking links, especially from unknown > senders.</font></td></tr></table><br> > > In troubleshooting the 100G line card, Arista has requested that the line > card be power cycled. Being that there is a possibility that the line card > would not recover from a restart, I am working with Dave @ the UofM to have > a spare available in the event that the card fails to restart. I plan on > blocking BGP to all ports on the card before restarting the card. > Based on the current state of the card, I am unsure that it will block BGP > properly. I plan on restarting the card tomorrow at 4PM CDT. In the past > I > have noticed that the 100G cards take a long time to boot up, so I would > anticipate a minimum of 15 minutes of downtime if everything goes > perfectly. > > Jeremy Lumby > Minnesota VoIP > 9217 17th Ave S #216 > Bloomington, MN 55425 > M: 612-355-7740 > D: 612-392-6814 > F: 952-873-7425 > jlumby(a)mnvoip.com > > > > -----Original Message----- > From: Jeremy Lumby [mailto:jlumby@mnvoip.com] > Sent: Wednesday, April 15, 2020 4:18 PM > To: MICE Discuss > Subject: 100G Linecard > > I wanted to let everyone know that we are experiencing an issue with the > 100G linecard on the MICE Arista core switch. The card is currently > outputting errors and not detecting new optics. I am currently working > with > Arista to troubleshoot the issue. At the moment any 100G upgrades would > need to be on hold until the issue is resolved. All established > connections > seem to be working fine. I will report back as soon as I have more > information. > > Jeremy Lumby > Minnesota VoIP > 9217 17th Ave S #216 > Bloomington, MN 55425 > M: 612-355-7740 > D: 612-392-6814 > F: 952-873-7425 > jlumby(a)mnvoip.com > ***This message and any attachments are solely for the intended recipient. > If you are not the intended recipient, disclosure, copying, use or > distribution of the information included in this message is prohibited -- > Please immediately and permanently delete.*** > -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

April 16, 2020

Re: 100G Linecard EMERGENCY MAINTENANCE

by Jeremy Lumby

Everything should be back to normal now Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> Date: 4/16/20 6:02 PM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE _____ >From : James Urwiller [james.urwiller(a)TURNKEY-TELECOM.COM] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Thursday, April 16 2020 17:22:43 Hows it lookin? Looks like my peers are back up. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com -----Original Message----- From: MICE Discuss On Behalf Of Jeremy Lumby Sent: Thursday, April 16, 2020 16:14 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE Sorry guys, I am running a bit behind, so this will end up being closer to 5PM anyway... -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Thursday, April 16, 2020 11:10 AM To: MICE Discuss Subject: RE: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE It is the MICE core. I would be willing to move it to 5PM CDT, however I would want the board to give their blessing since it was already announced for 4PM -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Thursday, April 16, 2020 11:07 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE This is on the mice core? Or the USInternet switch.. are they one in the same? Im confused. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com -----Original Message----- From: MICE Discuss On Behalf Of Jeremy Lumby Sent: Thursday, April 16, 2020 11:01 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE Correct, any port number starting with 3/ is on the card. -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Gary Glissendorf Sent: Thursday, April 16, 2020 10:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE Jermey which card is the 100G. is it slot 3 Gary Glissendorf | Network Architect gary.glissendorf(a)sdncommunications.com -----Original Message----- From: MICE Discuss On Behalf Of Jeremy Lumby Sent: Wednesday, April 15, 2020 5:56 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE CAUTION: This email originated from outside of SDN Communications. Exercise caution when opening attachments or clicking links, especially from unknown senders. In troubleshooting the 100G line card, Arista has requested that the line card be power cycled. Being that there is a possibility that the line card would not recover from a restart, I am working with Dave @ the UofM to have a spare available in the event that the card fails to restart. I plan on blocking BGP to all ports on the card before restarting the card. Based on the current state of the card, I am unsure that it will block BGP properly. I plan on restarting the card tomorrow at 4PM CDT. In the past I have noticed that the 100G cards take a long time to boot up, so I would anticipate a minimum of 15 minutes of downtime if everything goes perfectly. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Wednesday, April 15, 2020 4:18 PM To: MICE Discuss Subject: 100G Linecard I wanted to let everyone know that we are experiencing an issue with the 100G linecard on the MICE Arista core switch. The card is currently outputting errors and not detecting new optics. I am currently working with Arista to troubleshoot the issue. At the moment any 100G upgrades would need to be on hold until the issue is resolved. All established connections seem to be working fine. I will report back as soon as I have more information. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com ***This message and any attachments are solely for the intended recipient. If you are not the intended recipient, disclosure, copying, use or distribution of the information included in this message is prohibited -- Please immediately and permanently delete.***

April 16, 2020

Re: 100G Linecard EMERGENCY MAINTENANCE

by Ryan Malek

That's a pretty good reason... I'll fix my BGP. ------------------------------------------------------------------------ Ryan Malek - Router12 Networks LLC Internet, Phone, and Hosted Services Ph. 641.420.7180 On 4/16/2020 5:47 PM, Jeremy Lumby wrote: > The main reason is because mice is 100% volunteer and it is difficult > to get volunteers to come in in the middle of the night > > > > Jeremy Lumby > Minnesota VoIP > 9217 17th Ave S > Suite 216 > Bloomington MN 55425 > Main 612-355-7740 > Direct 612-392-6814 > EFax 952-873-7425 > jlumby(a)mnvoip.com > > > > -------- Original message -------- > From: Ryan Malek <rmalek(a)ROUTER12.NET> > Date: 4/16/20 5:43 PM (GMT-06:00) > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE > > ------------------------------------------------------------------------ > From : Ryan Malek [rmalek(a)ROUTER12.NET] > To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] > Date : Thursday, April 16 2020 17:43:42 > > I hope this isn't a stupid question... but why was this done at 5PM? > > I found out in a very brutal manner that something is wrong with my > BGP set up... > > > ------------------------------------------------------------------------ > Ryan Malek - Router12 Networks LLC > Internet, Phone, and Hosted Services > > Ph. 641.420.7180 > On 4/16/2020 5:29 PM, Jeremy Lumby wrote: >> The maintenance has completed, and everything appears to be returning to normal. >> >> -----Original Message----- >> From: Jeremy Lumby [mailto:jlumby@mnvoip.com] >> Sent: Thursday, April 16, 2020 4:14 PM >> To: MICE Discuss >> Subject: RE: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE >> >> Sorry guys, I am running a bit behind, so this will end up being closer to 5PM anyway... >> >> -----Original Message----- >> From: Jeremy Lumby [mailto:jlumby@mnvoip.com] >> Sent: Thursday, April 16, 2020 11:10 AM >> To: MICE Discuss >> Subject: RE: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE >> >> It is the MICE core. I would be willing to move it to 5PM CDT, however I would want the board to give their blessing since it was already announced for 4PM >> >> -----Original Message----- >> From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller >> Sent: Thursday, April 16, 2020 11:07 AM >> To:MICE-DISCUSS@LISTS.IPHOUSE.NET >> Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE >> >> This is on the mice core? Or the USInternet switch.. are they one in the >> same? Im confused. >> >> James Urwiller >> Network Architect >> Stealth Broadband >> james.urwiller(a)stealthbroadband.com >> >> >> -----Original Message----- >> From: MICE Discuss<MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy >> Lumby >> Sent: Thursday, April 16, 2020 11:01 >> To:MICE-DISCUSS@LISTS.IPHOUSE.NET >> Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE >> >> Correct, any port number starting with 3/ is on the card. >> >> -----Original Message----- >> From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of >> Gary Glissendorf >> Sent: Thursday, April 16, 2020 10:58 AM >> To:MICE-DISCUSS@LISTS.IPHOUSE.NET >> Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE >> >> Jermey which card is the 100G. is it slot 3 >> >> >> Gary Glissendorf | Network Architect >> gary.glissendorf(a)sdncommunications.com >> >> -----Original Message----- >> From: MICE Discuss<MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy >> Lumby >> Sent: Wednesday, April 15, 2020 5:56 PM >> To:MICE-DISCUSS@LISTS.IPHOUSE.NET >> Subject: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE >> >> <table style="border:1px; border-style:solid; border-color:#ac6337; >> background-color:#ffeb9c"><tr><td><font size=2 face=calibri>CAUTION: This >> email originated from outside of SDN Communications. Exercise caution when >> opening attachments or clicking links, especially from unknown >> senders.</font></td></tr></table><br> >> >> In troubleshooting the 100G line card, Arista has requested that the line >> card be power cycled. Being that there is a possibility that the line >> card would not recover from a restart, I am working with Dave @ the UofM >> to have a spare available in the event that the card fails to restart. I >> plan on blocking BGP to all ports on the card before restarting the card. >> Based on the current state of the card, I am unsure that it will block BGP >> properly. I plan on restarting the card tomorrow at 4PM CDT. In the past >> I have noticed that the 100G cards take a long time to boot up, so I would >> anticipate a minimum of 15 minutes of downtime if everything goes >> perfectly. >> >> Jeremy Lumby >> Minnesota VoIP >> 9217 17th Ave S #216 >> Bloomington, MN 55425 >> M: 612-355-7740 >> D: 612-392-6814 >> F: 952-873-7425 >> jlumby(a)mnvoip.com >> >> >> >> -----Original Message----- >> From: Jeremy Lumby [mailto:jlumby@mnvoip.com] >> Sent: Wednesday, April 15, 2020 4:18 PM >> To: MICE Discuss >> Subject: 100G Linecard >> >> I wanted to let everyone know that we are experiencing an issue with the >> 100G linecard on the MICE Arista core switch. The card is currently >> outputting errors and not detecting new optics. I am currently working >> with Arista to troubleshoot the issue. At the moment any 100G upgrades >> would need to be on hold until the issue is resolved. All established >> connections seem to be working fine. I will report back as soon as I have >> more information. >> >> Jeremy Lumby >> Minnesota VoIP >> 9217 17th Ave S #216 >> Bloomington, MN 55425 >> M: 612-355-7740 >> D: 612-392-6814 >> F: 952-873-7425 >> jlumby(a)mnvoip.com >> ***This message and any attachments are solely for the intended recipient. >> If you are not the intended recipient, disclosure, copying, use or >> distribution of the information included in this message is prohibited -- >> Please immediately and permanently delete.*** > > ------------------------------------------------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >

April 16, 2020

Re: 100G Linecard EMERGENCY MAINTENANCE

by Jeremy Lumby

The main reason is because mice is 100% volunteer and it is difficult to get volunteers to come in in the middle of the night Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: Ryan Malek <rmalek(a)ROUTER12.NET> Date: 4/16/20 5:43 PM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE _____ >From : Ryan Malek [rmalek(a)ROUTER12.NET] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Thursday, April 16 2020 17:43:42 I hope this isn't a stupid question... but why was this done at 5PM? I found out in a very brutal manner that something is wrong with my BGP set up... _____ Ryan Malek - Router12 Networks LLC Internet, Phone, and Hosted Services Ph. 641.420.7180 On 4/16/2020 5:29 PM, Jeremy Lumby wrote: The maintenance has completed, and everything appears to be returning to normal. -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Thursday, April 16, 2020 4:14 PM To: MICE Discuss Subject: RE: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE Sorry guys, I am running a bit behind, so this will end up being closer to 5PM anyway... -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Thursday, April 16, 2020 11:10 AM To: MICE Discuss Subject: RE: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE It is the MICE core. I would be willing to move it to 5PM CDT, however I would want the board to give their blessing since it was already announced for 4PM -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Thursday, April 16, 2020 11:07 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE This is on the mice core? Or the USInternet switch.. are they one in the same? Im confused. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Thursday, April 16, 2020 11:01 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE Correct, any port number starting with 3/ is on the card. -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Gary Glissendorf Sent: Thursday, April 16, 2020 10:58 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE Jermey which card is the 100G. is it slot 3 Gary Glissendorf | Network Architect gary.glissendorf(a)sdncommunications.com -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Wednesday, April 15, 2020 5:56 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE <table style="border:1px; border-style:solid; border-color:#ac6337; background-color:#ffeb9c"><tr><td><font size=2 face=calibri>CAUTION: This email originated from outside of SDN Communications. Exercise caution when opening attachments or clicking links, especially from unknown senders.</font></td></tr></table><br> In troubleshooting the 100G line card, Arista has requested that the line card be power cycled. Being that there is a possibility that the line card would not recover from a restart, I am working with Dave @ the UofM to have a spare available in the event that the card fails to restart. I plan on blocking BGP to all ports on the card before restarting the card. Based on the current state of the card, I am unsure that it will block BGP properly. I plan on restarting the card tomorrow at 4PM CDT. In the past I have noticed that the 100G cards take a long time to boot up, so I would anticipate a minimum of 15 minutes of downtime if everything goes perfectly. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Wednesday, April 15, 2020 4:18 PM To: MICE Discuss Subject: 100G Linecard I wanted to let everyone know that we are experiencing an issue with the 100G linecard on the MICE Arista core switch. The card is currently outputting errors and not detecting new optics. I am currently working with Arista to troubleshoot the issue. At the moment any 100G upgrades would need to be on hold until the issue is resolved. All established connections seem to be working fine. I will report back as soon as I have more information. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com ***This message and any attachments are solely for the intended recipient. If you are not the intended recipient, disclosure, copying, use or distribution of the information included in this message is prohibited -- Please immediately and permanently delete.***

April 16, 2020

Re: 100G Linecard EMERGENCY MAINTENANCE

by Ryan Malek

I hope this isn't a stupid question... but why was this done at 5PM? I found out in a very brutal manner that something is wrong with my BGP set up... ------------------------------------------------------------------------ Ryan Malek - Router12 Networks LLC Internet, Phone, and Hosted Services Ph. 641.420.7180 On 4/16/2020 5:29 PM, Jeremy Lumby wrote: > The maintenance has completed, and everything appears to be returning to normal. > > -----Original Message----- > From: Jeremy Lumby [mailto:jlumby@mnvoip.com] > Sent: Thursday, April 16, 2020 4:14 PM > To: MICE Discuss > Subject: RE: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE > > Sorry guys, I am running a bit behind, so this will end up being closer to 5PM anyway... > > -----Original Message----- > From: Jeremy Lumby [mailto:jlumby@mnvoip.com] > Sent: Thursday, April 16, 2020 11:10 AM > To: MICE Discuss > Subject: RE: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE > > It is the MICE core. I would be willing to move it to 5PM CDT, however I would want the board to give their blessing since it was already announced for 4PM > > -----Original Message----- > From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller > Sent: Thursday, April 16, 2020 11:07 AM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE > > This is on the mice core? Or the USInternet switch.. are they one in the > same? Im confused. > > James Urwiller > Network Architect > Stealth Broadband > james.urwiller(a)stealthbroadband.com > > > -----Original Message----- > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy > Lumby > Sent: Thursday, April 16, 2020 11:01 > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE > > Correct, any port number starting with 3/ is on the card. > > -----Original Message----- > From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of > Gary Glissendorf > Sent: Thursday, April 16, 2020 10:58 AM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE > > Jermey which card is the 100G. is it slot 3 > > > Gary Glissendorf | Network Architect > gary.glissendorf(a)sdncommunications.com > > -----Original Message----- > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy > Lumby > Sent: Wednesday, April 15, 2020 5:56 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: [MICE-DISCUSS] 100G Linecard EMERGENCY MAINTENANCE > > <table style="border:1px; border-style:solid; border-color:#ac6337; > background-color:#ffeb9c"><tr><td><font size=2 face=calibri>CAUTION: This > email originated from outside of SDN Communications. Exercise caution when > opening attachments or clicking links, especially from unknown > senders.</font></td></tr></table><br> > > In troubleshooting the 100G line card, Arista has requested that the line > card be power cycled. Being that there is a possibility that the line > card would not recover from a restart, I am working with Dave @ the UofM > to have a spare available in the event that the card fails to restart. I > plan on blocking BGP to all ports on the card before restarting the card. > Based on the current state of the card, I am unsure that it will block BGP > properly. I plan on restarting the card tomorrow at 4PM CDT. In the past > I have noticed that the 100G cards take a long time to boot up, so I would > anticipate a minimum of 15 minutes of downtime if everything goes > perfectly. > > Jeremy Lumby > Minnesota VoIP > 9217 17th Ave S #216 > Bloomington, MN 55425 > M: 612-355-7740 > D: 612-392-6814 > F: 952-873-7425 > jlumby(a)mnvoip.com > > > > -----Original Message----- > From: Jeremy Lumby [mailto:jlumby@mnvoip.com] > Sent: Wednesday, April 15, 2020 4:18 PM > To: MICE Discuss > Subject: 100G Linecard > > I wanted to let everyone know that we are experiencing an issue with the > 100G linecard on the MICE Arista core switch. The card is currently > outputting errors and not detecting new optics. I am currently working > with Arista to troubleshoot the issue. At the moment any 100G upgrades > would need to be on hold until the issue is resolved. All established > connections seem to be working fine. I will report back as soon as I have > more information. > > Jeremy Lumby > Minnesota VoIP > 9217 17th Ave S #216 > Bloomington, MN 55425 > M: 612-355-7740 > D: 612-392-6814 > F: 952-873-7425 > jlumby(a)mnvoip.com > ***This message and any attachments are solely for the intended recipient. > If you are not the intended recipient, disclosure, copying, use or > distribution of the information included in this message is prohibited -- > Please immediately and permanently delete.***

April 16, 2020