- mice-discuss - lists.micemn.net

MICE 100Gig Card Replacement Maintenance Window
by Jeremy Lumby Jan. 18, 2019

Jan. 18, 2019

After yesterday's meeting discussion about the 100G card replacement on the MICE core switch, I now have a tracking number for a new 100G card from Arista. Based on needing 7 days of major maintenance notice, and a request to complete before MLK day it looks like Friday 1/18/2019 at 2PM CST will be the best time to complete the maintenance. The new card requires a switch OS upgrade. Based on an Arista recommendation, I will be upgrading to 4.20.11M prior to the card replacement. This will cause a total traffic disruption on the MICE core switch. Prior to the maintenance I will be blocking BGP on all ports of the core switch to allow traffic to gracefully reroute. If you choose to shutdown BGP on your own prior to the maintenance, please leave your interface enabled so that link can be verified after the maintenance completes. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington, MN 55425 Main: 612-355-7740 x211 Direct: 612-392-6814 EFax: 952-873-7425 jlumby(a)mnvoip.com

3 6

Re: Subscription Mail: Re: [MICE-DISCUSS] [MICE-ANNOUNCE] MICE 100Gig Card Replacement Maintenance Window
by Jeremy Lumby Jan. 18, 2019

Jan. 18, 2019

Yes, this is still on track for today. I have just arrived at the data center. I do plan on blocking port 179 for a minimum of 5 minutes prior to taking the switch down. I will send out another email at 2 p.m. right before I begin the maintenance Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> Date: 1/18/19 1:01 PM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Subscription Mail: Re: [MICE-DISCUSS] [MICE-ANNOUNCE] MICE 100Gig Card Replacement Maintenance Window _____ >From : James Urwiller [james.urwiller(a)TURNKEY-TELECOM.COM] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Friday, January 18 2019 13:01:56 Ahh IC.. because the routes are still valid during the timeout. I was thinking it would be like a fiber cut where we have no valid routes while timers count down. NICE! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com -----Original Message----- From: MICE Discuss On Behalf Of Ryan Goldberg Sent: Friday, January 18, 2019 12:56 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Subscription Mail: Re: [MICE-DISCUSS] [MICE-ANNOUNCE] MICE 100Gig Card Replacement Maintenance Window I believe the idea is to block tcp port 179 ahead of time so the session “dies” and this creates the least disruptive way to do this type of work for all parties. > On Jan 18, 2019, at 12:52 PM, James Urwiller > wrote: > > Is this still happening @2PM today? By "blocking bgp" u mean shutdown > on your end? > > James Urwiller > Network Architect > Stealth Broadband > james.urwiller(a)stealthbroadband.com > > > -----Original Message----- > From: MICE Announcements On Behalf > Of Richard Laager > Sent: Thursday, January 10, 2019 18:39 > To: MICE-ANNOUNCE(a)LISTS.IPHOUSE.NET > Subject: [MICE-ANNOUNCE] MICE 100Gig Card Replacement Maintenance > Window > > -------- Forwarded Message -------- > Subject: MICE 100Gig Card Replacement Maintenance Window > Date: Thu, 10 Jan 2019 17:35:00 -0600 > From: Jeremy Lumby > Reply-To: MICE Discuss > Organization: Minnesota VoIP > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > > After yesterday's meeting discussion about the 100G card replacement > on the MICE core switch, I now have a tracking number for a new 100G > card from Arista. Based on needing 7 days of major maintenance > notice, and a request to complete before MLK day it looks like Friday > 1/18/2019 at 2PM CST will be the best time to complete the > maintenance. The new card requires a switch OS upgrade. Based on an > Arista recommendation, I will be upgrading to 4.20.11M prior to the > card replacement. This will cause a total traffic disruption on the > MICE core switch. Prior to the maintenance I will be blocking BGP on > all ports of the core switch to allow traffic to gracefully reroute. > If you choose to shutdown BGP on your own prior to the maintenance, > please leave your interface enabled so that link can be verified after the > maintenance completes. > > Jeremy Lumby > Minnesota VoIP > 9217 17th Ave S > Suite 216 > Bloomington, MN 55425 > Main: 612-355-7740 x211 > Direct: 612-392-6814 > EFax: 952-873-7425 > jlumby(a)mnvoip.com > > ###################################################################### > ## > > To unsubscribe from the MICE-ANNOUNCE list, click the following link: > &*TICKET_URL(MICE-ANNOUNCE,SIGNOFF); >

1 0

Re: [MICE-ANNOUNCE] MICE 100Gig Card Replacement Maintenance Window
by James Urwiller Jan. 18, 2019

Jan. 18, 2019

Is this still happening @2PM today? By "blocking bgp" u mean shutdown on your end? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com -----Original Message----- From: MICE Announcements <MICE-ANNOUNCE(a)LISTS.IPHOUSE.NET> On Behalf Of Richard Laager Sent: Thursday, January 10, 2019 18:39 To: MICE-ANNOUNCE(a)LISTS.IPHOUSE.NET Subject: [MICE-ANNOUNCE] MICE 100Gig Card Replacement Maintenance Window -------- Forwarded Message -------- Subject: MICE 100Gig Card Replacement Maintenance Window Date: Thu, 10 Jan 2019 17:35:00 -0600 From: Jeremy Lumby <jlumby(a)MNVOIP.COM> Reply-To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Organization: Minnesota VoIP To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET After yesterday's meeting discussion about the 100G card replacement on the MICE core switch, I now have a tracking number for a new 100G card from Arista. Based on needing 7 days of major maintenance notice, and a request to complete before MLK day it looks like Friday 1/18/2019 at 2PM CST will be the best time to complete the maintenance. The new card requires a switch OS upgrade. Based on an Arista recommendation, I will be upgrading to 4.20.11M prior to the card replacement. This will cause a total traffic disruption on the MICE core switch. Prior to the maintenance I will be blocking BGP on all ports of the core switch to allow traffic to gracefully reroute. If you choose to shutdown BGP on your own prior to the maintenance, please leave your interface enabled so that link can be verified after the maintenance completes. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington, MN 55425 Main: 612-355-7740 x211 Direct: 612-392-6814 EFax: 952-873-7425 jlumby(a)mnvoip.com ######################################################################## To unsubscribe from the MICE-ANNOUNCE list, click the following link: &*TICKET_URL(MICE-ANNOUNCE,SIGNOFF);

2 2

Zayo Belle Plaine Remote Switch Port Channel Augement
by Jay Hanke Jan. 17, 2019

Jan. 17, 2019

Zayo is adding port: Ethernet5.43 (Main Switch) To their existing port channel (Po9) feeding the remote switch at their Belle Plaine data center. I have renamed the assignments from NP Belle Plaine Remote to Zayo Belle Plaine Remote in the documentation. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

2 1

Fastly upgrade to 2x100G
by Jay Hanke Jan. 12, 2019

Jan. 12, 2019

Fastly is upgrading from 2x10G to 2x100G. Please configure 100G ports for Fastly (NO LAG): Ethernet3/9/1 Ethernet4/50/1 All IP addressing will remain the same. Following migration Fastly will no longer use ports: Ethernet4/46 Ethernet5/46 Thanks! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

2 1

Please welcome Joe's data Center to MICE!
by Jay Hanke Jan. 10, 2019

Jan. 10, 2019

Name: Joe's Datacenter Port: MN VoIP Remote (Port?) ASN: 19969 IPv4: 206.108.255.134/24 IPv6: 2001:504:27:0:0:4e01::1/64 Peering Contact: joe(a)joesdatacenter.com Route Servers- YES BFD: NO Welcome Aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

3 2

New Years Traffic
by Jeremy Lumby Jan. 10, 2019

Jan. 10, 2019

Just wanted to congratulate all MICE members for crossing the 500Gig mark tonight for the first time.

5 5

ip route objects in MICE
by Timothy Peiffer Dec. 29, 2018

Dec. 29, 2018

I am interested in gathering data for a firewall ruleset that allows more direct usage from networks that are in the metro region of Twin Cities and Duluth, and to a lesser degree communities and surrounding areas for Crookston and Morris. For the participants of MICE, do you have a way of easily presenting your routes by geolocation? I pulled down our route tables for one of our Northern Lights routers connected and matched the base address against max mind geolocate. The result was a list of about 7,000 routes that I thought was unmanageable. Is there a better way, maybe through BGP communities or similar methods, to get more direct relevant info? I want to have a ruleset that permits <ISP x>/minneapolis but denies <ISP x>/atlanta. -- Regards, Tim Peiffer +1 612-626-7884 Network Engineer Office of Information Technology (OIT) University of Minnesota

2 1

Amazon issues?
by James Urwiller Dec. 21, 2018

Dec. 21, 2018

I have seen my peer with Amazon bounce a few times this AM, anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300]

4 4

Please Welcome Router12 to MICE!
by Jay Hanke Dec. 19, 2018

Dec. 19, 2018

Name: Router12 Port: Ethernet 1 (SFN Albert Lea Remote) 10GE ASN: 55009 IPv4: 206.108.255.118/24 IPv6: 2001:504:27:0:0:d6e1::1/64 Peering Contact: rmalek(a)router12.net Route Servers- YES BFD: NO Welcome aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

2 1

WIN/Airstream 10G LAG Augment
by Jay Hanke Dec. 18, 2018

Dec. 18, 2018

Airstream has been allocated Ethernet5/18 to add to their existing LAG. Please update the switch configuration. The new LAG is 30G. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

2 1

Facebook MICE Connection Active
by Jay Hanke Dec. 17, 2018

Dec. 17, 2018

The Facebook MICE connections are active. If your network would like to peer with Facebook over MICE please email requests to peering(a)fb.com. Facebook does NOT connect to the MICE route servers so each network will need to establish their own BGP sessions directly with Facebook. Thanks! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

3 2

Longlines Contact Update
by Jay Hanke Dec. 10, 2018

Dec. 10, 2018

Longlines has requested to update the peering contact to llarsen(a)longlines.biz Thanks! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

2 1

Marco 1g-10G conversion
by Jay Hanke Dec. 10, 2018

Dec. 10, 2018

Marco is moving to a dedicated 10G port on the main switch. The new port is Ethernet5/19. Welcome aboard (again) -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

1 0

Amazon peering
by Darin Steffl Dec. 6, 2018

Dec. 6, 2018

Hello, We've been trying to peer with Amazon since Dec. 2017 and their most recent response is that we're still in their provisioning queue after 1 year. Does anyone have a contact there I can escalate this to? I've reached out to the two contacts listed in PeeringDB and that was their response. I find this unacceptable to be approved to peer with them a year ago but still be waiting to configure their BGP session, which took me all of 1 minute to complete on my router. Any ideas? All other direct peering we've done has been completed within 1 week like Netflix, Google, Akamai, Cloudflare, etc. Thank you -- Darin Steffl Minnesota WiFi www.mnwifi.com 507-634-WiFi <http://www.facebook.com/minnesotawifi> Like us on Facebook <http://www.facebook.com/minnesotawifi>

5 11

Please Welcome Fibernet Communications to MICE!
by Jay Hanke Nov. 27, 2018

Nov. 27, 2018

Name: Fibernet Communications ASN: 18883 Port: Zayo Remote Switch (Premier Port) IPv4: 206.108.255.133 /24 IPv6: 2001:504:27:0:0:49c3::1 /64 Peering Contact: peering(a)fibernetcommunications.net Route Server: YES BFD Support NO Welcome Aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

3 2

Four BGP sessions drops with Google/YouTube (AS36040) today
by Frank Bulk Nov. 26, 2018

Nov. 26, 2018

FYI, we saw our BGP session drop with AS36040 several times today: * 12:08:46 to 12:08:51 pm * 2:01 to 2:02 pm * ~4:02 to ~4:04 pm * ~7:36 to ~7:38 pm Graphs show some serious stability issues: [cid:image001.png@01D48368.C4C26A60] Regards, Frank

3 9

Please Welcome Facebook to MICE!
by Jay Hanke Nov. 14, 2018

Nov. 14, 2018

Name: Facebook ASN: 32934 Ports: 2x2x10G First LAG: Ethernet4/27 Ethernet4/28 Second LAG: Ethernet5/27 Ethernet5/28 IPv4: 206.108.255.116/24 206.108.255.117/24 IPv6: 2001:504:27:0:0:80a6::1/64 2001:504:27:0:0:80a6::2/64 Peering contact: peering(a)fb.com Route Server: NO BFD Support: NO Note: These port assignments contain ports that were previously in use. Welcome aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

2 1

MICE Congestion
by Jay Hanke Nov. 14, 2018

Nov. 14, 2018

We are seeing very heavy traffic on several ports tonight: Amazon TDS Jaguar WIN -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

1 0

Arvig 100G upgrade
by Jay Hanke Nov. 13, 2018

Nov. 13, 2018

Arvig is upgrading their MICE connection to 100G. The new port is Ethernet 3/8/1 on the main switch. Arvig will be turning down their existing connections to ports Ethernet 4/7 and Ethernet 5/9 as part of the migration. All IP Addressing information will remain the same. Thanks! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

1 0

Please welcome Ostra LLC to MICE!
by Jay Hanke Nov. 2, 2018

Nov. 2, 2018

Name: Ostra LLC Port: MN VoIP Remote ASN: 26446 IPv4: 206.108.255.98/24 IPv6: 2001:504:27:0:0:674e::1/64 Peering Contact: patrick(a)ostrainc.net BFD: NO Route Server: NO Whois: https://bgp.he.net/AS26446#_whois Please join the MICE mailing lists for technical and governance information at http://micemn.net/contact.html. Welcome Aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

3 2

MICE peering down for us since ~10:29 am
by Frank Bulk Oct. 27, 2018

Oct. 27, 2018

I don't see a "link down" on our L2, but graph of Belle Plaine shows no traffic moving. Anyone have visibility to where it's down? Frank

4 7

Random Outages
by Jay Hanke Oct. 26, 2018

Oct. 26, 2018

Did something get cut somewhere? I'm seeing multiple services from multiple carriers dropping out south of Minneapolis about 15 minutes ago. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

3 2

Please Welcome Xcel Energy to MICE!
by Jay Hanke Oct. 26, 2018

Oct. 26, 2018

Name: Xcel Energy Port: Ethernet 4/25 (Main Switch) ASN: 215 IPv4: 206.108.255.115/24 <http://206.108.255.114/24> IPv6: 2001:504:27:0:0:00d7::1 /64 Route Server: YES BFD Support: YES Peering Contact: Andrew.Schmidt(a)xcelenergy.com Please join our mailing lists for technical updates and governance information at http://lists.iphouse.net/cgi-bin/wa?A0=MICE-DISCUSS Also, Please update/create your entry at PeeringDB.com listing your connection to the MICE Internet Exchange. We also strongly recommend that you have up to date IRR entries for your networks. Please provide your Arista compatible SFP+ optic to Cologix when you order your cross connect. Welcome Aboard! -- Jay Hanke, Peering Coordinator Midwest Internet Cooperative Exchange peering(a)micemn.net

4 6

Global Net ASN395466 - Outage
by Global Net NOC Oct. 17, 2018

Oct. 17, 2018

All Our Zayo circuit into Minneapolis went down @ 10:28:12 MT. BGP sessions at MICEMN are down. Currently do not have confirmation but the initial report from Zayo is a possible fiber cut. Global Net NOC ASN395466 mailto:noc@theglobal.net

1 0

Yomura Peering Contacts
by Justin Krejci Oct. 17, 2018

Oct. 17, 2018

We basically get zero response from them now and our MICE BGP session with them has been done for a long time and they don't seem to have a good phone number or email that works to reach a live person. They also don't appear to have any recent traffic on MICE since June. Our BGP session with them at SIX also has been down for quite some time too. Does anyone who peers with Yomura, at MICE or elsewhere, have any contacts over there or have any idea what is going on with them? According to their LinkedIn profile and listed employees on LinkedIn, they appear to be a spread out multinational but it appears their desire to have an active presence on the interwebs is non-existent. The last time I got an email from an @yomura.com address was September 2017. They don't have any A or AAAA records for yomura.com or www.yomura.com<http://www.yomura.com>. Their whois data is all privatized. It seems like they don't want to exist or something. Justin Krejci 952-253-3200 ? 1-800-US-INTERNET 12450 Wayzata Blvd. Suite 315 ? Minnetonka, MN 55305 [http://www.usinternet.com/img/usi-signature.png]

3 2

Global Net (AS395466) - Upcoming Maintenance 10/15
by Global Net NOC Oct. 12, 2018

Oct. 12, 2018

MICEMN Members - We have a short maintenance window scheduled for Monday, October 15th to perform a software upgrade at our edge. Our BGP sessions will flap several times. Start: 10/15/18 1000 GMT End: 10/15/18 1010 GMT Thanks, Global Net NOC noc(a)theglobal.net Global Net Peering peering(a)theglobal.net

1 0

Please Welcome ImOn Communications to MICE!
by Jay Hanke Oct. 12, 2018

Oct. 12, 2018

Name: Imon Communications Port: MN VoIP Remote ASN: 393238 IPv4: 206.108.255.114/24 IPv6: 2001:504:27:0:6:0016::1 /64 Route Server: YES BFD Support: YES Peering Contact: ImOnAdmins(a)imon.net Please join our mailing lists for technical updates and governance information at http://lists.iphouse.net/cgi-bin/wa?A0=MICE-DISCUSS Also, Please update/create your entry at PeeringDB.com listing your connection to the MICE Internet Exchange. We also strongly recommend that you have up to date IRR entries for your networks. Welcome Aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

2 1

MICE Route Filtering
by David Farmer Oct. 8, 2018

Oct. 8, 2018

At NANOG it was strongly suggested we, privately for MICE and more generally for all IXes, should implement IRR filtering on our route servers ASAP. We are now one of the bigger IXes not already filtering, especially in the US. We should probably block routes with invalid RPKI ROAs too. Arouteserver was recommended as one of the better and easier to implement options. There are offers to help us with this from Theo de Raadt < deraadt(a)yycix.ca> of the Calgary Internet Exchange (YYCIX) and by others. https://blog.apnic.net/2017/03/17/ixp-automation-made-easy-new-open-source-… https://github.com/pierky/arouteserver https://arouteserver.readthedocs.io/en/latest/ FYI additionally, Fastly already filters based on IRR objects, and HE has recently started filtering. https://www.fastly.com/peering http://routing.he.net/algorithm.html Also at NANOG, it was announced by Google that they plan to begin filtering routes based IRR data early next year. See slide 114 of the following; https://pc.nanog.org/static/published/meetings/NANOG74/1760/20181003_Tzveta… There is lots of other good stuff in the deck, but the fact that Google plans to start filtering based on IRR objects is BIG news. So, we need to escalate doing route filtering on our Route Servers. Furthermore, if you don't already have IRR objects, you should probably start working on them. The following is a handy tool to check the consistency of your IRR objects. http://irrexplorer.nlnog.net/ Thanks. -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

3 3

Fwd: Voting Now Open for the 2018 ARIN Board of Trustees, ARIN Advisory Council, and NRO NC Elections
by David Farmer Oct. 6, 2018

Oct. 6, 2018

If you are an ARIN Member voting contact please remember to vote. If you are not your organizations voting contact please remind your voting contact to vote. If you would like suggestions on who to vote for please email me off the list. By the way, I'm not up until next year, but voting is still important. Thanks. ---------- Forwarded message --------- From: ARIN <info(a)arin.net> Date: Thu, Oct 4, 2018 at 5:01 PM Subject: [arin-announce] Voting Now Open for the 2018 ARIN Board of Trustees, ARIN Advisory Council, and NRO NC Elections To: <arin-announce(a)arin.net> Cast your online ballot now in the 2018 ARIN Elections to fill two seats on the ARIN Board of Trustees, five seats on the ARIN Advisory Council, and one seat on the Number Resource Organization Number Council (NRO NC). Eligible Voting Contacts from General Members in Good Standing as of the voter eligibility deadline of 20 August, may cast an online ballot now through 6:00 PM EDT, Friday, 12 October. To vote, simply log in to ARIN Online and look for the “Vote Now” link on your dashboard. To view candidate biographies, please view the ARIN Elections 2018 Voter Guide at: https://www.arin.net/participate/elections/candidate_bios.pdf To view or submit a Statement of Support, please click on the link below. Anyone, regardless of voter status, is eligible to submit a Statement of Support for a candidate. https://www.bigpulse.com/p51139/ During the week of 8 October, all eligible Voting Contacts should be aware that an ARIN representative will be personally calling them as a gentle reminder to please vote and to answer any election-related questions they may have. Participation in the election process is crucial, requires only minutes of a voter’s time, is done online, and is an important member responsibility. A single cast ballot provides eligible member organizations an opportunity to shape the future of ARIN, our community, and the Internet. For questions about voting, or if you encounter an issue with the election system, please contact a member of the Member Services team immediately via email at members(a)arin.net or submit a question via ARIN Online and direct it to Meetings/Elections. Regards, Wendy Leedy Member Engagement Coordinator American Registry for Internet Numbers (ARIN) -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

1 0

Anyone else seeing AS36040 (Google/Youtube) bouncing in and out this morning
by Frank Bulk Oct. 5, 2018

Oct. 5, 2018

Since 9:29 am a third-party service we use has been noticing that AS36040 is coming and going. I assume that it's seeing it from MICE's router server ... any way to confirm? Frank

3 4

Kansas City Internet eXchange peer and beer
by Brandon Mulligan Oct. 4, 2018

Oct. 4, 2018

Greetings. The Kansas City Internet eXchange is holding a free peer and beer event on Tuesday October 16th. We welcome any network operators from the midwest region.

1 1

Last call for Arista Training Day!
by John McLaughlin Oct. 1, 2018

Oct. 1, 2018

Hello MICE Members: Interested in learning more about why Arista Networks is quickly becoming the preferred choice in the datacenter, hybrid clouded central offices? Please join Arista Networks for a no-cost, full day of training with hands-on labs, led by Arista Engineers. Minnet When and Where? Wednesday, October 3rd, 9:00AM - 4:00PM Minnetonka Executive Suites - Lake Superior Room <https://maps.google.com/?q=12800+WhiteWater+Drive+Minnetonka,+MN,+55343&ent…> 12800 WhiteWater Drive <https://maps.google.com/?q=12800+WhiteWater+Drive+Minnetonka,+MN,+55343&ent…> Minnetonka, MN, 55343 <https://maps.google.com/?q=12800+WhiteWater+Drive+Minnetonka,+MN,+55343&ent…> Topics include the following: Arista Corporate overview Extensible Operating System (EOS®) overview and CLI Multi-Chassis Aggregation (MLAG) and Virtual ARP (VARP) overview Building Multi-Tenant Services with EVPN and VXLAN Provisioning with Arista CloudVision® Portal (CVP) Arista eAPI Lunch will be provided. **Note: please bring a laptop to access virtual labs. John McLaughlin North Central Sales jmclaughlin(a)arista.com Cell# 612-816-9024 https://www.barrons.com/articles/worlds-best-ceos-growth-leaders-1527304583…

1 0

Nanog?
by Reid Fishler Sept. 30, 2018

Sept. 30, 2018

Whose coming? This week, Vancouver. Reid -- Reid Fishler Director Hurricane Electric +1-510-580-4178

2 1

Re: South Front Networks, LLC Remote switch request
by Richard Laager Sept. 29, 2018

Sept. 29, 2018

I'm bringing this remote switch request to the discussion list per our remote switch policy: http://micemn.net/technical.html On 09/28/2018 09:25 AM, Jay Hanke wrote: > South Front Networks requests approval to install a MICE Remote Switch > in SFN's Albert Lea Datacenter. > > South Front proposes the following: > 1) SFN will acquire a Juniper QFX5100 or Arista comparable switch > dedicated to MICE. > 2) SFN will acquire and pay for any required connectivity back to the > MN VoIP remote switch, MN VoIP and SFN remote switches will share the > existing 40 Gbps MICE link into the main fabric. Both SFN and MN VoIP > agree to upgrade capacity as needed on the uplink to the main switch. > 3) SFN will initially install 20 Gbps of capacity and will upgrade > capacity as needed per the board and technical committee requirements > 4) SFN agrees to enforce the MICE technical port rules > 5) SFN agrees to coordinate connections to the new remote switch > 6) SFN agrees to inform all prospective members that connections going > to the SFN MICE Remote switch are not connected directly to MICE. > 7) SFN agrees to perform any required configuration and troubleshooting > 8) SFN agrees to provide configuration access and snmp access to the > MICE technical committee to ease troubleshooting and to provide > publicly available graphing. > > Thanks! > > -- > Jay Hanke, President > South Front Networks > jayhanke(a)southfront.io <mailto:jayhanke@southfront.io> > Phone 612-204-0000 -- Richard

3 3

Role email accounts on the list
by Mike Horwath Sept. 28, 2018

Sept. 28, 2018

How do people feel about this? We just had someone join the list using a noc@ email address. -- Mike Horwath, reachable via drechsau(a)Geeks.ORG

3 2

Fwd: route server IRR objects: RIPE use for ARIN addresses deprecated, ARIN IRR & RPKI tutorials
by Richard Laager Sept. 26, 2018

Sept. 26, 2018

This is from the SeattleIX announce list. I'm forwarding it, with Chris's permission, in case this is relevant to anyone here. -------- Forwarded Message -------- Subject: route server IRR objects: RIPE use for ARIN addresses deprecated, ARIN IRR & RPKI tutorials Date: Tue, 25 Sep 2018 22:22:14 +0000 (UTC) From: Chris Caputo <ccaputo(a)seattleix.net> To: announce(a)seattleix.net tl;dr: - RIPE made changes which don't break anything now, but may in future. - I recommend you move your IRR records to the RIR which assigned or allocated your prefixes. - link to ARIN RPKI tutorial at bottom. Many of you that used RIPE to create your Internet Routing Registry (IRR) objects received an email from RIPE at the beginning of September about a change in their registry in which non-RIPE prefixes are now labeled with "source: RIPE-NONAUTH". This is part of an effort to improve the quality of IRR data for the purposes of reducing accidental or fraudulent BGP announcements. The idea being that the Regional Internet Registries (RIRs) know best who addresses have been assigned/allocated to. If you have your records at RIPE (or elsewhere and want to move to ARIN), I recommend you do the following: (note the example with my AS6456 will soon no longer work because I will be deleting my records at RIPE since they have been moved to ARIN) - First, determine your maintainer object name. This can be figured out by going to http://www.radb.net/query/ and running a query on your ASN or prefixes. For example, a query on my AS6456 reveals a RIPE maintainer "mnt-by" field "MAINT-ALTOPIA-RIPE". You may find you have multiple maintainers and multiple IRRs. Focus on the RIPE one if that is what you want to move. aut-num: AS6456 [...] mnt-by: MAINT-ALTOPIA-RIPE source: RIPE-NONAUTH - Using my "MAINT-ALTOPIA-RIPE" I can do an inverse query at RIPE to see all of my objects: $ whois -h whois.ripe.net -i mnt-by -B MAINT-ALTOPIA-RIPE aut-num: AS6456 as-name: ALTOPIA-6456 descr: Altopia AS 6456 [...] as-set: AS-ALTOPIA descr: Altopia Corporation members: AS6456 [...] route: 208.90.168.0/22 descr: ALTOPIA-V4-1 assigned by ARIN origin: AS6456 [...] route6: 2620:0:cf0::/48 descr: ALTOPIA-V6-1 assigned by ARIN origin: AS6456 [...] etc... - Save a copy of all of your objects so you can use the result to aide in your move to ARIN. - Refer to https://www.seattleix.net/irr-tutorial#arin for a new tutorial on how to get set up at ARIN's IRR. - Use http://irrexplorer.nlnog.net to visualize which IRRs are reporting your prefixes or ASN. - After all of your ARIN objects are moved to ARIN, work to delete your ARIN objects at RIPE or elsewhere as part of being tidy. Bonus! I also made an ARIN Resource Public Key Infrastructure (RPKI) tutorial. Turns out RPKI is pretty easy to configure, with respect to making it so your own ARIN prefixes are somewhat (*) protected from being announced by unauthorized ASNs. (*: with respect to networks running RPKI validators) - https://www.seattleix.net/irr-tutorial#arinrpki Feedback & corrections welcome! Chris

2 1

Arista Test Drive Training Wednesday, October 3rd
by John McLaughlin Sept. 23, 2018

Sept. 23, 2018

Hello MICE Members: If you can join us for a day of free training please use the links below to register and review what an Arista Test Drive covers. https://solutions.arista.com/2018-09-atd-minnetonka-mn <https://solutions.arista.com/2018-09-atd-minnetonka-mn> https://solutions.arista.com/atd-training <https://solutions.arista.com/atd-training> ATD TRAINING What we offer: A curriculum designed to deliver world-class content and learning experience Small, intimate class sizes, led by our local engineers, for greater classroom interaction In addition to the schedule listed, we can add classes to fit your needs. Just tell us when and where, and we take care of the rest Please reach out to your Arista Account Manager or Training(a)Arista.com <mailto:Training@Arista.com> for more information! Thanks, -JMc John McLaughlin North Central Sales jmclaughlin(a)arista.com Cell# 612-816-9024 https://www.barrons.com/articles/worlds-best-ceos-growth-leaders-1527304583…

1 0

Power a pdu?
by Ryan Goldberg Sept. 15, 2018

Sept. 15, 2018

Anyone at 511 and have 208v pdu with L6-30 in and a few c13 and c19 out? Ran into a sticky spot and could use one or two tonight. Can order and ship new to you or return in 2.5 weeks. Sorry for the OT, slap my hand if necessary. Ryan 218-390-5485

2 3

MICE Mailing Address
by Kayla Olsen Sept. 10, 2018

Sept. 10, 2018

*This is a duplicate notice for some of you, please disregard if it's old news...* Greetings, The mailing address for MICE (Midwest Internet Cooperative Exchange) has changed. Please update your records to: Midwest Internet Cooperative Exchange PO Box 153 Mankato MN 56002-0153 http://micemn.net/ Thank you, Kayla Olsen MICE Treasurer

1 0

Routing of non-IX traffic
by Frank Bulk Aug. 23, 2018

Aug. 23, 2018

When I force a traceroute to originate from our MICE-facing connection, the first hop is 206.108.255.50 (AS32609 aka CNS). Any reason why? To making things more interesting, Incapsula-destined traffic goes via Paul Bunyan. Here's just one example: traceroute to www.yamaha-dealers.com (45.60.73.16), 30 hops max, 60 byte packets 1 AS32609.micemn.net (206.108.255.50) 14.059 ms 14.084 ms 14.076 ms 2 cns70.cnsllc.net (205.149.150.9) 18.484 ms 18.434 ms 18.507 ms 3 fg30.ips.cnsllc.net (205.149.150.30) 20.254 ms 20.346 ms 20.267 ms 4 crss2.PaulBunyan.net (205.149.159.197) 20.527 ms 20.562 ms 20.619 ms 5 cra.PaulBunyan.net (205.149.159.181) 23.398 ms fp233.ips.PaulBunyan.net (205.149.159.233) 22.669 ms cra.PaulBunyan.net (205.149.159.181) 23.393 ms 6 * * * 7 * * * 8 * * * 9 * * * 10 * * * 11 * * * 12 * * * 13 * * * 14 * * * 15 * * * 16 * * * 17 * * * 18 * * * 19 * * * 20 * * * 21 * * * 22 * * * 23 * * * 24 * * * 25 * * * 26 * * * 27 * * * 28 * * * 29 * * * 30 * * * SiouxCenter-Arista-North(s1) The reason I stumbled across this is because we've had more than a dozen customers over the last month complain about access to Incapsula-protected sites. Packet captures show TCP RSTs coming from the far side. Regards, Frank Bulk AS53347

11 18

Direct peering to Yahoo! unstable over the last few days
by Frank Bulk Aug. 21, 2018

Aug. 21, 2018

Anyone else seeing the same as us? Aug 17 17:55:10 207.32.15.28 Rib: %BGP-3-NOTIFICATION: sent to neighbor 206.108.255.58 (AS 10310) 4/0 (Hold Timer Expired Error/Unspecified) 0 bytes Aug 17 17:55:10 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.58 (AS 10310) old state Established event HoldTime new state Idle Aug 17 17:55:14 207.32.15.28 Rib: %BGP-3-NOTIFICATION: sent to neighbor 206.108.255.59 (AS 10310) 4/0 (Hold Timer Expired Error/Unspecified) 0 bytes Aug 17 17:55:14 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.59 (AS 10310) old state Established event HoldTime new state Idle Aug 17 17:55:17 207.32.15.28 Rib: %BGP-3-NOTIFICATION: sent to neighbor 2001:504:27::2846:0:2 (AS 10310) 4/0 (Hold Timer Expired Error/Unspecified) 0 bytes Aug 17 17:55:17 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::2846:0:2 (AS 10310) old state Established event HoldTime new state Idle Aug 17 18:02:13 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.59 (AS 10310) old state OpenConfirm event RecvKeepAlive new state Established Aug 17 18:02:19 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.58 (AS 10310) old state OpenConfirm event RecvKeepAlive new state Established Aug 17 18:02:48 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::2846:0:2 (AS 10310) old state OpenConfirm event RecvKeepAlive new state Established Aug 17 21:30:59 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.58 (AS 10310) old state Established event HoldTime new state Idle Aug 17 21:31:03 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::2846:0:2 (AS 10310) old state Established event HoldTime new state Idle Aug 17 21:31:06 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.59 (AS 10310) old state Established event HoldTime new state Idle Aug 17 21:38:05 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.59 (AS 10310) old state OpenConfirm event RecvKeepAlive new state Established Aug 17 21:38:12 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::2846:0:2 (AS 10310) old state OpenConfirm event RecvKeepAlive new state Established Aug 17 21:38:20 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.58 (AS 10310) old state OpenConfirm event RecvKeepAlive new state Established Aug 18 00:54:55 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.58 (AS 10310) old state Established event HoldTime new state Idle Aug 18 00:54:57 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::2846:0:2 (AS 10310) old state Established event HoldTime new state Idle Aug 18 00:54:59 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.59 (AS 10310) old state Established event HoldTime new state Idle Aug 18 01:02:41 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.58 (AS 10310) old state OpenConfirm event RecvKeepAlive new state Established Aug 18 01:02:49 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.59 (AS 10310) old state OpenConfirm event RecvKeepAlive new state Established Aug 18 01:02:53 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::2846:0:2 (AS 10310) old state OpenConfirm event RecvKeepAlive new state Established Aug 18 02:01:30 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.58 (AS 10310) old state Established event HoldTime new state Idle Aug 18 02:01:32 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.59 (AS 10310) old state Established event HoldTime new state Idle Aug 18 02:01:35 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::2846:0:2 (AS 10310) old state Established event HoldTime new state Idle Aug 18 02:15:55 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.59 (AS 10310) old state OpenConfirm event RecvKeepAlive new state Established Aug 18 02:16:00 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.58 (AS 10310) old state OpenConfirm event RecvKeepAlive new state Established Aug 18 02:16:00 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::2846:0:2 (AS 10310) old state OpenConfirm event RecvKeepAlive new state Established Aug 18 05:36:50 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.58 (AS 10310) old state Established event HoldTime new state Idle Aug 18 05:36:53 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::2846:0:2 (AS 10310) old state Established event HoldTime new state Idle Aug 18 05:36:56 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.59 (AS 10310) old state Established event HoldTime new state Idle Aug 18 05:47:17 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.58 (AS 10310) old state OpenConfirm event RecvKeepAlive new state Established Aug 18 05:47:21 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 206.108.255.59 (AS 10310) old state OpenConfirm event RecvKeepAlive new state Established Aug 18 05:47:24 207.32.15.28 Rib: %BGP-5-ADJCHANGE: peer 2001:504:27::2846:0:2 (AS 10310) old state OpenConfirm event RecvKeepAlive new state Established

3 3

Compudyne (AS47096) Network Maintenance
by Ryan Nelson Aug. 14, 2018

Aug. 14, 2018

We will be migrating our MICE connection to a new router tomorrow. In preparation for this we will be shutting down all BGP sessions in the early AM and intend to have them back online by early evening. Thanks, and sorry for the short notice, Ryan Nelson | Network Infrastructure Architect Compudyne | 306 W Michigan Street - Suite 200 | Duluth, MN 55802 rnelson(a)compudyne.com<mailto:rnelson@compudyne.com> | 218.336.2220 | compudyne.com<http://www.compudyne.com/> Duluth | Hibbing | Saint Paul | Marquette | Houghton | Anchorage ________________________________ [cid:image002.png@01D0BA36.584BB020]

1 0

Facebook/Instagram
by AnthonyAnderberg＠nuvera.net Aug. 9, 2018

Aug. 9, 2018

Has anyone else gotten reports of issues with Facebook/Instagram the last day or two? We're seeing intermittent problems where Facebook pages will load normally but then some of the pictures/videos in the page will be slow loading. I haven't really narrowed it beyond a handful of source addresses in Facebook's network, mostly in the 157.240.2.0/24 range, and haven't seen any other service issues or narrowed it to any one upstream carrier. It doesn't appear any of the content is coming through MICE, but I'm curious if anyone is/has seen something similar. We've reached out to Facebook but haven't gotten a response yet. Thanks in advance, anthony [Anthony_Anderberg]<https://www.nuvera.net/>

2 1

Re: Please welcome Global Net to MICE!
by Richard Laager Aug. 2, 2018

Aug. 2, 2018

On 07/30/2018 02:32 PM, Jay Hanke wrote: > Route Server: No I communicated with Global Net off-list. This is actually a "Yes" now. They _do_ want to be setup on the route servers. -- Richard

2 1

UG 29 Election
by Richard Laager Aug. 1, 2018

Aug. 1, 2018

At UG 29 in October, we will be holding an election for a board seat. The board consists of three seats with staggered terms, such that one seat comes up for re-election each year (at the fall meeting). This year, Reid's seat is up for election. Reid _is_ running for re-election. If anyone else is interested in running, please nominate yourself. Voting will be done in person. If you will not be attending in person, you must designate a proxy, in advance, in writing. The bylaws state that you send that to the Chief Manager (me, Richard Laager), and electronic means are acceptable. So a simple email is sufficient. If you are having trouble finding a proxy who will be there in person, ask on the list or I can help you find someone. -- Richard

1 0

Please welcome Global Net to MICE!
by Jay Hanke July 30, 2018

July 30, 2018

Name: Global Net Port: Ethernet5/37 (Main Switch) Speed: 10G ASN: 395466 IPv4: 206.108.255.97/24 IPv6: 2001:504:27:0:6:08ca::1/64 Route Server: No BFD Support: No Peering Contact: peering(a)theglobal.net Please provide your Arista compatible optic to Cologix or a member of the tech committee. Welcome aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

1 0

MICE BFD Settings
by AnthonyAnderberg＠nuvera.net July 25, 2018

July 25, 2018

At the last UG meeting it was suggested that we document MICE's route server BFD settings, that is done now: http://www.micemn.net/technical.html Was good seeing everyone again, anthony [Anthony_Anderberg]<https://www.nuvera.net/>

1 0

Dyn blog post has some recommendations for IXPs who may experience bad actors
by Frank Bulk July 12, 2018

July 12, 2018

The whole blog post I interesting, but the last fifth relates to IXPs: https://dyn.com/blog/shutting-down-the-bgp-hijack-factory/ Food for thought. Frank

1 0

Not learning all routes from RR#2
by Frank Bulk June 28, 2018

June 28, 2018

We (AS53347) moved to a new border router overnight and had some issues with getting our MICE route reflector peerings up -- we'd learn a route or two per second. We had to tweak our Arista's BGP configuration to not "enforce-first-as". Most other direct peers were fine. Eventually RR #1 came up just fine, but RR #2 continues to languish, learning just learning about 10,900 routes. SiouxCenter-Arista-North(s1)#show ip bgp sum BGP summary information for VRF default Router identifier 207.32.15.22, local AS number 18883 Neighbor Status Codes: m - Under maintenance Neighbor V AS MsgRcvd MsgSent InQ OutQ Up/Down State PfxRcd PfxAcc 206.108.255.1 4 53679 44493 4138 0 0 10:56:46 Estab 56188 56188 206.108.255.2 4 53679 39124 7640 0 0 11:38:40 Estab 10929 10929 I'm not sure if we have remote access to the RR's, but whoever does, any hints as to why we're experiencing this behavior? Frank

4 4