- mice-discuss - lists.micemn.net

Amazon Peering
by Jason Hanke 04 Jan '17

04 Jan '17

Amazon confirmed that they are up and ready for additional peers on MICE. peering(a)amazon.com -- Jay Hanke CTO Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke(a)neutralpath.net www.neutralpath.net

1 0

Route server #2 copper connection
by Jeremy Lumby 22 Dec '16

22 Dec '16

When I went to insert my optic into the switch for my upgraded 10G connection, I noticed that the cable for route server#2 was against the cabinet door, and simply opening/closing the door caused the link to bounce. Since the link had gone down from just opening the door, I switched the Copper SFP adapter to a different model, and it appears to be more compatible with the RJ45 connector on the patch cable since the link now stays up when the cable is moved in a normal manner. Jeremy

2 2

RR#2 cable?
by Doug McIntyre 22 Dec '16

22 Dec '16

Anybody close to 511 today? Looks like the cable has snaked its way out again for RR#2. Dec 19 17:04:19 micemn-02 kernel: bge1: link state changed to DOWN The machine is up and talking back on the mgmt link. It is link down on both the switch and the machine for the link into the switch stack. I'm sure if somebody goes and pushes on the cable again it'll be link up. Looks like that cable and that copper-SFP aren't too compatico. It might be better to not have switch diversity for them. -- Doug McIntyre <merlyn(a)iphouse.net> ~.~ ipHouse ~.~ Network Engineer/Provisioning/Jack of all Trades

6 9

UG 22 Minutes
by Richard Laager 19 Dec '16

19 Dec '16

Draft minutes available here: http://micemn.net/files/MICE%20UG%2022%20-%20Minutes.pdf If you have any corrections, please let me know. -- Richard

1 0

MICE UG Reminder
by Jason Hanke 12 Dec '16

12 Dec '16

The MICE Users Group is Wednesday. There is a proposal for new port fees on the docket. Please RSVP here: https://www.facebook.com/events/179450035795693/ -- Jay Hanke CTO Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke(a)neutralpath.net www.neutralpath.net

3 2

MN VoIP Remote Switch
by Jason Hanke 09 Dec '16

09 Dec '16

Please allocate xe-2/0/7 to the MN VoIP remote switch. Per the new policy for remote switches, please provision the initial port as a single member LAG. Welcome aboard! -- Jay Hanke CTO Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke(a)neutralpath.net www.neutralpath.net

2 1

Participants leaking BGP routes for the MICE IXP Block
by David Farmer 06 Dec '16

06 Dec '16

I have BGPmon set up to notify me of the MICE IXP blocks (IPv4 and IPv6) are being announce in BGP by any other AS that MICE itself. The current BPC is to not even put a route in your IGP for for an exchange block, let alone originate a BGP route for it. http://www.bgp4all.com.au/dokuwiki/_media/conferences/apnic42-ixp-design-bc… See slide 45. In the last 2 or 3 months I have seen three different participant ASNs originate routes for 206.108.255.0/24, haven't seen any for do it for 2001:504:27::0/48. I'm not going to name and shame, at least for past events. But, what should we do about this going forward? 1. Ignore it 2. Notify transgressors PRIVATELY 3. Manually, Name and Shame transgressors 4. Automated, Name and Shame of transgressors (setup a BGPmon account to mail to MICE-DISCUSS) 5. Other ideas? (electro-shock for transgressors :) ) Thanks -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

5 5

Route Server Filtering
by Richard Laager 05 Dec '16

05 Dec '16

I'm looking for feedback on a filtering proposal. I propose that, on the route server, by default, we filter incoming routes to block anything matching: _(174|209|286|701|1239|1299|2828|2914|3257|3320|3356|3549|5511|6453|6461|6762|6939|7018|12956)_ We can, of course, create exceptions if necessary. One obvious one is that HE's connection would need their own AS (6939) removed from the block list. This particular list is from here, with 6939 added by me: https://www.nanog.org/sites/default/files/Snijders_Everyday_Practical_Bgp.p… I've been using something similar in my own network for years because of a badly-behaved peer who I have been unable to set straight. They don't connect to MICE, though. This problem can and does occur at MICE. In fact, it's occurring right now. I've just emailed the relevant network. I suspect this happens because some networks filter their outgoing announcements using fixed prefix lists, not communities based on where they heard the route from. As a result, if their link to a customer goes down (temporarily or permanently), they start leaking transit routes for their customer AS. -- Richard

7 9

MICE Fees Proposal/UG Agenda Item/Request for Comment
by Jason Hanke 01 Dec '16

01 Dec '16

All- Our main switch is nearing the end of its lifespan and the available port count is dwindling. At the current rate of burn we will be out of ports in early-2017. USI has arranged for Arista Networks to donate a 7504 switch with 32x100G and 96x10G ports with one year of support. In year 2, MICE would be responsible for the ongoing support costs about 14k per year. There would be one additional slot for future growth. I would like to make a formal request for comment and add the following item to the UG agenda. Here's what I'd propose: 1G ports= Free (Only 1 port per member, NO LAG allowed) Initial 10G port= $250 Annual Each additional 10G port $1000 Annual per port (up to 8 member LAG allowed) 100G port $3000 Annual per port Remote switch operators pay the fee for their main switch ports. Remote switch participants do not pay a main switch port fee. No grandfathering, all types of networks are treated the same. We will not disconnect for non-payment until port run out and contention occurs. A policy will need to be developed. New ports billed at time of allocation. Each carrier provides their own optic. Arista has agreed to remove the vendor lockout for optics. This will yield about $37k of annual revenue assuming everyone pays. We don't disconnect for non-payment but members in good standing would take priority over non-paying members. This would cover hardware support and Arin fees and accounting expense with the remainder going If we extended the full fees to all 10G ports this would generate $70k annually. Looking out, I don't think we will need to raise that much cash to keep operating as we are now. Ongoing Expense looks something like this: Arin: $300 Accounting: $1800 (includes postage for billing) Hardware support: $15000 This financial projection assumes we add no additional ports than what is currently allocated. I'm seeking input/amendment from the membership prior to the board taking action for the 2017 year. -- Jay Hanke CTO Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke(a)neutralpath.net www.neutralpath.net

12 25

Google/YouTube Issues
by Derek Poehls 01 Dec '16

01 Dec '16

Can anyone tell me if they are seeing issues with YouTube/Google today? We have bilateral peering with Google over MICE which is currently down, and customers that are unable to play videos. Also, I received a notification from Google's peering team saying that there are issues with the GGC in Minneapolis. The strange thing is that I'm writing this email, and not already reading a bunch of them that others have already sent... Perhaps it's because we have the bilateral peering set up and others don't? I have an email into them as well - just figured I'd see what others are seeing. Thanks! -=-=-=-=-=-=-=-=- [cid:image001.png@01D21D7D.C7577200] Derek Poehls NOC Supervisor/Senior Network Engineer (218) 284-5775

3 3

GigaPoP Remote Switch
by Richard Laager 30 Nov '16

30 Nov '16

Should the GigaPoP be considered a "remote switch" for MICE? According to the participants list, WiscNet is connecting via the GigaPoP, but has their own IP. So it seems some layer 2 switching is happening there. -- Richard

3 2

Please allocate xe-2/0/8 to Arvig
by Jason Hanke 30 Nov '16

30 Nov '16

Please allocate xe-2/0/8 on the main switch to Arvig. This will be their second port and they would like to convert to LAG. -- Jay Hanke CTO Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke(a)neutralpath.net www.neutralpath.net

2 1

Please allocate port xe-0/1/3 to the GigaPop
by Jason Hanke 30 Nov '16

30 Nov '16

Please add port xe-0/1/3 to the GigaPop lag. Welcome aboard (again)! -- Jay Hanke CTO Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke(a)neutralpath.net www.neutralpath.net

3 4

MICE 10G Ports
by Jason Hanke 30 Nov '16

30 Nov '16

We are VERY low on 10G ports on the main switch. There are several 10G ports that are down or exchanging very little traffic: Onvoy xe-0/0/5 Unggoy xe-2/0/2 (initial turn up) HBC xe-2/0/10 Fastly xe-0/2/0,xe2/0/5 (initial turn up) Amazon ae1 (initial turn up) -- Jay Hanke CTO Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke(a)neutralpath.net www.neutralpath.net

1 0

UG 22 - Call for Agenda
by Richard Laager 29 Nov '16

29 Nov '16

If you have agenda items for the upcoming UG 22, please send them to me. -- Richard

1 0

Fee Poll results
by Jason Hanke 28 Nov '16

28 Nov '16

Here are the results from the over the weekend Fee poll: Recurring (Annual or Monthly Fees) 12 votes One time Fees 8 votes Optional, but invoiced to begin with 3 votes No Fees 1 vote -- Jay Hanke CTO Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke(a)neutralpath.net www.neutralpath.net

3 2

Port Fees Poll
by Jason Hanke 25 Nov '16

25 Nov '16

I've posted a Facebook poll looking for member input on port fees: https://www.facebook.com/events/179450035795693/permalink/197514153989281/ Also, please rsvp on the facebook event. -- Jay Hanke CTO Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke(a)neutralpath.net www.neutralpath.net

1 0

MN VoIP Remote Switch Request
by Richard Laager 22 Nov '16

22 Nov '16

The board has received a request for a new remote switch. In accordance with our procedures, I'm bringing this to the community for discussion. After this, the board will vote on the proposal. The switch would be operated by MN VoIP. It would be located in Cologix's suite 100 in the 511 Building. Jeremy Lumby wrote: > I would promise to notify any members connecting to the switch that > they are not on the main switch, upgrade my link to the main MICE > switch if the traffic goes above 66% and impose MAC, and BDPU limits > on all member facing ports connecting to the remote switch. To get > started I would upgrade to a 10G single port LAG The switch may not be dedicated to MICE. As such, the MICE technical committee may not have configuration access to the switch. SNMP access (for graphing individual ports) also may not be available, depending on build out. -- Richard

7 7

20G hotter than normal
by Jason Hanke 18 Nov '16

18 Nov '16

Bad weather must be good for MICE. :) Could be a big night. -- Jay Hanke CTO Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke(a)neutralpath.net www.neutralpath.net

4 3

Great Plains additional 10G port
by Jason Hanke 18 Nov '16

18 Nov '16

Please allocate Great Plains Communications xe-2/0/19. They will also need to convert to a LAG configuration with their existing port. -- Jay Hanke CTO Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke(a)neutralpath.net www.neutralpath.net

1 1

IX Denver Event
by Jason Hanke 16 Nov '16

16 Nov '16

IX Denver is having a social December 5th. If you're in the Denver area it'd be a great place to talk peering. Event info here: https://www.facebook.com/events/332369997122169/ -- Jay Hanke CTO Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke(a)neutralpath.net www.neutralpath.net

1 0

Additional 10G port for GigaPop
by Jason Hanke 16 Nov '16

16 Nov '16

I have allocated xe-2/0/27 to be added to the GigaPop LAG (ae0). Welcome aboard! -- Jay Hanke CTO Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke(a)neutralpath.net www.neutralpath.net

2 1

MICE Port Runout
by Jason Hanke 16 Nov '16

16 Nov '16

We are starting to run low on ports on the main switch. If you or your company cares deeply about the quality of internet this would be a great time to consider a donation of $ or gear. -- Jay Hanke CTO Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke(a)neutralpath.net www.neutralpath.net

6 10

MICE Equipment Diagram
by Mike Johnston 15 Nov '16

15 Nov '16

Attached is a diagram that I have have built depicting the MICE equipment and the remote switches. I have included a few notes provided by Jeremy. I have also included port and LAG descriptors, which I was able to obtain from list archives, the website, and cacti. This diagram is mostly intended to be a visual aid when having technical discussion. Diagramming individual participants was not included in the scope of this project. I am interested in constructive feedback, specifically: 1) Is it accurate? Please elaborate if not. 2) Is anything missing that is important to note? For example, is it important to note the management interfaces of the Route Servers? Obviously, we can only put so much information on a single sheet of paper. 3) Is anything not completely obvious? If not, then I need better notes, a key/legend, etc.. Thanks, Mike Johnston Wikstrom Telephone Company

5 6

MRS2 go down?
by Frank Bulk 15 Nov '16

15 Nov '16

We saw the MICE route server #2 go down around 1:47 pm? Frank

5 8