- mice-discuss - lists.micemn.net

Cologix donates Loaner 4550 switch
by Mike Hemphill Oct. 20, 2015

Oct. 20, 2015

Good afternoon, Cologix has donated a loaner Juniper 4550 to augment the existing Juniper platform. The intent is to provide a bridge to an ultimate upgrade in the switching platform to a more robust chassis solution. Cologix has purchased a new 4550 which it is “loaning” to MICE. This will allow MICE to accept additional 10-Gig members. Additionally, Cologix will provide the maintenance coverage for this device under an agreement that we have that is covering the rest of the Cologix Juniper platform devices. Cologix is pleased to support MICE and we truly appreciate our customers business & the opportunity to host the MICE platform in the Cologix data center. Best regards, Mike Mike Hemphill General Manager | *Cologix, Inc.* <http://www.cologix.com/> 511 11th Ave S, Suite 200 | Minneapolis, MN 55415 P: 1+612.333.1922 | M: 1+612.812.5242 mike.hemphill(a)cologix.com

3 2

MICE UG Meeting
by Shaun Carlson Oct. 19, 2015

Oct. 19, 2015

Good morning all! We are planning on having the next UG meeting on November 16th at 1 pm in the 511 building. I will send out a follow-up with more specific information in the next couple of days. Please let me know what agenda items you may have for the meeting! Thanks! s *Shaun Carlson*Senior Manager of Information Technology | Arvig ph: (218) 346-8673 | em: shaun.carlson(a)arvig.com

1 0

Switch Module Upgrade
by Jeremy Lumby Oct. 8, 2015

Oct. 8, 2015

The last module has been added to the 4500. There were no issues detected during the installation. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington, MN 55425 Main: 612-355-7740 x211 Direct: 612-392-6814 EFax: 952-873-7425 jlumby(a)mnvoip.com

1 0

MICE Route Server issues?
by James Stahr Oct. 6, 2015

Oct. 6, 2015

The exchange *seems* fine, but I can't reliably ping the route servers right now. My BGP sessions to them are up and stable, but ICMP isn't operating "normally" - has anything changed? This started at 15:24 CDT today: [stahr@ctg-bastion ~]$ ping -c 10 206.108.255.1 PING 206.108.255.1 (206.108.255.1) 56(84) bytes of data. 64 bytes from 206.108.255.1: icmp_seq=7 ttl=59 time=7.06 ms --- 206.108.255.1 ping statistics --- 10 packets transmitted, 1 received, 90% packet loss, time 9000ms rtt min/avg/max/mdev = 7.062/7.062/7.062/0.000 ms [stahr@ctg-bastion ~]$ ping -c 10 206.108.255.2 PING 206.108.255.2 (206.108.255.2) 56(84) bytes of data. 64 bytes from 206.108.255.2: icmp_seq=2 ttl=59 time=7.13 ms 64 bytes from 206.108.255.2: icmp_seq=6 ttl=59 time=6.98 ms 64 bytes from 206.108.255.2: icmp_seq=7 ttl=59 time=6.94 ms 64 bytes from 206.108.255.2: icmp_seq=10 ttl=59 time=7.05 ms --- 206.108.255.2 ping statistics --- 10 packets transmitted, 4 received, 60% packet loss, time 9001ms rtt min/avg/max/mdev = 6.942/7.028/7.135/0.093 ms [stahr@ctg-bastion ~]$ ping -c 10 206.108.255.52 PING 206.108.255.52 (206.108.255.52) 56(84) bytes of data. 64 bytes from 206.108.255.52: icmp_seq=1 ttl=61 time=14.0 ms 64 bytes from 206.108.255.52: icmp_seq=2 ttl=61 time=14.5 ms 64 bytes from 206.108.255.52: icmp_seq=3 ttl=61 time=14.0 ms 64 bytes from 206.108.255.52: icmp_seq=4 ttl=61 time=13.6 ms 64 bytes from 206.108.255.52: icmp_seq=5 ttl=61 time=13.0 ms 64 bytes from 206.108.255.52: icmp_seq=6 ttl=61 time=12.7 ms 64 bytes from 206.108.255.52: icmp_seq=7 ttl=61 time=12.2 ms 64 bytes from 206.108.255.52: icmp_seq=8 ttl=61 time=11.7 ms 64 bytes from 206.108.255.52: icmp_seq=9 ttl=61 time=11.2 ms 64 bytes from 206.108.255.52: icmp_seq=10 ttl=61 time=11.9 ms --- 206.108.255.52 ping statistics --- 10 packets transmitted, 10 received, 0% packet loss, time 9002ms rtt min/avg/max/mdev = 11.289/12.913/14.502/1.052 ms [stahr@ctg-bastion ~]$ Any new policing policy applied today? I seem to be able to ping normally if I use my 206.108.255.x address, but not reliably from any other address: r-pop-min-1#ping 206.108.255.1 repeat 100 source gig0/0/5 Type escape sequence to abort. Sending 100, 100-byte ICMP Echos to 206.108.255.1, timeout is 2 seconds: Packet sent with a source address of 206.108.255.26 !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! !!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Success rate is 100 percent (100/100), round-trip min/avg/max = 1/1/1 ms r-pop-min-1#ping 206.108.255.2 repeat 100 source gig0/0/5 Type escape sequence to abort. Sending 100, 100-byte ICMP Echos to 206.108.255.2, timeout is 2 seconds: Packet sent with a source address of 206.108.255.26 !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! !!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Success rate is 100 percent (100/100), round-trip min/avg/max = 1/1/1 ms r-pop-min-1#ping 206.108.255.1 repeat 100 source loop1 Type escape sequence to abort. Sending 100, 100-byte ICMP Echos to 206.108.255.1, timeout is 2 seconds: Packet sent with a source address of 205.173.182.62 ...!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! !!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Success rate is 97 percent (97/100), round-trip min/avg/max = 1/1/1 ms r-pop-min-1#ping 206.108.255.2 repeat 100 source loop1 Type escape sequence to abort. Sending 100, 100-byte ICMP Echos to 206.108.255.2, timeout is 2 seconds: Packet sent with a source address of 205.173.182.62 ...!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! !!!!!!!!!!!!!!!!!!!!!!!!!!!!!! Success rate is 97 percent (97/100), round-trip min/avg/max = 1/1/2 ms r-pop-min-1# -James

6 7

Netflix Additional ports
by Jason Hanke Oct. 5, 2015

Oct. 5, 2015

Please assign and add the following ports to the Netflix LAG xe-0/2/0 xe-0/2/1 xe-0/2/2 Thanks! -- Jay Hanke CTO Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke(a)neutralpath.net www.neutralpath.net

4 3

Juniper Donation
by Jeremy Lumby Oct. 5, 2015

Oct. 5, 2015

I have procured, and will be donating the final expansion module to the 4500 switch. This will max out the 4500 with 10G ports. I plan on installing it on 10/8/2015 around 1PM central time. Based upon the installation of the previous 4500 module, I do not expect any impact on traffic. Could someone who has the appropriate permissions please copy this to the announce list. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington, MN 55425 Main: 612-355-7740 x211 Direct: 612-392-6814 EFax: 952-873-7425 jlumby(a)mnvoip.com

4 3

Upcoming MICE Meeting
by Shaun Carlson Sept. 3, 2015

Sept. 3, 2015

All, We will NOT be having a meeting on 9/16 as originally planned. I will send out a new date in a few days. Please let me know if there is any preference for or against a specific date in October time frame. Thanks! s *Shaun Carlson*Senior Manager of Information Technology | Arvig ph: (218) 346-8673 | em: shaun.carlson(a)arvig.com

3 2

Are there any public bwctl servers within MICE?
by Tim Peiffer Sept. 1, 2015

Sept. 1, 2015

Other than the University of Minnesota, are there any unregistered publicly reachable bwctl servers within MICE in specific, or MInnesota in general ? I would like to do speed measurement across CenturyLink DSL, Comcast Cable and a few other residential networks. Tim Peiffer -- Tim Peiffer Network Support Engineer Office of Information Technology University of Minnesota/NorthernLights GigaPOP +1 612 626-7884 (desk)

1 0

PSA: Level3/TWTC
by Mike Horwath Aug. 27, 2015

Aug. 27, 2015

Nice outage: http://mailman.nanog.org/pipermail/nanog/2015-August/078610.html eewps! Affecting people I know and going on 4 hours long. -- Mike Horwath, reachable via drechsau(a)Geeks.ORG

1 0

Level3?
by Doug McIntyre Aug. 26, 2015

Aug. 26, 2015

Does anybody buy Level3 transit in the Minneapolis area? We're looking for certain paths out of them that have been hotpoints in the past, so looking to run some traceroutes through their transit in Minneapolis to a few points. Thanks! -- Doug McIntyre <merlyn(a)iphouse.net> ~.~ ipHouse ~.~ Network Engineer/Provisioning/Jack of all Trades

8 9

Number of prefixes received exceeds limit - HE IPv6 routes via the route servers?
by James Stahr Aug. 20, 2015

Aug. 20, 2015

Is someone just start re-advertising HE via the route server or did we just configure today a session for HE to the route server? It was my impression that they only did bilateral peering. Aug 20 14:04:01.902 CDT: %BGP-4-MAXPFX: Number of prefixes received from 2001:504:27::D1AF:0:1 (afi 1) reaches 143, max 150 Aug 20 14:04:01.908 CDT: %BGP-3-MAXPFXEXCEED: Number of prefixes received from 2001:504:27::D1AF:0:1 (afi 1): 151 exceeds limit 150 Our session is currently down and will remain down. When the session was up, we saw all of the paths start with 6939. James Stahr CDW

4 4

Please welcome Cloudflare to MICE!
by Jason Hanke Aug. 14, 2015

Aug. 14, 2015

Company: Cloudflare Port CFA/LOA (Main Switch): xe-0/1/0, xe-0/1/1 (20G LAG on Uplink module) ASN: 13335 IPv4: 206.108.255.45/24 IPv6: 2001:504:27:0:0:3417::1/64 Peering Contact: peering(a)cloudflare.com Cloudflare will provide SFP+ modules for their connections to Cologix for installation Route Server/website updates please! Welcome aboard! -- Jay Hanke CTO Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke(a)neutralpath.net www.neutralpath.net

5 4

SNMP Measurements for MICE?
by Hannigan, Martin Aug. 12, 2015

Aug. 12, 2015

All, Isn’t 95th @ 1m unusual and non-standard? http://micelg.usinternet.com/export/graph_385.html Best, -M<

8 12

MICE Switch Upgrade
by Anthony Anderberg July 30, 2015

July 30, 2015

As everyone will recall the exchange has had problems with the main switch flooding unicast traffic a couple times in the last few years. Juniper believes we're encountering a known bug that has been fixed in later software releases. Here's the bug description for people with Juniper support ids, as we'd suspected it deals with L2 database MAC learning/maintaining: https://prsearch.juniper.net/InfoCenter/index?page=prcontent&id=PR695200 The upgrade will require a short interruption in exchange traffic. We're currently planning on performing the upgrade next week on Wednesday morning - July 29th between 5am and 7am, that should be the low point in our daily traffic volume. Can someone forward this to the Announce list? Cheers, anthony Anthony Anderberg Sr. Systems Analyst [NUtel_email_logo_1] 320-234-5239 anthonyanderberg(a)nu-telecom.net<mailto:anthonyanderberg@nu-telecom.net> www.nutelecom.net<http://www.nutelecom.net>

9 11

Multiple members reporting no light on the main switch
by Jason Hanke July 26, 2015

July 26, 2015

There are multiple reports of members not getting light from the main switch. Cacti graphing is down. -- Jay Hanke CTO Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke(a)neutralpath.net www.neutralpath.net

9 13

Fwd: chn00102685,-,mice,l3ppc,-,tge,MICE_public_switch_fabric is DOWN
by Jason Hanke July 25, 2015

July 25, 2015

can someone take a peek? ---------- Forwarded message ---------- From: NOC IP <svc_NNOCIP(a)charter.com> Date: Fri, Jul 24, 2015 at 7:04 PM Subject: chn00102685,-,mice,l3ppc,-,tge,MICE_public_switch_fabric is DOWN To: "peering(a)micemn.net" <peering(a)micemn.net> MICE, Charter Communications is not getting any incoming light at the Colo link. Could you please check this link and reply with any issues from your end? Thank you, *[image: CharterCommunicatio#B375E30]* *Katie McCarthy, *CCNA | Network Operations Technician II | 866.248.7662 Opt. 2 9333 Dielman Industrial Drive | St Louis, MO 63132 *Please do your part to reduce unnecessary email volume by directing your request to the appropriate NOC group using the following distribution lists:* · *Critical Facilities*: DLCriticalFacilities(a)Charter.com · *IP, CMTS, Optical*: DLNOCIP(a)Charter.Com · *Video*: DLNOCVideo(a)Charter.com · *Voice*: DLNOCVoice(a)Charter.com -- Jay Hanke CTO Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke(a)neutralpath.net www.neutralpath.net

3 2

CNS Switch - Cacti Graph Anomalies
by Justin Krejci July 23, 2015

July 23, 2015

Looks like there is maybe some kind of trouble with the CNS Switch. There are a lot of cacti graphing gaps displayed but only for the ports being queried on the CNS switch itself. Looks like it started around 2pm yesterday. Looking at the LAG port graph off the main switch, it does not appear to be affecting actual member traffic so it may be a management issue with the CNS switch or some other control plane issue possibly. Could be indicative of a larger, brewing problem.

1 0

Minutes from UG 17
by Shaun Carlson July 15, 2015

July 15, 2015

Please see attached minutes and attendance record. Please note the attendance record also includes the vote counts for validation purposes. Please let me know if there are any corrections or omissions. Thanks! s *Shaun Carlson*Senior Manager of Information Technology | Arvig ph: (218) 346-8673 | em: shaun.carlson(a)arvig.com

1 0

Please log into we webex for meeting
by Mike Horwath July 15, 2015

July 15, 2015

Thank you. -- Mike Horwath via iPad.

1 0

Agenda and Documents for Tomorrow's Meeting
by Shaun Carlson July 15, 2015

July 15, 2015

All, Please see the attached Agenda and related documents for tomorrow's meeting, let me know if you have any questions. I plan to start the Webex at least 15 minutes prior to the meeting start time, please try to join a few minutes early to test and resolve any audio/video issues. In addition, *to facilitate communication, please use a Webcam if at all possible*. Here are the Webex meeting details again: Regular, Quarterly Meeting (On-Site and Virtual): Vote on 501.(c)6 - Wednesday, July 15th at 4:00 PM - Location: 511 Building Cafeteria - Webex Meeting Number: 196 840 950 When you sign into the virtual meeting, please log in with your company name and ASN to make tracking attendees easier. As with last time, I'll do a roll call to simplify the process since the virtual element makes things a little tougher. Documents Attached: - MICE UG 17 - Agenda -> Agenda for Tomorrow's Meeting - MICE UG 17 - Proxy Ballot -> Proxy Ballot Document for 501(c)(6) Vote(s) - MICE UG 17 - Attendance -> List of MICE members for attendance tracking - MICE, LLC - Amended and Restated Articles of Organization - MICE, LLC - Bylaws of Midwest Internet Cooperative Exchange LLC - MICE, LLC - Resolution secretary certifying amendment - MICE, LLC - Resolution approving Amended and Restated Articles Please let me know if there are any questions or follow-up correspondence requested. Thank you all and I look forward to seeing you tomorrow! s *Shaun Carlson*Senior Manager of Information Technology | Arvig ph: (218) 346-8673 | em: shaun.carlson(a)arvig.com

6 5

FYI 11th Ave closed
by David Farmer July 15, 2015

July 15, 2015

11th Ave is closed at the light rail. To get from Washington Ave to 511 use Portland Ave Sent from my iPhone

1 0

IPv6 issues to HE over MICE
by David Farmer July 15, 2015

July 15, 2015

We are seeing issues with IPv6 traffic over MICE to HE, things are working fine over our customer link to HE. I've opened a ticket with them. We dropped our IPv6 peering overnight with MICE, but things might be getting worse as NDSU is reporting problems with there other providers that goes across MICE as well. So, I'm sending out a head up to others connected via MICE. Thanks -- ================================================ David Farmer Email: farmer(a)umn.edu Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 1-612-626-0815 Minneapolis, MN 55414-3029 Cell: 1-612-812-9952 ================================================

1 0

Re: Please welcome Vast Broadband to MICE
by Jason Hanke July 13, 2015

July 13, 2015

I believe that Anthony finished up the config on the 19th of June. MICE should be ready to go. Is Vast sending someone up to meeting on Wednesday? There is a critical vote on the MICE non-profit status. Jay On Mon, Jul 13, 2015 at 12:19 PM, Daryl Elcock < Daryl.Elcock(a)vastbroadband.com> wrote: > We are getting close to a cutover, can you please verify everything is > ready on your end? > > Thanks, > > -----Original Message----- > From: Jason Hanke [mailto:jayhanke@neutralpath.net] > Sent: Friday, June 19, 2015 1:28 PM > To: MICE Discuss; Eric Hiben; Daryl Elcock; Mitch Elfstrand > Subject: Please welcome Vast Broadband to MICE > > Port: xe-0/0/32 (Main Switch) > Name: Vast Broadband > ASN: 20412 > IPv4: 206.108.255.24/24 > IPv6: 2607:fe10:ffff::242001:504:27:0:0:4fbc::1/64 > Peering Contact: peering(a)vastbroadband.com > > Route Server configuration and website updates please! > > Welcome aboard! > > -- > Jay Hanke > CTO > Neutral Path Communications > 3 Civic Center Plaza, Suite 204 > Mankato, MN 56001 > (507) 327-2398 mobile > jayhanke(a)neutralpath.net > www.neutralpath.net > -- Jay Hanke CTO Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke(a)neutralpath.net www.neutralpath.net

1 0

Please welcome Great Plains Communications to MICE
by Jason Hanke July 9, 2015

July 9, 2015

Port: xe-0/0/26 (Main Switch) ASN: 11317 IPv4: 206.108.255.122/24 IPv6: 2001:504:27:0:0:2C35::1/64 Contact: peering(a)gpcom.com Route servers and website please! Welcome Aboard! -- Jay Hanke CTO Neutral Path Communications 3 Civic Center Plaza, Suite 204 Mankato, MN 56001 (507) 327-2398 mobile jayhanke(a)neutralpath.net www.neutralpath.net

4 8

Reminder: Quarterly Meeting on July 15th at the 511 Building
by Shaun Carlson July 9, 2015

July 9, 2015

All, I wanted to send out a quick reminder of the upcoming quarterly meeting with a vote on the 501.(c)6 status on July 15th. *Regular, Quarterly Meeting (On-Site and Virtual): Vote on 501.(c)6* - Wednesday, July 15th at 4:00 PM - Location: 511 Building Cafeteria - Webex Meeting Number: 196 840 950 Please be sure to mark your calendars. We'll also need quorum to vote and if you plan to use a proxy to vote, please reach out to Reid, Mike or myself to be sure we've got the proper coordination and documentation. I will have a Webex available but I would *HIGHLY RECOMMEND* attending in person for this meeting. Thanks! s *Shaun Carlson*Senior Manager of Information Technology | Arvig ph: (218) 346-8673 | em: shaun.carlson(a)arvig.com

8 14