May 2013 - mice-discuss - lists.micemn.net

Re: Hurricane Electric

by Justin Krejci

Any headway on this? Any reoccurrences? -----Original Message----- From: Brandon Mickelson [bmick(a)RRV.NET] Received: Tuesday, 21 May 2013, 10:57am To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Subject: Re: [MICE-DISCUSS] Hurricane Electric I don’t have a specific network to check but it’s basically all traffic during that time so I don’t think it’s a small number of routes. I have an email to noc(a)he.net<mailto:noc@he.net> and I will see what they can tell me. Thanks Brandon Mickelson Network Services Coordinator Halstad Telephone Company RRV Network bmick(a)rrv.net<mailto:bmick@rrv.net> 218-456-2125 x227 1-800-457-2125 From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Jeremy Lumby Sent: Tuesday, May 21, 2013 10:47 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Hurricane Electric I poll my HE, and MICE interfaces at 30 second intervals, and do not see a drop to near 0 in either direction. Do you know of a specific network, and I can see if I my routers are prefering HE to get to it? I am guessing you are right that it may be quite aways upstream. ________________________________ From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Brandon Mickelson Sent: Tuesday, May 21, 2013 10:05 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] Hurricane Electric Has anyone noticed short traffic outages in the early morning in the past week or two? We are noticing this on two separate 10Gig connections at 511. BGP sessions appear to stay connected so we believe it’s further upstream in the HE network. Brandon Mickelson Network Services Coordinator Halstad Telephone Company RRV Network bmick(a)rrv.net<mailto:bmick@rrv.net> 218-456-2125 x227 1-800-457-2125 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 22, 2013

Re: Hurricane Electric

by Nevin Lyne

> From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of > Brandon Mickelson > Sent: Tuesday, May 21, 2013 10:05 AM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: [MICE-DISCUSS] Hurricane Electric > > Has anyone noticed short traffic outages in the early morning in the past > week or two? We are noticing this on two separate 10Gig connections at 511. > BGP sessions appear to stay connected so we believe it's further upstream in > the HE network. Yes, from some indications it seems it maybe at locations jumping from their 10GE to 100GE routes, but I have not completely confirmed that yet. Here are 3 traceroutes taken from 3 (of many) remote monitoring locations this morning inbound to our servers at IPHouse which has direct upstream to HE.net along with MICE of course. This is after http connection failures triggered a root cause analysis: traceroute to 216.243.167.181 (216.243.167.181), 30 hops max, 60 byte packets 1 cr-01.anx08.zur.ch.anexia-it.com (178.255.153.1) 0.436 ms 0.656 ms 0.789 ms 2 80.255.15.181 (80.255.15.181) 0.597 ms 0.738 ms 0.864 ms 3 10gigabitethernet1-4.core1.zrh1.he.net (91.206.52.170) 1.285 ms 1.476 ms 1.661 ms 4 10gigabitethernet4-1.core1.par2.he.net (184.105.222.49) 21.347 ms 21.684 ms 21.913 ms 5 10gigabitethernet7-1.core1.ash1.he.net (184.105.213.93) 100.597 ms 103.648 ms 103.810 ms 6 10gigabitethernet12-7.core1.chi1.he.net (184.105.213.245) 116.076 ms 118.860 ms 119.017 ms 7 * * * 8 * * * 9 * * * 10 * * * 11 * * * 12 * * * 13 * * * 14 * * * 15 * * * 16 * * * 17 * * * 18 * * * 19 * * * 20 * * * 21 * * * 22 * * * 23 * * * 24 * * * 25 * * * 26 * * * 27 * * * 28 * * * 29 * * * 30 * * * traceroute to 216.243.167.181 (216.243.167.181), 30 hops max, 60 byte packets 1 94-247-174-81-static.serverhotell.net (94.247.174.81) 0.291 ms 0.606 ms 0.860 ms 2 d62-181-86-211.cust.tele2.se (62.181.86.211) 1.139 ms 2.991 ms 3.222 ms 3 gbg-core-1.tengige0-3-0-1.tele2.net (130.244.39.118) 2.176 ms 2.468 ms 2.724 ms 4 bck-core-1.bundle-ether2.tele2.net (130.244.39.53) 3.458 ms 3.709 ms 3.975 ms 5 kst5-core-1.bundle-ether4.tele2.net (130.244.39.140) 8.662 ms 8.919 ms 9.144 ms 6 kst5-peer-1.ae0-unit0.tele2.net (130.244.205.125) 21.495 ms 20.633 ms 20.826 ms 7 10gigabitethernet1-2.core1.sto1.he.net (194.68.123.187) 8.306 ms 8.268 ms 8.280 ms 8 10gigabitethernet3-2.core1.ams1.he.net (72.52.92.45) 51.705 ms 51.682 ms 51.680 ms 9 10gigabitethernet1-4.core1.lon1.he.net (72.52.92.81) 32.198 ms 32.149 ms 32.325 ms 10 10gigabitethernet10-4.core1.nyc4.he.net (72.52.92.241) 120.785 ms 116.342 ms 116.106 ms 11 * * * 12 * * * 13 * * * 14 * * * 15 * * * 16 * * * 17 * * * 18 * * * 19 * * * 20 * * * 21 * * * 22 * * * 23 * * * 24 * * * 25 * * * 26 * * * 27 * * * 28 * * * 29 * * * 30 * * * traceroute to 216.243.167.181 (216.243.167.181), 30 hops max, 60 byte packets 1 static-ip-188-138-124-67.inaddr.ip-pool.com (188.138.124.67) 2.828 ms 3.247 ms 3.643 ms 2 static-ip-217-172-191-174.inaddr.ip-pool.com (217.172.191.174) 0.315 ms 0.795 ms 1.186 ms 3 * * * 4 * * * 5 30gigabitethernet4-3.core1.fra1.he.net (80.81.192.172) 14.679 ms 16.295 ms 16.671 ms 6 10gigabitethernet1-4.core1.par2.he.net (184.105.213.162) 15.111 ms 14.885 ms 14.933 ms 7 10gigabitethernet7-1.core1.ash1.he.net (184.105.213.93) 100.806 ms 98.623 ms 98.976 ms 8 10gigabitethernet1-2.core1.atl1.he.net (184.105.213.110) 110.607 ms 104.228 ms 104.508 ms 9 10gigabitethernet3-2.core1.dal1.he.net (184.105.213.113) 138.188 ms 139.042 ms 139.095 ms 10 * * * 11 * * * 12 * * * 13 * * * 14 * * * 15 * * * 16 * * * 17 * * * 18 * * * 19 * * * 20 * * * 21 * * * 22 * * * 23 * * * 24 * * * 25 * * * 26 * * * 27 * * * 28 * * * 29 * * * 30 * * * -- Nevin Lyne -- Founder / Director of Technology -- Gippy's Internet Solutions, LLC. / EngineHosting.com ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 21, 2013

Re: Hurricane Electric

by Dan Olsen

We did see the same issue here? Dan Olsen General Manager Windomnet City OF Windom & Southwest MN Broadband Services 443 10th St PO Box 38 Windom MN 56101 507-832-8007 _____ From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Matthew Beckwell Sent: Tuesday, May 21, 2013 10:45 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Hurricane Electric Hi Brandon, I noticed a traffic drop this morning on our connection, 2:09-2:17am CDT. I'm not sure if that aligns with what you're seeing. I don't have any high-resolution data prior to that. ~Matthew -- Matthew Beckwell - Senior Network and Application Engineer Advanced Integrated Technologies Technical Support: 1-800-300-5408 Office: 1-952-829-5511 x204 E-Mail: matthewb(a)aitech.net From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Brandon Mickelson Sent: Tuesday, May 21, 2013 10:05 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Hurricane Electric Has anyone noticed short traffic outages in the early morning in the past week or two? We are noticing this on two separate 10Gig connections at 511. BGP sessions appear to stay connected so we believe it's further upstream in the HE network. Brandon Mickelson Network Services Coordinator Halstad Telephone Company RRV Network bmick(a)rrv.net 218-456-2125 x227 1-800-457-2125 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> &A=1 _____ No virus found in this message. Checked by AVG - www.avg.com Version: 10.0.1432 / Virus Database: 3162/5843 - Release Date: 05/21/13 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> &A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 21, 2013

Re: Hurricane Electric

by Brandon Mickelson

I don't have a specific network to check but it's basically all traffic during that time so I don't think it's a small number of routes. I have an email to noc(a)he.net and I will see what they can tell me. Thanks Brandon Mickelson Network Services Coordinator Halstad Telephone Company RRV Network bmick(a)rrv.net 218-456-2125 x227 1-800-457-2125 From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Jeremy Lumby Sent: Tuesday, May 21, 2013 10:47 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Hurricane Electric I poll my HE, and MICE interfaces at 30 second intervals, and do not see a drop to near 0 in either direction. Do you know of a specific network, and I can see if I my routers are prefering HE to get to it? I am guessing you are right that it may be quite aways upstream. _____ From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Brandon Mickelson Sent: Tuesday, May 21, 2013 10:05 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Hurricane Electric Has anyone noticed short traffic outages in the early morning in the past week or two? We are noticing this on two separate 10Gig connections at 511. BGP sessions appear to stay connected so we believe it's further upstream in the HE network. Brandon Mickelson Network Services Coordinator Halstad Telephone Company RRV Network bmick(a)rrv.net 218-456-2125 x227 1-800-457-2125 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> &A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> &A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 21, 2013

Re: Hurricane Electric

by Dean Bahls

Hey guys, I don't have high-res graphing either, but notice two drops this morning. One at about 2:15am CDT and another at about 6:55am CDT. Thanks, Dean Dean Bahls Network Services Manager Cooperative Network Services, LLC (218) 346-3635 (office) dean.bahls(a)cooperative-networks.com From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Matthew Beckwell Sent: Tuesday, May 21, 2013 10:45 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Hurricane Electric Hi Brandon, I noticed a traffic drop this morning on our connection, 2:09-2:17am CDT. I'm not sure if that aligns with what you're seeing. I don't have any high-resolution data prior to that. ~Matthew -- Matthew Beckwell - Senior Network and Application Engineer Advanced Integrated Technologies Technical Support: 1-800-300-5408 Office: 1-952-829-5511 x204 E-Mail: matthewb(a)aitech.net From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Brandon Mickelson Sent: Tuesday, May 21, 2013 10:05 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Hurricane Electric Has anyone noticed short traffic outages in the early morning in the past week or two? We are noticing this on two separate 10Gig connections at 511. BGP sessions appear to stay connected so we believe it's further upstream in the HE network. Brandon Mickelson Network Services Coordinator Halstad Telephone Company RRV Network bmick(a)rrv.net 218-456-2125 x227 1-800-457-2125 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> &A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> &A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 21, 2013

Re: Hurricane Electric

by Jeremy Lumby

I poll my HE, and MICE interfaces at 30 second intervals, and do not see a drop to near 0 in either direction. Do you know of a specific network, and I can see if I my routers are prefering HE to get to it? I am guessing you are right that it may be quite aways upstream. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Brandon Mickelson Sent: Tuesday, May 21, 2013 10:05 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Hurricane Electric Has anyone noticed short traffic outages in the early morning in the past week or two? We are noticing this on two separate 10Gig connections at 511. BGP sessions appear to stay connected so we believe it’s further upstream in the HE network. Brandon Mickelson Network Services Coordinator Halstad Telephone Company RRV Network bmick(a)rrv.net 218-456-2125 x227 1-800-457-2125 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 21, 2013

Re: Hurricane Electric

by Matthew Beckwell

Hi Brandon, I noticed a traffic drop this morning on our connection, 2:09-2:17am CDT. I'm not sure if that aligns with what you're seeing. I don't have any high-resolution data prior to that. ~Matthew -- Matthew Beckwell - Senior Network and Application Engineer Advanced Integrated Technologies Technical Support: 1-800-300-5408 Office: 1-952-829-5511 x204 E-Mail: matthewb(a)aitech.net From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Brandon Mickelson Sent: Tuesday, May 21, 2013 10:05 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Hurricane Electric Has anyone noticed short traffic outages in the early morning in the past week or two? We are noticing this on two separate 10Gig connections at 511. BGP sessions appear to stay connected so we believe it's further upstream in the HE network. Brandon Mickelson Network Services Coordinator Halstad Telephone Company RRV Network bmick(a)rrv.net<mailto:bmick@rrv.net> 218-456-2125 x227 1-800-457-2125 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 21, 2013

Re: Hurricane Electric

by Reid Fishler

Brandon- Have you emailed noc(a)he.net when you see these? Reid On Tue, May 21, 2013 at 11:05 AM, Brandon Mickelson <bmick(a)rrv.net> wrote: > Has anyone noticed short traffic outages in the early morning in the past > week or two? We are noticing this on two separate 10Gig connections at > 511. BGP sessions appear to stay connected so we believe it’s further > upstream in the HE network.**** > > ** ** > > Brandon Mickelson**** > > Network Services Coordinator**** > > Halstad Telephone Company**** > > RRV Network**** > > bmick(a)rrv.net**** > > 218-456-2125 x227**** > > 1-800-457-2125**** > > ** ** > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > -- Reid Fishler Director Hurricane Electric +1-510-580-4178 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 21, 2013

Hurricane Electric

by Brandon Mickelson

Has anyone noticed short traffic outages in the early morning in the past week or two? We are noticing this on two separate 10Gig connections at 511. BGP sessions appear to stay connected so we believe it's further upstream in the HE network. Brandon Mickelson Network Services Coordinator Halstad Telephone Company RRV Network <mailto:bmick@rrv.net> bmick(a)rrv.net 218-456-2125 x227 1-800-457-2125 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 21, 2013

Re: Welcome Charter to MICE

by Doug McIntyre

On Fri, May 17, 2013 at 07:10:56PM +0000, Anthony Anderberg wrote: > Speaking of which, does anyone know if there is a way to get these Juniper switches to present SNMP interface IDs for 10G ports that don't yet have SFP+ installed? They didn't cover that topic in my CCIE training. (smile) There isn't any way to the best of my knowledge. The SNMP index is tracked in /var/db/dcd.snmp_ix, but even preconfiguring ports without an SFP in it won't pre-populate that. You could try editing that file with "future" data, and restart snmpd, but I wouldn't want to try that in production, nor do I think it would it would last, or even not crash snmpd due to that practice. -- Doug McIntyre <merlyn(a)iphouse.net> -- ipHouse/Goldengate/Bitstream/ProNS -- Network Engineer/Provisioning/Jack of all Trades ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

May 17, 2013