- mice-discuss - lists.micemn.net

Re: Mice Issues

by Andrew Hoyos

I'd agree. I've posted this a few times before, but AMS-IX has an *excellent* guide on how to properly configure your ports facing the IX (both in routed port or layer2 port scenario). https://www.ams-ix.net/config-guide/ Spanning tree interaction between the IX and members is just a recipe for disaster. I think if everyone takes a few minutes to review that and properly configure ports, most of these concerns would be alleviated. Thanks! Andrew -- Andrew Hoyos Hoyos Consulting LLC ofc: +1 608 616 9950 andrew(a)hoyosconsulting.com http://www.hoyosconsulting.com/ On Feb 20, 2014, at 1:59 PM, Jeremy Lumby wrote: > I think we should revisit the topic of how to better protect MICE from these Layer 2 issues that we have had a few of in the history of MICE. I feel that stability is extremely important, especially when it comes to attracting new members, as well as getting existing members to increase their capacity. I know that many of the Layer 2 security measures that are possible for the exchange increase the amount of administrative time that needs to be put into the exchange, however I feel it may be very well worth the extra work when adding/maintaining members' connections > > I was looking through my log files, and during the outage, I saw a bunch of entries stating: > %IPV6-3-CONFLICT: Router FE80::21D:71FF:FE98:74C0 on GigabitEthernet0/2 has conflicting ND settings > I am not very familiar with this error, and not sure if it was just as a result of the degraded conditions on MICE, or if it had something to do with the cause. > > Jeremy > > ######################################################################## > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 20, 2014

Re: Mice Issues

by Jeremy Lumby

I think we should revisit the topic of how to better protect MICE from these Layer 2 issues that we have had a few of in the history of MICE. I feel that stability is extremely important, especially when it comes to attracting new members, as well as getting existing members to increase their capacity. I know that many of the Layer 2 security measures that are possible for the exchange increase the amount of administrative time that needs to be put into the exchange, however I feel it may be very well worth the extra work when adding/maintaining members' connections I was looking through my log files, and during the outage, I saw a bunch of entries stating: %IPV6-3-CONFLICT: Router FE80::21D:71FF:FE98:74C0 on GigabitEthernet0/2 has conflicting ND settings I am not very familiar with this error, and not sure if it was just as a result of the degraded conditions on MICE, or if it had something to do with the cause. Jeremy ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 20, 2014

Re: MICE Traffic

by Mike Horwath

On Feb 20, 2014, at 3:38 PM, Jay Hanke <jayhanke(a)MANKATONETWORKS.NET> wrote: > It looks like we ran over 29 Gb/s of legit traffic (in+out) earlier > this afternoon! That’s awesome! -- Mike Horwath, reachable via drechsau(a)Geeks.ORG ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 20, 2014

MICE Traffic

by Jay Hanke

It looks like we ran over 29 Gb/s of legit traffic (in+out) earlier this afternoon! -- Jay Hanke CTO, CCIE #19093 Mankato Networks LLC PO Box 54 619 S Front St Mankato, MN 56001-3838 Google 530-618-2398 jayhanke(a)mankatonetworks.net http://www.mankatonetworks.com http://www.neutralpath.net ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 20, 2014

Re: Mice Issues

by Jeremy Lumby

Charter Update: I am providing this update to let others know what I went through after the outage to get re-connected to Charter in the event that others are seeing similar issues, hopefully it can cut a lot of troubleshooting time. -When the outage happened yesterday I shut down my MICE port. -All traffic shifted to my other upstreams as expected, other than Charter -I could not pass 2 way traffic with anyone on Charter's network. -Some traceroutes from Charter's side showed that traffic heading to me was hitting their peering router that was connected to MICE, even though my BGP session with them had been down for hours -Charter's peering router showed that my BGP session was still established through MICE from prior to the outage starting. -Charter attempted to clear the BGP connection to me as well as do a shutdown on my neighbor statement, however whenever they looked at it, it still showed established with the timer reflecting it being up prior to the MICE outage. -I turned my MICE port back up, and return traffic from Charter started making it to me, despite BGP being down from my point of view. -It took Charter removing all of their neighbor statements to me, and re-entering them before BGP properly re-established in both directions. -The entire time our IPv6 session worked as expected -We are both running Cisco hardware, I believe they have a 9K and I have a 7206VXR-G2 I hope this helps others out with troubleshooting in the future Jeremy -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of David Farmer Sent: Wednesday, February 19, 2014 5:58 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Mice Issues On 2/19/14, 17:45 , Jeremy Lumby wrote: > Is anyone else having issues with connectivity to Charter? I have > re-established connectivity to every one else through my other > upstreams, other than Charter. I am keeping my MICE port down > overnight for good measure. Our peering with Charter has reestablished via MICE, everything looks good here. -- ================================================ David Farmer Email: farmer(a)umn.edu Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 1-612-626-0815 Minneapolis, MN 55414-3029 Cell: 1-612-812-9952 ================================================ ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 20, 2014

Re: Mice Issues

by David Farmer

On 2/19/14, 17:45 , Jeremy Lumby wrote: > Is anyone else having issues with connectivity to Charter? I have > re-established connectivity to every one else through my other > upstreams, other than Charter. I am keeping my MICE port down overnight > for good measure. Our peering with Charter has reestablished via MICE, everything looks good here. -- ================================================ David Farmer Email: farmer(a)umn.edu Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 1-612-626-0815 Minneapolis, MN 55414-3029 Cell: 1-612-812-9952 ================================================ ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Dan Boehlke

So next question, which flavor of spanning tree is best. I configured PVST on a reflex, but remembered that the MICE switch is a Juniper, not a Cisco. Simple dot1d? -- Dan B. On Feb 19, 2014, at 5:50 PM, David Farmer <farmer(a)UMN.EDU> wrote: > On 2/19/14, 17:43 , Richard Laager wrote: >> On Wed, 2014-02-19 at 17:40 -0600, Dan Boehlke wrote: >>> The Vaultas switch has been configured to participate in spanning-tree >> >> Is that really what we want? > > There are philosophical arguments both ways on this one. Given our cooperative management there is an argument to having spanning tree there to catch us if/when we screw up. > > In a very tightly managed situation where there can be no loops then there is an argument to turn-off spanning tree, but god help you if there ever is a loop. > > > -- > ================================================ > David Farmer Email: farmer(a)umn.edu > Office of Information Technology > University of Minnesota > 2218 University Ave SE Phone: 1-612-626-0815 > Minneapolis, MN 55414-3029 Cell: 1-612-812-9952 > ================================================ > > ######################################################################## > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by David Farmer

On 2/19/14, 17:43 , Richard Laager wrote: > On Wed, 2014-02-19 at 17:40 -0600, Dan Boehlke wrote: >> The Vaultas switch has been configured to participate in spanning-tree > > Is that really what we want? There are philosophical arguments both ways on this one. Given our cooperative management there is an argument to having spanning tree there to catch us if/when we screw up. In a very tightly managed situation where there can be no loops then there is an argument to turn-off spanning tree, but god help you if there ever is a loop. -- ================================================ David Farmer Email: farmer(a)umn.edu Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 1-612-626-0815 Minneapolis, MN 55414-3029 Cell: 1-612-812-9952 ================================================ ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Dan Boehlke

I was just thinking that, because generally exchange point best practice is to turn spanning tree off. So maybe I shouldn't be embarrassed for not having done it.... :-( -- Dan B. On Feb 19, 2014, at 5:43 PM, Richard Laager <rlaager(a)wiktel.com> wrote: > On Wed, 2014-02-19 at 17:40 -0600, Dan Boehlke wrote: >> The Vaultas switch has been configured to participate in spanning-tree > > Is that really what we want? > > -- > Richard > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Jeremy Lumby

Is anyone else having issues with connectivity to Charter? I have re-established connectivity to every one else through my other upstreams, other than Charter. I am keeping my MICE port down overnight for good measure. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Dan Boehlke Sent: Wednesday, February 19, 2014 5:41 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Mice Issues The Vaultas switch has been configured to participate in spanning-tree, so it won't blindly go along with loops any more. Sorry. The Vaultas switch didn't make the loop, it just made it worse. Any word on the origination of the loop? -- Dan Boehlke dboehlke(a)mac.com On Feb 19, 2014, at 4:47 PM, Jay Hanke <jayhanke(a)MANKATONETWORKS.NET> wrote: Got ssh, that mac doug sent out belongs to Vaultas. On Wed, Feb 19, 2014 at 2:27 PM, Jay Hanke <jayhanke(a)mankatonetworks.net> wrote: There are two Extreme networks on the Mankato Remote switch, Vaultas and Revnet. I don't have ssh right now, can someone check? On Wed, Feb 19, 2014 at 2:21 PM, Doug McIntyre <merlyn(a)iphouse.net> wrote: On Wed, Feb 19, 2014 at 04:03:15PM -0600, Richard Laager wrote: Can someone look at the route server logs and see who the new IPv4 peer was that showed up just before this problem started? Nobody turned up recently. A better measure is who turned up on the switch rather than the route-server. This was a l2 flood, not anything in routing. No ports were up/down on the switch until the flood triggered my port and Implex's port offline (probably the same class of cisco switch protecting themselves from the l2 flood). Feb 19 15:11:45 MICE-SW1 mib2d[1107]: SNMP_TRAP_LINK_DOWN: ifIndex 604, ifAdminStatus up(1), ifOperStatus down(2), ifName ge-1/0/3 Feb 19 15:11:48 MICE-SW1 mib2d[1107]: SNMP_TRAP_LINK_DOWN: ifIndex 606, ifAdminStatus up(1), ifOperStatus down(2), ifName ge-1/0/5 So, it probably was from one of the existing remote switches. The MAC address I posted about before is an Extreme? switch. Also, the l2 flood seems abated. I've been pinging clear to the route servers for 5 minutes now. -- Doug McIntyre <merlyn(a)iphouse.net> ~.~ ipHouse ~.~ Network Engineer/Provisioning/Jack of all Trades ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke CTO, CCIE #19093 Mankato Networks LLC PO Box 54 619 S Front St Mankato, MN 56001-3838 Google 530-618-2398 jayhanke(a)mankatonetworks.net http://www.mankatonetworks.com http://www.neutralpath.net -- Jay Hanke CTO, CCIE #19093 Mankato Networks LLC PO Box 54 619 S Front St Mankato, MN 56001-3838 Google 530-618-2398 jayhanke(a)mankatonetworks.net http://www.mankatonetworks.com http://www.neutralpath.net ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Richard Laager

On Wed, 2014-02-19 at 17:40 -0600, Dan Boehlke wrote: > The Vaultas switch has been configured to participate in spanning-tree Is that really what we want? -- Richard ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Dan Boehlke

The Vaultas switch has been configured to participate in spanning-tree, so it won't blindly go along with loops any more. Sorry. The Vaultas switch didn't make the loop, it just made it worse. Any word on the origination of the loop? -- Dan Boehlke dboehlke(a)mac.com On Feb 19, 2014, at 4:47 PM, Jay Hanke <jayhanke(a)MANKATONETWORKS.NET> wrote: > Got ssh, that mac doug sent out belongs to Vaultas. > > On Wed, Feb 19, 2014 at 2:27 PM, Jay Hanke <jayhanke(a)mankatonetworks.net> wrote: >> There are two Extreme networks on the Mankato Remote switch, Vaultas >> and Revnet. I don't have ssh right now, can someone check? >> >> On Wed, Feb 19, 2014 at 2:21 PM, Doug McIntyre <merlyn(a)iphouse.net> wrote: >>> On Wed, Feb 19, 2014 at 04:03:15PM -0600, Richard Laager wrote: >>>> Can someone look at the route server logs and see who the new IPv4 peer >>>> was that showed up just before this problem started? >>> >>> Nobody turned up recently. >>> >>> A better measure is who turned up on the switch rather than the route-server. >>> This was a l2 flood, not anything in routing. >>> >>> No ports were up/down on the switch until the flood triggered >>> my port and Implex's port offline (probably the same class of cisco switch >>> protecting themselves from the l2 flood). >>> >>> Feb 19 15:11:45 MICE-SW1 mib2d[1107]: SNMP_TRAP_LINK_DOWN: ifIndex 604, ifAdminStatus up(1), ifOperStatus down(2), ifName ge-1/0/3 >>> Feb 19 15:11:48 MICE-SW1 mib2d[1107]: SNMP_TRAP_LINK_DOWN: ifIndex 606, ifAdminStatus up(1), ifOperStatus down(2), ifName ge-1/0/5 >>> >>> So, it probably was from one of the existing remote switches. >>> >>> The MAC address I posted about before is an Extreme? switch. >>> >>> >>> Also, the l2 flood seems abated. >>> >>> I've been pinging clear to the route servers for 5 minutes now. >>> >>> >>> >>> -- >>> Doug McIntyre <merlyn(a)iphouse.net> >>> ~.~ ipHouse ~.~ >>> Network Engineer/Provisioning/Jack of all Trades >>> >>> ######################################################################## >>> >>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >> >> >> >> -- >> Jay Hanke >> CTO, CCIE #19093 >> Mankato Networks LLC >> PO Box 54 >> 619 S Front St >> Mankato, MN 56001-3838 >> Google 530-618-2398 >> jayhanke(a)mankatonetworks.net >> http://www.mankatonetworks.com >> http://www.neutralpath.net > > > > -- > Jay Hanke > CTO, CCIE #19093 > Mankato Networks LLC > PO Box 54 > 619 S Front St > Mankato, MN 56001-3838 > Google 530-618-2398 > jayhanke(a)mankatonetworks.net > http://www.mankatonetworks.com > http://www.neutralpath.net > > ######################################################################## > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Jay Hanke

Got ssh, that mac doug sent out belongs to Vaultas. On Wed, Feb 19, 2014 at 2:27 PM, Jay Hanke <jayhanke(a)mankatonetworks.net> wrote: > There are two Extreme networks on the Mankato Remote switch, Vaultas > and Revnet. I don't have ssh right now, can someone check? > > On Wed, Feb 19, 2014 at 2:21 PM, Doug McIntyre <merlyn(a)iphouse.net> wrote: >> On Wed, Feb 19, 2014 at 04:03:15PM -0600, Richard Laager wrote: >>> Can someone look at the route server logs and see who the new IPv4 peer >>> was that showed up just before this problem started? >> >> Nobody turned up recently. >> >> A better measure is who turned up on the switch rather than the route-server. >> This was a l2 flood, not anything in routing. >> >> No ports were up/down on the switch until the flood triggered >> my port and Implex's port offline (probably the same class of cisco switch >> protecting themselves from the l2 flood). >> >> Feb 19 15:11:45 MICE-SW1 mib2d[1107]: SNMP_TRAP_LINK_DOWN: ifIndex 604, ifAdminStatus up(1), ifOperStatus down(2), ifName ge-1/0/3 >> Feb 19 15:11:48 MICE-SW1 mib2d[1107]: SNMP_TRAP_LINK_DOWN: ifIndex 606, ifAdminStatus up(1), ifOperStatus down(2), ifName ge-1/0/5 >> >> So, it probably was from one of the existing remote switches. >> >> The MAC address I posted about before is an Extreme? switch. >> >> >> Also, the l2 flood seems abated. >> >> I've been pinging clear to the route servers for 5 minutes now. >> >> >> >> -- >> Doug McIntyre <merlyn(a)iphouse.net> >> ~.~ ipHouse ~.~ >> Network Engineer/Provisioning/Jack of all Trades >> >> ######################################################################## >> >> To unsubscribe from the MICE-DISCUSS list, click the following link: >> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > > -- > Jay Hanke > CTO, CCIE #19093 > Mankato Networks LLC > PO Box 54 > 619 S Front St > Mankato, MN 56001-3838 > Google 530-618-2398 > jayhanke(a)mankatonetworks.net > http://www.mankatonetworks.com > http://www.neutralpath.net -- Jay Hanke CTO, CCIE #19093 Mankato Networks LLC PO Box 54 619 S Front St Mankato, MN 56001-3838 Google 530-618-2398 jayhanke(a)mankatonetworks.net http://www.mankatonetworks.com http://www.neutralpath.net ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Larry Patterson

Did they plug in a switch or a router? Was it a loop? Are there loop mitigation techniques in place to automatically shutdown offending ports? When would you suggest that it's safe to come back online? On 2/19/14 4:40 PM, "Jay Hanke" <jayhanke(a)MANKATONETWORKS.NET> wrote: >HCMC turned up peering this afternoon, l2 has been up for several days. > >I think the timing was maybe 20 minutes prior to issue. > > > >On Wed, Feb 19, 2014 at 2:03 PM, Richard Laager <rlaager(a)wiktel.com> >wrote: >> Can someone look at the route server logs and see who the new IPv4 peer >> was that showed up just before this problem started? >> >> -- >> Richard >> >> ######################################################################## >> >> To unsubscribe from the MICE-DISCUSS list, click the following link: >> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > >-- >Jay Hanke >CTO, CCIE #19093 >Mankato Networks LLC >PO Box 54 >619 S Front St >Mankato, MN 56001-3838 >Google 530-618-2398 >jayhanke(a)mankatonetworks.net >http://www.mankatonetworks.com >http://www.neutralpath.net > >######################################################################## > >To unsubscribe from the MICE-DISCUSS list, click the following link: >http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Jeff Anderson

Our port flipped to err-dis due to a detected loop. Jeff Anderson jeffa(a)implex.net 612.799.7277 Cell 612.339.8255 x200 Office 612.339.3310 Fax -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of David Farmer Sent: Wednesday, February 19, 2014 4:34 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Mice Issues On 2/19/14, 16:21 , Doug McIntyre wrote: > Also, the l2 flood seems abated. > > I've been pinging clear to the route servers for 5 minutes now. From looking at my CPU history, the appears to started 85 minutes ago, peaked about 75 minutes ago, subsided about 25 minutes ago. We saw BGP flaps all over the place, all peerings are back now except our peering with Implex, which has been down for 80 minutes or so. -- ================================================ David Farmer Email: farmer(a)umn.edu Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 1-612-626-0815 Minneapolis, MN 55414-3029 Cell: 1-612-812-9952 ================================================ ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Jay Hanke

HCMC turned up peering this afternoon, l2 has been up for several days. I think the timing was maybe 20 minutes prior to issue. On Wed, Feb 19, 2014 at 2:03 PM, Richard Laager <rlaager(a)wiktel.com> wrote: > Can someone look at the route server logs and see who the new IPv4 peer > was that showed up just before this problem started? > > -- > Richard > > ######################################################################## > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke CTO, CCIE #19093 Mankato Networks LLC PO Box 54 619 S Front St Mankato, MN 56001-3838 Google 530-618-2398 jayhanke(a)mankatonetworks.net http://www.mankatonetworks.com http://www.neutralpath.net ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by David Farmer

On 2/19/14, 16:33 , David Farmer wrote: > On 2/19/14, 16:21 , Doug McIntyre wrote: > >> Also, the l2 flood seems abated. >> >> I've been pinging clear to the route servers for 5 minutes now. > > From looking at my CPU history, the appears to started 85 minutes ago, > peaked about 75 minutes ago, subsided about 25 minutes ago. > > We saw BGP flaps all over the place, all peerings are back now except > our peering with Implex, which has been down for 80 minutes or so. Implex is back now too, so all our direct peerings are back up. -- ================================================ David Farmer Email: farmer(a)umn.edu Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 1-612-626-0815 Minneapolis, MN 55414-3029 Cell: 1-612-812-9952 ================================================ ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by David Farmer

On 2/19/14, 16:21 , Doug McIntyre wrote: > Also, the l2 flood seems abated. > > I've been pinging clear to the route servers for 5 minutes now. From looking at my CPU history, the appears to started 85 minutes ago, peaked about 75 minutes ago, subsided about 25 minutes ago. We saw BGP flaps all over the place, all peerings are back now except our peering with Implex, which has been down for 80 minutes or so. -- ================================================ David Farmer Email: farmer(a)umn.edu Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 1-612-626-0815 Minneapolis, MN 55414-3029 Cell: 1-612-812-9952 ================================================ ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Bertsch, Steven

We were seeing elevated levels of multicast, but most of what we were receiving was unicast well in excess of what we normally see. If MACs were flapping between ports due to a bridging loop, the switch may have disabled MAC learning in the VLAN, leading to unicast flooding after learned MACs timed out. Steven Bertsch Engineer III OneNeck(r) IT Solutions, a TDS(r) Company Direct: 612.395.8966 Cell: 612.232.1181 Email: steven.bertsch(a)oneneck.com Website: www.oneneck.com -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Danny Meister Sent: Wednesday, February 19, 2014 4:08 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Mice Issues We were seeing strange traffic making it to our MICE port before we shut it down. Other MICE members' http traffic destined to addresses not on our network. As if unicast packets were getting flooded. -Danny Danny Meister Network Engineer, Level II Atomic Data 615 North 3rd Street Minneapolis, MN 55401 612.466.2000 Main Line 612.466.2071 Direct Dial Simple. Safe. Smart. www.atomicdata.com On 2/19/14, 4:04 PM, "Steve Howard" <showard(a)PAULBUNYAN.NET> wrote: >On 02/19/2014 03:48 PM, Doug McIntyre wrote: >> On Wed, Feb 19, 2014 at 03:30:09PM -0600, Doug McIntyre wrote: >>> Did somebody make a loop/packet storm? >>> Going through the switch now, very slow to see if I can identify >>>who/what/where. >> >> At the moment, it looks to be coming from Mankato, unless somebody >> can tell me I'm reading things wrong. >> >> The logs are filling up with >> >> Feb 19 15:34:18 MICE-SW1 master >>MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) >>for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 >> Feb 19 15:34:18 MICE-SW1 backup >>MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) >>for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 >> Feb 19 15:34:18 MICE-SW1 backup >>MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) >>for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 >> Feb 19 15:34:18 MICE-SW1 master >>MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) >>for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 >> Feb 19 15:34:18 MICE-SW1 master >>MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) >>for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 >> Feb 19 15:34:18 MICE-SW1 backup >>MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) >>for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 >> >> >> That MAC address is learned from Mankato's remote 10G link >> >> dmcintyre@MICE-SW1> show ethernet-switching mac-learning-log | match >>00:04:96:37:14:c3 >> Wed Feb 19 15:11:44 2014 vlan_name default mac 00:04:96:37:14:c3 was >>deleted on xe-0/0/37.0 >> Wed Feb 19 15:11:44 2014 vlan_name default mac 00:04:96:37:14:c3 was >>learned on xe-0/0/37.0 >> >> >> But, I'm not getting an extraordinary level of input traffic from >>there. >> >> Juniper PR695200 says this error message can be harmless though, so I'm >>not >> convinced this is the root cause. >> > >Are you a bunch of broadcast/multicast traffic? The CNS switch is >seeing ~5000pps of broadcast traffic from the MICE main switch. I don't >know what the normal rate is, but it seems like it is a bit high. >Especially given that the average broadcast cost over the uptime of the >switch is about 20pps. > >If the Mankato switch has a high broadcast rate, I'd shut down the port >and see if things stabilize. > >######################################################################## > >To unsubscribe from the MICE-DISCUSS list, click the following link: >http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Richard Laager

On Wed, 2014-02-19 at 16:21 -0600, Doug McIntyre wrote: > On Wed, Feb 19, 2014 at 04:03:15PM -0600, Richard Laager wrote: > > Can someone look at the route server logs and see who the new IPv4 peer > > was that showed up just before this problem started? > > Nobody turned up recently. > > A better measure is who turned up on the switch rather than the route-server. > This was a l2 flood, not anything in routing. Yes, I know it was at layer 2, but if you look at the graph, there was one new *peer* (not route) that showed up just before this happened. It seems worth investigating that a little, as it *might* be related. In the graph tree, click "MICE Route Server". The first graph, "MICE IP4 Peers" is the graph to which I'm referring. -- Richard ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Jay Hanke

There are two Extreme networks on the Mankato Remote switch, Vaultas and Revnet. I don't have ssh right now, can someone check? On Wed, Feb 19, 2014 at 2:21 PM, Doug McIntyre <merlyn(a)iphouse.net> wrote: > On Wed, Feb 19, 2014 at 04:03:15PM -0600, Richard Laager wrote: >> Can someone look at the route server logs and see who the new IPv4 peer >> was that showed up just before this problem started? > > Nobody turned up recently. > > A better measure is who turned up on the switch rather than the route-server. > This was a l2 flood, not anything in routing. > > No ports were up/down on the switch until the flood triggered > my port and Implex's port offline (probably the same class of cisco switch > protecting themselves from the l2 flood). > > Feb 19 15:11:45 MICE-SW1 mib2d[1107]: SNMP_TRAP_LINK_DOWN: ifIndex 604, ifAdminStatus up(1), ifOperStatus down(2), ifName ge-1/0/3 > Feb 19 15:11:48 MICE-SW1 mib2d[1107]: SNMP_TRAP_LINK_DOWN: ifIndex 606, ifAdminStatus up(1), ifOperStatus down(2), ifName ge-1/0/5 > > So, it probably was from one of the existing remote switches. > > The MAC address I posted about before is an Extreme? switch. > > > Also, the l2 flood seems abated. > > I've been pinging clear to the route servers for 5 minutes now. > > > > -- > Doug McIntyre <merlyn(a)iphouse.net> > ~.~ ipHouse ~.~ > Network Engineer/Provisioning/Jack of all Trades > > ######################################################################## > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke CTO, CCIE #19093 Mankato Networks LLC PO Box 54 619 S Front St Mankato, MN 56001-3838 Google 530-618-2398 jayhanke(a)mankatonetworks.net http://www.mankatonetworks.com http://www.neutralpath.net ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Doug McIntyre

On Wed, Feb 19, 2014 at 04:03:15PM -0600, Richard Laager wrote: > Can someone look at the route server logs and see who the new IPv4 peer > was that showed up just before this problem started? Nobody turned up recently. A better measure is who turned up on the switch rather than the route-server. This was a l2 flood, not anything in routing. No ports were up/down on the switch until the flood triggered my port and Implex's port offline (probably the same class of cisco switch protecting themselves from the l2 flood). Feb 19 15:11:45 MICE-SW1 mib2d[1107]: SNMP_TRAP_LINK_DOWN: ifIndex 604, ifAdminStatus up(1), ifOperStatus down(2), ifName ge-1/0/3 Feb 19 15:11:48 MICE-SW1 mib2d[1107]: SNMP_TRAP_LINK_DOWN: ifIndex 606, ifAdminStatus up(1), ifOperStatus down(2), ifName ge-1/0/5 So, it probably was from one of the existing remote switches. The MAC address I posted about before is an Extreme? switch. Also, the l2 flood seems abated. I've been pinging clear to the route servers for 5 minutes now. -- Doug McIntyre <merlyn(a)iphouse.net> ~.~ ipHouse ~.~ Network Engineer/Provisioning/Jack of all Trades ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Danny Meister

We were seeing strange traffic making it to our MICE port before we shut it down. Other MICE members' http traffic destined to addresses not on our network. As if unicast packets were getting flooded. -Danny Danny Meister Network Engineer, Level II Atomic Data 615 North 3rd Street Minneapolis, MN 55401 612.466.2000 Main Line 612.466.2071 Direct Dial Simple. Safe. Smart. www.atomicdata.com On 2/19/14, 4:04 PM, "Steve Howard" <showard(a)PAULBUNYAN.NET> wrote: >On 02/19/2014 03:48 PM, Doug McIntyre wrote: >> On Wed, Feb 19, 2014 at 03:30:09PM -0600, Doug McIntyre wrote: >>> Did somebody make a loop/packet storm? >>> Going through the switch now, very slow to see if I can identify >>>who/what/where. >> >> At the moment, it looks to be coming from Mankato, unless somebody >> can tell me I'm reading things wrong. >> >> The logs are filling up with >> >> Feb 19 15:34:18 MICE-SW1 master >>MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) >>for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 >> Feb 19 15:34:18 MICE-SW1 backup >>MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) >>for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 >> Feb 19 15:34:18 MICE-SW1 backup >>MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) >>for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 >> Feb 19 15:34:18 MICE-SW1 master >>MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) >>for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 >> Feb 19 15:34:18 MICE-SW1 master >>MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) >>for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 >> Feb 19 15:34:18 MICE-SW1 backup >>MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) >>for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 >> >> >> That MAC address is learned from Mankato's remote 10G link >> >> dmcintyre@MICE-SW1> show ethernet-switching mac-learning-log | match >>00:04:96:37:14:c3 >> Wed Feb 19 15:11:44 2014 vlan_name default mac 00:04:96:37:14:c3 was >>deleted on xe-0/0/37.0 >> Wed Feb 19 15:11:44 2014 vlan_name default mac 00:04:96:37:14:c3 was >>learned on xe-0/0/37.0 >> >> >> But, I'm not getting an extraordinary level of input traffic from >>there. >> >> Juniper PR695200 says this error message can be harmless though, so I'm >>not >> convinced this is the root cause. >> > >Are you a bunch of broadcast/multicast traffic? The CNS switch is >seeing ~5000pps of broadcast traffic from the MICE main switch. I don't >know what the normal rate is, but it seems like it is a bit high. >Especially given that the average broadcast cost over the uptime of the >switch is about 20pps. > >If the Mankato switch has a high broadcast rate, I'd shut down the port >and see if things stabilize. > >######################################################################## > >To unsubscribe from the MICE-DISCUSS list, click the following link: >http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Steve Howard

On 02/19/2014 03:48 PM, Doug McIntyre wrote: > On Wed, Feb 19, 2014 at 03:30:09PM -0600, Doug McIntyre wrote: >> Did somebody make a loop/packet storm? >> Going through the switch now, very slow to see if I can identify who/what/where. > > At the moment, it looks to be coming from Mankato, unless somebody > can tell me I'm reading things wrong. > > The logs are filling up with > > Feb 19 15:34:18 MICE-SW1 master MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 > Feb 19 15:34:18 MICE-SW1 backup MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 > Feb 19 15:34:18 MICE-SW1 backup MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 > Feb 19 15:34:18 MICE-SW1 master MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 > Feb 19 15:34:18 MICE-SW1 master MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 > Feb 19 15:34:18 MICE-SW1 backup MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 > > > That MAC address is learned from Mankato's remote 10G link > > dmcintyre@MICE-SW1> show ethernet-switching mac-learning-log | match 00:04:96:37:14:c3 > Wed Feb 19 15:11:44 2014 vlan_name default mac 00:04:96:37:14:c3 was deleted on xe-0/0/37.0 > Wed Feb 19 15:11:44 2014 vlan_name default mac 00:04:96:37:14:c3 was learned on xe-0/0/37.0 > > > But, I'm not getting an extraordinary level of input traffic from there. > > Juniper PR695200 says this error message can be harmless though, so I'm not > convinced this is the root cause. > Are you a bunch of broadcast/multicast traffic? The CNS switch is seeing ~5000pps of broadcast traffic from the MICE main switch. I don't know what the normal rate is, but it seems like it is a bit high. Especially given that the average broadcast cost over the uptime of the switch is about 20pps. If the Mankato switch has a high broadcast rate, I'd shut down the port and see if things stabilize. ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Richard Laager

Can someone look at the route server logs and see who the new IPv4 peer was that showed up just before this problem started? -- Richard ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Nathan Beard

I've shutdown my port as well until things are resolved. On Wed, Feb 19, 2014 at 3:48 PM, Doug McIntyre <merlyn(a)iphouse.net> wrote: > On Wed, Feb 19, 2014 at 03:30:09PM -0600, Doug McIntyre wrote: > > Did somebody make a loop/packet storm? > > Going through the switch now, very slow to see if I can identify > who/what/where. > > > At the moment, it looks to be coming from Mankato, unless somebody > can tell me I'm reading things wrong. > > The logs are filling up with > > Feb 19 15:34:18 MICE-SW1 master > MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) for > VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 > Feb 19 15:34:18 MICE-SW1 backup > MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) for > VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 > Feb 19 15:34:18 MICE-SW1 backup > MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) for > VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 > Feb 19 15:34:18 MICE-SW1 master > MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) for > VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 > Feb 19 15:34:18 MICE-SW1 master > MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) for > VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 > Feb 19 15:34:18 MICE-SW1 backup > MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) for > VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 > > > That MAC address is learned from Mankato's remote 10G link > > dmcintyre@MICE-SW1> show ethernet-switching mac-learning-log | match > 00:04:96:37:14:c3 > Wed Feb 19 15:11:44 2014 vlan_name default mac 00:04:96:37:14:c3 was > deleted on xe-0/0/37.0 > Wed Feb 19 15:11:44 2014 vlan_name default mac 00:04:96:37:14:c3 was > learned on xe-0/0/37.0 > > > But, I'm not getting an extraordinary level of input traffic from there. > > Juniper PR695200 says this error message can be harmless though, so I'm not > convinced this is the root cause. > > > -- > Doug McIntyre <merlyn(a)iphouse.net> > ~.~ ipHouse ~.~ > Network Engineer/Provisioning/Jack of all Trades > > ######################################################################## > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Doug McIntyre

On Wed, Feb 19, 2014 at 03:30:09PM -0600, Doug McIntyre wrote: > Did somebody make a loop/packet storm? > Going through the switch now, very slow to see if I can identify who/what/where. At the moment, it looks to be coming from Mankato, unless somebody can tell me I'm reading things wrong. The logs are filling up with Feb 19 15:34:18 MICE-SW1 master MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 Feb 19 15:34:18 MICE-SW1 backup MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 Feb 19 15:34:18 MICE-SW1 backup MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 Feb 19 15:34:18 MICE-SW1 master MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 Feb 19 15:34:18 MICE-SW1 master MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 Feb 19 15:34:18 MICE-SW1 backup MRVL-L2:mrvl_fdb_mac_entry_uc_set(),966:FDb SP HW-overwrite failed(3) for VLANIdx=3:00:04:96:37:14:c3/48:IFL=105 That MAC address is learned from Mankato's remote 10G link dmcintyre@MICE-SW1> show ethernet-switching mac-learning-log | match 00:04:96:37:14:c3 Wed Feb 19 15:11:44 2014 vlan_name default mac 00:04:96:37:14:c3 was deleted on xe-0/0/37.0 Wed Feb 19 15:11:44 2014 vlan_name default mac 00:04:96:37:14:c3 was learned on xe-0/0/37.0 But, I'm not getting an extraordinary level of input traffic from there. Juniper PR695200 says this error message can be harmless though, so I'm not convinced this is the root cause. -- Doug McIntyre <merlyn(a)iphouse.net> ~.~ ipHouse ~.~ Network Engineer/Provisioning/Jack of all Trades ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Chase Rydberg

We're shut down as well until things calm down. Chase Rydberg *MDU Ethernet Solutions* On Wed, Feb 19, 2014 at 3:37 PM, Larry Patterson <larry(a)atomicdata.com>wrote: > Atomic has proactively shutdown our port to MICE due to heavy traffic > influx/reliability issues across the switch fabric. We will re-enable our > peering after the issues have subsided. > > On 2/19/14 3:31 PM, "Steve Howard" <showard(a)PAULBUNYAN.NET> wrote: > > >On 02/19/2014 03:23 PM, Jeremy Lumby wrote: > >> I have been experiencing packet loss, as well as seen many of my BGP > >>sessions go down across MICE. Has anyone else seen issues? > >> > > > >The first log message in the CNS switch was at Feb 19 15:11:44.238 > >CST. Did anybody plug something in then? > > > >######################################################################## > > > >To unsubscribe from the MICE-DISCUSS list, click the following link: > >http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > ######################################################################## > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Larry Patterson

Atomic has proactively shutdown our port to MICE due to heavy traffic influx/reliability issues across the switch fabric. We will re-enable our peering after the issues have subsided. On 2/19/14 3:31 PM, "Steve Howard" <showard(a)PAULBUNYAN.NET> wrote: >On 02/19/2014 03:23 PM, Jeremy Lumby wrote: >> I have been experiencing packet loss, as well as seen many of my BGP >>sessions go down across MICE. Has anyone else seen issues? >> > >The first log message in the CNS switch was at Feb 19 15:11:44.238 >CST. Did anybody plug something in then? > >######################################################################## > >To unsubscribe from the MICE-DISCUSS list, click the following link: >http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Doug McIntyre

On Wed, Feb 19, 2014 at 09:34:40PM +0000, Justin Krejci wrote: > Is someone advertising v6 routes they should not be onto the Mice servers? > > 2001:504:27::D1AF:0:1 4 53679 7060055 721494 80179512 0 13 00:03:02 244 > 2001:504:27::D1AF:0:2 4 53679 7073987 724693 80179512 0 0 00:11:10 9020 > > I see a lot of HE routes coming from route server 02 That is normal, HE is peering their whole IPv6 table to the route servers. -- Doug McIntyre <merlyn(a)iphouse.net> ~.~ ipHouse ~.~ Network Engineer/Provisioning/Jack of all Trades ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Justin Krejci

Is someone advertising v6 routes they should not be onto the Mice servers? 2001:504:27::D1AF:0:1 4 53679 7060055 721494 80179512 0 13 00:03:02 244 2001:504:27::D1AF:0:2 4 53679 7073987 724693 80179512 0 0 00:11:10 9020 I see a lot of HE routes coming from route server 02 ________________________________________ From: MICE Discuss [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] on behalf of James Stahr [stahr(a)MAILBAG.COM] Sent: Wednesday, February 19, 2014 3:28 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Mice Issues On 02/19/2014 3:23 PM, Jeremy Lumby wrote: > I have been experiencing packet loss, as well as seen many of my BGP sessions go down across MICE. Has anyone else seen issues? > > ######################################################################## > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > Yes, spanning tree loop? 30 second input rate 766296000 bits/sec, 118912 packets/sec -James ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Steve Howard

On 02/19/2014 03:23 PM, Jeremy Lumby wrote: > I have been experiencing packet loss, as well as seen many of my BGP sessions go down across MICE. Has anyone else seen issues? > The first log message in the CNS switch was at Feb 19 15:11:44.238 CST. Did anybody plug something in then? ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Doug McIntyre

On Wed, Feb 19, 2014 at 03:23:00PM -0600, Jeremy Lumby wrote: > I have been experiencing packet loss, as well as seen many of my BGP sessions go down across MICE. Has anyone else seen issues? I have a weird error on my MICE facing port. Feb 19 15:11:44.976 CST: %ETHCNTR-3-LOOP_BACK_DETECTED: Keepalive packet loop-back detected on GigabitEthernet0/4. Feb 19 15:11:44.976 CST: %PM-4-ERR_DISABLE: loopback error detected on Gi0/4, putting Gi0/4 in err-disable state I cleared that, but still having big packet loss across MICE. Did somebody make a loop/packet storm? Going through the switch now, very slow to see if I can identify who/what/where. -- Doug McIntyre <merlyn(a)iphouse.net> ~.~ ipHouse ~.~ Network Engineer/Provisioning/Jack of all Trades ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by Steve Howard

On 02/19/2014 03:23 PM, Jeremy Lumby wrote: > I have been experiencing packet loss, as well as seen many of my BGP sessions go down across MICE. Has anyone else seen issues? > Yes, something is broken. Loop? The CNS switch has many log entries like the following: Feb 19 15:27:50.787 CST: %SW_MATM-4-MACFLAP_NOTIF: Host 10f3.1134.e6de in vlan 847 is flapping between port Te0/10 and port Te0/8 Feb 19 15:28:04.578 CST: %SW_MATM-4-MACFLAP_NOTIF: Host 001b.0de7.15c0 in vlan 847 is flapping between port Te0/10 and port Te0/11 Feb 19 15:28:04.779 CST: %SW_MATM-4-MACFLAP_NOTIF: Host 0000.9999.2345 in vlan 847 is flapping between port Te0/11 and port Te0/10 Feb 19 15:28:04.846 CST: %SW_MATM-4-MACFLAP_NOTIF: Host 0021.a00a.a040 in vlan 847 is flapping between port Te0/10 and port Gi0/1 Feb 19 15:28:05.081 CST: %SW_MATM-4-MACFLAP_NOTIF: Host 001a.a10e.9f05 in vlan 847 is flapping between port Te0/10 and port Te0/12 Feb 19 15:28:05.383 CST: %SW_MATM-4-MACFLAP_NOTIF: Host 10f3.1134.e6de in vlan 847 is flapping between port Te0/10 and port Te0/8 Feb 19 15:28:19.862 CST: %SW_MATM-4-MACFLAP_NOTIF: Host 001b.0de7.15c0 in vlan 847 is flapping between port Te0/10 and port Te0/11 Feb 19 15:28:19.963 CST: %SW_MATM-4-MACFLAP_NOTIF: Host 001a.a10e.9f05 in vlan 847 is flapping between port Te0/10 and port Te0/12 Feb 19 15:28:20.030 CST: %SW_MATM-4-MACFLAP_NOTIF: Host 0000.9999.2345 in vlan 847 is flapping between port Te0/10 and port Te0/11 Feb 19 15:28:20.433 CST: %SW_MATM-4-MACFLAP_NOTIF: Host 0021.a00a.a040 in vlan 847 is flapping between port Te0/10 and port Gi0/1 Feb 19 15:28:22.798 CST: %SW_MATM-4-MACFLAP_NOTIF: Host 10f3.1134.e6de in vlan 847 is flapping between port Te0/10 and port Te0/8 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Mice Issues

by James Stahr

On 02/19/2014 3:23 PM, Jeremy Lumby wrote: > I have been experiencing packet loss, as well as seen many of my BGP sessions go down across MICE. Has anyone else seen issues? > > ######################################################################## > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > Yes, spanning tree loop? 30 second input rate 766296000 bits/sec, 118912 packets/sec -James ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Mice Issues

by Jeremy Lumby

I have been experiencing packet loss, as well as seen many of my BGP sessions go down across MICE. Has anyone else seen issues? ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 19, 2014

Re: Please welcome Emergent Networks to MICE!

by Anthony Anderberg

Welcome Emergent folks! You should be ready to go in the MICE route servers and such now. We'll complete the graph configuration once your port is ready. Certain routers will require the BGP command "no bgp enforce-first-as", everything else should be just as you'd expect. Cheers, anthony Anthony Anderberg Sr. Systems Analyst 320-234-5239 anthonyanderberg(a)nu-telecom.net www.nutelecom.net -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Jay Hanke Sent: Monday, February 03, 2014 5:40 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Please welcome Emergent Networks to MICE! Port: xe-0/0/35 Emergent Networks ASN: 29762 IPv4: 206.108.255.30/24 IPv6: 2001:504:27:0:0:7442::1/64 peering(a)emergentnetworks.com Prefix Limit: 15 Please update route servers and website! Welcome aboard! -- Jay Hanke CTO, CCIE #19093 Mankato Networks LLC PO Box 54 619 S Front St Mankato, MN 56001-3838 Google 530-618-2398 jayhanke(a)mankatonetworks.net http://www.mankatonetworks.com http://www.neutralpath.net ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 6, 2014

Re: Akamai (20940) < > MICEMN Network Fail

by Jay Hanke

Do we have an update on the issue? On Wed, Jan 29, 2014 at 6:58 AM, Hannigan, Martin <marty(a)akamai.com> wrote: > > > Key West, FL. But hey, I went through that below -17F stuff a few weeks ago > and for a few weeks. I completely sympathize. :-) > > > Enjoy the UG! > > Best, > > -M< > > > > On Jan 29, 2014, at 7:54 AM, Reid Fishler <rfishler(a)HE.NET> wrote: > > I think I speak for everyone who will be at MSP that we all wish we were > somewhere warmer...so enjoy your vacation, and send some heat our way! > > Reid > > > On Wed, Jan 29, 2014 at 7:51 AM, Hannigan, Martin <marty(a)akamai.com> wrote: >> >> MICE'onites, >> >> We're still out, obviously. We're waiting on our friends at Zayo to do >> some work on their side. Enjoy the UG meeting. Had I not been heading for >> vacation I would've been there. I'll plan to be at the next one. >> >> Best, >> >> -M< >> >> ######################################################################## >> >> To unsubscribe from the MICE-DISCUSS list, click the following link: >> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >> > > > > -- > Reid Fishler > Director > Hurricane Electric > +1-510-580-4178 > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke CTO, CCIE #19093 Mankato Networks LLC PO Box 54 619 S Front St Mankato, MN 56001-3838 Google 530-618-2398 jayhanke(a)mankatonetworks.net http://www.mankatonetworks.com http://www.neutralpath.net ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 4, 2014

Please welcome Emergent Networks to MICE!

by Jay Hanke

Port: xe-0/0/35 Emergent Networks ASN: 29762 IPv4: 206.108.255.30/24 IPv6: 2001:504:27:0:0:7442::1/64 peering(a)emergentnetworks.com Prefix Limit: 15 Please update route servers and website! Welcome aboard! -- Jay Hanke CTO, CCIE #19093 Mankato Networks LLC PO Box 54 619 S Front St Mankato, MN 56001-3838 Google 530-618-2398 jayhanke(a)mankatonetworks.net http://www.mankatonetworks.com http://www.neutralpath.net ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Feb. 3, 2014

Re: Mice Meeting Tomorrow @ 4 pm

by Reid Fishler

We could charades the entire thing, and just do video? Reid On Jan 31, 2014 5:55 PM, "Shaun Carlson" <shaun.carlson(a)arvig.com> wrote: > The webex was a last minute thing, but I thought the same thing after the > meeting. We will need to come up with a better audio/video solution to be > able to hear everyone though. > > I asked Dave Farmer if he had any ideas and he said he'd look into it for > future meetings. > > s > > On Friday, January 31, 2014, Mike O'Connor <mike(a)haven2.com> wrote: > >> let me second that emotion. my apologies for missing the meeting >> yesterday — i didn’t realize that WebEx was going to happen until… um… >> after the meeting was over. but i’d love to be able to attend over the >> wire. >> >> mikey >> >> >> On Jan 31, 2014, at 3:17 PM, Richard Laager <rlaager(a)WIKTEL.COM> wrote: >> >> > On Thu, 2014-01-30 at 10:59 -0600, Shaun Carlson wrote: >> >> I was thinking about offering a webex for those that can't travel to >> >> the cities. If you're interested in that option, please let me know. >> > >> > Despite my wisecracks about how people should attend the meeting in >> > person, in all seriousness, I think having the WebEx (or something >> > similar) as a regular thing would be excellent. >> > >> > -- >> > Richard >> > >> > ######################################################################## >> > >> > To unsubscribe from the MICE-DISCUSS list, click the following link: >> > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >> >> >> PHONE: 651-647-6109, FAX: 866-280-2356, WEB: www.haven2.com, HANDLE: >> OConnorStP (ID for Twitter, Facebook, LinkedIn, etc.) >> >> ######################################################################## >> >> To unsubscribe from the MICE-DISCUSS list, click the following link: >> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >> > > > -- > > > *Shaun Carlson*Network Engineering Manager | Arvig > ph: (218) 346-8673 | em: shaun.carlson(a)arvig.com > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 31, 2014

Re: Mice Meeting Tomorrow @ 4 pm

by Shaun Carlson

The webex was a last minute thing, but I thought the same thing after the meeting. We will need to come up with a better audio/video solution to be able to hear everyone though. I asked Dave Farmer if he had any ideas and he said he'd look into it for future meetings. s On Friday, January 31, 2014, Mike O'Connor <mike(a)haven2.com> wrote: > let me second that emotion. my apologies for missing the meeting > yesterday -- i didn't realize that WebEx was going to happen until... um... > after the meeting was over. but i'd love to be able to attend over the > wire. > > mikey > > > On Jan 31, 2014, at 3:17 PM, Richard Laager <rlaager(a)WIKTEL.COM<javascript:;>> > wrote: > > > On Thu, 2014-01-30 at 10:59 -0600, Shaun Carlson wrote: > >> I was thinking about offering a webex for those that can't travel to > >> the cities. If you're interested in that option, please let me know. > > > > Despite my wisecracks about how people should attend the meeting in > > person, in all seriousness, I think having the WebEx (or something > > similar) as a regular thing would be excellent. > > > > -- > > Richard > > > > ######################################################################## > > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > PHONE: 651-647-6109, FAX: 866-280-2356, WEB: www.haven2.com, HANDLE: > OConnorStP (ID for Twitter, Facebook, LinkedIn, etc.) > > ######################################################################## > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > -- *Shaun Carlson*Network Engineering Manager | Arvig ph: (218) 346-8673 | em: shaun.carlson(a)arvig.com ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 31, 2014

Re: Mice Meeting Tomorrow @ 4 pm

by Mike O'Connor

let me second that emotion. my apologies for missing the meeting yesterday — i didn’t realize that WebEx was going to happen until… um… after the meeting was over. but i’d love to be able to attend over the wire. mikey On Jan 31, 2014, at 3:17 PM, Richard Laager <rlaager(a)WIKTEL.COM> wrote: > On Thu, 2014-01-30 at 10:59 -0600, Shaun Carlson wrote: >> I was thinking about offering a webex for those that can't travel to >> the cities. If you're interested in that option, please let me know. > > Despite my wisecracks about how people should attend the meeting in > person, in all seriousness, I think having the WebEx (or something > similar) as a regular thing would be excellent. > > -- > Richard > > ######################################################################## > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 PHONE: 651-647-6109, FAX: 866-280-2356, WEB: www.haven2.com, HANDLE: OConnorStP (ID for Twitter, Facebook, LinkedIn, etc.) ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 31, 2014

Re: Mice Meeting Tomorrow @ 4 pm

by Eric Crist

I concur. If the state 4x4 truck association can manage a WebEx for board meetings, I'd think some tech guys could do the same. :P --- Eric F Crist System Administrator ClaimLynx, Inc (952) 593-5969 x2301 On Jan 31, 2014, at 15:17:52, Richard Laager <rlaager(a)WIKTEL.COM> wrote: > On Thu, 2014-01-30 at 10:59 -0600, Shaun Carlson wrote: >> I was thinking about offering a webex for those that can't travel to >> the cities. If you're interested in that option, please let me know. > > Despite my wisecracks about how people should attend the meeting in > person, in all seriousness, I think having the WebEx (or something > similar) as a regular thing would be excellent. > > -- > Richard > > ######################################################################## > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- This e-mail and any files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you are not the intended recipient or the individual responsible for delivering the e-mail to the intended recipient, please be advised that you have received this e-mail in error and that any use, dissemination, forwarding, printing, or copying of this e-mail is strictly prohibited. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender or call ClaimLynx at (952) 593-5969. ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 31, 2014

Re: Mice Meeting Tomorrow @ 4 pm

by Richard Laager

On Thu, 2014-01-30 at 10:59 -0600, Shaun Carlson wrote: > I was thinking about offering a webex for those that can't travel to > the cities. If you're interested in that option, please let me know. Despite my wisecracks about how people should attend the meeting in person, in all seriousness, I think having the WebEx (or something similar) as a regular thing would be excellent. -- Richard ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 31, 2014

Re: UG 11 Minutes

by Shaun Carlson

Martin, Basically, when a user opts out, they're graph will be removed from the "public" view of the exchange members. The aggregate graph will show the total bandwidth of the exchange, but not bandwidth specific to any member in particular. This was a quick summary of what we came up with during the list discussion a little while ago. s On Thursday, January 30, 2014, Hannigan, Martin <marty(a)akamai.com> wrote: > Folks, > > > Please define anonymity of traffic? What is the agg and port graph policy > in total?? > > Best, > > Martin > > On Jan 30, 2014, at 19:10, "Shaun Carlson" <shaun.carlson(a)ARVIG.COM<javascript:_e(%7B%7D,'cvml','shaun.carlson(a)ARVIG.COM');>> > wrote: > > Please see attached. > > s > > > *Shaun Carlson *Network Engineering Manager | Arvig > ph: (218) 346-8673 | em: shaun.carlson(a)arvig.com<javascript:_e(%7B%7D,'cvml','shaun.carlson(a)arvig.com');> > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > <MICE Minutes - UG 11.pdf> > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > -- *Shaun Carlson*Network Engineering Manager | Arvig ph: (218) 346-8673 | em: shaun.carlson(a)arvig.com ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 31, 2014

Re: UG 11 Minutes

by Shaun Carlson

My apologies... I meant to fix that and forgot. I will adjust for the final copy. s On Thursday, January 30, 2014, Eric Crist <ecrist(a)claimlynx.com> wrote: > AS62708 is ClaimLynx, Inc, not Acclaim Networks. > > --- > Eric F Crist > System Administrator > ClaimLynx, Inc > (952) 593-5969 x2301 > > > > On Jan 30, 2014, at 18:10:22, Shaun Carlson <shaun.carlson(a)ARVIG.COM<javascript:;>> > wrote: > > > Please see attached. > > > > s > > > > Shaun Carlson > > Network Engineering Manager | Arvig > > ph: (218) 346-8673 | em: shaun.carlson(a)arvig.com <javascript:;> > > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > > <MICE Minutes - UG 11.pdf> > > > -- > This e-mail and any files transmitted with it are confidential and are > intended solely for the use of the individual or entity to whom they are > addressed. If you are not the intended recipient or the individual > responsible for delivering the e-mail to the intended recipient, please be > advised that you have received this e-mail in error and that any use, > dissemination, forwarding, printing, or copying of this e-mail is strictly > prohibited. > > If you have received this communication in error, please return it to the > sender immediately and delete the original message and any copy of it from > your computer system. If you have any questions concerning this message, > please contact the sender or call ClaimLynx at (952) 593-5969. > > ######################################################################## > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > -- *Shaun Carlson*Network Engineering Manager | Arvig ph: (218) 346-8673 | em: shaun.carlson(a)arvig.com ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 31, 2014

Re: UG 11 Minutes

by Hannigan, Martin

Folks, Please define anonymity of traffic? What is the agg and port graph policy in total?? Best, Martin On Jan 30, 2014, at 19:10, "Shaun Carlson" <shaun.carlson(a)ARVIG.COM<mailto:shaun.carlson@ARVIG.COM>> wrote: Please see attached. s Shaun Carlson Network Engineering Manager | Arvig ph: (218) 346-8673 | em: shaun.carlson(a)arvig.com<mailto:shaun.carlson@arvig.com> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <MICE Minutes - UG 11.pdf> ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 31, 2014

Re: UG 11 Minutes

by Eric Crist

AS62708 is ClaimLynx, Inc, not Acclaim Networks. --- Eric F Crist System Administrator ClaimLynx, Inc (952) 593-5969 x2301 On Jan 30, 2014, at 18:10:22, Shaun Carlson <shaun.carlson(a)ARVIG.COM> wrote: > Please see attached. > > s > > Shaun Carlson > Network Engineering Manager | Arvig > ph: (218) 346-8673 | em: shaun.carlson(a)arvig.com > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > <MICE Minutes - UG 11.pdf> -- This e-mail and any files transmitted with it are confidential and are intended solely for the use of the individual or entity to whom they are addressed. If you are not the intended recipient or the individual responsible for delivering the e-mail to the intended recipient, please be advised that you have received this e-mail in error and that any use, dissemination, forwarding, printing, or copying of this e-mail is strictly prohibited. If you have received this communication in error, please return it to the sender immediately and delete the original message and any copy of it from your computer system. If you have any questions concerning this message, please contact the sender or call ClaimLynx at (952) 593-5969. ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 31, 2014

UG 11 Minutes

by Shaun Carlson

Please see attached. s *Shaun Carlson*Network Engineering Manager | Arvig ph: (218) 346-8673 | em: shaun.carlson(a)arvig.com ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 31, 2014

Re: UG 11 Agenda

by Shaun Carlson

Webex Info for those attending remote: https://meetings.webex.com/collabs/#/meetings/detail?uuid=M5RBQE2WOLSLV5KNF… Meeting Number:191 052 698 s *Shaun Carlson*Network Engineering Manager | Arvig ph: (218) 346-8673 | em: shaun.carlson(a)arvig.com On Thu, Jan 30, 2014 at 2:53 PM, Shaun Carlson <shaun.carlson(a)arvig.com>wrote: > Please see attached... > > s > > > *Shaun Carlson *Network Engineering Manager | Arvig > ph: (218) 346-8673 | em: shaun.carlson(a)arvig.com > ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 30, 2014