- mice-discuss - lists.micemn.net

Re: FYI: Hurricane Electric changed to 10Gig

by Jay Hanke

On Sun, Oct 30, 2011 at 10:29 AM, Mike Wilker <mwilker(a)jagcom.net> wrote: > The last I saw from Mr. Farmer was that they were talking to Akamai about > the UofM providing the needed bandwidth. Should we be waiting for the > results of that before seeing about other members chipping in? Dave is planning to open up some of their peering connections to help. We're going to need more to keep up with growth even if the new connection offloads 50%, we're still just about full. Jay ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 30, 2011

Re: FYI: Hurricane Electric changed to 10Gig

by Mike Wilker

The last I saw from Mr. Farmer was that they were talking to Akamai about the UofM providing the needed bandwidth. Should we be waiting for the results of that before seeing about other members chipping in? Mike Wilker Chief Technical Officer Jaguar Communications 507-214-0259 mwilker(a)jagcom.net On Sun, Oct 30, 2011 at 10:20 AM, Jay Hanke <jayhanke(a)mankatonetworks.net>wrote: > On Sat, Oct 29, 2011 at 11:35 PM, Frank Bulk <fbulk(a)mypremieronline.com> > wrote: > > I see that Akamai's peak is sitting around 1 Gbps, while it was > regularly peaking to 1.7 Gbps before the 25th. Is this part of Akamai's > cap change? > > Yes, we need more donated bandwidth for cache fill. > > Jay > > ######################################################################## > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 30, 2011

Re: FYI: Hurricane Electric changed to 10Gig

by Jay Hanke

On Sat, Oct 29, 2011 at 11:35 PM, Frank Bulk <fbulk(a)mypremieronline.com> wrote: > I see that Akamai's peak is sitting around 1 Gbps, while it was regularly peaking to 1.7 Gbps before the 25th. Is this part of Akamai's cap change? Yes, we need more donated bandwidth for cache fill. Jay ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 30, 2011

Re: FYI: Hurricane Electric changed to 10Gig

by Frank Bulk

I see that Akamai's peak is sitting around 1 Gbps, while it was regularly peaking to 1.7 Gbps before the 25th. Is this part of Akamai's cap change? Frank -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Anthony Anderberg Sent: Thursday, October 27, 2011 11:18 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] FYI: Hurricane Electric changed to 10Gig That's what I was thinking too, so I'd corrected Richard's participant list before uploading it. Am updating graphs and such now... I copied Hurricane's old port RRD into its new port so we'd retain their history for the aggregate graph. Looks like the Akamai cluster is going again, thanks to everyone for their work on that. Anthony Anderberg Sr. Systems Analyst 320-234-5239 anthonyanderberg(a)nu-telecom.net www.nutelecom.net -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Steve Howard Sent: Thursday, October 27, 2011 11:13 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] FYI: Hurricane Electric changed to 10Gig On 10/27/2011 12:46 AM, Richard Laager wrote: > I assume this was TE0/10? > Hurricane is on Ten 0/9 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 30, 2011

Re: MICE Akamai Issues

by Justin Krejci

Apologies for the confusion. Been quite busy the last few days and it was not immediately clear to my subconscious that the list was not already familiar with the issue. As already explained well by Dave, nobody probably would have even noticed it if the capacity was just reduced as opposed to completely disabled. On Thu, 2011-10-27 at 15:28 -0500, Mike Horwath wrote: > Thanks, Dave! > ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2011

Re: MICE Akamai Issues

by Mike Horwath

Thanks, Dave! -- Mike Horwath ipHouse - Welcome home! drechsau(a)iphouse.net The universe is an island, surrounded by whatever it is that surrounds universes. - Berkeley Fortune ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2011

Re: MICE Akamai Issues

by Hannigan, Martin

On 10/27/11 7:07 PM, "David Farmer" <farmer(a)UMN.EDU> wrote: > On 10/27/11 13:55 CDT, Mike Horwath wrote: >> On Thu, Oct 27, 2011 at 01:49:36PM -0500, Hannigan, Martin wrote: >>> It's not offline. Our NOC inadvertently shut it off after I had >>> asked them to simply place a cap on the amount of capacity it would >>> push. That was fixed this morning. I would've seen it sooner myself, >>> but I'm in Senegal at the moment. >> >> So this had nothing to do with USI then? >> >> I am still pretty confused. >> >> I have 2 reasons right now for outage: >> >> USI has a proposal into Akamai regarding<something> > > The amount of transit necessary for cache fill is more the USI was told > and is causing some congestion for them. It shouldn't be anymore as I had the cap "fixed" and adjusted to the expected amount. If it's still an issue, I haven't heard it so let me know. [ clip ] >> >> If that's the case, what is the cap? > > There isn't a cap but there was congestion. > There is a cap on my side at the moment and it's 1.25 Gb/s. With respect to settled numbers, we're settled. Our system reacts to changes typically within 48 hours. We usually see more use when things get more local for a variety of reasons. Best, -M< ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2011

Re: MICE Akamai Issues

by David Farmer

On 10/27/11 13:55 CDT, Mike Horwath wrote: > On Thu, Oct 27, 2011 at 01:49:36PM -0500, Hannigan, Martin wrote: >> It's not offline. Our NOC inadvertently shut it off after I had >> asked them to simply place a cap on the amount of capacity it would >> push. That was fixed this morning. I would've seen it sooner myself, >> but I'm in Senegal at the moment. > > So this had nothing to do with USI then? > > I am still pretty confused. > > I have 2 reasons right now for outage: > > USI has a proposal into Akamai regarding<something> The amount of transit necessary for cache fill is more the USI was told and is causing some congestion for them. We are proposing to Akamai and UMN supplements the inbound transit for cache fill of the node. > Akamai inadvertently shut it off after a cap was put into place This is the cause of the outage, not the cause of the initial problem that most people weren't aware of. > but neither is really giving me an answer. > > Is the problem that USI donated bandwdith and some cap was exceeded > for feeding the Akamai cluster? > > If that's the case, what is the cap? There isn't a cap but there was congestion. > Can the load be shared amongst some/all providers for the benefit > of the exchange point? We are talking to Akamai about the issue. > Is the problem that Akamai exceeded an internal cap for feeding into > MICE's network and it needed to be adjusted? > > If that's the case, what was the cap? What is it now? > > Is there anything others can do to help alleviate this in the > future? Over the summer we were averaging 800Mb to 1Gb of combine cache fill and TCP ACK traffic, and serving a total of 2 to 2.5G of content out of our node to both MICE and GigaPOP participants. At peak the two nodes seem to be serving 2.5 to 3G, but I'm not really confident of those number because we really haven't got everything settled in yet, I'd like to see a week or two of sustained numbers before I believe we've settled in. -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 =============================================== ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2011

Re: MICE Akamai Issues

by Mike Horwath

On Thu, Oct 27, 2011 at 01:49:36PM -0500, Hannigan, Martin wrote: > It's not offline. Our NOC inadvertently shut it off after I had > asked them to simply place a cap on the amount of capacity it would > push. That was fixed this morning. I would've seen it sooner myself, > but I'm in Senegal at the moment. So this had nothing to do with USI then? I am still pretty confused. I have 2 reasons right now for outage: USI has a proposal into Akamai regarding <something> Akamai inadvertently shut it off after a cap was put into place but neither is really giving me an answer. Is the problem that USI donated bandwdith and some cap was exceeded for feeding the Akamai cluster? If that's the case, what is the cap? Can the load be shared amongst some/all providers for the benefit of the exchange point? Is the problem that Akamai exceeded an internal cap for feeding into MICE's network and it needed to be adjusted? If that's the case, what was the cap? What is it now? Is there anything others can do to help alleviate this in the future? -- Mike Horwath ipHouse - Welcome home! drechsau(a)iphouse.net The universe is an island, surrounded by whatever it is that surrounds universes. - Berkeley Fortune ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2011

Re: MICE Akamai Issues

by Hannigan, Martin

It's not offline. Our NOC inadvertently shut it off after I had asked them to simply place a cap on the amount of capacity it would push. That was fixed this morning. I would've seen it sooner myself, but I'm in Senegal at the moment. Best, -M< On 10/27/11 6:46 PM, "Mike Horwath" <drechsau(a)IPHOUSE.NET> wrote: > On Thu, Oct 27, 2011 at 01:42:43PM -0500, Richard Laager wrote: >> On Thu, 2011-10-27 at 13:10 -0500, Mike Horwath wrote: >>> What does USI have to do with the Akamai stuff? Is there a problem >>> between the two? >> >> I believe they are donating the bandwidth to feed the Akamai >> cluster. > > Ok. > > But what's the problem that occured to take the Akamai cluster > offline? ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2011

Re: MICE Akamai Issues

by Mike Horwath

On Thu, Oct 27, 2011 at 01:42:43PM -0500, Richard Laager wrote: > On Thu, 2011-10-27 at 13:10 -0500, Mike Horwath wrote: > > What does USI have to do with the Akamai stuff? Is there a problem > > between the two? > > I believe they are donating the bandwidth to feed the Akamai > cluster. Ok. But what's the problem that occured to take the Akamai cluster offline? -- Mike Horwath ipHouse - Welcome home! drechsau(a)iphouse.net The universe is an island, surrounded by whatever it is that surrounds universes. - Berkeley Fortune ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2011

Re: MICE Akamai Issues

by Richard Laager

On Thu, 2011-10-27 at 13:10 -0500, Mike Horwath wrote: > What does USI have to do with the Akamai stuff? Is there a problem > between the two? I believe they are donating the bandwidth to feed the Akamai cluster. Richard ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2011

Re: MICE Akamai Issues

by Mike Horwath

On Thu, Oct 27, 2011 at 11:30:22AM -0500, Justin Krejci wrote: > I sent over our proposal to Marty for Akamai's approval this > morning. If he says its OK then we should be able to get implement > without much delay, depending on what processes and procedures are > needed on the UMN side. > > Will keep this list updated. I must not understand the problem. What does USI have to do with the Akamai stuff? Is there a problem between the two? Help me to understand, please. -- Mike Horwath ipHouse - Welcome home! drechsau(a)iphouse.net The universe is an island, surrounded by whatever it is that surrounds universes. - Berkeley Fortune ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2011

Re: MICE Akamai Issues

by Justin Krejci

On Thu, 2011-10-27 at 02:01 -0500, Jay Hanke wrote: > On Wed, Oct 26, 2011 at 10:37 PM, Frank Bulk <fbulk(a)mypremieronline.com> wrote: > > Did this get resolved? > > >From the graphs it would appear not as there is basically no traffic > on the links to Akamai. > > Justin/Dave/Marty, do you have an update? > > Jay I sent over our proposal to Marty for Akamai's approval this morning. If he says its OK then we should be able to get implement without much delay, depending on what processes and procedures are needed on the UMN side. Will keep this list updated. ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2011

Re: FYI: Hurricane Electric changed to 10Gig

by Anthony Anderberg

That's what I was thinking too, so I'd corrected Richard's participant list before uploading it. Am updating graphs and such now... I copied Hurricane's old port RRD into its new port so we'd retain their history for the aggregate graph. Looks like the Akamai cluster is going again, thanks to everyone for their work on that. Anthony Anderberg Sr. Systems Analyst 320-234-5239 anthonyanderberg(a)nu-telecom.net www.nutelecom.net -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Steve Howard Sent: Thursday, October 27, 2011 11:13 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] FYI: Hurricane Electric changed to 10Gig On 10/27/2011 12:46 AM, Richard Laager wrote: > I assume this was TE0/10? > Hurricane is on Ten 0/9 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2011

Re: FYI: Hurricane Electric changed to 10Gig

by Steve Howard

On 10/27/2011 12:46 AM, Richard Laager wrote: > I assume this was TE0/10? > Hurricane is on Ten 0/9 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2011

Re: FYI: Hurricane Electric changed to 10Gig

by Justin Krejci

Looks like Anthony just updated the weathermap with the change now too. On Thu, 2011-10-27 at 00:46 -0500, Richard Laager wrote: > On Wed, 2011-10-26 at 20:26 -0500, Steve Howard wrote: > > Subject says it all... Hurricane Electric moved to a 10Gig interface on > > the CNS switch this evening. > > I assume this was TE0/10? > > I've attached an updated participants.html file, based on my previous > work. Can someone post this to the website (or tell me what's wrong with > it), please? > > Richard > > ######################################################################## > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2011

Re: MICE Akamai Issues

by Jay Hanke

On Wed, Oct 26, 2011 at 10:37 PM, Frank Bulk <fbulk(a)mypremieronline.com> wrote: > Did this get resolved? >From the graphs it would appear not as there is basically no traffic on the links to Akamai. Justin/Dave/Marty, do you have an update? Jay ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2011

Re: FYI: Hurricane Electric changed to 10Gig

by Richard Laager

On Wed, 2011-10-26 at 20:26 -0500, Steve Howard wrote: > Subject says it all... Hurricane Electric moved to a 10Gig interface on > the CNS switch this evening. I assume this was TE0/10? I've attached an updated participants.html file, based on my previous work. Can someone post this to the website (or tell me what's wrong with it), please? Richard ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2011

Re: MICE Akamai Issues

by Frank Bulk

Did this get resolved? Frank From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Jay Hanke Sent: Tuesday, October 25, 2011 9:18 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE Akamai Issues On Tue, Oct 25, 2011 at 8:42 AM, Jeremy Lumby <jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com>> wrote: Do you need me to go to 511 today to assist? Thanks for the offer. We've exceeded the allotment of cache flow bandwidth. We're working with Akamai on solutions. jay ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2011

FYI: Hurricane Electric changed to 10Gig

by Steve Howard

Hello, Subject says it all... Hurricane Electric moved to a 10Gig interface on the CNS switch this evening. Thanks, STeve ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 27, 2011

High Speed Internet in Welcome/Sherburn/Trimont

by James Montz

Anyone able, or provide contacts/leads for High Speed (>6Mbps) connectivity in the cities of Sherburn, Welcome, or Trimont? Please contact me off list. Thanks! --------------------------------------------------- *James C. Montz* ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 25, 2011

Re: MICE Akamai Issues

by Jay Hanke

On Tue, Oct 25, 2011 at 8:42 AM, Jeremy Lumby <jlumby(a)mnvoip.com> wrote: > ** > Do you need me to go to 511 today to assist? > Thanks for the offer. We've exceeded the allotment of cache flow bandwidth. We're working with Akamai on solutions. jay ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 25, 2011

Re: MICE Akamai Issues

by Jeremy Lumby

Do you need me to go to 511 today to assist? From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Jay Hanke Sent: Tuesday, October 25, 2011 8:32 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] MICE Akamai Issues The MICE Akamai cluster is currently running at reduced capacity. Jay To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 25, 2011

MICE Akamai Issues

by Jay Hanke

The MICE Akamai cluster is currently running at reduced capacity. Jay ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Oct. 25, 2011