Re: Packet loss between GigaPOP and Onvoy/Zayo
I'd have to agree Jeremy. Phil S from 7 Sigma and I have been working on a packet loss issue between CTC and Melrose/Benton/Albany for 2-3 months. We recently started noticing packet loss between Melrose and Perham via Zayo also, but they claim they never find anything on either of the complaints. Earlier this week I got a call about another location having issues, that one looked to be a L3 to TDS issue and not Zayo, but with all this I am having second thoughts. Hopefully enough barking will convince them. Mike Bushard, Jr -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Jeremy Lumby Sent: Friday, August 17, 2012 3:04 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Packetloss between GigaPOP and Onvoy/Zayo I have a feeling it has been going on for months, today is just the first I have spent some time to gather some concrete evidence -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Anthony Anderberg Sent: Friday, August 17, 2012 2:51 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Packetloss between GigaPOP and Onvoy/Zayo Mike@Arvig and I have been troubleshooting an issue since yesterday that seems like it's going to fit this thread as well. By the looks of my graphs the problem seems to clear up during low-traffic times. Does anyone have a good feel for when the issue started? Anthony Anderberg Sr. Systems Analyst 320-234-5239 anthonyanderberg@nu-telecom.net -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Frank DiGravina Sent: Friday, August 17, 2012 2:09 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Packetloss between GigaPOP and Onvoy/Zayo We also have a case with Zayo on behalf of a State of Mn connector whose traffic is losing -20% of their packets. When Zayo Bandwidth resolves our issue, it may resolve yours. Cordially, Frank Sent from my iPhone On Aug 17, 2012, at 1:45 PM, Jeremy Lumby <jlumby@MNVOIP.COM> wrote:
I have a customer who's ISP is TTM and they are buying from Zayo, as well as Level3. My route to and from them is currently going through MICE to the GigaPOP to Onvoy/Zayo to TTM. I am experiencing about 4% packet loss to them when I take this route, as opposed to going across Level3 to get to them is clean. I can cleanly get to 69.147.218.51 however the next hop of 192.35.86.49 is showing the same 4% packet loss that I am seeing to my end customer. Can anyone help clean up this link. I love the low latency (approx 2ms) to them, however the loss is not acceptable.
Thanks, Jeremy
###################################################################### ##
To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
On Fri, Aug 17, 2012 at 3:17 PM, Mike Bushard, Jr <mike.bushard@arvig.com> wrote:
I'd have to agree Jeremy. Phil S from 7 Sigma and I have been working on a packet loss issue between CTC and Melrose/Benton/Albany for 2-3 months. We recently started noticing packet loss between Melrose and Perham via Zayo also, but they claim they never find anything on either of the complaints. Earlier this week I got a call about another location having issues, that one looked to be a L3 to TDS issue and not Zayo, but with all this I am having second thoughts.
Any updates on this issue? I got an email to the peering account asking us to fix our stuff. Jay ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
My contact with Onvoy is willing to work it from the other side (looks to be a Zayo Bandwidth issue) Unfortunately without a case number, or Circuit ID, he is stuck. On a side note, is there anyone I can push to have Zayo turn up their direct connection to the exchange? -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Jay Hanke Sent: Wednesday, August 22, 2012 9:26 AM To: MICE-DISCUSS@LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Packet loss between GigaPOP and Onvoy/Zayo On Fri, Aug 17, 2012 at 3:17 PM, Mike Bushard, Jr <mike.bushard@arvig.com> wrote:
I'd have to agree Jeremy. Phil S from 7 Sigma and I have been working on a packet loss issue between CTC and Melrose/Benton/Albany for 2-3 months. We recently started noticing packet loss between Melrose and Perham via Zayo also, but they claim they never find anything on either of the complaints. Earlier this week I got a call about another location having issues, that one looked to be a L3 to TDS issue and not Zayo, but with all this I am having second thoughts.
Any updates on this issue? I got an email to the peering account asking us to fix our stuff. Jay ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
I attempted to report this issue between Zayo and UMN with BGP paths and packet loss examples on August 15 to Zayo. But because I am not a customer if Zayo, their support couldn't do anything with it. I'm glad to hear that the issues are resolved. That being said, what is the method for reporting networking issues amongst peering members? Thanks, Larry Patterson Chief Technology Officer Atomic Data 615 North 3rd Street Minneapolis, MN 55401 612.466.2000 Main Line 612.466.2080 Direct Dial Twitter <http://twitter.com/AtomicData> | Facebook <http://www.facebook.com/AtomicDataCenters> | LinkedIn <http://www.linkedin.com/companies/atomic-data-centers> Simple. Safe. Smart. www.atomicdata.com <http://www.atomicdata.com/> This message and any information or attachments included therewith is intended only for the individual or entity named above. If the reader is not the intended recipient, you are hereby notified that any use, dissemination, distribution or copy of this message or any information attached or contained therein is strictly prohibited. If you have received this message in error, please notify the sender by return e-mail and destroy all copies of the message and any attachments. Thank you. Please consider the environment before printing this email. On 8/22/12 9:34 AM, "Jeremy Lumby" <jlumby@MNVOIP.COM> wrote:
My contact with Onvoy is willing to work it from the other side (looks to be a Zayo Bandwidth issue) Unfortunately without a case number, or Circuit ID, he is stuck.
On a side note, is there anyone I can push to have Zayo turn up their direct connection to the exchange?
-----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Jay Hanke Sent: Wednesday, August 22, 2012 9:26 AM To: MICE-DISCUSS@LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Packet loss between GigaPOP and Onvoy/Zayo
On Fri, Aug 17, 2012 at 3:17 PM, Mike Bushard, Jr <mike.bushard@arvig.com> wrote:
I'd have to agree Jeremy. Phil S from 7 Sigma and I have been working on a packet loss issue between CTC and Melrose/Benton/Albany for 2-3 months. We recently started noticing packet loss between Melrose and Perham via Zayo also, but they claim they never find anything on either of the complaints. Earlier this week I got a call about another location having issues, that one looked to be a L3 to TDS issue and not Zayo, but with all this I am having second thoughts.
Any updates on this issue? I got an email to the peering account asking us to fix our stuff.
Jay
########################################################################
To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
########################################################################
To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
On Wed, Aug 22, 2012 at 3:05 PM, Larry Patterson <larry@atomicdata.com> wrote:
I attempted to report this issue between Zayo and UMN with BGP paths and packet loss examples on August 15 to Zayo. But because I am not a customer if Zayo, their support couldn't do anything with it. I'm glad to hear that the issues are resolved. That being said, what is the method for reporting networking issues amongst peering members?
Usually directly to the peering contact or via the MICE-DISCUSS list. Zayo isn't currently directly connected to the MICE fabric they connect via the Gigapop. Zayo is in the process of turning up a direct connection. They have assignments but I'm not sure if the x-conn has been ordered yet. Jay ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
FYI, no Zayo cross connect ordered as of yet. Mike Mike Hemphill General Manager | Cologix, Inc. 511 11th Ave S, Suite 450 | Minneapolis, MN 55415 P: 612.333.1922 | M: 612.812.5242 mike.hemphill@cologix.com cologix.com -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Jay Hanke Sent: Wednesday, August 22, 2012 3:24 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Packet loss between GigaPOP and Onvoy/Zayo On Wed, Aug 22, 2012 at 3:05 PM, Larry Patterson <larry@atomicdata.com> wrote:
I attempted to report this issue between Zayo and UMN with BGP paths and packet loss examples on August 15 to Zayo. But because I am not a customer if Zayo, their support couldn't do anything with it. I'm glad to hear that the issues are resolved. That being said, what is the method for reporting networking issues amongst peering members?
Usually directly to the peering contact or via the MICE-DISCUSS list. Zayo isn't currently directly connected to the MICE fabric they connect via the Gigapop. Zayo is in the process of turning up a direct connection. They have assignments but I'm not sure if the x-conn has been ordered yet. Jay ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
-----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Jay Hanke Sent: Wednesday, August 22, 2012 15:24 To: MICE-DISCUSS@LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Packet loss between GigaPOP and Onvoy/Zayo
On Wed, Aug 22, 2012 at 3:05 PM, Larry Patterson <larry@atomicdata.com> wrote:
That being said, what is the method for reporting networking issues amongst peering members?
Usually directly to the peering contact or via the MICE-DISCUSS list.
Please contact direct, at least for any concerns with TDS. There are many of us that are not able to monitor the -DISCUSS list for real-time problem notification. Regards, Andy Koch TDS Telecom - IP Network Operations andrew.koch@tdstelecom.com Desk: 608-664-4694 Cell: 608-616-0072 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
I am working on it from my side since we have a couple issues (on 3 different circuits), but it's a slow road. Mike Bushard, Jr -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Jay Hanke Sent: Wednesday, August 22, 2012 9:26 AM To: MICE-DISCUSS@LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Packet loss between GigaPOP and Onvoy/Zayo On Fri, Aug 17, 2012 at 3:17 PM, Mike Bushard, Jr <mike.bushard@arvig.com> wrote:
I'd have to agree Jeremy. Phil S from 7 Sigma and I have been working on a packet loss issue between CTC and Melrose/Benton/Albany for 2-3 months. We recently started noticing packet loss between Melrose and Perham via Zayo also, but they claim they never find anything on either of the complaints. Earlier this week I got a call about another location having issues, that one looked to be a L3 to TDS issue and not Zayo, but with all this I am having second thoughts.
Any updates on this issue? I got an email to the peering account asking us to fix our stuff. Jay ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
On 8/22/12 9:26 AM, Jay Hanke wrote:
On Fri, Aug 17, 2012 at 3:17 PM, Mike Bushard, Jr <mike.bushard@arvig.com> wrote:
I'd have to agree Jeremy. Phil S from 7 Sigma and I have been working on a packet loss issue between CTC and Melrose/Benton/Albany for 2-3 months. We recently started noticing packet loss between Melrose and Perham via Zayo also, but they claim they never find anything on either of the complaints. Earlier this week I got a call about another location having issues, that one looked to be a L3 to TDS issue and not Zayo, but with all this I am having second thoughts. Any updates on this issue? I got an email to the peering account asking us to fix our stuff.
Jay
########################################################################
To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
All, A case was opened the latter part of last week with Zayo Bandwidth upon the observation made by Dan Ruda of the State Of Mn DNR that packets were being lost as they traversed the connection between the Northernlights GigaPOP and Zayo. The case opened with Zayo is 107640. A promised call-back from their noc never happened. I spoke to their noc a few minutes ago and poked at them a bit. Their was no resolution. They promised a call-back in an hour. I will keep you posted as things develop. Frank Frank -- Frank DiGravina University of Minnesota Networking & Telecommunications Network Operations Phone: 612-626-9074 Cell: 612-386-0449 E-Mail: digravin@umn.edu Helpline: 612-301-HELP ######################################################################## To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1
participants (7)
-
Frank DiGravina
-
Jay Hanke
-
Jeremy Lumby
-
Koch, Andrew
-
Larry Patterson
-
Mike Bushard, Jr
-
Mike Hemphill