- mice-discuss - lists.micemn.net

Re: Any MICE bottleneck for Google Stadia?

by Jay Hanke

You can check your times against the public traffic graph at micelg.usinternet.net. Google is moving some bits... On Mon, Dec 2, 2019 at 2:50 PM Jon Westlund <jon.westlund(a)arvig.com> wrote: > > I am "testing" Stadia...just to confirm what our customers will experience :) > > My Stadia stream is sourced from the 136.112.0.0/12 prefix. There is considerable lag/disconnects during gameplay...I have seen the reports of this being a widespread issue with the new platform, but wanted to confirm that there is no bottleneck with MICE connectivity to Google - 206.108.255.141 AS15169. > > Can we confirm there is no saturation of their uplinks? Has there been a noticeable spike since Friday when some users received their Stadia system? > > Thanks, > JW -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

Dec. 2, 2019

Any MICE bottleneck for Google Stadia?

by Jon Westlund

I am "testing" Stadia...just to confirm what our customers will experience :) My Stadia stream is sourced from the 136.112.0.0/12 prefix. There is considerable lag/disconnects during gameplay...I have seen the reports of this being a widespread issue with the new platform, but wanted to confirm that there is no bottleneck with MICE connectivity to Google - 206.108.255.141 AS15169. Can we confirm there is no saturation of their uplinks? Has there been a noticeable spike since Friday when some users received their Stadia system? Thanks, JW

Dec. 2, 2019

Re: WiscNet Remote Switch / Dedicated Remote Switches

by Ben Wiechman

My concern would be protecting the integrity of the exchange. Just because there have been no issues, doesn't mean there will be no issues at some point. This doesn't necessarily require dedicated hardware, nor does dedicated hardware necessarily guarantee this. A request to disclose practices in place today sent to those that currently maintain shared extension switches would be a good starting point in achieving a better understanding of the potential risks and help identify potential best practices that are already in place in addition to the suggestions already offered by Steve. Ben Wiechman Director of IP Strategy and Engineering 320.247.3224 | ben.wiechman(a)arvig.com Arvig | 224 East Main Street | Melrose, MN 56352 | arvig.com On Mon, Dec 2, 2019 at 12:09 PM Jeremy Lumby <jlumby(a)mnvoip.com> wrote: > In my opinion the single MAC address per participant facing MICE is the > most important requirement for the protection of MICE. I feel it is so > important that I had contacted the board/received approval so that I could > restrict my extension switch to 1 MAC address per participant regardless of > if MICE requires it or not. I think short term exceptions for > maintenance/upgrades are fine. I feel that trying to implement the 1 MAC > address rule on a shared extension switch would be very problematic (mostly > for other traffic that could be going across the same switch). > > > > I do not feel that the added cost/complexity of requiring a dedicated > extension switch would deter any network from connecting. As an extension > switch operator that offers multiple different services I offer MICE > completely for free to anyone with no requirements that they connect to > anything other than MICE. With this being said they are responsible to > getting one connection to me, however once I receive that connection all > services are broken out onto separate dedicated hardware free of charge in > a manner that would satisfy any IX that allows a connection to anything > other than their own core switches. > > > > *From:* MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] *On Behalf > Of *Steve Howard > *Sent:* Monday, December 02, 2019 10:31 AM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] WiscNet Remote Switch / Dedicated Remote > Switches > > > > I am not in favor of requiring MICE remote switches to be dedicated solely > to MICE. > > I think the proposed policy adds unnecessary complexity and costs > (one-time hardware, monthly cross-connects, space at 511, and > environmental) for remote switch operators. It also discourages additional > membership (WiscNet) and, in my opinion, results in very little real value > to MICE. Why institute a policy with real costs to MICE members and not > much real value? > > Sometimes the MICE community seems to worship larger exchanges, most > notably, SIX and AMS-IX. MICE should make decisions based upon what is > best for MICE. Just because the “big” exchanges do something doesn’t > necessarily mean it is best for MICE. We are not SIX. We are not > AMS-IX. Sometimes it is better to be a leader at not a follower! > > > I’d rather not have unnecessary rules and burdens. I’m not exactly sure > what real problem this proposed rule is trying to solve. But, if there > truly is a technical problem here that needs to be solved, I’d like to > propose a couple of suggestions for discussion that could help protect the > exchange: > > 1) If supported by the remote switch, enforce a specific MAC address > requirement on the MICE VLAN for remote switches. Typically this would be > one MAC address on the MICE VLAN, but there are a few cases where an > additional MAC would be required. This could create some challenges when > changing routers, but, in many cases, these can be resolved with some prior > planning. For example: Paul Bunyan uses a switched virtual interface (a > Cisco BVI) for its connection to SIX. This gives us the flexibility to > move that interface to any device without having to contact people at SIX. > Yet, it still gives SIX the protection of a single MAC address per port. > MICE could also have a policy to briefly allow an extra MAC address when > there is planned maintenance. > > 2) MICE could institute a “probationary” status for remote switches that > have a history of problems at MICE. MICE has had non-dedicated remote > switches from its beginning. To the best of my knowledge, this has never > caused a problem. However, we’ve all seen the recent history of a single > MICE remote switch operator that has had issues with packet loss, > apparently slow downtime responses, etc. Fortunately, those problems have > only affected their customers. Remote switch operators that have a history > of poor performance could have additional requirements placed upon them > until they’ve operated well for a period of time. Additionally, if a > remote switch operator’s non-dedicated use causes problems at MICE, the > remote switch operator could lose the privilege of having a non-dedicated > switch. > > 3) MICE could determine an appropriate level of broadcast traffic and > institute broadscast storm control based upon a multiplier of of the > typical levels. > > Disclaimers: I work for Paul Bunyan Communications which connects to MICE > via the CNS remote switch; Paul Bunyan is a founder and part-owner of CNS; > I help manage the CNS remote switch; I am one of the co-founders of MICE. > I try to be loyal to Paul Bunyan, CNS, and MICE. It gets complicated > sometimes! > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >

Dec. 2, 2019

Re: WiscNet Remote Switch / Dedicated Remote Switches

by Jeremy Lumby

In my opinion the single MAC address per participant facing MICE is the most important requirement for the protection of MICE. I feel it is so important that I had contacted the board/received approval so that I could restrict my extension switch to 1 MAC address per participant regardless of if MICE requires it or not. I think short term exceptions for maintenance/upgrades are fine. I feel that trying to implement the 1 MAC address rule on a shared extension switch would be very problematic (mostly for other traffic that could be going across the same switch). I do not feel that the added cost/complexity of requiring a dedicated extension switch would deter any network from connecting. As an extension switch operator that offers multiple different services I offer MICE completely for free to anyone with no requirements that they connect to anything other than MICE. With this being said they are responsible to getting one connection to me, however once I receive that connection all services are broken out onto separate dedicated hardware free of charge in a manner that would satisfy any IX that allows a connection to anything other than their own core switches. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Steve Howard Sent: Monday, December 02, 2019 10:31 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] WiscNet Remote Switch / Dedicated Remote Switches I am not in favor of requiring MICE remote switches to be dedicated solely to MICE. I think the proposed policy adds unnecessary complexity and costs (one-time hardware, monthly cross-connects, space at 511, and environmental) for remote switch operators. It also discourages additional membership (WiscNet) and, in my opinion, results in very little real value to MICE. Why institute a policy with real costs to MICE members and not much real value? Sometimes the MICE community seems to worship larger exchanges, most notably, SIX and AMS-IX. MICE should make decisions based upon what is best for MICE. Just because the “big” exchanges do something doesn’t necessarily mean it is best for MICE. We are not SIX. We are not AMS-IX. Sometimes it is better to be a leader at not a follower! I’d rather not have unnecessary rules and burdens. I’m not exactly sure what real problem this proposed rule is trying to solve. But, if there truly is a technical problem here that needs to be solved, I’d like to propose a couple of suggestions for discussion that could help protect the exchange: 1) If supported by the remote switch, enforce a specific MAC address requirement on the MICE VLAN for remote switches. Typically this would be one MAC address on the MICE VLAN, but there are a few cases where an additional MAC would be required. This could create some challenges when changing routers, but, in many cases, these can be resolved with some prior planning. For example: Paul Bunyan uses a switched virtual interface (a Cisco BVI) for its connection to SIX. This gives us the flexibility to move that interface to any device without having to contact people at SIX. Yet, it still gives SIX the protection of a single MAC address per port. MICE could also have a policy to briefly allow an extra MAC address when there is planned maintenance. 2) MICE could institute a “probationary” status for remote switches that have a history of problems at MICE. MICE has had non-dedicated remote switches from its beginning. To the best of my knowledge, this has never caused a problem. However, we’ve all seen the recent history of a single MICE remote switch operator that has had issues with packet loss, apparently slow downtime responses, etc. Fortunately, those problems have only affected their customers. Remote switch operators that have a history of poor performance could have additional requirements placed upon them until they’ve operated well for a period of time. Additionally, if a remote switch operator’s non-dedicated use causes problems at MICE, the remote switch operator could lose the privilege of having a non-dedicated switch. 3) MICE could determine an appropriate level of broadcast traffic and institute broadscast storm control based upon a multiplier of of the typical levels. Disclaimers: I work for Paul Bunyan Communications which connects to MICE via the CNS remote switch; Paul Bunyan is a founder and part-owner of CNS; I help manage the CNS remote switch; I am one of the co-founders of MICE. I try to be loyal to Paul Bunyan, CNS, and MICE. It gets complicated sometimes! To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Dec. 2, 2019

Re: WiscNet Remote Switch / Dedicated Remote Switches

by Steve Howard

Dec. 2, 2019

Re: WiscNet Remote Switch / Dedicated Remote Switches

by Andrew Hoyos

I’m in full support of WiscNet being able to add a remote switch here, even if it’s not dedicated. This seems like a 2nd switch in the mix just complicates things in the end, reading through below. If it boiled down to adding additional participants on a non dedicated switch, or nothing - my $0.02 would be to add the additional participants via the non-dedicated switch. This is really the same thing as what Northern Lights Gigapop is doing on MICE already (https://it.umn.edu/northern-lights-gigapop-introduction <https://it.umn.edu/northern-lights-gigapop-introduction>). I think R+E institutions need a bit of flexibility in this regard, given the scale and needs of their connectivity to other institutions. The board, IMHO, should have some flexibility to approve one-offs like this, even if policy is changed in the future. In the interim, it seems like the request should be evaluated using current rules/procedures (which seems like it’s board discretion at this point in time - current rules found on website posted below). Remote Switches If you are interested in operating a MICE remote switch, please contact peering(a)micemn.net <mailto:peering@micemn.net>. The process for connecting a new remote switch is as follows: The remote switch operator will provide a technical proposal to the board. The board will publish the proposal to the discussion list. After a reasonable comment period, the board will approve or deny the proposal. Remote switch operators’ obligations include (but are not necessarily limited to): Operators must obtain prior approval from the board for modifications. Operators are responsible for the costs of operating their remote switch and the links to the core switch. They must monitor their traffic levels and promptly add capacity to keep the links running congestion-free. Operators must enforce MICE’s technical port rules on their remote switches. Operators must coordinate participant connections and disconnections with MICE. MICE allocates exchange IP addresses and documents participant connections. Operators must inform their participants that the participants are not connecting directly to MICE. The remote switch operator cannot claim to be MICE. Operators must inform their participants that the participants are also subject to MICE rules, procedures, and costs. > On Nov 28, 2019, at 3:08 AM, Richard Laager <rlaager(a)WIKTEL.COM> wrote: > > I realize I am sending this on a holiday. This does _not_ require > immediate attention; next week is fine. > > ---- > > WiscNet has proposed a remote switch. I'm forwarding their proposal to > the MICE-DISCUSS list per our procedure. You can find it at the bottom > of this message. If you have any feedback for the board, please share > on-list or off-list, as you prefer. Note that the listserv software sets > a Reply-To, so if you are trying to reply off-list, you will have to > _edit_ the To field in your reply. > > The interesting question from my perspective, which we discussed a bit > at the last UG, is whether MICE should require remote switches to be > dedicated to this purpose. It's my understanding that other exchanges, > e.g. SIX, have this requirement. The last few remote switches have all > been dedicated, so things had trended that way without it being an > official MICE policy. The WiscNet proposal is for a non-dedicated switch > which is bringing this question to the forefront. > > Requiring remote switches to be dedicated is intended to help protect > the MICE switching fabric. It would provide a clean demarcation point, > which is important for applying rules like one-MAC-per-port, etc. It > also reduces the chances of problems in practice due to clean > separation, less complexity of configuration, etc. > > Currently, the following remote switches are, to the best of my > knowledge, dedicated: > > Zayo (formerly Neutral Path) > Minnesota VoIP > South Front Networks > Compudyne > > The following remote switches are not dedicated: > CNS > > I'm not sure about the following, but they're probably not dedicated: > Mankato Networks > Northern Lights GigaPoP* > > * This is something we treat somewhat like a remote switch, but I > believe they pre-date the remote switch policy. > > Note that the non-dedicated switches are the original remote switches or > their direct successors. > > I believe the consensus at the last UG when we discussed this was that: > - Implicitly: We need to decide the policy. > - Either way, the policy needs to apply to all remote switches; i.e. > we don't reject some solely for being non-dedicated while accepting > others. > - If we require remotes to be dedicated, existing non-dedicated > switches need to be grandfathered for at least some amount of time. > Upgrades to new switches would end grandfathering. > > I do not feel confident saying there was a consensus on the actual > question of whether dedicated switches should be required or not. If you > feel I misjudged the consensus of the room in either direction, please > let me know. > > If a dedicated switch was required, WiscNet would have to add an > additional switch, which would look like this: > > [MICE Arista] > | > | 100G-LR4 > | > [WiscNet MICE Remote Switch ] * No VLANs, All Untagged > | | > | 100G-SR4 | 100G-SR4 > | | > | VLAN 123 | VLAN 456 > | untagged | untagged > [WiscNet Existing Switch] > | | > | existing | existing > | 100G-LR4 | 100G-LR4 > | | > [WiscNet MX] [Iowa MX] > > The VLAN IDs (123, 456) are made-up examples. > > We discussed this and other alternatives off-list. WiscNet is firmly > opposed to adding such an additional switch. If MICE requires dedicated > remote switches, WiscNet will not operate a remote switch. They will > still upgrade their connectivity to MICE to 100G, but Iowa and MERIT > will likely be left out (unless they decide to get their own MICE ports). > > I (and I assume the rest of the board) would also be especially > interested to hear from the other operators of non-dedicated remote > switches. Feel free to reply on-list or off-list at your option. > > As per the usual remote switch procedure, after there's been an > opportunity for comments, the next step is for the board to vote on the > WiscNet remote switch proposal. Approving this proposal implicitly > decides that non-dedicated switches are okay, at least for now. It is my > view that we should _explicitly_ decide the dedicated remote switch > question one way or another, so I will also ask for a board decision on > that, but I cannot _require_ such a decision individually, of course. > > There is no specific timeline on this, but if you have thoughts, please > share them as soon as possible. > > Finally, while this is already public knowledge, I'd like to > specifically disclose that my employer's connection to MICE is on the > CNS switch, a non-dedicated remote switch. > > -------- Forwarded Message -------- > Subject: Re: WiscNet - AS2381 - Mice Remote Switch > Date: Mon, 18 Nov 2019 13:22:44 +0000 > From: Chris Wopat <wopat(a)wiscnet.net> > > Hi folks, sorry for the multi-week week delay in responding. > > I've attached a simplified diagram indicating how WiscNet would like to > connect to MICE. The diagram is separated by three phases- Current, > Proposed, Future. > > We are looking to transition from our current 10g connection via > University of Minnesota Gigapop, to a direct 100g connection from the > MICE core Arista switch to WiscNet's recently installed QFX10002. > > We would like to have the ability to share this connection with other > Research and Education organizations that may already connect to our > existing switch, as well as a few who may connect to it in the future. > > Known entities on the interested list are University of Iowa (AS3676) > and MERIT Network (AS237). This list may grow a little over time, but > it's likely that we'll be able to count this number entities on one hand. > > WiscNet is a non profit 501(c)(3) who per our bylaws > (https://www.wiscnet.net/bylaws) primarily serve educational > institutions and do not service commercial entities. > > When WiscNet recently reached out asking to become a MICE remote switch, > we were disappointed to hear that a recent(?) policy change was made > indicating that remote switches must be dedicated for MICE usage only. > > We will not be able to dedicate this device for MICE usage, nor would it > be cost effective to purchase a separate switch just for this purpose. > We're hoping that there's some middle category here where we're a switch > + our few research partners, similar to how a few entities are set up today. > > Cheers, > -- > Chris Wopat > Network Engineer, WiscNet > wopat(a)wiscnet.net 608-210-3965 > <wiscnet minneapolis design mice.pdf>

Dec. 1, 2019

WiscNet Remote Switch / Dedicated Remote Switches

by Richard Laager

I realize I am sending this on a holiday. This does _not_ require immediate attention; next week is fine. ---- WiscNet has proposed a remote switch. I'm forwarding their proposal to the MICE-DISCUSS list per our procedure. You can find it at the bottom of this message. If you have any feedback for the board, please share on-list or off-list, as you prefer. Note that the listserv software sets a Reply-To, so if you are trying to reply off-list, you will have to _edit_ the To field in your reply. The interesting question from my perspective, which we discussed a bit at the last UG, is whether MICE should require remote switches to be dedicated to this purpose. It's my understanding that other exchanges, e.g. SIX, have this requirement. The last few remote switches have all been dedicated, so things had trended that way without it being an official MICE policy. The WiscNet proposal is for a non-dedicated switch which is bringing this question to the forefront. Requiring remote switches to be dedicated is intended to help protect the MICE switching fabric. It would provide a clean demarcation point, which is important for applying rules like one-MAC-per-port, etc. It also reduces the chances of problems in practice due to clean separation, less complexity of configuration, etc. Currently, the following remote switches are, to the best of my knowledge, dedicated: Zayo (formerly Neutral Path) Minnesota VoIP South Front Networks Compudyne The following remote switches are not dedicated: CNS I'm not sure about the following, but they're probably not dedicated: Mankato Networks Northern Lights GigaPoP* * This is something we treat somewhat like a remote switch, but I believe they pre-date the remote switch policy. Note that the non-dedicated switches are the original remote switches or their direct successors. I believe the consensus at the last UG when we discussed this was that: - Implicitly: We need to decide the policy. - Either way, the policy needs to apply to all remote switches; i.e. we don't reject some solely for being non-dedicated while accepting others. - If we require remotes to be dedicated, existing non-dedicated switches need to be grandfathered for at least some amount of time. Upgrades to new switches would end grandfathering. I do not feel confident saying there was a consensus on the actual question of whether dedicated switches should be required or not. If you feel I misjudged the consensus of the room in either direction, please let me know. If a dedicated switch was required, WiscNet would have to add an additional switch, which would look like this: [MICE Arista] | | 100G-LR4 | [WiscNet MICE Remote Switch ] * No VLANs, All Untagged | | | 100G-SR4 | 100G-SR4 | | | VLAN 123 | VLAN 456 | untagged | untagged [WiscNet Existing Switch] | | | existing | existing | 100G-LR4 | 100G-LR4 | | [WiscNet MX] [Iowa MX] The VLAN IDs (123, 456) are made-up examples. We discussed this and other alternatives off-list. WiscNet is firmly opposed to adding such an additional switch. If MICE requires dedicated remote switches, WiscNet will not operate a remote switch. They will still upgrade their connectivity to MICE to 100G, but Iowa and MERIT will likely be left out (unless they decide to get their own MICE ports). I (and I assume the rest of the board) would also be especially interested to hear from the other operators of non-dedicated remote switches. Feel free to reply on-list or off-list at your option. As per the usual remote switch procedure, after there's been an opportunity for comments, the next step is for the board to vote on the WiscNet remote switch proposal. Approving this proposal implicitly decides that non-dedicated switches are okay, at least for now. It is my view that we should _explicitly_ decide the dedicated remote switch question one way or another, so I will also ask for a board decision on that, but I cannot _require_ such a decision individually, of course. There is no specific timeline on this, but if you have thoughts, please share them as soon as possible. Finally, while this is already public knowledge, I'd like to specifically disclose that my employer's connection to MICE is on the CNS switch, a non-dedicated remote switch. -------- Forwarded Message -------- Subject: Re: WiscNet - AS2381 - Mice Remote Switch Date: Mon, 18 Nov 2019 13:22:44 +0000 From: Chris Wopat <wopat(a)wiscnet.net> Hi folks, sorry for the multi-week week delay in responding. I've attached a simplified diagram indicating how WiscNet would like to connect to MICE. The diagram is separated by three phases- Current, Proposed, Future. We are looking to transition from our current 10g connection via University of Minnesota Gigapop, to a direct 100g connection from the MICE core Arista switch to WiscNet's recently installed QFX10002. We would like to have the ability to share this connection with other Research and Education organizations that may already connect to our existing switch, as well as a few who may connect to it in the future. Known entities on the interested list are University of Iowa (AS3676) and MERIT Network (AS237). This list may grow a little over time, but it's likely that we'll be able to count this number entities on one hand. WiscNet is a non profit 501(c)(3) who per our bylaws (https://www.wiscnet.net/bylaws) primarily serve educational institutions and do not service commercial entities. When WiscNet recently reached out asking to become a MICE remote switch, we were disappointed to hear that a recent(?) policy change was made indicating that remote switches must be dedicated for MICE usage only. We will not be able to dedicate this device for MICE usage, nor would it be cost effective to purchase a separate switch just for this purpose. We're hoping that there's some middle category here where we're a switch + our few research partners, similar to how a few entities are set up today. Cheers, -- Chris Wopat Network Engineer, WiscNet wopat(a)wiscnet.net 608-210-3965

Nov. 28, 2019

Re: HBC Port Augment/LAG conversion

by Doug McIntyre

On Mon, Nov 25, 2019 at 01:14:09PM -0600, Jay Hanke wrote: >Ethernet4/11 has been allocated to HBC. > >Their existing port (e5/11) will need to be converted to a LAG and >then e4/11 added into the group. Okay, I've allocated Port-Channel32 for HBC. How about this workflow though? They turn up the new link on Ethernet4/11 as a single-port LAG, cut their traffic on their side to the new port, and then ask us to bind the original port back into the LAG that is Port-Channel32 that their traffic would now be traversing? This is how things are setup now, waiting to hear if they want something different. -- Doug McIntyre <merlyn(a)iphouse.net> ~.~ ipHouse ~.~ Network Engineer/Provisioning/Jack of all Trades

Nov. 25, 2019

HBC Port Augment/LAG conversion

by Jay Hanke

Ethernet4/11 has been allocated to HBC. Their existing port (e5/11) will need to be converted to a LAG and then e4/11 added into the group. Welcome aboard (again)! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

Nov. 25, 2019

Re: packet loss today

by Justin Huffman

My connection has been stable since the Zayo maintenance. Sent from my Payphone ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Frank Bulk <fbulk(a)MYPREMIERONLINE.COM> Sent: Saturday, November 23, 2019 8:20:26 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] packet loss today WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. Thanks, that probably explains why I saw some BGP sessions down from 1:24 to 1:27 am (Central). Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Justin Huffman Sent: Friday, November 22, 2019 9:38 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] packet loss today Zayo called me, our issue IS related to your ticket as well. Zayo is also telling me an emergency maintenance is in the works to replace a line card and optics hopefully around midnight Central time. Sent from my Payphone ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM<mailto:james.urwiller@TURNKEY-TELECOM.COM>> Sent: Friday, November 22, 2019 9:24:07 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: Re: [MICE-DISCUSS] packet loss today WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. telling me its optic/card and they are pushing for an emergency midnight maintenance to swap. Sent from my iPhone 7 On Nov 22, 2019, at 20:50, Justin Huffman <jhuffman(a)longlines.biz<mailto:jhuffman@longlines.biz>> wrote: Zayo is saying our path is clean, does anyone else have updates from Zayo? Sent from my Payphone ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM<mailto:james.urwiller@TURNKEY-TELECOM.COM>> Sent: Friday, November 22, 2019 4:38:11 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: Re: [MICE-DISCUSS] packet loss today WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. My ticket is 3716945 James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> <image001.jpg> From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Huffman Sent: Friday, November 22, 2019 16:37 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] packet loss today I'm opening up a ticket as well... Sent from my Payphone ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM<mailto:james.urwiller@TURNKEY-TELECOM.COM>> Sent: Friday, November 22, 2019 4:31:14 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: Re: [MICE-DISCUSS] packet loss today WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. Thanks all – I will open a ticket. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> <image002.jpg> From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jeremy Lumby Sent: Friday, November 22, 2019 16:29 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] packet loss today I am having the exact same experience between 511 and Belle Plaine. I opened a ticket yesterday, and did not even get a reply. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Friday, November 22, 2019 4:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] packet loss today Greetings all, I have been noticing packet loss today similar to how it was a few weeks back before Zayo replaced a card. I know they had a fiber cut yesterday in Omaha south of where I hop on to get to the exchange, I was unaffected by that but today I just have a lot of packet loss. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> <image002.jpg> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 23, 2019

Re: packet loss today

by Frank Bulk

Thanks, that probably explains why I saw some BGP sessions down from 1:24 to 1:27 am (Central). Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Justin Huffman Sent: Friday, November 22, 2019 9:38 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] packet loss today Zayo called me, our issue IS related to your ticket as well. Zayo is also telling me an emergency maintenance is in the works to replace a line card and optics hopefully around midnight Central time. Sent from my Payphone ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM<mailto:james.urwiller@TURNKEY-TELECOM.COM>> Sent: Friday, November 22, 2019 9:24:07 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: Re: [MICE-DISCUSS] packet loss today WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. telling me its optic/card and they are pushing for an emergency midnight maintenance to swap. Sent from my iPhone 7 On Nov 22, 2019, at 20:50, Justin Huffman <jhuffman(a)longlines.biz<mailto:jhuffman@longlines.biz>> wrote: Zayo is saying our path is clean, does anyone else have updates from Zayo? Sent from my Payphone ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM<mailto:james.urwiller@TURNKEY-TELECOM.COM>> Sent: Friday, November 22, 2019 4:38:11 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: Re: [MICE-DISCUSS] packet loss today WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. My ticket is 3716945 James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> <image001.jpg> From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Huffman Sent: Friday, November 22, 2019 16:37 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] packet loss today I'm opening up a ticket as well... Sent from my Payphone ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM<mailto:james.urwiller@TURNKEY-TELECOM.COM>> Sent: Friday, November 22, 2019 4:31:14 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: Re: [MICE-DISCUSS] packet loss today WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. Thanks all – I will open a ticket. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> <image002.jpg> From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jeremy Lumby Sent: Friday, November 22, 2019 16:29 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] packet loss today I am having the exact same experience between 511 and Belle Plaine. I opened a ticket yesterday, and did not even get a reply. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Friday, November 22, 2019 4:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] packet loss today Greetings all, I have been noticing packet loss today similar to how it was a few weeks back before Zayo replaced a card. I know they had a fiber cut yesterday in Omaha south of where I hop on to get to the exchange, I was unaffected by that but today I just have a lot of packet loss. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> <image002.jpg> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

Nov. 23, 2019

Re: packet loss today

by Justin Huffman

Zayo called me, our issue IS related to your ticket as well. Zayo is also telling me an emergency maintenance is in the works to replace a line card and optics hopefully around midnight Central time. Sent from my Payphone ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> Sent: Friday, November 22, 2019 9:24:07 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] packet loss today WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. telling me its optic/card and they are pushing for an emergency midnight maintenance to swap. Sent from my iPhone 7 On Nov 22, 2019, at 20:50, Justin Huffman <jhuffman(a)longlines.biz> wrote: Zayo is saying our path is clean, does anyone else have updates from Zayo? Sent from my Payphone ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> Sent: Friday, November 22, 2019 4:38:11 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] packet loss today WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. My ticket is 3716945 James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> <image001.jpg> From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Huffman Sent: Friday, November 22, 2019 16:37 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] packet loss today I'm opening up a ticket as well... Sent from my Payphone ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM<mailto:james.urwiller@TURNKEY-TELECOM.COM>> Sent: Friday, November 22, 2019 4:31:14 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: Re: [MICE-DISCUSS] packet loss today WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. Thanks all – I will open a ticket. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> <image002.jpg> From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jeremy Lumby Sent: Friday, November 22, 2019 16:29 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] packet loss today I am having the exact same experience between 511 and Belle Plaine. I opened a ticket yesterday, and did not even get a reply. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Friday, November 22, 2019 4:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] packet loss today Greetings all, I have been noticing packet loss today similar to how it was a few weeks back before Zayo replaced a card. I know they had a fiber cut yesterday in Omaha south of where I hop on to get to the exchange, I was unaffected by that but today I just have a lot of packet loss. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> <image002.jpg> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 23, 2019

Re: packet loss today

by James Urwiller

telling me its optic/card and they are pushing for an emergency midnight maintenance to swap. Sent from my iPhone 7 > On Nov 22, 2019, at 20:50, Justin Huffman <jhuffman(a)longlines.biz> wrote: > > > Zayo is saying our path is clean, does anyone else have updates from Zayo? > > Sent from my Payphone > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> > Sent: Friday, November 22, 2019 4:38:11 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> > Subject: Re: [MICE-DISCUSS] packet loss today > > WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. > My ticket is 3716945 > > James Urwiller > Network Architect > Stealth Broadband > james.urwiller(a)stealthbroadband.com > <image001.jpg> > > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Justin Huffman > Sent: Friday, November 22, 2019 16:37 > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] packet loss today > > I'm opening up a ticket as well... > > Sent from my Payphone > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> > Sent: Friday, November 22, 2019 4:31:14 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> > Subject: Re: [MICE-DISCUSS] packet loss today > > WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. > Thanks all – I will open a ticket. > > James Urwiller > Network Architect > Stealth Broadband > james.urwiller(a)stealthbroadband.com > <image002.jpg> > > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby > Sent: Friday, November 22, 2019 16:29 > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] packet loss today > > I am having the exact same experience between 511 and Belle Plaine. I opened a ticket yesterday, and did not even get a reply. > > From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller > Sent: Friday, November 22, 2019 4:24 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: [MICE-DISCUSS] packet loss today > > Greetings all, > I have been noticing packet loss today similar to how it was a few weeks back before Zayo replaced a card. I know they had a fiber cut yesterday in Omaha south of where I hop on to get to the exchange, I was unaffected by that but today I just have a lot of packet loss. Anyone else? > > James Urwiller > Network Architect > Stealth Broadband > james.urwiller(a)stealthbroadband.com > <image002.jpg> > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 23, 2019

Re: packet loss today

by Justin Huffman

Zayo is saying our path is clean, does anyone else have updates from Zayo? Sent from my Payphone ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> Sent: Friday, November 22, 2019 4:38:11 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] packet loss today WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. My ticket is 3716945 James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Huffman Sent: Friday, November 22, 2019 16:37 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] packet loss today I'm opening up a ticket as well... Sent from my Payphone ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM<mailto:james.urwiller@TURNKEY-TELECOM.COM>> Sent: Friday, November 22, 2019 4:31:14 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: Re: [MICE-DISCUSS] packet loss today WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. Thanks all – I will open a ticket. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jeremy Lumby Sent: Friday, November 22, 2019 16:29 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] packet loss today I am having the exact same experience between 511 and Belle Plaine. I opened a ticket yesterday, and did not even get a reply. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Friday, November 22, 2019 4:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] packet loss today Greetings all, I have been noticing packet loss today similar to how it was a few weeks back before Zayo replaced a card. I know they had a fiber cut yesterday in Omaha south of where I hop on to get to the exchange, I was unaffected by that but today I just have a lot of packet loss. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 23, 2019

Re: packet loss today

by Justin Huffman

Here’s mine… TTN-0003716968 From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of James Urwiller Sent: Friday, November 22, 2019 4:38 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] packet loss today WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. My ticket is 3716945 James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Huffman Sent: Friday, November 22, 2019 16:37 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] packet loss today I'm opening up a ticket as well... Sent from my Payphone ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM<mailto:james.urwiller@TURNKEY-TELECOM.COM>> Sent: Friday, November 22, 2019 4:31:14 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: Re: [MICE-DISCUSS] packet loss today WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. Thanks all – I will open a ticket. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jeremy Lumby Sent: Friday, November 22, 2019 16:29 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] packet loss today I am having the exact same experience between 511 and Belle Plaine. I opened a ticket yesterday, and did not even get a reply. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Friday, November 22, 2019 4:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] packet loss today Greetings all, I have been noticing packet loss today similar to how it was a few weeks back before Zayo replaced a card. I know they had a fiber cut yesterday in Omaha south of where I hop on to get to the exchange, I was unaffected by that but today I just have a lot of packet loss. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 22, 2019

Re: packet loss today

by James Urwiller

My ticket is 3716945 James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Justin Huffman *Sent:* Friday, November 22, 2019 16:37 *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] packet loss today I'm opening up a ticket as well... Sent from my Payphone ------------------------------ *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> *Sent:* Friday, November 22, 2019 4:31:14 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Subject:* Re: [MICE-DISCUSS] packet loss today WARNING!! This message originated from an *External Source*. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. Thanks all – I will open a ticket. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Jeremy Lumby *Sent:* Friday, November 22, 2019 16:29 *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] packet loss today I am having the exact same experience between 511 and Belle Plaine. I opened a ticket yesterday, and did not even get a reply. *From:* MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET <MICE-DISCUSS(a)LISTS.IPHOUSE.NET>] *On Behalf Of *James Urwiller *Sent:* Friday, November 22, 2019 4:24 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* [MICE-DISCUSS] packet loss today Greetings all, I have been noticing packet loss today similar to how it was a few weeks back before Zayo replaced a card. I know they had a fiber cut yesterday in Omaha south of where I hop on to get to the exchange, I was unaffected by that but today I just have a lot of packet loss. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 22, 2019

Re: packet loss today

by Justin Huffman

I'm opening up a ticket as well... Sent from my Payphone ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> Sent: Friday, November 22, 2019 4:31:14 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] packet loss today WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. Thanks all – I will open a ticket. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jeremy Lumby Sent: Friday, November 22, 2019 16:29 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] packet loss today I am having the exact same experience between 511 and Belle Plaine. I opened a ticket yesterday, and did not even get a reply. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Friday, November 22, 2019 4:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] packet loss today Greetings all, I have been noticing packet loss today similar to how it was a few weeks back before Zayo replaced a card. I know they had a fiber cut yesterday in Omaha south of where I hop on to get to the exchange, I was unaffected by that but today I just have a lot of packet loss. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 22, 2019

Re: packet loss today

by James Urwiller

Thanks all – I will open a ticket. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Jeremy Lumby *Sent:* Friday, November 22, 2019 16:29 *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] packet loss today I am having the exact same experience between 511 and Belle Plaine. I opened a ticket yesterday, and did not even get a reply. *From:* MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET <MICE-DISCUSS(a)LISTS.IPHOUSE.NET>] *On Behalf Of *James Urwiller *Sent:* Friday, November 22, 2019 4:24 PM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* [MICE-DISCUSS] packet loss today Greetings all, I have been noticing packet loss today similar to how it was a few weeks back before Zayo replaced a card. I know they had a fiber cut yesterday in Omaha south of where I hop on to get to the exchange, I was unaffected by that but today I just have a lot of packet loss. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 22, 2019

Re: packet loss today

by Jeremy Lumby

I am having the exact same experience between 511 and Belle Plaine. I opened a ticket yesterday, and did not even get a reply. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Friday, November 22, 2019 4:24 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] packet loss today Greetings all, I have been noticing packet loss today similar to how it was a few weeks back before Zayo replaced a card. I know they had a fiber cut yesterday in Omaha south of where I hop on to get to the exchange, I was unaffected by that but today I just have a lot of packet loss. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 22, 2019

Re: packet loss today

by Justin Huffman

We hop on Zayo in Sioux City that takes us to 511. We've been experiencing ospf flaps between Sioux City and 511 all day. Sent from my Payphone ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> Sent: Friday, November 22, 2019 4:23:37 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] packet loss today WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. Greetings all, I have been noticing packet loss today similar to how it was a few weeks back before Zayo replaced a card. I know they had a fiber cut yesterday in Omaha south of where I hop on to get to the exchange, I was unaffected by that but today I just have a lot of packet loss. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 22, 2019

packet loss today

by James Urwiller

Greetings all, I have been noticing packet loss today similar to how it was a few weeks back before Zayo replaced a card. I know they had a fiber cut yesterday in Omaha south of where I hop on to get to the exchange, I was unaffected by that but today I just have a lot of packet loss. Anyone else? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300]

Nov. 22, 2019

Re: Please Welcome PhirePhly Design to MICE!

by Doug McIntyre

On Thu, Nov 21, 2019 at 01:44:37PM -0600, Jay Hanke wrote: >Name: PhirePhly Design >Port: Ethernet 11 MN Voip Remote Switch >ASN: 7034 >IPv4: 206.108.255.152/24 >IPv6: 2001:504:27:0:0:1b7a::1/64 >Peering Contact: kenneth(a)phirephly.design >Route Servers- YES >BFD: No Okay, the RS's are all set up for them. Welcome! -- Doug McIntyre <merlyn(a)iphouse.net> ~.~ ipHouse ~.~ Network Engineer/Provisioning/Jack of all Trades

Nov. 21, 2019

Please Welcome PhirePhly Design to MICE!

by Jay Hanke

Name: PhirePhly Design Port: Ethernet 11 MN Voip Remote Switch ASN: 7034 IPv4: 206.108.255.152/24 IPv6: 2001:504:27:0:0:1b7a::1/64 Peering Contact: kenneth(a)phirephly.design Route Servers- YES BFD: No Welcome Aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

Nov. 21, 2019

Re: [ADV] [MICE-DISCUSS] Additional WIN 10G Port

by Doug McIntyre

On Wed, Nov 20, 2019 at 08:31:03AM -0600, Jay Hanke wrote: >Port 4/43 on the main switch has been allocated to WIN. Please add this >port to their existing LAG group. > >Welcome aboard! Okay, port 4/43 has been added to Port Channel 8 for WINS/Airstream. -- Doug McIntyre <merlyn(a)iphouse.net> ~.~ ipHouse ~.~ Network Engineer/Provisioning/Jack of all Trades

Nov. 20, 2019

Additional WIN 10G Port

by Jay Hanke

Port 4/43 on the main switch has been allocated to WIN. Please add this port to their existing LAG group. Welcome aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

Nov. 20, 2019

Re: MICE Limelight Upgrade/Route Server addition

by Doug McIntyre

On Mon, Nov 18, 2019 at 07:42:49PM -0600, Jay Hanke wrote: >Limelight is moving from their existing 2x10G LAG to 1x100G LAG on >main switch port 3/15/1. The existing 10G ports will be vacated. This >move was competed this afternoon. > >Limelight is also adding an additional 100G port to the MN VoIP remote >switch with an additional IP assignment. > >Name: Limelight (New additional) >Port: MN VoIP Port 2 (100G Switch) >ASN: 22882 >IPv4: 206.108.255.151 >IPv6: 2001:504:27:0:0:5926::2 > >Limelight has also requested RS sessions for both of their IP assignments. > >The following Limelight IPs need RS sessions created or verified >IPv4: 206.108.255.43 >IPv6: 2001:504:27:0:0:5926::1 Both of these have been added to both RSs. They should be all set to go. -- Doug McIntyre <merlyn(a)iphouse.net> ~.~ ipHouse ~.~ Network Engineer/Provisioning/Jack of all Trades

Nov. 19, 2019

Re: Google Issues?

by David Farmer

Looks like it came back just before 04:00. On Mon, Nov 18, 2019 at 8:35 PM Jeff Dahna <jeff.dahna(a)windommn.com> wrote: > Apparently it is a fiber cut on Level3 as per previous message. > -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

Nov. 19, 2019

Re: Google Issues?

by Richard Laager

On 11/18/19 8:30 PM, Nathan Beard wrote: > Google peering sessions via MICE have been down for nearly 8 hours at > this point for multiple customers including Stellar Association. For networks that have Google caches, are you advertising only customer routes to them, or also advertising peer routes? The latter supposedly enables peer-to-peer cache fill, which may be helpful, especially in times like this. https://support.google.com/interconnect/answer/7658603 > What should I advertise to the GGC node? > You should advertise all your user prefixes. If you have peers and > downstream customers, you may advertise their prefixes too. https://support.google.com/interconnect/answer/7658593 > Can GGC nodes cache-fill from other GGC nodes? > Yes. We refer to this as peer-to-peer cache-fill. It can lead to > substantial improvements in resilience, and reduction in transit or > AS15169 peering traffic. > > To enable peer-to-peer traffic, the IP prefix of the GGC servers must > be advertised to all GGC nodes that you want to be candidates to be > cache-fill sources. These other nodes can be in your network or nodes > hosted by your peers. > > It is possible for cache-fill traffic to flow in both directions > between two nodes, or between two ASNs. -- Richard

Nov. 19, 2019

Re: Google Issues?

by Jeff Dahna

Apparently it is a fiber cut on Level3 as per previous message.

Nov. 19, 2019

Google Issues?

by Nathan Beard

All, Google peering sessions via MICE have been down for nearly 8 hours at this point for multiple customers including Stellar Association. Is anybody aware of an issue? I don't recall seeing an update for any work being completed but it's possible that I missed something... *Nathan Beard* *7Sigma Systems, Inc.* Network Engineer (218) 820-7636 www.7sigma.com

Nov. 19, 2019

Re: MICE Limelight Upgrade/Route Server addition

by Richard Laager

On 11/18/19 7:42 PM, Jay Hanke wrote: > Limelight is moving from their existing 2x10G LAG to 1x100G LAG on > main switch port 3/15/1. The existing 10G ports will be vacated. This > move was competed this afternoon. > > Limelight is also adding an additional 100G port to the MN VoIP remote > switch with an additional IP assignment. > > Name: Limelight (New additional) > Port: MN VoIP Port 2 (100G Switch) > ASN: 22882 > IPv4: 206.108.255.151 > IPv6: 2001:504:27:0:0:5926::2 > > Limelight has also requested RS sessions for both of their IP assignments. Are they doing full routes with the route servers, or just partial? That is, their website Route Server value is currently "No". Does it move to "Yes" or "Partial"? -- Richard

Nov. 19, 2019

MICE Limelight Upgrade/Route Server addition

by Jay Hanke

Limelight is moving from their existing 2x10G LAG to 1x100G LAG on main switch port 3/15/1. The existing 10G ports will be vacated. This move was competed this afternoon. Limelight is also adding an additional 100G port to the MN VoIP remote switch with an additional IP assignment. Name: Limelight (New additional) Port: MN VoIP Port 2 (100G Switch) ASN: 22882 IPv4: 206.108.255.151 IPv6: 2001:504:27:0:0:5926::2 Limelight has also requested RS sessions for both of their IP assignments. The following Limelight IPs need RS sessions created or verified IPv4: 206.108.255.43 IPv6: 2001:504:27:0:0:5926::1 Welcome aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

Nov. 19, 2019

Re: Google

by Jeff Dahna

ETA= Estimated Time of Arrival. It is going to be awhile before it is restored. ETR= Estimated Time of Restoration

Nov. 18, 2019

Re: Google

by Dean Bahls

Ahh, thanks for setting me straight. That's actually pretty impressive if they can get it fixed that quickly. Dean -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Mike Johnston Sent: Monday, November 18, 2019 3:32 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Google On 2019-11-18 15:23, Dean Bahls wrote: > 23:00 ETA is not good. The ETA was stated as GMT, not local time. 23:00 GMT is 17:00 (5:00pm) local time.

Nov. 18, 2019

Re: Google

by Mike Johnston

On 2019-11-18 15:23, Dean Bahls wrote: > 23:00 ETA is not good. The ETA was stated as GMT, not local time. 23:00 GMT is 17:00 (5:00pm) local time.

Nov. 18, 2019

Re: Google

by Dean Bahls

I wonder if Zayo cut it…. JUST KIDDING! 😊 23:00 ETA is not good. I’m hearing some pretty ugly stories of folks suffering with this cut. Tells you how much folks rely on MICE nowadays!! Dean From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Andrew Hoyos Sent: Monday, November 18, 2019 3:18 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Google The latest update we had from Level3 (hey, look, a non Zayo related fiber issue, haha!) *** CASCADED EXTERNAL NOTES 18-Nov-2019 20:39:54 GMT From CASE: 17573224 - Event The Transport NOC reports that light level testing indicates a potential fault 13.8 kilometers from the testing site. The Outside Plant Engineer (OSPE) was engaged, provided the test results, and requested to assist with locating the exact point of failure. The OSPE has dispatched Field Operations personnel to the approximate location of the fault to begin searching for the physical damage point. As a precaution, construction teams have been engaged and dispatched to the approximate location of the damage. An ETA of approximately 23:00 GMT has been provided for the construction teams. On Nov 18, 2019, at 3:11 PM, Jeremy Schmeichel <Jeremy.Schmeichel(a)VASTBROADBAND.COM <mailto:Jeremy.Schmeichel@VASTBROADBAND.COM> > wrote: I’m glad someone asked, because I was wondering why our peer went down. Makes sense. From: MICE Discuss < <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Andrew Hoyos Sent: Monday, November 18, 2019 2:04 PM To: <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Google We lost some Level3 circuits at the same time as their peer dropped, due to a fiber cut in Wisconsin (near Dousman, WI). I’m 99.99% sure Google optical network rides that fiber from Chicago -> MSP, which implies they seem to be single homed, and backhauled to Chicago. On Nov 18, 2019, at 3:01 PM, Dean Bahls < <mailto:dean.bahls@COOPERATIVE-NETWORKS.COM> dean.bahls(a)COOPERATIVE-NETWORKS.COM> wrote: Any word on what’s going on at Google? I’m guessing someone had a bad day. Dean Dean Bahls Network Services Manager | Cooperative Network Services, LLC 14 Main St SW | PO Box J | Menahga, MN 56464 218.346.3635 (Direct) | 218.564.3000 (Main Office) <mailto:dean.bahls@cooperative-networks.com> dean.bahls(a)cooperative-networks.com <image003.jpg> _____ To unsubscribe from the MICE-DISCUSS list, click the following link: <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 CONFIDENTIAL: This email and any files transmitted with it are confidential and intended solely for the use of Vast Broadband/NTS and to whom they are addressed. If you have received this email in error, please notify the system manager. This message contains confidential information and is intended only for the individual named. If you are not the named addressee, you should not disseminate, distribute or copy this email. Please notify the sender immediately by email if you have received this email by mistake and delete this email from your system. If you are not the intended recipient, you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited. CONFIDENTIAL: This email and any files transmitted with it are confidential and intended solely for the use of Vast Broadband/NTS and to whom they are addressed. If you have received this email in error, please notify the system manager. This message contains confidential information and is intended only for the individual named. If you are not the named addressee, you should not disseminate, distribute or copy this email. Please notify the sender immediately by email if you have received this email by mistake and delete this email from your system. If you are not the intended recipient, you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited. _____ To unsubscribe from the MICE-DISCUSS list, click the following link: <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> &A=1

Nov. 18, 2019

Re: Google

by Andrew Hoyos

The latest update we had from Level3 (hey, look, a non Zayo related fiber issue, haha!) *** CASCADED EXTERNAL NOTES 18-Nov-2019 20:39:54 GMT From CASE: 17573224 - Event The Transport NOC reports that light level testing indicates a potential fault 13.8 kilometers from the testing site. The Outside Plant Engineer (OSPE) was engaged, provided the test results, and requested to assist with locating the exact point of failure. The OSPE has dispatched Field Operations personnel to the approximate location of the fault to begin searching for the physical damage point. As a precaution, construction teams have been engaged and dispatched to the approximate location of the damage. An ETA of approximately 23:00 GMT has been provided for the construction teams. > On Nov 18, 2019, at 3:11 PM, Jeremy Schmeichel <Jeremy.Schmeichel(a)VASTBROADBAND.COM> wrote: > > I’m glad someone asked, because I was wondering why our peer went down. Makes sense. > > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Andrew Hoyos > Sent: Monday, November 18, 2019 2:04 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> > Subject: Re: [MICE-DISCUSS] Google > > We lost some Level3 circuits at the same time as their peer dropped, due to a fiber cut in Wisconsin (near Dousman, WI). > I’m 99.99% sure Google optical network rides that fiber from Chicago -> MSP, which implies they seem to be single homed, and backhauled to Chicago. > > > On Nov 18, 2019, at 3:01 PM, Dean Bahls <dean.bahls(a)COOPERATIVE-NETWORKS.COM <mailto:dean.bahls@COOPERATIVE-NETWORKS.COM>> wrote: > > Any word on what’s going on at Google? I’m guessing someone had a bad day. > > Dean > > > Dean Bahls > Network Services Manager | Cooperative Network Services, LLC > 14 Main St SW | PO Box J | Menahga, MN 56464 > 218.346.3635 (Direct) | 218.564.3000 (Main Office) > dean.bahls(a)cooperative-networks.com <mailto:dean.bahls@cooperative-networks.com> > > <image003.jpg> > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> > CONFIDENTIAL: This email and any files transmitted with it are confidential and intended solely for the use of Vast Broadband/NTS and to whom they are addressed. If you have received this email in error, please notify the system manager. This message contains confidential information and is intended only for the individual named. If you are not the named addressee, you should not disseminate, distribute or copy this email. Please notify the sender immediately by email if you have received this email by mistake and delete this email from your system. If you are not the intended recipient, you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited. > CONFIDENTIAL: This email and any files transmitted with it are confidential and intended solely for the use of Vast Broadband/NTS and to whom they are addressed. If you have received this email in error, please notify the system manager. This message contains confidential information and is intended only for the individual named. If you are not the named addressee, you should not disseminate, distribute or copy this email. Please notify the sender immediately by email if you have received this email by mistake and delete this email from your system. If you are not the intended recipient, you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited. > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1>

Nov. 18, 2019

Re: Google

by Ben Wiechman

Did you first see issues around 12:30? Access to some Google services dropped for me around then. Ben Wiechman Director of IP Strategy and Engineering 320.247.3224 | ben.wiechman(a)arvig.com Arvig | 224 East Main Street | Melrose, MN 56352 | arvig.com On Mon, Nov 18, 2019 at 3:11 PM Jeremy Schmeichel < Jeremy.Schmeichel(a)vastbroadband.com> wrote: > I’m glad someone asked, because I was wondering why our peer went down. > Makes sense. > > > > *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Andrew > Hoyos > *Sent:* Monday, November 18, 2019 2:04 PM > *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET > *Subject:* Re: [MICE-DISCUSS] Google > > > > We lost some Level3 circuits at the same time as their peer dropped, due > to a fiber cut in Wisconsin (near Dousman, WI). > > I’m 99.99% sure Google optical network rides that fiber from Chicago -> > MSP, which implies they seem to be single homed, and backhauled to Chicago. > > > > On Nov 18, 2019, at 3:01 PM, Dean Bahls < > dean.bahls(a)COOPERATIVE-NETWORKS.COM> wrote: > > > > Any word on what’s going on at Google? I’m guessing someone had a bad day. > > > > Dean > > > > > > *Dean Bahls* > > Network Services Manager | Cooperative Network Services, LLC > > 14 Main St SW | PO Box J | Menahga, MN 56464 > > 218.346.3635 (Direct) | 218.564.3000 (Main Office) > > dean.bahls(a)cooperative-networks.com > > > > <image003.jpg> > > > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > CONFIDENTIAL: This email and any files transmitted with it are > confidential and intended solely for the use of Vast Broadband/NTS and to > whom they are addressed. If you have received this email in error, please > notify the system manager. This message contains confidential information > and is intended only for the individual named. If you are not the named > addressee, you should not disseminate, distribute or copy this email. > Please notify the sender immediately by email if you have received this > email by mistake and delete this email from your system. If you are not the > intended recipient, you are notified that disclosing, copying, distributing > or taking any action in reliance on the contents of this information is > strictly prohibited. > CONFIDENTIAL: This email and any files transmitted with it are > confidential and intended solely for the use of Vast Broadband/NTS and to > whom they are addressed. If you have received this email in error, please > notify the system manager. This message contains confidential information > and is intended only for the individual named. If you are not the named > addressee, you should not disseminate, distribute or copy this email. > Please notify the sender immediately by email if you have received this > email by mistake and delete this email from your system. If you are not the > intended recipient, you are notified that disclosing, copying, distributing > or taking any action in reliance on the contents of this information is > strictly prohibited. > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >

Nov. 18, 2019

Re: Google

by Jeremy Schmeichel

I’m glad someone asked, because I was wondering why our peer went down. Makes sense. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Andrew Hoyos Sent: Monday, November 18, 2019 2:04 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Google We lost some Level3 circuits at the same time as their peer dropped, due to a fiber cut in Wisconsin (near Dousman, WI). I’m 99.99% sure Google optical network rides that fiber from Chicago -> MSP, which implies they seem to be single homed, and backhauled to Chicago. On Nov 18, 2019, at 3:01 PM, Dean Bahls <dean.bahls(a)COOPERATIVE-NETWORKS.COM<mailto:dean.bahls@COOPERATIVE-NETWORKS.COM>> wrote: Any word on what’s going on at Google? I’m guessing someone had a bad day. Dean Dean Bahls Network Services Manager | Cooperative Network Services, LLC 14 Main St SW | PO Box J | Menahga, MN 56464 218.346.3635 (Direct) | 218.564.3000 (Main Office) dean.bahls(a)cooperative-networks.com<mailto:dean.bahls@cooperative-networks.com> <image003.jpg> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 CONFIDENTIAL: This email and any files transmitted with it are confidential and intended solely for the use of Vast Broadband/NTS and to whom they are addressed. If you have received this email in error, please notify the system manager. This message contains confidential information and is intended only for the individual named. If you are not the named addressee, you should not disseminate, distribute or copy this email. Please notify the sender immediately by email if you have received this email by mistake and delete this email from your system. If you are not the intended recipient, you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited. CONFIDENTIAL: This email and any files transmitted with it are confidential and intended solely for the use of Vast Broadband/NTS and to whom they are addressed. If you have received this email in error, please notify the system manager. This message contains confidential information and is intended only for the individual named. If you are not the named addressee, you should not disseminate, distribute or copy this email. Please notify the sender immediately by email if you have received this email by mistake and delete this email from your system. If you are not the intended recipient, you are notified that disclosing, copying, distributing or taking any action in reliance on the contents of this information is strictly prohibited.

Nov. 18, 2019

Re: Google

by Andrew Hoyos

We lost some Level3 circuits at the same time as their peer dropped, due to a fiber cut in Wisconsin (near Dousman, WI). I’m 99.99% sure Google optical network rides that fiber from Chicago -> MSP, which implies they seem to be single homed, and backhauled to Chicago. > On Nov 18, 2019, at 3:01 PM, Dean Bahls <dean.bahls(a)COOPERATIVE-NETWORKS.COM> wrote: > > Any word on what’s going on at Google? I’m guessing someone had a bad day. > > Dean > > > Dean Bahls > Network Services Manager | Cooperative Network Services, LLC > 14 Main St SW | PO Box J | Menahga, MN 56464 > 218.346.3635 (Direct) | 218.564.3000 (Main Office) > dean.bahls(a)cooperative-networks.com <mailto:dean.bahls@cooperative-networks.com> > > <image003.jpg> > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1>

Nov. 18, 2019

Google

by Dean Bahls

Any word on what's going on at Google? I'm guessing someone had a bad day. Dean Dean Bahls Network Services Manager | Cooperative Network Services, LLC 14 Main St SW | PO Box J | Menahga, MN 56464 218.346.3635 (Direct) | 218.564.3000 (Main Office) dean.bahls(a)cooperative-networks.com <mailto:dean.bahls@cooperative-networks.com>

Nov. 18, 2019

Re: Please Welcome SBT to MICE!

by Doug McIntyre

On Fri, Nov 15, 2019 at 08:54:58AM -0600, Jay Hanke wrote: >Name: SBT, Int >Port: Ethernet 4 MNVoip Remote Switch >ASN: 11255 >IPv4: 206.108.255.149/24 >IPv6: 2001:504:27:0:0:2bf7::1/64 >Peering Contact: peering(a)sbt.net >Route Servers- YES >BFD: YES Added to the route servers. Welcome! -- Doug McIntyre <merlyn(a)iphouse.net> ~.~ ipHouse ~.~ Network Engineer/Provisioning/Jack of all Trades

Nov. 18, 2019

Please Welcome SBT to MICE!

by Jay Hanke

Name: SBT, Int Port: Ethernet 4 MNVoip Remote Switch ASN: 11255 IPv4: 206.108.255.149/24 IPv6: 2001:504:27:0:0:2bf7::1/64 Peering Contact: peering(a)sbt.net Route Servers- YES BFD: YES Welcome aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

Nov. 15, 2019

Re: random packet loss since yesterday afternoon anyone?

by Jeremy Lumby

I saw it, and it appears related to: GENERAL INFORMATION Case Number: TTN-0003669752 Customer Ticket Number: Customer Circuit Id: Case Subject: Minnesota VoIP / ETYX/176681//ZYO / Packet loss Case Impact: Impaired Case Status: Service Restored Case Sub Status: Monitor Initial Down Time: Sun Nov 03 20:41:12 GMT 2019 Restore Date Time: Wed Nov 06 15:11:24 GMT 2019 Thu Nov 07 13:35:09 GMT 2019 The replacement has been completed please notify Zayo if you have further issues Wed Nov 06 18:05:19 GMT 2019 Current update: Correction. A Zayo technician has been dispatched to site to replace a failed card. ETA is 12:01 AM CDT on 11/07/2019 We will provide updates as they become available. Wed Nov 06 18:05:08 GMT 2019 Current update: Correction. A Zayo technician has been dispatched to site to replace a failed card. ETA is 12:01 AM CDT on 11/07/2019 We will provide updates as they become available. Wed Nov 06 17:05:06 GMT 2019 Current update: A Zayo technician has been dispatched to site to replace a failed card. ETA is 12:01 PM CDT. We will provide updates as they become available. Mon Nov 04 20:00:14 GMT 2019 Here's how the ports in question trace out after our dispatch today: NP_BLLPMN08YB1 1-3-4 = NNP-LS0000129 (MICE) = RR 001.100.05 Juniper 4500 MICE XE 38 NP_BLLPMN08YB1 1-3-6 = NNP-LB0000170 (MPLS) = RR 001.100.05 Juniper 4500 MSP1 XE 37 NP_BLLPMN08YB1 1-3-7 = NNP-LS0000186 (Nebraskalink) = RR 001.100.05 Brocade Netiron Port 2/4 NP_BLLPMN08YB1 1-3-8 = NNP-LB0000231 (MPLS) = RR 001.100.05 Juniper 4500 MSP1 XE 38 Per Ciena ( C10237538 ), since there is no common shelf/equipment, we are going to move forward with scheduling an MR in order to swap out the CYAN card and the optic to have absolute certainty that its not the optical gear. I'll be setting this up for us and letting everyone know when the day/time is for MR. Thanks for your patience throughout this process. Eric P. Reed - Zayo ONCC Mon Nov 04 19:36:04 GMT 2019 Hello, Our transport team is dispatching back out to further isolate the device causing the backbone flapping. -Zach Mon Nov 04 15:40:37 GMT 2019 CURRENT STATUS: I'm picking this tkt up for review and will get back to you once I have an opportunity to work with our TAC support and get some clear direction. Eric P. Reed - Zayo ONCC. Mon Nov 04 13:10:07 GMT 2019 Dear Customer, We are working with the equipment vendor and transport team to resolve the issue More updates to follow as they become available Mon Nov 04 12:00:19 GMT 2019 Dear Customer, We continue to escalate with the equipment vendor to get this issue resolved. More updates to follow as they become available. Mon Nov 04 10:05:25 GMT 2019 Dear Customer, We continue to work with the equipment vendor. More updates to follow as they become available Mon Nov 04 08:55:06 GMT 2019 Dear Customer, The transport team is currently working with the vendor. More updates to follow as they become available. Mon Nov 04 05:15:39 GMT 2019 Dear Customer, We have engaged our transport team to check that portion of the circuit. More updates to follow as they become available. Mon Nov 04 03:20:08 GMT 2019 Dear Customer, We are in the process of dispatching to the POP site to trouble. More updates to follow as they become available. If you are need of immediate assistance please contact the NOC at 1.866.236.2824 Opt 1, 3 Mon Nov 04 00:44:46 GMT 2019 <pre>Hello Jerey, We have identified a backbone flap which might be impacting your circuit. We are currently investigating the issue. Regards, Akramul H Zayo US:1.866.236.2824 Zayo Canada:1.888.404.9296 Cloud:+855.528.4797 zColo:+877.926.5687 Website: https://www.zayo.com From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Frank Bulk Sent: Thursday, November 07, 2019 7:29 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? I saw some disruption to MICE and all of my private peering sessions between 2 and 3 am this (11/7/2019) morning – anyone else see that? Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Wednesday, November 6, 2019 12:33 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? I just got an update stating that the last update was incorrect, and the card will be replaced tonight at midnight. From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Wednesday, November 06, 2019 11:08 AM To: MICE Discuss Subject: RE: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Even though I never got the notice of when Zayo was going to replace the card, they did replace it around the same time of last night’s damaged fiber replacement. I just now got notice that it completed, and they closed the ticket. I will watch for more loss tonight. From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Wednesday, November 06, 2019 8:29 AM To: MICE Discuss Subject: RE: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Unfortunately the maintenance was unrelated, it was to replaced a damaged 288 count fiber. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Wednesday, November 06, 2019 8:23 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Apparently they did the maintenance last night?? I was not notified, nor have I checked to see if its any better yet. But I did lose that link last night for about an hour from midnight to 1 AM CST. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Tuesday, November 5, 2019 09:30 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? I got the same update. I did see loss last night at Peak utilization, however it was nowhere near as bad as the previous night. I am also waiting on notification for them to swap the cards in the cyan gear Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> Date: 11/5/19 9:26 AM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? >From : James Urwiller [james.urwiller(a)TURNKEY-TELECOM.COM] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Tuesday, November 5 2019 09:26:57 Last ticket I received they traced out some other customers path (not mine) and told me there was no common path, but they wanted to swap a cyan transport card anyway, and would schedule the maintenance “soon” However I think its better-ish now?? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Justin Huffman Sent: Tuesday, November 5, 2019 09:17 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? We also opened up a case with Zayo however they put a loopback on the circuit and did not see any errors apparently. Are you all still seeing loss? If so, what did Zayo come up with? Thanks in advance, Justin From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Monday, November 4, 2019 11:01 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. The last few updates I had were that they dispatched a tech to Belle Plaine, then they moved the ticket back to the backbone group who engaged the hardware vendor. I still do not have an ETR, however yesterday I did see a little bit of loss at 8AM, however it got much worse as the traffic to MICE increased in the evening. Currently I am seeing loss, however it is much less than Sunday evening. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Monday, November 04, 2019 10:43 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Only updates I have on my ticket is that a tech is investigating.. it has certainly been sporadic for us. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Justin Huffman Sent: Monday, November 4, 2019 10:30 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? We have had a few customers complain about packet loss to google.com today as well and was able to see packet loss from one of our routers up to 511 building. However, I don’t see packet loss anymore, but maybe it is really intermittent. Did you hear any update from Zayo? Justin Long Lines Broadband From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Monday, November 4, 2019 8:36 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. I am seeing it on the Zayo path between Belle Plaine, and Minneapolis. I have a ticket open since yesterday afternoon, and they appear to be struggling to nail it down. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Monday, November 04, 2019 8:33 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Greetings all, Since yesterday afternoon I have been experiencing random packet loss to things that traceroute to the MICE exchange. It does not appear to be related to any particular participants path out from the exchange. Is anyone else seeing this? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 7, 2019

Re: random packet loss since yesterday afternoon anyone?

by Frank Bulk

I saw some disruption to MICE and all of my private peering sessions between 2 and 3 am this (11/7/2019) morning – anyone else see that? Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Wednesday, November 6, 2019 12:33 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? I just got an update stating that the last update was incorrect, and the card will be replaced tonight at midnight. From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Wednesday, November 06, 2019 11:08 AM To: MICE Discuss Subject: RE: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Even though I never got the notice of when Zayo was going to replace the card, they did replace it around the same time of last night’s damaged fiber replacement. I just now got notice that it completed, and they closed the ticket. I will watch for more loss tonight. From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Wednesday, November 06, 2019 8:29 AM To: MICE Discuss Subject: RE: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Unfortunately the maintenance was unrelated, it was to replaced a damaged 288 count fiber. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Wednesday, November 06, 2019 8:23 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Apparently they did the maintenance last night?? I was not notified, nor have I checked to see if its any better yet. But I did lose that link last night for about an hour from midnight to 1 AM CST. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jeremy Lumby Sent: Tuesday, November 5, 2019 09:30 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? I got the same update. I did see loss last night at Peak utilization, however it was nowhere near as bad as the previous night. I am also waiting on notification for them to swap the cards in the cyan gear Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com> -------- Original message -------- From: James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM<mailto:james.urwiller@TURNKEY-TELECOM.COM>> Date: 11/5/19 9:26 AM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? ________________________________ From : James Urwiller [james.urwiller(a)TURNKEY-TELECOM.COM<mailto:james.urwiller@TURNKEY-TELECOM.COM>] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> [MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>] Date : Tuesday, November 5 2019 09:26:57 Last ticket I received they traced out some other customers path (not mine) and told me there was no common path, but they wanted to swap a cyan transport card anyway, and would schedule the maintenance “soon” However I think its better-ish now?? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Huffman Sent: Tuesday, November 5, 2019 09:17 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? We also opened up a case with Zayo however they put a loopback on the circuit and did not see any errors apparently. Are you all still seeing loss? If so, what did Zayo come up with? Thanks in advance, Justin From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jeremy Lumby Sent: Monday, November 4, 2019 11:01 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. The last few updates I had were that they dispatched a tech to Belle Plaine, then they moved the ticket back to the backbone group who engaged the hardware vendor. I still do not have an ETR, however yesterday I did see a little bit of loss at 8AM, however it got much worse as the traffic to MICE increased in the evening. Currently I am seeing loss, however it is much less than Sunday evening. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com> From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Monday, November 04, 2019 10:43 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Only updates I have on my ticket is that a tech is investigating.. it has certainly been sporadic for us. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Justin Huffman Sent: Monday, November 4, 2019 10:30 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? We have had a few customers complain about packet loss to google.com<https://urldefense.proofpoint.com/v2/url?u=http-3A__google.com&d=DwMFaQ&c=e…> today as well and was able to see packet loss from one of our routers up to 511 building. However, I don’t see packet loss anymore, but maybe it is really intermittent. Did you hear any update from Zayo? Justin Long Lines Broadband From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Jeremy Lumby Sent: Monday, November 4, 2019 8:36 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. I am seeing it on the Zayo path between Belle Plaine, and Minneapolis. I have a ticket open since yesterday afternoon, and they appear to be struggling to nail it down. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com<mailto:jlumby@mnvoip.com> From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Monday, November 04, 2019 8:33 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Greetings all, Since yesterday afternoon I have been experiencing random packet loss to things that traceroute to the MICE exchange. It does not appear to be related to any particular participants path out from the exchange. Is anyone else seeing this? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://urldefense.proofpoint.com/v2/url?u=http-3A__lists.iphouse.net_cgi-2…>

Nov. 7, 2019

Re: random packet loss since yesterday afternoon anyone?

by Jeremy Lumby

I just got an update stating that the last update was incorrect, and the card will be replaced tonight at midnight. From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Wednesday, November 06, 2019 11:08 AM To: MICE Discuss Subject: RE: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Even though I never got the notice of when Zayo was going to replace the card, they did replace it around the same time of last night’s damaged fiber replacement. I just now got notice that it completed, and they closed the ticket. I will watch for more loss tonight. From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Wednesday, November 06, 2019 8:29 AM To: MICE Discuss Subject: RE: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Unfortunately the maintenance was unrelated, it was to replaced a damaged 288 count fiber. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Wednesday, November 06, 2019 8:23 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Apparently they did the maintenance last night?? I was not notified, nor have I checked to see if its any better yet. But I did lose that link last night for about an hour from midnight to 1 AM CST. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Tuesday, November 5, 2019 09:30 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? I got the same update. I did see loss last night at Peak utilization, however it was nowhere near as bad as the previous night. I am also waiting on notification for them to swap the cards in the cyan gear Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> Date: 11/5/19 9:26 AM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? >From : James Urwiller [james.urwiller(a)TURNKEY-TELECOM.COM] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Tuesday, November 5 2019 09:26:57 Last ticket I received they traced out some other customers path (not mine) and told me there was no common path, but they wanted to swap a cyan transport card anyway, and would schedule the maintenance “soon” However I think its better-ish now?? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Justin Huffman Sent: Tuesday, November 5, 2019 09:17 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? We also opened up a case with Zayo however they put a loopback on the circuit and did not see any errors apparently. Are you all still seeing loss? If so, what did Zayo come up with? Thanks in advance, Justin From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Monday, November 4, 2019 11:01 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. The last few updates I had were that they dispatched a tech to Belle Plaine, then they moved the ticket back to the backbone group who engaged the hardware vendor. I still do not have an ETR, however yesterday I did see a little bit of loss at 8AM, however it got much worse as the traffic to MICE increased in the evening. Currently I am seeing loss, however it is much less than Sunday evening. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Monday, November 04, 2019 10:43 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Only updates I have on my ticket is that a tech is investigating.. it has certainly been sporadic for us. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Justin Huffman Sent: Monday, November 4, 2019 10:30 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? We have had a few customers complain about packet loss to google.com today as well and was able to see packet loss from one of our routers up to 511 building. However, I don’t see packet loss anymore, but maybe it is really intermittent. Did you hear any update from Zayo? Justin Long Lines Broadband From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Monday, November 4, 2019 8:36 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. I am seeing it on the Zayo path between Belle Plaine, and Minneapolis. I have a ticket open since yesterday afternoon, and they appear to be struggling to nail it down. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Monday, November 04, 2019 8:33 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Greetings all, Since yesterday afternoon I have been experiencing random packet loss to things that traceroute to the MICE exchange. It does not appear to be related to any particular participants path out from the exchange. Is anyone else seeing this? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 6, 2019

Re: random packet loss since yesterday afternoon anyone?

by Jeremy Lumby

Even though I never got the notice of when Zayo was going to replace the card, they did replace it around the same time of last night’s damaged fiber replacement. I just now got notice that it completed, and they closed the ticket. I will watch for more loss tonight. From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Wednesday, November 06, 2019 8:29 AM To: MICE Discuss Subject: RE: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Unfortunately the maintenance was unrelated, it was to replaced a damaged 288 count fiber. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Wednesday, November 06, 2019 8:23 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Apparently they did the maintenance last night?? I was not notified, nor have I checked to see if its any better yet. But I did lose that link last night for about an hour from midnight to 1 AM CST. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Tuesday, November 5, 2019 09:30 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? I got the same update. I did see loss last night at Peak utilization, however it was nowhere near as bad as the previous night. I am also waiting on notification for them to swap the cards in the cyan gear Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> Date: 11/5/19 9:26 AM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? >From : James Urwiller [james.urwiller(a)TURNKEY-TELECOM.COM] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Tuesday, November 5 2019 09:26:57 Last ticket I received they traced out some other customers path (not mine) and told me there was no common path, but they wanted to swap a cyan transport card anyway, and would schedule the maintenance “soon” However I think its better-ish now?? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Justin Huffman Sent: Tuesday, November 5, 2019 09:17 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? We also opened up a case with Zayo however they put a loopback on the circuit and did not see any errors apparently. Are you all still seeing loss? If so, what did Zayo come up with? Thanks in advance, Justin From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Monday, November 4, 2019 11:01 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. The last few updates I had were that they dispatched a tech to Belle Plaine, then they moved the ticket back to the backbone group who engaged the hardware vendor. I still do not have an ETR, however yesterday I did see a little bit of loss at 8AM, however it got much worse as the traffic to MICE increased in the evening. Currently I am seeing loss, however it is much less than Sunday evening. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Monday, November 04, 2019 10:43 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Only updates I have on my ticket is that a tech is investigating.. it has certainly been sporadic for us. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Justin Huffman Sent: Monday, November 4, 2019 10:30 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? We have had a few customers complain about packet loss to google.com today as well and was able to see packet loss from one of our routers up to 511 building. However, I don’t see packet loss anymore, but maybe it is really intermittent. Did you hear any update from Zayo? Justin Long Lines Broadband From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Monday, November 4, 2019 8:36 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. I am seeing it on the Zayo path between Belle Plaine, and Minneapolis. I have a ticket open since yesterday afternoon, and they appear to be struggling to nail it down. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Monday, November 04, 2019 8:33 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Greetings all, Since yesterday afternoon I have been experiencing random packet loss to things that traceroute to the MICE exchange. It does not appear to be related to any particular participants path out from the exchange. Is anyone else seeing this? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 6, 2019

Re: random packet loss since yesterday afternoon anyone?

by Jeremy Lumby

Unfortunately the maintenance was unrelated, it was to replaced a damaged 288 count fiber. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Wednesday, November 06, 2019 8:23 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Apparently they did the maintenance last night?? I was not notified, nor have I checked to see if its any better yet. But I did lose that link last night for about an hour from midnight to 1 AM CST. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Tuesday, November 5, 2019 09:30 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? I got the same update. I did see loss last night at Peak utilization, however it was nowhere near as bad as the previous night. I am also waiting on notification for them to swap the cards in the cyan gear Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> Date: 11/5/19 9:26 AM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? >From : James Urwiller [james.urwiller(a)TURNKEY-TELECOM.COM] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Tuesday, November 5 2019 09:26:57 Last ticket I received they traced out some other customers path (not mine) and told me there was no common path, but they wanted to swap a cyan transport card anyway, and would schedule the maintenance “soon” However I think its better-ish now?? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Justin Huffman Sent: Tuesday, November 5, 2019 09:17 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? We also opened up a case with Zayo however they put a loopback on the circuit and did not see any errors apparently. Are you all still seeing loss? If so, what did Zayo come up with? Thanks in advance, Justin From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Monday, November 4, 2019 11:01 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. The last few updates I had were that they dispatched a tech to Belle Plaine, then they moved the ticket back to the backbone group who engaged the hardware vendor. I still do not have an ETR, however yesterday I did see a little bit of loss at 8AM, however it got much worse as the traffic to MICE increased in the evening. Currently I am seeing loss, however it is much less than Sunday evening. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Monday, November 04, 2019 10:43 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Only updates I have on my ticket is that a tech is investigating.. it has certainly been sporadic for us. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Justin Huffman Sent: Monday, November 4, 2019 10:30 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? We have had a few customers complain about packet loss to google.com today as well and was able to see packet loss from one of our routers up to 511 building. However, I don’t see packet loss anymore, but maybe it is really intermittent. Did you hear any update from Zayo? Justin Long Lines Broadband From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Monday, November 4, 2019 8:36 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. I am seeing it on the Zayo path between Belle Plaine, and Minneapolis. I have a ticket open since yesterday afternoon, and they appear to be struggling to nail it down. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Monday, November 04, 2019 8:33 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Greetings all, Since yesterday afternoon I have been experiencing random packet loss to things that traceroute to the MICE exchange. It does not appear to be related to any particular participants path out from the exchange. Is anyone else seeing this? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 6, 2019

Re: random packet loss since yesterday afternoon anyone?

by James Urwiller

Apparently they did the maintenance last night?? I was not notified, nor have I checked to see if its any better yet. But I did lose that link last night for about an hour from midnight to 1 AM CST. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Jeremy Lumby *Sent:* Tuesday, November 5, 2019 09:30 *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? I got the same update. I did see loss last night at Peak utilization, however it was nowhere near as bad as the previous night. I am also waiting on notification for them to swap the cards in the cyan gear Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> Date: 11/5/19 9:26 AM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? ------------------------------ *From* : James Urwiller [james.urwiller(a)TURNKEY-TELECOM.COM] *To* : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] *Date* : Tuesday, November 5 2019 09:26:57 Last ticket I received they traced out some other customers path (not mine) and told me there was no common path, but they wanted to swap a cyan transport card anyway, and would schedule the maintenance “soon” However I think its better-ish now?? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Justin Huffman *Sent:* Tuesday, November 5, 2019 09:17 *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? We also opened up a case with Zayo however they put a loopback on the circuit and did not see any errors apparently. Are you all still seeing loss? If so, what did Zayo come up with? Thanks in advance, Justin *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Jeremy Lumby *Sent:* Monday, November 4, 2019 11:01 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? WARNING!! This message originated from an *External Source*. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. The last few updates I had were that they dispatched a tech to Belle Plaine, then they moved the ticket back to the backbone group who engaged the hardware vendor. I still do not have an ETR, however yesterday I did see a little bit of loss at 8AM, however it got much worse as the traffic to MICE increased in the evening. Currently I am seeing loss, however it is much less than Sunday evening. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com *From:* MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET <MICE-DISCUSS(a)LISTS.IPHOUSE.NET>] *On Behalf Of *James Urwiller *Sent:* Monday, November 04, 2019 10:43 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Only updates I have on my ticket is that a tech is investigating.. it has certainly been sporadic for us. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Justin Huffman *Sent:* Monday, November 4, 2019 10:30 *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? We have had a few customers complain about packet loss to google.com today as well and was able to see packet loss from one of our routers up to 511 building. However, I don’t see packet loss anymore, but maybe it is really intermittent. Did you hear any update from Zayo? Justin Long Lines Broadband *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of *Jeremy Lumby *Sent:* Monday, November 4, 2019 8:36 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? WARNING!! This message originated from an *External Source*. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. I am seeing it on the Zayo path between Belle Plaine, and Minneapolis. I have a ticket open since yesterday afternoon, and they appear to be struggling to nail it down. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com *From:* MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET <MICE-DISCUSS(a)LISTS.IPHOUSE.NET>] *On Behalf Of *James Urwiller *Sent:* Monday, November 04, 2019 8:33 AM *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Greetings all, Since yesterday afternoon I have been experiencing random packet loss to things that traceroute to the MICE exchange. It does not appear to be related to any particular participants path out from the exchange. Is anyone else seeing this? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 6, 2019

Re: random packet loss since yesterday afternoon anyone?

by Jeremy Lumby

I got the same update. I did see loss last night at Peak utilization, however it was nowhere near as bad as the previous night. I am also waiting on notification for them to swap the cards in the cyan gear Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> Date: 11/5/19 9:26 AM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? _____ >From : James Urwiller [james.urwiller(a)TURNKEY-TELECOM.COM] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Tuesday, November 5 2019 09:26:57 Last ticket I received they traced out some other customers path (not mine) and told me there was no common path, but they wanted to swap a cyan transport card anyway, and would schedule the maintenance “soon” However I think its better-ish now?? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com stealth300 From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Justin Huffman Sent: Tuesday, November 5, 2019 09:17 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? We also opened up a case with Zayo however they put a loopback on the circuit and did not see any errors apparently. Are you all still seeing loss? If so, what did Zayo come up with? Thanks in advance, Justin From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Monday, November 4, 2019 11:01 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. The last few updates I had were that they dispatched a tech to Belle Plaine, then they moved the ticket back to the backbone group who engaged the hardware vendor. I still do not have an ETR, however yesterday I did see a little bit of loss at 8AM, however it got much worse as the traffic to MICE increased in the evening. Currently I am seeing loss, however it is much less than Sunday evening. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Monday, November 04, 2019 10:43 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Only updates I have on my ticket is that a tech is investigating.. it has certainly been sporadic for us. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com stealth300 From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Justin Huffman Sent: Monday, November 4, 2019 10:30 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? We have had a few customers complain about packet loss to google.com today as well and was able to see packet loss from one of our routers up to 511 building. However, I don’t see packet loss anymore, but maybe it is really intermittent. Did you hear any update from Zayo? Justin Long Lines Broadband From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Monday, November 4, 2019 8:36 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? WARNING!! This message originated from an External Source. Please use proper judgment and caution when opening attachments, clicking links, or responding to this email. I am seeing it on the Zayo path between Belle Plaine, and Minneapolis. I have a ticket open since yesterday afternoon, and they appear to be struggling to nail it down. Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of James Urwiller Sent: Monday, November 04, 2019 8:33 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] random packet loss since yesterday afternoon anyone? Greetings all, Since yesterday afternoon I have been experiencing random packet loss to things that traceroute to the MICE exchange. It does not appear to be related to any particular participants path out from the exchange. Is anyone else seeing this? James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com stealth300 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Nov. 5, 2019