- mice-discuss - lists.micemn.net

Re: Google CDN at MICE

by Jeremy Lumby

I opened a ticket with Google, however they typically take several days to reply. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Ryan Rosenwald Sent: Tuesday, January 29, 2019 12:38 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Google CDN at MICE Any word back on this? RYAN ROSENWALD Technology Manager (218) 454-1234 company (218) 454-1111 direct ryan(a)goctc.com goctc.com From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of AnthonyAnderberg(a)nuvera.net Sent: Tuesday, January 29, 2019 8:10 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Google CDN at MICE Does anyone have insight into what happened with Google at MICE last night? To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 29, 2019

Re: Google CDN at MICE

by Ryan Rosenwald

Any word back on this? RYAN ROSENWALD Technology Manager (218) 454-1234 company (218) 454-1111 direct ryan(a)goctc.com<mailto:ryan@goctc.com> goctc.com [fb] <https://www.facebook.com/connectctc> [tw] <https://twitter.com/connectctc> [yt] <https://youtu.be/A_tgcHZD6oA> [pic] From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of AnthonyAnderberg(a)nuvera.net Sent: Tuesday, January 29, 2019 8:10 AM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Google CDN at MICE Does anyone have insight into what happened with Google at MICE last night? [cid:image007.png@01D4B7CF.81496090] [signature_1049503188] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 29, 2019

Re: Youtube/Google

by Jeremy Lumby

I have not had any complaints either, however I noticed that the redirector is serving our traffic off of the Google cache connected to KCIX. From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Ryan Rosenwald Sent: Tuesday, January 29, 2019 12:23 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Youtube/Google Negative here at CTC. RYAN ROSENWALD Technology Manager (218) 454-1234 company (218) 454-1111 direct ryan(a)goctc.com goctc.com From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Jeff Wilde Sent: Tuesday, January 29, 2019 12:19 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Youtube/Google Any complaints on connectivity Issues through people watching Youtube? We have had some people calling in that said it is sporadic. Just curious. Jeff Wilde IT Manager Park Region Telephone Company P: 218-826-8330 E: jeff.wilde(a)parkregion.com To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 29, 2019

Re: Youtube/Google

by Ryan Rosenwald

Negative here at CTC. RYAN ROSENWALD Technology Manager (218) 454-1234 company (218) 454-1111 direct ryan(a)goctc.com<mailto:ryan@goctc.com> goctc.com [fb] <https://www.facebook.com/connectctc> [tw] <https://twitter.com/connectctc> [yt] <https://youtu.be/A_tgcHZD6oA> [pic] From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Jeff Wilde Sent: Tuesday, January 29, 2019 12:19 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Youtube/Google Any complaints on connectivity Issues through people watching Youtube? We have had some people calling in that said it is sporadic. Just curious. Jeff Wilde IT Manager Park Region Telephone Company P: 218-826-8330 E: jeff.wilde(a)parkregion.com<mailto:jeff.wilde@parkregion.com> ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 29, 2019

Youtube/Google

by Jeff Wilde

Any complaints on connectivity Issues through people watching Youtube? We have had some people calling in that said it is sporadic. Just curious. Jeff Wilde IT Manager Park Region Telephone Company P: 218-826-8330 E: jeff.wilde(a)parkregion.com<mailto:jeff.wilde@parkregion.com>

Jan. 29, 2019

Google CDN at MICE

by AnthonyAnderberg＠nuvera.net

Does anyone have insight into what happened with Google at MICE last night? [cid:image001.png@01D4B7AA.040189C0] [signature_1049503188]

Jan. 29, 2019

Re: Exchange Stable

by James Urwiller

same Frank!! same... i got a call back from Zayo noc at 19:07 tonight, with no real assurance that anyone knew what was going on. they were just asking if I was still experiencing issues. :( Sent from my iPhone 7 > On Jan 22, 2019, at 18:38, Frank Bulk <fbulk(a)mypremieronline.com> wrote: > > Zayo had scheduled maintenance for the 14th, rescheduled it to the 16th and then canceled maintenance (on the 16th)… but then our link to MICE, through their network, was down today (22nd) from ~12:07 to ~1:10 am with no warning at all. > > Even the maintenance window notifications were unclear – no real clarity from Zayo change maintenance. > > We also saw the BGP service interruption at 3:32 pm, and then a link down at 3:33 pm (presumably when the 100G wave over which our 10G rides went down). =( > > Frank > > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Schmeichel > Sent: Tuesday, January 22, 2019 5:08 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] Exchange Stable > > Zayo has had a fiber crew out working today from what we’ve been told. It’s been impacting our traffic for sure. > > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Andy Koch > Sent: Tuesday, January 22, 2019 2:58 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] Exchange Stable > > Hi James, > > My sessions are showing uptimes of ~4days on the MICE, which correlates to the main switch maintenance last week. You may want to check in with Zayo as it looks that they lost all traffic on the remote switch in Belle Plaine at 1AM. Traffic graphs are not quite as clear this afternoon, but there was an upward spike on several ports. > > http://micelg.usinternet.com/cacti/graph_view.php?action=tree&tree_id=1&lea… > > > > Andy Koch > Hoyos Consulting LLC > ofc: +1 608 616 9950 > andyk(a)hoyosconsulting.com > http://www.hoyosconsulting.com > > On 1/22/19 3:41 PM, James Urwiller wrote: > Any one else notice all their peers bounce last night around 1AM CST, and a few again just a few minutes ago? > Just checking to see If I should talk to my transport provider or if this is something @ MICE. Let me know! > > > James Urwiller > Network Architect > Stealth Broadband > james.urwiller(a)stealthbroadband.com > > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 23, 2019

Re: Exchange Stable

by Frank Bulk

Zayo had scheduled maintenance for the 14th, rescheduled it to the 16th and then canceled maintenance (on the 16th)… but then our link to MICE, through their network, was down today (22nd) from ~12:07 to ~1:10 am with no warning at all. Even the maintenance window notifications were unclear – no real clarity from Zayo change maintenance. We also saw the BGP service interruption at 3:32 pm, and then a link down at 3:33 pm (presumably when the 100G wave over which our 10G rides went down). =( Frank From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Schmeichel Sent: Tuesday, January 22, 2019 5:08 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Exchange Stable Zayo has had a fiber crew out working today from what we’ve been told. It’s been impacting our traffic for sure. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Andy Koch Sent: Tuesday, January 22, 2019 2:58 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Exchange Stable Hi James, My sessions are showing uptimes of ~4days on the MICE, which correlates to the main switch maintenance last week. You may want to check in with Zayo as it looks that they lost all traffic on the remote switch in Belle Plaine at 1AM. Traffic graphs are not quite as clear this afternoon, but there was an upward spike on several ports. http://micelg.usinternet.com/cacti/graph_view.php?action=tree&tree_id=1&lea… Andy Koch Hoyos Consulting LLC ofc: +1 608 616 9950 andyk(a)hoyosconsulting.com<mailto:andyk@hoyosconsulting.com> http://www.hoyosconsulting.com On 1/22/19 3:41 PM, James Urwiller wrote: Any one else notice all their peers bounce last night around 1AM CST, and a few again just a few minutes ago? Just checking to see If I should talk to my transport provider or if this is something @ MICE. Let me know! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 23, 2019

Re: Exchange Stable

by Justin Krejci

We were told Zayo had scheduled maintenance but did not send notifications to all parties that were to be affected (eg US Internet). We have several circuits still affected (ie are down) and we are continuing to claw through their support channels and are hearing some disturbing things. ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of Jeremy Schmeichel <Jeremy.Schmeichel(a)VASTBROADBAND.COM> Sent: Tuesday, January 22, 2019 5:07 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Exchange Stable Zayo has had a fiber crew out working today from what we've been told. It's been impacting our traffic for sure. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Andy Koch Sent: Tuesday, January 22, 2019 2:58 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Exchange Stable Hi James, My sessions are showing uptimes of ~4days on the MICE, which correlates to the main switch maintenance last week. You may want to check in with Zayo as it looks that they lost all traffic on the remote switch in Belle Plaine at 1AM. Traffic graphs are not quite as clear this afternoon, but there was an upward spike on several ports. http://micelg.usinternet.com/cacti/graph_view.php?action=tree&tree_id=1&lea… Andy Koch Hoyos Consulting LLC ofc: +1 608 616 9950 andyk(a)hoyosconsulting.com<mailto:andyk@hoyosconsulting.com> http://www.hoyosconsulting.com On 1/22/19 3:41 PM, James Urwiller wrote: Any one else notice all their peers bounce last night around 1AM CST, and a few again just a few minutes ago? Just checking to see If I should talk to my transport provider or if this is something @ MICE. Let me know! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 23, 2019

Re: Exchange Stable

by Jeremy Schmeichel

Zayo has had a fiber crew out working today from what we’ve been told. It’s been impacting our traffic for sure. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Andy Koch Sent: Tuesday, January 22, 2019 2:58 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Exchange Stable Hi James, My sessions are showing uptimes of ~4days on the MICE, which correlates to the main switch maintenance last week. You may want to check in with Zayo as it looks that they lost all traffic on the remote switch in Belle Plaine at 1AM. Traffic graphs are not quite as clear this afternoon, but there was an upward spike on several ports. http://micelg.usinternet.com/cacti/graph_view.php?action=tree&tree_id=1&lea… Andy Koch Hoyos Consulting LLC ofc: +1 608 616 9950 andyk(a)hoyosconsulting.com<mailto:andyk@hoyosconsulting.com> http://www.hoyosconsulting.com On 1/22/19 3:41 PM, James Urwiller wrote: Any one else notice all their peers bounce last night around 1AM CST, and a few again just a few minutes ago? Just checking to see If I should talk to my transport provider or if this is something @ MICE. Let me know! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 22, 2019

Re: Exchange Stable

by Andy Koch

Hi James, My sessions are showing uptimes of ~4days on the MICE, which correlates to the main switch maintenance last week. You may want to check in with Zayo as it looks that they lost all traffic on the remote switch in Belle Plaine at 1AM. Traffic graphs are not quite as clear this afternoon, but there was an upward spike on several ports. http://micelg.usinternet.com/cacti/graph_view.php?action=tree&tree_id=1&lea… Andy Koch Hoyos Consulting LLC ofc: +1 608 616 9950 andyk(a)hoyosconsulting.com http://www.hoyosconsulting.com On 1/22/19 3:41 PM, James Urwiller wrote: > > Any one else notice all their peers bounce last night around 1AM CST, > and a few again just a few minutes ago? > > Just checking to see If I should talk to my transport provider or if > this is something @ MICE. Let me know! > > James Urwiller > > Network Architect > > Stealth Broadband > > james.urwiller(a)stealthbroadband.com > <mailto:james.urwiller@stealthbroadband.com> > > stealth300 > > > ------------------------------------------------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >

Jan. 22, 2019

Re: Exchange Stable

by AnthonyAnderberg＠nuvera.net

Looks like it went down last night too, or at least traffic on that LAG dropped to zero – I see a little drip from the silliness a bit ago too: [cid:image001.png@01D4B26A.E02ED4B0] [signature_521369910] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> Reply-To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Date: Tuesday, January 22, 2019 at 3:52 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Exchange Stable Zayo is my transport.. I will bring it up with them. Thank you! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of AnthonyAnderberg(a)NUVERA.NET<mailto:AnthonyAnderberg@NUVERA.NET> Sent: Tuesday, January 22, 2019 15:52 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Exchange Stable Looks like the ports making up the Zayo-Remote bounced down and back up at 15:31:19. I’d thought perhaps Zayo was adding the 3rd link to that LAG but it is still showing two active members. [signature_198002810] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM<mailto:james.urwiller@TURNKEY-TELECOM.COM>> Reply-To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Date: Tuesday, January 22, 2019 at 3:41 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> Subject: [MICE-DISCUSS] Exchange Stable Any one else notice all their peers bounce last night around 1AM CST, and a few again just a few minutes ago? Just checking to see If I should talk to my transport provider or if this is something @ MICE. Let me know! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 22, 2019

Re: Exchange Stable

by James Urwiller

Zayo is my transport.. I will bring it up with them. Thank you! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] *From:* MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *On Behalf Of * AnthonyAnderberg(a)NUVERA.NET *Sent:* Tuesday, January 22, 2019 15:52 *To:* MICE-DISCUSS(a)LISTS.IPHOUSE.NET *Subject:* Re: [MICE-DISCUSS] Exchange Stable Looks like the ports making up the Zayo-Remote bounced down and back up at 15:31:19. I’d thought perhaps Zayo was adding the 3rd link to that LAG but it is still showing two active members. [image: signature_198002810] *From: *MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> *Reply-To: *MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Date: *Tuesday, January 22, 2019 at 3:41 PM *To: *MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> *Subject: *[MICE-DISCUSS] Exchange Stable Any one else notice all their peers bounce last night around 1AM CST, and a few again just a few minutes ago? Just checking to see If I should talk to my transport provider or if this is something @ MICE. Let me know! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300] ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ------------------------------ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 22, 2019

Re: Exchange Stable

by AnthonyAnderberg＠nuvera.net

Looks like the ports making up the Zayo-Remote bounced down and back up at 15:31:19. I’d thought perhaps Zayo was adding the 3rd link to that LAG but it is still showing two active members. [signature_198002810] From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> Reply-To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Date: Tuesday, January 22, 2019 at 3:41 PM To: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] Exchange Stable Any one else notice all their peers bounce last night around 1AM CST, and a few again just a few minutes ago? Just checking to see If I should talk to my transport provider or if this is something @ MICE. Let me know! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [stealth300] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Jan. 22, 2019

Re: ADV: [MICE-DISCUSS] Exchange Stable

by Doug McIntyre

On Tue, Jan 22, 2019 at 03:41:54PM -0600, James Urwiller wrote: >Any one else notice all their peers bounce last night around 1AM CST, and a >few again just a few minutes ago? > >Just checking to see If I should talk to my transport provider or if this >is something @ MICE. Let me know! No changes here. Looking at the route servers, there's a few BGP sessions changes in the last 24h, but nothing like what you've reported. -- Doug McIntyre <merlyn(a)iphouse.net> ~.~ ipHouse ~.~ Network Engineer/Provisioning/Jack of all Trades

Jan. 22, 2019

Exchange Stable

by James Urwiller

Any one else notice all their peers bounce last night around 1AM CST, and a few again just a few minutes ago? Just checking to see If I should talk to my transport provider or if this is something @ MICE. Let me know! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com [image: stealth300]

Jan. 22, 2019

Re: CNS Connection

by Dean Bahls

A little additional information regarding the CNS disconnect notice: Their BGP sessions at the addresses below are no longer advertising prefixes and will be shut down shortly: IPv4: 206.108.255.50 IPv6: 2001:504:27::7F61:0:1 Thanks, Dean From: Dean Bahls <dean.bahls(a)cooperative-networks.com> Sent: Monday, January 21, 2019 10:27 AM To: 'MICE Discuss' <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> Cc: lance.bragstad(a)cooperative-networks.com Subject: CNS Connection Good morning, Over the course of time, CNS's downstream traffic has dwindled to nothing and we are no longer providing layer 3 services. We will be shutting down shortly. NOTE: We WILL still be an active participant in MICE and will continue to host the satellite switch in our facility at 511. We believe in the whole premise behind MICE and stand behind them firmly. We just don't have any downstream customers to serve anymore. Please holler if you have questions. Thanks! Dean Dean Bahls Network Services Manager | Cooperative Network Services, LLC 14 Main St SW | PO Box J | Menahga, MN 56464 218.346.3635 (Direct) | 218.564.3000 (Main Office) dean.bahls(a)cooperative-networks.com <mailto:dean.bahls@cooperative-networks.com>

Jan. 21, 2019

CNS Connection

by Dean Bahls

Good morning, Over the course of time, CNS's downstream traffic has dwindled to nothing and we are no longer providing layer 3 services. We will be shutting down shortly. NOTE: We WILL still be an active participant in MICE and will continue to host the satellite switch in our facility at 511. We believe in the whole premise behind MICE and stand behind them firmly. We just don't have any downstream customers to serve anymore. Please holler if you have questions. Thanks! Dean Dean Bahls Network Services Manager | Cooperative Network Services, LLC 14 Main St SW | PO Box J | Menahga, MN 56464 218.346.3635 (Direct) | 218.564.3000 (Main Office) dean.bahls(a)cooperative-networks.com <mailto:dean.bahls@cooperative-networks.com>

Jan. 21, 2019

Re: MICE 100Gig Card Replacement Maintenance Window

by Jeremy Lumby

Everyone's link is now back up, and all BGP from my point of view is established. -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Friday, January 18, 2019 2:53 PM To: MICE Discuss Subject: RE: [MICE-DISCUSS] MICE 100Gig Card Replacement Maintenance Window I am seeing all BGP sessions up on my router other than one network who's link did not come back. -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Sergii Polishchuk Sent: Friday, January 18, 2019 2:42 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE 100Gig Card Replacement Maintenance Window Do not forget to remove filter to 179 port BGP please. Connectivity restored. But not BGP yet. Sergi -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: January 18, 2019 1:59 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE 100Gig Card Replacement Maintenance Window The maintenance described below will begin momentarily -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Thursday, January 10, 2019 5:35 PM To: MICE Discuss Subject: MICE 100Gig Card Replacement Maintenance Window After yesterday's meeting discussion about the 100G card replacement on the MICE core switch, I now have a tracking number for a new 100G card from Arista. Based on needing 7 days of major maintenance notice, and a request to complete before MLK day it looks like Friday 1/18/2019 at 2PM CST will be the best time to complete the maintenance. The new card requires a switch OS upgrade. Based on an Arista recommendation, I will be upgrading to 4.20.11M prior to the card replacement. This will cause a total traffic disruption on the MICE core switch. Prior to the maintenance I will be blocking BGP on all ports of the core switch to allow traffic to gracefully reroute. If you choose to shutdown BGP on your own prior to the maintenance, please leave your interface enabled so that link can be verified after the maintenance completes. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington, MN 55425 Main: 612-355-7740 x211 Direct: 612-392-6814 EFax: 952-873-7425 jlumby(a)mnvoip.com

Jan. 18, 2019

Re: MICE 100Gig Card Replacement Maintenance Window

by James Urwiller

Wouldn't be Akamai would it? My peer to them is the only peer not back up yet. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Friday, January 18, 2019 14:53 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE 100Gig Card Replacement Maintenance Window I am seeing all BGP sessions up on my router other than one network who's link did not come back. -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Sergii Polishchuk Sent: Friday, January 18, 2019 2:42 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE 100Gig Card Replacement Maintenance Window Do not forget to remove filter to 179 port BGP please. Connectivity restored. But not BGP yet. Sergi -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: January 18, 2019 1:59 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE 100Gig Card Replacement Maintenance Window The maintenance described below will begin momentarily -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Thursday, January 10, 2019 5:35 PM To: MICE Discuss Subject: MICE 100Gig Card Replacement Maintenance Window After yesterday's meeting discussion about the 100G card replacement on the MICE core switch, I now have a tracking number for a new 100G card from Arista. Based on needing 7 days of major maintenance notice, and a request to complete before MLK day it looks like Friday 1/18/2019 at 2PM CST will be the best time to complete the maintenance. The new card requires a switch OS upgrade. Based on an Arista recommendation, I will be upgrading to 4.20.11M prior to the card replacement. This will cause a total traffic disruption on the MICE core switch. Prior to the maintenance I will be blocking BGP on all ports of the core switch to allow traffic to gracefully reroute. If you choose to shutdown BGP on your own prior to the maintenance, please leave your interface enabled so that link can be verified after the maintenance completes. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington, MN 55425 Main: 612-355-7740 x211 Direct: 612-392-6814 EFax: 952-873-7425 jlumby(a)mnvoip.com

Jan. 18, 2019

Re: MICE 100Gig Card Replacement Maintenance Window

by Jeremy Lumby

I am seeing all BGP sessions up on my router other than one network who's link did not come back. -----Original Message----- From: MICE Discuss [mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET] On Behalf Of Sergii Polishchuk Sent: Friday, January 18, 2019 2:42 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE 100Gig Card Replacement Maintenance Window Do not forget to remove filter to 179 port BGP please. Connectivity restored. But not BGP yet. Sergi -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: January 18, 2019 1:59 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE 100Gig Card Replacement Maintenance Window The maintenance described below will begin momentarily -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Thursday, January 10, 2019 5:35 PM To: MICE Discuss Subject: MICE 100Gig Card Replacement Maintenance Window After yesterday's meeting discussion about the 100G card replacement on the MICE core switch, I now have a tracking number for a new 100G card from Arista. Based on needing 7 days of major maintenance notice, and a request to complete before MLK day it looks like Friday 1/18/2019 at 2PM CST will be the best time to complete the maintenance. The new card requires a switch OS upgrade. Based on an Arista recommendation, I will be upgrading to 4.20.11M prior to the card replacement. This will cause a total traffic disruption on the MICE core switch. Prior to the maintenance I will be blocking BGP on all ports of the core switch to allow traffic to gracefully reroute. If you choose to shutdown BGP on your own prior to the maintenance, please leave your interface enabled so that link can be verified after the maintenance completes. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington, MN 55425 Main: 612-355-7740 x211 Direct: 612-392-6814 EFax: 952-873-7425 jlumby(a)mnvoip.com

Jan. 18, 2019

Re: MICE 100Gig Card Replacement Maintenance Window

by Jeremy Lumby

The maintenance is complete, and the BGP block has been removed. There is one port that did not link back up, and I am contacting that member directly to resolve. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington, MN 55425 Main: 612-355-7740 x211 Direct: 612-392-6814 EFax: 952-873-7425 jlumby(a)mnvoip.com -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Friday, January 18, 2019 1:59 PM To: MICE Discuss Subject: RE: MICE 100Gig Card Replacement Maintenance Window The maintenance described below will begin momentarily -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Thursday, January 10, 2019 5:35 PM To: MICE Discuss Subject: MICE 100Gig Card Replacement Maintenance Window After yesterday's meeting discussion about the 100G card replacement on the MICE core switch, I now have a tracking number for a new 100G card from Arista. Based on needing 7 days of major maintenance notice, and a request to complete before MLK day it looks like Friday 1/18/2019 at 2PM CST will be the best time to complete the maintenance. The new card requires a switch OS upgrade. Based on an Arista recommendation, I will be upgrading to 4.20.11M prior to the card replacement. This will cause a total traffic disruption on the MICE core switch. Prior to the maintenance I will be blocking BGP on all ports of the core switch to allow traffic to gracefully reroute. If you choose to shutdown BGP on your own prior to the maintenance, please leave your interface enabled so that link can be verified after the maintenance completes. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington, MN 55425 Main: 612-355-7740 x211 Direct: 612-392-6814 EFax: 952-873-7425 jlumby(a)mnvoip.com

Jan. 18, 2019

Re: MICE 100Gig Card Replacement Maintenance Window

by Sergii Polishchuk

Do not forget to remove filter to 179 port BGP please. Connectivity restored. But not BGP yet. Sergi -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: January 18, 2019 1:59 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] MICE 100Gig Card Replacement Maintenance Window The maintenance described below will begin momentarily -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Thursday, January 10, 2019 5:35 PM To: MICE Discuss Subject: MICE 100Gig Card Replacement Maintenance Window After yesterday's meeting discussion about the 100G card replacement on the MICE core switch, I now have a tracking number for a new 100G card from Arista. Based on needing 7 days of major maintenance notice, and a request to complete before MLK day it looks like Friday 1/18/2019 at 2PM CST will be the best time to complete the maintenance. The new card requires a switch OS upgrade. Based on an Arista recommendation, I will be upgrading to 4.20.11M prior to the card replacement. This will cause a total traffic disruption on the MICE core switch. Prior to the maintenance I will be blocking BGP on all ports of the core switch to allow traffic to gracefully reroute. If you choose to shutdown BGP on your own prior to the maintenance, please leave your interface enabled so that link can be verified after the maintenance completes. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington, MN 55425 Main: 612-355-7740 x211 Direct: 612-392-6814 EFax: 952-873-7425 jlumby(a)mnvoip.com

Jan. 18, 2019

Re: MICE 100Gig Card Replacement Maintenance Window

by Jeremy Lumby

The maintenance described below will begin momentarily -----Original Message----- From: Jeremy Lumby [mailto:jlumby@mnvoip.com] Sent: Thursday, January 10, 2019 5:35 PM To: MICE Discuss Subject: MICE 100Gig Card Replacement Maintenance Window After yesterday's meeting discussion about the 100G card replacement on the MICE core switch, I now have a tracking number for a new 100G card from Arista. Based on needing 7 days of major maintenance notice, and a request to complete before MLK day it looks like Friday 1/18/2019 at 2PM CST will be the best time to complete the maintenance. The new card requires a switch OS upgrade. Based on an Arista recommendation, I will be upgrading to 4.20.11M prior to the card replacement. This will cause a total traffic disruption on the MICE core switch. Prior to the maintenance I will be blocking BGP on all ports of the core switch to allow traffic to gracefully reroute. If you choose to shutdown BGP on your own prior to the maintenance, please leave your interface enabled so that link can be verified after the maintenance completes. Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington, MN 55425 Main: 612-355-7740 x211 Direct: 612-392-6814 EFax: 952-873-7425 jlumby(a)mnvoip.com

Jan. 18, 2019

Re: Subscription Mail: Re: [MICE-DISCUSS] [MICE-ANNOUNCE] MICE 100Gig Card Replacement Maintenance Window

by Jeremy Lumby

Yes, this is still on track for today. I have just arrived at the data center. I do plan on blocking port 179 for a minimum of 5 minutes prior to taking the switch down. I will send out another email at 2 p.m. right before I begin the maintenance Jeremy Lumby Minnesota VoIP 9217 17th Ave S Suite 216 Bloomington MN 55425 Main 612-355-7740 Direct 612-392-6814 EFax 952-873-7425 jlumby(a)mnvoip.com -------- Original message -------- From: James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> Date: 1/18/19 1:01 PM (GMT-06:00) To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Subscription Mail: Re: [MICE-DISCUSS] [MICE-ANNOUNCE] MICE 100Gig Card Replacement Maintenance Window _____ >From : James Urwiller [james.urwiller(a)TURNKEY-TELECOM.COM] To : MICE-DISCUSS(a)LISTS.IPHOUSE.NET [MICE-DISCUSS(a)LISTS.IPHOUSE.NET] Date : Friday, January 18 2019 13:01:56 Ahh IC.. because the routes are still valid during the timeout. I was thinking it would be like a fiber cut where we have no valid routes while timers count down. NICE! James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com -----Original Message----- From: MICE Discuss On Behalf Of Ryan Goldberg Sent: Friday, January 18, 2019 12:56 To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Subscription Mail: Re: [MICE-DISCUSS] [MICE-ANNOUNCE] MICE 100Gig Card Replacement Maintenance Window I believe the idea is to block tcp port 179 ahead of time so the session “dies” and this creates the least disruptive way to do this type of work for all parties. > On Jan 18, 2019, at 12:52 PM, James Urwiller > wrote: > > Is this still happening @2PM today? By "blocking bgp" u mean shutdown > on your end? > > James Urwiller > Network Architect > Stealth Broadband > james.urwiller(a)stealthbroadband.com > > > -----Original Message----- > From: MICE Announcements On Behalf > Of Richard Laager > Sent: Thursday, January 10, 2019 18:39 > To: MICE-ANNOUNCE(a)LISTS.IPHOUSE.NET > Subject: [MICE-ANNOUNCE] MICE 100Gig Card Replacement Maintenance > Window > > -------- Forwarded Message -------- > Subject: MICE 100Gig Card Replacement Maintenance Window > Date: Thu, 10 Jan 2019 17:35:00 -0600 > From: Jeremy Lumby > Reply-To: MICE Discuss > Organization: Minnesota VoIP > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > > After yesterday's meeting discussion about the 100G card replacement > on the MICE core switch, I now have a tracking number for a new 100G > card from Arista. Based on needing 7 days of major maintenance > notice, and a request to complete before MLK day it looks like Friday > 1/18/2019 at 2PM CST will be the best time to complete the > maintenance. The new card requires a switch OS upgrade. Based on an > Arista recommendation, I will be upgrading to 4.20.11M prior to the > card replacement. This will cause a total traffic disruption on the > MICE core switch. Prior to the maintenance I will be blocking BGP on > all ports of the core switch to allow traffic to gracefully reroute. > If you choose to shutdown BGP on your own prior to the maintenance, > please leave your interface enabled so that link can be verified after the > maintenance completes. > > Jeremy Lumby > Minnesota VoIP > 9217 17th Ave S > Suite 216 > Bloomington, MN 55425 > Main: 612-355-7740 x211 > Direct: 612-392-6814 > EFax: 952-873-7425 > jlumby(a)mnvoip.com > > ###################################################################### > ## > > To unsubscribe from the MICE-ANNOUNCE list, click the following link: > &*TICKET_URL(MICE-ANNOUNCE,SIGNOFF); >

Jan. 18, 2019