- mice-discuss - lists.micemn.net

Re: Zayo/Other?

by Ben Wiechman

OSP crews are being mobilized, splicers are engaged, cut is near lake crystal MN. No ETA Looks like there is an OTDR distance from the internal notes. Will need to locate specific location of the cut once crews arrive on site. Ben Wiechman Director of IP Strategy and Engineering Direct: 320.256.0184 Cell: 320.247.3224 ben.wiechman(a)arvig.com 150 Second Street SW | Perham, MN 56573 | arvig.com On Mon, Jun 14, 2021, 18:10 Ben Wiechman <ben.wiechman(a)arvig.com> wrote: > Fiber cut between Mankato and LaSalle is the word I have. Don't have much > more status information than that. Believe Zayo is still working to nail > down the location. > > Ben Wiechman > Director of IP Strategy and Engineering > Direct: 320.256.0184 > Cell: 320.247.3224 > ben.wiechman(a)arvig.com > 150 Second Street SW | Perham, MN 56573 | arvig.com > > On Mon, Jun 14, 2021, 18:01 James Urwiller < > james.urwiller(a)turnkey-telecom.com> wrote: > >> Did anyone else loose all MICE peers around 14:20 CST? I have a ticket >> open, but no response as of yet. >> >> >> >> James Urwiller >> >> Network Architect >> >> Stealth Broadband >> >> james.urwiller(a)stealthbroadband.com >> >> >> >> ------------------------------ >> >> To unsubscribe from the MICE-DISCUSS list, click the following link: >> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >> >

June 15, 2021

Re: Zayo/Other?

by Justin Krejci

Looking at the MICE weathermap, it looks like most everything is up. I believe there was a fiber cut around that time a bit south of Mankato. Might that be affecting you directly or indirectly? ________________________________ From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> on behalf of James Urwiller <james.urwiller(a)TURNKEY-TELECOM.COM> Sent: Monday, June 14, 2021 6:01 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Zayo/Other? Did anyone else loose all MICE peers around 14:20 CST? I have a ticket open, but no response as of yet. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [cid:image001.jpg@01D76147.3F9A7B60] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1<https://url-shield.securence.com/?p=1.0&r=jkrejci@usinternet.com&sid=162371…>

June 14, 2021

Re: Zayo/Other?

by Ben Wiechman

Fiber cut between Mankato and LaSalle is the word I have. Don't have much more status information than that. Believe Zayo is still working to nail down the location. Ben Wiechman Director of IP Strategy and Engineering Direct: 320.256.0184 Cell: 320.247.3224 ben.wiechman(a)arvig.com 150 Second Street SW | Perham, MN 56573 | arvig.com On Mon, Jun 14, 2021, 18:01 James Urwiller < james.urwiller(a)turnkey-telecom.com> wrote: > Did anyone else loose all MICE peers around 14:20 CST? I have a ticket > open, but no response as of yet. > > > > James Urwiller > > Network Architect > > Stealth Broadband > > james.urwiller(a)stealthbroadband.com > > > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >

June 14, 2021

Re: Zayo/Other?

by Jeff Dahna

Our connections are down to MPLS via ZAYO. The latest update to our case: ZAYO NCC - Mon Jun 14 22:37:34 GMT 2021 Current Update: OSP has been engaged and crews are being mobilized and are headed to a suspected damage location in Lake Crystal MN. Underground crews and Splicers are engaged and are heading to this location. Once we have an ETA we will share it. More updates to follow. Jeff Dahna General Manager | City of Windom Telecom Dept-Windomnet | ASN46692 443 10th Street, PO Box 38 | Windom, MN 56101 Work Main: 507-832-8000 | Work Desk: 507-832-8680 jeff.dahna(a)windommn.com<mailto:jeff.dahna@windommn.com> | www.windomnet.com<http://www.windomnet.com/> Charter Member MN Public Broadband Alliance From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of James Urwiller Sent: Monday, June 14, 2021 6:01 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] Zayo/Other? Did anyone else loose all MICE peers around 14:20 CST? I have a ticket open, but no response as of yet. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com<mailto:james.urwiller@stealthbroadband.com> [cid:image002.jpg@01D76148.1850B140] ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

June 14, 2021

Zayo/Other?

by James Urwiller

Did anyone else loose all MICE peers around 14:20 CST? I have a ticket open, but no response as of yet. James Urwiller Network Architect Stealth Broadband james.urwiller(a)stealthbroadband.com

June 14, 2021

Re: Please welcome T-Mobile to MICE!

by Doug McIntyre

On Wed, Jun 09, 2021 at 05:41:11PM -0500, Jay Hanke wrote: >Name: T-Mobile USA >Switch: 511 Main Switch >Port: Single LAG Group ports eth3/2/1, Ethernet6/9/1 (2x100G) >ASN: 21928 >IPv4: 206.108.255.179/24 >IPv6: 2001:504:27::55a8:0:1/64 >Peering Contact: NTSO-NISS(a)T-Mobile.com >Route Servers- Yes >BFD: NO Added to the route servers. Welcome!

June 10, 2021

Re: Please welcome T-Mobile to MICE!

by AnthonyAnderberg＠nuvera.net

Po41 , setting it up for them now. Cheers, anthony On 6/9/21, 10:31 PM, "MICE Discuss on behalf of Richard Laager" <MICE-DISCUSS(a)LISTS.IPHOUSE.NET on behalf of rlaager(a)WIKTEL.COM> wrote: On 6/9/21 5:41 PM, Jay Hanke wrote: > Name: T-Mobile USA > Switch: 511 Main Switch > Port: Single LAG Group ports eth3/2/1, Ethernet6/9/1 (2x100G) Website updated. I just need the Po interface number. -- Richard

June 10, 2021

Re: Please welcome T-Mobile to MICE!

by Richard Laager

On 6/9/21 5:41 PM, Jay Hanke wrote: > Name: T-Mobile USA > Switch: 511 Main Switch > Port: Single LAG Group ports eth3/2/1, Ethernet6/9/1 (2x100G) Website updated. I just need the Po interface number. -- Richard

June 10, 2021

Please welcome T-Mobile to MICE!

by Jay Hanke

Name: T-Mobile USA Switch: 511 Main Switch Port: Single LAG Group ports eth3/2/1, Ethernet6/9/1 (2x100G) ASN: 21928 IPv4: 206.108.255.179/24 IPv6: 2001:504:27::55a8:0:1/64 Peering Contact: NTSO-NISS(a)T-Mobile.com Route Servers- Yes BFD: NO Willkommen an Bord! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

June 9, 2021

Re: PCH Port Move

by Doug McIntyre

On Wed, Jun 09, 2021 at 11:11:43AM -0500, Jay Hanke wrote: >PCH is moving their two pending port on the former IP House remote to >the MN VoIP remote switch. > >The ports are allocated as follows: > >AS42 >MN VoIP 10G Switch Eth26 >206.108.255.142 >2001:504:27:0:0:002a::1 > >AS3856 >MN VoIP 10G Switch Eth27 >206.108.255.143 >2001:504:27:0:0:0f10::1 > >MICE Tech- Could you verify the route server sessions are still in the >configuration? If not, add them? PCH never had anything going previously, but I've got things setup in the RRs for this setup now.

June 9, 2021

PCH Port Move

by Jay Hanke

PCH is moving their two pending port on the former IP House remote to the MN VoIP remote switch. The ports are allocated as follows: AS42 MN VoIP 10G Switch Eth26 206.108.255.142 2001:504:27:0:0:002a::1 AS3856 MN VoIP 10G Switch Eth27 206.108.255.143 2001:504:27:0:0:0f10::1 MICE Tech- Could you verify the route server sessions are still in the configuration? If not, add them? -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

June 9, 2021

Re: 511 Issues?

by Frank Bulk

From my notes: HTTPv6 to www.cloudflare.com has socket timeout from: ~4:14 to ~4:29 pm ~4:33 to ~4:38 pm BGP session to AWS via MICE down from 4:15 to 4:18 pm Qrator alerts Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jay Hanke Sent: Tuesday, June 1, 2021 8:41 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] 511 Issues? We (mice) lost Amazon and Cloudflare peering in MSP this afternoon. We're also seeing intermittent hits on Arvig circuits to/from 511 for the last couple of hours (legacy Arvig not windstream, so it could be Zayo). On Tue, Jun 1, 2021 at 8:33 PM Corey Hauer <coreyhauer(a)gmail.com> wrote: > > There is an aerial Windstream fiber cut between Waterloo IA and 511. Replacement fiber is in place and awaiting new splice cases and splicing. > > Does that geography tie to the issues you see? > > On Tue, Jun 1, 2021 at 6:18 PM Jay Hanke <jayhanke(a)southfront.io> wrote: >> >> Is there something going on at 511? >> >> We're seeing multiple networks on MICE down or degraded and an >> assortment of random issues. >> >> -- >> Jay Hanke, President >> South Front Networks >> jayhanke(a)southfront.io >> Phone 612-204-0000 > > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

June 3, 2021

EIDG Port Channel Converstion

by Jay Hanke

EIDG is upgrading to a 1x2x10G port channel on the SFN remote switch. Their new port is Ethernet15 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

June 2, 2021

Re: 511 Issues?

by Jon Westlund

I am not seeing any obvious issues with our transport network Jay. We are getting ~90k routes from the MICE route reflector which is typical. We also lost both Amazon peers about 5 hours ago.. Do you have a specific circuit we can look at for example? Thanks, JW On Tue, Jun 1, 2021 at 8:41 PM Jay Hanke <jayhanke(a)southfront.io> wrote: > We (mice) lost Amazon and Cloudflare peering in MSP this afternoon. > We're also seeing intermittent hits on Arvig circuits to/from 511 for > the last couple of hours (legacy Arvig not windstream, so it could be > Zayo). > > > On Tue, Jun 1, 2021 at 8:33 PM Corey Hauer <coreyhauer(a)gmail.com> wrote: > > > > There is an aerial Windstream fiber cut between Waterloo IA and 511. > Replacement fiber is in place and awaiting new splice cases and splicing. > > > > Does that geography tie to the issues you see? > > > > On Tue, Jun 1, 2021 at 6:18 PM Jay Hanke <jayhanke(a)southfront.io> wrote: > >> > >> Is there something going on at 511? > >> > >> We're seeing multiple networks on MICE down or degraded and an > >> assortment of random issues. > >> > >> -- > >> Jay Hanke, President > >> South Front Networks > >> jayhanke(a)southfront.io > >> Phone 612-204-0000 > > > > > > ________________________________ > > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > > -- > Jay Hanke, President > South Front Networks > jayhanke(a)southfront.io > Phone 612-204-0000 > -- Jon Westlund Network Engineer Direct: 320.256.0229 Cell: 320.237.2386 jon.westlund(a)arvig.com 150 Second Street SW | Perham, MN 56573 | arvig.com

June 2, 2021

Re: 511 Issues?

by Jay Hanke

We (mice) lost Amazon and Cloudflare peering in MSP this afternoon. We're also seeing intermittent hits on Arvig circuits to/from 511 for the last couple of hours (legacy Arvig not windstream, so it could be Zayo). On Tue, Jun 1, 2021 at 8:33 PM Corey Hauer <coreyhauer(a)gmail.com> wrote: > > There is an aerial Windstream fiber cut between Waterloo IA and 511. Replacement fiber is in place and awaiting new splice cases and splicing. > > Does that geography tie to the issues you see? > > On Tue, Jun 1, 2021 at 6:18 PM Jay Hanke <jayhanke(a)southfront.io> wrote: >> >> Is there something going on at 511? >> >> We're seeing multiple networks on MICE down or degraded and an >> assortment of random issues. >> >> -- >> Jay Hanke, President >> South Front Networks >> jayhanke(a)southfront.io >> Phone 612-204-0000 > > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

June 2, 2021

Re: 511 Issues?

by Corey Hauer

There is an aerial Windstream fiber cut between Waterloo IA and 511. Replacement fiber is in place and awaiting new splice cases and splicing. Does that geography tie to the issues you see? On Tue, Jun 1, 2021 at 6:18 PM Jay Hanke <jayhanke(a)southfront.io> wrote: > Is there something going on at 511? > > We're seeing multiple networks on MICE down or degraded and an > assortment of random issues. > > -- > Jay Hanke, President > South Front Networks > jayhanke(a)southfront.io > Phone 612-204-0000 >

June 2, 2021

511 Issues?

by Jay Hanke

Is there something going on at 511? We're seeing multiple networks on MICE down or degraded and an assortment of random issues. -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

June 2, 2021

Re: HE upgrade to 1x2x100G

by Doug McIntyre

On Tue, May 11, 2021 at 01:19:49PM -0500, Jay Hanke wrote: >HE is adding one additional 100G port to their existing Port Channel 6 > >The new port is: > >MICE MAIN :: Ethernet6/5/1 > >This email will also serve as LOA/CFA. > >All IP information will remain the same. HE requested the upgrade take >place ASAP. I've configured the port and have added it to their existing port-channel 6. It is ready for them to crossconnect.

May 11, 2021

HE upgrade to 1x2x100G

by Jay Hanke

HE is adding one additional 100G port to their existing Port Channel 6 The new port is: MICE MAIN :: Ethernet6/5/1 This email will also serve as LOA/CFA. All IP information will remain the same. HE requested the upgrade take place ASAP. Welcome aboard! -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

May 11, 2021

Re: Link to all MICE peers dropped

by Frank Bulk

Thanks, everyone. FiberComm learned that there's some kind of transport issue between northwest Iowa and MICE. FiberComm's transport provider is aware and looking into it. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jay Hanke Sent: Monday, May 3, 2021 3:06 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Link to all MICE peers dropped yea You can look at the mice weathermap for these as well. Just don't post the graphs. :) On Mon, May 3, 2021 at 3:03 PM Frank Bulk <fbulk(a)mypremieronline.com> wrote: > > Thanks, Jay. Anyone else? > Did FiberComm take a hit, too? We share much of our path together. > > Frank > > -----Original Message----- > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jay Hanke > Sent: Monday, May 3, 2021 2:59 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] Link to all MICE peers dropped > > Looks like Premier and Fibernet both took a hit about that time. > > On Mon, May 3, 2021 at 2:55 PM Frank Bulk <fbulk(a)mypremieronline.com> wrote: > > > > Our link to all MICE peers dropped at 2:47:39 pm – anyone else see an outage and/or disruption? > > > > > > > > Frank > > > > AS18883 > > > > > > ________________________________ > > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > > -- > Jay Hanke, President > South Front Networks > jayhanke(a)southfront.io > Phone 612-204-0000 > -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

May 3, 2021

Re: Link to all MICE peers dropped

by Jay Hanke

yea You can look at the mice weathermap for these as well. Just don't post the graphs. :) On Mon, May 3, 2021 at 3:03 PM Frank Bulk <fbulk(a)mypremieronline.com> wrote: > > Thanks, Jay. Anyone else? > Did FiberComm take a hit, too? We share much of our path together. > > Frank > > -----Original Message----- > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jay Hanke > Sent: Monday, May 3, 2021 2:59 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] Link to all MICE peers dropped > > Looks like Premier and Fibernet both took a hit about that time. > > On Mon, May 3, 2021 at 2:55 PM Frank Bulk <fbulk(a)mypremieronline.com> wrote: > > > > Our link to all MICE peers dropped at 2:47:39 pm – anyone else see an outage and/or disruption? > > > > > > > > Frank > > > > AS18883 > > > > > > ________________________________ > > > > To unsubscribe from the MICE-DISCUSS list, click the following link: > > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > > -- > Jay Hanke, President > South Front Networks > jayhanke(a)southfront.io > Phone 612-204-0000 > -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

May 3, 2021

Re: Link to all MICE peers dropped

by Frank Bulk

Thanks, Jay. Anyone else? Did FiberComm take a hit, too? We share much of our path together. Frank -----Original Message----- From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jay Hanke Sent: Monday, May 3, 2021 2:59 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Link to all MICE peers dropped Looks like Premier and Fibernet both took a hit about that time. On Mon, May 3, 2021 at 2:55 PM Frank Bulk <fbulk(a)mypremieronline.com> wrote: > > Our link to all MICE peers dropped at 2:47:39 pm – anyone else see an outage and/or disruption? > > > > Frank > > AS18883 > > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

May 3, 2021

Re: Link to all MICE peers dropped

by Steve Howard

May 3, 2021

Re: Link to all MICE peers dropped

by Jay Hanke

Looks like Premier and Fibernet both took a hit about that time. On Mon, May 3, 2021 at 2:55 PM Frank Bulk <fbulk(a)mypremieronline.com> wrote: > > Our link to all MICE peers dropped at 2:47:39 pm – anyone else see an outage and/or disruption? > > > > Frank > > AS18883 > > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 -- Jay Hanke, President South Front Networks jayhanke(a)southfront.io Phone 612-204-0000

May 3, 2021

Link to all MICE peers dropped

by Frank Bulk

Our link to all MICE peers dropped at 2:47:39 pm - anyone else see an outage and/or disruption? Frank AS18883

May 3, 2021