- mice-discuss - lists.micemn.net

Re: Google AS15169 at MICE is up

by Darin Steffl

Thanks for getting this turned up! I've submitted our request to migrate from 36040 to 15169. I checked the traffic graphs and I don't see the 15169 port in there yet, just the existing 36040. Is this supposed to be setup yet or does that typically follow a few days after the port is active? Thanks On Wed, Aug 7, 2019 at 4:56 PM Dave Schwartz < 0000000aaf163ccf-dmarc-request(a)lists.iphouse.net> wrote: > Hi MICE Participants, > > Our 100G link from AS15169 to MICE is now live. We are peered and > announcing/accepting routes from the route server. We welcome you to > request public peering with us. > > Public peering with Google is encouraged as we do not announce all > prefixes to our route server, only summary routes. We do however announce > all Google prefixes on our direct IX peering sessions. When you peer with > us you also will be able to obtain access to the Google ISP Portal where > you can manage your traffic, view your networks YouTube performance, among > other features. > > There are two ways to request public peering. > > 1. If you already have access to the Google ISP Portal please visit > tickets --> request new IX interconnection and submit your details on your > ASN and IP. > > 2. If you do not have access to the ISP Portal please visit > isp.google.com/iwantpeering . On the form select Peering --> IX Peering > and select Minneapolis from the dropdown. In the comments section please > notate that you are part of MICE. > > While we have paused IX peering due to IRR validation we will be > reviewing MICE requests on a case by case basis for approval since we are > changing ASNs. > > Please send me a direct message should you have any specific questions or > concerns on your request. > > Thanks, > Dave > > > -- > > Dave Schwartz > Peering & Content Distribution > Google AS15169 > daveschwartz(a)google.com > +1-650-253-7615 > +44 20 3820 9224 > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > -- Darin Steffl Minnesota WiFi www.mnwifi.com 507-634-WiFi <http://www.facebook.com/minnesotawifi> Like us on Facebook <http://www.facebook.com/minnesotawifi>

Aug. 7, 2019

Google AS15169 at MICE is up

by Dave Schwartz

Hi MICE Participants, Our 100G link from AS15169 to MICE is now live. We are peered and announcing/accepting routes from the route server. We welcome you to request public peering with us. Public peering with Google is encouraged as we do not announce all prefixes to our route server, only summary routes. We do however announce all Google prefixes on our direct IX peering sessions. When you peer with us you also will be able to obtain access to the Google ISP Portal where you can manage your traffic, view your networks YouTube performance, among other features. There are two ways to request public peering. 1. If you already have access to the Google ISP Portal please visit tickets --> request new IX interconnection and submit your details on your ASN and IP. 2. If you do not have access to the ISP Portal please visit isp.google.com/iwantpeering . On the form select Peering --> IX Peering and select Minneapolis from the dropdown. In the comments section please notate that you are part of MICE. While we have paused IX peering due to IRR validation we will be reviewing MICE requests on a case by case basis for approval since we are changing ASNs. Please send me a direct message should you have any specific questions or concerns on your request. Thanks, Dave -- Dave Schwartz Peering & Content Distribution Google AS15169 daveschwartz(a)google.com +1-650-253-7615 +44 20 3820 9224

Aug. 7, 2019

Routing Security Articles

by David Farmer

The first link below is an excellent article on BGP (Routing) Security, worth a read by both network engineers and C-level executives. The second link is an article with an equally excellent list for network engineers on what they can and should do about these risks. This article includes a great list of questions for a network engineer to start a conversation with your executives ensure they know at least the high-level answers to these questions. Thanks. ----- What Stops a Nation-State BGP Hijack? https://www.senki.org/what-stops-a-nation-state-bgp-hijack/ Nation-State BGP Hijack risks are real! But, the way the Internet Operations Community keeps the Internet glued together minimizes the risk. All Organizations can do their part to minimize the Nation-State BGP Hijack. Each organization can do its part in their corner of the Internet. Collectively, this builds a more robust Internet. This post will provide tools that any organization, individual, researcher, or reporter can use to pull back the fear, understand the realities of BGP, and explore meaningful action. ---- BGP Route Hijacks & Routing Mistakes – What can be done Today? Protecting your Business, Customers, & the Internet from BGP Route Hijacking Chaos? https://www.senki.org/operators-security-toolkit/bgp-route-hijack/ Principle: Global Interconnection Health is a CxO Priority. Every Business depends on their interconnection to the Internet/Telecom. That interconnection is dependent on BGP. Any large organization leadership needs to ask their staff questions: Q. How are we connected to the Internet? Q. How are we protecting our BGP Routes on the Internet? Q. How do we make sure we don’t make a BGP mistake? How do we make sure we do not advertise “YouTube?” Q. Explain to me in simple terms, our BGP based interconnection policy? Q. What is our BGP Crisis Reaction Plan? What do we do when someone tries to BGP Hijack us from the other side of the planet? Q. How would we know if we’re being attacked through a BGP Hijack? -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

Aug. 7, 2019

Fwd: [arin-announce] Registration Now Open for ARIN on the Road: Des Moines

by David Farmer

I thought this would be of interest to at least some of you. ---------- Forwarded message --------- From: ARIN <info(a)arin.net> Date: Wed, Aug 7, 2019 at 10:56 AM Subject: [arin-announce] Registration Now Open for ARIN on the Road: Des Moines To: <arin-announce(a)arin.net> The American Registry for Internet Numbers (ARIN) is bringing our educational roadshow to Des Moines, IA. We hope you will join us at the Embassy Suites Des Moines Downtown from 10:00 AM to 3:30 PM CDT on Thursday, 19 September 2019. This one-day event is your opportunity to learn about topics such as: * ARIN’s Mission and Core Functions * ARIN Technical Services * How Policy is Developed in the ARIN Region * IPv6 Services * IPv4 Wait List and Transfers * Community Engagement with ARIN * Open microphone to answer your questions! Note: Are you part of an organization that would like to share its IPv6 implementation story with others? We want to hear from you! We would like to include your story as part of the agenda. We will have a member of ARIN’s Registration Services Department with us in order to provide one-on-one assistance to anyone with questions about their ARIN-issued Internet number resources or anyone interested in applying for resources, such as IPv6. In addition to providing great professional education, ARIN on the Road will give you a chance to connect with colleagues and find out how you can help shape the future of the Internet by getting involved in the ARIN community. Registration is free and lunch is on us! Seating is limited so register today at: https://www.arin.net/desmoines Help ARIN spread the word by extending this invitation to interested local friends and colleagues by sharing this email or the URL above. Regards, Susan Hamlin Senior Director, Communications and Member Services American Registry for Internet Numbers (ARIN) _______________________________________________ ARIN-Announce You are receiving this message because you are subscribed to the ARIN Announce Mailing List (ARIN-announce(a)arin.net) Unsubscribe or manage your mailing list subscription at: https://lists.arin.net/mailman/listinfo/arin-announce Please contact info(a)arin.net if you experience any issues. -- =============================================== David Farmer Email:farmer@umn.edu Networking & Telecommunication Services Office of Information Technology University of Minnesota 2218 University Ave SE Phone: 612-626-0815 Minneapolis, MN 55414-3029 Cell: 612-812-9952 ===============================================

Aug. 7, 2019

Re: MICE 2019 Board Election

by Richard Laager

I am running for re-election. My platform is primarily to continue the path we're on: MICE is maturing / has matured, and if re-elected, I'd like to keep working on issues related to that. My focus has been and likely would remain on handling administrative issues, some boring / some not. My main goal for my current board term was to sort out our non-profit status with the IRS. While that took longer than we might have liked due to the question of how we should be classified, I consider that project to have been a success. We have a normalized non-profit status with the IRS. The differences between 501(c)(6) and 501(c)(12) for us are minimal. While I can't take the credit for it, the next big hurdle was the port fees. With port fees in place, we are now in a much more sustainable financial position. These were the "big ticket" items, and they're now behind us, but there is still ongoing administrative work. Where applicable, I try to utilize a continuous improvement process, making small tweaks over time as issues arise. For example, I have worked on improving our Order Form. A project that is still on my plate is the insurance issue, which is actively moving forward again. There's a realistic chance that will be resolved by the October meeting / the end of my current board term. Looking forward, I would like to continue to streamline our meetings. We also need to implement some solution to the "quorum problem": the MICE membership has grown while UG attendance is relatively consistent. The next 3 years will likely involve many networks upgrading from 10G to 100G, which could present issues to be solved (e.g. needing more ports and/or adjusting port fees). The impending launch of various new streaming services will be interesting for the industry as a whole, but could result in new content participants joining MICE, more traffic being moved across MICE, and/or an increased desire for reliability/redundancy/diversity in the MICE core. I believe MICE is well positioned to meet these challenges. -- Richard

Aug. 6, 2019

MICE 2019 Board Election

by Richard Laager

The MICE board consists of three directors with staggered 3-year terms. One position is up for election each year at our fall meeting. This year's fall meeting, UG 33, will be held on October 16 at the 511 Building. The current seat up for election is the one that I hold. At this time, the board would like to open nominations. If you or someone you know is interested in running, please reply on the MICE-DISCUSS list or contact any board member. Nominations will close September 30th. -- Richard

Aug. 2, 2019

Re: SFN Remote Outage

by Darin Steffl

I'm sure the plant guys already plan on that too. This area has received over 20" of rain in the last month so we're very saturated here which contributed to the washout. On Tue, Jul 23, 2019 at 2:09 PM Ben Wiechman <ben.wiechman(a)arvig.com> wrote: > I will be sure to ask about that, but it is likely that it is already > under evaluation. > > Ben Wiechman > > Director of IP Strategy and Engineering > > 320.247.3224 | ben.wiechman(a)arvig.com > > Arvig | 224 East Main Street | Melrose, MN 56352 | arvig.com > > > > > On Tue, Jul 23, 2019 at 2:06 PM Darin Steffl <darin.steffl(a)mnwifi.com> > wrote: > >> Much better picture Ben. I didn't feel like climbing down there ha. >> >> Hopefully the permanent fix involves boring on the other side of the road >> where it doesn't have a chance of washing out again. >> >> On Tue, Jul 23, 2019 at 2:03 PM Ben Wiechman <ben.wiechman(a)arvig.com> >> wrote: >> >>> [image: 12564.jpeg] >>> >>> This shows another location and the amount of dirt that was washed away. >>> >>> Splicing crews were completely hands off by around noon. Some services >>> were restored earlier. >>> >>> Ben Wiechman >>> >>> Director of IP Strategy and Engineering >>> >>> 320.247.3224 | ben.wiechman(a)arvig.com >>> >>> Arvig | 224 East Main Street | Melrose, MN 56352 | arvig.com >>> >>> >>> >>> >>> On Tue, Jul 23, 2019 at 12:43 PM Darin Steffl <darin.steffl(a)mnwifi.com> >>> wrote: >>> >>>> Our service was restored around 10:36am today. I stopped by to take >>>> some pictures since I work close to the cut. The road definitely washed >>>> out. The fix is temporary with fiber laying in the ditch until they >>>> schedule a permanent fix. >>>> >>>> >>>> https://photos.app.goo.gl/1b551CBzbkEkvVXy7 >>>> >>>> On Tue, Jul 23, 2019, 8:36 AM Ben Wiechman <ben.wiechman(a)arvig.com> >>>> wrote: >>>> >>>>> It is Arvig fiber. The road was washed out in at least three >>>>> locations, with no available culverts or other options to push the fiber >>>>> across the road in order to get the fiber repaired last night. The >>>>> conditions were unsafe so we prepped as much as we could before dark and >>>>> resumed splicing as soon as possible this morning. We are sorry for the >>>>> impact, but needed to consider the safety of our crews on this one. >>>>> >>>>> Ben Wiechman >>>>> >>>>> Director of IP Strategy and Engineering >>>>> >>>>> 320.247.3224 | ben.wiechman(a)arvig.com >>>>> >>>>> Arvig | 224 East Main Street | Melrose, MN 56352 | arvig.com >>>>> >>>>> >>>>> >>>>> >>>>> On Tue, Jul 23, 2019 at 8:12 AM Darin Steffl <darin.steffl(a)mnwifi.com> >>>>> wrote: >>>>> >>>>>> Current ETR is 7:30pm tonight so roughly 29 hours after the outage >>>>>> started. I've confirmed it's Arvig fiber, not zayo. >>>>>> >>>>>> On Tue, Jul 23, 2019, 8:11 AM Jay Hanke <jayhanke(a)southfront.io> >>>>>> wrote: >>>>>> >>>>>>> The word is that the road the fiber is on has washed out west of >>>>>>> Rochester. >>>>>>> >>>>>>> On Mon, Jul 22, 2019, 3:33 PM Darin Steffl <darin.steffl(a)mnwifi.com> >>>>>>> wrote: >>>>>>> >>>>>>>> It was 2:35pm to be exact. Hopefully it's not a Zayo line since >>>>>>>> they seem to take 18-24+ hours to fix their cuts. >>>>>>>> >>>>>>>> On Mon, Jul 22, 2019 at 3:32 PM Jay Hanke <jayhanke(a)southfront.io> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> Yes, that lines up with our timing/vendor as well. >>>>>>>>> >>>>>>>>> On Mon, Jul 22, 2019 at 3:29 PM Darin Steffl < >>>>>>>>> darin.steffl(a)mnwifi.com> wrote: >>>>>>>>> > >>>>>>>>> > We lost an arvig circuit at 2:45 so it must be the same cut. >>>>>>>>> > >>>>>>>>> > On Mon, Jul 22, 2019, 3:23 PM Jay Hanke <jayhanke(a)southfront.io> >>>>>>>>> wrote: >>>>>>>>> >> >>>>>>>>> >> Our transport to Albert Lea is currently down. >>>>>>>>> >> >>>>>>>>> >> -- >>>>>>>>> >> Jay Hanke, President >>>>>>>>> >> South Front Networks >>>>>>>>> >> jayhanke(a)southfront.io >>>>>>>>> >> Phone 612-204-0000 >>>>>>>>> > >>>>>>>>> > >>>>>>>>> > ________________________________ >>>>>>>>> > >>>>>>>>> > To unsubscribe from the MICE-DISCUSS list, click the following >>>>>>>>> link: >>>>>>>>> > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> Jay Hanke, President >>>>>>>>> South Front Networks >>>>>>>>> jayhanke(a)southfront.io >>>>>>>>> Phone 612-204-0000 >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Darin Steffl >>>>>>>> Minnesota WiFi >>>>>>>> www.mnwifi.com >>>>>>>> 507-634-WiFi >>>>>>>> <http://www.facebook.com/minnesotawifi> Like us on Facebook >>>>>>>> <http://www.facebook.com/minnesotawifi> >>>>>>>> >>>>>>>> ------------------------------ >>>>>>>> >>>>>>>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>>>>>>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>>>>>> >>>>>>> >>>>>>> ------------------------------ >>>>>>> >>>>>>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>>>>>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>>>>> >>>>>> >>>>>> ------------------------------ >>>>>> >>>>>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>>>>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>>>> >>>>> >>>>> ------------------------------ >>>>> >>>>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>>>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>>> >>>> >>>> ------------------------------ >>>> >>>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>> >>> >>> ------------------------------ >>> >>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>> >> >> >> -- >> Darin Steffl >> Minnesota WiFi >> www.mnwifi.com >> 507-634-WiFi >> <http://www.facebook.com/minnesotawifi> Like us on Facebook >> <http://www.facebook.com/minnesotawifi> >> >> ------------------------------ >> >> To unsubscribe from the MICE-DISCUSS list, click the following link: >> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >> > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > -- Darin Steffl Minnesota WiFi www.mnwifi.com 507-634-WiFi <http://www.facebook.com/minnesotawifi> Like us on Facebook <http://www.facebook.com/minnesotawifi>

July 23, 2019

Re: SFN Remote Outage

by Ben Wiechman

I will be sure to ask about that, but it is likely that it is already under evaluation. Ben Wiechman Director of IP Strategy and Engineering 320.247.3224 | ben.wiechman(a)arvig.com Arvig | 224 East Main Street | Melrose, MN 56352 | arvig.com On Tue, Jul 23, 2019 at 2:06 PM Darin Steffl <darin.steffl(a)mnwifi.com> wrote: > Much better picture Ben. I didn't feel like climbing down there ha. > > Hopefully the permanent fix involves boring on the other side of the road > where it doesn't have a chance of washing out again. > > On Tue, Jul 23, 2019 at 2:03 PM Ben Wiechman <ben.wiechman(a)arvig.com> > wrote: > >> [image: 12564.jpeg] >> >> This shows another location and the amount of dirt that was washed away. >> >> Splicing crews were completely hands off by around noon. Some services >> were restored earlier. >> >> Ben Wiechman >> >> Director of IP Strategy and Engineering >> >> 320.247.3224 | ben.wiechman(a)arvig.com >> >> Arvig | 224 East Main Street | Melrose, MN 56352 | arvig.com >> >> >> >> >> On Tue, Jul 23, 2019 at 12:43 PM Darin Steffl <darin.steffl(a)mnwifi.com> >> wrote: >> >>> Our service was restored around 10:36am today. I stopped by to take some >>> pictures since I work close to the cut. The road definitely washed out. The >>> fix is temporary with fiber laying in the ditch until they schedule a >>> permanent fix. >>> >>> >>> https://photos.app.goo.gl/1b551CBzbkEkvVXy7 >>> >>> On Tue, Jul 23, 2019, 8:36 AM Ben Wiechman <ben.wiechman(a)arvig.com> >>> wrote: >>> >>>> It is Arvig fiber. The road was washed out in at least three locations, >>>> with no available culverts or other options to push the fiber across the >>>> road in order to get the fiber repaired last night. The conditions were >>>> unsafe so we prepped as much as we could before dark and resumed splicing >>>> as soon as possible this morning. We are sorry for the impact, but needed >>>> to consider the safety of our crews on this one. >>>> >>>> Ben Wiechman >>>> >>>> Director of IP Strategy and Engineering >>>> >>>> 320.247.3224 | ben.wiechman(a)arvig.com >>>> >>>> Arvig | 224 East Main Street | Melrose, MN 56352 | arvig.com >>>> >>>> >>>> >>>> >>>> On Tue, Jul 23, 2019 at 8:12 AM Darin Steffl <darin.steffl(a)mnwifi.com> >>>> wrote: >>>> >>>>> Current ETR is 7:30pm tonight so roughly 29 hours after the outage >>>>> started. I've confirmed it's Arvig fiber, not zayo. >>>>> >>>>> On Tue, Jul 23, 2019, 8:11 AM Jay Hanke <jayhanke(a)southfront.io> >>>>> wrote: >>>>> >>>>>> The word is that the road the fiber is on has washed out west of >>>>>> Rochester. >>>>>> >>>>>> On Mon, Jul 22, 2019, 3:33 PM Darin Steffl <darin.steffl(a)mnwifi.com> >>>>>> wrote: >>>>>> >>>>>>> It was 2:35pm to be exact. Hopefully it's not a Zayo line since they >>>>>>> seem to take 18-24+ hours to fix their cuts. >>>>>>> >>>>>>> On Mon, Jul 22, 2019 at 3:32 PM Jay Hanke <jayhanke(a)southfront.io> >>>>>>> wrote: >>>>>>> >>>>>>>> Yes, that lines up with our timing/vendor as well. >>>>>>>> >>>>>>>> On Mon, Jul 22, 2019 at 3:29 PM Darin Steffl < >>>>>>>> darin.steffl(a)mnwifi.com> wrote: >>>>>>>> > >>>>>>>> > We lost an arvig circuit at 2:45 so it must be the same cut. >>>>>>>> > >>>>>>>> > On Mon, Jul 22, 2019, 3:23 PM Jay Hanke <jayhanke(a)southfront.io> >>>>>>>> wrote: >>>>>>>> >> >>>>>>>> >> Our transport to Albert Lea is currently down. >>>>>>>> >> >>>>>>>> >> -- >>>>>>>> >> Jay Hanke, President >>>>>>>> >> South Front Networks >>>>>>>> >> jayhanke(a)southfront.io >>>>>>>> >> Phone 612-204-0000 >>>>>>>> > >>>>>>>> > >>>>>>>> > ________________________________ >>>>>>>> > >>>>>>>> > To unsubscribe from the MICE-DISCUSS list, click the following >>>>>>>> link: >>>>>>>> > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Jay Hanke, President >>>>>>>> South Front Networks >>>>>>>> jayhanke(a)southfront.io >>>>>>>> Phone 612-204-0000 >>>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Darin Steffl >>>>>>> Minnesota WiFi >>>>>>> www.mnwifi.com >>>>>>> 507-634-WiFi >>>>>>> <http://www.facebook.com/minnesotawifi> Like us on Facebook >>>>>>> <http://www.facebook.com/minnesotawifi> >>>>>>> >>>>>>> ------------------------------ >>>>>>> >>>>>>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>>>>>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>>>>> >>>>>> >>>>>> ------------------------------ >>>>>> >>>>>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>>>>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>>>> >>>>> >>>>> ------------------------------ >>>>> >>>>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>>>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>>> >>>> >>>> ------------------------------ >>>> >>>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>> >>> >>> ------------------------------ >>> >>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>> >> >> ------------------------------ >> >> To unsubscribe from the MICE-DISCUSS list, click the following link: >> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >> > > > -- > Darin Steffl > Minnesota WiFi > www.mnwifi.com > 507-634-WiFi > <http://www.facebook.com/minnesotawifi> Like us on Facebook > <http://www.facebook.com/minnesotawifi> > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >

July 23, 2019

Re: SFN Remote Outage

by Darin Steffl

Much better picture Ben. I didn't feel like climbing down there ha. Hopefully the permanent fix involves boring on the other side of the road where it doesn't have a chance of washing out again. On Tue, Jul 23, 2019 at 2:03 PM Ben Wiechman <ben.wiechman(a)arvig.com> wrote: > [image: 12564.jpeg] > > This shows another location and the amount of dirt that was washed away. > > Splicing crews were completely hands off by around noon. Some services > were restored earlier. > > Ben Wiechman > > Director of IP Strategy and Engineering > > 320.247.3224 | ben.wiechman(a)arvig.com > > Arvig | 224 East Main Street | Melrose, MN 56352 | arvig.com > > > > > On Tue, Jul 23, 2019 at 12:43 PM Darin Steffl <darin.steffl(a)mnwifi.com> > wrote: > >> Our service was restored around 10:36am today. I stopped by to take some >> pictures since I work close to the cut. The road definitely washed out. The >> fix is temporary with fiber laying in the ditch until they schedule a >> permanent fix. >> >> >> https://photos.app.goo.gl/1b551CBzbkEkvVXy7 >> >> On Tue, Jul 23, 2019, 8:36 AM Ben Wiechman <ben.wiechman(a)arvig.com> >> wrote: >> >>> It is Arvig fiber. The road was washed out in at least three locations, >>> with no available culverts or other options to push the fiber across the >>> road in order to get the fiber repaired last night. The conditions were >>> unsafe so we prepped as much as we could before dark and resumed splicing >>> as soon as possible this morning. We are sorry for the impact, but needed >>> to consider the safety of our crews on this one. >>> >>> Ben Wiechman >>> >>> Director of IP Strategy and Engineering >>> >>> 320.247.3224 | ben.wiechman(a)arvig.com >>> >>> Arvig | 224 East Main Street | Melrose, MN 56352 | arvig.com >>> >>> >>> >>> >>> On Tue, Jul 23, 2019 at 8:12 AM Darin Steffl <darin.steffl(a)mnwifi.com> >>> wrote: >>> >>>> Current ETR is 7:30pm tonight so roughly 29 hours after the outage >>>> started. I've confirmed it's Arvig fiber, not zayo. >>>> >>>> On Tue, Jul 23, 2019, 8:11 AM Jay Hanke <jayhanke(a)southfront.io> wrote: >>>> >>>>> The word is that the road the fiber is on has washed out west of >>>>> Rochester. >>>>> >>>>> On Mon, Jul 22, 2019, 3:33 PM Darin Steffl <darin.steffl(a)mnwifi.com> >>>>> wrote: >>>>> >>>>>> It was 2:35pm to be exact. Hopefully it's not a Zayo line since they >>>>>> seem to take 18-24+ hours to fix their cuts. >>>>>> >>>>>> On Mon, Jul 22, 2019 at 3:32 PM Jay Hanke <jayhanke(a)southfront.io> >>>>>> wrote: >>>>>> >>>>>>> Yes, that lines up with our timing/vendor as well. >>>>>>> >>>>>>> On Mon, Jul 22, 2019 at 3:29 PM Darin Steffl < >>>>>>> darin.steffl(a)mnwifi.com> wrote: >>>>>>> > >>>>>>> > We lost an arvig circuit at 2:45 so it must be the same cut. >>>>>>> > >>>>>>> > On Mon, Jul 22, 2019, 3:23 PM Jay Hanke <jayhanke(a)southfront.io> >>>>>>> wrote: >>>>>>> >> >>>>>>> >> Our transport to Albert Lea is currently down. >>>>>>> >> >>>>>>> >> -- >>>>>>> >> Jay Hanke, President >>>>>>> >> South Front Networks >>>>>>> >> jayhanke(a)southfront.io >>>>>>> >> Phone 612-204-0000 >>>>>>> > >>>>>>> > >>>>>>> > ________________________________ >>>>>>> > >>>>>>> > To unsubscribe from the MICE-DISCUSS list, click the following >>>>>>> link: >>>>>>> > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> Jay Hanke, President >>>>>>> South Front Networks >>>>>>> jayhanke(a)southfront.io >>>>>>> Phone 612-204-0000 >>>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Darin Steffl >>>>>> Minnesota WiFi >>>>>> www.mnwifi.com >>>>>> 507-634-WiFi >>>>>> <http://www.facebook.com/minnesotawifi> Like us on Facebook >>>>>> <http://www.facebook.com/minnesotawifi> >>>>>> >>>>>> ------------------------------ >>>>>> >>>>>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>>>>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>>>> >>>>> >>>>> ------------------------------ >>>>> >>>>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>>>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>>> >>>> >>>> ------------------------------ >>>> >>>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>> >>> >>> ------------------------------ >>> >>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>> >> >> ------------------------------ >> >> To unsubscribe from the MICE-DISCUSS list, click the following link: >> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >> > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > -- Darin Steffl Minnesota WiFi www.mnwifi.com 507-634-WiFi <http://www.facebook.com/minnesotawifi> Like us on Facebook <http://www.facebook.com/minnesotawifi>

July 23, 2019

Re: SFN Remote Outage

by Ben Wiechman

[image: 12564.jpeg] This shows another location and the amount of dirt that was washed away. Splicing crews were completely hands off by around noon. Some services were restored earlier. Ben Wiechman Director of IP Strategy and Engineering 320.247.3224 | ben.wiechman(a)arvig.com Arvig | 224 East Main Street | Melrose, MN 56352 | arvig.com On Tue, Jul 23, 2019 at 12:43 PM Darin Steffl <darin.steffl(a)mnwifi.com> wrote: > Our service was restored around 10:36am today. I stopped by to take some > pictures since I work close to the cut. The road definitely washed out. The > fix is temporary with fiber laying in the ditch until they schedule a > permanent fix. > > > https://photos.app.goo.gl/1b551CBzbkEkvVXy7 > > On Tue, Jul 23, 2019, 8:36 AM Ben Wiechman <ben.wiechman(a)arvig.com> wrote: > >> It is Arvig fiber. The road was washed out in at least three locations, >> with no available culverts or other options to push the fiber across the >> road in order to get the fiber repaired last night. The conditions were >> unsafe so we prepped as much as we could before dark and resumed splicing >> as soon as possible this morning. We are sorry for the impact, but needed >> to consider the safety of our crews on this one. >> >> Ben Wiechman >> >> Director of IP Strategy and Engineering >> >> 320.247.3224 | ben.wiechman(a)arvig.com >> >> Arvig | 224 East Main Street | Melrose, MN 56352 | arvig.com >> >> >> >> >> On Tue, Jul 23, 2019 at 8:12 AM Darin Steffl <darin.steffl(a)mnwifi.com> >> wrote: >> >>> Current ETR is 7:30pm tonight so roughly 29 hours after the outage >>> started. I've confirmed it's Arvig fiber, not zayo. >>> >>> On Tue, Jul 23, 2019, 8:11 AM Jay Hanke <jayhanke(a)southfront.io> wrote: >>> >>>> The word is that the road the fiber is on has washed out west of >>>> Rochester. >>>> >>>> On Mon, Jul 22, 2019, 3:33 PM Darin Steffl <darin.steffl(a)mnwifi.com> >>>> wrote: >>>> >>>>> It was 2:35pm to be exact. Hopefully it's not a Zayo line since they >>>>> seem to take 18-24+ hours to fix their cuts. >>>>> >>>>> On Mon, Jul 22, 2019 at 3:32 PM Jay Hanke <jayhanke(a)southfront.io> >>>>> wrote: >>>>> >>>>>> Yes, that lines up with our timing/vendor as well. >>>>>> >>>>>> On Mon, Jul 22, 2019 at 3:29 PM Darin Steffl <darin.steffl(a)mnwifi.com> >>>>>> wrote: >>>>>> > >>>>>> > We lost an arvig circuit at 2:45 so it must be the same cut. >>>>>> > >>>>>> > On Mon, Jul 22, 2019, 3:23 PM Jay Hanke <jayhanke(a)southfront.io> >>>>>> wrote: >>>>>> >> >>>>>> >> Our transport to Albert Lea is currently down. >>>>>> >> >>>>>> >> -- >>>>>> >> Jay Hanke, President >>>>>> >> South Front Networks >>>>>> >> jayhanke(a)southfront.io >>>>>> >> Phone 612-204-0000 >>>>>> > >>>>>> > >>>>>> > ________________________________ >>>>>> > >>>>>> > To unsubscribe from the MICE-DISCUSS list, click the following link: >>>>>> > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> Jay Hanke, President >>>>>> South Front Networks >>>>>> jayhanke(a)southfront.io >>>>>> Phone 612-204-0000 >>>>>> >>>>> >>>>> >>>>> -- >>>>> Darin Steffl >>>>> Minnesota WiFi >>>>> www.mnwifi.com >>>>> 507-634-WiFi >>>>> <http://www.facebook.com/minnesotawifi> Like us on Facebook >>>>> <http://www.facebook.com/minnesotawifi> >>>>> >>>>> ------------------------------ >>>>> >>>>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>>>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>>> >>>> >>>> ------------------------------ >>>> >>>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>>> >>> >>> ------------------------------ >>> >>> To unsubscribe from the MICE-DISCUSS list, click the following link: >>> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >>> >> >> ------------------------------ >> >> To unsubscribe from the MICE-DISCUSS list, click the following link: >> http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >> > > ------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 >

July 23, 2019