I have seen that in the past that there is a limit that Cacti thinks is an error if it goes above. I know Anthony has had to adjust that setting for other ports in the past. Since this is the first time for Cloudflare has moved that much traffic, it is the first time we have had a chance to notice it. From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET> On Behalf Of Jonathan Stewart Sent: Friday, May 24, 2024 2:14 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] Traffic spike starting at 2:00am today Also noticed: The Port-Channel13 graph (For Cloudflare) broke at about 02:30 as it passed 80 Gbps, and remained blank for an hour.. Maybe something with counters rolling over too quickly? Jonathan Stewart Network Engineer LES.NET - AS18451 Desk: 1-204-666-6191 Mobile: 1-204-990-2120 130 Portage Avenue E Winnipeg, MB R3C 0A1 CANADA On Fri, 2024-05-24 2:04 p.m., Justin Krejci wrote: I have found the Fastly team to be very competent and helpful. We currently have a couple of PNIs with them, and we saw the same spike in traffic from numerous of our peers, including Fastly. If you have a large amount of traffic volume exchanged with Fastly, you should explore getting some PNI connectivity with them. -----Original Message----- From: Josh Hoppes <Josh.Hoppes@CFUNET.NET <mailto:Josh%20Hoppes%20%3cJosh.Hoppes@CFUNET.NET%3e> > Reply-To: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET <mailto:MICE%20Discuss%20%3cMICE-DISCUSS@LISTS.IPHOUSE.NET%3e> > To: MICE-DISCUSS@LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Traffic spike starting at 2:00am today Date: Fri, 24 May 2024 18:10:17 +0000 We noticed more traffic from Fastly reaching us via transits a while back and had reached out to them back in the beginning of April. Their network operations team had this to say: The traffic you're seeing on transit has been driven by overall capacity limits on our MICE ports. (There are multiple ASNs whose traffic is "contributing" to this constraint.) We have automated traffic engineering systems which will divert "overflow" traffic to alternate paths - usually transit, as you've been seeing - when demand for direct peering paths is higher than available capacity. We recognize this is suboptimal, and the Fastly infrastructure management team is actively working on targeted upgrades and peering additions in Minneapolis. I don't have a specific timeline, but can confirm it is an active priority and should help to alleviate the need for transit overflow. From: MICE Discuss <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> <MICE-DISCUSS@LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Friday, May 24, 2024 12:39 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Traffic spike starting at 2:00am today CAUTION: This email originated from outside of the organization. Do not click links or open attachments unless you recognize the sender and know the content is safe. They have been in need of an upgrade for a while. They have not responded to my emails. From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> > On Behalf Of Jonathan Stewart Sent: Friday, May 24, 2024 12:37 PM To: MICE-DISCUSS@LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: Re: [MICE-DISCUSS] Traffic spike starting at 2:00am today What or who is the source of this traffic, anyone know? A CDN maybe? Oh wait, I can answer my own question using micelg.usinternet.com: Fastly AS54113. Both 100G links are at 90% since 03:00 till now. Wow. Jonathan Stewart Network Engineer LES.NET - AS18451 Desk: 1-204-666-6191 Mobile: 1-204-990-2120 130 Portage Avenue E Winnipeg, MB R3C 0A1 CANADA On Fri, 2024-05-24 10:30 a.m., Jay Hanke wrote: It's ok if you guys play Fortnite... :) On Fri, May 24, 2024 at 10:25 AM Brandon Mickelson <bmick@rrv.net <mailto:bmick@rrv.net> > wrote: My 11 year old said it was a new season of Fortnite is today. Brandon Mickelson Halstad Telephone Company brandon.mickelson@halstadtel.com <mailto:bmick@rrv.net> 218-456-2125 x227 1-800-457-2125 From: MICE Discuss <MICE-DISCUSS@LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> > On Behalf Of Dean Bahls Sent: Friday, May 24, 2024 9:39 AM To: MICE-DISCUSS@LISTS.IPHOUSE.NET <mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] Traffic spike starting at 2:00am today Curious if anyone knows why we are seeing about 25-30% increase in traffic today. Some big updates going on perhaps? Thanks, Dean Dean Bahls COO | Fiber Minnesota & Aurora Fiber Optic Networks 14 Main St SW | PO Box J | Menahga, MN 56464 218.564-1321 (Direct) | 218.564.3000 (Main Office) <mailto:dean.bahls@fiberminnesota.com> dean.bahls@fiberminnesota.com _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <https://url-shield.securence.com/?p=1.0&r=jkrejci@usinternet.com&sid=1716574829062-013-00311360&s=drn5kdvx&n=br6v5koyb&ms=0.0,0.0,0.0,0.0&u=http%3A%2F%2Flists.iphouse.net%2Fcgi-bin%2Fwa%3FSUBED1%3DMICE-DISCUSS%26A%3D1> &A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <https://url-shield.securence.com/?p=1.0&r=jkrejci@usinternet.com&sid=1716574829062-013-00311360&s=drn5kdvx&n=br6v5koyb&ms=0.0,0.0,0.0,0.0&u=http%3A%2F%2Flists.iphouse.net%2Fcgi-bin%2Fwa%3FSUBED1%3DMICE-DISCUSS%26A%3D1> &A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <https://url-shield.securence.com/?p=1.0&r=jkrejci@usinternet.com&sid=1716574829062-013-00311360&s=ut4n6dv2&n=br6v5koyc&ms=0.0,0.0,0.0,0.0&u=http%3A%2F%2Flists.iphouse.net%2Fcgi-bin%2Fwa%3FSUBED1%3DMICE-DISCUSS%26A%3D1> &A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <https://url-shield.securence.com/?p=1.0&r=jkrejci@usinternet.com&sid=1716574829062-013-00311360&s=ut4n6dv2&n=br6v5koyc&ms=0.0,0.0,0.0,0.0&u=http%3A%2F%2Flists.iphouse.net%2Fcgi-bin%2Fwa%3FSUBED1%3DMICE-DISCUSS%26A%3D1> &A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <https://url-shield.securence.com/?p=1.0&r=jkrejci@usinternet.com&sid=1716574829062-013-00311360&s=ut4n6dv2&n=br6v5koyc&ms=0.0,0.0,0.0,0.0&u=http%3A%2F%2Flists.iphouse.net%2Fcgi-bin%2Fwa%3FSUBED1%3DMICE-DISCUSS%26A%3D1> &A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <https://url-shield.securence.com/?p=1.0&r=jkrejci@usinternet.com&sid=1716574829062-013-00311360&s=ut4n6dv2&n=br6v5koyc&ms=0.0,0.0,0.0,0.0&u=http%3A%2F%2Flists.iphouse.net%2Fcgi-bin%2Fwa%3FSUBED1%3DMICE-DISCUSS%26A%3D1> &A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> &A=1 _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> &A=1