December 2023 - mice-discuss - lists.micemn.net

Please welcome Tritan Internet to MICE!

by Jeremy Lumby

Name: Tritan Internet LLC Switch: NOCIX Ports: E 5/14 ASN: 393577 IPv4: 206.108.255.222/24 IPv6: 2001:504:27:0:6:169::1/64 Peering Contact: noc(a)as393577.net Route Servers: YES Welcome Aboard! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

Dec. 28, 2023

Please welcome ParadoxNetworks to MICE!

by Jeremy Lumby

Name: ParadoxNetworks Limited Switch: NOCIX Ports: E 5/13 ASN: 52025 IPv4: 206.108.255.221/24 IPv6: 2001:504:27:0:0:CB39::1/64 Peering Contact: peering(a)pdxnet.co.uk Route Servers: YES Welcome Aboard! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 Main: 612-355-7740 Direct: 612-392-6814 Fax: 952-873-7425 jlumby(a)mnvoip.com

Dec. 24, 2023

Re: BGP ADD-PATH capability

by Richard Laager

On 2023-12-22 08:00, Michael Hare wrote: > > Ack'ing this is a negotiated feature, buyer beware for those who turn > it on and are using prefix-limits on their BGP sessions. > Prefix limit is a fair point. > Is there a graph or can you provide a one time count of the current > RIB sizes on the RS? > Here is how it changes (as viewed by my AS just before I sent the original email): Before: 107271 After: 113441 > I am in favor adding the feature, but I’m not sure if 1 week spacing > is enough to prove stability. > If your concern about 1 week spacing is related to prefix limits, then I think we will be fine. I can look at who has a session up before, make the change, and see if anyone's session goes down. If so, I can contact them specifically. If your concern about 1 week spacing is just a generalized concern, do you have a suggestion of what sort of period would be appropriate? -- Richard

Dec. 24, 2023

Re: BGP ADD-PATH capability

by Jay Hanke

We are looking at this on QCIX as well. I'll bring this up on the NA-IX forum and see what the other IXes are doing and have done and what issues have been solved or created. jay On Fri, Dec 22, 2023 at 8:00 AM Michael Hare <000000097dab80c5-dmarc-request(a)lists.iphouse.net> wrote: > > Ack'ing this is a negotiated feature, buyer beware for those who turn it on and are using prefix-limits on their BGP sessions. I've used add-path on JunOS and on that platform you optionally add a 'path-count' function on the TX side for intra ASN stuff. In the bird implementation the behavior is "all" routes. Is there a graph or can you provide a one time count of the current RIB sizes on the RS? > > > > I am in favor adding the feature, but I’m not sure if 1 week spacing is enough to prove stability. But I’m known to be nervous. > > > > Bird docs mentioning the feature here: https://bird.network.cz/?get_doc&v=20&f=bird-6.html > > > > -Michael > > > > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby > Sent: Thursday, December 21, 2023 9:07 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: Re: [MICE-DISCUSS] BGP ADD-PATH capability > > > > I think the added functionality probably outweighs the possible issues. I am in favor. > > > > From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Richard Laager > Sent: Thursday, December 21, 2023 8:57 PM > To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET > Subject: [MICE-DISCUSS] BGP ADD-PATH capability > > > > I propose that MICE enable BGP ADD-PATH capability (RFC 7911) on the route servers (in TX mode only). This is negotiated BGP capability, so we do not need any per-participant setting for it. > > ADD-PATH is useful if the best path route is being filtered but another route would not be. We discussed adding this at a UG meeting years ago. > > There are other IXPs that have this enabled. For example, this one: https://www.bcix.de/ixp/content/0/route-servers > > In terms of timeline, I propose something like this: > > January 9: Enable it on Route Server 1. > January 16: Enable it on Route Server 2. > > The actual change looks like this for the RS1-only piece, and then the conditional would be removed when we want to deploy to RS2: > > --- a/roles/ixpmanager/files/mice/api/v4/router/server/bird2/neighbors.foil.php > +++ b/roles/ixpmanager/files/mice/api/v4/router/server/bird2/neighbors.foil.php > @@ -315,6 +315,9 @@ protocol bgp pb_<?= $int['fvliid'] ?>_as<?= $int['autsys'] ?> from tb_rsclient { > import filter f_import_as<?= $int['autsys'] ?>; > table t_<?= $int['fvliid'] ?>_as<?= $int['autsys'] ?>; > export filter f_export_as<?= $int['autsys'] ?>; > +<?php if( $t->router->router_id == "206.108.255.1" ): ?> > + add paths tx; > +<?php endif; ?> > }; > <?php if( $int['bgpmd5secret'] && !$t->router->skip_md5 ): ?> > password "<?= $int['bgpmd5secret'] ?>"; > > -- > > Richard > > > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > > > ________________________________ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Dec. 22, 2023

Re: BGP ADD-PATH capability

by Michael Hare

Ack'ing this is a negotiated feature, buyer beware for those who turn it on and are using prefix-limits on their BGP sessions. I've used add-path on JunOS and on that platform you optionally add a 'path-count' function on the TX side for intra ASN stuff. In the bird implementation the behavior is "all" routes. Is there a graph or can you provide a one time count of the current RIB sizes on the RS? I am in favor adding the feature, but I’m not sure if 1 week spacing is enough to prove stability. But I’m known to be nervous. Bird docs mentioning the feature here: https://bird.network.cz/?get_doc&v=20&f=bird-6.html -Michael From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Jeremy Lumby Sent: Thursday, December 21, 2023 9:07 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: Re: [MICE-DISCUSS] BGP ADD-PATH capability I think the added functionality probably outweighs the possible issues. I am in favor. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET>> On Behalf Of Richard Laager Sent: Thursday, December 21, 2023 8:57 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET<mailto:MICE-DISCUSS@LISTS.IPHOUSE.NET> Subject: [MICE-DISCUSS] BGP ADD-PATH capability I propose that MICE enable BGP ADD-PATH capability (RFC 7911) on the route servers (in TX mode only). This is negotiated BGP capability, so we do not need any per-participant setting for it. ADD-PATH is useful if the best path route is being filtered but another route would not be. We discussed adding this at a UG meeting years ago. There are other IXPs that have this enabled. For example, this one: https://www.bcix.de/ixp/content/0/route-servers In terms of timeline, I propose something like this: * January 9: Enable it on Route Server 1. * January 16: Enable it on Route Server 2. The actual change looks like this for the RS1-only piece, and then the conditional would be removed when we want to deploy to RS2: --- a/roles/ixpmanager/files/mice/api/v4/router/server/bird2/neighbors.foil.php +++ b/roles/ixpmanager/files/mice/api/v4/router/server/bird2/neighbors.foil.php @@ -315,6 +315,9 @@ protocol bgp pb_<?= $int['fvliid'] ?>_as<?= $int['autsys'] ?> from tb_rsclient { import filter f_import_as<?= $int['autsys'] ?>; table t_<?= $int['fvliid'] ?>_as<?= $int['autsys'] ?>; export filter f_export_as<?= $int['autsys'] ?>; +<?php if( $t->router->router_id == "206.108.255.1" ): ?> + add paths tx; +<?php endif; ?> }; <?php if( $int['bgpmd5secret'] && !$t->router->skip_md5 ): ?> password "<?= $int['bgpmd5secret'] ?>"; -- Richard ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 ________________________________ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1

Dec. 22, 2023

Re: BGP ADD-PATH capability

by Jeremy Lumby

I think the added functionality probably outweighs the possible issues. I am in favor. From: MICE Discuss <MICE-DISCUSS(a)LISTS.IPHOUSE.NET> On Behalf Of Richard Laager Sent: Thursday, December 21, 2023 8:57 PM To: MICE-DISCUSS(a)LISTS.IPHOUSE.NET Subject: [MICE-DISCUSS] BGP ADD-PATH capability I propose that MICE enable BGP ADD-PATH capability (RFC 7911) on the route servers (in TX mode only). This is negotiated BGP capability, so we do not need any per-participant setting for it. ADD-PATH is useful if the best path route is being filtered but another route would not be. We discussed adding this at a UG meeting years ago. There are other IXPs that have this enabled. For example, this one: https://www.bcix.de/ixp/content/0/route-servers In terms of timeline, I propose something like this: * January 9: Enable it on Route Server 1. * January 16: Enable it on Route Server 2. The actual change looks like this for the RS1-only piece, and then the conditional would be removed when we want to deploy to RS2: --- a/roles/ixpmanager/files/mice/api/v4/router/server/bird2/neighbors.foil.php +++ b/roles/ixpmanager/files/mice/api/v4/router/server/bird2/neighbors.foil.php @@ -315,6 +315,9 @@ protocol bgp pb_<?= $int['fvliid'] ?>_as<?= $int['autsys'] ?> from tb_rsclient { import filter f_import_as<?= $int['autsys'] ?>; table t_<?= $int['fvliid'] ?>_as<?= $int['autsys'] ?>; export filter f_export_as<?= $int['autsys'] ?>; +<?php if( $t->router->router_id == "206.108.255.1" ): ?> + add paths tx; +<?php endif; ?> }; <?php if( $int['bgpmd5secret'] && !$t->router->skip_md5 ): ?> password "<?= $int['bgpmd5secret'] ?>"; -- Richard _____ To unsubscribe from the MICE-DISCUSS list, click the following link: http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> &A=1

Dec. 22, 2023

BGP ADD-PATH capability

by Richard Laager

I propose that MICE enable BGP ADD-PATH capability (RFC 7911) on the route servers (in TX mode only). This is negotiated BGP capability, so we do not need any per-participant setting for it. ADD-PATH is useful if the best path route is being filtered but another route would not be. We discussed adding this at a UG meeting years ago. There are other IXPs that have this enabled. For example, this one: https://www.bcix.de/ixp/content/0/route-servers In terms of timeline, I propose something like this: * January 9: Enable it on Route Server 1. * January 16: Enable it on Route Server 2. The actual change looks like this for the RS1-only piece, and then the conditional would be removed when we want to deploy to RS2: --- a/roles/ixpmanager/files/mice/api/v4/router/server/bird2/neighbors.foil.php +++ b/roles/ixpmanager/files/mice/api/v4/router/server/bird2/neighbors.foil.php @@ -315,6 +315,9 @@ protocol bgp pb_<?= $int['fvliid'] ?>_as<?= $int['autsys'] ?> from tb_rsclient { import filter f_import_as<?= $int['autsys'] ?>; table t_<?= $int['fvliid'] ?>_as<?= $int['autsys'] ?>; export filter f_export_as<?= $int['autsys'] ?>; +<?php if( $t->router->router_id == "206.108.255.1" ): ?> + add paths tx; +<?php endif; ?> }; <?php if( $int['bgpmd5secret'] && !$t->router->skip_md5 ): ?> password "<?= $int['bgpmd5secret'] ?>"; -- Richard

Dec. 22, 2023

Re: Strange Cacti graphs

by Jonathan Stewart

I see what you mean on the Aggregate graphs on the MICE Looking Glass. http://micelg.usinternet.com/cacti/graph.php?action=view&local_graph_id=262… It could be a real member port doing something--but those are ~100 Gbps spikes. What I also notice is that each spike is followed by a dip of roughly the same magnitude. This makes me think of sampling jitter (or artifacts, or noise) It's hard to describe but port counters don't update every second, sometimes it's every 30 seconds. Then Cacti comes along every approx 5 minutes (300 seconds) to poll the counters. The slight mismatch in timing means that Cacti usually gets 10 counter updates per 300 seconds--but every hour it gets 11 on one interval, and 9 on the next. Overall, the graph is accurate, but it shows this 5% noise every hour. This is guesswork in the case of MICE, but I've seen this in other networks, Cheers, Jonathan Jonathan Stewart Network Engineer LES.NET - AS18451 Desk: 1-204-666-6191 Mobile: 1-204-990-2120 130 Portage Avenue E Winnipeg, MB R3C 0A1 CANADA On Tue, 2023-12-19 4:27 p.m., Dean Bahls wrote: > > Anyone notice the strange spikes/valleys on the Cacti graphs lately? > > Looks like a heartbeat every hour on the hour. > > Thanks, > > Dean > > *Dean Bahls* > > **COO | Fiber Minnesota > > 14 Main St SW | PO Box J | Menahga, MN 56464 > > *218.564-1321 (Direct)* | 218.564.3000 (Main Office) > > dean.bahls(a)fiberminnesota.com <mailto:dean.bahls@fiberminnesota.com> > > > ------------------------------------------------------------------------ > > To unsubscribe from the MICE-DISCUSS list, click the following link: > http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1 > <http://lists.iphouse.net/cgi-bin/wa?SUBED1=MICE-DISCUSS&A=1> >

Dec. 21, 2023

Please welcome ImOn Communications to MICE!

by Jeremy Lumby

Name: ImOn Communications Switch: MN VoIP 100G Switch Port: E 2/1 as a single 100G member in portchannel 4 ASN: 393238 IPv4: This is a port upgrade. All IP info remains the same. IPv6: Peering Contact: imonadmins(a)imon.net Route Servers: Yes Welcome Aboard Again! Jeremy Lumby Minnesota VoIP 9217 17th Ave S #216 Bloomington, MN 55425 M: 612-355-7740 D: 612-392-6814 F: 952-873-7425 jlumby(a)mnvoip.com

Dec. 21, 2023

Strange Cacti graphs

by Dean Bahls

Anyone notice the strange spikes/valleys on the Cacti graphs lately? Looks like a heartbeat every hour on the hour. Thanks, Dean Dean Bahls COO | Fiber Minnesota 14 Main St SW | PO Box J | Menahga, MN 56464 218.564-1321 (Direct) | 218.564.3000 (Main Office) dean.bahls(a)fiberminnesota.com<mailto:dean.bahls@fiberminnesota.com> [cid:image001.png@01DA3298.4466DA60] [cid:image002.png@01DA3298.4466DA60]

Dec. 19, 2023