RIFT Key/Value TIE Structure and Processing

Introduction The Routing in Fat-Trees RIFT protocol allows for key/value pairs to be advertised within Key-Value Topology Information Elements (KV-TIEs). There are no restrictions placed on the type of data that is contained in KV-TIEs nor what the data is used for. For example, it might be beneficial to advertise overlay protocol state from leaf nodes to the Top-of-Fabric (ToF) nodes. This would make it possible to view critical state of a fabric-wide service from a single ToF node rather than retrieving and reconciling the same state from multiple leaf nodes.

Key-Value Structure This section describes the generic Key structure and semantics, further illustrates these components.

Generic Key-Value Structure where:

Key-Type:

A 1-byte value that identifies the Key-Type. It MUST be a reserved value from the RIFT Key-Type Registry that is defined later in this document. The range of valid values is 1 - 255 (2^8-1). 0 is an illegal value and MUST NOT be allocated to or used by any implementation. It MUST be ignored on receipt.

Key Identifier:

A 3-byte value that identifies the specific key and describes the structure of the contained values. The range of valid values is 1 - 16777215 (2^24-1). 0 is an illegal value and MUST NOT be allocated to or used by any implementation. It MUST be ignored on receipt.

Values:

A variable length value that contains data associated with the Key Identifier. It SHOULD contain 1 or more elements. Whether the collection of elements allows duplicates and/or is ordered is governed by the particular Key Identifier's specification.

Key Sub-Type The Key Sub-Type is an OPTIONAL mechanism to further describe the contained values and their structure. This is illustrated by . While the Key Sub-Type is optional, it MUST be used when the Key-Type is either Well-Known or Experimental in order to avoid interoperability issues.

Generic Key-Value Structure with Key Sub-Type where:

Key Sub-Type:

An OPTIONAL 1-byte value that identifies the Key Sub-Type which describes the structure of the contained values. If used, it MUST be a reserved value from the RIFT Well-Known Key Sub-Types registry. The range of valid values is 1 - 255 (2^8-1). 0 is an illegal value and MUST NOT be allocated to or used by any implementation. It MUST be ignored on receipt.

Key Identifier:

If the Key Sub-Type is used, it inherently reduces the Key Identifier space from 3-bytes to 2-bytes. The Key Identifier is otherwise unchanged. The range of valid values is now 1 - 65535 (2^16-1). 0 is an illegal value and MUST NOT be allocated to or used by any implementation. It MUST be ignored on receipt.

Experimental Key-Type This section reserves a value in the RIFT Key-Type Registry to indicate an Experimental Key-Type. As shown in , the Key-Type will be used to identify the Key-Type as Experimental. The Key Identifier will be used to identify the specific key and describe the structure of the contained values.

Experimental Key-Type

Well-Known Key-Type This section reserves a value in the RIFT Key-Type Registry to indicate Well-Known Key-Types that all implementations SHOULD support. As shown in , the Key-Type will be used to identify the Key-Type as Well-Known. The Key Identifier will be used to identify the specific key and describe the structure of the contained values.

Well-Known Key-Type

OUI Key-Type This section reserves a value in the RIFT Key-Type Registry to indicate an OUI (vendor-specific) Key-Type that any implementation MAY support. As shown in , the Key-Type will be used to identify the Key-Type as OUI. The Key Identifier MUST use the implementing organization's reserved OUI space to indicate the key and value structure.

OUI Key-Type

Design Considerations While no restrictions are placed on Key-Value data or what it is used for, it is RECOMMENDED that a serialized Thrift model be used for simpler interoperability. is an example of this type of implementation. Key-Value elements SHOULD NOT be used to carry topology information used by RIFT itself to perform distributed computations.

Tie-Breaking Considerations In cases where KV-TIEs are flooded from north to south, policies SHOULD be implemented in order to avoid network-wide flooding. For networks with more than one ToF node, it is RECOMMENDED that those ToF nodes contain identical KV-TIE information when being distributed from north to south. RIFT requires that only one KV-TIE is selected when identical keys are received from multiple northbound neighbors. If this is not considered then the tie-breaking rules may cause a node to select a suboptimal KV-TIE. Consider a case where failure conditions cause the ToF nodes to become split-brained. While the Key-Type and Key Identifier will be identical, the value(s) contained within may differ. The node(s) receiving these differing KV-TIEs will select the one from the ToF node with the highest System ID, potentially leading to unintended effects.

Southbound Key-Value TIE Tie-Break Sub-Type This Key-Value pair contains information that allows an implementation to test and verify proper tie-breaking behavior for the Southbound Key store.

Southbound Tie-Break (Global) Sub-Type 0 1 2 3 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 2 3 4 5 6 7 8 9 0 1 +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | Well-Known | Tie Break | Key Identifier | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ | (System ID, | | Level), | +-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+-+ where:

System ID:

A REQUIRED value indicating the node's unique System ID.

Level:

A RECOMMENDED value indicating the node's level.

Key Target The Key Target is an OPTIONAL value that identifies group(s) of node(s) that are intended to receive a given Key-Value TIE. Key Targets are 64-bits in length with a valid range of 0 - 18446744073709551615 (2^64-1), this will reduce the chances that Key Target values collide. A value of all 0s represent that every node is intended to receive this Key-Value TIE and MUST NOT be used for any other reason. A value of all 1s represent that all leaf nodes are intended to receive this Key-Value TIE and MUST NOT be used for any other reason. Any other value MUST be derived from the following normative algorithm.

Key Target Standard Algorithm /// random seeds used in algorithms to increase entropy pub const RANDOMSEEDS: [UnsignedSystemID; 3] = [ 67438371571u64, 37087353685, 88675895388, ]; /// given a system ID delivers the bits set by the according Bloom Filter in the southbound /// key value target. /// /// @note: This is standardized and cannot be changed between releases! pub (crate) fn target2bits(target: UnsignedSystemID) -> KeyValueTargetType { (0 as usize .. 3) .map(|s| { let rot = (target ^ RANDOMSEEDS[s]).rotate_left(s as _); rot.to_ne_bytes().iter().fold(0, |v: u8, nv| v.rotate_right(4) ^ *nv) % 64 }) .fold(0, |v, nv| v | v | (1 << nv)) }

Key Target Processing Nodes that support the processing of Key Targets MUST only do so on KV-TIEs in the southbound direction. Key Targets MUST NOT be present on KV-TIEs in the northbound direction and are otherwise ignored and logged. Nodes that do not support the processing of Key Targets MUST continue to send KV-TIEs to all nodes in the appropriate direction. Additionally, Key Targets MUST be preserved when KV-TIEs are re-originated in the southbound direction.

Purging/Rollover There are several reasons a node may select a different KV-TIE. For example, the KV-TIE is considered newer due to the sequence number incrementing, there was a change in the original tie-breaking result between multiple KV-TIEs, or a loss of northbound connectivity to the node that advertised the previously selected KV-TIE. Consider a case where Leaf-1, Leaf-2, and Leaf-3 are members of a group of nodes represented by Key Target KT1. If Leaf-2 is removed from that group and a newer instance of the KV-TIE needs to be flooded Leaf-2 will have to maintain the older KV-TIE in the LSDB until the lifetime expires. This could lead to suboptimal behavior in the fabric. If the new KV-TIE being flooded does not include the previous Key Target value, then implementations SHOULD flood the newer instance of the KV-TIE with a very short lifetime to nodes that belonged to the previous Key Target but not the new Key Target. This logic only applies to KV-TIEs being flooded in the southbound direction.

IANA Considerations Per , IANA is requested to create two new registries under the top-level "RIFT" category:

RIFT Key-Types
RIFT Well-Known Key-Types

The following sections detail each registry's individual requirements and suggested values. Experts reviewing requests for new values to either registry MUST consider the items in the Expert Review Guidance section.

RIFT Key-Types This section requests that IANA create and help govern the following registry:

Registry Name:

RIFT Key-Types

Registration Procedures:

Expert Review

Description:

Key-Type registry for the RIFT protocol.

Reference:

This document.

RIFT Key-Types Requested Entries This section requests that IANA register the following suggested values to the "RIFT Key-Types" registry.

Value	Key-Type	Description	Status/Reference
0	Illegal	Not allowed.	This document
1	Experimental	Indicates that the Key-Type is Experimental.	This document.
2	Well-Known	Indicates that the Key-Type is Well-Known.	This document.
3	OUI	Indicates that the Key-Type is OUI (vendor specific).	This document.

RIFT Well-Known Key Sub-Types This section requests that IANA create and help govern the following registry:

Registry Name:

RIFT Well-Known Key Sub-Types

Registration Procedures:

Expert Review

Description:

Well-Known Key Sub-Types registry for the RIFT protocol.

Reference:

This document.

RIFT Well-Known Key Sub-Types Requested Entries This section requests that IANA register the following suggested values to the "RIFT Well-Known Key Sub-Types" Registry.

Value	Key-Identifier	Description	Status/Reference
0	Illegal	Not allowed.	This document.
1	MAC/IP Binding	To be defined.	To be defined.
2	FAM Security Roll-Over Key	To be defined.	To be defined.
127	Southbound Tie-Break Key Sub-Type	Used for Southbound Keystore tie-breaking testing and verification.	This document.

Expert Review Guidance Experts reviewing requests for values from the "RIFT Key-Types" registry or the "RIFT Well-Known Key-Types" registry are responsible for the following:

Determining the existence of a specification that clearly defines the purpose supporting the request and MUST contain all required fields for given registry. The document MUST also be permenent and publically available.
Ensuring that any requests are made available to the RIFT working group for review should the work originate from outside of the RIFT Working Group.
Ensuring that any work produce outside of the IETF does not conflict with any work that is already published or actively pursuing being published.

Security Considerations This document introduces no new security concerns to RIFT or other specifications referenced in this document given that the Key-Value TIEs are already extensively secured by the RIFT protocol specification itself.

Acknowledgements To be provided.

Normative References Ambiguity of Uppercase vs Lowercase in RFC 2119 Key Words RFC 2119 specifies common key words that may be used in protocol specifications. This document aims to reduce the ambiguity by clarifying that only UPPERCASE usage of the key words have the defined special meanings. Key words for use in RFCs to Indicate Requirement Levels In many standards track documents several words are used to signify the requirements in the specification. These words are often capitalized. This document defines these words as they should be interpreted in IETF documents. This document specifies an Internet Best Current Practices for the Internet Community, and requests discussion and suggestions for improvements. Guidelines for Writing an IANA Considerations Section in RFCs RIFT: Routing in Fat Trees Informative References RIFT Auto-EVPN Thrift Language Implementation and Documentation Apache Software Foundation

Thrift Models This section contains the Thrift models that MAY be used to test southbound Key-Value tie-breaking based on System ID. Per the main RIFT specification, all signed values MUST be interpreted as unsigned values.

southbound_kv.thrift

RIFT Common Schema for Southbound Key-Value Tie-Break Key Sub-Type include "common.thrift" namespace py southbound_kv namespace rs models const i8 GlobalSystemIdentifierKV = 127 /** simple type to test correct tie-breaking based on system ID */ struct SystemIdentifierKV { 1: required common.SystemIDType system_id, 2: optional common.LevelType level, }