Community hub
0 subscribers7 pages, 0 posts
Recent from talks
Be the first to start a discussion here.
Be the first to start a discussion here.
Be the first to start a discussion here.
Be the first to start a discussion here.
Contribute something
Welcome to the community hub built to collect knowledge and have discussions related to Virtual Extensible LAN.
Nothing was collected or created yet.
Virtual Extensible LAN
View on Wikipediafrom Wikipedia
Virtual eXtensible LAN (VXLAN) is a network virtualization technology that uses a VLAN-like encapsulation technique to encapsulate OSI layer 2 Ethernet frames within layer 4 UDP datagrams, using 4789 as the default IANA-assigned destination UDP port number,[1] although many implementations that predate the IANA assignment use port 8472. VXLAN attempts to address the scalability problems associated with large cloud computing deployments.[2] VXLAN endpoints, which terminate VXLAN tunnels and may be either virtual or physical switch ports, are known as VXLAN tunnel endpoints (VTEPs).[3][4]
History
[edit]VXLAN is an evolution of efforts to standardize on an overlay encapsulation protocol. Compared to single-tagged IEEE 802.1Q VLANs which provide a limited number of layer-2 VLANs (4094, using a 12-bit VLAN ID), VXLAN increases scalability up to about 16 million logical networks (using a 24-bit VNID) and allows for layer-2 adjacency across IP networks. Multicast or unicast with head-end replication (HER) is used to flood Broadcast, unknown-unicast and multicast traffic.[5]
The VXLAN specification was originally created by VMware, Arista Networks and Cisco.[6][7]
Implementations
[edit]VXLAN is widely, but not universally, implemented in commercial networking equipment. Several open-source implementations of VXLAN also exist.
Commercial
[edit]Arista, Cisco, and VMware were the originators of VXLAN and support it in various products.
Other backers of the VXLAN technology include Huawei,[8] Broadcom, Citrix, Pica8, Big Switch Networks, Arrcus, Cumulus Networks, Dell EMC, Netgate, Ericsson, Mellanox,[9] Red Hat,[10] Joyent, and Juniper Networks.
Open source
[edit]- FreeBSD,[11]
- OpenBSD,[12]
- Linux,[13]
- Open vSwitch is an example of a software-based virtual network switch that supports VXLAN overlay networks.
Standards specifications
[edit]VXLAN is officially documented by the IETF in RFC 7348.[10] VXLAN encapsulates a MAC frame in a UDP datagram for transport across an IP network,[14] creating an overlay network or tunnel.
Alternative technologies
[edit]Alternative technologies addressing the same or similar operational concerns include:
- IEEE 802.1ad ("Q-in-Q"), which greatly increases the number of VLANs supported by standard IEEE 802 Ethernet beyond 4K.
- IEEE 802.1ah ("MAC-in-MAC"), which supports tunneling Ethernet in a way that greatly increases the number of VLANs supported while avoiding a large increase in the size of the MAC Address table in a Carrier Ethernet deployment.
- Network Virtualization using Generic Route Encapsulation (NVGRE), which uses different framing but has similar goals to VxLAN.
See also
[edit]- Distributed Overlay Virtual Ethernet (DOVE)
- Ethernet VPN (EVPN)
- GENEVE, an industry effort to unify both VXLAN and NVGRE technologies
- Generic routing encapsulation (GRE)
- IEEE 802.1ad, an Ethernet networking standard, also known as provider bridging, Stacked VLANs, or simply Q-in-Q.
- IEEE 802.1ah, an IEEE Ethernet networking standard, also known as Provider Backbone Bridging (PBB) or MAC-in-MAC.
- NVGRE, Network Virtualization using GRE, which is a similar competing specification to VxLAN.
- Overlay Transport Virtualization (OTV)
- Virtual LAN (VLAN)
- Layer 2 Tunneling Protocol (L2TP)
References
[edit]- ^ Herrod, Steve (August 30, 2011). "Towards Virtualized Networking for the Cloud". VMware. Archived from the original on 2011-09-12. Retrieved 2013-02-25.
- ^ "Configuring VXLANs" (PDF). Cisco. Retrieved 2024-04-17.
- ^ Andre Pech (2013-11-08). "Running OpenStack over a VXLAN Fabric" (PDF). openstack.org. pp. 8, 12. Retrieved 2016-07-04.
- ^ "Open vSwitch Manual: vtep – hardware_vtep database schema". openvswitch.org. Retrieved 2016-07-04.
- ^ "Arista Expands Leaf Switch Product Portfolio" (Press release). Arista Networks. 22 October 2014. Retrieved 8 November 2014.
Arista's updated VXLAN implementation eliminates the need for multicast in the underlay network by using Head End Replication for forwarding broadcast, multicast and unknown unicast traffic
- ^ Timothy Prickett Morgan (30 August 2011). "VMware, Cisco stretch virtual LANs across the heavens". The Register. Retrieved 2013-02-25.
- ^ "VXLAN Bridges Virtual and Physical Networks to the Cloud" (PDF). Retrieved 2013-12-01.
- ^ "Huawei CE12800 Series Data Center Switches - Huawei products". Huawei. December 2012.
- ^ Timothy Pricket Morgan (April 23, 2013). "Mellanox adds VM-flitting to ConnectX-3 adapters - Going Pro with VXLAN". The Register.
- ^ a b M. Mahalingam; D. Dutt; K. Duda; P. Agarwal; L. Kreeger; T. Sridhar; M. Bursell; C. Wright (August 2014). Virtual eXtensible Local Area Network (VXLAN). Internet Engineering Task Force. doi:10.17487/RFC7348. ISSN 2070-1721. RFC 7348. Informational.
- ^ "FreeBSD 10.2-RELEASE Release Notes". The FreeBSD Project. Retrieved 30 June 2016.
- ^ Reyk Floeter (October 14, 2013). "OpenBSD vxlan implementation". Reyk Floeter. Archived from the original on October 29, 2014. Retrieved October 14, 2013.
- ^ "Linux Virtual eXtensible Local Area Networking documentation". Linux Kernel documentation. Retrieved Sep 4, 2025.
- ^ M. Mahalingam (February 22, 2013). "What Is VXLAN". Huawei. Retrieved 2013-02-25.
External links
[edit]- VXLAN Deep Dive: Part 1 and Part 2, November 2012, by Joe Onisick
Virtual Extensible LAN
View on Grokipediafrom Grokipedia
Virtual Extensible LAN (VXLAN) is a network virtualization technology that overlays Layer 2 Ethernet networks over an underlying Layer 3 IP infrastructure, enabling the creation of virtualized network segments in large-scale environments such as data centers.[1] It achieves this by encapsulating original Ethernet frames within UDP packets, which are then routed across IP networks using VXLAN Tunnel End Points (VTEPs) located on hypervisors or network devices to handle encapsulation and decapsulation.[1] This approach allows virtual machines (VMs) in different physical locations to communicate as if connected on the same local area network, while preserving Layer 2 semantics like MAC addressing.[1]
VXLAN was developed to overcome the scalability limitations of traditional VLANs, which are restricted to 4094 identifiers under the IEEE 802.1Q standard due to their 12-bit field.[2] In contrast, VXLAN employs a 24-bit VXLAN Network Identifier (VNI) to support up to 16 million unique network segments, facilitating multi-tenancy, isolation of tenant traffic, and efficient resource utilization in virtualized and cloud computing setups.[1] Key benefits include support for live VM migration (such as VMware vMotion) without IP address changes or subnet constraints, and the ability to leverage existing IP multicast or unicast mechanisms for broadcast, unknown unicast, and multicast (BUM) traffic handling, thereby reducing the flood domain size and improving performance in east-west data flows.[3]
Initiated around 2011 by a collaboration of industry leaders including Arista, Broadcom, Cisco, Citrix, Intel, Red Hat, and VMware to address growing demands for flexible data center networking, VXLAN gained formal standardization through RFC 7348, published by the Internet Engineering Task Force (IETF) in August 2014.[4] Since then, it has seen widespread adoption in software-defined networking (SDN) architectures, particularly when combined with BGP Ethernet VPN (EVPN) for control plane functions, enabling dynamic MAC and IP address learning across distributed environments.[5] Major implementations appear in hypervisors like VMware vSphere, open-source projects such as Open vSwitch, and hardware from vendors including Cisco, Juniper, and Arista, making VXLAN a cornerstone for scalable, multi-tenant cloud infrastructures.[3]
Overview
Definition and Purpose
Virtual Extensible LAN (VXLAN) is a network virtualization technology that serves as an encapsulation protocol for extending Layer 2 Ethernet networks over an underlying Layer 3 IP infrastructure, utilizing UDP tunneling to encapsulate MAC frames within IP packets.[1] This design enables the creation of virtualized Layer 2 overlays, allowing virtual machines (VMs) and other endpoints to communicate as if they were on the same local network segment, even when separated by routed IP networks.[1] The primary purpose of VXLAN is to overcome the scalability limitations of traditional VLANs, which are restricted to a maximum of 4094 unique identifiers due to the 12-bit VLAN ID field in the 802.1Q header.[1] By employing a 24-bit Virtual Network Identifier (VNI) within its encapsulation header, VXLAN supports up to 16 million distinct logical network segments, facilitating large-scale network virtualization without the constraints of physical Layer 2 boundaries.[1] This expansion is particularly essential in modern data centers, where the proliferation of virtualized workloads demands flexible segmentation to isolate traffic efficiently. In multi-tenant cloud and data center environments, VXLAN plays a crucial role in enabling network segmentation for diverse tenants, ensuring isolation of broadcast domains and unicast traffic while optimizing resource utilization across distributed infrastructure.[1] It operates on the principle of overlay networks, where the VXLAN overlay provides virtualized Layer 2 connectivity atop a physical Layer 3 underlay network, using tunnel endpoints to manage the encapsulation and decapsulation processes without altering the underlay's routing fabric.[1] This separation allows administrators to scale and manage virtual networks independently of the underlying physical topology, supporting dynamic workload mobility and enhanced security through tenant-specific isolation.[1]Key Features and Benefits
Virtual Extensible LAN (VXLAN) employs a 24-bit Virtual Network Identifier (VNI) that enables segmentation of up to 16 million unique virtual networks, vastly surpassing the 4094-limit of traditional VLANs and addressing scalability challenges in large-scale data centers.[1] This feature allows for fine-grained isolation of tenant networks without the constraints of Layer 2 broadcast domains. Additionally, VXLAN uses UDP-based encapsulation to transport Layer 2 frames over IP networks, leveraging the standard UDP port 4789 for seamless integration with existing infrastructure.[1] For handling broadcast, unknown unicast, and multicast (BUM) traffic, VXLAN supports multicast group discovery mechanisms, such as PIM-SM, or unicast head-end replication (HER) to efficiently replicate packets across the overlay without flooding the underlay network.[1] The primary benefits of VXLAN include enhanced scalability in virtualized environments by overlaying Layer 2 networks over a robust Layer 3 underlay.[1] This design facilitates seamless mobility of virtual machines across physical hosts and subnets, preserving their IP addresses and network configurations without requiring reconfiguration or address changes.[1] Furthermore, by operating over IP, VXLAN reduces dependency on the Spanning Tree Protocol (STP), mitigating its limitations in large topologies such as slow convergence and restricted scalability, while leveraging the inherent loop prevention of Layer 3 routing.[1] Quantitatively, VXLAN's 16 million segment capacity provides orders-of-magnitude improvement over VLANs, enabling massive multi-tenancy in cloud data centers.[1] VXLAN integrates effectively with Software-Defined Networking (SDN) frameworks, allowing dynamic provisioning and orchestration of overlay networks through centralized controllers that automate tenant isolation and policy enforcement.[1]Technical Fundamentals
Encapsulation and VTEPs
In VXLAN, the encapsulation process involves wrapping an original Ethernet frame in multiple outer headers to form an overlay tunnel across an underlay IP network. At the ingress VTEP, the inner Ethernet frame—carrying the original Layer 2 payload—is prepended with a VXLAN header, a UDP header (using port 4789), an outer IP header, and an outer Ethernet header. This creates a tunneled packet that traverses the underlay network as standard IP traffic, preserving the Layer 2 semantics of the original frame while enabling scalability beyond traditional VLAN limitations. Upon reaching the egress VTEP, the outer headers are stripped away, and the inner frame is forwarded to the appropriate local endpoint.[1] The VXLAN Tunnel End Point (VTEP) serves as the critical ingress and egress point for this encapsulation and decapsulation process. VTEPs can be implemented in hardware on network switches or in software within hypervisors on virtualized servers, where they manage the tunneling of traffic between virtual machines or endpoints. Key functions include learning MAC address mappings to remote VTEP IP addresses, performing the header additions and removals, and ensuring traffic isolation across different overlay segments using the 24-bit VXLAN Network Identifier (VNI). The VNI provides segmentation similar to VLAN IDs but supports up to 16 million unique networks.[1] For broadcast, unknown unicast, and multicast (BUM) traffic, VXLAN relies on mechanisms to flood packets efficiently across the overlay without flooding the entire underlay. In the standard multicast-based approach, each VNI is mapped to a specific IP multicast group, and the ingress VTEP sends BUM packets to that group using protocols like PIM-Sparse Mode (PIM-SM); remote VTEPs joined to the group then decapsulate and forward the traffic locally. Alternatively, in environments using Ethernet VPN (EVPN), BUM traffic can be handled via unicast replication, where the ingress VTEP (or provider edge device) replicates and sends individual unicast packets to each remote VTEP's IP address, avoiding the need for underlay multicast but potentially increasing bandwidth usage.[1][6] The underlay network supporting VXLAN must provide reliable IP connectivity between VTEPs, typically over IPv4 or IPv6, to ensure seamless tunnel operation. A key consideration is the Maximum Transmission Unit (MTU), as VXLAN encapsulation adds approximately 50 bytes of overhead to the original frame; to avoid fragmentation and performance degradation, the underlay MTU should be at least 1550 bytes when supporting standard 1500-byte Ethernet payloads. VTEPs are not permitted to fragment packets, so proper MTU configuration across the path is essential for end-to-end delivery.[1][7]Header Structure and Packet Format
The VXLAN encapsulation adds an outer header stack to the original Ethernet frame to enable transport over an IP network. The outer headers consist of an Ethernet header (14 bytes, optionally 18 with VLAN tagging), followed by an IP header (20 bytes for IPv4 or 40 bytes for IPv6), and a UDP header (8 bytes) with a destination port of 4789, which is the IANA-assigned port for VXLAN traffic.[1] The source UDP port is typically dynamically assigned based on a hash of the inner packet to support entropy for load balancing.[1] The core of the encapsulation is the 8-byte VXLAN header, inserted immediately after the UDP header. This header begins with an 8-bit flags field, where the I-bit (bit 6, value 1) indicates a valid VNI follows, and the remaining 7 bits are reserved and set to 0.[1] Following the flags is the 24-bit VXLAN Network Identifier (VNI), which uniquely identifies the virtual network segment (supporting up to 16 million segments), followed by a 32-bit reserved field set to 0.[1] The inner payload is the original Ethernet frame, including source and destination MAC addresses, optional 802.1Q VLAN tag, Ethertype, and the higher-layer payload, but excluding the frame check sequence (FCS) to avoid duplication.[1] The full VXLAN packet structure thus sequences as: outer Ethernet header → outer IP header → outer UDP header → VXLAN header → inner Ethernet frame. This encapsulation introduces approximately 50 bytes of overhead for IPv4 unicast traffic (14-byte Ethernet + 20-byte IP + 8-byte UDP + 8-byte VXLAN), increasing to about 70 bytes for IPv6.[1] For extensibility beyond Ethernet payloads, VXLAN-GPE (Generic Protocol Extension) modifies the header to support protocols like IPv4 or IPv6 directly. It reuses the 8-byte structure but repurposes reserved bits: adding a 2-bit version field (initially 0), a P-bit for indicating a next protocol field (8 bits identifying payload type, e.g., 0x03 for Ethernet), a B-bit for broadcast/unknown/multicast traffic, an O-bit for operations/administration/maintenance (OAM) packets, and an instance bit, while retaining the 24-bit VNI and reserving the rest to 0; it uses UDP port 4790.[8]History and Development
Origins and Initial Development
The development of Virtual Extensible LAN (VXLAN) originated in the early 2010s as a collaborative effort among key industry players, including VMware, Arista Networks, and Cisco, to address the scalability challenges posed by rapid server virtualization in data centers. The surge in virtual machines (VMs) created demands for far more than the 4096 network segments supported by traditional IEEE 802.1Q VLANs, while also requiring the extension of Layer 2 connectivity over Layer 3 networks to enable VM mobility across geographically distributed sites for cloud providers and enterprises. This was particularly critical for multi-tenant environments, where elastic provisioning and isolation of resources were essential, but existing technologies like Spanning Tree Protocol struggled with loop prevention and MAC address table limitations in top-of-rack switches.[9][10] The foundational specification emerged from pre-standardization work, culminating in the first experimental Internet-Draft published on August 26, 2011, authored by M. Mahalingam and T. Sridhar (VMware), D. G. Dutt and L. Kreeger (Cisco), K. Duda (Arista), P. Agarwal (Broadcom), M. Bursell (Citrix), and C. Wright (Red Hat). This draft proposed VXLAN as a UDP-based encapsulation protocol to create overlay networks, allowing up to 16 million unique identifiers (VNIs) for virtual segments while tunneling Ethernet frames across IP underlays without altering the underlying physical infrastructure. The initiative was motivated by the need to decouple network identity from physical location, facilitating seamless workload migration in virtualized setups.[9][11] Early prototypes focused on integrating VXLAN into existing platforms for proof-of-concept testing and interoperability. VMware began incorporating VXLAN into its vSphere and nascent NSX networking suite around 2011-2012, enabling features like live VM migration (vMotion) over Layer 3 boundaries to support dynamic cloud scaling. Arista Networks demonstrated hardware-based VXLAN termination in its EOS on the 7500 Series switches at VMworld 2012, leveraging VTEPs for efficient encapsulation and bridging in virtualized environments. Cisco introduced VXLAN support in its Nexus 1000V virtual switch in January 2012, followed by hardware integration in the Nexus 9000 series, allowing initial vendor collaborations to validate multi-tenant isolation and performance before broader IETF engagement.[10][12][13] These efforts involved iterative draft proposals and joint interoperability testing among the vendors, ensuring VXLAN's design prioritized openness and scalability for emerging cloud architectures without relying on proprietary extensions.[9]Standardization Process
The standardization of Virtual Extensible LAN (VXLAN) progressed through the efforts of the Internet Engineering Task Force (IETF), particularly via the Network Virtualization Overlays (NVO3) Working Group, which was chartered in 2012 to develop protocols and extensions for network virtualization in data center environments.[14] This group emerged from a Birds of a Feather (BoF) session held at IETF 80 in March 2011, focusing on overlay technologies to support scalable multi-tenant virtualization over Layer 3 networks. Key milestones in the process included the submission of early individual Internet-Drafts in late 2011, with significant revisions and community feedback occurring throughout 2012 as the proposals aligned with NVO3 objectives.[15] These drafts built on vendor prototypes to propose VXLAN as a UDP-based encapsulation method addressing VLAN limitations. The culmination of this phase was the publication of RFC 7348 in August 2014, an informational document authored by a team from VMware, Cisco, and other contributors, which defined the core VXLAN protocol, including its 24-bit Virtual Network Identifier (VNI) for up to 16 million segments and encapsulation over UDP port 4789. Following RFC 7348, the NVO3 Working Group and related IETF activities advanced VXLAN through targeted updates for enhanced functionality and deployment. RFC 8365, published in May 2018 by the BESS Working Group, integrated VXLAN with Ethernet VPN (EVPN) as a network virtualization overlay solution, providing detailed guidance on multicast considerations such as ingress replication for BUM traffic to avoid dependency on underlay multicast infrastructure. Ongoing NVO3 efforts include the development of VXLAN-GPE, outlined in draft-ietf-nvo3-vxlan-gpe (version 13, last updated November 2023; expired without becoming an RFC as of 2025), which extends the VXLAN header to support additional next protocols like IPv4/IPv6 and Ethernet, along with metadata options for policy enforcement.[16] Throughout the process, contributions from original VXLAN developers at VMware and Cisco, combined with broader industry input from entities like Arista Networks and Juniper Networks, emphasized interoperability testing and refinements to ensure VXLAN's compatibility across hardware and software platforms.[17] This collaborative approach, including design team reviews within NVO3, addressed gaps in scalability and extensibility identified during draft iterations.Implementations
Commercial Solutions
Cisco Systems has been a pioneer in commercial VXLAN implementations, integrating the technology into its Nexus 9000 series switches since 2013 as part of the Application Centric Infrastructure (ACI) framework, with enhanced support for Ethernet VPN (EVPN) control plane introduced in 2015 to enable scalable multi-tenant overlays.[18][19] These solutions leverage hardware-accelerated ASICs in Nexus switches for high-performance encapsulation and decapsulation, supporting up to 16 million segments via 24-bit VNIs, and integrate seamlessly with the ACI SDN controller for policy-based automation and orchestration.[20] Security enhancements include CloudSec for 256-bit AES-GCM encryption of inter-site VXLAN traffic in multi-site fabrics, ensuring confidentiality without impacting throughput.[21] VMware's NSX-T platform, evolving from NSX-V introduced in 2013, employs VXLAN for hypervisor-based VTEPs on ESXi hosts, enabling software-defined overlays that abstract Layer 2 networks over Layer 3 underlays for virtualized data centers.[22][23] NSX-T's integration with its central management and control plane allows dynamic VTEP provisioning and load balancing, with hardware offload support on compatible NICs for reduced CPU overhead in high-density environments.[24] Unique to VMware's offering is tight coupling with vSphere for micro-segmentation and distributed firewalling, extending VXLAN tunnels across hybrid clouds while supporting encryption via IPsec for secure overlays.[25] Huawei's CloudFabric solution incorporates VXLAN within its data center fabric architecture, deploying VTEPs on CloudEngine switches since around 2016 to support lossless Ethernet for AI and cloud workloads.[26] The platform uses iMaster NCE-Fabric as an SDN controller for automated VXLAN provisioning, BGP-EVPN signaling, and intent-based networking, optimizing for ultra-low latency in large-scale deployments.[27] Commercial distinctions include hardware acceleration via custom ASICs for VXLAN routing at wire speeds and built-in security features like IPsec encryption for VXLAN traffic in multi-tenant scenarios.[28] Arista Networks provides VXLAN support in its EOS-based switches, such as the 7050X and 7280R series, enabling overlay networks with EVPN control plane for data center fabrics since the early 2010s. Arista's implementation emphasizes high-scale routing and multicast optimization for BUM traffic, integrating with their CloudVision platform for management and analytics in multi-tenant environments.[10] Juniper Networks integrates VXLAN into its QFX and MX series devices, supporting both static and EVPN-based configurations for Layer 2 extensions over Layer 3 networks. Introduced in Junos OS releases around 2014, Juniper's solutions feature hardware-accelerated VTEPs and interoperability with SDN controllers like Contrail (now Mist AI-driven), facilitating scalable virtualization in enterprise and service provider data centers.[2] Adoption of commercial VXLAN solutions has surged in hyperscale environments, with technologies akin to VXLAN underpinning Amazon Web Services (AWS) Virtual Private Cloud (VPC) overlays for traffic mirroring and segmentation since 2019, facilitating scalable isolation across global regions.[29] Post-2020 enhancements have focused on edge computing, including 5G environments, where vendors like Huawei and Cisco support VXLAN for scalable overlays in distributed deployments. For instance, Cisco's 2024 configuration guides detail VXLAN EVPN setups for multi-site fabrics, emphasizing resilient any-to-any connectivity with integrated analytics via Nexus Dashboard.[30]Open-Source Projects
The Linux kernel has provided native support for VXLAN since version 3.7, released in 2012, enabling the creation of VXLAN tunnel endpoints (VTEPs) directly within the operating system. This integration allows for efficient encapsulation of Ethernet frames over UDP without requiring additional user-space software for basic functionality. Configuration of VTEPs and VXLAN interfaces is facilitated by tools in the iproute2 suite, such as theip link add type vxlan command, which supports parameters for VNI assignment, remote endpoints, and learning modes. Recent enhancements in kernel versions 6.x, including improved support for EVPN integration through extended Netlink attributes, have optimized VXLAN handling for dynamic control planes in large-scale deployments.
Open vSwitch (OVS), an open-source multilayer virtual switch designed for software-defined networking (SDN), incorporates robust VXLAN tunneling capabilities to extend Layer 2 domains across distributed environments.[31] OVS supports VXLAN as a primary overlay protocol, allowing automated tunnel creation between hypervisors or hosts via OpenFlow controllers, which is essential for SDN architectures in virtualized data centers.[31] Similarly, Free Range Routing (FRR), a suite of routing daemons, provides BGP-EVPN control plane support for VXLAN, enabling MAC and IP address learning, route advertisement, and multi-tenancy through standards-compliant EVPN Type-2 and Type-3 routes.[32]
Community-driven development of VXLAN has been advanced through contributions to the IETF, where the core protocol was standardized in RFC 7348, and via the Linux Foundation's networking projects, which foster interoperability and performance improvements.[33] Testing frameworks like OFTest, originally developed for OpenFlow validation, have been adapted by the community to verify VXLAN behavior in OVS-based setups, ensuring compliance with encapsulation and forwarding requirements.
Since 2020, VXLAN integration has expanded into container orchestration ecosystems, particularly through Kubernetes Container Network Interface (CNI) plugins such as Multus, which acts as a meta-plugin to attach multiple networks—including VXLAN overlays—to pods for hybrid cloud-native and virtualized workloads.[34] This enables fine-grained control over pod networking, such as delegating VXLAN tunnels to secondary interfaces managed by plugins like OVS-CNI, supporting scalable microservices deployments post-2020.[35]
Standards and Specifications
Primary RFCs and Protocols
The primary specification for Virtual Extensible LAN (VXLAN) is defined in RFC 7348, published in August 2014, which outlines a framework for overlaying virtualized Layer 2 networks over Layer 3 infrastructure.[1] This RFC specifies VXLAN encapsulation, where Ethernet frames are tunneled within UDP/IP packets, using a standardized UDP destination port of 4789 and a 24-bit VXLAN Network Identifier (VNI) to segment up to 16 million isolated networks.[1] It emphasizes UDP for its simplicity and compatibility with existing network hardware, while supporting both IPv4 and IPv6 as outer headers to enable deployment over diverse underlay networks.[1] Related RFCs extend VXLAN's functionality through control plane mechanisms and advanced features. RFC 7432, published in February 2015, introduces BGP MPLS-Based Ethernet VPN (EVPN), providing a standardized control plane for discovering and advertising MAC addresses and VNIs across provider edge devices, initially focused on MPLS but adaptable to VXLAN overlays.[36] Building on this, RFC 8365 from May 2018 details EVPN as a Network Virtualization Overlay (NVO3) solution, explicitly integrating VXLAN for data plane encapsulation and using BGP to distribute reachability information without relying solely on data plane learning.[6] VXLAN interacts with several protocols to form complete overlay networks. It integrates with BGP via EVPN for overlay control plane operations, enabling dynamic endpoint discovery and route advertisement, while the underlay relies on standard IP routing protocols.[6] For handling broadcast, unknown unicast, and multicast (BUM) traffic in early deployments, VXLAN uses IP multicast groups mapped to VNIs, requiring underlay support from protocols like Protocol Independent Multicast (PIM) in sparse or source-specific modes.[1] Subsequent RFCs address VXLAN's initial limitations, particularly its dependency on multicast for efficient BUM traffic distribution, which could strain non-multicast-enabled underlays. RFC 8365 mitigates this by supporting ingress replication—where the ingress VTEP replicates packets unicast to remote VTEPs listed in EVPN Inclusive Multicast Ethernet Tag (IMET) routes—alongside optional PIM-based multicast, thus enhancing scalability in unicast-only environments.[6]Interoperability and Extensions
One key interoperability challenge in VXLAN deployments involves VTEP discovery, which can be achieved dynamically through protocols like BGP-EVPN for scalable, protocol-based remote VTEP learning, or via static configuration for simpler environments without a control plane.[37][38] In multi-vendor setups, such as between Cisco NX-OS and Juniper Junos OS, BGP-EVPN configurations may lead to route invalidation if next-hop addresses differ—Junos uses the VTEP source IP, while NX-OS expects the physical interface IP—requiring policy adjustments like setting the next-hop to the VTEP IP on Junos with vpn-apply-export.[39] Another common issue is handling MTU mismatches in VXLAN tunnels, where the overhead from encapsulation (typically 50 bytes) can fragment packets if underlay MTUs are not adjusted to at least 1550 bytes, necessitating Path MTU Discovery (PMTUD) enablement via configurations like ip unreachables on uplinks.[40][39] VXLAN extensions enhance its flexibility beyond the core encapsulation defined in RFC 7348.[41] An IETF draft for VXLAN-GPE introduces a "Next Protocol" field to support diverse payloads like IPv4, IPv6, Ethernet, or Network Service Header (NSH), along with bits for OAM signaling and ingress-replicated BUM traffic, enabling multi-protocol overlays and service chaining in data centers.[17] Integration with SRv6 for segment routing allows seamless handoff at data center interconnects, where EVPN routes are imported into VRFs and mapped to SRv6 SIDs via BGP address families, supporting traffic engineering across VXLAN fabrics and SRv6 cores without packet loss.[42] Testing and certification efforts ensure VXLAN reliability across vendors, with IETF-backed events like those organized by EANTC demonstrating multi-vendor compatibility. Multi-vendor interoperability for EVPN-VXLAN has been validated in EANTC events, including demonstrations by vendors such as Juniper in 2023 and 2025.[43][44] As of 2025, VXLAN's future directions emphasize alignment with 5G and edge computing standards to support low-latency, sliced networks. Enhancements focus on programmable data planes for 5G edge data centers, where VXLAN enables network slice isolation via NFV and edge tools, reducing latency for applications like AI-driven services.[45][46]Alternative Technologies
Limitations of Traditional VLANs
Traditional Virtual Local Area Networks (VLANs), defined by the IEEE 802.1Q standard, utilize a 12-bit VLAN Identifier (VID) field in Ethernet frames to tag traffic, enabling up to 4094 unique VLANs (values 1 to 4094, with 0 reserved for priority-tagged null frames and 4095 for implementation-specific use).[47] Each VLAN functions as a separate broadcast domain, logically segmenting the network to contain broadcast traffic within defined groups of devices. However, in large-scale networks, this structure leads to challenges, as expanding broadcast domains beyond recommended sizes—such as exceeding 1024 hosts per domain—amplifies broadcast storms and degrades performance due to excessive flooding of unknown unicast, multicast, and broadcast packets across all ports in the domain.[48] A primary limitation arises in virtualized environments, where rapid proliferation of virtual machines (VMs)—often termed VM or VLAN sprawl—quickly exhausts the 4094 VLAN limit, resulting in increased broadcast traffic and management complexity across data centers hosting thousands of VMs.[49][50] Additionally, traditional VLANs are inherently Layer 2 constructs confined to a single broadcast domain, making it difficult to extend them across Layer 3 boundaries without implementing inter-VLAN routing via protocols like those supported in Cisco IOS, which introduces configuration overhead, potential single points of failure at routers or Layer 3 switches, and scalability issues in multi-site or routed topologies. In data centers characterized by high east-west traffic—server-to-server communications within the same facility—VLANs exacerbate inefficiencies through frequent flooding of frames to all ports in a VLAN when destination MAC addresses are unknown, consuming significant bandwidth and straining switch resources.[51] The reliance on Spanning Tree Protocol (STP) to prevent loops further compounds this, as STP's convergence times (up to 50 seconds in basic implementations) and per-VLAN instance overhead limit fault domains and introduce delays unsuitable for dynamic, high-volume environments, often leading to suboptimal topologies and increased latency during failures.[52] Prior to 2010, network operators heavily depended on VLANs for segmentation, prompting the development of proprietary and standardized extensions to mitigate the 4094-tag constraint, such as IEEE 802.1ad (Provider Bridges), ratified in 2005, which introduced double tagging (Q-in-Q) to stack an additional service provider VLAN tag atop the customer tag, effectively expanding the addressable space for service providers while preserving backward compatibility with 802.1Q.[53][54]Other Network Virtualization Methods
Network Virtualization using Generic Routing Encapsulation (NVGRE) is a tunneling protocol primarily associated with Microsoft environments, such as Hyper-V, that leverages Generic Routing Encapsulation (GRE) over IP to enable multi-tenant network virtualization in data centers.[55] It incorporates a 24-bit Virtual Subnet ID (VSID) within the GRE key extension to segment virtual networks, allowing up to 16 million unique identifiers for scalability across Layer 3 underlays.[55] While NVGRE provides lower encapsulation header overhead compared to UDP-based alternatives—typically around 28 bytes for the IP and GRE components—it incurs higher processing demands in some hardware due to limited support for GRE offloading and lacks the entropy from UDP ports, reducing flexibility for equal-cost multipath (ECMP) routing and load balancing.[55][56] Generic Network Virtualization Encapsulation (Geneve), standardized by the IETF in RFC 8926, serves as a unified and extensible alternative for overlay networks, using UDP over IPv4 or IPv6 with a compact 8-byte base header on port 6081.[57] Its key innovation lies in the variable-length Type-Length-Value (TLV) options field following the base header, which supports the insertion of arbitrary metadata (up to 260 bytes total header size (8-byte base plus up to 252 bytes of options)) for advanced features like service chaining or security policies without protocol redesign.[57] This extensibility positions Geneve as more future-proof than VXLAN's rigid 8-byte fixed header, enabling seamless adaptation to evolving control planes and hardware accelerations while maintaining compatibility with existing IP fabrics through UDP source port entropy for ECMP.[57] Geneve's design also facilitates interoperability among diverse virtualization technologies by accommodating capabilities from predecessors like VXLAN and NVGRE.[57] Stateless Transport Tunneling (STT), originally proposed by Nicira (later acquired by VMware), represents an early UDP-based approach to network virtualization outlined in an expired IETF Internet-Draft from 2013.[58] STT encapsulates Ethernet frames using a TCP-like header structure to exploit NIC offloads such as TCP Segmentation Offload (TSO) and Large Receive Offload (LRO), aiming for high-throughput performance in hypervisor environments with minimal state maintenance at endpoints.[58] It features a 64-bit Context ID for network identification, supporting larger segment sizes up to 64 KB, but has achieved limited adoption due to the lack of standardization and the rise of more versatile protocols.[58] In contemporary VMware NSX deployments, STT has been overshadowed by Geneve, rendering it effectively deprecated for new implementations.[59] The following table summarizes key differences among these methods and VXLAN in terms of design trade-offs:| Protocol | Encapsulation Overhead (bytes, approx. tunnel header) | Scalability (Network ID bits) | Native Control Plane Support |
|---|---|---|---|
| VXLAN | 36 (IP + UDP + header) | 24 (16M segments) | EVPN (RFC 7432), multicast [1] |
| NVGRE | 28 (IP + GRE + key) | 24 (16M segments) | None; relies on external mechanisms [55] |
| Geneve | 36+ (IP + UDP + header + TLV options, min. 36) | 24 (VNI) + extensible options | EVPN compatible [57][60] |
| STT | 46 (IP + UDP + header) | 64 | None [58] |