Hubbry Logo
Slab allocationSlab allocationMain
Open search
Slab allocation
Community hub
Slab allocation
logo
7 pages, 0 posts
0 subscribers
Be the first to start a discussion here.
Be the first to start a discussion here.
Contribute something
Slab allocation
Slab allocation
Slab allocation
View on Wikipedia
from Wikipedia

Slab allocation is a memory management mechanism intended for the efficient memory allocation of objects. In comparison with earlier mechanisms, it reduces fragmentation caused by allocations and deallocations. This technique is used for retaining allocated memory containing a data object of a certain type for reuse upon subsequent allocations of objects of the same type. It is analogous to an object pool, but only applies to memory, not other resources.

Slab allocation was first introduced in the Solaris 2.4 kernel by Jeff Bonwick.[1] Bonwick claims the name "Slab" comes from a Kellogg's cereal commercial catchphrase rhyme, "grab a slab".[2]

Slab allocation is now widely used by many Unix and Unix-like operating systems including FreeBSD[3] and Linux,[4] both in the SLAB allocator and its replacement, SLUB.[5]

Basis

[edit]

Slab allocation significantly reduces the frequency of computationally costly initialization and destruction of kernel data-objects, which can outweigh the cost of allocating memory for them.[1] When the kernel creates and deletes objects often, overhead costs of initialization can result in significant performance drops. Object caching leads to less frequent invocation of functions which initialize object state: when a slab-allocated object is released after use, the slab allocation system typically keeps it cached (rather than doing the work of destroying it) ready for re-use next time an object of that type is needed (thus avoiding the work of constructing and initialising a new object).

With slab allocation, a cache for a certain type or size of data object has a number of pre-allocated "slabs" of memory; within each slab there are memory chunks of fixed size suitable for the objects.[6] The slab allocator keeps track of these chunks, so that when it receives a request to allocate memory for a data object of a certain type, usually it can satisfy the request with a free slot (chunk) from an existing slab. When the allocator is asked to free the object's memory, it just adds the slot to the containing slab's list of free (unused) slots. The next call to create an object of the same type (or allocate memory of the same size) will return that memory slot (or some other free slot) and remove it from the list of free slots. This process eliminates the need to search for suitable memory space and greatly alleviates memory fragmentation. In this context, a slab is one or more contiguous pages in the memory containing pre-allocated memory chunks.

Implementation

[edit]

The slab allocation algorithm defines the following terms:

  1. Cache: cache represents a small amount of very fast memory. A cache is a storage for a specific type of object, such as semaphores, process descriptors, file objects, etc.
  2. Slab: slab represents a contiguous piece of memory, usually made of several virtually contiguous pages. The slab is the actual container of data associated with objects of the specific kind of the containing cache.

When a program sets up a cache, it allocates a number of objects to the slabs associated with that cache. This number depends on the size of the associated slabs.

Slabs may exist in one of the following states:

  1. empty – all objects on a slab marked as free
  2. partial – slab consists of both used and free objects
  3. full – all objects on a slab marked as used

Initially, the system marks each slab as "empty". When the process calls for a new kernel object, the system tries to find a free location for that object on a partial slab in a cache for that type of object. If no such location exists, the system allocates a new slab from contiguous virtual pages and assigns it to a cache. The new object gets allocated from this slab, and its location becomes marked as "partial".

The allocation takes place quickly, because the system builds the objects in advance and readily allocates them from a slab.

Implementation techniques

[edit]

Free lists

[edit]

A slab represents one memory allocation to the cache from the machine, and whose size is customarily a multiple of the page size. The slab will be divided into a number of entries, which will then be requested by the cache as the client code requests memory for new objects. It is necessary then to keep track of which parts of the slab are free to use and which ones were already occupied. This is generally done using "free lists": lists of free entries in the slab ready to store new objects.

The free list may be a separate data structure, such as an array of indices indicating which entries of the slab are free, or it may be embedded within the slab. The Linux SLUB allocator keeps the free list as a linked list of pointers, each of which is stored directly in the free memory area of the slab they represent.[7]

Slab sizes

[edit]

Operating systems may use different slab sizes and internal layouts depending on the size of the objects to be stored. The reason for the large slabs having a different layout from the small slabs is that it allows large slabs to pack better into page-size units, which helps with fragmentation. For example, objects that are at least 1/8 of the page size for a given machine may benefit from a "large slab" size, with explicit free lists, while smaller objects may use a "small slab" setup, embed the free list tracking. Bonwick's original presentation of the slab allocator already made the distinction of layouts for large and small slabs.[1]

Systems using slab allocation

[edit]

See also

[edit]

Notes

[edit]
[edit]
Revisions and contributorsEdit on WikipediaRead on Wikipedia

Slab allocation

View on Grokipedia
from Grokipedia
Slab allocation is a kernel management mechanism designed to efficiently handle the allocation and deallocation of small, frequently requested objects by maintaining caches of pre-initialized slabs, where each slab consists of one or more contiguous pages divided into fixed-size object slots. This approach minimizes internal fragmentation, reduces the overhead of object initialization on each allocation, and optimizes utilization through techniques like slab coloring, which aligns objects to avoid cache line sharing across slabs. By reusing objects from full, partial, or empty slabs within per-object-type caches, slab allocation enables rapid access to ready-to-use kernel structures such as inodes or descriptors, making it particularly suited for high-frequency, short-lived allocations in operating system kernels. The slab allocator was originally developed by Jeff Bonwick for the 5.4 kernel, as detailed in his 1994 USENIX paper, where it was introduced as an object-caching system to address inefficiencies in traditional memory allocators like the binary buddy system. Bonwick's design emphasized caching frequently used objects in a warm, initialized state to eliminate repetitive setup costs and fragmentation from variable-sized allocations. This innovation was later extended in a 2001 paper by Bonwick and Jonathan Adams, which incorporated magazines for multiprocessor scalability and vmem for managing arbitrary resource arenas beyond physical memory. In the , slab allocation was adapted starting with version 2.2 in 1999, drawing directly from Bonwick's original concepts to provide a general-purpose allocator for kernel objects. originally implemented three variants to suit different system needs: the SLAB allocator, which uses fine-grained slab lists and per-CPU queues for low-latency access; SLUB, a simplified and scalable version that merges slabs into per-CPU partial lists to reduce metadata overhead and improve concurrency on multi-core systems, which became the default in kernel 2.6.23; and SLOB, a minimalistic option for resource-constrained embedded environments that treats as a simple of blocks without dedicated slab structures. However, SLOB was removed in kernel 6.4 (June 2023) and SLAB in kernel 6.8 (March 2024), leaving SLUB as the sole general-purpose slab allocator. Key APIs include kmem_cache_create() for initializing caches, kmem_cache_alloc() and kmem_cache_free() for object handling, and kmem_cache_destroy() for cleanup, all of which support flags for behaviors like high- allocation or debugging. These developments enhance kernel performance by cutting allocation times—often to near-constant O(1) complexity—and mitigating issues like hotplug and NUMA awareness in modern hardware.

Overview and History

Definition and Purpose

Slab allocation is a memory management technique used in operating system kernels to efficiently handle the allocation and deallocation of fixed-size kernel objects. It operates by pre-allocating contiguous blocks of memory known as slabs, which are subdivided into fixed-size chunks tailored to specific object types, thereby enabling the reuse of these objects without the overhead of repeated memory searches or reinitialization. The primary purpose of slab allocation is to minimize the time and space costs associated with frequent object creation and destruction, particularly for complex kernel structures that require initialization of embedded components such as locks or reference counts. By implementing object caching, it retains the state of allocated objects between uses, allowing for rapid servicing of allocation requests from a pre-constructed pool rather than invoking costly dynamic memory operations each time. This approach significantly enhances performance; for instance, the allocation time for stream head objects in 5.4 was reduced from 33 µs to 5.7 µs on a SPARCstation-2. In its high-level workflow, slab allocation maintains dedicated caches for each object type. When a request for an object arrives, it is served directly from the corresponding cache if available; otherwise, a new slab is allocated from the kernel's , populated with the required objects, and added to the cache. Deallocation simply returns the object to the cache without destruction, preserving its initialized state for future reuse, while reclamation mechanisms destroy and free slabs only under pressure. This method is particularly suited to kernel environments with recurring allocations of similar objects, such as inodes for management or task structures for process handling, where grouping allocations by type optimizes both spatial locality and initialization efficiency.

Historical Development

Slab allocation was introduced by Jeff Bonwick at in 1994 as part of the kernel memory allocator for SunOS 5.4, which corresponds to Solaris 2.4. This design replaced the previous System V Release 4 (SVr4)-based allocator, aiming to improve efficiency for kernel object management by using object-caching primitives that minimize initialization overhead and fragmentation. The allocator addressed key limitations of buddy allocators, which were common in Unix kernels of the era, such as external fragmentation and the high cost of object construction and destruction for frequently allocated kernel structures. Its influence spread to other systems in the late ; for instance, incorporated a zone-based allocator in version 3.0 (released in 1998), which was later enhanced to provide slab-like functionality in version 5.0 (2003). In the , the SLAB implementation—directly inspired by Bonwick's work—was integrated starting with Linux 2.2 in 1999, enhancing performance over the prior K&R-style allocator. Subsequent evolutions in Linux included the SLOB variant, a lightweight implementation suited for embedded systems with constrained memory, introduced in 2005. To address scalability issues on multi-processor systems, the SLUB allocator was developed as a simpler, unqueued alternative and became the default in Linux 2.6.23 in October 2007, offering better performance by reducing locking overhead and per-CPU caching. SLUB also incorporated support for huge pages to optimize memory usage in large-scale environments. As of 2025, SLUB remains the primary slab allocator in the , with the original SLAB variant fully removed in kernel version 6.8 (late 2023) and SLOB removed in kernel version 6.4 (mid-2023). Ongoing optimizations focus on multi-core scalability and integration with modern hardware features like huge pages, but no fundamental overhauls have occurred since SLUB's adoption.

Motivations and Problems Addressed

Memory Fragmentation in Traditional Allocators

Traditional kernel memory allocators, such as the commonly used in operating systems, suffer from external fragmentation, where free memory becomes scattered into small, non-contiguous blocks over time due to repeated allocations and deallocations. This scattering prevents the satisfaction of requests for large contiguous regions, even when the total free memory is sufficient, as the merges only adjacent blocks of equal size (powers of two) but fails to coalesce disparate fragments efficiently under heavy workloads. In kernel environments, this issue is exacerbated by long-lived allocations for structures like page tables or I/O buffers, leading to allocation failures and the need for costly memory compaction or reclamation processes. Internal fragmentation in these allocators arises from the allocation of fixed-size blocks that exceed the requested size, resulting in wasted space within each allocated unit. The buddy system's power-of-two block sizes mean that a request slightly larger than half a block size receives the next larger power-of-two block, potentially wasting up to 50% of the space in the worst case, with an expected waste of around 25-28% across allocations. For small kernel objects, such as descriptors or inodes typically under 1 KB, traditional allocators often rounded up to full page sizes (e.g., 4 KB), amplifying internal waste to as much as around 60% per allocation and contributing to overall inefficiency. In high-load kernel scenarios, like those in early and BSD systems, these fragmentation types combined to waste 40-50% of available , as observed in benchmarks such as the kenbus where traditional power-of-two allocators in SVr4 exhibited 46% fragmentation. Frequent small, fixed-size allocations for kernel data structures, such as task control blocks or objects, intensified the problem by creating numerous partially used blocks, increasing allocation failure rates and overhead from frequent searches through free lists. Compared to user-space general-purpose allocators like malloc, which handle variable-sized requests with techniques like binning to mitigate fragmentation, kernel allocators face heightened challenges due to the predictable yet frequent demand for fixed-size objects in a real-time, non-garbage-collected environment, making fragmentation more detrimental to system stability and performance.

Overhead of Object Initialization

In traditional kernel memory allocators, such as those based on sequential-fit or buddy systems, the initialization of each newly allocated object incurs significant computational overhead. This typically involves zeroing out the allocated to ensure and prevent leakage, initializing object-specific fields like locks, pointers, and counters, and linking the object into relevant kernel structures such as lists or hash tables. These steps can consume thousands of CPU cycles per object, often exceeding the costs of the underlying memory allocation itself, as measured in pre-slab implementations where object setup dominated performance profiles. Deallocation introduces comparable overhead through a reverse set of operations, including unlinking the object from data structures, resetting fields to a safe state, and in buddy-based systems, attempting to coalesce freed blocks with adjacent buddies to combat fragmentation. This coalescing step requires searching for matching free blocks and merging them, which adds variable latency depending on the layout and can lead to spikes during allocation bursts when multiple objects are freed concurrently. While fragmentation represents a related issue of spatial inefficiency, the runtime costs of these initialization and deallocation routines primarily manifest as temporal delays in object lifecycle management. A concrete example of this overhead arises in process creation operations, such as the fork() system call in Unix-like kernels, where structures like the task_struct in Linux must be allocated and fully initialized for each new task. This includes copying parent process state, setting up scheduling parameters, and initializing security contexts, which collectively bottleneck system performance under high load, as repeated init/deinit cycles amplify delays in multi-process environments. Kernel objects such as inodes for file system operations or semaphores for synchronization are often short-lived yet requested at high frequency, leading to cumulative overhead that degrades overall throughput in demanding workloads. Prior to the , early kernel designs lacked dedicated object pools or caching mechanisms, relying instead on ad-hoc general-purpose allocators like simple malloc/free implementations integrated with buddy or sequential-fit heuristics. These approaches exacerbated initialization costs in multi-user systems, where concurrent allocations of complex objects—such as or tasks—resulted in unacceptable latency, prompting the development of more efficient strategies to mitigate such inefficiencies.

Core Concepts

Caches and Slabs

In slab allocation, a cache serves as the primary organizational unit for managing objects of a specific type, such as kernel structures like task_struct or inodes. Each cache, often implemented as a kmem_cache in systems like , oversees the lifecycle of multiple slabs dedicated to that object type, maintaining global statistics including total object usage, allocation counts, and configurable growth limits to control expansion. Caches provide a centralized interface for allocation and deallocation requests, ensuring that objects are pre-initialized and readily available to minimize runtime overhead. This design allows for type-specific optimizations, where clients create caches via primitives like kmem_cache_create, specifying parameters such as object size, alignment requirements, and optional constructor functions for initialization. A slab, in contrast, represents a contiguous block of memory pages—typically one or more 4 KB pages in common implementations—partitioned into fixed-size slots tailored to hold objects of a single cache's type. Each slab includes embedded metadata for tracking object availability, such as freelist pointers and usage counters, which enable efficient navigation without external data structures. For instance, a slab for 400-byte objects uses a single 4 KB page to store 10 such objects, resulting in approximately 2.4% internal fragmentation. Slabs are sourced dynamically from a backing memory allocator, such as the buddy system, when a cache requires additional capacity, ensuring they align with the system's page granularity for minimal waste. The relationship between caches and slabs is hierarchical and list-based: a cache maintains separate queues of slabs categorized by their state—full (no free objects), partial (some free objects), and empty (all objects free)—with allocation requests preferentially serviced from partial slabs to maximize reuse and reduce fragmentation. This organization allows caches to grow or shrink by adding or removing slabs as demand fluctuates, while empty slabs can be returned to the backing allocator for reclamation. Object states within slabs, such as allocated or free, are managed internally but contribute to the slab's overall categorization in the cache.

Object Allocation States

In the slab allocation mechanism, objects within a slab progress through distinct lifecycle states that facilitate efficient reuse and minimize initialization overhead. The primary states are unused (free slots available for allocation), allocated (currently in use by the kernel), and partially initialized (pre-configured with common default values at the slab level). Unused objects reside on a free list within their slab, ready for immediate assignment without full reinitialization, while allocated objects are actively referenced by kernel components. The partially initialized state applies to objects that have undergone batch initialization via a constructor function during slab creation, setting shared attributes like zeroed fields or standard metadata to enable rapid deployment. Transitions between these states are designed for speed and simplicity. Upon allocation, an unused or partially initialized object is transitioned to the allocated state with minimal additional setup, such as linking it to the requesting kernel subsystem, avoiding per-allocation constructors. Deallocation reverses this by marking the object as unused, returning it to the free list without invoking a full destructor to preserve its partially initialized form for future use. This approach contrasts with traditional allocators by retaining object state across cycles, reducing latency from costly zeroing or custom setup operations. The benefits of these states stem from the use of optional constructor (ctor) and destructor (dtor) hooks, which are invoked only during slab growth or shrinkage rather than individual allocations. The ctor pre-initializes all objects in a new slab with common defaults, such as clearing sensitive fields, while the dtor performs cleanup only when a slab is fully emptied and returned to the page allocator, ensuring resources like locks are released. This selective invocation cuts initialization costs significantly—for instance, in the original , it reduced head allocation time from 33 μs to 5.7 μs by caching initialized states. By maintaining partially initialized objects, the system avoids redundant zeroing for frequently allocated kernel structures, enhancing throughput in high-demand scenarios. Tracking these states occurs at the object slot level within the slab structure. For small objects, a or embedded pointer (such as a freelist link) indicates the state, utilizing unused space to avoid metadata overhead; larger objects may use a separate buffer control to map indices to free or allocated status. This lightweight mechanism ensures constant-time state queries and updates, integrating seamlessly with the enclosing cache and slab descriptors.

Implementation Details

Slab Creation and Management

Slab creation in the slab allocator is triggered when a cache requires additional objects and has no available partial or full slabs with free space. In this scenario, the allocator invokes a growth function, such as kmem_cache_grow() in implementations like , to request pages from the underlying page allocator (e.g., the ). These pages are then divided into fixed-size objects matching the cache's specifications, with metadata structures initialized to track object locations and states. If a constructor function is provided during cache setup, it is executed for each object to perform initialization, ensuring objects are in a ready state without per-allocation overhead. Management of slabs within a cache involves maintaining lists to categorize them by utilization: full, partial, and free. Policies enforce limits on the total number of slabs per cache to avoid unbounded consumption, often by capping the number of objects or slabs based on system constraints. Shrinking occurs under pressure, where empty (free) slabs are identified and their pages returned to the page allocator via functions like kmem_cache_shrink(), reclaiming contiguous blocks. Growth strategies typically begin with a minimum number of slabs upon cache creation and expand incrementally on demand, such as when the cache's partial slabs are depleted, to balance responsiveness and resource use. Post-creation, objects within new slabs start in a free state, ready for allocation. Error handling during slab creation addresses failures in page allocation, often due to out-of-memory (OOM) conditions. If the page allocator cannot fulfill the request, the operation fails gracefully, with the kernel logging warnings via mechanisms like printk() for debugging OOM killers or resource exhaustion. In such cases, higher-level allocators like kmalloc() may fall back to alternative strategies, such as using larger general-purpose pools, to ensure system stability. For example, in the , the kmem_cache_create() function establishes cache parameters including size, alignment, and constructor, while object allocation routines first attempt to retrieve from partial slabs via get_partial() and, if unsuccessful, trigger new_slab() to create a new one.

Allocation and Deallocation Process

In slab allocation, the process of requesting an individual object from a cache begins by searching the free list of partial slabs within the cache. In implementations with per-CPU caches, such as the , available objects are first checked from the local per-CPU cache to minimize contention in multiprocessor environments. Should partial slabs also lack free objects, a new slab is created and populated with initialized objects, as detailed in slab creation procedures. The selected object is then marked as allocated, and its pointer is returned to the requester. Deallocation reverses this flow by first validating the object's address and cache affiliation to prevent errors. In some implementations like , if a destructor function is registered for the object type, it is invoked to clean up resources before freeing. The object is subsequently added to the appropriate free list, typically the per-CPU freelist for quick reuse or the partial slab's list otherwise. If the slab becomes entirely empty after deallocation, it is marked for potential reclamation under memory pressure, though it may remain in the cache's free slab list for future allocations. To manage concurrency, slab allocators employ cache-wide locks, such as spinlocks, when accessing shared free lists in partial or full slabs. These locks are minimized in per-CPU designs, where local caches allow lock-free operations for most allocations and deallocations on the same processor. The core algorithms can be outlined in as follows: Allocation Pseudocode:

kmem_cache_alloc(struct kmem_cache *cache, int flags) { if (free_object = pop_from_percpu_freelist(cache)) { return free_object; } else if (free_object = pop_from_partial_slab_freelist(cache)) { return free_object; } else { create_new_slab(cache); free_object = pop_from_new_slab_freelist(cache); return free_object; } }

kmem_cache_alloc(struct kmem_cache *cache, int flags) { if (free_object = pop_from_percpu_freelist(cache)) { return free_object; } else if (free_object = pop_from_partial_slab_freelist(cache)) { return free_object; } else { create_new_slab(cache); free_object = pop_from_new_slab_freelist(cache); return free_object; } }

Deallocation Pseudocode:

kmem_cache_free(struct kmem_cache *cache, void *object) { validate_object(cache, object); if (destructor) destructor(object); obj_index = compute_index_in_slab(object); push_to_freelist(cache, obj_index); // To per-CPU or partial slab if (slab_is_empty(cache, slab_of(object))) { mark_slab_for_reclamation(slab_of(object)); } }

kmem_cache_free(struct kmem_cache *cache, void *object) { validate_object(cache, object); if (destructor) destructor(object); obj_index = compute_index_in_slab(object); push_to_freelist(cache, obj_index); // To per-CPU or partial slab if (slab_is_empty(cache, slab_of(object))) { mark_slab_for_reclamation(slab_of(object)); } }

These processes achieve average O(1) due to direct access to freelists and avoidance of linear searches, enabling efficient handling of frequent small-object allocations in kernel environments.

Advanced Techniques

Slab Coloring

Slab coloring is a technique used in the slab allocator to optimize processor cache performance by distributing object es evenly across cache lines, thereby reducing and cache conflicts among concurrently accessed objects. In this approach, each slab is assigned a unique offset, or "color," from its page-aligned base , which shifts the starting positions of objects within the slab. This prevents multiple unrelated objects from mapping to the same cache line, which could otherwise lead to thrashing and increased miss rates in multi-threaded environments like operating system kernels. The method addresses the limitations of traditional power-of-two allocators, which often align objects poorly with cache geometries, leading to suboptimal utilization. Implementation involves calculating the color during slab creation, where the offset is chosen from a sequence of values that fit within the unused space of the slab page. For instance, with 200-byte objects allocated from 4KB pages on systems with 8-byte cache line granularity, colors range from 0 to 64 bytes in 8-byte increments, ensuring that successive slabs use different offsets to spread objects across cache lines. The maximum number of colors is limited by the slab's free space after accounting for object sizes and metadata, and the allocator cycles through these colors for new slabs in a cache. This padding introduces minimal overhead since colors exploit the natural slack in page-sized slabs. The benefits of slab coloring include significant improvements in cache hit rates and overall system throughput, particularly on multiprocessor systems. On the SPARCcenter 2000, it reduced primary cache miss rates by 13% and improved bus balance from 43% to 17% imbalance, while benchmarks showed 5% fewer primary cache misses during parallel kernel builds. These gains stem from better cache line utilization and reduced memory traffic concentration, making it especially effective for kernel workloads with high contention. Slab coloring was introduced in the original 5.4 slab allocator design, tailored for processors to enhance multiprocessor scalability.

Per-CPU Caches

In multi-processor systems, per-CPU caches in slab allocators address issues arising from global lock contention during allocation and deallocation operations. Each CPU maintains a small, local cache consisting of partial slabs or free objects, which is replenished from a global depot or cache only when depleted. This design ensures that most operations occur locally without acquiring shared locks, thereby minimizing inter-CPU communication and cache line bouncing. The mechanism employs a layered approach where the per-CPU cache acts as a fast-access buffer, often implemented as a —a fixed-size or of object pointers per CPU—stocked with pre-allocated items from larger slabs. For allocation, the requesting CPU first attempts to pop an object from its local magazine; if empty, it swaps with a secondary local buffer or fetches a full magazine from the global depot using atomic operations like (cmpxchg) to avoid locks. Deallocation pushes objects back to the local magazine, with overflow items returned to the depot only on imbalance, such as when a CPU's cache exceeds capacity or detects uneven distribution across processors. Object migration between CPUs is rare and triggered solely by such imbalances, preserving locality. This approach yields significant performance benefits, reducing the time spent holding global locks from microseconds to nanoseconds per operation and enabling linear scalability with the number of cores, as demonstrated in benchmarks showing doubled throughput on multi-CPU systems under high load. By localizing access, it also lowers remote and cache miss rates, with empirical results indicating miss rates bounded by the inverse of the magazine size. Tuning of per-CPU caches balances efficiency against memory overhead, typically limiting the cache to 1-2 partial slabs or a small number of objects (e.g., 6-120 depending on object size) per CPU to prevent excessive remote accesses or wasted space on idle processors. Dynamic adjustment of cache sizes, based on contention metrics, further optimizes usage without manual intervention. In the SLUB allocator, per-CPU caches are realized through partial lists embedded in the kmem_cache_cpu structure, where each CPU holds a freelist of objects from an active slab for lockless fast-path operations on supported architectures. When local partial lists overflow or deplete, objects are migrated remotely via atomic exchanges, integrating seamlessly with the broader allocation process. As of October 2025, the (version 6.18) introduced Sheaves, an opt-in per-CPU array-based caching layer for the SLUB allocator that replaces traditional CPU partial slabs. This enhancement aims to reduce overhead in per-CPU operations and improve overall .

Free List Management

In slab allocators, free list management involves tracking and linking unallocated objects within slabs to enable rapid reuse during allocation requests. Each slab maintains its own freelist, which serves as a of available objects, ensuring that allocations and deallocations operate in constant time by simply adjusting pointers and reference counts. This approach preserves object initialization and reduces fragmentation by keeping related objects grouped and ready for immediate use. For small objects—typically those smaller than half the slab size—the freelist pointer is embedded directly within the object itself, often at the end of the buffer, pointing to the next free object in the list. This embedded minimizes metadata overhead by repurposing space in the object for linkage, such as using a kmem_bufctl structure that includes the freelist pointer and buffer . In contrast, larger objects employ a separate , such as an array of indices (kmem_bufctl_t in SLAB implementations) or a , stored either on-slab (within the slab's initial space) or off-slab (in a dedicated cache) to track free object positions without invading object space. For instance, in the original slab design, slabs under 1/8 page use embedded kmem_bufctl for efficiency, while the SLAB allocator uses an on-slab kmem_bufctl_t array for objects under 512 bytes, initializing it as a pseudo-linked list with sequential indices ending in a like BUFCTL_END. Common strategies for freelist organization include LIFO (last-in, first-out), where objects are added and removed from the head of the list for simplicity and cache locality, though FIFO (first-in, first-out) variants exist in some adaptations. In the SLUB allocator, freelists operate at the page level, with metadata embedded in the struct page (using fields like freelist for the head pointer, inuse for allocated count, and offset for pointer placement) and pointers chained through free objects themselves, enabling lockless per-CPU access. Maintenance during operations is straightforward: on deallocation, the object is pushed to the front of the freelist by updating the previous head to point to it, and the reference count is decremented; on allocation, the head is popped, metadata cleared (e.g., zeroing the embedded pointer), and the count incremented, with the slab transitioned to full or empty lists as needed. The original design exemplifies this with each slab holding a freelist head in its kmem_slab structure, while Linux SLAB updates the slab_t->free index to traverse the kmem_bufctl_t array. Optimizations focus on reducing traversal costs and lock contention, such as batching multiple allocations or deallocations to process freelists in bulk before updating cache-wide structures, and efficiently handling transitions between full, partial, and empty slab states via sorted lists or reference counts. For example, SLUB batches freelist transfers to per-CPU structures to avoid frequent locking of the struct page, while the original allocator uses simple pointer swaps for constant-time pushes and pops, reclaiming fully free slabs only under pressure. These techniques ensure scalable performance, with SLAB's array-based indexing allowing O(1) free object lookup regardless of slab fullness.

Variations

Original Slab Allocator

The original slab allocator, introduced by Jeff Bonwick in the 5.4 kernel (later Solaris 2.4), represents a foundational approach to kernel by organizing fixed-size objects into reusable slabs to minimize fragmentation and initialization overhead. This design caches kernel objects such as inodes and structures in dedicated slabs, allowing rapid allocation and deallocation without repeated calls to lower-level allocators. Core features include explicit constructors and destructors to initialize and clean up object state, ensuring that objects are in a valid condition upon allocation and release their resources properly upon deallocation. Additionally, caches enable batch allocations by grouping multiple objects into "magazines" for efficient transfer, serving as a precursor to per-CPU caching mechanisms in later implementations. Slab coloring, tailored for Sun hardware like systems, offsets object placements within slabs to optimize cache line utilization and balance bus traffic, reducing contention on multiprocessor buses. Slabs in this allocator are classified into three types based on their occupancy: full slabs contain all objects allocated, partial slabs have a mix of allocated and free objects managed via per-slab freelists, and empty slabs hold no allocations and await reuse. Magazines facilitate small and full transfers of objects between the kernel's central depot and device drivers or other kernel subsystems, allowing bulk operations to amortize locking costs and improve throughput for high-frequency allocations. The allocator integrates seamlessly with the kmem framework, which handles variable-sized allocations, by dedicating approximately 30 slab caches for common object sizes ranging from 8 bytes to 9 KB. It supports variable slab sizes determined by object alignment requirements, limiting internal fragmentation to at most 12.5% by ensuring slabs are sized as multiples of the power-of-two alignment. Performance optimizations in the original design target uniprocessor (UP) and architectures, employing per-cache locks to serialize access within each object cache while allowing concurrent operations across different caches, which reduced average allocation and free times from 33 µs to 5.7 µs in benchmarks. However, the reliance on global locking for depot operations created a bottleneck in symmetric multiprocessor (SMP) environments, limiting scalability without subsequent modifications. This design laid the groundwork for ports to other systems and enhancements, such as refined magazine mechanisms for better multiprocessor support.

Linux SLAB Allocator

The Linux SLAB allocator was introduced in the Linux kernel version 2.2 in 1999 by Manfred Spraul, who ported and adapted Jeff Bonwick's original slab design from Solaris to suit the x86 architecture and Linux's memory management framework. This implementation replaced the earlier kmalloc allocator, providing a more efficient object-caching mechanism tailored to kernel needs, such as rapid allocation of frequently used structures like inodes and task structs. While drawing from the Solaris primitives for slab caches and freelists, the Linux version incorporated platform-specific optimizations to handle the buddy allocator's page-based allocations and constraints. A key enhancement in the SLAB allocator was the addition of debugging features to detect common errors. Redzoning places guard markers at the boundaries of allocated objects to trap buffer overflows, while fills freed or uninitialized objects with a distinctive (typically 0x5a) to identify invalid accesses. These capabilities are controlled through kmem_cache creation flags, such as SLAB_RED_ZONE for enabling redzoning and SLAB_POISON for , allowing developers to activate them selectively via kernel configuration options like CONFIG_DEBUG_SLAB. Such features proved invaluable for robustness in production kernels, though they incur a performance overhead due to additional checks and metadata. The allocator's structure emphasizes per-CPU efficiency and scalability, particularly in multi-processor environments. Each slab cache maintains per-CPU arrays for local object freelists to minimize contention, supplemented by alien[] arrays that stage remote frees from other CPUs or NUMA nodes, reducing cross-node traffic. For memory accounting in containerized environments, SLAB integrates objcg (object cgroup) support, enabling per-cgroup tracking of slab allocations through the memory control group (memcg) subsystem; this charges individual objects to specific upon allocation, facilitating fine-grained resource limits. Unlike the original Solaris design, which relied on magazines for tiered caching, SLAB uses simpler array-based freelists for free object management, streamlining implementation while integrating with vmalloc for caches involving larger objects that exceed typical page boundaries. By the , the original SLAB allocator had been largely deprecated in favor of the simpler SLUB variant, which became the default in Linux 2.6.23 (2007) due to reduced complexity and better performance on modern hardware. Nonetheless, SLAB remains configurable via the SLAB kernel build option and continues to see use in distributions like SUSE and certain embedded setups where its debugging maturity is preferred.

SLUB Allocator

The SLUB allocator, developed by Christoph Lameter in 2007, was introduced as a streamlined replacement for the SLAB allocator to address its growing complexity and scalability issues in multi-processor environments. It was merged into the with version 2.6.22 in July 2007, becoming the default allocator starting from kernel 2.6.23 due to its simpler codebase and reduced overhead. Unlike its predecessor, which relied on extensive queuing mechanisms, SLUB prioritizes efficiency on modern hardware by minimizing locks and metadata structures, making it particularly suited for high-throughput workloads on multi-core systems. At its core, SLUB manages memory through per-page freelists, where free objects within a slab page are linked directly using pointers stored in the objects themselves, avoiding additional per-object overhead. All slab metadata is embedded in the kernel's struct page, enabling seamless integration with the page allocator and eliminating separate slab descriptors. To achieve lock-free operations on the fast path, SLUB utilizes per-CPU caches of partial slabs—pages that are neither full nor empty—allowing allocations and deallocations to proceed without global synchronization in most cases. This design contrasts with SLAB's per-CPU array caches by forgoing batching optimizations for small objects in favor of a uniform freelist approach, which simplifies code while maintaining low-latency access. SLUB includes several targeted optimizations and features for robustness and debugging. For small objects, the absence of SLAB-style batching reduces complexity, though it may slightly increase cache pressure in some scenarios. Debugging capabilities, such as the SLUB_REDZONE option, add padding bytes around allocated objects to detect overflows and memory corruption during development or troubleshooting. Additionally, SLUB supports huge pages (orders greater than zero) for caches requiring larger contiguous allocations, improving efficiency in memory-intensive applications. In terms of performance, initial benchmarks showed SLUB delivering 5-10% faster allocation speeds compared to SLAB, attributed to its leaner code paths and reduced . It also enhances (NUMA) systems by facilitating page migration: since metadata resides solely in the struct page, entire slabs can be relocated between nodes without custom handling, improving locality and reducing remote access latencies. As of 2025, SLUB continues as the sole general-purpose slab allocator in the mainline , following the deprecation and removal of SLAB in version 6.8; ongoing refinements ensure compatibility and optimization for architectures like arm64 and . In 6.18 (2025), introduced "sheaves," an opt-in per-CPU caching mechanism for SLUB to further reduce lock contention on high-core-count systems.

SLOB Allocator

The SLOB (Simple List of Blocks) allocator was introduced by Matt Mackall in 2006 as a lightweight alternative to the SLAB and SLUB allocators, specifically targeting resource-constrained embedded environments with less than 2 MB of RAM. Its design centers on a single global freelist that encompasses all free objects, organized by size categories using simple singly-linked lists, which eliminates per-cache overhead and relies on the underlying page allocator for expansion. Allocation proceeds via a first-fit search through the appropriate size-based list, while deallocation merges freed blocks back into the list, all managed within a unified arena without dedicated slab structures. This minimalist approach draws from traditional K&R-style heap management, ensuring compatibility with kmalloc and kmem_cache operations but with granular 8-byte alignments on architectures like x86. While offering constant O(1) space overhead and a compact codebase of around 600 lines, SLOB trades off higher internal fragmentation from its first-fit strategy and lacks optimizations such as slab coloring or per-CPU caches, rendering it ideal for uniprocessor (UP) embedded systems where minimal footprint outweighs allocation speed. In the , SLOB is enabled through the CONFIG_SLOB configuration option, often selected in embedded builds by disabling CONFIG_SLUB or CONFIG_SLAB, allowing it to serve as the default kmalloc backend from a single contiguous arena. However, its global locking and potential for linear-time traversals make it unsuitable for high-performance or multi-core workloads. By the early 2020s, SLOB was deprecated in 6.2 in favor of SLUB and subsequently removed entirely in version 6.4 due to maintenance burdens and the prevalence of more capable alternatives.

Adoption in Operating Systems

Solaris

The slab allocator forms the core of the Solaris kernel memory (kmem) allocator, introduced in Solaris 2.4 in 1994 to manage all kernel memory allocations except page-level structures, replacing the previous buddy allocator from SVR4 Unix. This implementation, designed by Jeff Bonwick, uses object-caching to minimize initialization overhead for frequently allocated kernel objects by maintaining pre-initialized slabs in caches tailored to specific object sizes and types. Subsequent extensions integrated the slab allocator with advanced features, including support for introduced in Solaris 10 in 2005, where kmem caches allocate memory for ZFS components such as the Adaptive Replacement Cache (ARC) buffers. The allocator also incorporates auditing capabilities, such as redzone and deadzone checks to detect overwrites and use-after-free errors, along with tools like the Modular Debugger's ::findleaks command, which traces unreferenced allocations in crash dumps. Additionally, it supports Solaris Zones by providing isolated kmem caches per zone to enhance resource separation in consolidated environments. As of 11.4 (released in 2018) and its updates through 2025, the kmem allocator includes probes under the kmem provider (e.g., kmem:::alloc and kmem:::free) for real-time monitoring of allocation patterns and performance. Common usage includes allocating door descriptors for and ARC buffers for caching, with the slabstat(1M) tool providing statistics on cache utilization and fragmentation. The allocator scales efficiently to petabyte-scale systems, leveraging per-CPU magazines for low-overhead access in multi-socket environments with thousands of cores.

Linux

Slab allocation was first integrated into the with version 2.2 in 1999, introducing the original SLAB allocator inspired by Solaris implementations. Over time, it evolved with the addition of the SLOB allocator for embedded systems and the SLUB allocator, which became the default in kernel version 2.6.23 in 2007 due to its improved performance and simpler design. SLOB was deprecated in kernel 6.2 and removed in kernel 6.4 (2023), while SLAB was deprecated in 6.5 and removed in 6.8 (2024), leaving SLUB as the primary general-purpose allocator as of 2025. The slab allocator underpins key kernel memory management functions, including the kmalloc() for small allocations and aspects of vmalloc() for larger mappings. Configuration of the slab allocator, particularly SLUB, can be tuned via kernel boot parameters to optimize for specific workloads. For instance, the slub_max_order parameter sets the maximum page order for slab allocations, with a default of 0 imposing no artificial limit beyond system constraints; higher values (e.g., 1 or 2) reduce fragmentation on high- systems but risk out-of-memory conditions on low-RAM machines. Runtime statistics are accessible through /proc/slabinfo, which reports per-cache details like object counts, active usage, and consumption for monitoring allocation patterns. In practice, the slab allocator manages caches for frequently allocated kernel structures, such as task_struct for descriptors, dentry for directory entries in the virtual filesystem layer, and sk_buff for network packet buffers. Integration with control groups () extends this to containerized environments, where the enforces limits on kernel memory (kmem) usage, including slab allocations, via interfaces like memory.kmem.limit_in_bytes to prevent resource exhaustion in isolated workloads. Monitoring tools like slabtop provide real-time views of top slab caches sorted by metrics such as memory usage or object count, aiding in identifying leaks or hotspots without halting the system. For , the CONFIG_DEBUG_SLAB kernel configuration option enables features like , red-zoning, and tracepoints to detect corruption or double-frees, with runtime toggling via boot parameters like slab_debug=FZ. As of 2025, SLUB remains the dominant allocator across distributions, benefiting from ongoing optimizations for scalability and security, including support for slab allocation in Rust-based kernel components such as objects, enhancing in the Rust-for-Linux ecosystem without disrupting C-based code.

Other Systems

implements Memory Allocator (UMA), a slab-inspired mechanism introduced in 1998 with the initial zone allocator and refined in 5.0 (2003) to function explicitly as a slab allocator using zones for object collections and kegs as backing caches for fixed-size items. UMA manages dynamically sized collections of identical objects, serving as the backend for kernel functions like malloc and the allocation of (vm) objects, thereby reducing initialization overhead for frequently used kernel structures. NetBSD and OpenBSD employ pool allocators that operate in a slab-like manner, caching pre-initialized buffers of fixed sizes to accelerate allocation and deallocation of kernel structures such as processes, sockets, and file descriptors. In , the pool(9) interface provides a resource manager for fixed-size buffers, maintaining per-pool caches to minimize fragmentation and support efficient reuse, akin to slab caches. OpenBSD's pool(9) similarly uses slab-style caching with dedicated zones for kernel objects, emphasizing features like in allocation to mitigate exploits while handling structures like mbufs and uvm objects. The kernel incorporates partial analogs to slab allocation through its executive pool manager, which uses lookaside lists for fast allocation of small, frequent objects via functions like ExAllocatePool, though it lacks a pure slab implementation and relies on paged and non-paged pools for general memory. Research into NT kernel variants has proposed slab-like enhancements to the pool system to improve object caching and reduce overhead for driver and subsystem allocations. In embedded environments, Android leverages the SLUB allocator from the Linux kernel for efficient kernel memory management, particularly in handling device drivers and system services on resource-constrained mobile hardware. Real-time operating systems like Zephyr include minimal slab ports, where memory slabs serve as kernel objects enabling dynamic allocation of fixed-size blocks from pre-designated regions, supporting low-latency operations in IoT and embedded applications without the full complexity of general-purpose slabs.

Advantages and Limitations

Benefits

Slab allocation significantly reduces memory fragmentation compared to traditional buddy systems by grouping objects of identical sizes into fixed slabs, limiting internal fragmentation to a maximum of 12.5% per slab and achieving overall of approximately 14% under heavy workloads, in contrast to 46% observed in comparable allocators like those in SVR4. This efficiency stems from pre-allocating contiguous blocks tailored to specific object sizes, minimizing both internal within slabs and external fragmentation across the heap. Allocation and deallocation operations in slab allocators are notably faster, with allocation averaging 3.8 microseconds in early implementations, compared to 25.0 microseconds in prior versions and 9.4 microseconds in SVR4 systems; these benchmarks, derived from evaluations, highlight the O(1) enabled by per-cache freelists. Object caching further accelerates repeated allocations by avoiding reinitialization, reducing times from 33 microseconds to 5.7 microseconds for complex structures like stream heads. The pre-initialization of objects in slabs lowers runtime overhead by eliminating per-allocation setup costs, achieving savings of up to 83% in cycles for object construction in kernel workloads, as evidenced by reduced kernel execution time by 5% in terminal server benchmarks. Extensions like per-CPU magazines enable to thousands of cores by distributing locks and caches, delivering up to 16-fold throughput gains on 16-CPU systems and 50% improvements in benchmarks like LADDIS on multi-socket servers. Slab allocation provides deterministic behavior with predictable latencies, making it suitable for real-time kernels where allocation times remain bounded without searches or coalescing delays; enhancements to handle remote frees ensure predictability in multi-core real-time systems. Empirical evaluations of the Linux SLUB variant, a streamlined slab implementation, demonstrate throughput improvements of 5-10% in benchmarks like kernbench on multi-core systems, outperforming earlier SLAB designs in CPU-intensive tests. Recent enhancements, such as the Sheaves implementation in 6.18 (as of October 2025), provide up to 30% gains in multi-threaded workloads on EPYC processors.

Drawbacks

Despite its design to minimize fragmentation, slab allocation can still suffer from internal fragmentation when object sizes do not align perfectly with slab boundaries, leading to wasted space within slabs; for instance, the original implementation capped this at 12.5% as an empirical trade-off between space efficiency and allocation speed. Memory overhead arises from metadata storage for slab management, such as descriptors and pointers, which can consume 5-10% additional space depending on object size; in Linux's SLUB variant, this contributes to higher overall usage compared to simpler allocators like SLOB, with examples showing 32200 kB versus 30800 kB in certain workloads. Per-CPU caches, intended to reduce contention, may hold unused objects, exacerbating idle memory retention across multiple processors. The allocator's complexity stems from intricate data structures like cache lists (full, partial, free) and coloring mechanisms to optimize performance, increasing kernel code size and maintenance efforts; this also complicates debugging memory leaks, as cached objects obscure allocation patterns. Early designs faced lock contention in shared caches, though later variants like SLUB mitigate this at the cost of added implementation layers. Scalability limitations appear in multi-node NUMA systems, where global cache reaping ignores node locality, potentially leading to inefficient cross-node allocations; per-CPU structures help but can bottleneck under extreme loads, prompting alternatives like percpu_alloc for very small objects. Security concerns include vulnerability to use-after-free exploits, as cached and recycled objects may retain sensitive data if not properly zeroed or ; while features like object poisoning detect overflows, the caching mechanism introduces unpredictability that attackers can leverage for heap manipulation, bypassing type separation restrictions in SLAB/SLUB.

References

  1. https://people.eecs.berkeley.edu/~kubitron/courses/cs194-24-S14/hand-outs/bonwick_slab.pdf
  2. https://www.kernel.org/doc/gorman/html/understand/understand011.html
  3. https://docs.kernel.org/core-api/memory-allocation.html
  4. https://www.usenix.org/legacy/publications/library/proceedings/usenix01/full_papers/bonwick/bonwick.pdf
  5. https://lwn.net/Articles/974138/
  6. https://www.usenix.org/conference/usenix-summer-1994-technical-conference/slab-allocator-object-caching-kernel
  7. https://man.freebsd.org/cgi/man.cgi?query=zone&sektion=9
  8. https://events.static.linuxfound.org/sites/events/files/slides/slaballocators.pdf
  9. https://lwn.net/Articles/157944/
  10. https://lwn.net/Articles/229984/
  11. https://www.kernel.org/doc/gorman/html/understand/understand009.html
  12. https://highscalability.com/linux-kernel-vs-memory-fragmentation-part-i/
  13. https://www.cs.umd.edu/class/fall2019/cmsc420-0201/Lects/lect15-memory.pdf
  14. http://homepage.cs.uiowa.edu/~jones/opsys/notes/27.shtml
  15. https://lwn.net/images/pdf/LDD3/ch08.pdf
  16. http://www.jikos.cz/jikos/Kmalloc_Internals.html
  17. http://www.parrot.org/sites/www.parrot.org/files/vmem.pdf
  18. https://blogs.oracle.com/linux/linux-slub-allocator-internals-and-debugging-1
  19. https://lore.kernel.org/lkml/[email protected]/
  20. https://www.verifysoft.com/2001/slab.c.html
  21. https://docs.kernel.org/next/admin-guide/mm/slab.html
  22. https://lpc.events/event/16/contributions/1272/attachments/946/1862/slabs.pdf
  23. https://lwn.net/Articles/898513/
  24. https://kernelnewbies.org/Linux_2_6_22
  25. https://www.phoronix.com/news/Linux-6.18-Likely-Sheaves
  26. https://stackoverflow.com/questions/15470560/what-to-choose-between-slab-and-slub-allocator-in-linux-kernel
  27. https://hammertux.github.io/slab-allocator
  28. https://lwn.net/Articles/918344/
  29. https://www.phoronix.com/news/Linux-6.4-Dropping-SLOB
  30. https://www.cs.dartmouth.edu/~sergey/io/cs258/2015/solaris_kernel_memory.pdf
  31. https://blogs.oracle.com/solaris/post/changes-to-zfs-arc-memory-allocation-in-113
  32. https://docs.oracle.com/cd/E19120-01/open.solaris/817-2543/kmem-1/index.html
  33. https://www.usenix.org/event/lisa04/tech/full_papers/price/price.pdf
  34. https://docs.oracle.com/en/operating-systems/solaris/oracle-solaris/11.4/dtrace-guide/probe-descriptions.html
  35. https://docs.oracle.com/cd/E53394_01/html/E54818/chapter2-126.html
  36. https://www.phoronix.com/news/SLAB-Officially-Deprecated
  37. https://docs.kernel.org/admin-guide/kernel-parameters.html
  38. https://docs.kernel.org/admin-guide/mm/slab.html
  39. https://docs.kernel.org/admin-guide/cgroup-v1/memory.html
  40. https://man7.org/linux/man-pages/man1/slabtop.1.html
  41. https://cateee.net/lkddb/web-lkddb/DEBUG_SLAB.html
  42. https://arstechnica.com/gadgets/2025/02/linux-leaders-pave-a-path-for-rust-in-kernel-while-supporting-c-veterans/
  43. https://learn.microsoft.com/en-us/windows-hardware/drivers/ddi/wdm/nf-wdm-exallocatepool
  44. https://media.blackhat.com/bh-dc-11/Mandt/BlackHat_DC_2011_Mandt_kernelpool-Slides.pdf
  45. https://docs.zephyrproject.org/latest/kernel/memory_management/slabs.html
  46. https://grace-liu.github.io/static/papers/18-RTAS-smr.pdf
  47. https://lwn.net/Articles/229096/
  48. https://www.webpronews.com/linux-6-18-adds-googles-sheaves-for-slub-allocator-speed-boost/
  49. https://gosec.sjtu.edu.cn/wp-content/uploads/2021/05/CCS2015Xu.pdf
Add your contribution
Related Hubs
Contribute something
User Avatar
No comments yet.