Hubbry Logo
search
logo
List of codecs avatar
List of codecs
List of codecs
current hub
L

List of codecs

logo
Community Hub0 Subscribers
Read side by side
List of codecs
View on Wikipedia
from Wikipedia

The following is a list of compression formats and related codecs.

Audio compression formats

[edit]
Main article: Audio coding format

Non-compression

[edit]

Lossless compression

[edit]
Main article: Lossless data compression

Lossy compression

[edit]
Main article: Lossy data compression § Audio

General/Speech hybrid

[edit]

Neural audio codecs

[edit]

General

[edit]
AES3
[edit]
  • SMPTE 302M
    • FFmpeg (decoder only)
  • Dolby E
    • FFmpeg (decoder only)
Bluetooth
[edit]
Digital radio
[edit]

Voice

[edit]
Main article: Speech coding

(low bit rate, optimized for speech)

Microsoft DirectPlay
[edit]

Those codecs are used by many PC games which use voice chats via Microsoft DirectPlay API.

  • Voxware MetaVoice
    • Windows Media Player (voxmvdec.ax)
  • Truespeech
    • Windows Media Player (tssoft32.acm)
    • FFmpeg (decoder only)
  • MS GSM
    • Windows Media Player (msgsm32.acm)
    • libgsm
    • FFmpeg (decoder only)
  • MS-ADPCM
    • Windows Media Player (msadp32.acm)
    • FFmpeg
Digital Voice Recorder
[edit]
  • International Voice Association (IVA) standards:
    • Digital Speech Standard / Standard Play (DSS-SP)
      • FFmpeg (decoding only)
    • Digital Speech Standard / Quality Play (DSS-QP)
  • Sony LPEC
  • Truespeech Triple Rate CODER (TRC)[26] – used in some pocket recorders
  • Micronas [de] Intermetall MI-SC4 - used by voice recorders such as RadioShack Digital Recorder[27] and I-O DATA [ja] HyperHyde[28]
    • FFmpeg (decoder only)
  • Sanyo LD-ADPCM - used by Sanyo ICR series[29]
    • FFmpeg (decoder only)[29]
Mobile phone
[edit]
Generation 2
[edit]
Generation 3/4
[edit]
  • 3rd Generation Partnership Project (3GPP)
    • Adaptive Multi-Rate (AMR)
      • AMR-NB
        • 3GPP TS 26.073 – AMR speech Codec (C-source code) – reference implementation[30]
        • opencore-amr (one may compile ffmpeg with—enable-libopencore-amrnb to incorporate the OpenCORE lib)
        • FFmpeg (by default decoder only, but see above the compiling options to incorporate the OpenCORE lib)
      • AMR-WB
        • 3GPP TS 26.173 – AMR-WB speech Codec (C-source code) – reference implementation[12]
        • opencore-amr (decoder), from OpenCORE (one may compile ffmpeg with—enable-libopencore-amrwb to incorporate the OpenCORE lib)
        • vo-amrwbenc (encoder), from VisualOn, included in Android (one may compile ffmpeg with—enable-libvo-amrwbenc to incorporate the VisualOn lib)
        • FFmpeg (by default decoder only, but see above the compiling options).
      • AMR-WB+
        • 3GPP TS 26.273 – AMR-WB+ speech Codec (C-source code) – reference implementation[31]
      • Enhanced Voice Services (EVS)
        • 3GPP TS.26.443 – Codec for Enhanced Voice Services (EVS) – ANSI C code (floating-point)[32]
  • 3rd Generation Partnership Project 2 (3GPP2)
Professional mobile radio
[edit]
  • APCO
    • Project 25 Phase 2 Enhanced Full-Rate (AMBE+2 4400bit/s with 2800bit/s FEC)
    • Project 25 Phase 2 Half-Rate (AMBE+2 2450bit/s with 1150bit/s FEC) – also used in NXDN and DMR
      • mbelib (decoder only)
    • Project 25 Phase 1 Full Rate (IMBE 7200bit/s)
      • mbelib (decoder only)
  • European Telecommunications Standards Institute (ETSI)
    • ETS 300 395-2 (TETRA ACELP 4.6kbit/s)
  • TETRAPOL
    • RPCELP 6 kbit/s
  • D-STAR Digital Voice (AMBE 2400bit/s with 1200bit/s FEC)
    • mbelib (decoder only)
  • Professional Digital Trunking System Industry Association (PDT Alliance) standards:
    • NVOC – used in China
  • Spirit DSP RALCWI
  • DSPINI
    • SPR Robust
    • TWELP Robust
  • Codec2
    • libcodec2
  • RL-CELP (used in Japanese railways[33][34])
Military
[edit]

Video games

[edit]
  • Bink Audio, Smacker Audio
    • FFmpeg (decoder only)
  • Actimagine (Nintendo European Research & Development) FastAudio[36]
    • MobiclipDecoder (decoder only)
    • FFmpeg (decoder only)
  • Nintendo GCADPCM[37] (a.k.a. DSP ADPCM or THP ADPCM) - used in GameCube, Wii and Nintendo 3DS.
    • vgmstream (decoder only)
    • VGAudio
    • FFmpeg (decoder only)
  • Sony VAG[37] (a.k.a. Sony PSX ADPCM)
    • vgmstream (decoder only)
    • FFmpeg (decoder only)
  • Sony HEVAG[37] - used in PS Vita.[38]
    • vgmstream (decoder only)
  • Sony ATRAC9[37] - used in PS4 and PS Vita.
    • VGAudio (decoder only)
    • FFmpeg (decoder only)
  • Microsoft XMA[37] - WMA variants for Xbox 360 hardware decoding.[39]
    • FFmpeg (decoder only)
  • Xbox ADPCM
    • vgmstream (decoder only)
    • FFmpeg (decoder only)
  • CRI ADX ADPCM
    • vgmstream (decoder only)
    • VGAudio
    • FFmpeg
  • CRI AHX
  • CRI HCA/HCA-MX - used in CRI ADX2 middleware.[40]
    • vgmstream (decoder only)
    • VGAudio
    • FFmpeg (decoder only)
    • libcgss
    • HCADecoder (decoder only)
  • FMOD FADPCM[41]
    • vgmstream (decoder only)

Text compression formats

[edit]

Video compression formats

[edit]
Main article: Video coding format
Further information: Video codec and Comparison of video codecs

Non-compression

[edit]
  • RGB 4:4:4 (only linear, transfer-converted and bit-reduced also sort of compression up to about 3:1 for HDR)
  • YUV 4:4:4/4:2:2/4:1:1/4:2:0 (all lower 4:4:4 is spatially compressed up to 2:1 for 4:2:0 with specific colour distortions).
    • Intel IYUV
  • 10-bit uncompressed video
  • Composite digital signal - used by SMPTE D-2 and D-3 broadcast digital videocassettes
  • Avid DNxUncompressed (SMPTE RDD 50)
  • V210 - defined by Apple and used by Serial digital interface Input/output video cards[42]

Analog signals

[edit]

Lossless video compression

[edit]
  • ITU-T/ISO/IEC standards:
  • IETF standards:
    • FFV1 (RFC 9043)[47]  – FFV1's compression factor is comparable to Motion JPEG 2000, but based on quicker algorithms (allows real-time capture). Written by Michael Niedermayer and published as part of FFmpeg under GNU LGPL.
      • FFmpeg
  • SMPTE standards:
    • VC-2 HQ lossless (a.k.a. Dirac Pro lossless)
      • libdirac
      • libschroedinger
  • Alparysoft Lossless Video Codec (Alpary)
  • Apple Animation (QuickTime RLE)
    • QuickTime
    • FFmpeg
  • ArithYuv
  • AV1
  • AVIzlib
    • LCL (VfW codec) MSZH and ZLIB[48]
    • FFmpeg
  • Autodesk Animator Codec (AASC)
    • FFmpeg (decoder only)
  • CAI Format
  • CamStudio GZIP/LZO
    • FFmpeg (decoder only)
  • Chennai Codec (EVX-1)
    • Cairo Experimental Video Codec (open source)
  • Dxtory
    • FFmpeg (decoder only)
  • FastCodec
  • Flash Screen Video v1/v2[49]
    • FFmpeg
  • FM Screen Capture Codec
    • FFmpeg (decoder only)
  • Fraps codec (FPS1)[50]
    • FFmpeg (decoder only)
  • Grass Valley Lossless
    • Grass Valley Codec Option
    • FFmpeg (decoder only)
  • Huffyuv Huffyuv (or HuffYUV) was written by Ben Rudiak-Gould and published under the terms of the GNU GPL as free software, meant to replace uncompressed YCbCr as a video capture format. It uses very little CPU but takes a lot of disk space. See also ffvhuff which is an "FFmpeg only" version of it.
    • FFmpeg
  • IgCodec
  • Intel RLE
  • innoHeim/Rsupport Screen Capture Codec
    • FFmpeg (decoder only)
  • Lagarith A more up-to-date fork of Huffyuv is available as Lagarith[51]
    • Lagarith Codec (VfW codec)
    • FFmpeg (decoder only)
  • LOCO[52] - based on JPEG-LS
    • FFmpeg (decoder only)
  • MagicYUV[53]
    • MagicYUV SDK
    • FFmpeg
  • Microsoft RLE (MSRLE)
    • FFmpeg
  • MSU Lossless Video Codec
  • MSU Screen Capture Lossless
  • CorePNG [de] - based on PNG
    • FFmpeg
  • ScreenPresso (SPV1)
    • FFmpeg (decoder only)
  • ScreenPressor[54] - a successor of MSU Screen Capture Lossless
    • FFmpeg (decoder only)
  • SheerVideo
    • FFmpeg (decoder only)
  • Snow lossless
    • FFmpeg
  • TechSmith Screen Capture Codec (TSCC)[55]
    • EnSharpen Video Codec for QuickTime
    • FFmpeg (decoder only)
  • Toponoky
  • Ut Video Codec Suite[56][57]
    • libutvideo
    • FFmpeg
  • VBLE[58]
    • FFmpeg (decoder only)
  • VP9 by Google[59]
    • libvpx
    • FFmpeg (decoder only)
  • YULS
  • ZeroCodec
    • FFmpeg (decoder only)
  • ZMBV (Zip Motion Block Video) Codec - used by DOSBox
    • FFmpeg

Lossless game codecs

[edit]
  • DXA
    • ScummVM Tools (encoder only)
    • FFmpeg (decoder only)

Lossy compression

[edit]

General

[edit]

AI-based / AI-enhanced video codecs

[edit]
  • AIVC[67]
  • Deep Render codec[68][69]
  • MPAI
    • AI-Enhanced Video Coding (MPAI-EVC; under development)
    • AI-based End-to-End Video Coding (MPAI-EEV; under development)

Scalable / Layered

[edit]

VP8,[70] VP9,[70] AV1,[70] and H.266/VVC support scalable modes by default.

  • ITU-T/ISO/IEC standards:
    • Scalable Video Coding (H.264/SVC; H.264/MPEG-4 AVC Annex G; an extension of H.264/MPEG-4 AVC)
    • Scalable High Efficiency Video Coding (SHVC; an extension of H.265/HEVC)
    • Low Complexity Enhancement Video Coding (LCEVC; MPEG-5 Part 2)
      • LCEVC Decoder SDK (open source; decoder only)
      • V-Nova LCEVC SDK
  • SMPTE standards
    • VC-4 Layered Video Extension (SMPTE ST 2058-1:2011)

Intra-frame-only

[edit]
  • Motion JPEG
    • FFmpeg
    • Morgan Multimedia M-JPEG[71]
    • Pegasus PICVideo M-JPEG
    • MainConcept M-JPEG
  • ISO/IEC standard
    • Motion JPEG 2000 (ISO/IEC 15444-3, ITU-T T.802)
      • libopenjpeg
      • FFmpeg
      • Morgan Multimedia M-JPEG2000[72]
      • Morgan Multimedia dcpPlayer (decoder only)[73]
    • JPEG XS (ISO/IEC 21122) Lightweight Low latency video codec
      • intoPIX fastTICO-XS[74]
    • DV (IEC 61834)
      • FFmpeg
    • MPEG-4 SStP (ISO/IEC 14496-2)
    • Motion JPEG XR (ISO/IEC 29199-3, ITU-T T.833)
    • Animated JPEG XL (ISO/IEC 18181)
  • IETF Internet Draft
  • Apple ProRes 422/4444
    • FFmpeg
  • Apple Intermediate Codec
    • FFmpeg (decoder only)
  • Apple Pixlet
    • FFmpeg (decoder only)
  • AVC-Intra
    • x264 (encoder only)
    • FFmpeg (decoder only)
  • AVC-Ultra – a subset of MPEG-4 AVC Hi444PP profile
  • XAVC-I
  • CineForm HD
    • CineForm-SDK  – developed by GoPro (open source)
    • FFmpeg
  • SMPTE standard
    • VC-2 SMPTE standard (a.k.a. Dirac Pro. SMPTE ST 2042)
      • Schrödinger
      • dirac-research
      • VC-2 Reference Encoder and Decoder  – developed by BBC (open source)
      • FFmpeg (the encoder only supports VC-2 HQ profile)
    • VC-3 SMPTE standard (SMPTE ST 2019)
    • VC-5 SMPTE standard (SMPTE ST 2073; a superset of CineForm HD)
    • VC-6 SMPTE standard (SMPTE ST 2117-1)
      • V-Nova VC-6 SDK
  • Grass Valley HQ/HQA/HQX
    • Grass Valley Codec Option
    • FFmpeg (decoder only)
  • NewTek NT25
  • NewTek SpeedHQ - used in Network Device Interface (NDI) protocol
    • NewTek Codec[78]
    • FFmpeg

Stereoscopic 3D / Multiview

[edit]
  • Multiview Video Coding
  • Multiview High Efficiency Video Coding (MV-HEVC; an extension of H.265/HEVC)
    • MainConcept MV-HEVC Encoder add-on
    • FFmpeg (decoder only)
    • x265 v4.0 or later (encoder only)
    • NVENC[79] (for NVIDIA GPU)

Security and surveillance cameras

[edit]
  • Guobiao standards (GB/T)
    • AVS-S-P2 (suspended[80])
    • SVAC (GB/T 25724-2010)
  • Infinity CCTV Codec (IMM4/IMM5/IMM6)
    • FFmpeg[81][82] (IMM4 and IMM5 decoder only)
[edit]
  • CDXL codec
    • FFmpeg (decoder only)
  • Cinepak[83] (a.k.a. Apple Compact Video)
    • FFmpeg
  • Photo CD codec
    • FFmpeg (decoder only)
  • MotionPixels - used in MovieCD
    • FFmpeg (decoder only)
  • CD+G (CD+Graphics) codec
    • FFmpeg (decoder only)
    • VLC (decoder only)
  • CD+EG (CD+Extended Graphics) codec

Network video codecs

[edit]

Screen capture video codecs

[edit]

Bayer/Compressed RAW video codecs

[edit]
  • CinemaDNG (created by Adobe; used in Blackmagic cameras)
  • Redcode RAW (used in RED cameras) – a modified version of JPEG 2000[91]
    • libredcode
  • ArriRaw (used in Arri cameras)
  • Cineform RAW (used in Silicon Imaging cameras)
    • CineForm-SDK
  • Blackmagic RAW (used in Blackmagic cameras)
    • Blackmagic RAW SDK
  • Cintel RAW (used in Cintel Scanner[92])
    • FFmpeg (decoder only)
  • Apple ProRes RAW
    • FFmpeg (decoder only)[93]
  • intoPIX TICO RAW[94]
    • intoPIX fastTICO-RAW SDK & TICO-RAW FPGA/ASIC libraries[95]
  • Canon CRX - used in Canon Cinema Raw Light movie
    • Canon RAW Plugin for Avid Media Access
    • LibRaw (decoder only; open source)
  • Sony X-OCN

Video games

[edit]

Real-time

[edit]
  • RivaTuner video codec (RTV1/RTV2)
    • FFmpeg (RTV1 decoder only)
  • Hap/Hap Alpha/Hap Q
    • VIDVOX hap codec
    • FFmpeg
  • DXV Codec
    • Resolume DXV Codec
    • FFmpeg
  • NotchLC
    • FFmpeg (decoder only)
  • VESA Display Stream Compression (DSC)
  • VESA Display Compression-M (VDC-M)

See also

[edit]

References

[edit]
Revisions and contributorsEdit on WikipediaRead on Wikipedia

List of codecs

View on Grokipedia
from Grokipedia
A codec, short for coder-decoder, is a device, software algorithm, or standard that encodes and decodes digital data streams, most commonly used to compress audio, video, and image files for efficient storage, transmission, and playback while balancing quality and file size.[1] A list of codecs serves as a comprehensive catalog of these encoding methods, organized by media type, compression approach, and application, highlighting standards developed by organizations like the International Telecommunication Union (ITU-T), International Organization for Standardization (ISO), and Internet Engineering Task Force (IETF) to support diverse technologies from telephony to streaming media.[2] Codecs are broadly classified into two categories: lossless, which enable exact reconstruction of the original data without any loss of information, and lossy, which achieve higher compression ratios by discarding perceptually less important data, often at the cost of minor quality degradation.[3] Lossless codecs, such as PNG for images, preserve fidelity for applications requiring precision, like archiving or graphics editing. In contrast, lossy codecs dominate consumer media due to their efficiency; for instance, JPEG for still images uses discrete cosine transform to reduce file sizes significantly for web and photography use.[4] Audio and speech codecs form a key subset, with ITU-T standards like G.711 providing narrowband encoding at 64 kbit/s for traditional telephony, while advanced options such as G.722.2 (AMR-WB) support wideband audio up to 23.85 kbit/s for improved clarity in mobile and VoIP applications.[5] Video codecs, primarily from the ITU-T H.26x series, enable motion-compensated compression; notable examples include H.264/AVC, which achieves up to 50% better efficiency than predecessors for high-definition broadcasting and streaming at bit rates from 384 kbit/s upward, and its successor H.265/HEVC for 4K and beyond. These lists evolve with technological needs, incorporating open-source alternatives like Opus for interactive audio (covering 6–510 kbit/s across speech and music)[6] and VP9 for royalty-free video distribution.[7]

Audio Codecs

Uncompressed Audio Formats

Uncompressed audio formats represent digital audio signals in their raw form, without applying any data reduction techniques, ensuring that the original analog waveform is digitized and stored with complete fidelity. These formats primarily rely on pulse-code modulation (PCM), where continuous audio is sampled at regular intervals and quantized into discrete binary values. Key characteristics include variable sample rates, such as 44.1 kHz for consumer compact disc audio or 48 kHz for professional video and broadcasting applications, which determine the frequency range captured according to the Nyquist theorem. Bit depths typically range from 16 bits per sample for standard dynamic range to 24 bits or higher for extended resolution, allowing for greater precision in amplitude representation and lower noise floors. Channel configurations support mono for single-source recordings, stereo for two-channel playback, and multichannel setups like 5.1 surround for immersive audio.[8][9][10] A prominent example is linear PCM (LPCM), an uncompressed variant of PCM that uses uniform quantization steps and serves as the foundation for several container formats. In the WAV (Waveform Audio File Format), LPCM data is stored in little-endian byte order, preceded by a RIFF-based header that includes metadata like sample rate, bit depth, and channel count, making it ideal for Windows environments. The AIFF (Audio Interchange File Format) employs big-endian ordering for LPCM, with a similar header structure based on Apple's IFF specification, facilitating cross-platform compatibility in Macintosh systems. Broadcast WAV (BWF), an extension of WAV standardized by the European Broadcasting Union, adds fields for timecode and originator information in its header while retaining LPCM payload, enhancing interoperability in professional workflows. These formats maintain the integrity of the audio stream by avoiding any processing beyond basic encapsulation.[11][12][9] The historical roots of uncompressed audio trace back to the development of digital recording in the 1970s, but widespread adoption began with the Compact Disc Digital Audio (CD-DA) standard, known as the Red Book, published in 1980 by Philips and Sony. This specification defined stereo LPCM at 16-bit depth and 44.1 kHz sample rate, enabling approximately 74 minutes of playback per disc and revolutionizing consumer audio distribution. Over time, formats evolved to support higher resolutions; for instance, Direct Stream Digital (DSD), introduced in 1999 by Sony and Philips for Super Audio CD (SACD), uses 1-bit delta-sigma modulation at a 2.8224 MHz sample rate to achieve extended frequency response up to 100 kHz, positioning it as an uncompressed high-resolution alternative to multibit PCM. These advancements addressed limitations in dynamic range and bandwidth while preserving raw data integrity.[13][9][14] In professional applications, uncompressed formats are essential for studio mastering, where engineers require unaltered signals to apply precise equalization and dynamics processing without introducing artifacts. They are also critical in live sound reinforcement, supporting real-time multichannel mixing at high sample rates to minimize latency and ensure accurate reproduction during performances. For archival storage, formats like BWF are recommended by institutions for long-term preservation, as their uncompressed nature allows future generations to access the full original data without degradation from decoding errors. Unlike compressed alternatives, these formats retain every detail of the source material, making them indispensable where audio purity is paramount.[11][15][16] The storage requirements for uncompressed audio can be calculated using the formula for PCM data size, which accounts for the parameters defining the signal:
Storage (bytes)=sample rate (Hz)×bit depth (bits/sample)×channels×duration (seconds)8 \text{Storage (bytes)} = \frac{\text{sample rate (Hz)} \times \text{bit depth (bits/sample)} \times \text{channels} \times \text{duration (seconds)}}{8}
For example, a 3-minute stereo recording at 44.1 kHz and 16-bit depth yields approximately 10.5 MB, highlighting the trade-off between fidelity and file size in resource-intensive environments. This equation underscores the format's direct proportionality to audio specifications, guiding decisions in storage and transmission planning.[17][18]

Lossless Audio Codecs

Lossless audio codecs employ reversible compression techniques to reduce file sizes while enabling bit-identical reconstruction of the original waveform, distinguishing them from uncompressed formats that serve as the baseline for such reconstruction.[19] Core principles include predictive modeling, such as linear prediction, to estimate audio samples and generate residuals, followed by decorrelation and entropy coding methods like Huffman, Rice, or arithmetic coding to efficiently encode these residuals without data loss.[19] These approaches exploit redundancies in audio signals, achieving typical compression ratios of 40-60% file size reduction for CD-quality audio, though performance varies by content and codec.[20] Error detection mechanisms, such as CRC checksums, ensure integrity during storage and transmission, while support for multi-channel audio up to 8 or more channels accommodates surround sound formats.[19] The development of lossless audio codecs accelerated in the late 1990s and early 2000s as an alternative to the rising popularity of lossy formats like MP3, prioritizing archival quality and high-fidelity playback for audiophiles.[21] One early milestone was Shorten, introduced in 1993 by Tony Robinson at Cambridge University, which pioneered open-source lossless compression using linear prediction and Huffman coding, though it is now largely deprecated.[22] By the mid-2000s, FLAC had emerged as the de facto open-source standard, with its specification finalized in 2001 and adoption growing through integration in media players and hardware by 2007.[23] This period marked a shift toward royalty-free, efficient codecs suitable for both archiving and emerging streaming applications. Key examples illustrate the diversity in design and application. FLAC (Free Lossless Audio Codec), developed starting in 1999 by Josh Coalson and maintained by the Xiph.Org Foundation since 2003, uses fixed-order linear predictors (orders 0-4) and Rice coding for residuals, supporting metadata tagging, fast seeking, and streaming via Ogg containers.[23] It achieves compression ratios around 1.8:1 (approximately 55% of original size) and includes 32-bit CRC for error detection across multi-channel streams up to 8 channels.[19] ALAC (Apple Lossless Audio Codec), introduced by Apple in 2004 and standardized as MPEG-4 ALS in 2006, employs LPC with long-term prediction and Golomb-Rice or arithmetic coding, offering similar ratios (around 1.83:1) while supporting up to 24-bit/192 kHz resolution and integration in MP4 containers for iOS and macOS ecosystems.[24] Monkey's Audio (APE), released in 2000 by Matthew T. Ashland, combines adaptive predictors with range-style arithmetic encoding for superior compression (up to 1.87:1 ratios), though at higher computational cost, and features redundant CRCs for error resilience in multi-channel files.[25] OptimFROG, developed by Florin Ghido around 2001, prioritizes maximal compression through multi-layer adaptive filtering and range coding, often outperforming others in file size reduction for archiving, albeit with slower encoding.[26] These codecs have integrated into broader ecosystems, with FLAC gaining native support in extended WAV formats via RIFF chunks and powering lossless streaming on services like Tidal, which delivers HiRes FLAC up to 24-bit/192 kHz since 2021.[27] Such adoption underscores their role in preserving audio fidelity across professional production, consumer playback, and distribution platforms.[19]
CodecDeveloper/OrganizationInitial ReleaseTypical Compression RatioKey Features
FLACXiph.Org Foundation20011.79:1Metadata, streaming, 8-channel support, CRC
ALACApple Inc.20041.83:1MP4 integration, Hi-Res up to 192 kHz
Monkey's AudioMatthew T. Ashland20001.87:1High compression, redundant CRCs
OptimFROGFlorin Ghido~2001>1.9:1 (optimized)Maximal size reduction, adaptive filters
ShortenTony Robinson1993~1.5-2:1Early linear prediction, open-source precursor

General Lossy Audio Codecs

General lossy audio codecs are designed for compressing music and general audio signals by discarding data that is imperceptible to the human ear, achieving significant file size reductions while preserving subjective quality. These codecs rely on perceptual coding principles, which leverage psychoacoustic models to analyze the audio signal and allocate bits preferentially to perceptually salient components. By exploiting limitations in human auditory perception, such as the inability to discern fine details in the presence of stronger sounds, these methods enable efficient storage and transmission without audible degradation for most listeners.[28] At the core of perceptual coding are psychoacoustic models that compute masking thresholds to shape quantization noise below audible levels. Frequency masking occurs when a louder masker signal raises the detection threshold for nearby frequencies within critical bands, typically spanning 100-200 Hz at low frequencies and widening at higher ones; this allows quieter spectral components to be quantized more coarsely. Temporal masking complements this by suppressing audibility before (pre-masking, up to 20 ms) and after (post-masking, 100-200 ms) a strong signal. Transform coding, particularly the Modified Discrete Cosine Transform (MDCT), plays a key role by converting the time-domain signal into a frequency-domain representation with high resolution (e.g., 576 lines in MP3, up to 1024 in AAC), facilitating precise noise control and bit allocation while minimizing aliasing through windowing techniques.[29][30] A foundational example is MP3 (MPEG-1 Audio Layer III), developed by the Fraunhofer Society and standardized in ISO/IEC 11172-3 in 1993, which popularized digital music distribution. MP3 employs a hybrid filterbank combining polyphase and MDCT for spectral analysis, supporting bitrates from 32 to 320 kbps in constant bitrate (CBR) or variable bitrate (VBR) modes to adapt to signal complexity. Its dominance in the 2000s stemmed from widespread adoption in portable players like the iPod, enabling hours of storage on limited devices.[31] AAC (Advanced Audio Coding), standardized by MPEG in ISO/IEC 13818-7 in 1997, serves as MP3's successor, delivering equivalent quality at approximately 70% of the bitrate through enhanced tools like temporal noise shaping (TNS) and improved joint stereo coding. It supports multichannel audio up to 48 channels and includes HE-AAC profiles for low-bitrate efficiency (e.g., below 64 kbps per channel) via spectral band replication. By the 2010s, AAC supplanted MP3 in streaming platforms due to its superior efficiency for broadband delivery.[31] Ogg Vorbis, introduced by the Xiph.Org Foundation in 2000 with its bitstream frozen on May 8, emerged as a royalty-free, open-source alternative supporting sample rates from 8 to 48 kHz and bitrates from 45 to 500 kbps. Using MDCT-based analysis and advanced perceptual entropy coding, it matches or exceeds MP3 quality at comparable rates, promoting adoption in free software ecosystems.[32] Quality assessment for these codecs often uses the Mean Opinion Score (MOS), a subjective scale from 1 (bad) to 5 (excellent) derived from listener tests, where scores above 4.0 signify transparency—indistinguishability from the original. Bitrate ladders provide practical guidance: MP3 achieves near-transparent quality around 256-320 kbps (MOS ~4.2-4.5), while AAC reaches similar transparency at 192-256 kbps (MOS ~4.3-4.6), approximating CD-quality (16-bit/44.1 kHz PCM) fidelity for stereo music.[33][34] These codecs find primary applications in music streaming services, such as Apple Music (using 256 kbps AAC) and Spotify (employing AAC or Ogg Vorbis variants up to 320 kbps), where they balance bandwidth constraints with perceptual quality for on-demand playback. They also power portable devices, from smartphones to wireless earbuds, enabling efficient offline storage and Bluetooth transmission without compromising listening experiences.[35]

Speech-Focused Audio Codecs

Speech-focused audio codecs are designed to efficiently compress human voice signals for transmission over bandwidth-limited channels, prioritizing intelligibility and naturalness at low bitrates while minimizing computational complexity for real-time applications such as telephony.[36] These codecs exploit the parametric structure of speech, modeling it as a source-filter system where the vocal tract shapes a source excitation (glottal pulses for voiced sounds or noise for unvoiced), enabling significant bandwidth reduction compared to general-purpose audio codecs.[37] A core technique in these codecs is linear predictive coding (LPC), which estimates the speech waveform as a linear combination of past samples to model the vocal tract's all-pole filter, thereby capturing formant frequencies that define vowel quality and speaker identity.[37] LPC parameters are typically derived over short frames (10-30 ms) using methods like autocorrelation or covariance analysis, allowing reconstruction with residual excitation. Code-excited linear prediction (CELP) extends LPC by using an analysis-by-synthesis approach to select excitation vectors from codebooks, optimizing perceptual quality at bitrates below 10 kbps.[38] Pitch detection plays a crucial role in voiced speech modeling, identifying the fundamental frequency (typically 50-400 Hz) via autocorrelation or normalized cross-correlation to enable periodic excitation that preserves formants and prosody.[39] The ITU-T G-series recommendations form the backbone of speech codec standards, evolving from 1980s public switched telephone network (PSTN) requirements to support voice over IP (VoIP) and mobile networks. Early developments focused on narrowband (300-3400 Hz) coding for analog-to-digital transition in telephony, with subsequent standards incorporating wideband extensions for improved clarity.[40] Key examples of speech-focused codecs include:
CodecYearOrganizationBitrate (kbps)Technique
G.7111988 (orig. 1972)ITU-T64μ-law/A-law PCM
G.7291996ITU-T8CS-ACELP
Opus2012IETF6-510Hybrid CELP/MDCT
Speex2003Xiph.Org2-44CELP-based
G.711 uses logarithmic pulse code modulation to quantize 8 kHz sampled speech, providing toll-quality audio suitable as a baseline for PSTN and VoIP.[36] G.729 employs conjugate-structure algebraic CELP (CS-ACELP) to achieve near-toll quality at ultra-low bitrates, with 10 ms frames and built-in voice activity detection.[41] Opus integrates CELP for low-bitrate speech and modified discrete cosine transform (MDCT) for higher rates, supporting variable frame sizes (2.5-60 ms) and adaptive bitrate switching for robust VoIP performance.[6] Speex, an open-source CELP variant, offers narrowband to wideband modes with perceptual enhancements like variable bitrate and packet loss concealment.[42] Performance in speech codecs emphasizes low algorithmic delay, typically under 20 ms for interactive use, as higher latency impairs conversational flow; for instance, ITU-T guidelines recommend one-way delays below 150 ms for acceptable quality, with codec processing contributing minimally via short frame lengths.[43] Robustness to packet loss in IP networks is achieved through techniques like packet loss concealment (PLC), which interpolates lost frames using pitch-synchronous overlap-add or history buffering to mitigate up to 10-20% loss without audible artifacts.[44] These codecs are widely deployed in teleconferencing platforms like Zoom for low-latency group calls, mobile telephony standards such as GSM and LTE for efficient spectrum use, and digital radio communications for secure voice transmission.[45]

Neural Audio Codecs

Neural audio codecs represent a class of data-driven compression techniques that leverage deep learning models to encode and decode audio signals, achieving higher efficiency and perceptual quality compared to traditional methods, particularly at low bitrates. These codecs typically employ an encoder-decoder architecture where the encoder compresses raw audio into a compact latent representation, often quantized into discrete tokens, and the decoder reconstructs the signal, frequently enhanced by generative components to minimize artifacts. Unlike rule-based approaches, neural codecs learn representations directly from large audio datasets, enabling adaptability to diverse content such as speech and music.[46][47] Core neural architectures in these codecs include autoencoders, which form the backbone for dimensionality reduction and reconstruction; generative adversarial networks (GANs), used to train high-fidelity decoders that produce realistic waveforms; and diffusion models, which iteratively denoise latent representations for improved generation quality. Autoencoders, often convolutional or transformer-based, map audio to a lower-dimensional space, while GANs, such as those employing discriminators to refine outputs, ensure perceptual fidelity during decoding. Diffusion models have emerged in recent designs to handle stochastic sampling in the latent space, enhancing codec robustness for variable-rate compression.[46][48][49] Prominent examples include Google's Lyra, introduced in 2021 as a hybrid neural codec targeting speech at approximately 3 kbps, utilizing a neural vocoder for efficient real-time encoding on resource-constrained devices. Building on this, Google's SoundStream, released the same year, pioneered an end-to-end neural architecture capable of compressing both speech and music at bitrates as low as 3 kbps, outperforming conventional codecs in subjective quality tests through its residual vector quantizer and GAN-trained decoder. Meta's EnCodec, launched in 2022, advanced high-fidelity compression to 3 kbps for stereo audio at 48 kHz, employing a multi-scale quantization scheme that supports real-time operation on consumer hardware.[50][46][47] Post-2020 advancements have integrated transformer architectures for scalable sequence modeling, allowing codecs to capture long-range dependencies in audio more effectively than earlier convolutional designs. These models are typically trained on expansive datasets like LibriSpeech, a 1,000-hour corpus of English speech, which facilitates learning of diverse acoustic patterns and improves generalization. Such integrations have enabled variable bitrate allocation, where the quantizer dynamically adjusts token usage based on content complexity, yielding up to 10x compression ratios over baselines like MP3 at equivalent quality levels.[51][52][47] Key benefits of neural audio codecs include adaptive bitrate control, which optimizes transmission in bandwidth-limited scenarios, and artifact reduction through post-processing neural vocoders that refine reconstructed signals for naturalness. These features make them suitable for applications requiring low latency, such as real-time communication, where traditional codecs often introduce audible distortions at sub-6 kbps rates.[53][46] As of 2025, neural audio codecs see experimental adoption in streaming protocols like WebRTC for voice AI interfaces, with open-source releases of models like EnCodec accelerating research and integration into hybrid systems. Challenges persist in computational efficiency for edge devices, but ongoing challenges like the Low-Resource Audio Codec initiative drive further innovations in low-bitrate performance.[54][55][56]

Game Audio Codecs

Game audio codecs are designed to meet the unique demands of interactive entertainment, where real-time responsiveness is paramount. Unlike general-purpose audio compression, these codecs prioritize low-latency decoding to synchronize sounds with gameplay events, such as footstep impacts or weapon discharges, while maintaining dynamic range for immersive effects like explosions or ambient environments. They often support procedural audio generation, where sounds are synthesized on-the-fly based on game logic, and integrate with spatialization techniques like Head-Related Transfer Function (HRTF) for 3D positioning in virtual spaces. Middleware platforms such as FMOD and Wwise facilitate this by providing tools for codec selection, mixing, and real-time parameter adjustment, ensuring compatibility across hardware constraints.[57] The evolution of game audio codecs traces back to the resource-limited era of 1980s consoles, where simple chiptune synthesis dominated due to hardware constraints, evolving into sampled audio formats that balanced storage and performance. Early examples include Adaptive Differential Pulse Code Modulation (ADPCM), a predictive compression technique that reduced bitrate by encoding differences between samples, widely used in the Nintendo Entertainment System (NES) via 4-bit DPCM variants and the Super Nintendo Entertainment System (SNES) with its S-DSP chip supporting 16-bit ADPCM across eight channels at 32 kHz.[58][59] By the mid-1990s, platform-specific innovations emerged, such as Sony's VAG (Variable Audio Generator) codec for the PlayStation 1, an ADPCM-based format that compressed 16-bit audio into 4-bit blocks for efficient storage of sound effects and music on CDs. Microsoft's XMA (Xbox Media Audio), introduced for the Xbox 360, built on the Windows Media Audio (WMA) framework to offer both lossy and lossless modes with up to 32 channels and higher bitrates, optimizing for the console's multi-core architecture. In modern engines, OGG Vorbis has become a staple for its open-source, royalty-free compression, supporting variable bitrates from 45 kbps to 500 kbps and seamless integration in titles across PC and consoles.[60][61][62] This progression has extended into the 2020s with advanced codecs like Bink Audio from RAD Game Tools, integrated into Unreal Engine, offering high-quality compression and fast decoding for high-fidelity assets.[63] Lossless codecs like FLAC are occasionally referenced in development pipelines for uncompressed asset storage prior to final compression.[57] Technical characteristics of game audio codecs emphasize minimal CPU overhead to avoid impacting frame rates, typically targeting decode times under 1 ms per frame on mid-range hardware. They incorporate features like looping sample support for seamless music transitions and variable bitrate encoding to allocate more bits to high-impact sounds (e.g., action sequences) versus ambient noise, reducing overall memory footprint without perceptible artifacts. Latency is critically managed through buffer optimizations and hardware-accelerated decoding, often achieving end-to-end delays below 5 ms to align audio with visual cues in fast-paced scenarios.[57][64] These codecs are deployed across diverse platforms, including consoles like PlayStation and Xbox for standardized hardware pipelines, PC for customizable high-resolution playback, and mobile devices where power efficiency is key to extending battery life during extended sessions. Middleware like Wwise enables cross-platform codec handling, such as converting ADPCM for legacy compatibility or OGG for modern streaming, while FMOD focuses on low-overhead integration for indie titles.[57][65]

Image Codecs

Uncompressed Image Formats

Uncompressed image formats store digital images as raw pixel data without any form of data reduction or encoding, preserving every bit of information exactly as captured or generated. These formats represent images through direct pixel-by-pixel arrays, typically in color spaces such as RGB or RGBA, where each pixel's value is stored sequentially. They support various bit depths, commonly 8-bit per channel for standard color reproduction or 16-bit for higher precision in professional workflows, ensuring no loss of detail during storage or basic transfer.[66][67][68] A defining characteristic of these formats is the absence of entropy reduction techniques, resulting in straightforward, predictable file structures that prioritize accessibility over efficiency. Pixel data is organized in row-major order, with optional headers specifying dimensions, color depth, and orientation. For instance, RGB storage allocates separate values for red, green, and blue components per pixel, while RGBA adds an alpha channel for transparency. Bit depths determine the range of color values: 8-bit allows 256 levels per channel (24-bit total for RGB), whereas 16-bit extends this to 65,536 levels, reducing quantization artifacts in gradients and shadows.[66][69][70] Key examples include the Bitmap (BMP) format, developed by Microsoft in the mid-1980s as a device-independent raster format for Windows systems, supporting uncompressed storage of 1- to 32-bit pixel data in a simple header-plus-pixel-array structure. The Truevision Targa (TGA) format, introduced by Truevision in 1984 for its graphics adapter hardware, features raw pixel arrays in uncompressed modes, accommodating 8- to 32-bit depths with flexible color mapping and optional alpha channels. The Portable Bitmap (PBM) and Portable Pixmap (PPM) formats, part of the Netpbm suite created by Jef Poskanzer in the late 1980s, provide minimalist uncompressed representations: PBM for binary monochrome (1-bit), and PPM for RGB color (up to 24-bit in binary form), emphasizing portability across Unix-like systems.[66][71][67][69][68][70] The storage size of an uncompressed image can be calculated using the formula: file size (in bytes) = width (pixels) × height (pixels) × number of channels × (bit depth per channel / 8). This equation reflects the direct mapping of pixel data, where channels typically number three for RGB or four for RGBA, and the division by 8 converts bits to bytes; for example, a 1920×1080 RGB image at 8-bit depth yields approximately 6.22 MB.[72][73] Historically, these formats emerged in the early days of digital imaging during the 1980s, coinciding with the rise of personal computers and graphics hardware, serving as foundational standards for scanners, frame buffers, and early displays before compression became prevalent. BMP standardized raster handling in Microsoft ecosystems, TGA supported high-end video capture, and Netpbm formats facilitated open-source image processing on Unix platforms, all predating widespread adoption of lossy methods.[71][69][68] In applications, uncompressed formats are essential in professional photography for raw camera sensor dumps, where every pixel's original data must be retained for post-processing. They are also critical in medical imaging for archiving diagnostic scans without alteration, scientific visualization for precise rendering of simulations and microscopy data, and graphics pipelines requiring unaltered input for rendering engines. Compared to their compressed variants, these formats yield larger files but guarantee fidelity.[74][75]

Lossless Image Codecs

Lossless image codecs enable the compression of raster images while preserving every bit of original data, allowing perfect reconstruction without any quality degradation. This makes them essential for applications requiring pixel-perfect fidelity, such as technical illustrations, line art, and documents where alterations could introduce errors. Unlike uncompressed formats, which store raw pixel data without reduction, lossless codecs exploit redundancies in image structure through reversible algorithms to achieve file size reductions while maintaining exact reproducibility.[76] Common techniques in lossless image compression include run-length encoding (RLE), which efficiently represents sequences of identical pixels by storing the value once along with the count of repetitions, particularly effective for images with large uniform areas. Lempel-Ziv-Welch (LZW) compression builds a dictionary of recurring patterns to substitute repeated sequences with shorter codes, offering good performance on images with repetitive elements. DEFLATE, combining LZ77 sliding window matching with Huffman coding, further enhances efficiency by predicting pixel values across scanlines and applying adaptive filtering to minimize differences before compression.[77][78] The Graphics Interchange Format (GIF), introduced by CompuServe in 1987, was one of the earliest widely adopted lossless codecs, supporting up to 256 colors per frame and using LZW compression alongside RLE for simple raster images and animations. It became a staple for early web graphics due to its compact size over slow connections but is limited by its color palette, making it unsuitable for photographs. The Portable Network Graphics (PNG) format, developed in 1994 by the PNG Development Group and standardized by the W3C in 1996, emerged as a patent-free alternative to GIF, incorporating DEFLATE compression with per-row filtering and support for full-color images, transparency via alpha channels, and interlacing for progressive loading.[79][76][80] The Tagged Image File Format (TIFF), originally created by Aldus Corporation in the mid-1980s and later maintained by Adobe, supports a wide range of lossless compression options including LZW and DEFLATE, along with multi-page documents and extensive metadata embedding such as EXIF tags for camera settings and geolocation. Evolving from needs in the desktop publishing and printing industries, TIFF provides flexibility for high-bit-depth images and layered data, though its verbosity can result in larger files compared to PNG. Typical compression ratios for PNG range from 2:1 to 5:1 depending on image content, balancing size and computational effort.[81][78][82][77] These codecs find primary use in web graphics (PNG and GIF for transparency and icons), CAD drawings and vector-to-raster conversions (TIFF for precision), and archival photography where data integrity is paramount, ensuring no loss during repeated encoding-decoding cycles.[83]

Lossy Image Codecs

Lossy image codecs apply perceptual compression to photographic and web images, discarding data that minimally impacts human perception to achieve substantial file size reductions, often 10-20 times smaller than uncompressed formats while maintaining acceptable visual quality. These codecs transform and quantize image data in ways that exploit visual redundancies, making them ideal for bandwidth-constrained environments. Unlike lossless methods, which preserve all original data for exact reconstruction, lossy approaches introduce irreversible changes but enable practical storage and transmission of high-resolution images.[84] Central principles include the Discrete Cosine Transform (DCT), which divides images into 8x8 pixel blocks and converts spatial data to frequency components, concentrating energy in lower frequencies for efficient compression; quantization, which scales and rounds DCT coefficients using a quality-specific table to eliminate fine details; and chroma subsampling, typically in 4:2:0 format, which halves or quarters color (chrominance) resolution relative to luminance since the human eye is less sensitive to color variations.[84] These steps, applied sequentially in codecs like JPEG, ensure that perceptual fidelity is prioritized over pixel-perfect accuracy.[84] Prominent examples include JPEG, standardized in 1992 by the ITU-T under ISO/IEC 10918 with the JFIF file format for interchange, featuring adjustable quality levels from 1 (highly compressed) to 100 (near-lossless) to control the trade-off between size and artifacts.[84][85] WebP, released by Google in 2010 based on the VP8 video codec, supports lossy compression alongside animation, transparency, and optional lossless modes, yielding 25-34% smaller files than equivalent JPEGs or PNGs.[86] JPEG 2000, finalized by the JPEG committee in 2000 as ISO/IEC 15444, shifts to discrete wavelet transforms for better rate-distortion performance, enabling scalable quality and lossless fallback while outperforming DCT-based methods at low bit rates.[87] AVIF (AV1 Image File Format), developed by the Alliance for Open Media and standardized in 2020 as ISO/IEC 23000-22, leverages intra-frame encoding from the AV1 video codec for lossy compression, achieving 20-50% size reductions over JPEG and WebP with support for HDR, wide color gamut, and transparency; by November 2025, it has gained broad adoption across major web browsers and platforms for efficient image delivery.[88] Key milestones encompass JPEG's rapid ubiquity in digital cameras during the 1990s, where it standardized image encoding for consumer devices, fueling the shift from film to digital photography with efficient storage for millions of pixels.[89] WebP gained broad browser adoption in the 2020s, achieving native support across Chrome (2013 onward), Firefox (2019), Edge (2019), and Safari (2020), which accelerated its integration into web ecosystems for optimized image delivery.[90] Common artifacts at aggressive compression include blocking, visible grid-like boundaries from independent block processing, and ringing, wave-like distortions near edges due to Gibbs phenomenon in quantized frequencies, both more pronounced in uniform or high-contrast areas.[91] The Peak Signal-to-Noise Ratio (PSNR) serves as a standard metric to evaluate these, computing the logarithmic ratio of peak signal power to mean squared error distortion, where values above 30 dB typically indicate good perceptual quality.[92] These codecs power applications in web display, where formats like WebP reduce load times on sites serving billions of images daily; mobile photography, enabling quick captures and sharing on devices with limited storage; and social media, facilitating efficient uploads of user-generated photos across platforms like Instagram and Twitter.[86][93]

RAW and Specialized Image Codecs

RAW image formats store unprocessed or minimally processed data directly from a digital camera's image sensor, enabling extensive post-production adjustments while preserving the sensor's full dynamic range and color fidelity. Unlike processed formats, RAW files maintain data in a linear color space with gamma 1.0, avoiding perceptual adjustments that could limit editing flexibility. They often incorporate proprietary headers that encode sensor-specific details, such as filter array patterns and decoding instructions, which vary by manufacturer.[94] A common structure in RAW files is the Bayer pattern color filter array, where individual photosites capture only one color—red, green, or blue—with green filters typically doubled to match human visual sensitivity. This results in monochrome grayscale values per pixel, necessitating demosaicing algorithms during conversion to full-color RGB images; these algorithms interpolate missing color data using surrounding pixels and metadata about the filter arrangement.[94] Prominent examples include Adobe's Digital Negative (DNG), introduced in 2004 as an open, archival standard based on TIFF/EP to promote interoperability across camera brands. Canon's CR2 format, launched in 2004 with the EOS 20D camera, uses lossless JPEG compression for sensor data within a TIFF structure.[95] Nikon's NEF (Nikon Electronic Format) captures uncompressed or compressed sensor output, supporting 12- or 14-bit depths depending on the model. For specialized needs, OpenEXR (EXR), developed by Industrial Light & Magic in 1999, supports high dynamic range (HDR) imaging with 16-bit half-precision floating-point values per channel, allowing representation of over 30 stops of dynamic range without integer limitations.[96][97][98] These formats typically feature 12- to 16-bit depth per channel, providing 4,096 to 65,536 tonal levels for smoother gradients and reduced banding compared to 8-bit formats. Embedded metadata includes camera settings like exposure time, ISO sensitivity, and white balance multipliers, which can be non-destructively adjusted in software without altering the original sensor data.[94][97][99] Over the 2010s and 2020s, adoption of standardized formats like DNG accelerated due to concerns over vendor lock-in, where proprietary RAW files risked becoming obsolete as manufacturers discontinued support, complicating long-term archiving and software compatibility. Adobe's open DNG specification addressed this by embedding original proprietary data while providing a universal wrapper, though many vendors persist with native formats for optimized performance.[100] In professional workflows, RAW formats are essential for photography, allowing precise control over highlights, shadows, and color corrections without quality loss. In visual effects (VFX), formats like EXR facilitate multi-channel HDR compositing and layering for film production. Specialized applications extend to medical imaging, where RAW-like minimally processed data supports accurate diagnostic scans by retaining full sensor precision.[101][102][103]

Text Compression Formats

Lossless Text Codecs

Lossless text codecs are algorithms designed to compress textual data in a reversible manner, ensuring exact reconstruction of the original input without any information loss. These methods exploit redundancies in text, such as repeated patterns and symbol frequencies, to reduce storage and transmission sizes while maintaining data integrity. Widely adopted in file archiving, data transfer protocols, and backup systems, they form the backbone of tools like ZIP and gzip, enabling efficient handling of documents, logs, and source code.[104] The primary techniques in lossless text compression include dictionary-based methods, Huffman coding, and the Burrows-Wheeler transform (BWT). Dictionary-based approaches, such as LZ77 and LZ78 variants, build a dynamic or static dictionary of substrings from the input text to replace repetitions with shorter references; LZ77 uses a sliding window over previous data for matches, while LZ78 constructs a dictionary incrementally from the input stream. Huffman coding, a prefix-free entropy encoding scheme, assigns variable-length binary codes to symbols based on their frequency probabilities, with shorter codes for more common characters to minimize average code length. BWT rearranges the input into a rotated form that groups similar characters together, facilitating subsequent run-length encoding and entropy coding for improved compression ratios. Key examples trace the evolution from early archivers to modern implementations. The ARC format, introduced in 1985 by System Enhancement Associates, pioneered LZW-based compression for archiving multiple files.[105] ZIP, developed by PKWARE in 1989, later incorporated the DEFLATE algorithm—a combination of LZ77 and Huffman coding—in 1993 for broad compatibility in software distribution. Gzip, released in 1992 by Jean-loup Gailly and Mark Adler, primarily uses DEFLATE (with optional LZW support) and became a standard for web compression via HTTP. Bzip2, authored by Julian Seward in 1996, integrates BWT with Huffman coding to achieve higher ratios for larger files. LZMA, integrated into 7-Zip by Igor Pavlov around 1999 and formalized in its SDK by 2007, extends LZ77 with advanced range encoding for superior compression, particularly on repetitive text. More recently, Zstandard (zstd), developed by Yann Collet at Facebook and released in 2016, balances high compression ratios with fast decompression speeds using a finite-state entropy coder alongside LZ77-style matching. Compression ratios for lossless text codecs typically range from 2x to 10x on repetitive content like logs or code, depending on the algorithm and input entropy; for instance, DEFLATE often yields 3-5x on English text. These limits are bounded by Shannon's entropy, which quantifies the minimum average bits per symbol as
H=−∑ipilog⁡2pi, H = -\sum_{i} p_i \log_2 p_i,

where pip_i is the probability of symbol ii, representing the inherent information content that no lossless method can compress below. Applications span software distribution for smaller downloads, log file archiving to save storage, and backups to optimize data retention, ensuring fidelity for analytical and archival purposes.[106]
CodecYearDeveloperCore MethodsNotable Feature
ARC1985SEALZW (LZ78 variant)Early multi-file archiver
ZIP (DEFLATE)1993PKWARELZ77 + HuffmanUbiquitous file format
gzip1992Gailly/AdlerDEFLATE/LZWWeb and Unix standard
bzip21996SewardBWT + HuffmanHigh ratios for large files
LZMA~1999/2007Pavlov (7-Zip)LZ77 + range codingExcellent for binaries/text
zstd2016Collet (Facebook)LZ77 + FSEFast decompression

Lossy Text Codecs

Lossy text codecs represent a niche category of compression techniques designed for structured textual data, such as HTML, XML, or markup languages, where the irreversible discard of non-essential elements like whitespace, comments, or redundant attributes is permissible without compromising core functionality or semantic integrity. Unlike general-purpose lossless text compression, which preserves every byte for exact reconstruction, lossy approaches prioritize bandwidth and storage efficiency in scenarios where human readability of the source is secondary to performance, such as web delivery or resource-constrained environments. These methods emerged prominently in the 2010s amid web optimization efforts, driven by the need to accelerate page loads on mobile and low-bandwidth networks, often building on lossless foundations by applying targeted approximations post-compression. Dedicated lossy text codecs remain rare as of 2025, with most implementations focusing on preprocessing steps like minification followed by lossless compression; emerging AI-based methods, such as denoising autoencoders in tools like TextEconomizer, show promise for semantic-preserving compression.[107][108][109] Core approaches in lossy text compression include semantic pruning, which systematically eliminates structurally insignificant components to reduce file size while retaining meaning; for instance, pruning techniques parse the text into a syntactic tree and remove nodes like optional formatting elements, achieving higher ratios than pure entropy coding. Tokenization contributes by breaking text into compact symbols or groups, sometimes sacrificing precise spacing or order details for brevity, as seen in web markup where tokens represent repeated patterns approximately. Approximate matching further enables efficiency by identifying and substituting similar substrings or tags with shorter equivalents, particularly effective for repetitive XML structures where minor variations do not alter data interpretation. These strategies allow for controlled fidelity, with tools enabling users to adjust the aggressiveness of data discard to balance size against potential artifacts.[110][111] Prominent examples include specialized HTML minifiers like htmlcompressor, a tool that applies semantic pruning to remove comments, unnecessary whitespace, and shorten attribute values in HTML, CSS, and JavaScript, often yielding 20-30% size reductions standalone before further lossless layering. These minification tools, while not traditional codecs, function as lossy preprocessors in compression pipelines for web content. Such approaches typically offer 10-20% extra reduction over pure lossless methods by tolerating approximation, with the trade-off being potential loss of source editability or debugging ease, mitigated through configurable parameters.[112] Applications of lossy text codecs are concentrated in web serving, where they minimize transfer sizes for faster rendering; mobile applications, to conserve data usage and battery; and embedded systems, for fitting constraints in IoT or firmware updates. In practice, fidelity controls ensure that changes remain imperceptible to end-users, such as unaltered DOM output in browsers, making these techniques viable for production environments despite their rarity compared to lossless alternatives.[108][107]

Video Codecs

Uncompressed Video Formats

Uncompressed video formats store sequences of individual frames as raw pixel data in color spaces such as RGB or YUV, without applying any intra-frame or inter-frame compression to eliminate redundancy. This approach ensures complete fidelity to the source material, with each frame comprising full-resolution luma (Y) and subsampled chroma (U/V) components in YUV formats, or direct red, green, and blue values in RGB. Common YUV subsampling like 4:2:2 maintains uncompressed status by avoiding data reduction techniques, allowing pixel-perfect reproduction ideal for intermediate processing stages. These formats are stored in simple raw files or embedded within containers like AVI or QuickTime MOV without codec-based alteration.[113][114] Prominent examples include raw YUV files (often with .yuv extensions), which consist of planar or packed frame data where Y, U, and V planes are sequentially arranged without headers or metadata beyond basic dimensions. Uncompressed AVI or MOV files similarly encapsulate these raw streams, supporting bit depths up to 16 bits per channel for professional use. Apple's ProRes 4444 serves as a near-uncompressed variant, delivering 12-bit 4:4:4:4 RGBA data with visually lossless compression limited to alpha channels, enabling efficient handling of high-dynamic-range content while approximating raw quality.[113][115][116] The storage requirements for these formats are substantial due to their unaltered nature. For a YUV 4:2:2 frame, the size in bytes is calculated as $ \text{width} \times \text{height} \times \frac{\text{bit depth}}{8} \times 2 $, reflecting full luma sampling and half-horizontal chroma sampling per component. The total video size is then this frame size multiplied by frames per second and duration in seconds; for instance, a 1920×1080 10-bit 4:2:2 frame at 60 fps yields approximately 2.49 Gbps, or 5.18 MB per frame. Uncompressed formats originated in late-1980s broadcast standards, exemplified by the Serial Digital Interface (SDI) developed for SMPTE in 1989 to transmit unaltered digital video over coaxial cables, replacing analog workflows. By the 2010s, they extended to 4K and 8K production pipelines, supporting resolutions up to 8192×4320 at 60 fps for demanding real-time playback.[117][118][119][120] In applications, uncompressed video excels in film post-production for precise editing and compositing, where multigenerational workflows demand no quality loss. CGI rendering pipelines leverage these formats to transfer high-fidelity assets between software, ensuring seamless integration of rendered elements. Scientific fields, including medical videoconferencing and high-speed imaging, utilize them for analysis requiring exact pixel values, as seen in uncompressed HD systems outperforming compressed alternatives in detail preservation. While suited for production, they contrast with compressed formats reserved for final distribution due to bandwidth constraints.[115][121][122]

Analog Video Formats

Analog video formats represent the foundational standards for television broadcasting and recording prior to the widespread adoption of digital technologies, primarily utilizing continuous electrical waveforms to convey luminance and chrominance information. Composite video, the most basic type, combines luminance (brightness) and chrominance (color) into a single signal, as seen in the NTSC standard developed in the United States in 1953, which allocates a bandwidth of 4.2 MHz for the video signal, employs 525 interlaced scan lines at 30 frames per second, and maintains a 4:3 aspect ratio.[123] Similarly, the PAL standard, introduced in Europe during the 1960s, uses 625 interlaced lines at 25 frames per second with the same 4:3 aspect ratio, modulating chrominance on a subcarrier to achieve color encoding while preserving compatibility with monochrome receivers.[123] These composite formats, while efficient for broadcast transmission over limited bandwidth channels of 6 MHz, suffered from cross-color and cross-luminance artifacts due to the intertwined signals.[124] Component video formats addressed these limitations by separating the signals into distinct channels, such as Y (luminance), Pb (blue-difference), and Pr (red-difference), originating in the 1950s as an intermediate processing step in early color television systems to maintain higher fidelity in professional environments.[125] S-Video, a simplified component variant, separates luminance (Y) from chrominance (C) into two channels, offering improved color resolution over composite without the full separation of YPbPr, and became prominent in consumer devices from the late 1980s.[123] Interlacing, a common characteristic across these formats, alternates odd and even scan lines between fields to reduce bandwidth demands while achieving effective motion portrayal, though it introduced potential artifacts like flicker in static images.[123] Aspect ratios were standardized at 4:3 to match the era's display conventions, limiting horizontal resolution to approximately 330-440 TV lines depending on the signal's modulation.[124] The transition from analog to digital involved digitizing these waveforms using standards like ITU-R BT.601, established in 1982, which defines sampling parameters for component video—13.5 MHz for luminance and 6.75 MHz for each chrominance difference signal—to enable accurate conversion of NTSC, PAL, and similar sources into digital form with minimal aliasing. This facilitated the development of codecs for analog capture, such as DV, introduced in 1995 by a consortium including Sony and Panasonic, which employs intra-frame compression to digitize and store video from analog sources like camcorders or tape decks, ensuring frame-independent editing suitable for legacy material transfer.[126] Professional examples include Sony's Betacam format, launched in 1982, a component analog system recording Y, Pb, and Pr signals on 1/2-inch tape with FM modulation for high-bandwidth studio use, supporting up to 90 minutes of recording.[127] For consumer analog like VHS, which used composite signals, digitization often relied on intra-frame codecs such as MJPEG, applying JPEG compression per frame to capture and archive footage without inter-frame dependencies that could exacerbate generational loss.[128] In the legacy context, widespread digitization projects in the 2000s preserved deteriorating analog tapes through systematic conversion, as exemplified by institutional efforts to migrate broadcast and home video collections to digital files under ITU-R BT.601 guidelines, preventing signal degradation from magnetic decay and ensuring long-term accessibility.[129] These initiatives bridged the pre-digital era to modern uncompressed digital formats, which serve as direct successors by maintaining raw signal fidelity post-conversion.[130]

Lossless Video Codecs

Lossless video codecs enable frame-accurate compression of video data without any degradation in quality, reconstructing the original pixels bit-for-bit upon decoding. This reversibility relies on mathematical techniques that eliminate redundancies while preserving all information, making them indispensable for workflows requiring unaltered fidelity, such as professional editing and long-term storage. Unlike lossy alternatives, these codecs prioritize exact reconstruction over aggressive size reduction, typically achieving modest efficiency gains suitable for intermediate production stages.[131] The core methods in lossless video codecs involve intra-frame compression, treating each frame as an independent image and applying techniques akin to PNG's predictive differential encoding to exploit spatial redundancies within frames. More sophisticated approaches incorporate inter-frame prediction to capture temporal similarities between consecutive frames, followed by entropy coding like arithmetic or Huffman methods to represent prediction errors compactly. For instance, median prediction—computing a value as the median of neighboring pixels (e.g., left, top, and top-left)—is commonly used, paired with context-adaptive arithmetic range coding for optimal bit allocation. These reversible processes ensure no information discard, supporting diverse pixel formats and colorspaces.[131][132] Prominent examples include FFV1, an open-source intra-frame codec developed in 2003 by Mike Melanson as part of the FFmpeg project and maintained by Michael Niedermayer since 2004. Standardized in RFC 9043 (2021), FFV1 employs median prediction and either Golomb Rice or range (arithmetic) coding, supporting bit depths from 8 to 16 bits per sample and alpha channels via a dedicated transparency plane. It handles various chroma subsamplings (e.g., 4:4:4 for high-fidelity content) and is noted for its efficiency in preservation tasks. Huffyuv, created around 2000 by Ben Rudiak-Gould, focuses on speed for capture scenarios, using Huffman coding on intra-frame prediction errors (e.g., gradient or left predictors) for YCbCr or RGB data at 8-bit depths, though it lacks native alpha support. Lossless JPEG (LJPEG), introduced in 1993 as an extension to the ISO/IEC 10918-1 JPEG standard, applies predictive coding with Huffman or arithmetic entropy per frame, commonly in motion JPEG streams, supporting up to 16-bit depths but without standard alpha integration for video. These codecs exemplify the balance between speed, efficiency, and compatibility in lossless design.[133][131][134][135] Historically, lossless video codecs arose to address escalating storage demands in the 1990s and early 2000s, particularly in visual effects (VFX) pipelines where repeated decoding and re-encoding could accumulate errors in lossy formats. The VFX industry, including studios like Industrial Light & Magic, drove adoption through needs for high-bit-depth intermediates in compositing and rendering, often using frame-sequence approaches but extending to video codecs for streamlined workflows. FFV1's evolution—from version 0 (2006) to version 3 (2013) with added CRC checksums for integrity—reflects growing emphasis on archival reliability, while Huffyuv targeted real-time capture to supplant uncompressed formats. LJPEG's integration into early digital video standards facilitated its use in professional tools from the outset.[133][131] In practice, these codecs serve archival purposes, as endorsed by the Library of Congress for long-term audiovisual preservation in containers like Matroska, ensuring data integrity for future access. They function as editing proxies in post-production to avoid generational loss during cuts and effects application, and in broadcast contribution feeds for transmitting raw feeds prior to final encoding. Support for alpha channels (e.g., in FFV1) aids transparency handling in VFX compositing, while high bit depths (up to 16 bits) preserve subtle gradients in scientific imaging or HDR workflows. Compression ratios generally range from 2-3x relative to uncompressed sources, with FFV1 averaging 2.7-3.1x across RGB, YUY2, and YV12 colorspaces, Huffyuv around 2-2.2x, and LJPEG about 1.5-2x, depending on content complexity—providing meaningful storage savings without compromising quality.[133][136][131]
CodecTypical Compression RatioKey Features SupportedPrimary Strengths
FFV12.7-3.1xAlpha channels, 8-16 bit depths, intra-frameArchival efficiency, standardization
Huffyuv2-2.2x8-bit depths, RGB/YCbCrEncoding speed, capture use
LJPEG1.5-2xUp to 16-bit depths, intra-frameCompatibility with JPEG tools

General Lossy Video Codecs

General lossy video codecs employ hybrid block-based coding techniques to achieve efficient compression for standard video content, such as movies and streaming services. These codecs typically rely on motion estimation and compensation in the MPEG style, where video frames are divided into blocks and motion vectors are estimated to predict subsequent frames from reference frames, reducing temporal redundancy. The residual signal after motion compensation is then transformed using the discrete cosine transform (DCT) to concentrate energy into fewer coefficients, followed by quantization and entropy coding. Rate-distortion optimization (RDO) plays a crucial role by selecting encoding parameters, such as block modes and quantization levels, to minimize distortion for a given bitrate, balancing quality and compression efficiency.[137] The evolution of these codecs began with MPEG-2 in 1994, which introduced block-based motion compensation and DCT for DVD and broadcast applications, establishing the foundational hybrid framework.[138] This was succeeded by H.264/AVC in 2003, developed jointly by ITU-T and MPEG, which enhanced efficiency through improved motion estimation, variable block sizes, and intra-prediction, achieving up to 50% better compression than MPEG-2 for high-definition (HD) content.[139] H.265/HEVC, standardized in 2013, further advanced the paradigm with larger coding tree units, advanced motion vector prediction, and enhanced RDO, delivering approximately 50% bitrate reduction over H.264/AVC at equivalent quality.[140] By 2018, AV1 emerged as a royalty-free alternative from the Alliance for Open Media (AOMedia), incorporating similar hybrid principles but with optimizations like compound prediction modes and improved entropy coding, resulting in about 30% better compression efficiency than HEVC by 2025 benchmarks.[141] Key examples include H.264/AVC, widely adopted for its versatility; H.265/HEVC, optimized for 4K and beyond; and AV1, emphasizing open-source accessibility.[139][140][141] These codecs support various profiles to tailor performance, such as the Main profile for baseline interoperability and the High profile for advanced features like 8x8 transform and weighted prediction, enabling higher quality at lower bitrates. For HD video (1080p), typical bitrates range from 5-20 Mbps depending on content complexity and desired quality, with streaming often targeting 4-8 Mbps for H.264/AVC to balance bandwidth and visuals.[139][142] Applications span Blu-ray discs, which mandate H.264/AVC High profile for HD playback; online platforms like YouTube, supporting H.264/AVC, H.265/HEVC, and increasingly AV1 for efficient delivery; and broadcast television, where MPEG-2 persists in legacy systems while newer standards like HEVC enable 4K transmission.[140] Scalable extensions of these codecs allow adaptive bitrate streaming by embedding multiple quality layers.[139]

AI-Enhanced Video Codecs

AI-enhanced video codecs leverage machine learning models to optimize compression processes, surpassing the fixed algorithmic approaches of traditional lossy video codecs by adaptively learning patterns from data. Emerging prominently in the late 2010s, these codecs address the demands of high-resolution and immersive content by integrating neural networks into core functions like prediction and transformation, enabling more efficient bitrate allocation while preserving perceptual quality. By 2025, they represent a key focus in standards development, promising substantial efficiency gains for streaming and beyond. Central techniques include neural motion compensation, which employs convolutional neural networks to estimate optical flow and refine frame predictions at the pixel level, reducing artifacts in dynamic scenes compared to block-matching methods. Super-resolution upsampling uses generative adversarial networks or diffusion models to upscale low-resolution encoded frames during decoding, enhancing detail reconstruction without increasing transmission bitrates. Variational autoencoders (VAEs) model the compression process through probabilistic latent representations, jointly optimizing rate and distortion via an evidence lower bound objective; for instance, 3D VAEs with autoregressive priors enable entropy coding that approaches HEVC performance at low bitrates (0.10–0.25 bpp).[143] Key examples illustrate these advancements. Deep Video Compression (DVC), introduced in 2019, is an end-to-end framework that replaces hybrid codec modules with neural networks for motion estimation, compensation, residual coding, and entropy estimation, achieving MS-SSIM scores on par with H.265 (e.g., 0.961 at 0.053 bpp) while outperforming H.264. Proposals for AI enhancements to video coding, including neural network-based tools for intra-prediction and loop filtering, are being explored in ongoing MPEG and ITU-T work beyond VVC, such as in the Enhanced Compression Model (ECM), to boost efficiency in high-resolution scenarios. Netflix has integrated neural tools into AV1 workflows, including AI-driven preprocessing for content-adaptive encoding, yielding up to 20% bitrate savings over baseline AV1 configurations.[144][145] By 2025, integration into MPEG standards has accelerated, with the Enhanced Compression Model (ECM) achieving approximately 25% bitrate reduction over VVC in random-access modes, compounding VVC's 30–50% gains over HEVC to deliver overall savings of 20–50% relative to HEVC depending on content type. These advancements stem from exploratory work in MPEG-AI, including Video Coding for Machines (VCM), which embeds neural components for feature extraction and compression. A notable example is the MPEG Video Coding for Machines (VCM) standard, which integrates neural networks for compressing video features directly for machine analysis, achieving efficiencies tailored to AI tasks like object detection.[146] Training typically occurs on large-scale datasets like Vimeo-90K, comprising 89,800 diverse 7-frame clips at 256×256 resolution to capture real-world motion and textures. However, challenges persist in computational complexity, as models with millions of parameters (e.g., DVC's 11 million) require multi-GPU setups for training—often days-long processes—and may limit encoding speeds to 20–30 fps on consumer hardware for standard definitions.[147] Applications target demanding scenarios such as 8K streaming, where AI extensions in VVC-like standards handle ultra-high resolutions with minimal quality loss, and VR content, benefiting from neural super-resolution to enable immersive, low-latency experiences in 360-degree formats.[148][149]

Scalable Video Codecs

Scalable video codecs generate layered bitstreams comprising a base layer that provides essential video functionality and enhancement layers that progressively add detail, allowing decoders to extract subsets of the stream for adaptation to fluctuating bandwidth or device capabilities. This layering mechanism supports three primary forms of scalability: spatial, which enables decoding at multiple resolutions by upscaling lower-layer content; temporal, which permits extraction of lower frame rates through hierarchical prediction structures; and quality (or signal-to-noise ratio, SNR) scalability, which refines fidelity by reducing quantization artifacts in successive layers.[150][151] The development of scalable video coding gained momentum in the 2000s, propelled by the proliferation of mobile internet and the demand for video delivery across diverse network conditions, from low-bandwidth cellular connections to high-speed wired links. In response to these needs, the Moving Picture Experts Group (MPEG) issued a call for proposals in October 2003 to create an efficient scalable extension to existing standards, culminating in collaborative efforts between MPEG and the ITU-T Video Coding Experts Group (VCEG). A seminal outcome was Scalable Video Coding (SVC), standardized as an extension to H.264/AVC (Annex G) in July 2007, which introduced network-friendly bitstream scalability with only moderate increases in decoder complexity compared to single-layer coding. Building on this foundation, Scalable High Efficiency Video Coding (SHVC) emerged as the scalability extension to H.265/HEVC, finalized in 2014 as part of HEVC version 2, supporting advanced layering for ultra-high-definition content while maintaining backward compatibility with base-layer HEVC decoders. In the 2020s, efforts to extend scalability to open-source codecs have advanced through initiatives like the Scalable Video Technology for AV1 (SVT-AV1), an AV1-compliant implementation developed by the Alliance for Open Media and contributors, which incorporates spatial, temporal, and quality layers in its ongoing drafts and releases.[152][150][153] These codecs offer significant benefits in dynamic environments, including seamless switching between layers—such as transitioning from standard definition (SD) to high definition (HD) without interrupting playback or requiring full re-encoding—thus minimizing latency and drift in adaptive scenarios. For SNR scalability, enhancement layers employ finer quantization parameters, yielding measurable improvements in video quality; for instance, two-layer SNR configurations in SVC can achieve 1-2 dB gains in peak signal-to-noise ratio (PSNR) over single-layer equivalents at comparable bitrates, establishing better perceptual quality without excessive overhead. In practical deployments, scalable video codecs facilitate efficient resource allocation in live streaming via the Dynamic Adaptive Streaming over HTTP (DASH) protocol, where servers deliver layered segments that clients select based on real-time bandwidth estimates, optimizing throughput for large-scale audiences. Similarly, in video conferencing systems leveraging WebRTC, selective forwarding units (SFUs) distribute appropriate layers to participants, enhancing scalability for multi-party sessions by tailoring streams to individual connection speeds and reducing server load.[154][155][156][157]

Intra-Frame Video Codecs

Intra-frame video codecs compress video by encoding each frame independently, treating the sequence as a series of standalone images without exploiting temporal redundancies between frames. This approach mirrors still-image compression techniques, such as those used in JPEG, where spatial redundancies within a single frame are reduced through methods like discrete cosine transform (DCT) or wavelet transforms, resulting in no dependencies on adjacent frames for decoding.[158][159][160] Prominent examples include Motion JPEG (M-JPEG), which applies the JPEG standard—finalized in 1992 by the Joint Photographic Experts Group—to each video frame, making it suitable for early digital video applications.[161] Another is Motion JPEG 2000 (MJ2), an extension of the JPEG 2000 standard that uses wavelet-based compression for individual frames, supporting both lossy and lossless modes while maintaining frame independence.[87] Cinepak, developed in 1991 by SuperMac Technologies for Apple's QuickTime, employs vector quantization on blocks within each frame to achieve efficient compression for low-bandwidth playback.[162] These codecs offer advantages such as low decoding latency, since each frame can be processed without buffering prior frames, and simplified editing workflows, where cuts or modifications do not propagate errors across the sequence due to the absence of inter-frame references. Compression ratios are typically comparable to those of high-quality still images, often achieving 10:1 to 20:1 depending on content complexity, without the artifacts from motion prediction.[163][164] Historically, intra-frame codecs like Cinepak and M-JPEG powered 1990s CD-ROM multimedia titles, enabling playable video on limited hardware by prioritizing frame-by-frame simplicity over bitrate efficiency. In modern contexts, they persist in applications like GoPro cameras for raw or high-quality modes, where independent frames facilitate quick post-production access, though often in hybrid forms for broader compatibility. A key drawback is their higher bitrate requirements—frequently 2-5 times those of inter-frame codecs for equivalent quality—leading to larger file sizes and increased storage demands.[162][165][166]

Multiview Video Codecs

Multiview video codecs are designed to compress multiple synchronized video streams captured from different camera angles, facilitating stereoscopic 3D and multiview applications that provide depth perception and immersive viewing experiences. These codecs build upon single-view standards like H.264/AVC and HEVC by incorporating inter-view prediction to exploit spatial correlations between views, reducing redundancy while maintaining compatibility with 2D decoders.[167] The core challenge addressed is the high data volume from simultaneous captures, typically requiring efficient handling of temporal, spatial, and inter-view dependencies to enable practical transmission and storage.[168] Key techniques in multiview video coding include disparity estimation, which computes horizontal pixel shifts between views to represent scene depth and enable disparity-compensated prediction, and view synthesis, which interpolates or extrapolates virtual views from encoded ones for enhanced prediction accuracy or rendering of novel viewpoints. These methods form the basis of Multiview Coding (MVC), a framework that uses hierarchical B-frames across views for scalable bitstream extraction of individual perspectives. Disparity estimation operates similarly to motion estimation but across spatial rather than temporal dimensions, often using block-matching algorithms to derive disparity vectors that guide inter-view reference sampling. View synthesis, meanwhile, employs depth or disparity maps to warp pixels from reference views, supporting advanced features like depth-image-based rendering (DIBR) for free-viewpoint video.[167][169][170] Prominent examples include MVC as an extension to H.264/AVC, standardized in March 2009 by ITU-T Recommendation H.264 (Annex H) and ISO/IEC 14496-10, which introduces multiview profiles without modifying the core 2D syntax, allowing a single bitstream to carry a base view decodable by legacy H.264 devices and dependent views for 3D. Building on this, MV-HEVC (Multiview High Efficiency Video Coding), finalized in October 2014 as part of HEVC version 2 by the Joint Collaborative Team on Video Coding (JCT-VC), extends HEVC's coding tools to multiple views with improved inter-view prediction, achieving higher efficiency for resolutions up to 4K. 3D-HEVC, completed in February 2015 as HEVC version 3 by the Joint Collaborative Team on 3D Video Coding Extension (JCT-3V), further integrates depth map coding alongside texture views, enabling more precise view synthesis for asymmetric or multi-view-plus-depth scenarios.[168][171][172] Standards for multiview deployment, such as Blu-ray 3D introduced in the 2010s by the Blu-ray Disc Association, mandate MVC with frame packing, where alternating left- and right-eye frames are encapsulated in a single H.264-compatible stream to deliver full 1080p resolution per eye at 24 Hz, contrasting with side-by-side packing that squeezes both views horizontally into one frame, halving effective resolution to 1920x540 per eye and increasing visible artifacts. This frame-packed approach ensures seamless playback on 3D displays via HDMI 1.4a, supporting bitrates up to 25 Mbps for the base view plus delta for the dependent view.[173][174] In terms of efficiency, multiview codecs impose a bitrate overhead of 50-100% relative to single-view 2D encoding for stereoscopic pairs, as the additional view requires encoding residual differences after inter-view prediction, though this is substantially less than the 200% of naive simulcast; for example, MVC and MV-HEVC typically reduce stereo bitrate by 20-50% compared to simulcasting two independent 2D streams, depending on scene disparity and camera baseline. Quantitative evaluations show MV-HEVC yielding up to 27% bitrate savings over HEVC simulcast for multiview content, while 3D-HEVC achieves average reductions of 24-59% over HEVC simulcast for texture-plus-depth stereo without excessive complexity.[167][175][176] Applications of multiview video codecs are prominent in cinema, where MVC facilitated widespread 3D Blu-ray distribution starting in 2010, enabling high-quality stereoscopic playback in home theaters. In VR/AR, MV-HEVC and 3D-HEVC support multiview rendering for head-tracked immersion, synthesizing views in real-time to minimize latency and bandwidth in headset streaming. Broadcasting leverages these for live 3D events, such as the 2010 FIFA World Cup, where ESPN aired 25 matches in stereoscopic 3D using formats compatible with MVC extensions, reaching viewers via dedicated 3D channels and demonstrating multiview potential for sports immersion.[173][177][178]

Surveillance Video Codecs

Surveillance video codecs are specialized compression algorithms designed for security and monitoring applications, prioritizing efficient storage and transmission of footage from fixed or semi-fixed cameras while preserving critical details for forensic analysis. These codecs emphasize motion detection to allocate resources dynamically, enabling long-term archiving in bandwidth-constrained environments like CCTV systems. Key optimizations include support for variable bitrates that adjust based on scene activity, reducing data usage during static periods without compromising quality during events.[179][180] The evolution of surveillance codecs began in the early 2000s with Motion JPEG (MJPEG), a simple format widely used in initial IP cameras for its ease of implementation and compatibility with web browsers, though it suffered from high bandwidth demands due to per-frame compression without inter-frame prediction. By the mid-2000s, H.264 (Advanced Video Coding) emerged as a standard, offering up to 50% better compression than MJPEG through motion compensation and entropy coding, making it ideal for IP surveillance networks.[181] Extensions for analytics integrated with H.264 allowed real-time processing of motion events, enhancing detection in security feeds.[182] In the 2010s, proprietary enhancements like Axis Zipstream, introduced in 2015, built on H.264 by analyzing streams in real-time to suppress non-essential details, achieving average bandwidth reductions of 50% or more while retaining forensic detail in areas of interest.[183] By 2025, AI integration had advanced codecs further, with motion-based algorithms dynamically adjusting compression based on detected activities, as seen in Canon's AI-powered surveillance solutions that use intelligent analytics for event-driven encoding.[184][185] Core features of these codecs include Region of Interest (ROI) encoding, which allocates higher bitrates and resolution to predefined or detected critical areas—such as faces or vehicles—while compressing backgrounds more aggressively to optimize storage.[186] Smart cropping complements this by automatically trimming motionless or peripheral regions in the frame, further minimizing data without losing evidential value, particularly in low-activity scenes.[187] For night vision scenarios, low-bitrate modes leverage efficient codecs like H.265, which maintain usable quality in infrared or low-light conditions at bitrates 50% lower than H.264, supporting extended recording in resource-limited setups.[188] Efficiency is enhanced by variable bitrate (VBR) control tied to activity levels, where encoders increase allocation during motion and drop to minimal rates in static views, often capped to prevent network overload.[189] Compliance with ONVIF standards ensures interoperability, mandating support for baseline H.264 profiles and configurable parameters like GOP length for seamless integration across devices.[190] These codecs find primary use in closed-circuit television (CCTV) for urban security, smart home systems for automated alerts, and traffic monitoring for incident capture, where event-driven compression reduces storage needs by up to 70% in AI-enhanced implementations.[191]

CD-ROM Video Codecs

CD-ROM video codecs emerged in the early 1990s to address the limitations of optical media storage, enabling playable video within the 1.2 Mbps sustained data transfer rate of single-speed CD-ROM drives. These codecs prioritized intra-frame compression techniques, where each frame is encoded independently, to facilitate random seeking in interactive applications without requiring sequential decoding of preceding frames. This design was essential for multimedia titles that demanded quick navigation, such as educational software or games, while keeping decoding feasible on software-only hardware without dedicated accelerators.[192][193] Prominent examples include Cinepak, developed in 1992 by SuperMac Technologies in partnership with Apple, which employed vector quantization to achieve 320×240 resolution video at 15 frames per second under CD-ROM constraints, balancing quality and low CPU demands. Intel's Indeo, also released in 1992, focused on efficient software decoding for its namesake interactive video format, supporting higher resolutions like 640×480 while integrating seamlessly with Windows environments. Later, Sorenson Video, introduced by Sorenson Vision in 1997, offered enhanced compression ratios through adaptive block-based methods, making it suitable for longer playback durations on the same media.[193][193][194] In the mid-1990s, these codecs drove the popularity of multimedia CD-ROMs, exemplified by Microsoft's Encarta encyclopedia, which incorporated Cinepak-encoded videos to deliver interactive content on systems with 100-300 MHz processors like the Intel Pentium. Compression ratios were tuned for real-time playback on such hardware, typically achieving 50:1 to 100:1 reduction for VGA-resolution footage without excessive artifacts. They were commonly embedded in container formats like Apple's QuickTime (.mov) for Macintosh compatibility or Microsoft's AVI for Windows, allowing cross-platform distribution in titles from publishers like Broderbund and Knowledge Adventure.[195][192] Though largely superseded by DVD and streaming technologies, CD-ROM video codecs influenced early internet video by pioneering low-bitrate strategies that informed subsequent network-oriented standards.[193]

Network Video Codecs

Network video codecs are optimized for transmission over IP networks, prioritizing error resilience and adaptive streaming to mitigate challenges like packet loss, latency, and bandwidth variability. These codecs incorporate specialized adaptations such as slice-based encoding, which divides frames into independently decodable units to enable partial reconstruction even if some data is lost during transit. Forward Error Correction (FEC) integrates redundant parity data into RTP streams, allowing receivers to recover from errors without retransmission, as outlined in RFC 5109 for generic FEC payloads. RTP packetization further supports this by fragmenting large Network Abstraction Layer Units (NALUs) into manageable packets, with aggregation modes for efficient delivery.[196][197][198] A foundational standard for these codecs is RFC 6184, published in 2011, which defines the RTP payload format for H.264 video, accommodating single NALU packets, aggregation, and fragmentation to suit low-bitrate real-time applications and high-bitrate streaming. H.264 is commonly deployed over the Real-Time Streaming Protocol (RTSP), which handles session control and media negotiation, paired with RTP for transport, enabling reliable delivery in scenarios requiring dynamic playback. Notable examples include Google's WebM format, utilizing the VP8 codec (initially developed by On2 in 2008 and open-sourced by Google in 2010) and its successor VP9 (released in 2013), both engineered for web streaming with built-in support for error concealment and network adaptability. The AV1 codec extends this with low-latency modes, signaled by the low_delay_mode_flag in its specification, which permits buffer underflow for real-time encoding and transmission over IP.[198][199] Core features enhance robustness, including Group of Pictures (GOP) structures tailored for error recovery, where shorter GOP lengths or redundant key frames confine error propagation to fewer subsequent frames, improving overall stream integrity. Bitrate adaptation dynamically scales encoding rates in response to network feedback, facilitating seamless quality adjustments in adaptive bitrate streaming systems. These capabilities underpin applications such as IPTV for multicast delivery over broadband, video calls in real-time communication platforms, and IoT cameras transmitting feeds across unreliable wireless links. Scalable video codecs may complement these by providing layered encoding for finer-grained network adaptation.[200][201][202][203]

Screen Capture Video Codecs

Screen capture video codecs are specialized compression formats optimized for digitizing and encoding computer desktop content, such as graphical user interfaces, text documents, and static slides, which exhibit distinct patterns like sharp edges, limited color palettes, and minimal motion compared to natural video. These codecs prioritize lossless or near-lossless quality to preserve readability and detail in elements like fonts and icons, while achieving substantial file size reductions through exploitation of spatial and temporal redundancies inherent in screen material. Unlike general-purpose codecs, screen capture variants incorporate tools tailored for low-entropy regions, enabling efficient handling of cursor movements, window resizes, and scrolling without introducing artifacts that could obscure fine details.[204][205] Core techniques in these codecs include palette mode, which maps pixel blocks to a compact set of representative colors, drastically reducing bitrate for UI graphics and diagrams by encoding only palette indices rather than full RGB values. Palette optimization refines this by adaptively selecting the most frequent colors within a block and predicting palettes from neighboring areas, yielding up to 50% bitrate savings in color-sparse content. Run-length encoding (RLE) complements this for linear elements like text strings or borders, representing sequences of identical pixels as a value-length pair to compress uniform runs efficiently, often integrated with deflate algorithms for further gains. Temporal differencing addresses dynamic aspects such as scrolling or animations by subtracting prior frames to encode only changed regions, minimizing data for semi-static scenes like document pans.[206][207][208][209] Notable examples include the CamStudio Lossless Codec, a proprietary format from the early 2000s designed for tutorial recordings, employing LZO for rapid intra-frame compression of static screens and GZIP for enhanced ratios in mixed-motion captures. In the 2010s, VP9 introduced a screen content tuning mode via its libvpx implementation, enabling aggressive rate control and reduced noise sensitivity to better handle desktop streams with sharp transitions. AV1 advanced this further with integrated screen content coding (SCC) extensions, including palette and intra-block copy tools that excel at UI elements, often outperforming predecessors by 30-50% in bitrate efficiency for text-heavy interfaces.[210][211][204] The evolution of these codecs accelerated alongside open-source screencasting software like OBS Studio, launched in 2012 to facilitate accessible recording and streaming workflows. For slide-based or presentation content, they deliver compression ratios exceeding 10:1 at lossless quality, far surpassing general codecs due to exploitable redundancies in uniform backgrounds and infrequent updates. Cursor overlay support ensures seamless integration of interactive elements without additional overhead. Primary applications encompass educational tutorials for step-by-step demonstrations, remote desktop protocols in tools like TeamViewer for audit trails, and real-time gaming streams where low-latency encoding maintains fluidity.[212][213][214]

Game Video Codecs

Game video codecs are specialized compression formats designed for delivering high-quality cutscenes and cinematics within video games, prioritizing efficient decoding on resource-constrained hardware like consoles and GPUs while maintaining visual fidelity for immersive storytelling. These codecs emerged as a solution to the challenges of integrating full-motion video (FMV) into games during the CD-ROM era, where storage limitations and processing power necessitated custom optimizations to avoid performance bottlenecks during playback. Unlike general-purpose video codecs, game variants emphasize low CPU overhead, rapid seek times for non-linear playback, and compatibility with game engines to enable seamless integration into interactive sequences. The history of game video codecs traces back to the PlayStation 1 (PS1) era in the mid-1990s, when FMV cutscenes became prevalent in titles like Final Fantasy VII, relying on early compression techniques such as Cinepak and Intel Indeo to fit video data onto CDs without overwhelming the console's hardware. By the late 1990s and early 2000s, proprietary solutions like Bink, developed by RAD Game Tools in 1997, gained dominance by offering superior performance for real-time decoding on multiple platforms, powering cutscenes in over 15,000 games across 14 systems. This evolution continued into the 2020s, with AAA titles shifting toward real-time rendered cinematics encoded on-the-fly using engine-integrated tools, reducing reliance on pre-compressed videos while leveraging modern GPUs for dynamic quality adjustments. Key examples include Bink, a proprietary codec from RAD Game Tools that balances compression efficiency with high visual quality through advanced deblocking and multi-core scaling, achieving up to 75% SIMD instruction utilization for faster decoding. For indie developers, Theora from the Xiph.Org Foundation provides a royalty-free alternative, supporting variable bit rates and adaptive deblocking for flexible cutscene implementation in games like World of Goo and Machinarium, enabling accessible video playback without licensing costs. Additionally, BC7, introduced in DirectX 11 in 2008 by Microsoft, serves as a texture compression format for video-like assets in cinematics, offering high-quality RGB/RGBA encoding at 16 bytes per 4x4 pixel block to minimize memory usage in GPU-bound scenes. Optimizations in game video codecs often integrate texture compression techniques, such as BC7's block-based encoding, to handle animated or dynamic elements within cutscenes efficiently on GPUs, reducing bandwidth and VRAM demands without perceptible quality loss. Low-latency decoding is a core focus, exemplified by Bink's GPU-accelerated compute shaders on platforms like Windows and PlayStation 5, which decode 4K frames in under 1.4 milliseconds—up to three times faster than CPU-only methods—ensuring smooth playback amid concurrent game logic. These codecs support features like seamless playback during loading screens, where Bink's minimal CPU footprint (as low as 4 milliseconds for 4K on PC) allows videos to run without interrupting asset streaming or gameplay transitions. High dynamic range (HDR) integration is also prominent, with Bink natively handling full-range colorspaces (0-255) and HDR metadata for enhanced contrast and vibrancy in modern titles. Integration with popular engines like Unity and Unreal is facilitated through dedicated plugins; Bink offers pre-built modules for both, enabling direct import of .bk2 files for cross-platform cinematic playback, while Theora's open-source nature allows custom embedding in Unity's VideoPlayer for indie workflows supporting Ogg containers.

Real-Time Video Codecs

Real-time video codecs are specialized compression algorithms optimized for live applications where low latency is paramount, enabling interactive experiences such as videoconferencing and instant broadcasting. Unlike general-purpose codecs, these prioritize rapid encoding and decoding to minimize delays, often achieving end-to-end glass-to-glass latencies under 100 milliseconds, which is essential for maintaining natural conversation flow and real-time feedback.[215] Developed primarily for bandwidth-constrained environments, they balance compression efficiency with computational simplicity to support deployment on diverse hardware, from early desktops to modern mobile devices. The core priorities of real-time video codecs include ultra-low delay targeting sub-100 ms round-trip times, hardware acceleration through SIMD instructions and dedicated chips like GPUs, and simplicity in design to reduce processing cycles. For example, encoding pipelines are streamlined to process frames in near real-time, avoiding complex predictions that could introduce buffering delays. Hardware acceleration, such as Intel Quick Sync or NVIDIA NVENC, offloads computations to achieve 10-20x speedups over software-only encoding, making these codecs viable for edge devices. Simplicity manifests in reduced motion estimation searches and fixed quantization parameters, ensuring decoders run efficiently even on low-power processors.[216] These attributes distinguish real-time codecs from offline variants by emphasizing interactivity over maximum compression.[217] Key examples illustrate these priorities in practice. H.263, standardized by the ITU-T in 1996, was designed for low-bitrate communication over circuits like ISDN, powering early webcams and video calls with its efficient block-based coding that supported real-time transmission at rates as low as 20 kbps.[217] Its unrestricted motion vector mode and optional enhancements like advanced prediction minimized latency for videoconferencing. VP8, open-sourced by Google in 2010 via the WebM project, incorporates a low-complexity mode with adaptive entropy coding and up to eight data partitions for parallel decoding, enabling 30% faster performance than H.264 at equivalent bitrates while suiting real-time web delivery.[216] Similarly, x264—an open-source H.264 implementation—offers fast presets like ultrafast and veryfast, which simplify rate-distortion optimization and motion search to encode 1080p video at 30 fps in real-time on consumer CPUs, often tuned with zerolatency options to eliminate lookahead buffering.[218] The evolution of real-time video codecs traces from the 1990s, when H.263 enabled ISDN-based video telephony with latencies around 200 ms, to the 2000s shift toward internet protocols via H.264 and VP8 for broadband webcam applications. By the 2010s, WebRTC integration standardized low-latency pipelines, and into 2025, 5G networks facilitate ultra-reliable low-latency communication (URLLC) with edge-accelerated codecs, reducing glass-to-glass delays to 10-50 ms for mobile real-time video.[219] This progression has been driven by advances in network infrastructure, allowing seamless scaling from wired ISDN to wireless 5G ecosystems.[220] Performance is evaluated through metrics like encoding time—the duration to compress a single frame, ideally under 33 ms for 30 fps streams—and glass-to-glass latency, encompassing capture, encoding, transmission, decoding, and rendering, with benchmarks targeting below 100 ms for interactive use. For instance, VP8 in low-complexity mode achieves encoding times of 10-20 ms per frame on mid-range hardware, while H.263 variants report glass-to-glass latencies of 50-150 ms in early deployments. These metrics guide optimizations, such as preset selections in x264 that trade minor quality losses for 2-5x faster encoding speeds.[215] Quantitative assessments often use test sequences from ITU standards to ensure cross-platform consistency.[217] Applications of real-time video codecs span interactive domains, including WebRTC for browser-native videoconferencing, where VP8 and H.264 enable sub-second peer-to-peer streams with adaptive bitrate control. In live sports broadcasting, they support low-latency feeds under 2 seconds, allowing fans to react in near real-time via 5G-enhanced distribution. For drones, these codecs transmit high-motion video with minimal delay for remote control and live monitoring, often using RTSP over WebRTC to achieve 100-200 ms latencies in UAV applications. These codecs briefly integrate with network protocols like RTP for robust transmission over variable connections.[221]

References

  1. Coder-Decoder - Glossary | CSRC
  2. Visual Coding & VCEG - ITU
  3. Digital Media Compression - Tutorials + Resources - Library Guides
  4. How JPEG Became the Internet's Image Standard - IEEE Spectrum
  5. [PDF] LS to IESG and IETF-RAI on information on ITU-T Speech and audio ...
  6. RFC 6716 - Definition of the Opus Audio Codec - IETF Datatracker
  7. Digital audio concepts - Media - MDN Web Docs - Mozilla
  8. Linear Pulse Code Modulated Audio (LPCM) - Library of Congress
  9. [PDF] Universal Serial Bus Device Class Definition for Audio Data Formats
  10. WAVE Audio File Format with LPCM audio - The Library of Congress
  11. WAVE PCM soundfile format - Stanford CCRMA
  12. DSD vs. PCM: Myth vs. Truth - Mojo Audio
  13. One-bit Delta Sigma Audio Encoding (DSD), Direct Stream Digital
  14. Digital Audio Recording: The Basics
  15. An Introduction to Archiving Music Recordings - Pro Audio Files
  16. How to calculate audio file size - Moeller Studios
  17. [PDF] CHAPTER 6 FUNDAMENTALS OF DIGITAL AUDIO
  18. https://erk.fe.uni-lj.si/2023/papers/zeleznik(overview_of
  19. FLAC - XiphWiki - Xiph.org
  20. After MP3: The Past, Present, and Future of Audio Codecs
  21. [PDF] Simple lossless and near-lossless waveform compression
  22. https://xiph.org/flac/
  23. About lossless audio in Apple Music - Apple Support
  24. Monkey's Audio - a fast and powerful lossless audio compressor
  25. OptimFROG - Main
  26. Sound Quality - TIDAL
  27. Psychoacoustic Models for Perceptual Audio Coding—A Tutorial ...
  28. [PDF] Perceptual Audio Coding - arXiv
  29. [PDF] Perceptual Coding of Digital Audio - MP3-Tech.org
  30. [PDF] MP3 and AAC Explained - Fraunhofer IIS
  31. Vorbis audio compression - Xiph.org
  32. [PDF] Beyond CD-Quality: Advanced Audio Coding (AAC) for High ...
  33. AAC Sample Rate and Bit Rate for High Quality Audio? - Super User
  34. Spotify vs. Apple Music: Is there a difference in sound quality? - CNET
  35. G.711 : Pulse code modulation (PCM) of voice frequencies - ITU
  36. [PDF] Speech Analysis and Synthesis by Linear Prediction of the Speech ...
  37. [PDF] Code-excited linear prediction(CELP): High-quality speech at ...
  38. [PDF] Speech Coding - UNT Digital Library
  39. [PDF] CCITT - 50 YEARS OF EXCELLENCE - 1956-2006 - ITU
  40. G.729 : Coding of speech at 8 kbit/s using conjugate-structure ... - ITU
  41. Speex: a free codec for free speech
  42. [PDF] ITU-T Rec. G.1020 (07/2006) Performance parameter definitions for ...
  43. Packet loss concealment of VoIP under severe loss conditions
  44. [PDF] Speech Coding Methods, Standards, and Applications - ViVoNets
  45. [2107.03312] SoundStream: An End-to-End Neural Audio Codec
  46. [2210.13438] High Fidelity Neural Audio Compression - arXiv
  47. [PDF] On the Design of Diffusion-based Neural Speech Codecs - arXiv
  48. On the Design of Diffusion-based Neural Speech Codecs - arXiv
  49. google/lyra: A Very Low-Bitrate Codec for Speech Compression
  50. [2506.04492] Bringing Interpretability to Neural Audio Codecs - arXiv
  51. https://www.openslr.org/12/
  52. SoundStream: An End-to-End Neural Audio Codec - Google Research
  53. facebookresearch/encodec: State-of-the-art deep learning ... - GitHub
  54. Low-Resource Audio Codec (LRAC): 2025 Challenge Description
  55. LRAC Challenge 2025: Pushing the limits of speech coding
  56. A Guide for Choosing the Right Codec | Audiokinetic Blog
  57. Super Nintendo / Famicom Architecture | A Practical Analysis
  58. ADPCM codec? - Page 2 - nesdev.org
  59. PSXSPX CDROM File Audio Single Samples VAG (Sony) - Nocash
  60. XMA - MultimediaWiki - Multimedia.cx
  61. How to get your project to target Ogg-Vorbis - Epic Games Developers
  62. RAD Audio Codec (Experimental)
  63. Low latency audio | Android game development
  64. Audio Middleware: Why would I want it in my game?
  65. BMP Format Overview - Win32 apps - Microsoft Learn
  66. TGA format specification - Paul Bourke
  67. PPM Format Specification - Netpbm
  68. Truevision TGA, version 2.0 - Library of Congress
  69. The PBM Format - Netpbm
  70. Bitmap Image File (BMP), Version 5 - Library of Congress
  71. Understanding File Types, Bit Depth, & Memory Cost of Images
  72. File Size Calculations - 101 Computing
  73. Medical Image File Formats - PMC - NIH
  74. File Formats for Microscopy
  75. Portable Network Graphics (PNG) Specification (Third Edition) - W3C
  76. https://www.libpng.org/pub/png/book/chapter09.html
  77. [PDF] Revision 6.0 - ITU
  78. Compuserve Introduces the Graphic Interchange (GIF) Image Format
  79. PNG Working Group Charter - W3C
  80. TIFF, Revision 6.0 - Library of Congress
  81. TIFF Uncompressed File with Exif Metadata - The Library of Congress
  82. Image file type and format guide - Media - MDN Web Docs - Mozilla
  83. T.81 : Information technology - Digital compression and coding of continuous-tone still images - Requirements and guidelines
  84. T.871 (05/2011) - ITU-T Recommendation database
  85. An image format for the Web | WebP - Google for Developers
  86. JPEG 2000
  87. History of digital cameras: From '70s prototypes to iPhone ... - CNET
  88. WebP image format | Can I use... Support tables for HTML5, CSS3, etc
  89. [PDF] Compression Artifacts Reduction by a Deep Convolutional Network
  90. Image Quality Metrics - MATLAB & Simulink - MathWorks
  91. The Best Image Format for Mobile Apps - Cloudinary
  92. [PDF] Understanding Digital Raw Capture - Adobe
  93. Digital Negative (DNG) - Adobe Photoshop
  94. We asked camera companies why their RAW formats are all different ...
  95. Understanding RAW Files - Nikon Support
  96. ASWF Deep Dive: OpenEXR Origin Story: Part 1
  97. 8, 12, 14 vs 16-bit depth: What do you really need?!
  98. DNG Format: How It Works and Pros/Cons to Know About - Cloudinary
  99. RAW Image Fundamentals | Canon U.S.A., Inc.
  100. https://www.fxelements.com/guides/openexr
  101. DICOM and RAW file formats - w. Patrick Gale
  102. [PDF] Dictionary-based Coding - Data Compression
  103. History of Lossless Data Compression Algorithms
  104. [PDF] Other Lossless Compression Algorithms - UT Computer Science
  105. XML Lossy Text Compression: A Preliminary Study - SpringerLink
  106. Compression | 2019 | The Web Almanac by HTTP Archive
  107. (PDF) Text Compression by Syntactic Pruning - ResearchGate
  108. [PDF] Semantic Lossy Compression of XML Data - CEUR-WS
  109. Reduce the size of HTML, CSS, JavaScript, PHP and Smarty code.
  110. google/brotli: Brotli compression format - GitHub
  111. No Compression Applied: Fix Text Compression On Your Website
  112. LZJB - Semantic Scholar
  113. YUV pixel formats - FOURCC.org
  114. 10-bit and 16-bit YUV Video Formats - Win32 apps - Microsoft Learn
  115. [PDF] Apple ProRes
  116. Uncompressed Media Subtypes - Win32 apps | Microsoft Learn
  117. Video Basics - Biamp Cornerstone
  118. Why Video Bit Depth Matters | Larry Jordan
  119. What is SDI? How does it differ from HDMI? - DEXON Systems
  120. Uncompressed 8K - PIXERA
  121. https://www.wolfcrow.com/the-costs-of-working-with-2k-and-4k-uncompressed-footage/
  122. Uncompressed High-Definition Videoconferencing Tools for ...
  123. Understanding Analog Video Signals
  124. Bandwidth Versus Video Resolution - Analog Devices
  125. Component Video - Allan Jayne
  126. Digital Video Encoding (DV, DVCAM, DVCPRO)
  127. [PDF] MPEG IMX Family - Pro Sony
  128. DV Formats: Everything You Need To Know - VideoUniversity
  129. Video Preservation and Digital Reformatting: Pain and Possibility ...
  130. Rec. ITU-R BT.601 25th Anniversary and still ´in force´ - the bridge ...
  131. RFC 9043: FFV1 Video Coding Format Versions 0, 1, and 3
  132. Some Notes on Lossless Video Codecs
  133. FF Video Codec 1, Version 0, 1 and 3 - The Library of Congress
  134. Huffyuv - rationalqm.us
  135. Lossless JPEG – Knowledge and References - Taylor & Francis
  136. [PDF] Lossless video codecs comparison - compression.ru
  137. [PDF] Hybrid Video Coding
  138. MPEG-2 standard
  139. H.264 : Advanced video coding for generic audiovisual services - ITU
  140. H.265 : High efficiency video coding - ITU
  141. AV1 Video Codec | Alliance for Open Media
  142. H.264 Video Quality: Comparing Resolutions & Bitrates (2024)
  143. [2202.04365] AIVC: Artificial Intelligence based Video Codec - arXiv
  144. AV2 vs. AV1: 2025 4K-Streaming Benchmarks Using Netflix Open ...
  145. AV1 @ Scale: Film Grain Synthesis, The Awakening - Netflix TechBlog
  146. AI Video Compression Standards: Who's Doing What and When
  147. Vimeo-90k - COVE - Computer Vision Exchange
  148. VVC – What's up and coming for the future of video codecs
  149. Video encoding - Uncrewed Systems Technology
  150. https://ieeexplore.ieee.org/document/4317636
  151. Scalable Video Coding - an overview | ScienceDirect Topics
  152. [PDF] Overview of the Scalable Video Coding Extension of the H.264/AVC ...
  153. https://ieeexplore.ieee.org/document/6861911
  154. [PDF] An Overview of Scalable Video Streaming
  155. [PDF] Scalable Video Coding - LIRMM
  156. DASH-IF Report: DASH and WebRTC-Based Streaming
  157. Scalable Video Coding (SVC) Extension for WebRTC - W3C
  158. Interframe vs. Intraframe Compression - Verkada
  159. Understanding What a Video Codec Is and How It Works
  160. Video Encoding Basics: What is a Video Codec? - Haivision
  161. [PDF] iso/iec 10918-1 (1986-1993) - ITU
  162. Cinepak - Glossary Terms - Streaming Media
  163. Understanding Video Inter-Frame Compression Techniques - FastPix
  164. Top 10 Video Formats in Sports and Media | Imagen Blog
  165. What is the best master video format in professional video editing ...
  166. Interframe vs. Intraframe (Pros & Cons) - DVXuser.com
  167. [PDF] Overview of the Stereo and Multiview Video Coding Extensions of ...
  168. H.264 (03/2009) - ITU-T Recommendation database
  169. View synthesis prediction for multiview video coding - ScienceDirect
  170. https://ieeexplore.ieee.org/document/922043
  171. High Efficiency Video Coding (HEVC) | HEVC
  172. Multiview High Efficiency Video Coding (MV-HEVC)
  173. Final 3-D Blu-ray Specification Announced
  174. What Are the Tech Specs for Blu-ray 3D? - Sound & Vision
  175. Enabling Stereoscopic and 3D Views Using MV-HEVC in NVIDIA ...
  176. [PDF] Analysis of the Encoding Efficiency of 3D HEVC - Atlantis Press
  177. How MV-HEVC makes spatial and multiview video more efficient
  178. ESPN's broadcast of the FIFA World Cup in 3D: How does it look?
  179. [PDF] Understand IP Surveillance Camera Bandwidth - Fortinet
  180. Bit Rate Explained - Nelly's Security
  181. Using H.264 video compression in IP video surveillance systems
  182. How to Integrate Video Analytics With Surveillance - Fora Soft
  183. Axis introduces Zipstream for more compression
  184. AI in Video Surveillance: Trends and Challenges in 2025
  185. Smart Surveillance | Intelligent Video Analytics
  186. ROI (Region of Interest) - Surveillance, CCTV Cameras, Alarms - Delta
  187. Smart Coding - i-PRO
  188. H.265 Video Codec For Surveillance Systems: Why Use It?
  189. Bandwidth Fundamentals For Video Surveillance - IPVM
  190. [PDF] ONVIF™ Media Service Specification
  191. 2025 Industry Trends in IP Video Surveillance - Kenton Brothers
  192. Tech Flashback: Digital Video at 1.2 Mbit/s – Developments in Video ...
  193. From Cinepak to H.265: a brief history of video compression
  194. John McGowan's AVI Overview: Audio and Video Codecs
  195. Medium Over Message: A CD-ROM Multimedia Bubble Survivor's Tale
  196. [PDF] The H.264/MPEG-4 Advanced Video Coding (AVC) Standard - ITU
  197. RFC 5109: RTP Payload Format for Generic Forward Error Correction
  198. RFC 6184 - RTP Payload Format for H.264 Video - IETF Datatracker
  199. RFC 2326: Real Time Streaming Protocol (RTSP)
  200. Error resilient GOP structures on video streaming - ScienceDirect.com
  201. Adaptive Bitrate Streaming (ABR): What is it? [2023 Update] - Bitmovin
  202. IPTV Video Encoders - Thor Broadcast
  203. Video Streaming Protocols for IoT - Nabto
  204. Screen Content Coding in AV1 Explained with Results - Visionular
  205. [PDF] An HEVC-based Screen Content Coding Scheme - Microsoft
  206. Color palette for screen content coding - IEEE Xplore
  207. [PDF] Overview of Screen Content Coding in Recently Developed Video ...
  208. TechSmith Screen Capture Codec - Multimedia Wiki
  209. Video Encoding with Temporal Compression (Microsoft Media ...
  210. Download CamStudioCodec_1.5_Setup.exe (CamStudio
  211. LiveSwitch iOS/macOS API Reference: WebM VP8/VP9 Encoder
  212. OBS Studio
  213. MSU Screen Capture Lossless Codec - compression.ru
  214. Screen recording: Capture and save sessions - TeamViewer
  215. Low-Latency Video Streaming Guide | Definitions, Examples ... - Mux
  216. [PDF] Technical Overview of VP8, an Open Source Video Codec for the Web
  217. H.263 : Video coding for low bit rate communication
  218. Encode/H.264 - FFmpeg Wiki
  219. https://ieeexplore.ieee.org/document/1413814
  220. Digital Plumbing: The Infrastructure Behind Video Calling
  221. The 6 Best Video Streaming Protocols and Streaming Formats in 2025
User Avatar
No comments yet.