《ARM技术及其应用》课程教学资源（文献资料）isep_MMcourse_MariaTrocan

MPEG-4FRVideoCodingISEPMaria TrocanSignal, Image&Telecommunications Dept

MPEG-4 Video Coding Maria Trocan ISEP Signal, Image & Telecommunications Dept

What's MPEG ?ISO,IECOrganizationsIsO-IntemationalSC24StandardsComputergraphicsandOrganizationimageprocessingWG1Coding of still picturesGKSPHIGS,CGM.VRML,X3DJPEGJTC1Over244technicalcommitteesSC29WG11Codingofaudio,pictureCoding of moving picturesmultimedia and hypermediaand audioIEC-InternationalMPEGElectrotechnicalCommission/SO/IECJTC1/SC29/WG11=MPEG

ISO - International Standards Organization GKS, PHIGS, CGM, VRML, X3D SC24 Computer graphics and image processing SC29 Coding of audio, picture, multimedia and hypermedia JPEG WG1 Coding of still pictures WG11 Coding of moving pictures and audio MPEG ISO, IEC Organizations What’s MPEG ? ISO/IEC JTC1/SC29/WG11 = MPEG IEC - International Electrotechnical Commission JTC1 Over 244 technical committees

What's MPEG-4 ?TheMPEGfamilyMPEGMPEG-21ISO/IEC2100002MPEG-7Multimedia terminalISO/IEC1593801MPEG-4specificationContentdescriptionISO/IEC1449699MPEG-2lultimediadatabaseInteractive TVISO/IEC1381894searchesWebapplicationsMPEG-1DVDS2D/3DapplicationsISO/IEC1117292Digital BroadcastsRichMediaCD-Rommovies(cable/sat)Movie trailers

The MPEG family MPEG MPEG-1 ISO/IEC 11172 ‘92 CD-Rom movies Movie trailers. MPEG-2 ISO/IEC 13818 ‘94 DVDs Digital Broadcasts (cable/sat) MPEG-4 ISO/IEC 14496 ‘99 Interactive TV Web applications 2D/3D applications Rich Media MPEG-7 ISO/IEC 15938 ‘01 Content description Multimedia database searches MPEG-21 ISO/IEC 21000 ‘02 Multimedia terminal specification What’s MPEG-4 ?

MPEG-44CharacteristicsMPEG-4ObjectsNatural-still images,audio,2D/3DvideoSynthetics-audio,objects,2D/3DscenesCompressionCompression口MPEG-4ObjectiveComprressionTechnological supportforobjectcompressionandtransmission

MPEG-4 Objects Natural – still images, audio, 2D/3D video
MPEG-4 Objective Technological support for object compression and transmission Synthetics - audio, objects, 2D/3D scenes Compression Compression Compression MPEG-4 Characteristics

MPEG-44CharacteristicsMedia compositionInteractive Scene DescriptionSceneSceneDescriptionStreamlayerObjectDescriptionObjectDescriptorStreamlayerMPEG-4VisualStreamDstreamVisualStream(Multi)MediaLayerVisualStreamAudioStream

Object Descriptor Stream Object Description layer Media composition Interactive Scene Description MPEG-4 stream Visual Stream Visual Stream Visual Stream Audio Stream (Multi) Media Layer Scene Description Stream Scene layer MPEG-4 Characteristics

MPEG-4compressionNatural media: advanced functionalities160kbpsArbitrarybitratevideocoding100kbps

Natural media: advanced functionalities Arbitrary bitrate video coding 160 kbps 100 kbps MPEG-4 compression

MPEG-4SpecificationsMPEG-4 standard componentsPart1Systems(2001)Part11Scene Description andApplicationEnginePart2Visual (2001)Part12ISOBaseMediaFilePart3Audio(2001)FormatPart4Conformance(2002)Part13IPMPExtensionsPart5ReferenceSoftwarePart14MP4FileFormat(2002)Part15Advanced VideoPart6DMIF-DeliveryCoding File FormatMultimedia Integration Framework(2000)Part16AnimationFrameworkeXtension（AFX)Part7OptimizedSoftware(2002)Part17Streaming TextFormatPart8Part18MPEG40nIP(2002)Font CompressionandStreamingPart9ReferenceHardware(2003)Part19SynthesizedStreamsPart10Part20LASERAdvanced Video Coding一(AVC)jointwithITU-T(2003)

MPEG-4 standard components MPEG-4 Specifications – Part 1 Systems (2001) – Part 2 Visual (2001) – Part 3 Audio (2001) – Part 4 Conformance (2002) – Part 5 Reference Software (2002) – Part 6 DMIF - Delivery Multimedia Integration Framework (2000) – Part 7 Optimized Software (2002) – Part 8 MPEG 4 on IP (2002) – Part 9 Reference Hardware (2003) – Part 10 Advanced Video Coding (AVC) joint with ITU-T (2003) – Part 11 Scene Description and Application Engine – Part 12 ISO Base Media File Format – Part 13 IPMP Extensions – Part 14 MP4 File Format – Part 15 Advanced Video Coding File Format – Part 16 Animation Framework eXtension (AFX) – Part 17 Streaming Text Format – Part 18 Font Compression and Streaming – Part 19 Synthesized Streams – Part 20 LASER

MPEG-4SpecificationsModule organizationISO/IEC14496-10:2004ISO/IEC14496-2:2004Coding ofvisual objectsCoding of visual objectsPart10,AdvancedVideoPart2,VisualCoding

Module organization MPEG-4 Specifications ISO/IEC 14496-10:2004 Coding of visual objects, Part 10, Advanced Video Coding ISO/IEC 14496-2:2004 Coding of visual objects, Part 2, Visual

Video CompressionVideo compression:a must?!MinutesDurationFrequencyImageMovie:3x720x576x25x60x90:167961600000*bytesPixel34DVD:4.5Gb222CD:650-700Mb118ADSL:0.25Mb/s* 156 Gb (=29,66 Mb/s)

Video compression: a must ?! Video Compression * 156 Gb (=29,66 Mb/s) Movie: DVD : 4.5 Gb 34 CD : 650-700 Mb 222 ADSL : 0.25 Mb/s 118 Pixel Image Frequency Minutes Duration

Video CompressionCompression...how does it work ?!Spatial redundancyTemporalredundancy

Compression.how does it work ?! Video Compression Spatial redundancy Temporal redundancy