Tables of Contents for Multimedia Communication Systems
Acknowledgments
xvii
List of Acronymsxix
Multimedia Communications
1
12
Multimedia Communication Model
4
1
Elements of Multimedia Systems
4
1
Packet Transfer Concept
8
1
Multimedia Requirements and ATM Networks
9
1
Audio-Visual Integration
13
22
Biomodality of Human Speech
16
2
Speech-Driven Talking Heads
21
2
Audio-to-Visual Mapping
27
3
Classification-Based Conversion27
1
HMM for Audio-to-Visual Conversion28
1
Audio and Visual Integration for Lip-Reading Applications28
1
Audio-Visual Information Preprocessing29
1
Pattern-Recognition Strategies29
1
Integration Strategy29
1
Bimodal Person Verification
30
1
Joint Audio-Video Coding
31
1
Multimedia Processing in Communications
35
70
Signal-Processing Elements
40
2
Challenges of Multimedia Information Processing
42
9
Pre and Postprocessing44
1
Speech, Audio and Acoustic Processing for Multimedia44
2
Video Signal Processing46
2
Content-Based Image Retrieval48
1
Texture-Based Methods48
1
Shape-Based Methods49
1
Color-Based Methods49
2
Perceptual Coding of Digital Audio Signals
51
7
General Perceptual Audio-Coding Architecture51
2
Review of Psychoacoustic Fundamentals53
1
Absolute Threshold of Hearing53
1
Critical Band Frequency Analysis54
1
Simultaneous Masking and the Spread of Masking55
1
Temporal Masking56
1
PE57
1
Transform Audio Coders
58
8
Optimum Coding in the Frequency Domain59
1
Perceptual Transform Coder60
1
Hybrid Coder61
1
Transform Coding Using DFT Interblock Redundancy62
1
ASPEC62
1
Differential Perceptual Audio Coder63
1
DFT Noise Substitution64
1
DCT with Vector Quantization65
1
MDCT65
1
MDCT with VQ66
1
Wavelet Decompositions67
2
DWT-based Subband Coders69
1
Speech Coder Attributes
69
2
CD Audio Coding for Multimedia Applications
71
1
TC and Subband Coding (SBC)74
1
Predictive Coding75
1
Motion-Compensated Video Coding76
2
Watermarking Techniques80
1
Main Features of Watermarking81
2
Application Domains83
2
Organization, Storage and Retrieval Issues
85
3
Streaming Issues for Speech and Audio85
2
Streaming Issues for Video87
1
Signal Processing for Networked Multimedia
88
1
NNs for Multimedia Processing
89
5
NNs for Optimal Visualization90
1
Neural Techniques for Motion Estimation91
1
NN Application to Face Detection and Recognition91
1
Personal Authentication by Fusing Image and Speech92
1
Subject-Based Retrieval for Image and Video Databases93
1
Face-Based Video Indexing and Browsing94
1
Image-Processing Hardware and Software95
1
Multimedia Processors' Classification96
2
General Purpose Microprocessors98
3
Microprocessors for Embedded Applications101
1
Distributed Multimedia Systems
105
34
Main Features of a DMS
107
1
Resource Management of DMS
107
1
IP Networking109
1
IP Multicast110
1
Resource Reservation Protocol (RSVP)111
1
RTP112
1
Integrated Management Architecture for IP-Based Networks112
2
Performance Management114
1
Fault Management114
1
Configuration Management115
1
Security Management115
1
Accounting and Billing Management116
1
ATM116
3
Integration of IP and ATM119
1
Real-Time Multimedia over ATM (RMOA)120
2
Multimedia Operating Systems
122
2
CPU Management123
1
Memory Management123
1
I/O Management124
1
File System Management124
1
Distributed Multimedia Servers
124
2
Multimedia Packing125
1
Distributed Multimedia Applications
126
11
ITV127
1
VoD128
3
Telecooperation131
1
Telecooperation Infrastructure132
1
Telecooperative Applications133
2
Telemedicine135
1
Hypermedia Applications135
1
Basic Features of a Hypermedia System135
1
The Web136
1
Multimedia Communication Standards
139
234
MPEG Approach to Multimedia Standardization
142
4
MPEG-1 (Coding of Moving Pictures and Associated Audio)
146
8
The Basic MPEG-1 Interframe Coding Scheme149
3
Conditional Replenishment152
1
Specific Storage Media Functionalities152
1
Rate Control153
1
MPEG-2 (Generic Coding of Moving Pictures and Associated Audio)
154
22
MPEG-2 Video157
1
MPEG-2 Video---The Basics158
5
MPEG-2 Video Syntax163
1
MPEG-2 Video Scalability163
3
MPEG-2 Video: Profiles and Levels166
1
MPEG-2 Audio167
4
MPEG-2 Systems171
4
MPEG-2 DSM-CC175
1
MPEG-4---Coding of Audiovisual Objects
176
86
Overview of MPEG-4: Motivations, Achievement, Process and Requirements178
2
Media Objects180
2
MPEG-4 Version 1182
1
MPEG-4 Version 2183
5
Extensions to MPEG-4 Beyond Version 2188
1
Profiles in MPEG-4189
3
Verification Testing: Checking MPEG's Performance192
1
MPEG-4 Standardization Process193
1
Requirements for MPEG-4194
1
MPEG-4 Systems195
1
MPEG-4 Systems Architecture196
3
Elementary Stream Management (ESM)199
2
Auxiliary Descriptors and Streams201
2
Structuring Content by Grouping of Streams203
1
Managing Content Complexity203
1
Distributed Content-Handling Considerations204
1
System Decoder Model (SDM) for ES Synchronization204
1
MPEG-4 Systems BIFS205
5
DMIF210
3
DMIF Computational Model213
1
MPEG-4 Video214
2
Shape-Coding Tools for MPEG-4 Natural Video216
1
Motion Estimation and Compensation217
1
Texture-Coding Tools218
2
Multifunctional Coding220
1
Sprite Coding221
1
Scalability221
2
Error Resilience223
1
Relationship Between Natural and Synthetic Video Coding223
2
Synthetic Images225
1
Integration of Face Animation with Natural Video226
1
FAPs227
5
Face Model232
1
Coding of FAPs233
2
FIT235
1
Integration of Face Animation and Text-to-Speech (TTS) Synthesis235
1
BIFS for Facial Animation236
1
2D Mesh Coding237
1
VO Tracking238
1
2D-Mesh Object Encoder/Decoder239
4
MPEG-4 Audio243
1
MPEG-4 Natural Audio Coding244
1
General Audio Coding (Advanced Audio Coding Based)244
4
Twin VQ248
1
Speech Coding in MPEG-4 Audio248
4
Scalability in MPEG-4 Natural Audio252
1
Synthetic Audio in MPEG-4252
3
Audio BIFS255
1
Profiles and Levels in MPEG-4256
1
Visual Object Types256
3
Visual Profiles259
1
Audio Object Types260
1
Audio Profiles261
1
Graphics261
1
Systems Profiles261
1
MPEG-4 Visual Texture Coding (VTC) and JPEG 2000 Image Compression Standards
262
20
JPEG 2000 Development Process263
4
Overview of Still-Image Coding Standards267
1
MPEG-4 VTC267
1
JPEG267
1
PNG268
1
Significant Features of JPEG 2000268
1
Region of Interest (ROI) Coding268
1
Scalability268
1
Error Resilience269
1
IPRs269
1
Architecture of JPEG 2000269
6
JPEG 2000 Bit Stream275
2
Compression Efficiency Comparisons277
4
Error Resilience281
1
MPEG-7 Standardization Process of Multimedia Content Description
282
19
Objective of the MPEG-7 Standard282
3
Status of the MPEG-7 Standard285
1
Major Functionalities in MPEG-7286
1
MPEG-7 Systems286
3
MPEG-7 DDL289
1
MPEG-7 Audio289
1
MPEG-7 Visual290
7
MPEG-7 MMDSs297
2
MPEG-7 Reference Software (XM)299
1
MPEG-7 Conformance299
1
Applications Enabled by MPEG-7300
1
MPEG-21 Multimedia Framework
301
7
Audiovisual Content Representation Issues303
1
Description of a Multimedia Framework Architecture304
1
MPEG-21 Digital Item Declaration304
1
Content Representation305
1
Digital Item Identification and Description305
1
Content Management and Usage305
1
Intellectual Property Management and Protection305
1
Terminals and Networks306
1
Event Reporting306
1
Requirements for Digital Item Declaration306
2
ITU-T Standardization of Audiovisual Communication Systems
308
36
ITU-T Standardization Process308
2
Audiovisual Systems (H.310, H.320, H.321, H.322, H.323, and H.324)310
2
H.320 Standard312
1
Standards for Audiovisual Services Across ATM H.310 and H.321312
3
Standard H.322---Guaranteed QoS LAN Systems315
2
ITU-T H.323 Standard317
2
H.324 Standard319
1
Video-Coding Standards (H.261, H.263 and H.26L)319
1
H.261 Standard319
4
H.263 Standard323
4
H.263+ (H.263 Version 2) Standard327
5
H.263++ Standard Development332
1
H.26L Standard333
3
ITU-T Speech-Coding Standards336
2
Bit Rate338
1
Delay338
1
Complexity339
1
Quality339
1
Multimedia Multiplex and Synchronization Standards340
1
ITU-T Recommendation H.221341
1
ITU-T Recommendation H.223341
1
ITU-T Recommendation H.225341
2
Common Control Protocol H.245343
1
IETF and Internet Standards
344
26
IETF Standardization Process344
3
Internet Network Architecture347
1
Internet Protocols348
2
Classical IP Stack350
1
IP Version 6351
1
Priority Field352
1
Flow Label353
1
IPv6 Addresses353
2
Hop-by-Hop Options Header355
1
Fragment Header356
1
Routing Header356
1
IPv6 Security357
2
Real-Time Multimedia Transmission Across the Internet359
1
Signaling360
1
Session Control360
1
Transport361
2
Network Infrastructure363
1
Multimedia Data for Network Use364
1
MPEG-4 Video Transport Across the Internet365
1
Use of RTP365
1
System Architecture366
2
MPEG-4 Server368
1
MPEG-4 Client369
1
Multimedia Communications Across Networks
373
124
Packet Audio/Video in the Network Environment
373
9
Packet Voice374
3
Integrated Packet Networks377
3
Packet Video380
2
Video Transport Across Generic Networks
382
29
Layered Video Coding386
1
Layered Compression386
2
Layered Transmission388
1
Error-Resilient Video Coding Techniques388
2
Error-Resilient Encoding390
2
Decoder Error Concealment392
1
Error-Resilient Entropy Code393
1
Scalable Rate Control394
2
Rate Control Techniques396
1
Theoretical Foundation of the SRC397
3
Streaming Video Across the Internet400
1
Video Compression401
2
Requirements Imposed by Streaming Applications403
1
Application Layer QoS Control404
3
Continuous Media Distribution Services407
2
Streaming Servers409
1
Media Synchronization409
1
Protocols for Streaming Video410
1
Multimedia Transport Across ATM Networks
411
13
Multiplexing in ATM Networks412
1
Video Delay in ATM Networks413
4
Errors and Losses in ATM417
3
MPEG Video Error Concealment420
1
Loss Concealment420
1
Video Across WATM Networks421
1
Heterogeneous Networking422
2
Multimedia Across IP Networks
424
8
Video Transmission Across IP Networks424
2
Traffic Specification for MPEG Video Transmission on the Internet426
1
Bandwidth Allocation Mechanism427
1
Fine-Grained Scalable Video Coding for Multimedia Across IP428
4
Multimedia Across DSLs
432
9
VoDSL Architecture433
5
Delivering Voice Services Across DSL438
1
Multimedia Across ADSL439
1
Serial Transmission: TDM439
2
Parallel Transmission Frequency Division Multiplexing441
1
Internet Access Networks
441
8
DSL Networks443
2
Cable Access Networks445
2
Fixed Wireless Routed for Internet Access447
2
Multimedia Across Wireless
449
39
Wireless Broadband Communication System (WBCS) for Multimedia451
2
Audiovisual Solutions for Wireless Communications453
5
Mobile Networks458
1
Speech Transmission in GSM459
1
Video Across GSM460
2
Mobile ATM462
1
Mobile IP462
5
Wireless Multimedia Delivery467
2
SIP in Mobile Environment469
1
Multicast Routing in Cellular Networks470
1
Broadband Wireless Mobile471
2
Broadcasting Networks473
4
Digital Video Broadcasting (DVB)477
1
Data Transmission Using MPEG-2 and DVB478
2
MPEG Program Stream480
1
MPEG Transport Stream481
3
Broadband Multimedia Satellite Systems484
2
Multimedia Home Platform486
1
Multimedia Car Platform487
1
Digital Television Infrastructure for Interactive Multimedia Services
488
5
Interactive Broadcast Data (IDB) Services490
2
Data Carousel Concept492
1