Index

1-bit quantization (black and white), 27

1-pass CBR, 286, 483

1-pass codecs, 144–7

1-pass quality-limited VBR, 286

2-pass bitrate VBR, 286

2-pass CBR, 285

2-pass codecs, 147–8

3/4 UMatic, 82

3GPP formats, 438

3-pass codecs, 148

4:1:1 sampling, 25–6

4:2:0 sampling, 25

4:2:2 sampling, 25

4:2:2 vs. 4:4:4 vs. 4:2:0 vs. 4:1:1 vs. “RAW”, 77

4:4:4 sampling, 25

4 × 4 blocks, of H.264, 227

8-bit audio, 32

8-bit grayscale, 28

8-bit per channel, 27

8 mm camcorder format, 82

10-bit 4:2:2, 30

12-bit 4:4:4, 30

16:9 versus 4:3 devices, 72–3

16-bit audio, 32

16-bit color, 28

16-bit depth, 31

20-bit audio, 32–3

24-bit audio, 33

“24p”

in 720p bitstreams, 168

DVD, 412

in interlaced stream, 167–8

32-bit and 64-bit float, 33

32-bit floating-point, 31–2

.ismc, 480, 481

.NET, 473–4, 476, 477

.wma file format, 341

μ-Law, 558

A

AAC, + 216

AAC encoders

Apple (QuickTime and iTunes), 216–17

Coding Technologies (Dolby), 220–1

encoding strategies, 218–20

in flash, 466

Microsoft AAC-LC implementation, 221

MPEG-4 export vs. QuickTime export, 217

quality, 218

AAC Low Complexity (AAC LC), 60, 215, 556

AACS, 410, 411

AC-3, 171–2

ACELP.net, 347

Acquisition, 65, 84

audio connections, 88–91

video connections, 84–8

ActionScript Audio Codecs, 466

Active picture, 115

Adaptive deadzone (ADZ), 323

Adaptive Multi-Rate (AMR), 200

Adaptive streaming, 381–4, 460, 461

Additive VBR, 160–1

Adobe Flash Media Live Encoder (AFMLE), 467

Adobe Media Encoder, 466

Adobe Media Encoder CS4, 270

ADPCM, 270

Advanced Audio Coding (AAC), 171, 200

encoders, 216–21

high efficiency AAC v1, 216

high efficiency AAC v2, 216

M4A file format, 215

profiles, 215–16

Advanced Simple Profile (ASP), 138, 205–6, 207

Advanced System Format (ASF), 279

Advanced Television Standards Committee (ATSC), 70, 175

Advanced Video Coding (AVC), 224

AES/EBU, 90

A-Law, 558

Alpha channel, 258, 262

Alternates, 547–50

AMR Narrowband, 556

Analog SD, capturing, 91

Animation, 555

Antialiasing, 98

Apple, 181, 215, 216–17, 247, 430, 431, 523, 526, 527, 530, 535, 540, 541, 543, 544, 551

Apple Lossless, 556

Apple TV, 432

Arithmetic coding, 40

Aspect ratio/pixel shape, 149

ATSC, see Advanced Television Standards Committee

Audience, 62–3

Audio

Dolby Digital (AC-3), 171–2

DTS (Digital Theater Systems), 172–3

MPEG-1 audio, 169–70

MPEG-2 audio, 170–1

MPEG audio, 173

Audio codecs, 157, 556–8

ActionScript, 466

bit depth, 158

CBR and VBR, 159–61

channels, 158–9

data rate, 159

encoding speed, 161

FLV, 269–70

general-purpose codecs vs. speech codecs, 157

in-box, 513

MPEG-4, 200

QuickTime, 556–8

RealPlayer, 361–2

sample rate, 158

tradeoffs, 161

bit depth, 162

CBR vs. VBR, 162

channels, 162

data rate, 162

sample rate, 161

stereo encoding mode, 162

Windows Media, 432

Audio compression, 58

audio rate control, 60

sub-band compression, 58–60

Audio connections, 88

AES/EBU, 90

balanced, 89–90

optical, 90–1

S/PDIF (Sony/Philips Digital InterFace), 90

unbalanced, 89

Audio noise reduction, 135

Audio-only files for devices, 439

Audio preprocessing, 134

audio noise reduction, 135

dynamic range compression, 135

normalization, 134–5

Audio rate control, 60

Audio sample rate, 158

Audio tracks, 537

Authoring codecs, 553

Authoring Dynamic Streaming, 462

Authoring tools, 560–1

Automatic Keyframes, 260

AVCHD, 80

AVC-Intra, 97

Average bit rate (ABR), 160, 186, 188, 219

AVI (Audio Video Interleave), 510–11

Avid, formation of, 524

AVI/DivX/Xvid, 438–9

AVISynth, 114, 124, 128, 506

B

Balanced audio connections, 89

Balanced mediocrity, 63–4

Baseline profile, 233

BD-J, 410

BD-R, 411

BD-RE, 411

Betacam, 83

Betacam SX, 83

B-frame, 54, 152, 204, 242, 320–1

B-Frame Delta QP, 323

Bicubic, 124

Bilinear, 123–4

Binary Format for Scene (BIFS), 193, 197–8

Bink, 367

business model, 369

encoder, 368

file format and codecs, 368

need for, 367

playback, 369

Bit depth, 158

and color space, 149

Bit rate, 157, 158, 241, 486

Bits, 35

Bitstream, 137

BitTorrent, 381

Black-body colors, 1

Blanking areas, 115

BlindPP, 129

BlindPP filter, 107

Blocking, 49

Blu-Ray, 172, 173, 317–18

audio, 408–10

interactivity, 410

mastering, 410–11

tech specs, 405–6

video codecs, 406–8

Bob, 112, 113

Boxes, 194–5

Brightness, 130

Broadcast delay, 293

Broadcast standards, 68

ATSC (Advanced Television Standards Committee), 70

NTSC (National Television Systems Committee), 68–9

PAL (Phase Alternating Line), 69

SECAM (Système Électronique pour Couleur Avec Mémoire), 70

C

CABAC entropy coding, of H.264, 232

CableLabs, 176

CableLabs specs, 430

Cannon connectors, 90

Canopus ProCoder, 179–80

Capture

analog SD, 91

codecs, 95

AVC-Intra, 97

Cineform, 96

DNxHD, 96

DV, 95

FFV1, 96

Huffyuv, 96

Lagarith, 96

Motion JPEG, 95

MPEG-2, 96–7

ProRes, 96

uncompressed, 95

component analog, 91–2

data rates for, 97–8

digital, 92

from screen, 92–5

Carbon, 491

Carbon/AFMES Settings, 469

Carbon coder, 363, 364

CBox, 3, 93

CBR, see Constant bitrate

CD-ROM, QuickTime for, 541

CE devices, 426–7

Channels, 158–9, 162

Chroma adjustment, 132

hue, 133

saturation, 132

Chroma coding and macroblocks, 49–50

Chroma subsampling, 109

CIE (Commission Internationale de l’Eclairage), 5

Cilia, 12

Cineform, 96, 514

CinemaCraft MPEG-2, 181

Cinepak, 512

CineVision PSE, 306, 333

CMYK color space, 26–7

Coaxial (coax) connections, 84–5

Codebook, 36

Code-Excited Linear Prediction (CELP), 200, 351

Coding Technologies (Dolby), 220–1

Co-location, 386

Color correction, 129

Color Look Up Table (CLUT), 27

Color space conversion

601/709 convertion, 109

chroma subsampling, 109

dithering, 109–10

Color spaces, 22

CMYK color space, 26–7

RGB, 22–3

RGBA, 23

Y’CbCr, 23–6, 29–30

Common Language Infrastructure (CLI), 474

Communication goals, 62

Component analog, capturing, 91–2

Component RGB, 86

Component Y’CbCr video, 85–6

Composite video, 85

Compression, 66

Compression efficiency

of FLV, 258

of H.264, 224

Consoles, 241

Constant bitrate (CBR), 60, 160, 186, 188, 285

vs. variable bitrate (VBR), 159–61, 162

“Constrained Baseline” profile, 233

Consumer electronics, 203, 424–5

Content delivery networks (CDNs), 385–6

Context Adaptive Variable Length Coding (CAVLC) mode, 232

Contrast, use of, 130–1

Conventional MP3 decoder, 191

CoreAVC, 507

Cropping, 115

edge blanking, 115–17

letterboxing, 117–19

safe areas, 119–21

CRT monitors, 116

Custom quantization tables, 204

D

D1, 83

D2, 83

D5, 83

D5 HD, 83

D9 (Digital-S), 84

Data compression, 37

general-purpose compression, 37–8

small increases in compression, 38

well-compressed data, 37

Data rate modes, 285–6

Data rates, 138, 159, 162

1-pass, 144–7

2-pass, 147–8

3-pass, 148

compression efficiency, 139–41

rate control, 141

VBR and CBR, 141–4

Deblock, 129

Decibels (dB), 13

Decoder performance

of FLV, 258

of H.264, 225

Default.html, 481

Deinterlacing, 110

blend, 112

bob, 113

field elimination, 111

motion adaptive, 111

motion search adaptive, 111–12

spatial adaptive, 111

Delivery, 66

Desktop Window Manager (DWM), 93, 95

Device revolution, 530

Device video, uniqueness of, 427

DGDecode, 106, 107

DialNorm, see Dialog Normalization

Dialog Normalization, 172

Differential Quantization (DQuant), 55, 232, 323–4

Digidesign, formation of, 524

Digital Betacam, 83

Digital capture, 92

Digital Living Network Alliance (DLNA), 429

Digital rapids, 491–2

Digital rights management (DRM), 489

Digital video workflow, 61

acquisition, 65

compression, 66

delivery, 66

planning, 61–4

postproduction, 64–5

preprocessing, 65

production, 64

DirectShow, 504

Discrete cosine transformation (DCT), 41

chroma coding and macroblocks, 49–50

Fourier, 41

frame, finishing, 50–1

quantization, 44–7

ringing and blocking, 49

scale factor and quantization parameter, 47

versus wavelet, 76

DisplayPort, 87

Display Window Manager (DWM), 502

Dithering, 109–10

DivX, 199, 207, 208

DivX Inc., 202

DivX Media Format (DMF), 202

DivX Networks, 202, 438

DivX/Xvid, 514–15

DivX/Xvid Saga, 201–2

DLL hell, 505

DNxHD, 96

Dolby Digital (AC-3), 171–2, 401, 409

Dolby Digital Plus, 172, 409

Dolby Pulse, 216, 220

Dolby TrueHD, 172, 409

DOS, 497

Downloadable file, 375

Downscaling, 122

DQuant, see Differential Quantization

Drive speed, 97–8

Drop frames option, 259, 268

DTS (Digital Theater Systems), 172–3

audio codec, 401

Master Audio (DTS-MA), 409–10

DTS-ES, 172

DTS-HD High-Resolution Audio, 409

Duplicated disc, 398

DV, 78, 95

DV 100, see DVCPRO-HD

DV25, 512, 554

DV audio record, in 48 kHz 16-bit, 73

DVB, 70, 176

DVCPRO50, 78, 554

DVCPRO-HD, 78–9, 554

DVD + R, 404

DVD + RW, 404

DVD, 396

aspect ratio, 398–9

audio, 400–1

disc playback, characteristics of, 395

interactivity, 402

mastering, 402–4

MPEG-2 for, 397–8

multi-angle DVD, 399–400

progressive DVD, 399

tech specs, 397

DVD-R, 403

DVD-RAM, 404

DVD-R DL, 403

DVD-RW, 403

DV/DVCPRO, 554

D-VHS, 82

DVI connectors, 86

DVPRO50, 78

DVR-MS, 515

DXVA, 505

Dynamic range compression, 135

Dynamic Streaming, 384, 461–2

E

Easy RealMedia Producer, 363, 365

Edge blanking, 115–17

Edge Noise Removal, 322

Encoder latency, 293–4

Encoders, for Windows Media, 294

Episode, 300–1

Expression Encoder, 295–7

Flip4Mac, 298–300

Windows Media Encoder, 297–8

WMSnoop, 301, 302

Encoding for devices, 439–40

Encoding mode recommendations, 328–9

Enterprise video, 278

Entropy coding, 36

CABAC, 232

in H.264, 242

Envivio, 491

Episode, 300–1

Episode Pro, 196, 271, 560

Expression Encoder, 114, 295–7, 491

Expression Encoder, 3, 95, 221, 287, 295, 297, 331, 442, 482, 483

Expression Encoder Screen Capture (EESC) application, 95

Extended profile, 234

F

F4V, 465

Fast Path player, 477

Fast-Start, 197

ffdshow, 505–6

ffmpeg, 272

FFT3DFilter, 128–9

FFV1, 96

FhG, 185, 187

Fidelity Range Extensions (FRExt), 223, 234

Filter settings

Edge Noise Removal filter, 322

Noise Reduction filter, 322

Final Cut Pro, 528

Final Cut Studio (FCS), 531

FireWire, 87–8

Flagship Flix Pro, 271

Flash, 238, 240, 271, 457, 540

Adobe Flash Media Encoding Server, 467

Adobe Flash Media Live Encoder (AFMLE), 467

codec support, 459

for conferencing, 462

Dynamic Streaming, 384, 461–2

early years, 457

encoding, 559

encoding tools for, 466

Adobe Media Encoder, 466

Sorenson squeeze, 467

of FLV, 258

formats and codecs, 463

AAC in, 466

ActionScript Audio Codecs, 466

F4V, 465

FLV, 465

H.264 in, 465

MP3, 465

for interactive media, 462

H.264 era, 458–9

mobile and CE devices, 459

for phones, 462–3

playback performance, 460

for progressive download, 460

for real-time streaming, 460–1

Rhozet Carbon, 467

streaming technologies, 460

ubiquitous player, 459

uniform rich cross-platform/browser experience, 459

video, introduction of, 458

VP6 and video breakout, 458

Flash Lite 2.0, 463

Flash Lite 3.1, 463

Flash Media Server (FMS), 196, 460

Flash Media Server 2.0, 458

Flash Video (FLV), 257, 458

audio codecs, 269

ADPCM, 270

MP3, 269–70

Nellymoser/Speech, 270

PCM, 270

drawbacks, 258–9

green/blue screen vs. chroma-keyed, 276

need for, 257

alpha channels, 258

compatibility with older versions of Flash, 257

decoder performance, 258

On2 VP6 codec, 262

alpha channel, 262

new VP6 implementation, 264

VP6 options, 264–9

VP6-S, 264

Sorenson Spark (H.263), 259, 260

Automatic Keyframes, 260

Image Smoothing, 260

Minimum Quality, 259

playback scalability, 262

Quick Compress, 259

tools, 270

Adobe Media Encoder CS4, 270

ffmpeg, 272

Flix, 271

QuickTime Export Component, 271

Sorenson Squeeze, 271–2

Telestream Flip4Factory and Episode, 271

Flip4Mac, 298–300, 301, 558

Flix, 267, 271

Flix Exporter, 264, 271

Flix Standard, 271

Floating-point, 31–2

FLV, see Flash Video

fMP4, 195, 197, 478

FMS, see Flash Media Server

Foliage blowing, compression of, 74

Formats for devices

audio-only files for devices, 439

AVI/DivX/Xvid, 438–9

MPEG-4, 437–8

Windows Media and VC-1, 438

Fourier, Joseph, 41

Fovea, 4

Fractal compression, 57–8

Fragmented MPEG-4 file, see fMP4

Frame rate, 133–4, 149

B-frames, 152

inserted keyframes, 152

keyframe rate/GOP length, 151

Frame size, 148

and rates, 91

analog SD, capturing, 91

codecs, capturing, 95–7

component analog, capturing, 91–2

digital, capturing, 92

screen, capturing from, 92–5

FRAPS, 95

Fundamentals of compression

alternate transforms, 56

fractal compression, 57–8

wavelet compression, 56

audio compression, 58

audio rate control, 60

sub-band compression, 58–60

data compression, 37–8

information theory, 35–7

perceptual optimizations, 55–6

rate control, 55

spatial compression, 38–51

temporal compression, 51–4

FutureSplash Animator, 257, 457

G

G3 processor and PC Convergence, 527

G4 processor, 529

G5 processor, 530

Gamma adjustment, 131–2

General-purpose codecs vs. speech codecs, 157

Global motion compensation (GMC), 204

GOP settings, 320–1

GraphEdit, 504

Green/blue screen vs. chroma-keyed, 276

H

H.262, 163

H.263 codec, 552

H.264, 67, 108, 138, 199, 201, 203, 224, 440, 458–9, 530, 551

Baseline profile, 423

drawbacks

decoder performance, 225

licensing costs, 225

profile support, 225

Windows out of box, 225

encoders

Main Concept, 243–4

Microsoft, 250

QuickTime, 247–50

Telestream, 246

x264, 245–6

in flash, 465

need for

compression efficiency, 224

ubiquity, 224

profiles

Baseline, 233

Extended, 234

High, 234–5

Intra, 235

Main, 234

Scalable Video Coding (SVC) profiles, 235–8

settings, for H.264 encoding

B-frames, number of, 242

bitrate, 241

entropy coding, 242

in-loop deblocking, strength of, 243

level, 241

profile, 241

pyramid B-frames, 242

reference frames, number of, 243

slices, 242

uniqueness, 226

4 × 4 blocks, 227

CABAC entropy coding, 232

differential quantization, 232

flexible interlaced coding, 231–2

logarithmic quantization scale, 231

modes beyond 8-bit 4:2:0, 233

multiple reference frames, 229–30

pyramid B-frames, 230–1

quantization weighting matrices, 232–3

quarter-pixel motion precision, 229

strong in-loop deblocking, 227–8

variable block-size motion compensation, 229

weighted prediction, 231

usage

Consoles, 241

Flash, 238–40

Portable Media Players, 241

QuickTime, 238

Silverlight, 240

Windows, 7, 240

H.265 and next-generation video codec, 254–5

H.26L, 223

Haali Media Splitter, 506–7

Hardware-accelerated transcoding, 508

Harmonics, 10

HC Encoder (HcEnc), 181

HDCAM, 80

HDCAM-SR, 84

HDCP, 87

HD DVD, 412

HDMI, 87

HDMV, 410

HD-SDI, 88

HDV, 79–80, 554

Hearing, 1, 10

capability, 13–14

ear, working mechanism of, 12

psychoacoustics, 14

sound, mechanism of, 10–12

Helix DNA Client, 359

Hi8, 82

High, 10, 234–5

High Efficiency AAC (HE AAC), 216

High Profile, 138

Hint tracks, 195–6, 537

Holy Grail, 84

Hosting, 385

hosting services, 385–6

in-house hosting, 385

HTTP Live Streaming, 543–5

Hue, Saturation, and Lightness (HSL), 34

Huffman coding, 36

Huffyuv, 96, 514

I

I-frames, 51–2, 55

iLBC, 556

IMA audio codec, 557

Image Smoothing, 260

IMX, 80, 554

Indexed color, 27–8

In-house hosting, 385

Inlet, 491

Inlet Fathom, 331–2

In-loop deblocking, strength of, 243

In-Loop filter, 322

Inserted keyframes, 152

Instantaneous Decoder Refresh (IDR), 229–30

Intelligent Streaming, 288, 461

Intel switch, 531

Intensity, 93

Interframe vs. intraframe codecs, 76

Interlaced support, 205

Interlaced video, 71–2, 166–8

Interoperable DRM, 278

Intra profiles, 235

Inverse telecine, 113–14

iPod, 530

iPod classic/nano/touch and iPhone, 430–2

IPTV, 318

ISO MPEG-4, 284

Iterated Function System, see Fractal compression

iTunes, 430

iTunes .m4p file, 215

J

Joint Video Team (JVT), 223, 224

K

Keyframe rate/GOP length, 151

Keyframe strobing, 151

L

Lab color mode, 26

Lagarith, 96, 514

LAME, 60, 187

average bit rate, 188

constant bit rate, 188

quality, 188–9

variable bit rate, 188

Lancsoz, 125

Last floating-point DCT, 205

Legacy Audio Codecs, 557–8

Legacy Windows Media Video Codecs, 283–4

Letterboxing, 117–19

Level, 137, 138

Licensing costs, 225, 306

Light, introduction to, 1–2

Live broadcasting, QuickTime for, 543

Live smooth streaming, 487

Live streaming, 287–8

Logarithmic quantization scale, of H.264, 231

Lookahead parameter, 321

Lookahead Rate Control (LRC), 293, 321

Lossy and lossless compression, 38

Low-latency webcasting, 293

Low-pass filtering, 127

Low power PC playback, 203

Luma adjustment, 129

normalizing black, 130

Luminance, 23

LZ77 (Lempel Ziv 1977) algorithm, 39–40

LZW (Lempel-Ziv-Welch) algorithm, 39–40

M

M4A file format, 215

Mac, as media platform

Avid, Digidesign, and Radius, formation of, 524

birth, 523

clones, buying, 526

Final Cut Pro, 528

G3 Era and PC convergence, 527–8

G4 Era, 529

Macintosh II, 523–4

Mac OS X, 527

Macromind Director, 525

Multimedia Mac, 525

PowerPC Switch, 525–6

QuickTime, 527

QuickTime 1.0, 525

QuickTime, 2, 525

QuickTime 2.5 and QuickTime Media Layer, 526

QuickTime, 4, 528

QuickTime, 5, 528–9

QuickTime 6 and MPEG-4, 529

QuickTime v3, 526

System, 7, 525

MACE (Macintosh Audio Compression and Expansion), 558

Macintosh II, 523–4

Mac OS X, 529–30

device revolution, 530

G5 Era, 530

Intel Switch, 531

Mac, reduced focus on, 531–2

QuickTime 7 and H.264, 530–1

Snow Leopard and QuickTime X, 532–3

MacOS’s Quartz, 95

Macroblock Adaptive Field-Frame (MBAFF), 231

Macroblocks, 49–50

Macromedia, 257

Macromind Director, 525

Main profile, 138, 234, 309, 311–12

Master Movie, 548

Matroska container format (MKV), 350

Media, on Windows, 497

DOS, 497

formats, 510

.WAV file format, 515

AVI (Audio Video Interleave), 510–11

AVI versions, 511

DVR-MS, 515

In-Box Audio Codecs, 513

In-Box Video Codecs, 511–12

MPEG-1, 516

MPEG-2, 516

MPEG-4, 516

third-party AVI Codecs, 514–15

Windows Media, 515

NetShow, 499

Silverlight, 509

VLC, 509

Windows, 1–2, 497

Windows 3.0/3.1, 498

Windows, 7, 502–3

Windows 95/98/Me, 498–9

Windows 2000, 500

Windows APIs for Media, 503

DirectShow, 504–7

Media Foundation, 507–8

Video for Windows (VfW), 503–4

Windows Media Format SDK, 508

Windows Media 9 Series, 501

Windows Media Center, 510

Windows Media launches, 500

Windows Media Player, 508–9

Windows NT, 499–500

Windows Vista, 502

Windows XP, 500–1

Zune Media Player, 509

Media Center Extender, 510

Media Foundation (MF), 507

MediaPlayerTemplate.xap, 481

MediaStreamSource, 476

Mezzanine files, 106

Microsoft, 246, 250, 527

Microsoft AAC-LC implementation, 221

Microsoft Media Server (MMS) protocol, 287

Microsoft RLE, 512

Microsoft Video, 1, 512

Mobile, 203

and CE devices, 459

Mod16, 104, 126

Moonlight, 473

Mosquito noise, 49

Motion

blur, 74, 98–9

camera, 75

Motion adaptive deinterlacer, 111

Motion estimation, 52

Motion-JPEG, 95, 555

Motion Match Method, 326

Motion search adaptive deinterlacer, 111–12

Motion Search Level, 324–5

Motion Search Range, 325

Moving Picture Experts Group (MPEG), 163, 193

MP3, 185, 269–70, 465, 490

encoding examples, 189–90

FhG, 187

LAME, 187

average bit rate, 188

constant bit rate, 188

quality, 188–9

variable bit rate, 188

modes, 186

Joint Stereo, 187

Mid/Side encoding, 187

mono, 186

Normal Stereo, 187

mp3Pro codec, 190–1

rate control modes, 185

ABR, 186

CBR, 186

VBR, 186

MPEG-1, 163, 516, 537–8

audio, 169–70

for universal playback, 173–4

video codec, 165–6

MPEG-2, 96, 106–7, 163–4, 181, 516

audio, 170–1

for authoring, 174

for broadcast, 174

ATSC, 175

CableLabs, 176

DVB, 176

encoding tools, 179

of Apple, 181

Canopus ProCoder, 179–80

CinemaCraft, 181

HC Encoder (HcEnc), 181

Main Concept, 180

Rhozet Carbon Coder, 180

Layer II, 403

video encoder, 166

interlaced video, 166–8

and MPEG-3, 168

profiles and levels, 169

MPEG-3, 168

MPEG-4, 193, 516, 535

architecture, 194

audio codecs, 200

Adaptive Multi-Rate (AMR), 200

Advanced Audio Coding (AAC), 200

Code-Excited Linear Prediction (CELP), 200

codec, 551–2

file format, 194, 439–40

BIFS, 199–8

boxes, 194–5

Fast-Start, 197

fragmented MPEG-4 files, 197–8

tracks, 195–7

and H.264, 489–90

players, 198–9

profiles and levels, 199

in QuickTime, 542

streaming, 198

video codecs, 199

H.264, 199

MPEG-4 part, 2, 199

VC-1, 199

MPEG-4 export vs. QuickTime export, 217–18

MPEG-4 part, 10, 224

MPEG-4 part 2 video codec, 199, 201

DivX/Xvid Saga, 201–2

drawbacks

H.264/VC-1, 203

lower efficiency, 203

implementations

DivX, 207, 208

QuickTime, 209, 211

Sorenson Media, 208, 210

Telestream, 209, 211

Xvid, 208, 209

levels, 206–7

need for, 202

consumer electronics, 203

low power PC playback, 203

mobile, 203

profiles

Advanced Simple Profile (ASP), 205–6

short header, 205

Simple Profile, 205, 439

Studio Profile, 206

uniqueness, 204

B-frames, 204

custom quantization tables, 204

global motion compensation (GMC), 204

in-loop deblocking filter, 205

interlaced support, 205

last floating-point DCT, 205

quarter-pixel motion compensation, 204

MPEG audio, 173

MPEG compression

2-pass VBR, 177

352 from 704 from 720, 176–7

aspect ratios, 177

field order, 177–8

high-quality modes, 177

light hand, preprocess with, 179

minimum bitrate, 178–9

progressive best effort, 178

reference frames minimization, 178

MPEG file formats

elementary stream, 164

program stream, 164

transport stream, 164

MPEG IMX, 554

MPEG Licensing Authority (MPEG-LA), 305

MS MPEG-4 versions, 284

Multi-angle DVD, 399–400

Multibitrate encoding, 544

Multicasting, 380–1

Multimedia Mac, 525

Multiple bitrate encoding (MBR), 379–80

Multiple language audio, 487

Multiple reference frames, of H.264, 229–30

Multithreaded Multiple Bitrate Encoding Hotfix, 292

Music tracks, 539

N

National Television Systems Committee (NTSC), 68–9

Nearest-neighbor, 123

Nellymoser/Speech, 270

NetShow, 277, 499

NeXT, 527

NGV (Next Generation Video), 360

Noise reduction, 126, 322

blurring, 127

low-pass filtering, 127

sharpening, 127

spatial noise reduction, 128

temporal noise reduction, 128–9

None codec, 556

Nonlinear editing systems (NLEs), 30

NTSC, see National Television Systems Committee

NVidia Tegra chip, 433

Nyquist frequency, 16–19

O

Ogg

compression efficiency, 349

Dirac, 352–3

file format, 350

MKV, 350

OGM, 350

OGV, 350

FLAC (Fast Lossless Audio Codec), 351–2

free format, preference for, 349

licensing costs, avoid, 349

native embedding in firefox and chrome, 349

OGV, encoding, 353–4

Speex, 351

support, 350

Theora, 352

Vorbis, 60, 350–1

OGM, 350

encoding, 353–4

OGV, 350

On2, 352, 458

On2 VP6 codec, 262

alpha channel, 262

new VP6 implementation, 264

VP6 options, 264–9

VP6-S, 264

On-demand streaming, 287

Open/closed GOP, 152–3

Open Media Project (OMP), 463

Open Specification Promise, 474

Optical audio connections, 90–1

Optimal viewing distances, for device screens, 424

Overlap filter, 322

Overtones, 10–11

P

PAL (Phase Alternating Line), 68, 69

Palette, 27

Pan-and-scan, 117, 118

Pay A Lot, see PAL

PCM, 171, 270, 400, 408–9

Peer-to-peer (P2P), 381

Perceptual optimizations, 55–6

Perceptual Options, 322–4

Adaptive deadzone (ADZ), 323

B-Frame Delta QP, 323

DQuant, 323–4

In-Loop filter, 322

Overlap filter, 322

Perfection At Last, see PAL

Perian, 559

P-frames, 52–4

Phones and devices, 423

CE devices, 426–7

consumer electronics, 424–5

content, getting, 427

adaptive streaming to devices, 428

attached storage via USB, 427

progressive downloading to devices, 428

sharing to devices, 429

sideloaded content, 428

standard streaming to devices, 428

walled garden, 430

device video, uniqueness of, 427

formats

audio-only files for devices, 439

AVI/DivX/Xvid, 438–9

encoding for devices, 439–40

MPEG-4, 437–8

Windows Media and VC-1, 438

note, devices of, 430

Apple TV, 432

iPod Classic/Nano/Touch and iPhone, 430–2

PlayStation, 3, 436–7

PlayStation, 3, 436–7

PlayStation Portable, 435–6

Xbox, 360, 434–5

Zune, 432–3

Zune HD, 433–4

portable devices, 425–6

portable media players, 423–4

Photosensitive ganglion cell (PGC), 3

Picture Adaptive Field-Frame (PAFF), 231

Planning, 61

audience, 62–3

balanced mediocrity, 63–4

communication goals, 62

content, 61

Playback scalability option, 262

Player latency, 294

PlayReady and Windows Media DRM, 289

PlayStation, 3, 436–7

PlayStation Portable (PSP), 435–6

PNG codec, 555–6

Portable devices, 425–6

Windows Media for, 288

Portable Media Players, 241, 423–4

Post-only formats, 81

Postproduction, 64–5, 98–102

PowerPC Macs, 474

PowerPC Switch, 525–6

Preprocessing, 65, 103

audio preprocessing, 134

audio noise reduction, 135

dynamic range compression, 135

normalization, 134–5

brightness, 130

chroma adjustment, 132

hue, 133

saturation, 132

color space conversion

601/709, 109

chroma subsampling, 109

dithering, 109–10

contrast, 130–1

cropping, 115

edge blanking, 115–17

letterboxing, 117–19

safe areas, 119–21

decoding, 105

H.264, 108

MPEG-2, 106–7

VC-1, 107–8

deinterlacing, 110

blend, 112

bob, 113

field elimination, 111

motion adaptive, 111

motion search adaptive, 111–12

spatial adaptive, 111

frame rate, 133–4

gamma adjustment, 131–2

inverse telecine, 113–14

luma adjustment, 129

normalizing black, 130

mixed sources, 114

noise reduction, 126

blurring, 127

low-pass filtering, 127

sharpening, 127

spatial noise reduction, 128

temporal noise reduction, 128–9

principles, 104–5

progressive source, 115

scaling, 121

aspect ratios, 121–2

downscaling, 122

mod, 16, 126

scaling algorithms, 122–6

scaling interlaced, 126

Preproduction, 70–1

Preview.png, 481

Processing order, 132

Production, 64, 67, 71–5

Production format, 76

3/4 Umatic, 82

4:2:2 vs. 4:4:4 vs. 4:2:0 vs. 4:1:1 vs. “RAW”, 77

8 mm, 82

AVCHD, 80

Betacam, 82

Betacam SX, 83

D1, 83

D2, 83

D5, 83

D5 HD, 83

D9 (Digital-S), 84

DCT vs. wavelet, 76

Digital Betacam, 83

DV, 78

DVCPRO-HD, 78–9

D-VHS, 82

DVPRO50, 78

HDCAM, 80

HDCAM-SR, 84

HDV, 79–80

Hi8, 82

IMX, 80

interframe vs. intraframe, 76

post-only formats, 81

RED cameras, 80–1

subsampled vs. full raster, 76

S-VHS, 82

tape vs. solid state vs. cable, 77–8

VHS, 81–2

XDCAM, 80

Profile, meaning of, 137–8

Profile support, of H.264, 225

Pro gear, 72

Progressive download, 375–7

Flash for, 460

QuickTime for, 541

Windows Media for, 286–7

Progressive DVD, 399

Progressive source, 115

Project Starlight, 478

Proprietary Memory Stick flash memory format, 435

ProRes, 96, 553–4

Protected Media Path, 507–8

Pyramid B-frames, of H.264, 230–1, 242

Q

QDesign Music codec, 557

Qualcomm PureVoice, 557

Quality@Perf, 305

Quality mode, 188–9

Quality VBR, 186

Quant errors, 33

Quantization, 19–22

errors, 33–4

levels and bit depth, 27

1-bit (black and white), 27

8-bit grayscale, 28

8-bit per channel, 27

16-bit color (high color/thousands of colors/555/565), 28–32

indexed color, 27–8

quantizing audio, 32–3

Quantization parameter (QP), 143

and scale factor, 47

Quantization weighting matrices, of H.264, 232–3

Quantizing audio, 32–3

Quantizing video, 19–21

Quarter-pixel motion compensation, 204

Quarter-pixel motion precision, of H.264, 229

Quick Compress, 259

QuickTime, 105, 194, 195, 209, 211, 238, 247–8, 250, 523, 535–6

alternate movies, 547–50

audio codecs, 556–8

authoring codecs, 553–6

authoring tools, 560–1

compression dialog, 545–7

delivery codecs, 551–3

files delivery in, 540

CD-ROM, 541

HTTP Live Streaming, 543–5

Live Broadcasting, 543

Progressive Download, 541

RTSP, 542–3

import/export components, 558–9

tracks, 536–40

QuickTime 1.0, 525

QuickTime, 2, 525

QuickTime 2.5, 526

QuickTime, 3, 526

QuickTime, 4, 528

QuickTime, 5, 528–9

QuickTime 6 and MPEG-4, 529

QuickTime, 7, 530–1

QuickTime Export Component, 271

QuickTime Format, 536

QuickTime Media Layer, 526

QuickTime Player Pro, 550, 560

QuickTime Player X, 561

QuickTime Pro, 105

QuickTime v3, 526

QuickTime VR (QTVR) track, 539–40

QuickTime X, 532–3, 561

R

Radius, formation of, 524

Random error diffusion, 110

Rate control, 55, 141

in Windows Media Audio Codecs, 341

Rate Distortion Theory, 55

Raw AV, 490–1

RealAudio, 10, 361

RealAudio 8 (RA8), 361–2

RealMedia, 357

codecs

NGV, 360

RealVideo, 10, 360

format, 358

need for, 357

RealAudio Codecs, 361

RealAudio, 8, 361–2

RealAudio, 10, 361

RealAudio Music, 362

RealAudio Surround, 362

RealAudio Voice, 361

Stereo Music, 362

RealPlayer, 358–9

RealVideo, for streaming, 359

progressive download, 360

SureStream, 359–60

RealVideo Encoding Tools, 362

carbon, 363, 364

Easy RealMedia Producer, 363, 365

RealProducer Basic, 362

Real Producer Plus, 363

RealNetworks, 357

Real Time Messaging Protocol (RTMP), 460

Real-time streaming, 377–81

flash for, 460–1

Silverlight for, 477–8

Real Time Streaming Protocol (RTSP), 195, 378

QuickTime for, 542–3

RED cameras, 80–1

Reference frames, 243

Replicated disc, 396, 402

RGB, 22–3, 511

RGBA, 23, 512

Rhozet Carbon/Adobe Flash Media Encoding Server, 467

Rhozet Carbon Coder, 180, 333

RIA (Rich Internet/Interactive Application), 457

Road Pizza, 553

ROM discs and local playback, Windows Media for, 286

Run-Length Encoding (RLE), 39, 555

S

Sample rate, 158, 161

Sampling sound, 16

Sampling space, 15–16

Sampling time, 16

Scalable Video Coding (SVC) profiles, 235

drawbacks, 237–8

need for, 237

profiles, 237

quality scalability, 237

spatial scalability, 236

temporal scalability, 236

usage, 238

Scaling, 121

algorithms, 122–5

aspect ratios, 121–2

downscaling, 122

interlaced, 126

Mod, 16, 126

Screen, capturing from, 92–5

Screen scraping, 93

SDK Hotfixes, 292

SECAM, 70

Seeing, 1

brain and vision, 5–6

color perceiving, 6–7

eye, mechanisms of, 2–5

light, introduction to, 1–2

luminance, perceiving, 6

motion, perceiving, 9–10

perceiving white, 7–8

space, perceiving, 8

Serial Digital Interface (SDI) connections, 88

Server latency, 294

Settings.dat, 482

Shannon limit, 38

SHED (Secure Hardware Encoding Decoders), 508

Short header, 205

Shutter speed, 74–5

Silverlight, 240, 279, 294, 473, 509

.NET tooling, 476

broad and extensible media format support, 476

encoding tools for, 491

Carbon, 491

Digital Rapids, 491

Envivio, 491

Expression Encoder, 491

grab networks, 492

inlet, 491

ViewCast, 491–2

formats and codecs for, 488

MP3, 490

MPEG-4 and H.264, 489

raw AV, 490–1

Smooth Streaming, 489–90

Windows Media, 488–9

history, 473–5

media format support, 476

movies, Silverlight enhanced, 476

performance, 477

for progressive download, 477

for real-time streaming, 477–8

Smooth Streaming, 476

authoring, 484–7

CBR, 482–3

file format, 478–82

IIS, 479

interactive media, Silverlight for, 487–8

silverlight, for devices, 488

VBR, 483–4

ubiquity, 477

uniform cross-platform/browser experience, 475–6

Simple Profile, 205, 207

of VC-1, 312

Skin track, 540

Slices, 242

Smooth Streaming

authoring, 484–7

CBR, 482–3

file format, 478–82

with H.264, 240

IIS, 479

interactive media, silverlight for, 487–8

silverlight, for devices, 488

VBR, 483–4

SmoothStreaming.xap, 482

Smooth Streaming Encoder SDK (SSESDK), 305–6, 316, 483, 484, 489

Snow Leopard, 532

Soft lighting, 73

Sorenson Media, 208, 210, 257

Sorenson Spark (H.263), 259, 260, 261

Automatic Keyframes, 260

Image Smoothing, 260

Minimum Quality, 259

playback scalability, 262

Quick Compress, 259

Sorenson Squeeze, 271, 467, 560–1

Sorenson Video 1 (SV1), 553

Sorenson Video 2 (SV2), 553

Sorenson Video 3 (SV3), 552

Spatial adaptive deinterlacer, 111

Spatial compression, 38

arithmetic coding, 40

chroma coding and macroblocks, 49–50

discrete cosine transformation, 41–9

frame, finishing, 50–1

LZ77 and LZW, advanced lossless compression with, 39–40

methods, 39

run-length encoding, 39

Spatial noise reduction, 128

S/PDIF (Sony/Philips Digital InterFace), 90

Spectral Band Replication (SBR), 216

Sprite tracks, 540

Standard QuickTime Compression Dialog, 545–7

Statmux, 174

Stereo encoding mode, 162

Stereo Music, 362

Streaming

RealVideo for, 359

progressive download, 360

SureStream, 359–60

Windows Media for, 287–8

Strong in-loop deblocking, of H.264, 227–8

Studio Profile, 206

Sub-band compression, 58–60

Subsampled vs. full raster format, 76

Subtractive VBR, 161

Super sampling, 125

SureStream, 359–60, 361, 461

S-VHS, 82

S-Video, 85

System, 7, 525

Systems process video luma, 21

System Stream, 164

T

Tape vs. solid state vs. cable format, 77–8

TCP (Transmission Control Protocol), 375, 378

TechSmith’s Camtasia, 93, 283

Telecined Video, 113–14

Telestream, 209, 246–7

Telestream Flip4Factory, 271

Telestream H.264 codec, 246–7

Temporal compression, 51

bidirectional prediction, 53–4

motion estimation, 52

prediction, 51–2

Temporal noise reduction, 128–9

Text track, 197, 538

Thumb.jpg, 481

Tracks, 195

hint tracks, 195–6

text tracks, 197

Tradeoffs, 161

bit depth, 162

CBR vs. VBR, 162

chanels, 162

data rate, 162

sample rate, 161

stereo encoding mode, 162

TrueHD, 93, 409

U

Ubiquity, of H.264, 224

UDF (Universal Disc Format) file system, 397

UDP streaming model, 378

UMD (Universal Media Disc), 435

Unbalanced audio connections, 89

Uncompressed capture codecs, 95

Uncompressed video and audio, 15

color spaces, 22

CMYK color space, 26–7

RGB, 22–3

RGBA, 23

Y’CbCr, 23–6, 29–30

gradients, 21–2

Nyquist frequency, 16–19

quantization, 19–21

and bit depth, 27–33

errors, 33–4

sampling sound, 16

sampling space, 15–16

sampling time, 16

Universal Plug and Play (UPnP), 429

UYVY/YUY2/YV16/HDYC, 512

V

V210, 512

VagueDenoiser, 129

Variable bitrate (VBR), 60, 80, 186, 285

and constant bitrate, 141–4, 159–61, 162

Variable block-size motion compensation, of H.264, 229

Variable resolution, working of, 317

VC-1 Encoder SDK, 290, 318

Vectorscope, 133

VGA capture systems, 93

VHS (Video Home System), 81

Video buffering verifier (VBV), 138, 141

Video Codec 1 (VC-1), 107–8, 199, 305

drawbacks

compression efficiency paramount, 306

licensing costs, 306

need for

CineVision PSE, 306

Quality@Perf, 305

Smooth Streaming, 305–6

Windows Media Compatibility, 305

tools for, 330

CineVision PSE, 333

Expression Encoder, 3, 331

Inlet Fathom, 331–2

Rhozet Carbon, 333

uniqueness, 306

16-bit integer iDCT, 307

block size, 306

dynamic resolution change, 309

in-loop deblocking filter, 308

intensity compensation, 308

Overlap transform, 307–8

quarter-pixel motion estimation, 307

usage

Blu-Ray, 317–18

IPTV, 318

Smooth Streaming, 315–17

Windows Media, 315

VC-1 encoding, advanced settings for, 320

encoding mode recommendations, 328–9

filter settings, 322

GOP settings, 320–1

high-quality live settings, 329–30

high-quality offline, 330

insane offline, 330

Lookahead, 321

Motion Estimation Settings, 324–6

Perceptual Options, 322–4

threads, number of, 326–7

VideoType, 326

VC-1 encoding, basic settings for, 318

buffer size, 319

complexity, 318–19

keyframe rate, 319

VC-1 profiles

Advanced Profile, 312–14

levels, in VC-1, 314–15

Main Profile, 311–12

Simple Profile, 312

and Windows Media Video, 9, 282

Video codecs, 137, 553

aspect ratio/pixel shape, 149

balanced mediocrity with video compression, 154–5

bit depth and color space, 149

bitstream, 137

data rates, 138

1-pass, 144–7

2-pass, 147–8

3-pass, 148

compression efficiency, 139–40

rate control, 141

segment re-encoding, 150

VBR and CBR, 141–4

encoder complexity, 153–4

frame rate, 149

B-frames, 152

inserted keyframes, 152

keyframe rate/GOP length, 151

frame size, 148–9

Level, 138

minimum frame quality, 153

open/closed GOP, 152–3

profile, 137–8

Video for Windows (VfW), 503–4

Video Object (VOB) files, 402

Video-on-demand (VOD) /pay-per-view (PPV), 395

Video Quality Expert’s Group (VCEG), 223

Video RAW, 77

Video safe areas, 119

Video track, 536, 537

VideoType, 326

ViewCast, 491–2

Visible light spectrum, 1

Vista Compatibility Hotfix, 292

VLC (VideoLan Client), 509

VoxWare MetaSound and MetaVoice, 347

VP6 options, 264–9

auto key frames enabled/key frame settings, 266

auto key frame threshold, 267

CBR settings, 268–9

CBR vs. VBR, 265

compress alpha data, 265

compression speed, 267

drop frames to maintain data rate, 268

drop frames watermark/temporal resampling, 268

implementation, 264

maximum quality/override quantizers, 268

minimum distance to keyframe, 267

minimum quality/override quantizers, 267

noise pre-processing level, 268

professional tools for, 259

sharpness, 268

VBR settings, 269

and video breakout, 458

VP6-S, 264

W

Walled garden, 430

WAV, 515

Wavelet compression, 56

Wavelet versus DCT, 76

Webcasting, 380

Web page, Windows Media in, 288–9

Web video, 373

categories

adaptive streaming, 381–4

downloadable file, 375

peer-to-peer, 381

progressive download, 375–7

real-time streaming, 377–81

connection speeds, 373–4

Flash’s Dynamic Streaming, 384

hosting, 385–6

Weighted prediction, of H.264, 231

White, 7–8

Windows 1.0, 497

Windows 3.0/3.1, 498

Windows, 7, 240, 291–2, 502–3

Windows 95/98/Me, 498

Windows 2000, 500

Windows Media, 277, 315, 488–9, 515

Advanced System Format, 279

drawback

target platform, support on, 278–9

encoders for, 295

Episode, 300–1

Expression Encoder, 295–7

Flip4Mac, 298–300

Windows Media Encoder, 297–8

WMSnoop, 301, 302

encoding options in

data rate modes, 285–6

encoding tools, 289

encoder latency, 293–4

low-latency webcasting, 293

player latency, 294

server latency, 294

VC-1 Encoder SDK, 290

Windows, 7, 291–3

Windows Media Format SDK, 290

Windows Server 2003, 291

Windows XP, Vista, or Server 2008, 291

launches, 500

need for, 278

enterprise video, 278

interoperable DRM, 278

Windows playback, 278

and PlayReady DRM, 289

usage

in portable devices, 288

in progressive download, 286–7

in ROM discs and local playback, 286

in streaming, 287–8

in web page, 288–9

and VC-1, 438

Windows Media Player, 279–80

Windows Media Video Codecs, 280

legacy codecs, 283–4

Profiles, 280

Windows Media Video 9 (WMV3), 280

Windows Media Video 9.1 Image, 283

Windows Media Video 9 Advanced Profile, 282

Windows Media Video 9 Screen, 283

Windows Media 9 Series, 501

Windows Media Audio (WMA), 60, 160

file format, 341

rate control in, 341

WMA 9.2 standard, 341, 343–4

WMA 10 Pro, 342, 344–6

WMA 9.2 lossless, 347

WMA 9 voice, 342

WMA codecs, 347

Windows Media Center, 510

Windows Media Compatibility, 305

Windows Media DRM, 289

Windows Media Encoder, 297–8

Windows Media Format SDK, 290, 508

Windows Media Player (WMP), 279–80, 508–9

Center and Zune, 429–30

Windows Media Screen, 7, 284

Windows Media Services (WMS), 287

Windows Media Video, 7, 284

Windows Media Video, 8, 283–4

Windows NT, 499–500

Windows playback, 278

Windows Presentation Foundation (WPF), 474

Windows Server 2003, 291

Windows Server 2008, 291, 502

Windows Vista, 291, 502

Windows XP, 291, 500–1

WMA, see Windows Media Audio

WMP, 11, 342

WMSnoop, 301, 302

WMV9, 488

WMV 9 PowerToy, 108

WMV/VC-1 decoders, 107

X

X, 264

CRF mode, 246

great performance, 245

great quality, 246

MB-tree, 246

rapid development, 246

single-slice multithreading, 246

XAML (eXtensible Application Markup Language), 474

Xbox, 360, 434–5

Xbox Live Marketplace, 375

XDCAM, 80

XDCAM EX, 555

Xiph, 352

XiphQT, 559

XLR connectors, 89–90

XP, see Windows XP

Xvid, 199, 201, 208, 209

Y

Y’CbCr, 23–6, 29–30

channel-specific filters, 30

performance, 29–30

quality, 29

Y/C, see S-Video

“Yeltsin Walk” pattern, 167

YUV-9 sampling, 26

YV12/NV12/IYUV, 512

Z

Zune, 432–3

Zune HD, 423, 433–4

Zune Media Player, 509

..................Content has been hidden....................

You can't read the all page of ebook, please click here login for view all page.
Reset
3.16.218.105