Course Name: Multimedia Compression and

Communications

Course Code: s2293038

Semester: 5

Credit: 4

Program: Electronics

Course Module: Compulsory

Responsible: Jingyu Yang

E-mail: yjy@tju.edu.cn

Department:Tianjin International Engineering Institute, Tianjin University

Time Allocation (1 credit hour = 45 minutes)

Course Description

The course has an extensive coverage of media compression, synthesis and recognition, media communications and networking, and standards for audio-visual communications over wired and wireless networks.

Prerequisite

Signal Processing, Signal and Systems.

Course Objectives

After taking the course, students are supposed to understand characteristics of multimedia traffic, network transport issues, the network requirements for audio/video transport, and optimization models for optimal network design. Students also get familiar with IP QoS issues, content delivery networks (CDNs), P2P networks, and wireless LANs for the support of multimedia applications.

Course Syllabus

1. Basics of analog and digital video

   1. Color video formation and specification

   2. Analog TV system

   3. Video raster

   4. Digital video formats

2. Frequency domain analysis of video signals

   1. Spatial frequency response of the human visual system

   2. Temporal frequency response of the human visual system

3. Scene, camera, and motion modeling

   1. 3D motion and projected 2D motion

   2. Models for typical camera/object motions

4. 2D motion estimation

   1. Optical flow equation

   2. Different motion estimation methods

      1. Pel-based

      2. Block-based

      3. Mesh-based

      4. Global motion estimation

      5. Multi-resolution approach

5. Basic compression techniques

   1. Information bounds for lossless and lossy source coding

   2. Binary encoding

   3. Scalar/vector quantization

6. Waveform-based coding

   1. Transform coding

   2. Predictive coding

      1. Motion compensated prediction and interpolation

      2. Block-based hybrid video coding

      3. Scalable video coding

7. Video compression standards (H.261 and H.263, MPEG1, MPEG2, MPEG4, MPEG7).

8. Error control in video communications

9. Video transport over the Internet and wireless networks

Textbooks & References

• Y. Wang, J. Ostermann, and Y.Q.Zhang.Video Processing and Communications(1st ed). Prentice Hall, 2002.ISBN:0130175471. (Required)

  1. Recommended Readings:

• D. Taubman and M. Marcellin. JPEG2000:Image Compression Fundamentals, Standards,and Practice. Kluwer, 2001. ISBN: 079237519X.

• Iain E G Richardson.H.264 and MPEG-4 Video Compression. John Wiley & Sons, September 2003. ISBN 0-470-84837-5.

• M. E. Al-Mualla, C. N. Canagarajah and D. R. Bull.Video Coding for Mobile Communications: Efficiency, Complexity and Resilience. Elsevier Science, Academic Press, 2002.ISBN: 0120530791.

• A. Murat Tekalp.Digital Video Processing. Prentice Hall, Englewood Cliffs, NJ, 1995.

• Khalid Sayood.Introduction to Data Compression (2nd ed). Morgan Kaufmann, 2000.

• Jerry Gibson, Toby Berger, Tom Lookabaugh, Rich Baker and David Lindbergh.Digital Compression for Multimedia: Principles & Standards. Morgan Kaufmann, 1998. ISBN 1-55860-369-7.

• A. N. Netravali and B. G. Haskell.Digital Pictures – Representation, Compression and Standards (2nd ed). Plenum Press, 1995.

Grade Distribution

Attendance: 20% Homework 1: 40% Homework 2:40%

Capability Tasks

CT1: To understand basic science, and to have analytical ability and the ability to integrate related knowledge.

CT2: To apply relevant professional knowledge to the field of science and technology: understanding of the basic concepts and its connotation, application of different methods and concepts which have been learned, capability of judging the scope and limitations of such applications.

CT3: To grasp methodologies and engineering tools: identifying, utilizing and solving problems. Even if the students are not familiar with the content, they can turn to computer tools for systematic analysis.

CT4: To carry out experiments in research environment with the abilities to utilize tools, especially for data collection and processing.

CT10: To have the capacity to work in international environment; the capability to master one or more foreign languages and be open to foreign cultures; be able to acclimatize themselves to the international language environment.

Achievements

• To master the basic notions of compression for multimedia. - Level: M

• To know and manipulate new solutions for the compression and visualization of multimedia data as well as the latest standards. - Level: M

Students: Electronics, Year 3