Multimedia Signal Processing

The course treats multimedia presentations (speech, audio, images, video and interactivity) and their characteristics, perception of audio visual information as well as principles and methods for digital processing of audio visual information for representation, presentation and analysis of the different signal types. The main focus is on digital signal compression, multimedia systems, interactivity, estimation and detection using machine learning and multimedia presentations

Learning goals: The subject shall provide an introduction to our perception of speech, audio, music, image and video to be able to understand advanced techniques, algorithms and concepts for digital processing of multimedia presentations. The processing will be highlighted by applications from multimedia systems.

Knowledge:

- understand different characterisations of sound and images in the time domain as well as in the frequency domain and their interrelationships ,

- understand human perception of sound and images,

- know the principles and technologies of compression algorithm for sound and images and their application in a digital system,

- know the principles and technologies for machine learning used on multimedia signals - know the principles and technologies of several important standards and their typical application scenarios and - strengthen the candidates methodology and technical insight within multimedia systems.

Skills:

- combine previous knowledge and skills within mathematics, statistics and programming with new theory to solve practical problems within sound and image processing,

- understand block diagrams for compression schemes for sound and image systems and understand signal decomposition, quantisation and coding within these and - understand estimation and detection of multimedia signal using machine learning.

- training in active use of the topic by analysing and understanding applications of multimedia signal processing within multimedia systems in addition to challenging their critical thinking and attitudes towards today`s established knowledge within the area.

General competencies:

- quality evaluations and use of sound and images in typical applications within entertainment and - when relevant the candidate shall be able to understand the topics in a broader technical, financial and commercial context and collaborate on solving a practical project.

Lectures, exercises and computer exercises.