Multimedia Analysis

The course provides basic knowledge and hands on experience in content analysis for the full range of different types of multimedia, including audio, speech, text, images and video. The emphasis is on 1) techniques needed to develop systems that provide users with a variety of functionalities, e.g., search, organization, discovery and sharing; 2) designing and implementing experiments to support system development; academic thinking is a vital skill moving forward as a professional engineer. An important aspect of the course is learning to differentiate between building and evaluating applications from a technological and human point of view. The course builds on concepts from signal processing and on image processing (2-D filtering, visual features, segmentation and basic image classification). It introduces new concepts such as text classification, automatic speech recognition and multimodal video indexing. It makes the bridge between fundamental techniques and applications that allow users to interact with multimedia collections at a level that goes beyond a signal and encompasses aspects of human interpretation of the meaning and use of multimedia content.