IA/0126 - DIGITAL MEDIA
Academic Year 2021/2022
Free text for the University
CRISTIAN PERRA (Tit.)
- Teaching style
- Lingua Insegnamento
|[70/91] INTERNET ENGINEERING||[91/00 - Ord. 2018] INGEGNERIA DELLE TECNOLOGIE PER INTERNET||6||60|
In line with the educational objectives of the Degree Course in Internet Technology Engineering, the objective of the course is to make the student acquire fundamental knowledge, skills and competences in the field of systems and applications for digital media (Digital Media) declined according to the five Dublin Descriptors, and detailed below.
* Knowledge and understanding: the student will know the ways of representing the digital signals used in systems and applications for digital media, the tools to identify their properties, understanding their physical / mathematical meaning. He will know the components of the acquisition, representation, coding, transmission, reception, decoding systems and will be able to evaluate the performance of the individual components and the overall architecture. He will know the basic techniques for the design and development of these systems and the criteria and methods for choosing design solutions that meet the project requirements and application use cases. He will know the processes underlying the definition of the main standards for digital media.
* Knowledge and understanding skills applied: the student will be able to evaluate the performance of the individual components of a system of acquisition, representation, coding, transmission, reception, decoding and the overall performance of this system on the basis of mathematical and graphic representations. Will be able to apply the knowledge of the standards in use in the field of digital media for the design and development of the systems defined in the standards.
* Autonomy of judgment: the student will be able to critically evaluate the results of the analyzes carried out by analyzing numerical data and graphic representations. He will be able to critically compare different architectures and identify the most suitable solutions to meet the project requirements.
* Communication skills: the student will be able to clearly express technical and scientific concepts in the field of digital media, in the contexts of Internet Technology Engineering.
* Ability to learn: the student will be able to integrate knowledge from various sources in order to achieve a broad vision of the problems related to the analysis and design of systems and applications for digital media (Digital Media)
In order to successfully undertake the study of Digital Media, the student must have acquired the following knowledge, skills and competences from previous courses.
Basic elements of linear algebra. Trigonometric, exponential and log functions and their properties. Ordinary linear differential equations. Integrals. Complex numbers. Properties of polynomials. Fourier transform.
Algebra, matrix, differential calculus. Study and representation of functions of one or more variables. Transformations of variables.
Ability to apply the methods of algebra and the analysis of functions for the representation and analysis of the individual components of a system of acquisition, representation, coding, transmission, reception, decoding.
1. Introduction (1 hour, lesson; 1 hour theory, test): presentation of the objectives, the prerequisites, the contents, the teaching methods, the learning verification method and the calendar of the frontal lessons and exercises. Self-test of preliminary knowledge
2. Standards for digital media (2 hours, lesson): standardization bodies; standard development process
3. Signals for digital media (6 hours, lesson; 2 hours tutorial): colour spaces, images, video, audio, plenoptic function, point cloud, light field, holography, virtual reality, augmented reality
4. Digital media compression (2 hours, lesson; 2 hours tutorial): spatial domain and transformed domain, histogram of a signal, frequency of a signal, spatial redundancy, temporal redundancy
5. Quantization (2 hours, lesson; 2 hours tutorial): quantizer design, uniform quantizer, quantization error
6. Predictive coding (2 hours, lesson; 2 hours tutorial): linear predictor, DPCM encoder / decoder
7. Coding for transforms (2 hours, lesson; 2 hours tutorial): discrete cosine transform (DCT), wavelet transform
8. Image encoding (8 hours, lesson; 2 hours tutorial): Standard JPEG, JPEG2000, JPEG XS, JPEG XR, JPEG XT
9. Video coding (4 hours, lesson; 2 hours, tutorial): MPEG standard
10. Plenoptic coding: Standard for coding of point clouds, light fields, holography (4 hours, lesson)
11. Coding with neural networks (2 hours, lesson): Autoencoder and standardization activities
12. Digital right management (2 hours, lesson): DRM for the provision of multimedia services
13. Immersive digital media: 360, virtual reality (VR), augmented reality (AR) (2 hours, lesson)
14. Laboratory: Development of immersive VR and AR applications (6 hours, guided tutorial)
The teaching is organized as a 60-hours module. The teaching activity consists of:
- 1 hour initial test for self-verification of incoming knowledge and skills;
- 39 hours of lectures with the help of video projection of the teacher's PC to present text screens (power points), software applications for the encoding / compression / representation of digital media (mainly Matlab and the reference software of ISO / IEC standards);
- 20 hours of guided exercise, with individual and / or group work, independently constituted, with the support of the teacher and didactic tutors. Part of the exercises are carried out with the help of Matlab's image processing functions and part of them are carried out with applications for digital media. Classroom participation is solicited through questions, requests for interpretation of the analytical results and reflections on the application aspects, with links to other subjects (signal theory, telecommunication networks).
Verification of learning
The evaluation involves the realization of a project during which the student will have to demonstrate knowledge of the algorithms and tools underlying the development of applications for digital media, demonstrate that he can evaluate the performance of the project carried out through objective and subjective evaluations, of knowing how to discuss and critically compare the results obtained. To pass the test, the student must demonstrate an appropriate and correct knowledge of the methodologies of design, experimentation, analysis of the results for the realization of a system or an application for digital media. The student must demonstrate an adequate general and technical linguistic mastery, as well as a sufficient capacity for synthesis and critical analysis, through a final oral presentation of the activities carried out, of the system or application developed, and of the results obtained. The final score, expressed in thirtieths, is attributed by means of an arithmetic average of the assessments attributed to the following elements of the final presentation: a) analysis of the problem (0-11 points); b) design of the solution (0-11 points); c) presentation of the demonstrator or the software created (0-11 points); d) experimentation (0-11 points); e) final presentation (0-11 points). The final mark is obtained with the formula F = 3 * (a + b + c + d + e) / 5, and the mark is with honours if F exceeds 31.5.
K.R. Rao, J.J. Hwang, "Techniques and Standards for Image Video and Audio Coding, Prentice Hal PTR
David Taubman and Michael W. Marcellin, JPEG2000: Image Compression Fundamentals, Standards and Practice, Springer
The teaching material available for the student on the teachers' website includes:
* Digital Media teaching program;
* Dataset to be used for both frontal presentations and tutorials;
* Links to websites with software used during lessons
* Links to in-depth audio-video documents
* Links to detailed text documents