Course program
In summary, the main program of the course concerns about the modern multimedia signal processing techniques with particular emphasis on real-time processing. The aim of the course is to provide the basic elements of modern techniques used in the field of multimedia signal processing. The course includes 12 lessons, whose agenda is summarized below.
1. Audio formats and types of multimedia signal processing [5 hours]
2. Offline processing and first algorithms [5 hours]
3. Online processing: linear and circular buffers [5 hours]
4. The audio filter project [5 hours]
5. The audio effects [5 hours]
6. Applications: adaptive noise canceller, spectral subtraction, audio signal restoration, source separation [5 hours]
7. Audio in real time. Management of sound devices [5 hours]
8. System objects for audio [5 hours]
9. The MIDI protocol and its practical use [5 hours]
10. Audio plugins and their implementation [5 hours]
11: Simulink for audio [5 hours]
12. PortAudio: a C ++ library for audio streaming [5 hours]
Prerequisites
Basic knowledge of digital signal processing and informatics.
Books
1. Michele Scarpiniti, MATLAB per l'Audio, Versione 1.4, pp. 1-462, ISBN: 979-8709410411, Self-published, Amazon KDP, Febbraio 2021. (Available on AMAZON)
2. Michele Scarpiniti, Antonio Salini, Introduzione all'audio real-time: Basi teoriche e prime applicazioni, Edizione 2021, pp. 1-358, ISBN: 979-8516660337, Self-published, Amazon KDP, Giugno 2021. (Available on AMAZON)
3. Additional teaching material available on the website http://michelescarpiniti.site.uniroma1.it/didattica/labemm
Teaching mode
The method of delivery of the course is a series of lectures and exercises.
The course is conducted in a traditional mode or in remote mode if there are restrictions due to the pandemic.
Frequency
Course attendance is optional but it strongly recommended as there will be analyzed particular implementaions that can not be simply carried out in an independend way.
Exam mode
Project development with delivery of the report and related software.
To pass the exam it is necessary to achieve a grade of not less than 18/30. The student must demonstrate to have acquired a sufficient knowledge of the modern multimedia signal processing techniques and to be able to carry out a project independently.
In evaluating the exam, the determination of the final grade takes into account the following elements:
1) Technical quality of the project: 70%
2) Project discussion: 30%
Bibliography
1. T. A. Davis, "MATLAB Primer", 8-th edition, CRC Press, 2010.
2. A. D. Poularikas, "Signals and Systems Primer with MATLAB", CRC Press, 2006.
3. U. Zolzer (Ed.), "DAFX: Digital Audio Effects". Wiley, 2011.
4. R. Boulanger, V. Lazzarini (Eds.), "The Audio Programming Book", The MIT Press,2011.
5. V. Lazzarini, "Computer Music Instruments: Foundations, Design and Development", Springer, 2017.
6. V. Lazzarini, "Computer Music Instruments II: Realtime and Object-Oriented Audio", Springer, 2019.
7. G. Bradsky, A. Kaehler, "Learning OpenCV - Computer Vision with the OpenCV Library", O'Reilly, 2008.
Lesson mode
The course is performed through lectures with practical implementation of real-time audio applications.
