About this course: In this course you will learn about audio signal processing methodologies that are specific for music and of use in real applications. We focus on the spectral processing techniques of relevance for the description and transformation of sounds, developing the basic theoretical and practical knowledge with which to analyze, synthesize, transform and describe audio signals in the context of music applications. The course is based on open software and content. The demonstrations and programming exercises are done using Python under Ubuntu, and the references and materials for the course come from open online repositories. We are also distributing with open licenses the software and materials developed for the course.
Who is this class for: This course is primary aimed at advanced undergraduate or master students, along with professionals, interested in signal processing, programming and music.
Created by: Universitat Pompeu Fabra of Barcelona, Stanford University
Taught by: Xavier Serra, Associate Professor
Dept. of Information and Communication Technologies, UPF
Taught by: Prof Julius O Smith, III, Professor of Music and (by courtesy) Electrical Engineering
CCRMA
| Level | Intermediate |
| Commitment | 10 weeks of study, 8 hours/week |
| Language | English |
| How To Pass | Pass all graded assignments to complete the course. |
| User Ratings |
Syllabus
WEEK 1
Introduction
Introduction to the course, to the field of Audio Signal Processing, and to the basic mathematics needed to start the course. Introductory demonstrations to some of the software applications and tools to be used. Introduction to Python and to the sms-tools pac...
11 videos, 1 reading
Graded: Basics
Graded: Python and sound
WEEK 2
Discrete Fourier transform
The Discrete Fourier Transform equation; complex exponentials; scalar product in the DFT; DFT of complex sinusoids; DFT of real sinusoids; and inverse-DFT. Demonstrations on how to analyze a sound using the DFT; introduction to Freesound.org. Generating sinuso...
6 videos, 1 reading
Graded: DFT
Graded: Sinusoids and DFT
WEEK 3
Fourier theorems
Linearity, shift, symmetry, convolution; energy conservation and decibels; phase unwrapping; zero padding; Fast Fourier Transform and zero-phase windowing; and analysis/synthesis. Demonstration of the analysis of simple periodic signals and of complex sounds;...
7 videos, 1 reading
Graded: Fourier properties
Graded: Fourier Properties
WEEK 4
Short-time Fourier transform
STFT equation; analysis window; FFT size and hop size; time-frequency compromise; inverse STFT. Demonstration of tools to compute the spectrogram of a sound and on how to analyze a sound using them. Implementation of the windowing of sounds using Python and pr...
6 videos, 1 reading
Graded: Short-time Fourier transform
Graded: Short-time Fourier Transform (STFT)
WEEK 5
Sinusoidal model
Sinusoidal model equation; sinewaves in a spectrum; sinewaves as spectral peaks; time-varying sinewaves in spectrogram; sinusoidal synthesis. Demonstration of the sinusoidal model interface of the sms-tools package and its use in the analysis and synthesis of ...
8 videos, 1 reading
Graded: Sinusoidal model
Graded: Sinusoidal model
WEEK 6
Harmonic model
Harmonic model equation; sinusoids-partials-harmonics; polyphonic-monophonic signals; harmonic detection; f0-detection in time and frequency domains. Demonstrations of pitch detection algorithm, of the harmonic model interface of the sms-tools package and of i...
7 videos, 1 reading
Graded: Harmonic model
Graded: Harmonic Model
WEEK 7
Sinusoidal plus residual model
Stochastic signals; stochastic model; stochastic approximation of sounds; sinusoidal/harmonic plus residual model; residual subtraction; sinusoidal/harmonic plus stochastic model; stochastic model of residual. Demonstrations of the stochastic model, harmonic p...
8 videos, 1 reading
Graded: Sinusoidal plus residual model
Graded: Sinusoidal plus residual
WEEK 8
Sound transformations
Filtering and morphing using the short-time Fourier transform; frequency and time scaling using the sinusoidal model; frequency transformations using the harmonic plus residual model; time scaling and morphing using the harmonic plus stochastic model. Demonstr...
9 videos, 1 reading
Graded: Sound transformations
Graded: Transformations
WEEK 9
Sound and music description
Extraction of audio features using spectral analysis methods; describing sounds, sound collections, music recordings and music collections. Clustering and classification of sounds. Demonstration of various plugins from SonicVisualiser to describe sound and mus...
6 videos
Graded: Sound and music description
Graded: Sound and music description
WEEK 10
Concluding topics
Audio signal processing beyond this course. Beyond audio signal processing. Review of the course topics. Where to learn more about the topics of this course. Presentation of MTG-UPF. Demonstration of Dunya, a web browser to explore several audio music collecti...
6 videos, 1 reading
Graded: Concluding topics
Graded: A music piece combining sounds and their transformations
FAQs
How It Works
Coursework
Each course is like an interactive textbook, featuring pre-recorded videos, quizzes and projects.
Help from Your Peers
Connect with thousands of other learners and debate ideas, discuss course material, and get help mastering concepts.
Creators
Universitat Pompeu Fabra of Barcelona
Pompeu Fabra University (UPF) is a modern public university, conveniently located in the centre of Barcelona (Spain) with the aim of providing top quality education and standing out as a research-based university. UPF is both a specialised university with a unique teaching model and a cutting-edge research institution. UPF places a strong emphasis on quality teaching, based on comprehensive education and student-centred learning, and innovation in the learning processes. UPF’s MOOCs are produced within this general goal.
Stanford University
The Leland Stanford Junior University, commonly referred to as Stanford University or Stanford, is an American private research university located in Stanford, California on an 8,180-acre (3,310 ha) campus near Palo Alto, California, United States.
Ratings and Reviews
I learned a lot and had fun at the same time
good course . If there will any Speech recognition course it will useful > Hope Coursera will start speech recognition course in future .
Very well presented and thorough investigation into spectrogram, STFT and reconstruction techniques. Enjoying thanks.
Coursera provides universal access to the world’s best education, partnering with top universities and organizations to offer courses online.
© 2017 Coursera Inc. All rights reserved.
MS
For a free course this was amazing. It was technically very challenging in places but was massively informative and completing it has felt like a excellent accomplishment. My thanks fro all of the hard work that clearly went into constructing the lectures and material.