Deep Learning for Music Generation - Course - UNIRIO - 2nd Semester 2019 - Jean-Pierre Briot

Slides and programs

0. General Introduction

Slides

1. Introduction to Computer Music

Slides

2. Introduction to Deep Learning

Slides

MNIST handwritten digit classification Code
Version without one hot Code
Version with one hidden layer Code
Version with convolutions Code

3. Generation by Feedforward Architectures

Slides

DeepMusic Representation Code
DeepMusic Config Code
DeepMusic Metrics Code
Deep Music README

DeepMusic Bach chorale counterpoint Feedforward generator Code

Original Bach chorale from training dataset Midi
DeepMusic Bach chorale from training dataset counterpoint regenerated Midi
Original Bach chorale from test dataset Midi
DeepMusic Bach chorale counterpoint from test dataset regenerated Midi
Brazilian hymn Midi
DeepMusic Brazilian hymn counterpoint generated Midi

4. Generation by Autoencoder Architectures

Slides

MNIST handwritten digit Autoencoder generator Code

DeepMusic Bach chorale melody Autoencoder generator Code

Melody generated - label elements all 0 Midi
Melody generated - label elements all 0 Midi
Melody generated - label elements random [0, 1] Midi

MNIST handwritten digit Variational Autoencoder generator Code

DeepMusic Bach chorale melody Variational Autoencoder generator Code

Melody generated - z1 small Midi
Melody generated - z1 large Midi
Celtic Melody generated - z1=P0 Midi
Celtic Melody generated - z1=P1 Midi
Celtic Melody generated - z1=P2 Midi
Celtic Melody generated - z1=P3 Midi
Celtic Melody generated - z1=P4 Midi
Celtic Melody generated - z2=P1 Midi
Celtic Melody generated - z2=P2 Midi
Celtic Melody generated - z2=P3 Midi
Celtic Melody generated - z2=P4 Midi

DeepMusic (PyTorch) Celtic melody Rhythm Controlled Variational Autoencoder generator Code

5. Generation by Recurrent Architectures

Slides

DeepMusic Bach chorale melody Recurrent generator Code

Bach melody generated Midi

Celtic melody (RNN) generated Midi
Celtic melody (LSTM) generated Midi

6. Compound Architectures and GAN

Slides

DeepMusic GAN Celtic melody generator Code

Celtic melody generated - Ex1 Midi
Celtic melody generated - Ex2 Midi
Bach chorale generated - Ex1 Midi
Bach chorale generated - Ex2 Midi

7. Reinforcement Learning

Slides

8. The Challenge of Control

Slides

9. Additional Material

Slides


Jean-Pierre Briot, 12/11/2019