Workshop on AI for (Music and Games) Co-Creation (WAIC 2021)

Dates and Local

22, 23 and 24 November 2021.
Auditório Tércio Pacitti, CCET (Centro de Ciências Exatas e Tecnologia), UNIRIO (Universidade Federal do Estado do Rio de Janeiro), Avenida Pasteur, 458 - Urca, Rio de Janeiro, Brazil.
Map1 Map2

Results and Prospects

The workshop was intense and fruitful, with lots of questions discussed and experiences shared, and thus with lots of ideas and paths to further explore cooperatively! There were also some nice jam sessions!
Some Photos and Videos!
All presentations are made available (within Programme Section below).
You can replay all sessions through the dedicated Youtube channels.

Objective

Share experiences and discuss issues about creation and co-creation of music in various contexts with artificial intelligence (AI) / machine learning (ML) techniques (among others) and notably about how to insert such techniques into human(s) artistic creative process(es).
Note that the workshop focused on discussion/topics sessions and not (only) on a sequence of formal presentations.

Participants

Gustavo Amaral, Department of Informatics, Pontifícia Universidade Católica do Rio de Janeiro, Rio de Janeiro, RJ, Brazil
Carlos Arana, Faculty of Engineering, Universidad de Buenos Aires, Buenos Aires, Argentina & Berklee College of Music, Boston, MA, United States of America
Augusto Baffa, Department of Informatics, Pontifícia Universidade Católica do Rio de Janeiro, Rio de Janeiro, RJ, Brazil
Jean-Pierre Briot, LIP6 (Research Laboratory in Informatics), CNRS - Sorbonne Université, Paris, France
Giordano Cabral, Center of Informatics, Universidade Federal do Pernambuco, & CESAR, Recife, PE, Brazil
Filipe Calegario, Center of Informatics, Universidade Federal do Pernambuco, Recife, PE, Brazil
Bruno Feijó, Department of Informatics, Pontifícia Universidade Católica do Rio de Janeiro, Rio de Janeiro, RJ, Brazil
Paulo Fontana, Department of Applied Informatics, Universidade Federal do Estado do Rio de Janeiro, Rio de Janeiro, RJ, Brazil
Nathan Fradet, LIP6 (Research Laboratory in Informatics), CNRS - Sorbonne Université, Paris, France & Aubay, Boulogne-Billancourt, France
Cliff Korman, School of Music - Villa-Lobos Institute, Universidade Federal do Estado do Rio de Janeiro, Rio de Janeiro, RJ, Brazil
Antonio L. Furtado, Department of Informatics, Pontifícia Universidade Católica do Rio de Janeiro, Rio de Janeiro, RJ, Brazil
Rosana Lanzelotte, Instituto Musica Brasilis, Rio de Janeiro, RJ, Brazil
Sidney Lucena, Department of Applied Informatics, Universidade Federal do Estado do Rio de Janeiro, Rio de Janeiro, RJ, Brazil
Henrique Machado, Compositor, Rio de Janeiro, RJ, Brazil
Carlos Eduardo Mello, Department of Applied Informatics, Universidade Federal do Estado do Rio de Janeiro, Rio de Janeiro, RJ, Brazil
Pedro Moura, Department of Applied Informatics, Universidade Federal do Estado do Rio de Janeiro, Rio de Janeiro, RJ, Brazil
Mila Oliveira, Faculty of Computer Science, Universidade Federal do Rio de Janeiro, Rio de Janeiro, RJ, Brazil
François-David Pachet, Creator Technology Research Lab, Spotify, Paris, France
José Henrique Padovani, Music School, Universidade Federal de Minas Gerais, Belo Horizonte, MG, Brazil
Philippe Pasquier, School of Interactive Arts & Technology, Simon Fraser University, Vancouver, BC, Canada
Bertrand Petit-Hédelin, Startup Studio & Project INDES (Secure Diffuse Programming), INRIA, Sophia Antipolis, France
Liduino Pitombeira, School of Music, Universidade Federal do Rio de Janeiro, Rio de Janeiro, RJ, Brazil
Marcelo Queiroz, Computer Science Department, Universidade de São Paulo, São Paulo, SP, Brazil
Geber Ramalho, Center of Informatics, Universidade Federal do Pernambuco, & CESAR, Recife, PE, Brazil
Matheus Souza de Freitas, School of Music - Villa-Lobos Institute, Universidade Federal do Estado do Rio de Janeiro, Rio de Janeiro, RJ, Brazil
Estevan Barbará Teixeira, Department of Applied Informatics, Universidade Federal do Estado do Rio de Janeiro, Rio de Janeiro, RJ, Brazil

Program

Monday, 22 November Morning 09:00-12:00
- Introduction - Presentation of Workshop Objectives
  - Jean-Pierre Briot, Successes and Challenges and Themas for Reflexion | Presentation (PDF)
- Session Contexts and Prospects
  - Geber Ramalho, Some Challenges in (Creation and) Co-Creation of Music with Computers | Presentation (PDF)
Monday, 22 November Afternoon 14:00-17:00
- Session Interaction
  - Bertrand Petit-Hédelin, Skini for Generative and Interactive Music | Presentation (PDF) | Videos (Web) | More videos (Web page)
Monday, 22 November Afternoon 17:00-19h30
- Workshop Opening
  - Jean-Pierre Briot, Workshop Organizer
  - Cliff Korman, School of Music - Villa-Lobos Institute, UNIRIO
  - Sidney Lucena, Dean, CCET, UNIRIO
  - Markus Endler, Director, Department of Informatics, PUC-Rio
  - Olga Anokhina, Director, CNRS Rio
- Cocktail (Offered by CNRS Rio)
Tuesday, 23 November Morning 09:00-12:00
- Session Challenges and Experiences I
  - Giordano Cabral, Challenges in the Adoption of Music Co-Creation Tools | Presentation (PDF)
  - Bruno Feijó & Augusto Baffa, A Discussion on Interactive Narratives and Musical Elements in Games | Presentation (PDF)
  - Augusto Baffa & Bruno Feijó, Computer Generated Content Games and Open Worlds | Presentation (PDF)
  - Gustavo Amaral, Generation of Music for Games Integrated to the Plot of Emotions with Deep Learning Techniques | Presentation (PDF)
Tuesday, 23 November Afternoon 14:00-17:00
- Session Challenges and Experiences II
  - Philippe Pasquier, Music AI at the Metacreation Lab | Presentation (PDF)
  - Nathan Fradet, MidiTok, a Convenient Tool to Tokenize Symbolic Music for Deep Neural Networks | Presentation (PDF) | Example (MIDI) | Example (MP3)
Wednesday, 24 November Morning 09:00-12:00
- Session Challenges and Experiences III
  - Filipe Calegario, Interfaces and Creative Processes | Presentation (PDF)
  - Carlos Arana, Music Education Framework Based on Generative Neural Networks | Presentation (PDF)
Wednesday, 24 November Afternoon 14:00-17:00
- Session Challenges and Experiences IV
  - Carlos Eduardo Mello, Music Generation, AI and Social Good: Potentialities and Challenges | Presentation (PDF)
  - Matheus Souza de Freitas, A Compositor Experience in Using Interactive Systems (Max) | A Ready-Made-Sonata for Violin and Electronics Score (PDF) | Performance (Web)
- Session Research Agenda (Identification, Taxonomy and Exploration)
  - Giordano Cabral, Composition Tasks
  - Geber Ramalho, Design Space
  - Jean-Pierre Briot, Emotion Mappings
- Closing