/work/ExSampling: a system for the real-time ensemble performance of field-recorded environmental sounds
Research2020 - 5 - 14

ExSampling: a system for the real-time ensemble performance of field-recorded environmental sounds

NIMEMusic Tech

We propose ExSampling: an integrated system of recording application and Deep Learning environment for a real-time music performance of environmental sounds sampled by field recording. Automated sound mapping to Ableton Live tracks by Deep Learning enables field recording to be applied to real-time performance, and create interactions among sound recorders, composers and performers.

We propose ExSampling: an integrated system of recording application and Deep Learning environment for a real-time music performance of environmental sounds sampled by field recording. Automated sound mapping to Ableton Live tracks by Deep Learning enables field recording to be applied to real-time performance, and create interactions among sound recorders, composers and performers.

Paper: https://arxiv.org/abs/2006.09645

Our lab: https://cclab.sfc.keio.ac.jp/2020/06/16/exsampling/

System Overview

Image

Image

Classification Architecture

Image

MIDI Track Mapping

Image

Demo videos

BibTex

1@inproceedings{kobayashi_NIME20_58,
2  author = {Kobayashi, Atsuya and Anzai, Reo and Tokui, Nao},
3  title = {ExSampling: a system for the real-time ensemble performance of field-recorded environmental sounds},
4  pages = {305--308},
5  booktitle = {Proceedings of the International Conference on New Interfaces for Musical Expression},
6  editor = {Michon, Romain and Schroeder, Franziska},
7  year = {2020},
8  month = jul,
9  publisher = {Birmingham City University},
10  address = {Birmingham, UK},
11  issn = {2220-4806},
12  doi = {10.5281/zenodo.4813371},
13  url = {https://www.nime.org/proceedings/2020/nime2020_paper58.pdf}
14}