ExSampling: a system for the real-time ensemble performance of field-recorded environmental sounds

We propose ExSampling: an integrated system of recording application and Deep Learning environment for a real-time music performance of environmental sounds sampled by field recording. Automated sound mapping to Ableton Live tracks by Deep Learning enables field recording to be applied to real-time performance, and create interactions among sound recorders, composers and performers.


We propose ExSampling: an integrated system of recording application and Deep Learning environment for a real-time music performance of environmental sounds sampled by field recording. Automated sound mapping to Ableton Live tracks by Deep Learning enables field recording to be applied to real-time performance, and create interactions among sound recorders, composers and performers.

Paper: https://arxiv.org/abs/2006.09645

Our lab: https://cclab.sfc.keio.ac.jp/2020/06/16/exsampling/


System Overview

Image from Gyazo

Image from Gyazo

Classification Architecture

Image from Gyazo

MIDI Track Mapping

Image from Gyazo

Demo videos