Linguitone

Linguitone is a web-based system to assist in making electric guitar sounds using natural language expressions techniques.


I developed Web-based user intarface for designing the experience of "controling guitar effects with text inputs", and trained machine learning model to estimate the effect parameters from text embedding vectors using Japanese FastText / Doc2Vec and simple feed forward MLP.

Image from Gyazo

Audio effects are selected from Ableton Live effects controlled in real-time with text input from the application. Then the user can control smoothly while playing the guitar.

Image from Gyazo

Paper

Linguitone: 音色の言語表現を用いたエレクトリックギターの音作り支援システム