I developed Web-based user intarface for designing the experience of "controling guitar effects with text inputs", and trained machine learning model to estimate the effect parameters from text embedding vectors using Japanese FastText / Doc2Vec and simple feed forward MLP.
Audio effects are selected from Ableton Live effects controlled in real-time with text input from the application. Then the user can control smoothly while playing the guitar.
