Muses Ex Echoes


This work was exhibited on ‘MUSES EX MACHINA’ by TOKUI Nao Computational Creativity Lab, Keio University, December 9, 2022 -- January 15, 2023, at NTT Intercommunication Center [ICC], Tokyo.

https://www.ntticc.or.jp/en/exhibitions/2022/tokui-nao-computational-creativity-lab-keio-university/


In this work, my role was mainly management of the engineering team and development of the system that controls several deep learning models.

Image from Gyazo

Concept

In this work, two AI agents repeat both the generation of pictures and the utterance of interpretations alternately. One AI converts the descriptions of the pictures it generates into sentences and speaks them out loud, while the other AI listens, generates the next picture based on it, and speaks in the same way. The newly generated pictures are interpreted and spoken, resulting in a creative Echo.

Image from Gyazo

Current image-generating AIs have learned from the pictures and aesthetics that humans have created. The AI-generated pictures are reverberations, or Echoes, of human creativity in the learning data. The generated pictures are eventually disseminated on the Web and used by AI as training data. At this point, although the generated images may seem novel, they can actually be seen as stuck within the Echo that has existed up to that point. This "inside Echo" can also be said of us humans. The everyday productions are the result of past creations, just like the Echoes above. With this chain of Echoes, people live in the past and now Echo into the next age. However, doesn't the next age, or the future, seem to be different from the past age, "inside Echo"? Because now there are other things that emit Echoes besides us humans. The AIs here are not only listening to each other's speech, but also to external noises, such as human voices and environmental sounds. It is not clear whether these AIs hate it or admire it, but what is certain is that we can influence each other. And beyond that, a different Echo could resonate.

What will be created beyond the point where "all" our Echoes resonate with each other?


Supervisor: TOKUI Nao
Technical Director: KOBAYASHI Atsuya
Concept Director: KOBAYASHI Yuga
Original Concept: Ryo SIMON
Lighting: OKAZAKI Keisuke, TAKAISHI Keito, SHIBUYA Kazufumi
Machine Learning: ISHII Asuka, SAWA Shoma
Sound: Ryo SIMON, TAKANASHI Dai, OBARA Kai
Visual: TAKAISHI Keito, SHIBUYA Kazufumi, ISHII Asuka, MATSUOKA Yuma
Concept: HANDA Sogen, NOBUSUE Ryuku, OKAZAKI Keisuke, INOUE Takumi
Support: NARUSE Santa, KIEU Quoc Thai, SASAKI Yuria