Home  Contact Us
  Follow Us On:
 
Search:
Advertising Advertising Free Newsletter Free E-Newsletter
Magazine
  
      2024       2023       2022       2021       2020       2019       2018       2017       2016       2015       2014       2013       2012       2011       2010       2009       2008

TECH: Translating Motion into Music
Share to

Translating Motion into Music

AI将舞者的运动变成钢琴的声音
By Amber Oneal

BT 202006 TECH 1The wonders of AI (Artificial intelligence) are numerous. You will see that AI has changed every area of life. There are awe inspiring innovations and turning points related to the use of AI in every walk of life in some form or the other. In business, education, medicine, research, you name it––AI has made a contribution.
 

Arts are no exception. After changing how you listen to music, AI has now been used to change how you make music. And Yamaha has taken the initiative to involve AI one step further. They have developed AI technology to translate movement into music.
 

As surprising it may seem, the live performance of the renowned dancer, Kaiji Moriyama, is proof of this new development. In the recent concert “Mai Hi Ten Yu” in Tokyo, Kaiji Moriyama danced and made music on the piano along with the Berlin Philharmonic Orchestra Scharoun Ensemble.
 

This performance was the first of its kind, and the result was amazing. The music that was produced was not just some random combination of notes; it was comprehensible and artistic.
 

​The process was like the fusion of the dance movements into the notes of music played on the piano. As Kaiji Moriyama danced his steps, they were converted into music on the piano. This is not as simple as it sounds. He had to wear four different kinds of sensors on his back, wrists, and feet to convert his movements into music.

BT 202006 TECH 02雅马哈创造了一个可以做一些非常奇怪事情的AI人工智能。这种AI被整合到雅马哈创造的新音乐系统中,专门用来将世界知名舞者的动作转化为来自真实钢琴的音乐。 采用这种AI演出的音乐会被称为“Mai Hi Ten Yu”,由东京艺术大学和东京艺术大学赞助。
 

雅马哈这种音乐系统使用人工智能和传感器连接到舞者的身体。柏林爱乐乐团演奏者和舞者一起参加了演出。雅马哈将新音乐系统视为追求新形式艺术表现的进步,并计划进一步发展该系统。
 

系统中的人工智能仍处于开发阶段,通过分析附着在身体上四种传感器的信号,能够实时识别舞者的动作。数据库链接旋律和动作,AI能够立即创建旋律数据(MIDI)。然后,这些MIDI数据被发送到Yamaha Disklavier并被翻译成乐谱在钢琴上自动弹奏。这项创新为艺术家表达自己的方式打开了新的大门。

BT 202006 TECH 03The technology used

The Yamaha AI technology uses four different kinds of sensors attached to the dancer for the conversion of his movements into data. That data is then used by the same technology to make melodies with the help of a database that is based on the MIDI music. The converted MIDI music is sent to the Yamaha Disklavier Player Piano that plays it as music notes.
 

The Yamaha Disklavier Player Piano that was used in Kaiji Moriyama’s performance is the CFX concert grand, a virtual piano worth 150,000 USD that was used by award-winning engineers using the world’s best microphones and equipment to make an amazing virtual music library. The best part is that you can technically see the music being created.
 

What is the accuracy of this music?

Although one might doubt that the music was made by the movements of the dancer, Kaiji Moriyama put these doubts to rest. He claims that he had full control of the notes themselves and their intensity. He explained that the music changed with the way he balanced his body. That is how he had complete control over the different tunes that were created. If the AI is capable of capturing every fine movement of his body, then he would even have control of chords and notes, which is quite remarkable.

BT 202006 TECH 04The new method of expression

​Yamaha claims that this innovation opens new doorways to the way artists express themselves. Music will no longer be bound up with just playing the instruments, but the idea that music flows in the body will become more real. Different forms of dances could produce different forms of music. This idea is revolutionary for the music industry and the performing arts industry.

AI is changing how we live, communicate and express our emotions. It is becoming more and more involved in our lives. Although AI has been playing music that has already been composed, it has not yet composed music like that of famous musicians. This innovation can be seen as a step towards that. It is also a new way of not only seeing dance but hearing it as well!

    Subscription    |     Advertising    |     Contact Us    |
Address: Magnetic Plaza, Building A4, 6th Floor, Binshui Xi Dao.
Nankai District. 300381 TIANJIN. PR CHINA
Tel: +86 22 23917700
E-mail: webmaster@businesstianjin.com
Copyright 2024 BusinessTianjin.com. All rights reserved.