Robot uses deep learning and big data to write and play its own music

A marimba-playing robot with four arms and eight sticks is writing and playing its own compositions in a lab. The pieces are generated using artificial intelligence and deep learning.

Researchers fed the robot nearly 5,000 complete songs — from Beethoven to the Beatles to Lady Gaga to Miles Davis — and more than 2 million motifs, riffs and licks of music. Aside from giving the machine a seed, or the first four measures to use as a starting point, no humans are involved in either the composition or the performance of the music.

The first two compositions are roughly 30 seconds in length. The robot, named Shimon.

Ph.D. student Mason Bretan is the man behind the machine. He’s worked with Shimon for seven years, enabling it to “listen” to music played by humans and improvise over pre-composed chord progressions. Now Shimon is a solo composer for the first time, generating the melody and harmonic structure on its own.

“Once Shimon learns the four measures we provide, it creates its own sequence of concepts and composes its own piece,” said Bretan, who will receive his doctorate in music technology this summer. “Shimon’s compositions represent how music sounds and looks when a robot uses deep neural networks to learn everything it knows about music from millions of human-made segments.”

Bretan says this is the first time a robot has used deep learning to create music. And unlike its days of improvising, when it played monophonically, Shimon is able to play harmonies and chords. It’s also thinking much more like a human musician, focusing less on the next note, as it did before, and more on the overall structure of the composition.

“When we play or listen to music, we don’t think about the next note and only that next note,” said Bretan. “An artist has a bigger idea of what he or she is trying to achieve within the next few measures or later in the piece. Shimon is now coming up with higher-level musical semantics. Rather than thinking note by note, it has a larger idea of what it wants to play as a whole.”

“This is a leap in Shimon’s musical quality because it’s using deep learning to create a more structured and coherent composition,” said Weinberg, a professor in the School of Music. “We want to explore whether robots could become musically creative and generate new music that we humans could find beautiful, inspiring and strange.”

Shimon will create more pieces in the future. As long as the researchers feed it a different seed, the robot will produce something different each time — music that the researchers can’t predict. In the first piece, Bretan fed Shimon a melody comprised of eighth notes. It received a sixteenth note melody the second time, which influenced it to generate faster note sequences.

Bretan acknowledges that he can’t pick out individual songs that Shimon is referencing. He is able to recognize classical chord progression and influences of artists, such as Mozart, for example. “They sound like a fusion of jazz and classical,” said Bretan, who plays the keyboards and guitar in his free time. “I definitely hear more classical, especially in the harmony. But then I hear chromatic moving steps in the first piece — that’s definitely something you hear in jazz.” . According to Science daily

 

N.H.Kh

 

You might also like
Latest news
“Deir Ezzor, Memory of the Old City” a photographic  exhibition by photographer Jumaa Al-Suleiman  On International Children's Day, Ministry of Social Affairs completes the National Strategy for Chil... Putin confirms Russia’s readiness to assist CAR with security challenges 43985 martyrs since the beginning of the Israeli war of extermination in Gaza Strip Palestinian Prisoners' Commission and the Prisoners' Club: The occupation's brutality against childr... Russian Foreign Intelligence Service says Russia to address NATO’s engagement in strikes deep inside... Palestinian Ministry of Foreign Affairs calls for providing international protection for children Director of Kamal Adwan Hospital in northern Gaza Strip: "The occupation does not allow anything to ... The occupation continues its aggression on Jenin and its camp 14 martyrs, a number of wounded in the occupation's bombing of Gaza Strip A Lebanese Army Soldier and Five Civilians Martyred in Israeli occupation Airstrikes Venezuela Rejects U.S. Recognition of Edmundo González as President-Elect Al-Dahhak: The continuous US-backed Israeli crimes pose serious threat to regional and international... Omani Embassy in Damascus holds reception on the 54th anniversary of Oman's National Day  Kharita at "COP 29": The need to increase funding for countries to fulfill their obligations Palestinian Health Ministry: Israeli occupation killed 1,000 Palestinian doctors, nurses during its ... Pushilin calls for enhancing cooperation between the Donetsk Republic and Syria Pakistani plane, carrying aid for displaced people coming from Lebanon, arrives at Damascus Airport Sabbagh, Araqchi hold a press Conference in Tehran Slovak PM: US approval of strikes against Russia undermines peace efforts