This AI generates music from silent piano performances

Scientists have developed an AI that can generate music from silent piano performances, just by watching the movements of the player’s hands. The system, called Audeo, analyzes top-down videos of someone tickling the ivories to predict which keys are being pressed in each frame. It then produces a transcript of the music, which a synthesizer translates into sound. The researchers trained and tested the AI on footage of pianist Paul Barton playing tunes by famous composers. They then evaluated the accuracy of the Audeo’s compositions by playing them to music-recognition apps, such as Shazam and SoundHound. The apps identified the tune 86% of the time  — just 7%…

This story continues at The Next Web