Séminaire SMA
Neural Melody Generation from Lyrics
Monday, January 27, 2020Dr. Yi YU
enerating melody from lyrics to compose a song has been a very interesting research topic in the area of artificial intelligence and music, which tries to predict generative music relationship between lyrics and melody. Unfortunately, the limited availability of paired lyrics-melody corpus with alignment information has hindered the research progress. To address this problem, a large corpus consisting of 12,197 MIDI songs each with paired English lyrics and melody alignment is created by our group in National Institute of Informatics (NII), Tokyo. In the presentation, I will give a brief overview of AI-based melody generation from lyrics, discuss some challenging issues, and introduce how to train a conditional Long Short-Term Memory - Generative Adversarial Network (LSTM-GAN) over our large-scale lyrics-melody corpus for lyrics-conditioned neural melody generation. Moreover, some interesting experiment and demonstration will confirm that plausible and tuneful melody can be generated from lyrics. Dr. Yi Yu is an assistant professor with National Institute of Informatics (NII). Before joining NII, she was a senior research fellow at School of Computing, National University of Singapore. Her research interests include generative modeling and embedding learning, and its application in music, multimedia, and vision. She has published more than 60 scientific publications, and has supervised more than 30 students including Ph.D students, Master students, and project researchers. She and her team received best poster award from IEEE ISM 2018 and best paper runner up in APWeb-WAIM 2017, were recognized as finalist of the World’s FIRST 10K best paper award in ICME17, won the 2nd prize in Yahoo Flickr grand challenge 2015, were in the top winners (out of 29 teams) awarded by ACM SIGSPATIAL GIS Cup 2013, and received a best paper award from IEEE ISM 2012. More details about her research can be found at http://research.nii.ac.jp/~yiyu/ .
More details here …
cedric.herpson (at) nulllip6.fr