Producing "Open-Style" Choreography for K-Pop Music with Deep Learning

Songha Ban, Sharon Ong

    Research output: Contribution to conferenceAbstractScientificpeer-review

    Abstract

    The goal of this thesis to generate natural and beat-matching choreography from music using deep learning. We compare different pose estimators to create a dataset of human figures for dance generation. Our deep learning framework comprises of a music encoder to create music features which is fed to a pose generator to create dance pose sequences and a music feature generator which reconstructed music features from output poses to improve music feature encoding. Our results showed a pose estimator with a GRU music encoder, generated more natural dance movements which match K-Pop music compared to previous work.
    Original languageEnglish
    Publication statusPublished - 11 Nov 2021
    Event33rd Benelux Conference on Artificial Intelligence and the 30th Belgian Dutch Conference on Machine Learning - University of Luxembourg, Luxembourg, Luxembourg
    Duration: 10 Nov 202112 Nov 2021
    https://bnaic2021.uni.lu/

    Conference

    Conference33rd Benelux Conference on Artificial Intelligence and the 30th Belgian Dutch Conference on Machine Learning
    Abbreviated titleBNAIC/BENELEARN 2021
    Country/TerritoryLuxembourg
    CityLuxembourg
    Period10/11/2112/11/21
    Internet address

    Fingerprint

    Dive into the research topics of 'Producing "Open-Style" Choreography for K-Pop Music with Deep Learning'. Together they form a unique fingerprint.

    Cite this