MPE4G: Multimodal Pretrained Encoder for Co-Speech Gesture Generation

no code implementations • 25 May 2023 • Gwantae Kim, Seonghyeok Noh, Insung Ham, Hanseok Ko

Through the series of experiments and human evaluation, the proposed method renders realistic co-speech gestures not only when all input modalities are given but also when the input modalities are missing or noisy.

Gesture Generation Self-Supervised Learning