Skip to content

Transition between generated gesture #1

@YoungSeng

Description

@YoungSeng

The segments we trained are all 4s long, and it is difficult to generalize to arbitrary length gestures by positional encoding alone.
MDM-based models that require time-awareness (arbitrarily long inference) require a smooth transition between the generated sequences. The following practices can be referred to:

  1. Our approach is to add seed poses for smooth transitions.
  2. Its follow-up work PriorMDM uses DoubleTake for long motion generation.
  3. EDGE enforces temporal consistency between multiple sequences.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions