MotionXperts

We integrate the attention mechanism focused on the skeletal graph into the model for generating sports instruction.

Each video contains 5 instructions generated by the model.

The attention mechanism is also visualized:

Each video has 3 sets of attention focusing on different key points of the skeletal graph. Our goal is to illuminate the significance of every joint, shedding light on their individual importance. We also highlight the 3 most crucial relationships between two joints.

Less Important High Important

------------------------------------------->

Skeletal Format : SMPL