Motion Capture
AI Driven Mocap for VR
This motion capture pipeline used Metahuman characters in Unreal, Unreal Animator with a motion capture helmet (hand made) for facial and Move.AI for the body mocap.
This pipeline can be combined with photography + lighting / props or a fully 3D modelled environment for a plug n play mass content production pipeline.
Facial Animation
I created a pipeline for converting photogrammetry scans into rigged mixamo models.
This highlights the next phase of research, in which I used an obscure startup stereoscopic camera for point and click scans, which I converted into blendshapes and then drove using LIVE Face, and an IphoneX.
Although the research was never implemented, the goal was to create a pipeline for extremely high-quality human interactions, using minimum labor.
