Mesekai is a real-time, full-body, webcam motion tracking avatar web application. Use your body gestures and facial expressions to animate a virtual persona. Personalize your experience through the built-in avatar creator.
- Ready Player Me - avatar and avatar creator
- MediaPipe - face, hands, and body pose estimation
- Three.js - computations and 3D graphics rendering
- React - user interface
- Next.js - project framework
- Install dependencies
npm install
- Run the development server
npm run dev
- Navigate to http://localhost:3000 to see the result
Mesekai is an evolving project. If you would like to contribute, please create Issues, Pull Requests, or reach out to me directly.
- improve hand gestures
- correct wrist/forearm rotation
- add root bone translation
- handle extra shoulder bone
- improve smoothing, reduce jitter
- implement loading UI