Skip to content

Repository files navigation

Prepare data

  • MANO go for this repo and download mano model data
  • I download the model in path: MANO/mano_v1_2/models/MANO_LEFT.pkl
  • Prepare DART pose data in DART/DART_pose_data.npz (in google drive)

Install dependencies:

conda create -n spad_hand python=3.10
conda activate spad_hand
pip install -r requirements.txt
cd manotorch && pip install -e . && cd ..
  • Cuda version on my device is 11.8

Generate simulation data

python SPAD-Hand-Sim/sim_hist_batch.py 

Train pose estimation model

python pose_estimation/train.py

python pose_estimation/eval.py

Finetune pose estimation model on real data

python pose_estimation/finetune_real_data.py

python pose_estimation/eval_real_data.py

Calibrate hand mano parameters/camera parameters

Demo

  • run Demo.ipynb to check the hand mesh for given mano parameters

  • Mano model demo is adapted from repo:MANO

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

Packages

Used by

Contributors

Languages