Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to load the hand poses into the blender SMPLX add-on correctly? #14

Open
alexluo-netizen opened this issue Apr 15, 2023 · 3 comments

Comments

@alexluo-netizen
Copy link

alexluo-netizen commented Apr 15, 2023

Hi, thanks for your great work. I tried your codes and it works well on body pose, expression and the general shape!
However I still got some questions regarding the hand poses and the possible missed use parameters.

I tried to revise the generated '.pkl' file from the PYMAFX to make it aligned to be loaded into the SMPLX blender add on. (The reference dataset I used is AGORA sample data, which can be easily loaded into SMPLX blender add on.)
As you adviced in the previous issue that selecting 21 bones from 24 SMPL bones, I selected 63 from the 72 body poses. However, not like the 'body_pose', hand poses are stored in the key 'smplx_params' and they have different shapes than the SMPLX blender adds on requires.
I tried to convert the hand pose with shape torch.Size([1, 15, 3, 3]) to shape (1,45) by the method of converting rotation matrix to euler angle but it didn't work. The fingers of the mesh often keeps holding as fist and don't move well enough.
So far I have added 9 parameters in my pkl file, which are 'body_pose', 'betas', 'global_trans', 'left_hand_pose', right_hand_pose', 'jaw_pose', 'leye_pose', 'reye_pose' and 'expression'. Could you give me a hint that which parameters are possibly missed here?

@oijoijcoiejoijce
Copy link

+1

@Darius-H
Copy link

Have you solved this problem? I have trouble in reading smplx_params from .pkl file with smpl.SMPLX model.

Hi, thanks for your great work. I tried your codes and it works well on body pose, expression and the general shape! However I still got some questions regarding the hand poses and the possible missed use parameters.

I tried to revise the generated '.pkl' file from the PYMAFX to make it aligned to be loaded into the SMPLX blender add on. (The reference dataset I used is AGORA sample data, which can be easily loaded into SMPLX blender add on.) As you adviced in the previous issue that selecting 21 bones from 24 SMPL bones, I selected 63 from the 72 body poses. However, not like the 'body_pose', hand poses are stored in the key 'smplx_params' and they have different shapes than the SMPLX blender adds on requires. I tried to convert the hand pose with shape torch.Size([1, 15, 3, 3]) to shape (1,45) by the method of converting rotation matrix to euler angle but it didn't work. The fingers of the mesh often keeps holding as fist and don't move well enough. So far I have added 9 parameters in my pkl file, which are 'body_pose', 'betas', 'global_trans', 'left_hand_pose', right_hand_pose', 'jaw_pose', 'leye_pose', 'reye_pose' and 'expression'. Could you give me a hint that which parameters are possibly missed here?

@AWangji
Copy link

AWangji commented Dec 6, 2023

h smpl.SMPLX model.

Hi, I met some errors when importing pkl file in blender.
image

I want to know what blender addon do you use? or how do you resolve it. Thanks
this is what I use:
image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants