Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Why was Alphapose chosen? #7

Open
yayayru opened this issue Feb 21, 2023 · 4 comments
Open

Why was Alphapose chosen? #7

yayayru opened this issue Feb 21, 2023 · 4 comments

Comments

@yayayru
Copy link

yayayru commented Feb 21, 2023

Why was Alphapose chosen? What about Mediapipe holistic or OpenPose?

@yayayru yayayru changed the title Why was alphapose chosen? Why was Alphapose chosen? Feb 21, 2023
@pedroodb
Copy link
Collaborator

Alphapose was chosen as it allowed us to use the Halpe dataset format, which we found useful for sign language representation, and also for performance reasons as it can run on 8GB of RAM.

Probably Mediapipe and Openpose could work as well, but we didn't find any particular advantage.

@yayayru
Copy link
Author

yayayru commented Feb 24, 2023

What is the particular special advantage of Halpe dataset format for sign language representation if you could answer? Would you be able to show an example of sign language representation?

Halpe dataset format, which we found useful for sign language representation

@facundoq
Copy link
Member

facundoq commented Feb 24, 2023 via email

@yayayru
Copy link
Author

yayayru commented Feb 24, 2023

Yes, you can ask. The main problem with tracked skeletal fingers for sign language recognition task is that I'm interested in a specific detail. I tried OpenPose before, but there is a devops problem with python. Now I use Mediapipe Hands and Pose, Holistic, it's easier to do something there and it's convenient to analyze the finger skeletal model, see my video example.

I know more about Mediapipe than Alphapose. Alphapose and Mediapipe hands are the same number - 21 finger key points. I'm asking you, do you use a 2D or 3D finger skeletal model from Alphapose? Any other specific detail?:)

Err.. it has more finger keypoints than other formats/models. Also Alphapose was (is?) significantly easier to work with since it is based on pytorch. Can I ask why the interest in such a specific detail? Also, you can always run openpose on the videos...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants