Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to reset goals when picking or pushing objects #30

Open
gautica opened this issue Jun 19, 2023 · 1 comment
Open

How to reset goals when picking or pushing objects #30

gautica opened this issue Jun 19, 2023 · 1 comment

Comments

@gautica
Copy link

gautica commented Jun 19, 2023

Hi,
thanks for the interesting work. I am not sure how you set the goal for the pickup or pushing task, because the goal is the position of the object. As I understand, the goal of all the failure trials before touching the object is set to be the same object position, as it doesn't move. But it doesn't sound very correct to me. Is it set in this way? Thank you very much

@TianhongDai
Copy link
Owner

@gautica In goal-oriented DRL, we have two types of goals: {"achieved goals", "desired goal"}. In "PickAndPlace" and "Pushing" tasks, the desired goal position is the final goal position, which is indicated by the red spot in demo GIF. At the beginning of each episode, the desired goal is randomly sampled from the pre-defined goal space; The achieved goal is the position of the object (the cube in these two tasks.). The aim of these tasks is to control the robotic arm to manipulate the object close to the desired goal position (i.e. dist(achieved goal, desired goal) < threshold). Hope this answer helps you.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants