Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update md course3 #77

Closed
wants to merge 2 commits into from
Closed

Update md course3 #77

wants to merge 2 commits into from

Conversation

SissiFeng
Copy link
Collaborator

No description provided.

@sgbaird sgbaird marked this pull request as ready for review October 2, 2024 21:23
Copy link
Member

@sgbaird sgbaird left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Still working through the last bits. I really like the refactor!

This module revolves around "transfer of solid samples", and completes complex automation tasks through ROS, AprilTags, multi-axis robots and workflow orchestration platform. The goal is to learn how to coordinate different modules (including robot control, visual recognition, and workflow management) to complete complex solid sample transfer processes, such as performing a grabbing task from one workstation to another for sample processing (such as screwing a bottle cap or dropping a liquid). This is a multi-step automation process involving the coordinated operation of multiple hardware devices and software platforms.

### System Overview
- MyCobot Pi: For precise sample handling and manipulation
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Label as MyCobot 280 Pi


### System Overview
- MyCobot Pi: For precise sample handling and manipulation
- AGV (Automated Guided Vehicle): For transporting samples between stations
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Label as MyAGV

- [AprilTags Python Library](https://pypi.org/project/apriltag/)
Used for spatial referencing and tracking of sample containers using AprilTags for accurate positioning.

- Printed AprilTags (can be generated and printed from [AprilTag Generation](https://github.com/AprilRobotics/apriltag-generation))
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can go into the BoM


### 1. Scalability:
- For larger-scale operations, consider implementing a multi-robot system with centralized control.
- Utilize a database to track sample information and processing history.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice point here. Can maybe refer back to corresponding hello world module. Maybe a small code snippet of using pymongo? (Up to you)

This tutorial provides a basic framework for automated solid sample transfer. However, real-world applications often require more complex setups and face various challenges. Here are some considerations for extending the system and troubleshooting common issues:

### 1. Scalability:
- For larger-scale operations, consider implementing a multi-robot system with centralized control.
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wonder what would make sense to be within ROS2 vs. Prefect when a couple robots are involved.

- Use sensors to detect collisions or unexpected obstacles.
- Develop a logging system to record all operations and errors for later analysis.

Let's take the liquid handling station as an example to demonstrate error handling and logging:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This might be a good place to show an example of human-in-the-loop workflow orchestration with Prefect (e.g., error occurred - trigger an operator to go and check it out)

I have a YouTube video about this

@SissiFeng SissiFeng closed this Oct 4, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants