Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Where are the relevant codes for the three parallel mechanisms of TP, PP and DP implemented? #62

Open
lixingyii opened this issue Jan 6, 2025 · 1 comment
Open

Where are the relevant codes for the three parallel mechanisms of TP, PP and DP implemented? #62

lixingyii opened this issue Jan 6, 2025 · 1 comment

Comments

@lixingyii
Copy link

Hello, authors and developers of SimAI, I am very interested in your project. I would like to ask you a question: when I run ns-3 simulation, no matter how I adjust the parameters TP and PP, the relevant traffic of PP and DP is not found in the final result file. Is it because the mechanism of PP and DP is not implemented in ns3 simulator?
@Huoyuan100861
Copy link
Collaborator

Hello, authors and developers of SimAI, I am very interested in your project. I would like to ask you a question: when I run ns-3 simulation, no matter how I adjust the parameters TP and PP, the relevant traffic of PP and DP is not found in the final result file. Is it because the mechanism of PP and DP is not implemented in ns3 simulator?

"DP, we will perform it last with Allgather followed by ReduceScatter. For PP communication and bubble, we will temporarily use formulas for calculation."

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@Huoyuan100861 @lixingyii