Skip to content

Conversation

@tushar00jain
Copy link
Contributor

@tushar00jain tushar00jain commented Nov 4, 2025

Summary:

  • we need to pass the global rank information to pytorch so that the pg name can include the pg information
  • this is necessary to differentiate the default pg's on different replicas
  • these need to different because flight recorder matches collectives based on pg name as well

Stack created with Sapling. Best reviewed with ReviewStack.

@meta-cla meta-cla bot added the CLA Signed This label is managed by the Meta Open Source bot. label Nov 4, 2025
@tushar00jain tushar00jain force-pushed the pr1986 branch 2 times, most recently from 81bb146 to 2d5ff16 Compare November 6, 2025 18:24
Summary:
- we need to pass the global rank information to pytorch so that the pg name can include the pg information
- this is necessary to differentiate the default pg's on different replicas
- these need to different because flight recorder matches collectives based on pg name as well
Copy link
Member

@d4l3k d4l3k left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@tushar00jain tushar00jain marked this pull request as ready for review November 6, 2025 19:25
Copy link
Contributor

@fduwjj fduwjj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM but I guess you will need an approval from @tianyu-l @fegin or @wwwjn for this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Meta Open Source bot.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants