Skip to content

Document heterogeneous node groups for tasks - #4154

Open
Bihan wants to merge 1 commit into
dstackai:masterfrom
Bihan:pr_docs_hetero_node_groups
Open

Document heterogeneous node groups for tasks#4154
Bihan wants to merge 1 commit into
dstackai:masterfrom
Bihan:pr_docs_hetero_node_groups

Conversation

@Bihan

@Bihan Bihan commented Aug 17, 2026

Copy link
Copy Markdown
Collaborator

Summary

  • Add a Node groups section to the tasks concepts docs covering per-group nodes/resources/commands/ports and ${{ groups[i].nodes[j].IP_ADDRESS }} references.
  • Split from the feature work in Support Heterogenous Node Groups #4094 so docs can be reviewed separately.

Co-authored-by: Cursor <cursoragent@cursor.com>
@Bihan
Bihan requested a review from peterschmidt85 August 17, 2026 11:47

@peterschmidt85 peterschmidt85 left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  1. Do you think we could also add "???" (collapsible) section with P/D example?
  2. Do you think it would make sense to also re-write our mpirun and ray examples - and link them from here?

`${{ groups[i].nodes[j].IP_ADDRESS }}`, where `i` is the index of the group in `groups` and `j` is
the index of the node within that group.

Node `groups[0].nodes[0]` is the run's master node — it is what `DSTACK_MASTER_NODE_IP` resolves

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

IMO, this can use a blockquote to highlight this?

@Bihan

Bihan commented Aug 17, 2026

Copy link
Copy Markdown
Collaborator Author

@peterschmidt85

  1. Do you think we could also add "???" (collapsible) section with P/D example?

P/D is a service setup, and the next PR switches services from replicas: to groups: and adds interpolation. I think it would be better to add it once that PR lands, when the example can use groups: and ${{ groups[i].replicas[j].IP_ADDRESS }}.

  1. Do you think it would make sense to also re-write our mpirun and ray examples - and link them from here?
    Yes.

@peterschmidt85

Copy link
Copy Markdown
Contributor

@Bihan

P/D is a service setup

I meant adding a task example

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants