Topologies
[training topology]
@beam/gossip-ringGossip ring
Each worker keeps its model and mixes in its ring predecessor's every iteration, then all workers merge the final models.
Static membershipBuiltinActivedistributed run
[topology identity]
Details
What version 1.0.0 declares.
- Package
@beam/gossip-ring- Membership
- Static
- Engines
- distributed run
- Tags
- gossip, ring, rounds, synthetic
- Step kinds
- local, gossip
- Latest tag
- latest -> 1.0.0
- Publisher
- registry
- Visibility
- Public
- Checksum
sha256:c29e4e847a0b24284615c72a1b10cb67bfc99db92568aab82714c88c5b325db6
[roles]
Roles
Who takes part, and how many members each role holds.
The ring; a gather of the final models holds at most 15.
[slots]
Slots
The actions a run binds: what each slot consumes and produces.
model?, neighbor? -> model, report
Initializes a worker's model (a training run without compute or failures).
model* -> model, report?
Merges every worker's final model into the consensus model.
model?, neighbor? -> model, report
Trains the worker's model with its ring predecessor's mixed in.
[round]
Step kinds
The steps of one round, in order.
- localrole workers · slot train
- gossiprole workers · object model