Topologies

[training topology]

@beam/split-authorities

Split authorities

The run lead is not the aggregator: two stars share the trainers.

Elastic membershipBuiltinActivedistributed run

[topology identity]

Details

What version 1.0.2 declares.

Package
@beam/split-authorities
Membership
Elastic
Engines
distributed run
Tags
data-grants, elastic, live-session
Step kinds
local, gather, broadcast
Latest tag
latest -> 1.0.2
Publisher
registry
Visibility
Public
Checksum
sha256:46c1549d7a7ab17a405131c624ec424b2e98d8858808519f0c3ad08a1ddf501b

[roles]

Roles

Who takes part, and how many members each role holds.

trainer1..8

Members that join and leave.

aggregator1

Hands out data units and holds the model.

coordinator1

Leads the run; holds no state.

[slots]

Slots

The actions a run binds: what each slot consumes and produces.

merge
update* -> model

Merges the updates of a round into the next model version.

train
model, shards -> update

Trains on pulled data units from the latest model version.

coordinate
nothing -> decision

Leads the run (the coordinator's interface, a merge in the preset).

[round]

Step kinds

The steps of one round, in order.

  1. localrole coordinator · slot coordinate
  2. localrole trainer · slot train
  3. gatherfrom trainer · to aggregator · object update · slot merge
  4. broadcastfrom aggregator · to trainer · object model