Topologies

[training topology]

@beam/static-diloco

DiLoCo (fixed cohort)

One role holds run.lead and the model; a fixed cohort contributes without data grants (the CR-1 star).

Static membershipBuiltinActivedistributed run

[topology identity]

Details

What version 1.0.1 declares.

Package
@beam/static-diloco
Membership
Static
Engines
distributed run
Tags
diloco, live-session, star, static
Step kinds
local, gather, broadcast
Latest tag
latest -> 1.0.1
Publisher
registry
Visibility
Public
Checksum
sha256:db30f5ff8419870d5df209efd1bf1e04b17fce50a0ab1967eeac0ced3ee82073

[roles]

Roles

Who takes part, and how many members each role holds.

sync1

Leads the run and holds the model.

learner2

The fixed cohort.

[slots]

Slots

The actions a run binds: what each slot consumes and produces.

merge
update* -> model

Merges the updates of a round into the next model version.

train
model -> update

Trains from the latest model version and sends its update.

[round]

Step kinds

The steps of one round, in order.

  1. localrole learner · slot train
  2. gatherfrom learner · to sync · object update · slot merge
  3. broadcastfrom sync · to learner · object model