Contents:
Future
Reducer
default_reduce_fn()
Bases: object
object
Simple asynchronous (all)reduce operations on python objects. Assumes all invokations to allreduce, allreduce_async, and Future.result happen in the same order across all processes.
Broadcast a value from replica 0 to all other replicas. Currently uses allreduce with left-projection.