adaptdl package

Subpackages

• adaptdl.torch package
  • Accumulator
    • Accumulator.__iadd__()
    • Accumulator.__isub__()
    • Accumulator.__getitem__()
    • Accumulator.subtract()
    • Accumulator.synchronized()
    • Accumulator.update()
  • AdaptiveDataLoader
    • AdaptiveDataLoader.__iter__()
  • AdaptiveDataParallel
    • AdaptiveDataParallel.forward()
    • AdaptiveDataParallel.gain
    • AdaptiveDataParallel.to_tensorboard()
    • AdaptiveDataParallel.training
    • AdaptiveDataParallel.zero_grad()
  • ElasticSampler
    • ElasticSampler.__iter__()
    • ElasticSampler.__len__()
    • ElasticSampler.set_epoch()
  • current_dataloader()
  • current_epoch()
  • finished_epochs()
  • init_process_group()
  • remaining_epochs_until()
  • Submodules
    • adaptdl.torch.accumulator module
      • Accumulator
    • adaptdl.torch.data module
      • AdaptiveDataLoader
      • AdaptiveDataLoaderHelper
      • AdaptiveDataLoaderMixin
      • ElasticSampler
      • current_dataloader()
    • adaptdl.torch.epoch module
      • current_epoch()
      • finished_epochs()
      • remaining_epochs_until()
    • adaptdl.torch.gradient_noise_scale module
      • GradientNoiseScale
    • adaptdl.torch.iterator module
      • AdaptiveBPTTIterator
    • adaptdl.torch.parallel module
      • AdaptiveDataParallel
    • adaptdl.torch.scaling_rules module
      • AdaScale
      • LEGWScale
      • LinearScale
      • ScalingRuleBase
      • SqrtScale

Submodules

• adaptdl.checkpoint module
  • State
    • State.load()
    • State.save()
    • State.sync()
  • load_state()
  • save_all_states()
  • save_state()
• adaptdl.collective module
  • allreduce()
  • allreduce_async()
  • broadcast()
  • initialize()
  • teardown()
• adaptdl.env module
  • adaptdl_sched_version()
  • checkpoint_path()
  • from_ray()
  • job_id()
  • master_addr()
  • master_port()
  • num_nodes()
  • num_replicas()
  • num_restarts()
  • replica_rank()
  • share_path()
  • supervisor_url()
• adaptdl.goodput module
  • GoodputFunction
    • GoodputFunction.efficiency()
    • GoodputFunction.evaluate()
    • GoodputFunction.optimize()
    • GoodputFunction.throughput()
  • GradParams
    • GradParams.sqr
    • GradParams.var
  • PerfParams
    • PerfParams.alpha_c
    • PerfParams.alpha_n
    • PerfParams.alpha_r
    • PerfParams.beta_c
    • PerfParams.beta_n
    • PerfParams.beta_r
    • PerfParams.gamma
  • fit_perf_params()
• adaptdl.reducer module
  • Future
    • Future.result()
  • Reducer
    • Reducer.allreduce()
    • Reducer.allreduce_async()
    • Reducer.broadcast()
  • default_reduce_fn()
• adaptdl.sched_hints module
  • post_sched_hints()
• adaptdl.utils module
  • print_exc()