pub enum AllReduceOp {
Sum,
Average,
}Expand description
Strategy for combining gradients from multiple replicas.
Variants§
Sum
Sum all gradients (caller divides by N if needed).
Average
Average gradients across replicas (most common).
Trait Implementations§
Source§impl Clone for AllReduceOp
impl Clone for AllReduceOp
Source§fn clone(&self) -> AllReduceOp
fn clone(&self) -> AllReduceOp
Returns a duplicate of the value. Read more
1.0.0 (const: unstable) · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreimpl Copy for AllReduceOp
Source§impl Debug for AllReduceOp
impl Debug for AllReduceOp
impl Eq for AllReduceOp
Source§impl PartialEq for AllReduceOp
impl PartialEq for AllReduceOp
Source§fn eq(&self, other: &AllReduceOp) -> bool
fn eq(&self, other: &AllReduceOp) -> bool
Tests for
self and other values to be equal, and is used by ==.impl StructuralPartialEq for AllReduceOp
Auto Trait Implementations§
impl Freeze for AllReduceOp
impl RefUnwindSafe for AllReduceOp
impl Send for AllReduceOp
impl Sync for AllReduceOp
impl Unpin for AllReduceOp
impl UnsafeUnpin for AllReduceOp
impl UnwindSafe for AllReduceOp
Blanket Implementations§
impl<T> Boilerplate for T
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more