pub enum AllReduceOp {
Sum,
Average,
}Expand description
Strategy for combining gradients from multiple replicas.
Variants§
Sum
Sum all gradients (caller divides by N if needed).
Average
Average gradients across replicas (most common).
Trait Implementations§
Source§impl Clone for AllReduceOp
impl Clone for AllReduceOp
Source§fn clone(&self) -> AllReduceOp
fn clone(&self) -> AllReduceOp
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for AllReduceOp
impl Debug for AllReduceOp
Source§impl PartialEq for AllReduceOp
impl PartialEq for AllReduceOp
impl Copy for AllReduceOp
impl Eq for AllReduceOp
impl StructuralPartialEq for AllReduceOp
Auto Trait Implementations§
impl Freeze for AllReduceOp
impl RefUnwindSafe for AllReduceOp
impl Send for AllReduceOp
impl Sync for AllReduceOp
impl Unpin for AllReduceOp
impl UnwindSafe for AllReduceOp
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more