pub enum QuantBits {
Int8,
Int4,
}Expand description
Bit-width for quantized values.
Variants§
Int8
8-bit quantization (range: -128..127 or 0..255).
Int4
4-bit quantization (range: -8..7 or 0..15).
Trait Implementations§
impl Copy for QuantBits
impl Eq for QuantBits
impl StructuralPartialEq for QuantBits
Auto Trait Implementations§
impl Freeze for QuantBits
impl RefUnwindSafe for QuantBits
impl Send for QuantBits
impl Sync for QuantBits
impl Unpin for QuantBits
impl UnwindSafe for QuantBits
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more