Enum CudaStorage 

pub enum CudaStorage {
    F16(CudaSlice<u16>),
    BF16(CudaSlice<u16>),
    F32(CudaSlice<f32>),
    F64(CudaSlice<f64>),
    U8(CudaSlice<u8>),
    U32(CudaSlice<u32>),
    I64(CudaSlice<i64>),
}

GPU-side storage. Each variant wraps a cudarc CudaSlice for the corresponding dtype. F16 and BF16 are stored as CudaSlice (bit-level representation).

Variants

F16(CudaSlice<u16>)

BF16(CudaSlice<u16>)

F32(CudaSlice<f32>)

F64(CudaSlice<f64>)

U8(CudaSlice<u8>)

U32(CudaSlice<u32>)

I64(CudaSlice<i64>)

Implementations

impl CudaStorage

pub fn as_cuda_slice_f32(&self) -> Result<&CudaSlice<f32>>

Get the underlying CudaSlice (returns error if dtype doesn’t match).

pub fn as_cuda_slice_u16(&self) -> Result<&CudaSlice<u16>>

Get the underlying CudaSlice for F16 or BF16 storage.

pub fn from_f32_vec(data: Vec<f32>, device: &CudaDevice) -> Result<Self>

Transfer data from host Vec to a new CudaStorage on the given device.

pub fn from_f64_vec(data: Vec<f64>, device: &CudaDevice) -> Result<Self>

Transfer data from host Vec to a new CudaStorage on the given device.

pub fn from_f16_vec(data: Vec<f16>, device: &CudaDevice) -> Result<Self>

Transfer data from host Vec to a new F16 CudaStorage on the given device.

pub fn from_bf16_vec(data: Vec<bf16>, device: &CudaDevice) -> Result<Self>

Transfer data from host Vec to a new BF16 CudaStorage on the given device.

pub fn to_host_f64(&self, device: &CudaDevice) -> Result<Vec<f64>>

Copy all data to host as Vec.

Trait Implementations

impl BackendStorage for CudaStorage

fn dtype(&self) -> DType

The data type of the elements in this storage.

fn len(&self) -> usize

Total number of elements that fit in this storage.

fn is_empty(&self) -> bool

impl Clone for CudaStorage

fn clone(&self) -> Self

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for CudaStorage

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Send for CudaStorage

impl Sync for CudaStorage