Struct JitExecutor 

pub struct JitExecutor<B: Backend> { /* private fields */ }

A JIT-compiled executor that runs pre-compiled graph execution plans.

Unlike the interpreter (Executor), the JIT executor:

• Pre-compiles each graph into a flat instruction tape
• Pre-resolves all buffer slot assignments
• Inserts dead-value-free instructions for memory efficiency
• Dispatches operations without HashMap lookups or string matching

Usage

let jit = JitExecutor::<CpuBackend>::compile(program, device, config)?;
let result = jit.run("Forward", &inputs)?;
let output = result.get("output").unwrap();

Implementations

impl<B: Backend> JitExecutor<B>

pub fn compile( program: IrProgram, device: B::Device, config: RuntimeConfig, ) -> Result<Self>

Compile all graphs in a program and create a JIT executor.

pub fn stats(&self, graph_name: &str) -> Option<&CompileStats>

Get compilation statistics for a graph.

pub fn all_stats(&self) -> Vec<(&str, &CompileStats)>

Get all compilation statistics.

pub fn run( &self, graph_name: &str, inputs: &HashMap<String, Tensor<B>>, ) -> Result<JitResult<B>>

Run a compiled graph with the given inputs.

pub fn program(&self) -> &IrProgram

Get the underlying program.

pub fn config(&self) -> &RuntimeConfig

Get runtime config.

pub fn params(&self) -> &HashMap<(String, String), Tensor<B>>

Get all parameters.

pub fn graph_params(&self, graph_name: &str) -> Vec<Tensor<B>>

Get parameters for a specific graph.

pub fn update_params(&mut self, graph_name: &str, new_params: &[Tensor<B>])

Update parameters after an optimizer step.

pub fn recompile(&mut self, graph_name: &str) -> Result<()>

Recompile a single graph (e.g., after optimizer changes shapes).

pub fn dump(&self, graph_name: &str) -> Option<String>

Dump the compiled instruction tape for a graph (debugging).