perplexity_from_log_probs

Function perplexity_from_log_probs 

Source
pub fn perplexity_from_log_probs(log_probs: &[f64]) -> f64
Expand description

Perplexity from a flat array of per-token log-probabilities.

PPL = exp(-1/N * sum(log_probs))