Struct LlmResilienceConfig 

pub struct LlmResilienceConfig {
    pub max_retries: u32,
    pub retry_backoff_ms: u64,
    pub breaker_failure_threshold: u32,
    pub breaker_reset_timeout_ms: u64,
    pub breaker_half_open_max_calls: u32,
    pub latency_slo_ms: u64,
    pub error_budget_ratio: f64,
    pub error_budget_window_secs: u64,
}

Resilience configuration for LLM calls.

Fields

max_retries: u32

Maximum number of retries for retryable failures.

retry_backoff_ms: u64

Backoff between retries in milliseconds.

breaker_failure_threshold: u32

Consecutive failures before opening the circuit.

breaker_reset_timeout_ms: u64

How long to keep the circuit open before half-open.

breaker_half_open_max_calls: u32

Maximum trial calls while half-open.

latency_slo_ms: u64

Latency budget in milliseconds for LLM calls.

error_budget_ratio: f64

Error budget ratio threshold.

error_budget_window_secs: u64

Error budget window in seconds.

Implementations

impl LlmResilienceConfig

pub fn from_env() -> Self

Loads resilience configuration from environment variables.

pub fn from_config(config: &LlmConfig) -> Self

Loads resilience configuration from config file settings.

pub fn with_env_overrides(self) -> Self

Applies environment variable overrides.

Trait Implementations

impl Clone for LlmResilienceConfig

fn clone(&self) -> LlmResilienceConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LlmResilienceConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for LlmResilienceConfig

fn default() -> Self

Returns the “default value” for a type.