Struct LlmConfig 

pub struct LlmConfig {

    pub provider: LlmProvider,
    pub model: Option<String>,
    pub api_key: Option<String>,
    pub base_url: Option<String>,
    pub max_tokens: Option<u32>,
    pub timeout_ms: Option<u64>,
    pub connect_timeout_ms: Option<u64>,
    pub max_retries: Option<u32>,
    pub retry_backoff_ms: Option<u64>,
    pub breaker_failure_threshold: Option<u32>,
    pub breaker_reset_ms: Option<u64>,
    pub breaker_half_open_max_calls: Option<u32>,
    pub latency_slo_ms: Option<u64>,
    pub error_budget_ratio: Option<f64>,
    pub error_budget_window_secs: Option<u64>,
}

LLM provider configuration.

Fields

provider: LlmProvider

Provider name: “anthropic”, “openai”, “ollama”, “lmstudio”.

model: Option<String>

Model name.

api_key: Option<String>

API key (can be environment variable reference like ${OPENAI_API_KEY}).

base_url: Option<String>

Base URL for the provider (for self-hosted).

max_tokens: Option<u32>

Maximum completion tokens for LLM responses.

timeout_ms: Option<u64>

Request timeout in milliseconds.

connect_timeout_ms: Option<u64>

Connect timeout in milliseconds.

max_retries: Option<u32>

Maximum retries for LLM calls.

retry_backoff_ms: Option<u64>

Retry backoff in milliseconds.

breaker_failure_threshold: Option<u32>

Consecutive failures before opening circuit breaker.

breaker_reset_ms: Option<u64>

Circuit breaker reset timeout in milliseconds.

breaker_half_open_max_calls: Option<u32>

Half-open trial requests.

latency_slo_ms: Option<u64>

Latency budget in milliseconds.

error_budget_ratio: Option<f64>

Error budget ratio threshold.

error_budget_window_secs: Option<u64>

Error budget window in seconds.

Implementations

impl LlmConfig

pub fn from_config_file(file: &ConfigFileLlm) -> Self

Creates LLM config from config file settings.

ARCH-HIGH-002: Delegated from SubcogConfig::apply_config_file.

pub fn merge_from(&mut self, file: &ConfigFileLlm)

Merges another config into this one.

Only overrides fields that are set in the source.

Trait Implementations

impl Clone for LlmConfig

fn clone(&self) -> LlmConfig

Returns a duplicate of the value.

fn clone_from(&mut self, source: &Self)

Performs copy-assignment from source.

impl Debug for LlmConfig

fn fmt(&self, f: &mut Formatter<'_>) -> Result

Formats the value using the given formatter.

impl Default for LlmConfig

fn default() -> LlmConfig

Returns the “default value” for a type.