pub struct EmbeddingBulkheadConfig {
pub max_concurrent: usize,
pub acquire_timeout_ms: u64,
pub fail_fast: bool,
}Expand description
Configuration for the embedding bulkhead pattern.
Fields§
§max_concurrent: usizeMaximum concurrent embedding operations allowed.
Default: 2 (conservative due to CPU/memory intensity).
acquire_timeout_ms: u64Timeout for acquiring a permit in milliseconds (0 = no timeout).
Default: 30000ms (30 seconds - embeddings can be slow).
fail_fast: boolWhether to fail fast when bulkhead is full (vs. waiting).
Default: false (wait for permit).
Implementations§
Source§impl EmbeddingBulkheadConfig
impl EmbeddingBulkheadConfig
Sourcepub fn from_env() -> Self
pub fn from_env() -> Self
Loads configuration from environment variables.
| Variable | Description | Default |
|---|---|---|
SUBCOG_EMBEDDING_BULKHEAD_MAX_CONCURRENT | Max concurrent ops | 2 |
SUBCOG_EMBEDDING_BULKHEAD_ACQUIRE_TIMEOUT_MS | Permit timeout | 30000 |
SUBCOG_EMBEDDING_BULKHEAD_FAIL_FAST | Fail when full | false |
Sourcepub fn with_env_overrides(self) -> Self
pub fn with_env_overrides(self) -> Self
Applies environment variable overrides.
Sourcepub const fn with_max_concurrent(self, max: usize) -> Self
pub const fn with_max_concurrent(self, max: usize) -> Self
Sets the maximum concurrent operations.
Sourcepub const fn with_acquire_timeout_ms(self, timeout_ms: u64) -> Self
pub const fn with_acquire_timeout_ms(self, timeout_ms: u64) -> Self
Sets the acquire timeout in milliseconds.
Sourcepub const fn with_fail_fast(self, fail_fast: bool) -> Self
pub const fn with_fail_fast(self, fail_fast: bool) -> Self
Sets whether to fail fast when the bulkhead is full.
Trait Implementations§
Source§impl Clone for EmbeddingBulkheadConfig
impl Clone for EmbeddingBulkheadConfig
Source§fn clone(&self) -> EmbeddingBulkheadConfig
fn clone(&self) -> EmbeddingBulkheadConfig
Returns a duplicate of the value. Read more
1.0.0 · Source§fn clone_from(&mut self, source: &Self)
fn clone_from(&mut self, source: &Self)
Performs copy-assignment from
source. Read moreSource§impl Debug for EmbeddingBulkheadConfig
impl Debug for EmbeddingBulkheadConfig
Auto Trait Implementations§
impl Freeze for EmbeddingBulkheadConfig
impl RefUnwindSafe for EmbeddingBulkheadConfig
impl Send for EmbeddingBulkheadConfig
impl Sync for EmbeddingBulkheadConfig
impl Unpin for EmbeddingBulkheadConfig
impl UnwindSafe for EmbeddingBulkheadConfig
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more
Source§impl<T> CloneToUninit for Twhere
T: Clone,
impl<T> CloneToUninit for Twhere
T: Clone,
§impl<T> FutureExt for T
impl<T> FutureExt for T
§fn with_context(self, otel_cx: Context) -> WithContext<Self>
fn with_context(self, otel_cx: Context) -> WithContext<Self>
§fn with_current_context(self) -> WithContext<Self>
fn with_current_context(self) -> WithContext<Self>
§impl<T> Instrument for T
impl<T> Instrument for T
§fn instrument(self, span: Span) -> Instrumented<Self>
fn instrument(self, span: Span) -> Instrumented<Self>
§fn in_current_span(self) -> Instrumented<Self>
fn in_current_span(self) -> Instrumented<Self>
Source§impl<T> IntoEither for T
impl<T> IntoEither for T
Source§fn into_either(self, into_left: bool) -> Either<Self, Self>
fn into_either(self, into_left: bool) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left is true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read moreSource§fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
fn into_either_with<F>(self, into_left: F) -> Either<Self, Self>
Converts
self into a Left variant of Either<Self, Self>
if into_left(&self) returns true.
Converts self into a Right variant of Either<Self, Self>
otherwise. Read more§impl<T> IntoRequest<T> for T
impl<T> IntoRequest<T> for T
§fn into_request(self) -> Request<T>
fn into_request(self) -> Request<T>
Wrap the input message
T in a tonic::Request§impl<L> LayerExt<L> for L
impl<L> LayerExt<L> for L
§fn named_layer<S>(&self, service: S) -> Layered<<L as Layer<S>>::Service, S>where
L: Layer<S>,
fn named_layer<S>(&self, service: S) -> Layered<<L as Layer<S>>::Service, S>where
L: Layer<S>,
Applies the layer to a service and wraps it in [
Layered].