Struct BulkheadEmbedder 

pub struct BulkheadEmbedder<E: Embedder> {
    inner: E,
    config: EmbeddingBulkheadConfig,
    semaphore: Arc<Semaphore>,
}

Embedder wrapper with bulkhead (concurrency limiting) pattern.

Limits the number of concurrent embedding operations to prevent resource exhaustion.

Fields

inner: E

config: EmbeddingBulkheadConfig

semaphore: Arc<Semaphore>

Implementations

impl<E: Embedder> BulkheadEmbedder<E>

pub fn new(inner: E, config: EmbeddingBulkheadConfig) -> Self

Creates a new bulkhead-wrapped embedder.

pub fn available_permits(&self) -> usize

Returns the current number of available permits.

fn acquire_permit(&self) -> Result<OwnedSemaphorePermit>

Acquires a permit, respecting the configured timeout and fail-fast settings.

fn acquire_permit_fail_fast( &self, semaphore: &Arc<Semaphore>, available: usize, ) -> Result<OwnedSemaphorePermit>

Fast-fail acquisition that returns error immediately if bulkhead is full.

fn acquire_permit_with_timeout( &self, semaphore: &Arc<Semaphore>, ) -> Result<OwnedSemaphorePermit>

Acquisition with timeout that waits for a permit.

fn execute<T, F>(&self, operation: &'static str, call: F) -> Result<T>

where F: FnOnce() -> Result<T>,

Executes an operation with bulkhead protection.

Trait Implementations

impl<E: Embedder> Embedder for BulkheadEmbedder<E>

fn dimensions(&self) -> usize

Returns the embedding dimensions.

fn embed(&self, text: &str) -> Result<Vec<f32>>

Generates an embedding for the given text.

fn embed_batch(&self, texts: &[&str]) -> Result<Vec<Vec<f32>>>

Generates embeddings for multiple texts.