pub struct LmStudioClient {
endpoint: String,
model: Option<String>,
client: Client,
}Expand description
LM Studio local LLM client.
LM Studio provides an OpenAI-compatible API on localhost.
Fields§
§endpoint: StringAPI endpoint.
model: Option<String>Model to use (optional, LM Studio uses loaded model).
client: ClientHTTP client.
Implementations§
Source§impl LmStudioClient
impl LmStudioClient
Sourcepub const DEFAULT_ENDPOINT: &'static str = "http://localhost:1234/v1"
pub const DEFAULT_ENDPOINT: &'static str = "http://localhost:1234/v1"
Default API endpoint.
Sourcepub fn with_endpoint(self, endpoint: impl Into<String>) -> Self
pub fn with_endpoint(self, endpoint: impl Into<String>) -> Self
Sets the API endpoint.
Sourcepub fn with_model(self, model: impl Into<String>) -> Self
pub fn with_model(self, model: impl Into<String>) -> Self
Sets the model (optional).
Sourcepub fn is_available(&self) -> bool
pub fn is_available(&self) -> bool
Checks if LM Studio is available.
Trait Implementations§
Source§impl Default for LmStudioClient
impl Default for LmStudioClient
Source§impl LlmProvider for LmStudioClient
impl LlmProvider for LmStudioClient
Auto Trait Implementations§
impl Freeze for LmStudioClient
impl !RefUnwindSafe for LmStudioClient
impl Send for LmStudioClient
impl Sync for LmStudioClient
impl Unpin for LmStudioClient
impl !UnwindSafe for LmStudioClient
Blanket Implementations§
Source§impl<T> BorrowMut<T> for Twhere
T: ?Sized,
impl<T> BorrowMut<T> for Twhere
T: ?Sized,
Source§fn borrow_mut(&mut self) -> &mut T
fn borrow_mut(&mut self) -> &mut T
Mutably borrows from an owned value. Read more