factory
factory
¶
Factory function for creating LLM clients.
get_client(provider='openrouter', base_url=None, api_key=None, model=None, api_format=None, **kwargs)
¶
Create an LLM client for the given provider.
Parameters:
| Name | Type | Description | Default |
|---|---|---|---|
provider
|
str
|
Provider name ("openrouter", "openai", "vllm") |
'openrouter'
|
base_url
|
Optional[str]
|
Override the default base URL. For vLLM, None means offline mode. |
None
|
api_key
|
Optional[str]
|
API key (resolved from env if not provided) |
None
|
model
|
Optional[str]
|
Model name (required for vLLM offline mode) |
None
|
api_format
|
Optional[str]
|
API format ("chat" or "responses"). Defaults to "responses" for OpenAI, "chat" for other providers. |
None
|
**kwargs
|
Any
|
Additional kwargs passed to the client constructor |
{}
|
Returns:
| Type | Description |
|---|---|
LLMClient
|
An LLMClient instance |
Raises:
| Type | Description |
|---|---|
ValueError
|
If provider is unknown or vLLM offline mode missing model |