latest--AzureLLMUnit

shared
Type object
Schema URL https://catalog.lintel.tools/schemas/schemastore/eidolon-resource/_shared/latest--AzureLLMUnit.json
Parent schema eidolon-resource
Type: object

Azure LLM Unit. Requires model to be defined. See https://www.eidolonai.com/docs/howto/swap_llm for more details.

Authentication is handled oot with one of two mechanisms:

  • Static token defined with AZURE_OPENAI_API_KEY
  • Token provider defined by AZURE_CLIENT_ID, AZURE_CLIENT_SECRET, and AZURE_TENANT_ID

To use an alternative authentication mechanism, provide a custom token provider.

Properties

implementation const: "AzureLLMUnit" required
Constant: "AzureLLMUnit"
model Latest Overview required

The model to use for the LLM. Since Azure deployments use custom names, no default is provided. See https://www.eidolonai.com/docs/howto/swap_llm for more details. on defining custom models.

azure_endpoint string required

The azure_endpoint for the Azure LLM API. ie, "https://eidolon-azure.openai.azure.com/"

temperature number
Default: 0.3
force_json boolean
Default: true
max_tokens integer | null
Default: null
supports_system_messages boolean
Default: true
can_stream boolean
Default: true
azure_ad_token_provider _Reference | null
token_provider_scopes string[]
Default:
[
  "https://cognitiveservices.azure.com/.default"
]
api_version string
Default: "2024-02-01"
client_args object
Default:
{}

Definitions

_Reference object
implementation string