latest--OllamaLLMUnit

shared
Type object
Schema URL https://catalog.lintel.tools/schemas/schemastore/eidolon-resource/_shared/latest--OllamaLLMUnit.json
Parent schema eidolon-resource
Type: object

Properties

implementation const: "OllamaLLMUnit" required
Constant: "OllamaLLMUnit"
temperature number
Default: 0.3
force_json boolean
Default: true
max_tokens integer | null
Default: null
host string | null

Running Ollama location. Defaults to envar OLLAMA_HOST with fallback to 127.0.0.1:11434 if that is not set.

Default: null
client_options object
30 nested properties
numa boolean
Default: null
num_ctx integer
Default: null
num_batch integer
Default: null
num_gpu integer
Default: null
main_gpu integer
Default: null
low_vram boolean
Default: null
f16_kv boolean
Default: null
logits_all boolean
Default: null
vocab_only boolean
Default: null
use_mmap boolean
Default: null
use_mlock boolean
Default: null
embedding_only boolean
Default: null
num_thread integer
Default: null
num_keep integer
Default: null
seed integer
Default: null
num_predict integer
Default: null
top_k integer
Default: null
top_p number
Default: null
tfs_z number
Default: null
typical_p number
Default: null
repeat_last_n integer
Default: null
temperature number
Default: null
repeat_penalty number
Default: null
presence_penalty number
Default: null
frequency_penalty number
Default: null
mirostat integer
Default: null
mirostat_tau number
Default: null
mirostat_eta number
Default: null
penalize_newline boolean
Default: null
stop string[]
Default: null

Definitions

OllamaOptions object
numa boolean
Default: null
num_ctx integer
Default: null
num_batch integer
Default: null
num_gpu integer
Default: null
main_gpu integer
Default: null
low_vram boolean
Default: null
f16_kv boolean
Default: null
logits_all boolean
Default: null
vocab_only boolean
Default: null
use_mmap boolean
Default: null
use_mlock boolean
Default: null
embedding_only boolean
Default: null
num_thread integer
Default: null
num_keep integer
Default: null
seed integer
Default: null
num_predict integer
Default: null
top_k integer
Default: null
top_p number
Default: null
tfs_z number
Default: null
typical_p number
Default: null
repeat_last_n integer
Default: null
temperature number
Default: null
repeat_penalty number
Default: null
presence_penalty number
Default: null
frequency_penalty number
Default: null
mirostat integer
Default: null
mirostat_tau number
Default: null
mirostat_eta number
Default: null
penalize_newline boolean
Default: null
stop string[]
Default: null