docs/sample-provider-configs/localai.yml

base_url: http://my-localai-self-hosted-service:8080/v1
api_key: YOUR_API_KEY_HERE
text_generation:
  model_id: gpt-4
  prompt: "You are a brief, but helpful bot called {{ baibot_name }} powered by the {{ baibot_model_id }} model. The date/time now is: {{ baibot_now_utc }}."
  temperature: 1.0
  max_response_tokens: 4096
  max_context_tokens: 128000
speech_to_text:
  model_id: whisper-1
text_to_speech:
  model_id: tts-1
  voice: onyx
  speed: 1.0
  response_format: opus
image_generation:
  model_id: stablediffusion
  style: vivid
  size: 1024x1024
  quality: standard
Initial commit 2024-09-12 13:44:06 +03:00			`base_url: http://my-localai-self-hosted-service:8080/v1`
			`api_key: YOUR_API_KEY_HERE`
			`text_generation:`
			`model_id: gpt-4`
Add support for prompt variables (bot name, date/time, model id) Fixes https://github.com/etkecc/baibot/issues/10 This also includes them in the default prompts (for newly-created agents), so that people can get a better experience out of the box. 2024-09-21 14:05:19 +00:00			`prompt: "You are a brief, but helpful bot called {{ baibot_name }} powered by the {{ baibot_model_id }} model. The date/time now is: {{ baibot_now_utc }}."`
Initial commit 2024-09-12 13:44:06 +03:00			`temperature: 1.0`
			`max_response_tokens: 4096`
			`max_context_tokens: 128000`
			`speech_to_text:`
			`model_id: whisper-1`
			`text_to_speech:`
			`model_id: tts-1`
			`voice: onyx`
			`speed: 1.0`
			`response_format: opus`
			`image_generation:`
			`model_id: stablediffusion`
			`style: vivid`
			`size: 1024x1024`
			`quality: standard`