docs/sample-provider-configs/groq.yml

base_url: https://api.groq.com/openai/v1
api_key: YOUR_API_KEY_HERE
text_generation:
  model_id: llama3-70b-8192
  prompt: "You are a brief, but helpful bot called {{ baibot_name }} powered by the {{ baibot_model_id }} model. The date/time now is: {{ baibot_now_utc }}."
  temperature: 1.0
  max_response_tokens: 4096
  max_context_tokens: 131072
speech_to_text:
  model_id: whisper-large-v3
Initial commit 2024-09-12 13:44:06 +03:00			`base_url: https://api.groq.com/openai/v1`
			`api_key: YOUR_API_KEY_HERE`
			`text_generation:`
			`model_id: llama3-70b-8192`
Add support for prompt variables (bot name, date/time, model id) Fixes https://github.com/etkecc/baibot/issues/10 This also includes them in the default prompts (for newly-created agents), so that people can get a better experience out of the box. 2024-09-21 14:05:19 +00:00			`prompt: "You are a brief, but helpful bot called {{ baibot_name }} powered by the {{ baibot_model_id }} model. The date/time now is: {{ baibot_now_utc }}."`
Initial commit 2024-09-12 13:44:06 +03:00			`temperature: 1.0`
			`max_response_tokens: 4096`
			`max_context_tokens: 131072`
			`speech_to_text:`
			`model_id: whisper-large-v3`