Files
baibot-withmcp/docs/sample-provider-configs/groq.yml
Slavi Pantaleev 2a5a2d6a4d Add support for prompt variables (bot name, date/time, model id)
Fixes https://github.com/etkecc/baibot/issues/10

This also includes them in the default prompts (for newly-created agents),
so that people can get a better experience out of the box.
2024-09-21 14:28:38 +00:00

11 lines
392 B
YAML

base_url: https://api.groq.com/openai/v1
api_key: YOUR_API_KEY_HERE
text_generation:
model_id: llama3-70b-8192
prompt: "You are a brief, but helpful bot called {{ baibot_name }} powered by the {{ baibot_model_id }} model. The date/time now is: {{ baibot_now_utc }}."
temperature: 1.0
max_response_tokens: 4096
max_context_tokens: 131072
speech_to_text:
model_id: whisper-large-v3