Compare commits
5 Commits
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
91986a129c | ||
|
|
264f683d6a | ||
|
|
62f0f4fa0d | ||
|
|
69627abd74 | ||
|
|
d2660be33c |
@@ -1,3 +1,11 @@
|
|||||||
|
# (2025-05-11) Version 1.7.2
|
||||||
|
|
||||||
|
- (**Bugfix**) Allow `image_generation.size` configuration value for OpenAI to be `null` to allow the model to choose the size automatically and default to that
|
||||||
|
|
||||||
|
# (2025-05-11) Version 1.7.1
|
||||||
|
|
||||||
|
- (**Bugfix**) Fix lack of documentation for the new [image-editing](./docs/features.md#-image-editing) feature in the `!bai usage` command's output
|
||||||
|
|
||||||
# (2025-05-10) Version 1.7.0
|
# (2025-05-10) Version 1.7.0
|
||||||
|
|
||||||
- (**Feature**) Add vision support to the OpenAI and Anthropic providers. You can now mix text and images in your conversations - fixes [issue #5](https://github.com/etkecc/baibot/issues/5)
|
- (**Feature**) Add vision support to the OpenAI and Anthropic providers. You can now mix text and images in your conversations - fixes [issue #5](https://github.com/etkecc/baibot/issues/5)
|
||||||
|
|||||||
2
Cargo.lock
generated
2
Cargo.lock
generated
@@ -346,7 +346,7 @@ dependencies = [
|
|||||||
|
|
||||||
[[package]]
|
[[package]]
|
||||||
name = "baibot"
|
name = "baibot"
|
||||||
version = "1.7.0"
|
version = "1.7.2"
|
||||||
dependencies = [
|
dependencies = [
|
||||||
"anthropic",
|
"anthropic",
|
||||||
"anyhow",
|
"anyhow",
|
||||||
|
|||||||
@@ -7,7 +7,7 @@ license = "AGPL-3.0-or-later"
|
|||||||
readme = "README.md"
|
readme = "README.md"
|
||||||
keywords = ["matrix", "chat", "bot", "AI", "LLM"]
|
keywords = ["matrix", "chat", "bot", "AI", "LLM"]
|
||||||
include = ["/etc/assets/baibot-torso-768.png", "/src", "/README.md", "/CHANGELOG.md", "/LICENSE"]
|
include = ["/etc/assets/baibot-torso-768.png", "/src", "/README.md", "/CHANGELOG.md", "/LICENSE"]
|
||||||
version = "1.7.0"
|
version = "1.7.2"
|
||||||
edition = "2024"
|
edition = "2024"
|
||||||
|
|
||||||
[lib]
|
[lib]
|
||||||
|
|||||||
@@ -20,5 +20,5 @@ text_to_speech:
|
|||||||
image_generation:
|
image_generation:
|
||||||
model_id: gpt-image-1
|
model_id: gpt-image-1
|
||||||
style: null
|
style: null
|
||||||
size: 1024x1024
|
size: null
|
||||||
quality: null
|
quality: null
|
||||||
|
|||||||
@@ -16,5 +16,5 @@ text_to_speech:
|
|||||||
image_generation:
|
image_generation:
|
||||||
model_id: gpt-image-1
|
model_id: gpt-image-1
|
||||||
style: null
|
style: null
|
||||||
size: 1024x1024
|
size: null
|
||||||
quality: null
|
quality: null
|
||||||
|
|||||||
@@ -79,7 +79,7 @@ Simply send a command like `!bai image create A beautiful sunset over the ocean`
|
|||||||
|
|
||||||
See a [🖼️ Screenshot of the Image Creation feature](./screenshots/image-creation.webp).
|
See a [🖼️ Screenshot of the Image Creation feature](./screenshots/image-creation.webp).
|
||||||
|
|
||||||
You can then, respond in the same message thread with:
|
You can then respond in the same message thread with:
|
||||||
|
|
||||||
- more messages, to add more criteria to your prompt.
|
- more messages, to add more criteria to your prompt.
|
||||||
- a message saying `again`, to generate one more image with the current prompt.
|
- a message saying `again`, to generate one more image with the current prompt.
|
||||||
@@ -91,7 +91,7 @@ Simply send a command like `!bai image edit Turn the following image into an ani
|
|||||||
|
|
||||||
See a [🖼️ Screenshot of the Image Editing feature (manipulating a single image)](./screenshots/image-editing-single-image.webp) and a [🖼️ Screenshot of the Image Editing feature (manipulating multiple images)](./screenshots/image-editing-multiple-images.webp).
|
See a [🖼️ Screenshot of the Image Editing feature (manipulating a single image)](./screenshots/image-editing-single-image.webp) and a [🖼️ Screenshot of the Image Editing feature (manipulating multiple images)](./screenshots/image-editing-multiple-images.webp).
|
||||||
|
|
||||||
You can then, respond in the same message thread with:
|
You can then respond in the same message thread with:
|
||||||
|
|
||||||
- more messages, to add more criteria to your prompt.
|
- more messages, to add more criteria to your prompt.
|
||||||
- one or more images, to provide the images that the bot will operate on.
|
- one or more images, to provide the images that the bot will operate on.
|
||||||
@@ -101,7 +101,7 @@ You can then, respond in the same message thread with:
|
|||||||
|
|
||||||
#### 🫵 Creating stickers
|
#### 🫵 Creating stickers
|
||||||
|
|
||||||
A variation of [creating images](#creating-images) is to create "sticker images".
|
A variation of [creating images](#creating-images) is creating "sticker images".
|
||||||
|
|
||||||
See a [🖼️ Screenshot of the Sticker Creation feature](./screenshots/sticker-generation.webp).
|
See a [🖼️ Screenshot of the Sticker Creation feature](./screenshots/sticker-generation.webp).
|
||||||
|
|
||||||
|
|||||||
@@ -91,10 +91,10 @@ agents:
|
|||||||
# speed: 1.0
|
# speed: 1.0
|
||||||
# response_format: opus
|
# response_format: opus
|
||||||
# image_generation:
|
# image_generation:
|
||||||
# model_id: dall-e-3
|
# model_id: gpt-image-1
|
||||||
# style: vivid
|
# style: null
|
||||||
# size: 1024x1024
|
# size: null
|
||||||
# quality: standard
|
# quality: null
|
||||||
#
|
#
|
||||||
# - id: localai
|
# - id: localai
|
||||||
# provider: localai
|
# provider: localai
|
||||||
|
|||||||
@@ -153,7 +153,7 @@ pub struct ImageGenerationConfig {
|
|||||||
pub style: Option<async_openai::types::ImageStyle>,
|
pub style: Option<async_openai::types::ImageStyle>,
|
||||||
|
|
||||||
#[serde(default = "default_image_size")]
|
#[serde(default = "default_image_size")]
|
||||||
pub size: async_openai::types::ImageSize,
|
pub size: Option<async_openai::types::ImageSize>,
|
||||||
|
|
||||||
#[serde(default = "default_image_quality")]
|
#[serde(default = "default_image_quality")]
|
||||||
pub quality: Option<async_openai::types::ImageQuality>,
|
pub quality: Option<async_openai::types::ImageQuality>,
|
||||||
@@ -186,8 +186,8 @@ fn default_image_style() -> Option<async_openai::types::ImageStyle> {
|
|||||||
None
|
None
|
||||||
}
|
}
|
||||||
|
|
||||||
fn default_image_size() -> async_openai::types::ImageSize {
|
fn default_image_size() -> Option<async_openai::types::ImageSize> {
|
||||||
async_openai::types::ImageSize::S1024x1024
|
None
|
||||||
}
|
}
|
||||||
|
|
||||||
fn default_image_quality() -> Option<async_openai::types::ImageQuality> {
|
fn default_image_quality() -> Option<async_openai::types::ImageQuality> {
|
||||||
|
|||||||
@@ -284,11 +284,8 @@ impl ControllerTrait for Controller {
|
|||||||
|
|
||||||
let size = params
|
let size = params
|
||||||
.size_override
|
.size_override
|
||||||
.map(|s| {
|
.map(|s| convert_string_to_enum::<async_openai::types::ImageSize>(&s).unwrap())
|
||||||
convert_string_to_enum::<async_openai::types::ImageSize>(&s)
|
.or(image_generation_config.size);
|
||||||
.unwrap_or(image_generation_config.size)
|
|
||||||
})
|
|
||||||
.unwrap_or(image_generation_config.size);
|
|
||||||
|
|
||||||
let response_format = match model.clone() {
|
let response_format = match model.clone() {
|
||||||
ImageModel::DallE2 => Some(ImageResponseFormat::B64Json),
|
ImageModel::DallE2 => Some(ImageResponseFormat::B64Json),
|
||||||
@@ -303,10 +300,7 @@ impl ControllerTrait for Controller {
|
|||||||
|
|
||||||
let mut request_builder = CreateImageRequestArgs::default();
|
let mut request_builder = CreateImageRequestArgs::default();
|
||||||
|
|
||||||
request_builder
|
request_builder.model(model).prompt(prompt.to_owned());
|
||||||
.model(model)
|
|
||||||
.prompt(prompt.to_owned())
|
|
||||||
.size(size);
|
|
||||||
|
|
||||||
if let Some(response_format) = response_format {
|
if let Some(response_format) = response_format {
|
||||||
request_builder.response_format(response_format);
|
request_builder.response_format(response_format);
|
||||||
@@ -320,6 +314,10 @@ impl ControllerTrait for Controller {
|
|||||||
request_builder.quality(quality.clone());
|
request_builder.quality(quality.clone());
|
||||||
}
|
}
|
||||||
|
|
||||||
|
if let Some(size) = size {
|
||||||
|
request_builder.size(size);
|
||||||
|
}
|
||||||
|
|
||||||
let request = request_builder.build()?;
|
let request = request_builder.build()?;
|
||||||
|
|
||||||
tracing::trace!(
|
tracing::trace!(
|
||||||
@@ -382,9 +380,9 @@ impl ControllerTrait for Controller {
|
|||||||
}
|
}
|
||||||
|
|
||||||
let dalle2_size = match image_generation_config.size {
|
let dalle2_size = match image_generation_config.size {
|
||||||
async_openai::types::ImageSize::S256x256 => Some(DallE2ImageSize::S256x256),
|
Some(async_openai::types::ImageSize::S256x256) => Some(DallE2ImageSize::S256x256),
|
||||||
async_openai::types::ImageSize::S512x512 => Some(DallE2ImageSize::S512x512),
|
Some(async_openai::types::ImageSize::S512x512) => Some(DallE2ImageSize::S512x512),
|
||||||
async_openai::types::ImageSize::S1024x1024 => Some(DallE2ImageSize::S1024x1024),
|
Some(async_openai::types::ImageSize::S1024x1024) => Some(DallE2ImageSize::S1024x1024),
|
||||||
_ => None,
|
_ => None,
|
||||||
};
|
};
|
||||||
|
|
||||||
|
|||||||
@@ -224,9 +224,11 @@ impl TryInto<OpenAIImageGenerationConfig> for ImageGenerationConfig {
|
|||||||
|
|
||||||
fn try_into(self) -> Result<OpenAIImageGenerationConfig, Self::Error> {
|
fn try_into(self) -> Result<OpenAIImageGenerationConfig, Self::Error> {
|
||||||
let size = if let Some(size) = &self.size {
|
let size = if let Some(size) = &self.size {
|
||||||
convert_string_to_enum::<async_openai::types::ImageSize>(size)?
|
Some(convert_string_to_enum::<async_openai::types::ImageSize>(
|
||||||
|
size,
|
||||||
|
)?)
|
||||||
} else {
|
} else {
|
||||||
async_openai::types::ImageSize::S1024x1024
|
None
|
||||||
};
|
};
|
||||||
|
|
||||||
let style = if let Some(style) = &self.style {
|
let style = if let Some(style) = &self.style {
|
||||||
|
|||||||
@@ -3,5 +3,5 @@ pub fn heading() -> &'static str {
|
|||||||
}
|
}
|
||||||
|
|
||||||
pub fn intro() -> &'static str {
|
pub fn intro() -> &'static str {
|
||||||
"The bot can perform various tasks, such as 💬 Text Generation, 🗣️ Text-to-Speech, 🦻 Speech-to-Text, 🖌️ Image Creation, and more."
|
"The bot can perform various tasks, such as 💬 Text Generation, 🗣️ Text-to-Speech, 🦻 Speech-to-Text, 🖌️ Image Generation, and more."
|
||||||
}
|
}
|
||||||
|
|||||||
@@ -34,20 +34,31 @@ By default, the bot will also perform 💬 Text Generation on the text. This is
|
|||||||
If all your messages are in the same language, you can improve accuracy & latency by configuring the language via the **🦻 Speech-to-Text / 🔤 Language** setting.
|
If all your messages are in the same language, you can improve accuracy & latency by configuring the language via the **🦻 Speech-to-Text / 🔤 Language** setting.
|
||||||
|
|
||||||
|
|
||||||
### 🖌️ Image Creation
|
### Image Generation
|
||||||
|
|
||||||
#### Creating images
|
#### 🖌️ Creating images
|
||||||
|
|
||||||
Simply send a command like `%command_prefix% image create A beautiful sunset over the ocean` and the bot will start a threaded conversation and post an image based on your prompt.
|
Simply send a command like `%command_prefix% image create A beautiful sunset over the ocean` and the bot will start a threaded conversation and post an image based on your prompt.
|
||||||
|
|
||||||
You can then, respond in the same message thread with:
|
You can then respond in the same message thread with:
|
||||||
|
|
||||||
- more messages, to add more criteria to your prompt.
|
- more messages, to add more criteria to your prompt.
|
||||||
- a message saying `again`, to generate one more image with the current prompt.
|
- a message saying `again`, to generate one more image with the current prompt.
|
||||||
|
|
||||||
#### Creating stickers
|
#### 🎨 Editing images
|
||||||
|
|
||||||
A variation of **creating images** is to create "sticker images".
|
Simply send a command like `%command_prefix% image edit Turn the following image into an anime-style drawing` and the bot will start a threaded conversation asking for more details.
|
||||||
|
|
||||||
|
You can then respond in the same message thread with:
|
||||||
|
|
||||||
|
- more messages, to add more criteria to your prompt.
|
||||||
|
- one or more images, to provide the images that the bot will operate on.
|
||||||
|
- a message saying `go`, to start the image generation process.
|
||||||
|
- a message saying `again`, to prompt the bot to generate one more image edit with the current prompt.
|
||||||
|
|
||||||
|
#### 🫵 Creating stickers
|
||||||
|
|
||||||
|
A variation of **creating images** is creating "sticker images".
|
||||||
|
|
||||||
To create a sticker, send a command like `%command_prefix% sticker A huge bowl of steaming ramen with a mountain of beansprouts on top`.
|
To create a sticker, send a command like `%command_prefix% sticker A huge bowl of steaming ramen with a mountain of beansprouts on top`.
|
||||||
|
|
||||||
|
|||||||
Reference in New Issue
Block a user