Refactor Message Struct: Remove MultiContent, Add UserInput and AssistantOutput for Multi-modal Support #471
zhuangjie1125
announced in
Announcements
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
📌 Summary
To support multi-modal input and output for the model, Eino plans to make the following changes to the Message struct:
Changes
✅ New Features
UserInputMultiContent []ChatMessageInputPart: This field captures the multi-modal input provided by the user.AssistantGenMultiContent []ChatMessageOutputPart: This field captures the multi-modal output generated by the assistant.⛔ Deprecated (will be removed in future releases)
MultiContent []ChatMessagePart: This field has been removed as it is no longer maintained.ChatMessageImageURL,ChatMessageAudioURL,ChatMessageVideoURL,ChatMessageFileURL: These types have also been removed to simplify the structure and focus on multi-modal handling.Beta Was this translation helpful? Give feedback.
All reactions