Skip to content

[improvement] Make ConversationSummarizationTransform be able to be configured to trigger based on token counts #137

Description

@dhilloulinoracle

ConversationSummarizationTransform is currently triggered when there is a certain number of messages in the conversation, but in practice developers might be more concerned about the context size in terms of tokens.
It would therefore be useful to have the transform be configured in terms of tokens (or characters).

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions