Skip to content

Conversation

@xbotter
Copy link

@xbotter xbotter commented Aug 17, 2023

🔀 Add Unicode chunking for handling limited text

  • Added a new method ChunkStringByUnicode in MessageHandlerHelper to split text into chunks based on Unicode characters.
  • Added a new method TryHandleLimitedText in MessageHandlerHelper to handle long text by splitting it into chunks and processing each chunk separately.
  • Added unit tests for the new methods in MessageHandlerHelperTests.

The changes enable handling of long text content by splitting it into smaller chunks based on Unicode characters. This allows for more efficient processing and handling of text content within the specified byte limit.

      - Added a new method `ChunkStringByUnicode` in `MessageHandlerHelper` to split text into chunks based on Unicode characters.
      - Added a new method `TryHandleLimitedText` in `MessageHandlerHelper` to handle long text by splitting it into chunks and processing each chunk separately.
      - Added unit tests for the new methods in `MessageHandlerHelperTests`.

      The changes enable handling of long text content by splitting it into smaller chunks based on Unicode characters. This allows for more efficient processing and handling of text content within the specified byte limit.
@xbotter
Copy link
Author

xbotter commented Aug 30, 2023

@JeffreySu Please review it and let me know if there is anything that needs to be changed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant