Skip to content

Chunking overview: remove usage note about not setting combine text >= new after n characters #662

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

Paul-Cornell
Copy link
Collaborator

After spending several hours testing the previously-published usage note's admonitions with a variety of different chunking settings and document types, there seemed to be no impact on the results. If this surfaces as a significant issue with customers, the removed content can of course be added back in later with additional explanation as necessary.

Also, added slightly more commentary to explain some of the remaining conceptual diagrams.

@Paul-Cornell Paul-Cornell requested a review from vannestn June 17, 2025 17:03
@Paul-Cornell Paul-Cornell changed the title Chunking overview: remove usage note about note setting combine text >= new after n characters Chunking overview: remove usage about note setting combine text >= new after n characters Jun 17, 2025
@Paul-Cornell Paul-Cornell changed the title Chunking overview: remove usage about note setting combine text >= new after n characters Chunking overview: remove usage note about not setting combine text >= new after n characters Jun 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant