-
Notifications
You must be signed in to change notification settings - Fork 0
Issues
is:issue state:open
is:issue state:open
Issue creation is restricted in this repository
Search results
Add support for actively maintained sentence tokenizers (spaCy, Stanza, wtpsplit)
enhancementNew feature or requestNew feature or requestStatus: Open.#15 In 429er/afterthoughts;Add EntityEncoder for entity-aware late chunking
enhancementNew feature or requestNew feature or requestStatus: Open.#14 In 429er/afterthoughts;Replace BlingFire as default sentence tokenizer due to lack of maintenance
enhancementNew feature or requestNew feature or requestStatus: Open.#13 In 429er/afterthoughts;Set up ReadTheDocs documentation site
documentationImprovements or additions to documentationImprovements or additions to documentationStatus: Open.#12 In 429er/afterthoughts;Add get_chunks() method for dry-run chunk preview without encoding
enhancementNew feature or requestNew feature or requestStatus: Open.#10 In 429er/afterthoughts;Add structure-aware sentence tokenizers (markdown, Python code, HTML)
enhancementNew feature or requestNew feature or requestStatus: Open.#9 In 429er/afterthoughts;