Skip to content

feat: implement document ai functions#1058

Open
Ludwig-LMY wants to merge 1 commit into
oceanbase:vldb_2026from
Ludwig-LMY:document-ai-functions-vldb
Open

feat: implement document ai functions#1058
Ludwig-LMY wants to merge 1 commit into
oceanbase:vldb_2026from
Ludwig-LMY:document-ai-functions-vldb

Conversation

@Ludwig-LMY

Copy link
Copy Markdown

Summary

Implement Document AI functions for the CCF/OceanBase training task.

  • Add LOAD_FILE(location_name, file_name) to read local files from file:// LOCATION objects and return BLOB data.
  • Add AI_SPLIT_DOCUMENT(content, parameters) as a table function.
  • Support text/markdown document splitting by word or sentence with max and overlap parameters.
  • Expose AI_SPLIT_DOCUMENT output columns:
    • chunk_id
    • chunk_offset
    • chunk_length
    • chunk_text

Tests

  • Not run locally. This Windows environment does not have a full seekdb build/mysqltest runtime.
  • Target mysqltest cases:
    • tools/deploy/mysql_test/test_suite/ai_funcs/t/load_file.test
    • tools/deploy/mysql_test/test_suite/ai_funcs/t/ai_split_document.test

@CLAassistant

CLAassistant commented Jul 14, 2026

Copy link
Copy Markdown

CLA assistant check
All committers have signed the CLA.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants