Update ONNX Gen AI jextract example#304
Conversation
Signed-off-by: Ana-Maria Mihalceanu <[email protected]>
|
👋 Welcome back amihalceanu! A progress list of the required criteria for merging this PR into |
|
@ammbra This change now passes all automated pre-integration checks. After integration, the commit message for the final commit will be: You can use pull request commands such as /summary, /contributor and /issue to adjust it as needed. At the time when this comment was updated there had been no new commits pushed to the As you do not have Committer status in this project an existing Committer must agree to sponsor your change. ➡️ To flag this PR as ready for integration with the above commit message, type |
1. Status Quo
The current ONNX Gen AI example requires end users to manually build the native library. A lot of files are needed only to build the native runtime, but not serving a need later on.
2. Problem
The native build instructions are subject to change when comes to prerequisites and the build from latest sources can also come with unresolved issues on the native side.
3. Fix
This pull request introduces a few changes in the prerequisites:
onnxruntimeandonnxruntime-genai(theonnxruntime-genaiis a wrapper over the nativeonnxruntime). Release archives have the structure:The user should manually move the
libonnxruntime<release>.dylibin theonnxruntime-genailib folder.onnxruntime-genairelease using thepromptmethod code and add a way to exit the from LLM conversation incallmethod.I run tests through Github actions enabled in my fork.
Progress
Reviewing
Using
gitCheckout this PR locally:
$ git fetch https://git.openjdk.org/jextract.git pull/304/head:pull/304$ git checkout pull/304Update a local copy of the PR:
$ git checkout pull/304$ git pull https://git.openjdk.org/jextract.git pull/304/headUsing Skara CLI tools
Checkout this PR locally:
$ git pr checkout 304View PR using the GUI difftool:
$ git pr show -t 304Using diff file
Download this PR as a diff file:
https://git.openjdk.org/jextract/pull/304.diff
Using Webrev
Link to Webrev Comment