Add multi-backend free AI code generator with web UI and chat mode#1
Draft
gabehak wants to merge 1 commit into
Draft
Add multi-backend free AI code generator with web UI and chat mode#1gabehak wants to merge 1 commit into
gabehak wants to merge 1 commit into
Conversation
- HuggingFace Inference API as default backend (no download, free tier) - Ollama backend for fully local, offline inference - Local model backend retained for GPU-accelerated inference - Interactive chat mode with conversation history and language switching - Gradio web UI (app.py) with model/backend/language selectors - Rich terminal output with syntax highlighting and spinners - requirements.txt trimmed to only mandatory deps (torch/transformers optional) - setup.py extras_require for [local] and [web] installs - .env.example for HF_TOKEN configuration https://claude.ai/code/session_01Pj4aHSU99U1BYpkq31KNEF
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
ollama serve+ollama pull codellama)codex-cli chat) with conversation history, language switching, and iterative refinementpython app.py) with dropdowns for model, backend, and languagerequirements.txtslimmed to justrequests,click,rich,python-dotenv— torch/transformers now optional extrasTest plan
pip install -r requirements.txtinstalls without errorspython codex_cli.py generate -p "fibonacci in python"returns code via HF APIpython codex_cli.py chatenters interactive mode,exitquits cleanlypython codex_cli.py modelslists all model keyspython codex_cli.py generate -p "hello world" -o out.pywrites filepython app.pylaunches Gradio UI at localhost:7860HF_TOKEN=xxx python codex_cli.py generate -p "test"uses tokenhttps://claude.ai/code/session_01Pj4aHSU99U1BYpkq31KNEF
Generated by Claude Code