The Scrypted LLM plugin allows connecting to various LLM providers, or running your own locally.
The LLM plugin requirements:
- Docker/Proxmox: Must be using either the
intelornvidiadocker tags. - Mac: Works out of the box
- Windows: Intel requires installing the OneAPI toolkit.