Skip to content

basetenlabs/baseten-cli

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

31 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Baseten CLI

CI Release License

CLI for Baseten.

CLI Reference Docs

⚠️ Commands and flags may change between releases until this CLI reaches 1.0.

Installation

Homebrew (macOS and Linux)

# Add and trust the tap
brew tap basetenlabs/baseten
brew trust basetenlabs/baseten

# Install the CLI
brew install baseten

Prebuilt binaries

Download the latest release for Windows, macOS, or Linux, extract the archive, and place the baseten executable on your PATH.

Windows, macOS, and Linux one-liners

Windows (x64)

PowerShell:

Invoke-WebRequest `
  https://github.com/basetenlabs/baseten-cli/releases/download/v0.2.0/baseten_0.2.0_windows_amd64.zip `
  -OutFile baseten.zip; Expand-Archive -Force baseten.zip .

Then move baseten.exe to a directory on your PATH.

macOS (arm64)

curl -sL https://github.com/basetenlabs/baseten-cli/releases/download/v0.2.0/baseten_0.2.0_darwin_arm64.tar.gz \
  | sudo tar xz -C /usr/local/bin baseten

Linux (x64)

curl -sL https://github.com/basetenlabs/baseten-cli/releases/download/v0.2.0/baseten_0.2.0_linux_amd64.tar.gz \
  | sudo tar xz -C /usr/local/bin baseten

Usage

Authenticate via baseten auth login, or set BASETEN_API_KEY in the environment.

Run baseten --help (or baseten <command> --help) for the full command tree.

Deploying Models

From inside a model directory containing a config.yaml:

baseten model push

The directory defaults to the current working directory and is configurable via --dir. Useful flags:

  • --tail streams build and runtime logs to stderr after the push completes.
  • --wait blocks until the deployment reaches an active status and exits non-zero on terminal failure.

Calling a Model

baseten model predict --model-id <model-id> --data '{"prompt":"hello"}'

--model-name is also accepted. Pass --file <path> (or --file - for stdin) to send a request body from a file.

Viewing Logs

baseten model deployment logs --model-id <model-id> --deployment-id <deployment-id> --tail

Omit --tail and pass --since 1h (or --start/--end) to fetch a historical window.

Run baseten --help for more, and see docs.baseten.co for general Baseten platform documentation.

Building

To build from source, clone this repository and run:

go build ./cmd/baseten

See CONTRIBUTING.md for contribution guidelines.

Packages

 
 
 

Contributors