Forge CLI

Forge CLI is an AI-powered tool that automatically optimizes GPU kernels. It uses swarm AI agents to generate optimized CUDA or Triton code that outperforms PyTorch and torch.compile().

Quick Start

Install

# npm
npm install -g @rightnow/forge-cli

# macOS / Linux
curl -fsSL https://releases.rightnowai.co/forge/install.sh | bash

# Windows PowerShell
irm https://releases.rightnowai.co/forge/install.ps1 | iex

Sign In

forge login

Optimize

forge

Launches the interactive wizard to optimize HuggingFace models, KernelBench tasks, or custom PyTorch files.

Typical results: 1.5x - 5x speedup over baseline PyTorch.

Input Types

HuggingFace Models

forge optimize --huggingface meta-llama/Llama-3-8B

KernelBench

forge browse

Custom PyTorch

forge optimize --file model.py

Output Formats & Modes

Formats

Triton Python GPU kernels, easy integration
CUDA Native C++, maximum performance

Modes

--turbo Fast (~2 min)
(default) Balanced
--quality Maximum optimization

Key Commands

Command Description
forge Interactive wizard
forge login Sign in
forge credits Check balance
forge browse Browse KernelBench tasks
forge optimize Start optimization
forge session list View past sessions
forge health Check backend status

System Requirements

OS Windows 10+, macOS 10.15+, Linux (glibc 2.17+)
Arch x64 or ARM64
Node.js 18+ (only for npm install)

Verify & Update

Verify

forge --version
forge health

Update

npm update -g @rightnow/forge-cli

Or re-run the curl/PowerShell installer.

Troubleshooting

"command not found"

Add to PATH:

echo 'export PATH="$PATH:$HOME/.forge/bin"' >> ~/.bashrc && source ~/.bashrc

Windows: Restart terminal or add %USERPROFILE%\.forge\bin to PATH.

macOS Gatekeeper

xattr -d com.apple.quarantine ~/.forge/bin/forge

Permission denied

chmod +x ~/.forge/bin/forge

Credits

KernelBench / Custom code 1 credit
HuggingFace (single layer) 1 credit
HuggingFace (multi-layer) 2 credits

Next Steps

[**Commands Reference**
Complete command documentation.](/content/docs/forge/commands/index.html) [**Optimization Guide**
Tips for best results.](/content/docs/forge/optimization/index.html)