Back to products
i

PRODUCT DETAILS

infai

Run local AI with profiles, not flags

Launch date · UTC
2026-11-13
Domain
—
Domain ending
—
Category
Artificial intelligence

About this product

Its an open-source terminal control plane for local AI inference. Find or import models, save reusable launch profiles for llama.cpp and vLLM, check hardware fit, and run multiple models with live logs, ports, tokens-per-second, CPU, RAM, and VRAM telemetry. One Go binary, one SQLite file, no cloud or telemetry.

Keywords

clilocal inferenceOpen Source