Hindsight Models and Inference API

About this product

Hosted models for the steps around your LLM: reranking, embeddings and typed decisions. Point your Cohere or OpenAI client at inference.hindsight.vectorize.io and keep your code. hs-rerank-1 and hs-embed-1 are the most accurate small open models on our benchmarks and run fast on a CPU; hs-decide-1-flash answers yes/no, pick-one and how-likely questions in 167 ms, instead of an LLM call. From $0.005 per 1M tokens, $5 free credit, open weights on Hugging Face.

Keywords