Meta Llama 3.1 8B Instruct API pricing

What Meta Llama 3.1 8B Instruct costs in practice

Meta Llama 3.1 8B Instruct from Hyperbolic is billed at $0.12 per million input tokens and $0.3 per million output tokens. No separate prompt-cache rate is published for it, so every input token is billed at the full rate. It ranks #273 of 1557 priced chat listings by input price, which makes it 5.00× cheaper than the median priced model here ($0.6).

Three concrete workloads on this model's rates: a 20,000 requests/day support bot sending 2,500 tokens in and 400 out costs about $252 a month; summarising 5,000 documents a day at 12,000 tokens in and a 600-token summary costs about $243; and 1,000 agent sessions a day at 30,000 input and 5,000 output tokens costs about $153.

How Hyperbolic bills: Hyperbolic prices per million tokens for open-weight models on its decentralised GPU pool. The rate above is the one this index normalises to (USD per million tokens); the authoritative figure is always the provider's own pricing page, linked below.

The figure above excludes batch and committed-use discounts, regional rates, free tiers and enterprise agreements — providers publish those separately, and they can move the real bill by tens of percent. Context is listed as 33K tokens with at most 33K tokens of output per call; some providers bill requests above a long-context threshold at a higher tier, which this page does not model. Token counting also differs between providers' tokenizers, so two providers quoting the same rate can bill a different total for the same text.

Use Meta Llama 3.1 8B Instruct when you need tool calling and the monthly figure above fits the budget. If it does not, Gemini Exp 1114 (Google Gemini) is the nearest cheaper option at free per million input tokens — keep the capability flags in mind before swapping, since a cheaper model that lacks one of the features above will cost more once you work around it.