Llama 3.1 8b API pricing

What Llama 3.1 8b costs in practice

Llama 3.1 8b from Cerebras is billed at $0.1 per million input tokens and $0.1 per million output tokens. No separate prompt-cache rate is published for it, so every input token is billed at the full rate. It ranks #201 of 1557 priced chat listings by input price, which makes it 6.00× cheaper than the median priced model here ($0.6).

Three concrete workloads on this model's rates: a 20,000 requests/day support bot sending 2,500 tokens in and 400 out costs about $174 a month; summarising 5,000 documents a day at 12,000 tokens in and a 600-token summary costs about $189; and 1,000 agent sessions a day at 30,000 input and 5,000 output tokens costs about $105.

How Cerebras bills: Cerebras bills per million tokens for models it runs on wafer-scale hardware, with fewer models available than general-purpose platforms. The rate above is the one this index normalises to (USD per million tokens); the authoritative figure is always the provider's own pricing page, linked below.

The figure above excludes batch and committed-use discounts, regional rates, free tiers and enterprise agreements — providers publish those separately, and they can move the real bill by tens of percent. Context is listed as 128K tokens with at most 128K tokens of output per call; some providers bill requests above a long-context threshold at a higher tier, which this page does not model. Token counting also differs between providers' tokenizers, so two providers quoting the same rate can bill a different total for the same text.

Use Llama 3.1 8b when you need tool calling and the monthly figure above fits the budget. If it does not, Gemini Exp 1114 (Google Gemini) is the nearest cheaper option at free per million input tokens — keep the capability flags in mind before swapping, since a cheaper model that lacks one of the features above will cost more once you work around it.