Modelspage

Llama-3.1-8B-Instruct

Compact open Llama model for lightweight chat, drafting, and self-hosting

meta/llama-3.1-8b-instruct
Lab
Meta
Family
llama
Providers
21
Context
128,000
Output limit
4,096
Knowledge
2023-12
Release
2024-07-23
Updated
2024-07-23
Weights
Open
Input
Output types
Capabilities
tools, temperature

Providers

21
Providers
AbacusMetameta-llama/Meta-Llama-3.1-8B-Instruct128,0004,096$0.02 / $0.05NoYes-Yes
Amazon BedrockMetameta.llama3-1-8b-instruct-v1:0128,0004,096$0.22 / $0.22NoYesNoYes
Amazon BedrockMetaus.meta.llama3-1-8b-instruct-v1:0128,0004,096$0.22 / $0.22NoYesNoYes
Atomic ChatMetaMeta-Llama-3_1-8B-Instruct-GGUF131,0724,096$0.00 / $0.00NoYes-Yes
Cloudflare Workers AIMeta@cf/meta/llama-3.1-8b-instruct-fp832,00032,000$0.152 / $0.287NoNoNoYes
CoreWeaveMetameta-llama/Llama-3.1-8B-Instruct131,072131,072$0.22 / $0.22NoYesYesYes
Eden AIMetaarkanecloud/meta-llama/Llama-3.1-8B-Instruct131,0724,096$0.15 / $0.15NoYesNoYes
GroqMetallama-3.1-8b-instant131,072131,072$0.05 / $0.08NoYes-Yes
HeliconeMetallama-3.1-8b-instant131,07232,678$0.05 / $0.08NoYes-Yes
HeliconeMetallama-3.1-8b-instruct16,38416,384$0.02 / $0.05NoYes-Yes
HeliconeMetallama-3.1-8b-instruct-turbo128,000128,000$0.02 / $0.03NoYes-Yes
Hugging FaceMetameta-llama/Llama-3.1-8B-Instruct131,0724,096$0.06 / $0.06NoYesYesYes
InferenceMetameta/llama-3.1-8b-instruct16,0004,096$0.025 / $0.025NoYes-Yes
Kilo GatewayMetameta-llama/llama-3.1-8b-instruct131,072117,964$0.02 / $0.04NoYesYesYes
Merge GatewayMetameta/llama-3.1-8b-instruct128,0002,048$0.22 / $0.22NoYesNoYes
NanoGPTMetameta-llama/llama-3.1-8b-instruct131,07216,384$0.02 / $0.04NoYesNoYes
NeonMetameta-llama-3-1-8b-instruct131,0728,192$0.15 / $0.45NoYesYesYes
Novita AIMetameta-llama/llama-3.1-8b-instruct16,38416,384$0.02 / $0.05NoNoYesYes
OpenRouterMetameta-llama/llama-3.1-8b-instruct131,072117,964$0.05 / $0.08NoYesYesYes
PoeMetacerebras/llama-3.1-8b-cs128,0000$0.10 / $0.10NoYes-No
Vercel AI GatewayMetameta/llama-3.1-8b128,0008,192$0.22 / $0.22NoYes-Yes
No rows match the current search.

No rows match the current search.

Menu

Esc

Search

No matching results.

How to use

Modelspage lets you browse models, compare providers, and explore rankings. Open a model for its specifications and provider prices.

API

You can access provider data, provider-agnostic model metadata, or the combined catalog through JSON endpoints. Specialized model types are omitted by default; the site includes all model types.

Logos

Provider logos are available at /logos/{provider}.svg where {provider} is the provider ID. Lab logos are available at /logos/labs/{lab}.svg.

Upstream SDK

The models.dev SDK provides typed catalog queries and upstream snapshots for offline use.

Contribute

The model catalog is stored in GitHub as TOML files organized by provider and canonical model.