Meta: Llama 3.1 70B Instruct
- by meta-llama
- meta-llama/llama-3.1-70b-instruct
Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...
What the numbers mean
- Context window131,072 tokens
- How much the model can read in one request, counting your prompt, any files and the conversation so far. That is about 98,000 words, or 197 pages.
- Max output8,192 tokens
- The longest single reply it can write: about 6,100 words.
- Input price$0.72 per million tokens
- What you pay for everything the model reads. A 1,000-word prompt costs less than a cent.
- Output price$0.72 per million tokens
- What you pay for everything the model writes. Output usually costs more than input. A 500-word answer costs less than a cent.
- Modalitiestext in, text out
- The kinds of content it accepts and the kinds it produces. A model that takes images in can read a screenshot; one that only puts text out cannot draw.
- Knowledge cutoff2023-12-31
- The last date its training data covers. It does not know about anything after that unless you put it in the prompt.
Supported parameters
The settings you can pass with a request. A model that lists tools can call functions; one that lists structured_outputs can be held to a JSON schema.
max_tokensstoptemperaturetool_choicetools