Meta: Llama 3.2 3B Instruct
- by meta-llama
- meta-llama/llama-3.2-3b-instruct
Llama 3.2 3B is a 3-billion-parameter multilingual large language model, optimized for advanced natural language processing tasks like dialogue generation, reasoning, and summarization. Designed with the latest transformer architecture, it...
What the numbers mean
- Context window131,072 tokens
- How much the model can read in one request, counting your prompt, any files and the conversation so far. That is about 98,000 words, or 197 pages.
- Max output72,000 tokens
- The longest single reply it can write: about 54,000 words.
- Input price$0.051 per million tokens
- What you pay for everything the model reads. A 1,000-word prompt costs less than a cent.
- Output price$0.34 per million tokens
- What you pay for everything the model writes. Output usually costs more than input. A 500-word answer costs less than a cent.
- Modalitiestext in, text out
- The kinds of content it accepts and the kinds it produces. A model that takes images in can read a screenshot; one that only puts text out cannot draw.
- Knowledge cutoff2023-12-31
- The last date its training data covers. It does not know about anything after that unless you put it in the prompt.
Supported parameters
The settings you can pass with a request. A model that lists tools can call functions; one that lists structured_outputs can be held to a JSON schema.
frequency_penaltylogit_biaslogprobsmax_tokens