Eleutherai
EleutherAI: Llemma 7b
Llemma 7B is a language model for mathematics. It was initialized with Code Llama 7B weights, and trained on the Proof-Pile-2 for 200B tokens. Llemma models are particularly strong at chain-of-thought mathematical reasoning and using computational tools for mathematics, such as Python and formal theorem provers.
| Specifications | |
|---|---|
| Provider | Eleutherai |
| Input pricing | $0.80/M tokens |
| Output pricing | $1.20/M tokens |
| Context length | 4K tokens |
| Max output | 4K tokens |
| Input modalities | text |
| Output modalities | text |
| Tokenizer | Other |
| Knowledge cutoff | 2023-04-30 |
| Content moderated | No |
| HuggingFace | EleutherAI/llemma_7b |
Supported Parameters
frequency_penaltymax_tokensmin_ppresence_penaltyrepetition_penaltyseedstoptemperaturetop_ktop_p