Mistral 7B
Ready
accounts/fireworks/models/mistral-7b
LLM
The Mistral-7B-v0.1 Large Language Model (LLM) is a pretrained generative text model with 7 billion parameters utilizing Grouped-query attention (GQA) for faster inference and Sliding window attention (SWA) to handle longer sequences at a lower cost.
Details
StateReady
Created onOct 6, 2023
KindBase model
ProviderMistral AI
Features
CalibratedNo
Mixture-of-ExpertsNo
Parameters7B
TrainingNot supported
ServerlessNot supported
Context Length32k tokens
Function CallingNot supported
EmbeddingsNot supported
RerankersNot supported
Image InputNot supported
Usage guide
Deploy Mistral 7B in just a few commands.
- No rate limits
- Lower cost-of-ownership for high-traffic
- Large selection of models and custom base models
Dedicated deployments on Fireworks
On-demand deployments ensure you get dedicated GPUs for optimal performance, no rate limits, and fast autoscaling. Fireworks makes it easy to get started in just minutes.
Dedicated deployments are great for high utilization use cases – unlocking both cost-effective scale and better performance.
- Get started in minutes with our Deployment Quickstart guide
- Learn how to customize your autoscaling configuration
- Check out our advanced features (e.g. speculative decoding, quantizations, performance benchmarking, and more)