mistralai/mistral-inference
mistral-inference
Official inference library for Mistral models
37/100Infra
Stars10,806
Forks1,047
LanguageJupyter Notebook
LicenseApache-2.0
Overview
Official inference library for Mistral models
Best for
- Evaluating mistral-inference for Jupyter Notebook AI workflows.
- Comparing a GitHub project with 10,806 stars and current repository activity.
Pros
- mistral-inference has visible GitHub traction with 10,806 stars. Topics: llm, llm-inference, mistralai.
- The project provides an external homepage for deeper evaluation.
Cons
- Production fit still depends on documentation depth, issue activity, and release cadence.
- License review should confirm the Apache-2.0 terms fit your use case.
Production readiness
mistral-inference should be validated with its README, release history, open issues, and integration requirements before production use.
License risk
Apache-2.0 is reported by GitHub; review the repository license before redistribution or commercial use.
Install
pip install mistral-inferencewget https://models.mistralcdn.com/mistral-nemo-2407/mistral-nemo-instruct-2407.tarwget https://models.mistralcdn.com/mixtral-8x7b-v0-1/Mixtral-8x7B-v0.1-Instruct.tarpip install packaging mamba-ssm causal-conv1d transformerspip install --upgrade mistral-common