Petals
Collaborative tool for running large language models by distributing model parts.
Petals Introduction
What is Petals?
An open source tool for running large language models like BLOOM-176B collaboratively. Users load a small part of the model and team up with others serving the other parts to run inference or fine-tuning.
How to use Petals?
Load a small part of the large language model on your machine, then connect with others who are serving other parts of the model. Together, you can run inference or fine-tuning.
Why Choose Petals?
You should choose this if collaboration is key for you. It’s made to help teams work together seamlessly with AI support, making group projects less chaotic.
Petals Features
AI Developer Tools
- ✓Collaborative running of large language models
- ✓Distributed model loading
- ✓Support for inference and fine-tuning
FAQ?
Pricing
Pricing information not available







