TorchServe
PyTorch model serving framework for production deployment.
About
TorchServe is a model-serving framework for PyTorch jointly developed with AWS, providing model archiving, REST and gRPC endpoints, request batching, logging, metrics, and custom handlers for multi-model serving. Recent versions enforce token authorization by default for security. The project is no longer actively maintained, so users should note that updates and security patches are not planned. Released under the Apache 2.0 license.
Reviews (0)
Leave a Review
No reviews yet. Be the first to review!
Details
- Category
- AI Deployment & MLOps
- Price
- Free
- Platform
- Local/Desktop
- Difficulty
- Intermediate (3/5)
- License
- Apache-2.0
- Added
- Apr 3, 2026
Related Tools
Production model serving system for TensorFlow models.
Framework for building production-ready AI application services.
Container tool by Replicate for packaging ML models as standard Docker images.
Framework by Baseten for packaging and serving ML models.
Modern high-performance Python web framework for building APIs.
Local AI API platform that runs LLMs on your hardware with OpenAI-compatible API.