KServe

Kubernetes serverless inference platform for deploying ML models.

Open SourceSelf HostedOffline Capable
0.0 (0)

About

KServe, formerly KFServing, provides a Kubernetes custom resource for serverless inference of predictive and generative AI models across many frameworks such as TensorFlow, PyTorch, and ONNX. It standardizes deployment with autoscaling including scale-to-zero, canary rollouts, and multi-framework serving, and is a CNCF incubating project used by many organizations. Released under the Apache 2.0 license.

Reviews (0)

Leave a Review

No reviews yet. Be the first to review!

Details

Price
Free
Platform
Local/Desktop
Difficulty
Advanced (4/5)
License
Apache-2.0
Added
Apr 3, 2026

Related Tools

Production model serving system for TensorFlow models.

Open SourceSelf HostedOffline
Intermediate
0.0 (0)
Featured

Framework for building production-ready AI application services.

Open SourceSelf HostedOffline
Easy
0.0 (0)

Container tool by Replicate for packaging ML models as standard Docker images.

Open SourceSelf HostedOffline
Easy
0.0 (0)

Framework by Baseten for packaging and serving ML models.

Open SourceSelf HostedOffline
Easy
0.0 (0)

Modern high-performance Python web framework for building APIs.

Open SourceSelf HostedOffline
Easy
0.0 (0)

Local AI API platform that runs LLMs on your hardware with OpenAI-compatible API.

Open SourceSelf HostedOffline
Easy
0.0 (0)
Browse all AI Deployment & MLOps tools