[Survey] Towards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization

ClearML - Model-Serving Orchestration and Repository Solution

SecretFlow-Serving is a serving system for privacy-preserving machine learning models.

MoDM is a cache-aware, hybrid serving system that accelerates image generation by dynamically combining small and large diffusion models for efficient, high-quality output.

An async ML service built with FastAPI, Celery, RabbitMQ, and Redis for efficient, scalable ML model serving

Implementation of an ML Model Serving with Flask, the model is LGBM trained on Kaggle titanic data.

Machine Learning (MLeap) Model Serving application for Scala

Dhruva is a full-fledged DPG platform for serving AI models at scale.

Predviđanje rezultata telemarketinga

Simple web application developed with streamlit for serving Machine Learning Model