beginner/serving_tutorial

Run in Google Colab

Colab

Download Notebook

Notebook

View on GitHub

GitHub

Serve PyTorch models at scale with Ray Serve

Author: Ricardo Decal

This tutorial shows how to deploy a PyTorch model using Ray Serve with production-ready features.

What you will learn

• How to create a production-ready PyTorch model deployment that can scale to thousands of nodes and GPUs

• How to configure an HTTP endpoint for the deployment using FastAPI

• Enable dynamic request batching for higher throughput

• Configure autoscaling and per-replica CPU/GPU resource allocation

• Load test the service with concurrent requests and monitor it with the Ray dashboard

• How Ray Serve deployments can self-heal from failures

• Ray Serve’s advanced features like model multiplexing and model composition.

Prerequisites

• PyTorch v2.9+ and torchvision

• Ray Serve (ray[serve]) v2.52.1+

• A GPU is recommended for higher throughput but is not required

Ray Serve is a scalable framework for serving machine learning models in production. It’s built on top of Ray, which is a unified framework for scaling AI and Python applications that simplifies the complexities of distributed computing. Ray is also open source and part of the PyTorch Foundation.

Setup

To install the dependencies, run:

pip install "ray[serve]" torch torchvision

Start by importing the required libraries:

import asyncio
import time
from typing import Any

from fastapi import FastAPI
from pydantic import BaseModel
import aiohttp
import numpy as np
import torch
import torch.nn as nn
from ray import serve
from torchvision.transforms import v2

Define a PyTorch model

Define a simple convolutional neural network for the MNIST digit classification dataset:

class MNISTNet(nn.Module):
    def __init__(self):
        super().__init__()
        self.conv1 = nn.Conv2d(1, 32, 3, 1)
        self.dropout1 = nn.Dropout(0.25)
        self.conv2 = nn.Conv2d(32, 64, 3, 1)
        self.fc1 = nn.Linear(9216, 128)
        self.dropout2 = nn.Dropout(0.5)
        self.fc2 = nn.Linear(128, 10)

    def forward(self, x):
        x = self.conv1(x)
        x = nn.functional.relu(x)
        x = self.conv2(x)
        x = nn.functional.relu(x)
        x = nn.functional.max_pool2d(x, 2)
        x = self.dropout1(x)
        x = torch.flatten(x, 1)
        x = self.fc1(x)
        x = nn.functional.relu(x)
        x = self.dropout2(x)
        x = self.fc2(x)
        return nn.functional.log_softmax(x, dim=1)

Define the Ray Serve deployment

To deploy this model with Ray Serve, wrap the model in a Python class and decorate it with @serve.deployment.

Processing requests in batches is more efficient than processing requests one by one, especially when using GPUs. Ray Serve provides built-in support for dynamic request batching, where individual incoming requests are opportunistically batched. Enable dynamic batching using the @serve.batch decorator as shown in the following code:

app = FastAPI()

class ImageRequest(BaseModel):  # Used for request validation and generating API documentation
    image: list[list[float]] | list[list[list[float]]]  # 2D or 3D array

@serve.deployment
@serve.ingress(app)
class MNISTClassifier:
    def __init__(self):
        self.device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
        self.model = MNISTNet().to(self.device)
        # Define the transformation pipeline for the input images.
        self.transform = v2.Compose([
            v2.ToImage(),
            v2.ToDtype(torch.float32, scale=True),
            # Mean and standard deviation of the MNIST training subset.
            v2.Normalize(mean=[0.1307], std=[0.3013]),
        ])

        self.model.eval()

    # batch_wait_timeout_s is the maximum time to wait for a full batch,
    # trading off latency for throughput.
    @serve.batch(max_batch_size=128, batch_wait_timeout_s=0.1)
    async def predict_batch(self, images: list[np.ndarray]) -> list[dict[str, Any]]:
        # Stack all images into a single tensor.
        batch_tensor = torch.cat([
            self.transform(img).unsqueeze(0)
            for img in images
        ]).to(self.device).float()

        # Single forward pass on the entire batch at once.
        with torch.no_grad():
            logits = self.model(batch_tensor)
            predictions = torch.argmax(logits, dim=1).cpu().numpy()

        # Unbatch the results and preserve their original order.
        return [
            {
                "predicted_label": int(pred),
                "logits": logit.cpu().numpy().tolist()
            }
            for pred, logit in zip(predictions, logits)
        ]

    @app.post("/")
    async def handle_request(self, request: ImageRequest):
        """Handle an incoming HTTP request using FastAPI.

        Inputs are automatically validated using the Pydantic model.
        """
        # Process the single request.
        image_array = np.array(request.image)

        # Ray Serve's @serve.batch automatically batches requests.
        result = await self.predict_batch(image_array)

        return result

This is a FastAPI app, which extends Ray Serve with features like automatic request validation with Pydantic, auto-generated OpenAPI-style API documentation, and more.

Configure autoscaling and resource allocation

In production, traffic can vary significantly. Ray Serve’s autoscaling feature automatically adjusts the number of replicas based on traffic load, ensuring you have enough capacity during peaks while saving resources during quiet periods. Ray Serve scales to very large deployments with thousands of nodes and replicas.

You can also specify resource allocation per replica, such as the number of CPUs or GPUs. Ray Serve handles the orchestration of these resources across your cluster. Ray also supports fractional GPUs, allowing multiple replicas to share a single GPU when models are small enough to fit in memory together.

The following is a sample configuration with autoscaling and resource allocation:

num_cpus_per_replica = 1
num_gpus_per_replica = 1  # Set to 0 to run the model on CPUs instead of GPUs.
mnist_app = MNISTClassifier.options(
    autoscaling_config={
        "target_ongoing_requests": 50,  # Target 50 ongoing requests per replica.
        "min_replicas": 1,              # Keep at least 1 replica alive.
        "max_replicas": 80,             # Scale up to 80 replicas to maintain target_ongoing_requests.
        "upscale_delay_s": 5,           # Wait 5s before scaling up.
        "downscale_delay_s": 30,        # Wait 30s before scaling down.
    },
    # Max invocations to handle_request per replica to process simultaneously.
    # Requests exceeding this limit are queued by the router until capacity is available.
    max_ongoing_requests=200,
    # Max queue size for requests that exceed max_ongoing_requests.
    # If the queue is full, future requests are backpressured with errors until space is available.
    # -1 means the queue can grow until cluster memory is exhausted.
    max_queued_requests=-1,
    # Set the resources per replica.
    ray_actor_options={"num_cpus": num_cpus_per_replica, "num_gpus": num_gpus_per_replica}
).bind()

The app is ready to deploy. Suppose you ran this on a cluster of 10 machines, each with 4 GPUs. With num_gpus=0.5, Ray schedules 2 replicas per GPU, giving you 80 replicas across the cluster. This configuration permits the deployment to elastically scale up to 80 replicas as needed to handle traffic spikes and scale back down to 1 replica when traffic subsides.

Test the endpoint with concurrent requests

To deploy the app, use the serve.run function:

# Start the Ray Serve application.
handle = serve.run(mnist_app, name="mnist_classifier")

2026-04-27 13:41:38,656 WARNING services.py:2168 -- WARNING: The object store is using /tmp instead of /dev/shm because /dev/shm has only 2147471360 bytes available. This will harm performance! You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you can increase /dev/shm size by passing '--shm-size=10.24gb' to 'docker run' (or add it to the run_options list in a Ray cluster config). Make sure to set this to more than 30% of available RAM.
2026-04-27 13:41:40,827 INFO worker.py:2004 -- Started a local Ray instance. View the dashboard at 127.0.0.1:8265
/usr/local/lib/python3.10/dist-packages/ray/_private/worker.py:2052: FutureWarning: Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0
  warnings.warn(
(ProxyActor pid=4640) INFO 2026-04-27 13:41:43,175 proxy 172.17.0.2 -- Proxy starting on node ae456b8daa8dbb83f089cb92306f4ecaabfd0a55571710bcd7a51b73 (HTTP port: 8000).
INFO 2026-04-27 13:41:43,245 serve 3836 -- Started Serve in namespace "serve".
(ProxyActor pid=4640) INFO 2026-04-27 13:41:43,242 proxy 172.17.0.2 -- Got updated endpoints: {}.
(ServeController pid=4641) INFO 2026-04-27 13:41:43,308 controller 4641 -- Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
(ServeController pid=4641) INFO 2026-04-27 13:41:43,308 controller 4641 -- Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
(ProxyActor pid=4640) INFO 2026-04-27 13:41:43,312 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
(ProxyActor pid=4640) INFO 2026-04-27 13:41:43,319 proxy 172.17.0.2 -- Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x7f846c507cd0>.
(ServeController pid=4641) INFO 2026-04-27 13:41:43,412 controller 4641 -- Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
(ProxyActor pid=4640) INFO 2026-04-27 13:41:47,240 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=[RoutePattern(methods=['POST'], path='/'), RoutePattern(methods=['GET', 'HEAD'], path='/docs'), RoutePattern(methods=['GET', 'HEAD'], path='/docs/oauth2-redirect'), RoutePattern(methods=['GET', 'HEAD'], path='/openapi.json'), RoutePattern(methods=['GET', 'HEAD'], path='/redoc')])}.
INFO 2026-04-27 13:41:47,365 serve 3836 -- Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

You will see output similar to:

Started Serve in namespace "serve".
Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
Proxy starting on node ... (HTTP port: 8000).
Got updated endpoints: {}.
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x73a53c52c250>.
Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

The app is now listening for requests on port 8000.

To test the deployment, you can send many requests concurrently using aiohttp. The following code demonstrates how to send 1000 concurrent requests to the app:

async def send_single_request(session, url, data):
    async with session.post(url, json=data) as response:
        return await response.json()

async def send_concurrent_requests(num_requests):
    image = np.random.rand(28, 28).tolist()

    print(f"Sending {num_requests} concurrent requests...")
    async with aiohttp.ClientSession() as session:
        tasks = [
            send_single_request(session, url="http://localhost:8000/", data={"image": image})
            for _ in range(num_requests)
        ]
        responses = await asyncio.gather(*tasks)

    return responses

# Run the concurrent requests.
start_time = time.time()
responses = asyncio.run(send_concurrent_requests(1000))
elapsed = time.time() - start_time

print(f"Processed {len(responses)} requests in {elapsed:.2f} seconds")
print(f"Throughput: {len(responses)/elapsed:.2f} requests/second")

Sending 1000 concurrent requests...
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,611 mnist_classifier_MNISTClassifier 4u9dktkb 92939207-241c-4c9d-bd46-6058b20e424d -- POST / 200 517.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,614 mnist_classifier_MNISTClassifier 4u9dktkb 0580febd-3952-4ba3-8a33-dadab028c89d -- POST / 200 512.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,615 mnist_classifier_MNISTClassifier 4u9dktkb 18073bc0-ed29-4d45-89df-1267ccf46bbb -- POST / 200 510.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,616 mnist_classifier_MNISTClassifier 4u9dktkb 506f58d7-0b0e-46a2-a9c7-e416dcf18f00 -- POST / 200 508.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,617 mnist_classifier_MNISTClassifier 4u9dktkb a66c4618-34cd-461b-a641-af945adfd913 -- POST / 200 497.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,617 mnist_classifier_MNISTClassifier 4u9dktkb a5ef7ea6-1f6c-4388-8f89-ecd0bb411abc -- POST / 200 496.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,618 mnist_classifier_MNISTClassifier 4u9dktkb 46d9ee6d-674a-4ec8-958d-7c7537600d94 -- POST / 200 495.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,618 mnist_classifier_MNISTClassifier 4u9dktkb bd4f5226-c8ec-4e6a-9fa5-ee5e3c6b07d6 -- POST / 200 493.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,618 mnist_classifier_MNISTClassifier 4u9dktkb a90f41d4-aa41-4853-a7ec-aadeb7adbb0e -- POST / 200 494.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,620 mnist_classifier_MNISTClassifier 4u9dktkb cb721448-528f-46f6-a17a-ddba73f3338a -- POST / 200 495.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,620 mnist_classifier_MNISTClassifier 4u9dktkb 0c03cc1b-b968-4274-9b5c-a28ad3139ec3 -- POST / 200 494.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,621 mnist_classifier_MNISTClassifier 4u9dktkb 57714d4c-2b61-49cb-876d-c6947887dfd2 -- POST / 200 493.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,622 mnist_classifier_MNISTClassifier 4u9dktkb cc2e62d0-c041-4f96-b802-b27c4d219e53 -- POST / 200 493.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,623 mnist_classifier_MNISTClassifier 4u9dktkb 18e13618-528d-4d27-a6ab-0b707abf7daf -- POST / 200 493.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,681 mnist_classifier_MNISTClassifier 4u9dktkb d8731e36-bc20-4e06-87d0-f77c32b3e781 -- POST / 200 549.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,683 mnist_classifier_MNISTClassifier 4u9dktkb 468d77cb-7345-44cb-b15d-28f7633ace48 -- POST / 200 550.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,684 mnist_classifier_MNISTClassifier 4u9dktkb a4fcc611-f830-4c65-94e9-43d972ea704b -- POST / 200 550.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,684 mnist_classifier_MNISTClassifier 4u9dktkb 8728b1f9-0a4a-4858-9e32-92676c51d0e5 -- POST / 200 549.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,684 mnist_classifier_MNISTClassifier 4u9dktkb 85dc34d8-7c1a-4c83-98a2-a83d340801c4 -- POST / 200 549.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,686 mnist_classifier_MNISTClassifier 4u9dktkb c627b0f2-b195-4ada-bfba-5dac473e5444 -- POST / 200 550.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,687 mnist_classifier_MNISTClassifier 4u9dktkb 09a61686-027a-4355-8890-c6711a04c6f0 -- POST / 200 549.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,687 mnist_classifier_MNISTClassifier 4u9dktkb a35f154d-ea6b-4321-8282-7a0cc6b816e5 -- POST / 200 549.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,811 mnist_classifier_MNISTClassifier 4u9dktkb cdfd2ad9-31b0-4235-a176-c96936b6327f -- POST / 200 672.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,811 mnist_classifier_MNISTClassifier 4u9dktkb ca91c177-7a80-4bd1-9f64-b9957e3d7b2e -- POST / 200 671.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,812 mnist_classifier_MNISTClassifier 4u9dktkb aa993b0a-cafd-4b23-a80c-30ffa38e37f2 -- POST / 200 670.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,812 mnist_classifier_MNISTClassifier 4u9dktkb 4952f2f9-73d7-49a9-a31b-184d5c13dfe1 -- POST / 200 669.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,812 mnist_classifier_MNISTClassifier 4u9dktkb 44f656ce-72af-4db2-a6dd-f666d9ab4406 -- POST / 200 669.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,813 mnist_classifier_MNISTClassifier 4u9dktkb 4630a8f1-5e58-4fe3-a54f-d32f11ab7712 -- POST / 200 669.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,813 mnist_classifier_MNISTClassifier 4u9dktkb b4935c0b-5622-4091-a7d2-ba02b3f56089 -- POST / 200 669.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,814 mnist_classifier_MNISTClassifier 4u9dktkb 021d9230-955d-4f49-b1a0-cc51b76ac849 -- POST / 200 668.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,815 mnist_classifier_MNISTClassifier 4u9dktkb 042de7c3-0c9c-4302-b2be-98d847c9cd0c -- POST / 200 668.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,816 mnist_classifier_MNISTClassifier 4u9dktkb 86132788-1057-442b-9729-f40db1c44d4f -- POST / 200 667.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,816 mnist_classifier_MNISTClassifier 4u9dktkb 2cd3f365-f568-4bfc-a30d-431cf9989b0d -- POST / 200 666.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,817 mnist_classifier_MNISTClassifier 4u9dktkb f679b5bd-1710-4aac-99db-b58ccfcdd42b -- POST / 200 667.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,818 mnist_classifier_MNISTClassifier 4u9dktkb e6410aef-e6a3-4e64-a842-9113804d9518 -- POST / 200 667.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,821 mnist_classifier_MNISTClassifier 4u9dktkb f8f19dd6-c1e5-43b5-bbd8-a0e342f74ca1 -- POST / 200 669.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,822 mnist_classifier_MNISTClassifier 4u9dktkb af198476-ce08-4795-b9a0-9ea0d487272c -- POST / 200 669.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,822 mnist_classifier_MNISTClassifier 4u9dktkb 6df50241-63dd-459f-a81c-25b38d4fc82c -- POST / 200 668.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,822 mnist_classifier_MNISTClassifier 4u9dktkb 2c040ce8-d106-482b-a4af-00eea877af2e -- POST / 200 668.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,823 mnist_classifier_MNISTClassifier 4u9dktkb 2292372c-a952-45f8-950c-68d78419c392 -- POST / 200 664.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,823 mnist_classifier_MNISTClassifier 4u9dktkb 64495737-8f58-4c1f-a4ea-ac979edd2745 -- POST / 200 663.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,823 mnist_classifier_MNISTClassifier 4u9dktkb 373d7168-9cd5-4db8-aefa-d4b0e55d9b46 -- POST / 200 660.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,823 mnist_classifier_MNISTClassifier 4u9dktkb 02844bcb-d45f-4897-9dca-f145bf0c27b9 -- POST / 200 661.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,823 mnist_classifier_MNISTClassifier 4u9dktkb 0860a691-13a0-4be4-a513-453a4dc74a74 -- POST / 200 660.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,824 mnist_classifier_MNISTClassifier 4u9dktkb fb7bbd73-90ba-4d23-99bf-ccf51f76bcb6 -- POST / 200 657.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,824 mnist_classifier_MNISTClassifier 4u9dktkb 1961dfe3-97ad-4c5b-8a4b-9efa190fc94d -- POST / 200 656.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,824 mnist_classifier_MNISTClassifier 4u9dktkb 60c71563-351a-4234-898a-d1bcec8f5d29 -- POST / 200 655.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,824 mnist_classifier_MNISTClassifier 4u9dktkb 0fd89795-4190-474e-bbf7-fe1a769b7319 -- POST / 200 654.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,826 mnist_classifier_MNISTClassifier 4u9dktkb bb4215d6-c298-46cc-8ef9-a3185feedd95 -- POST / 200 530.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,826 mnist_classifier_MNISTClassifier 4u9dktkb d060ff30-e180-4bbc-878c-cdcf0ce3d654 -- POST / 200 531.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,826 mnist_classifier_MNISTClassifier 4u9dktkb 9280eb57-b68c-4d00-b98a-1ba220856683 -- POST / 200 529.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,827 mnist_classifier_MNISTClassifier 4u9dktkb 9986956b-25d9-478d-9a3f-c57b7c4a056e -- POST / 200 529.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,827 mnist_classifier_MNISTClassifier 4u9dktkb 4b07ada2-57aa-4d02-9f55-920a8d4c10b0 -- POST / 200 528.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,828 mnist_classifier_MNISTClassifier 4u9dktkb 5e43bb1d-d78b-474c-97a2-b1c4137b49d6 -- POST / 200 526.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,828 mnist_classifier_MNISTClassifier 4u9dktkb 97b96970-4aa4-4dd9-a109-249c5dd1153d -- POST / 200 526.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,828 mnist_classifier_MNISTClassifier 4u9dktkb b1e71364-a0a0-42a2-8f11-a87429f81272 -- POST / 200 526.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,829 mnist_classifier_MNISTClassifier 4u9dktkb d1482c12-c2f0-4b95-a1da-591821bd30cc -- POST / 200 524.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,829 mnist_classifier_MNISTClassifier 4u9dktkb c28cc0e0-a841-4c78-af16-5aab6c303af9 -- POST / 200 525.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,833 mnist_classifier_MNISTClassifier 4u9dktkb acf025cd-01c1-45a8-b7c7-3df10bcd5392 -- POST / 200 527.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,834 mnist_classifier_MNISTClassifier 4u9dktkb 4ad477bf-53b8-404a-aed4-b514a9d0fc43 -- POST / 200 529.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,834 mnist_classifier_MNISTClassifier 4u9dktkb 6e637970-34ba-4837-bf98-0550d055d6a0 -- POST / 200 527.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,834 mnist_classifier_MNISTClassifier 4u9dktkb 5a1d44e2-389a-4aa3-9818-e21a0ff63991 -- POST / 200 527.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,834 mnist_classifier_MNISTClassifier 4u9dktkb 9aa19544-7911-41c0-a511-1c3950a5cad7 -- POST / 200 525.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,835 mnist_classifier_MNISTClassifier 4u9dktkb 46fba7d5-624d-4323-8107-f0035edda950 -- POST / 200 525.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,835 mnist_classifier_MNISTClassifier 4u9dktkb 4e7dc34b-9c28-4e75-8915-d55a8540d73a -- POST / 200 525.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,836 mnist_classifier_MNISTClassifier 4u9dktkb 0c79519c-9754-4a22-997b-f5b0ae18e001 -- POST / 200 524.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,836 mnist_classifier_MNISTClassifier 4u9dktkb 805556a5-3097-4c52-aceb-89cdfa32de0b -- POST / 200 522.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,836 mnist_classifier_MNISTClassifier 4u9dktkb 2404b8de-9a44-4989-a5a0-6f850b7381cc -- POST / 200 522.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,836 mnist_classifier_MNISTClassifier 4u9dktkb d68e8f0a-f419-4174-a37d-eeb6559260f8 -- POST / 200 522.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,837 mnist_classifier_MNISTClassifier 4u9dktkb e4096168-397d-43d0-9447-d5305060efee -- POST / 200 521.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,837 mnist_classifier_MNISTClassifier 4u9dktkb 0719b874-bc7b-4653-af4f-1fe8b9721470 -- POST / 200 521.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,837 mnist_classifier_MNISTClassifier 4u9dktkb 1f26746f-e3ba-4e8d-b757-b05c13d5bed8 -- POST / 200 521.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,841 mnist_classifier_MNISTClassifier 4u9dktkb a78ff0ea-b966-4f87-929d-8d1715e16388 -- POST / 200 522.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,845 mnist_classifier_MNISTClassifier 4u9dktkb 5de08012-05ca-4533-a212-127202a3ce0f -- POST / 200 522.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,849 mnist_classifier_MNISTClassifier 4u9dktkb b9b3ab53-c7aa-4de9-a664-76a75ac7d3f4 -- POST / 200 525.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,852 mnist_classifier_MNISTClassifier 4u9dktkb 82db1664-9eae-4f13-937c-8fb45e089378 -- POST / 200 527.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,853 mnist_classifier_MNISTClassifier 4u9dktkb 50e468a4-4a1c-44d9-b667-65705138e36e -- POST / 200 528.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,853 mnist_classifier_MNISTClassifier 4u9dktkb 3fdb34d3-18b0-4fb2-b533-37be5ed62c23 -- POST / 200 526.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,854 mnist_classifier_MNISTClassifier 4u9dktkb 0b448caf-9c3d-432d-9269-0d9b19d4b78d -- POST / 200 525.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,858 mnist_classifier_MNISTClassifier 4u9dktkb 8c7a2071-ad0d-479b-8036-cbfe761687c9 -- POST / 200 529.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,858 mnist_classifier_MNISTClassifier 4u9dktkb f9ec8e98-503f-4d40-8877-b7dcc3a93b9c -- POST / 200 529.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,858 mnist_classifier_MNISTClassifier 4u9dktkb 8877dfae-8d95-4914-a4ca-0ccad78a62b8 -- POST / 200 528.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,858 mnist_classifier_MNISTClassifier 4u9dktkb 753f9edd-41db-4872-ac0c-877ce69eeba5 -- POST / 200 528.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,859 mnist_classifier_MNISTClassifier 4u9dktkb 80c346aa-0488-49db-935e-cb8423b56bc1 -- POST / 200 527.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,859 mnist_classifier_MNISTClassifier 4u9dktkb 1124a168-dffd-4685-bdb3-f98fb097bff4 -- POST / 200 525.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,859 mnist_classifier_MNISTClassifier 4u9dktkb ee604363-1406-4ea8-908f-1f5f12c42969 -- POST / 200 525.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,859 mnist_classifier_MNISTClassifier 4u9dktkb a6c25655-4389-4d25-bc8e-b104b1cb7ff6 -- POST / 200 525.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,860 mnist_classifier_MNISTClassifier 4u9dktkb 985ebee2-b912-4fa9-a8a2-bd8a4250a59c -- POST / 200 525.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,860 mnist_classifier_MNISTClassifier 4u9dktkb f24f28ac-754e-49f2-9316-0b321301cffe -- POST / 200 524.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,860 mnist_classifier_MNISTClassifier 4u9dktkb 3526dec5-11c1-4776-9170-02d1159808f4 -- POST / 200 524.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,861 mnist_classifier_MNISTClassifier 4u9dktkb afb960fa-3fb3-4aca-be8c-e44c9fb2eb1c -- POST / 200 524.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,861 mnist_classifier_MNISTClassifier 4u9dktkb 6f40bf66-7094-4f2a-af9f-8ca1632829a8 -- POST / 200 523.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,861 mnist_classifier_MNISTClassifier 4u9dktkb b6a527ac-be3c-4282-b3ea-67062ab4e154 -- POST / 200 523.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,862 mnist_classifier_MNISTClassifier 4u9dktkb 576c281e-63e6-49e7-9939-f393785fb49f -- POST / 200 521.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,862 mnist_classifier_MNISTClassifier 4u9dktkb eabc389b-8d56-4712-8648-a5456c66010f -- POST / 200 523.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,862 mnist_classifier_MNISTClassifier 4u9dktkb e91aff85-5980-4a28-a835-960d2ff63d1c -- POST / 200 521.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,862 mnist_classifier_MNISTClassifier 4u9dktkb 03ce5fca-62c3-4086-bf65-caade38bb561 -- POST / 200 520.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,873 mnist_classifier_MNISTClassifier 4u9dktkb 1021889b-b34c-41c7-af5e-8c9e523797d9 -- POST / 200 532.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,900 mnist_classifier_MNISTClassifier 4u9dktkb 9dbd6d47-6c58-48ba-9bc2-7d9b27525967 -- POST / 200 561.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,902 mnist_classifier_MNISTClassifier 4u9dktkb b7f04038-16a6-4c91-ba5b-147a0a2172f2 -- POST / 200 562.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,902 mnist_classifier_MNISTClassifier 4u9dktkb c9a720b4-d4cb-445b-b89f-f0116cb54c45 -- POST / 200 282.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,903 mnist_classifier_MNISTClassifier 4u9dktkb b8e9242f-92c8-4f39-a85e-1898bd36255f -- POST / 200 275.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,903 mnist_classifier_MNISTClassifier 4u9dktkb 411541d3-7a55-4f13-a699-3457398e0c58 -- POST / 200 283.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,903 mnist_classifier_MNISTClassifier 4u9dktkb fa13eb80-5962-4f61-b74f-579074d7ef6c -- POST / 200 272.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,904 mnist_classifier_MNISTClassifier 4u9dktkb eb4b85ef-a577-4d29-8ec0-9d7491d6b04a -- POST / 200 271.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,904 mnist_classifier_MNISTClassifier 4u9dktkb a2ce97e6-95bb-43f9-a85b-99048de372f2 -- POST / 200 270.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,904 mnist_classifier_MNISTClassifier 4u9dktkb 199a87bd-5646-47a2-8cc6-c8f24c489c4d -- POST / 200 268.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,904 mnist_classifier_MNISTClassifier 4u9dktkb 2b13643b-e41d-4449-a991-5fc314e4b140 -- POST / 200 268.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,904 mnist_classifier_MNISTClassifier 4u9dktkb b9826aa7-26ff-46f9-8aa0-5fb925380901 -- POST / 200 266.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,905 mnist_classifier_MNISTClassifier 4u9dktkb 6e5b5b30-b7fe-4003-aa18-307e5d73d881 -- POST / 200 266.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,905 mnist_classifier_MNISTClassifier 4u9dktkb d5254b7e-978c-4cea-ab03-b7fcc9a2c903 -- POST / 200 265.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,905 mnist_classifier_MNISTClassifier 4u9dktkb 274dcdae-c66f-4220-9a89-2bcf417bdf27 -- POST / 200 265.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,905 mnist_classifier_MNISTClassifier 4u9dktkb f176e2aa-36c2-450a-8c70-d7bbbfda986f -- POST / 200 264.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,906 mnist_classifier_MNISTClassifier 4u9dktkb 1eb6d3ca-3f2e-471f-ab1f-a1e42b2307a2 -- POST / 200 264.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,907 mnist_classifier_MNISTClassifier 4u9dktkb 32202eac-df93-43db-8703-19e03cbfadb1 -- POST / 200 231.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,907 mnist_classifier_MNISTClassifier 4u9dktkb 7dc7c503-3d08-4412-b9f9-7eb901db12f6 -- POST / 200 228.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,908 mnist_classifier_MNISTClassifier 4u9dktkb ebb9fabe-abd4-4f6e-baec-45717e192304 -- POST / 200 227.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,908 mnist_classifier_MNISTClassifier 4u9dktkb ee855b7d-165d-4661-be8e-4c161d80154e -- POST / 200 214.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,909 mnist_classifier_MNISTClassifier 4u9dktkb 0a5db736-5828-4884-8a9c-c290db279ed3 -- POST / 200 215.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,910 mnist_classifier_MNISTClassifier 4u9dktkb de6b4221-5828-4805-8d60-5baa5298d2e6 -- POST / 200 215.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,910 mnist_classifier_MNISTClassifier 4u9dktkb c869209f-f88b-4620-9806-fff17f8249a2 -- POST / 200 215.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:48,910 mnist_classifier_MNISTClassifier 4u9dktkb 3e5678d1-279b-4ec9-9f59-d5dc365b79be -- POST / 200 215.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,022 mnist_classifier_MNISTClassifier 4u9dktkb 379c49cf-614c-436d-a84f-10a7080da992 -- POST / 200 196.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,024 mnist_classifier_MNISTClassifier 4u9dktkb dd748b26-4e10-44e4-b242-6032bf743925 -- POST / 200 206.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,026 mnist_classifier_MNISTClassifier 4u9dktkb 659cb652-44c9-4c57-bf2e-e1b8e299a0b9 -- POST / 200 211.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,027 mnist_classifier_MNISTClassifier 4u9dktkb 28122a46-9140-44a8-9c37-d28bb819318b -- POST / 200 202.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,031 mnist_classifier_MNISTClassifier 4u9dktkb 53bc839f-0c2f-4212-9f41-fd8b828de30a -- POST / 200 209.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,031 mnist_classifier_MNISTClassifier 4u9dktkb 90d3959d-0b9a-4580-8667-5fef830f29df -- POST / 200 205.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,032 mnist_classifier_MNISTClassifier 4u9dktkb fb59feff-f1c0-40f1-b4f6-b6c99e239173 -- POST / 200 199.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,033 mnist_classifier_MNISTClassifier 4u9dktkb d2202ee3-ef07-4e52-a1cb-781b230949d9 -- POST / 200 200.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,034 mnist_classifier_MNISTClassifier 4u9dktkb 89fc6d5b-baea-485a-afd6-1ab71b361148 -- POST / 200 193.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,034 mnist_classifier_MNISTClassifier 4u9dktkb 0798583f-8c18-4c32-91e6-23e34b76a8b0 -- POST / 200 170.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,036 mnist_classifier_MNISTClassifier 4u9dktkb 7b97de36-777b-41e4-aa30-e6e7184b0cbf -- POST / 200 171.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,036 mnist_classifier_MNISTClassifier 4u9dktkb b5543814-fa12-4d51-a55f-2ff97b448021 -- POST / 200 122.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,038 mnist_classifier_MNISTClassifier 4u9dktkb c4a715b1-3655-4abe-957a-4f45858c981c -- POST / 200 123.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,038 mnist_classifier_MNISTClassifier 4u9dktkb 060a06ba-913e-4af3-b33e-dbe778d4868c -- POST / 200 138.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,040 mnist_classifier_MNISTClassifier 4u9dktkb 93c5315c-9d9a-4526-8063-633a9e13f411 -- POST / 200 127.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,041 mnist_classifier_MNISTClassifier 4u9dktkb 8cf22478-5c24-4527-b791-6f5196d1a749 -- POST / 200 128.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,043 mnist_classifier_MNISTClassifier 4u9dktkb 4e86c946-ed0f-4a94-9dbc-2bc907d25cf9 -- POST / 200 129.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,044 mnist_classifier_MNISTClassifier 4u9dktkb 7a6756a0-364e-41b1-b728-4fcd45f006cb -- POST / 200 130.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,045 mnist_classifier_MNISTClassifier 4u9dktkb 00880dfe-f04c-4bb2-bcfe-a2d92ba2680e -- POST / 200 130.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,045 mnist_classifier_MNISTClassifier 4u9dktkb 9683b632-2593-4a93-8445-6b39795ed49b -- POST / 200 130.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,154 mnist_classifier_MNISTClassifier 4u9dktkb e49ce24e-8d9b-4f38-b84a-eefb08a5d493 -- POST / 200 237.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,155 mnist_classifier_MNISTClassifier 4u9dktkb 9ac2fba6-1643-4d90-af01-0466eb0da093 -- POST / 200 234.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,156 mnist_classifier_MNISTClassifier 4u9dktkb d32a89fb-a1ba-4add-be4d-58f86eab7a3f -- POST / 200 234.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,174 mnist_classifier_MNISTClassifier 4u9dktkb 7b903b3e-cc04-4a31-963d-ae697ebb7cfa -- POST / 200 249.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,175 mnist_classifier_MNISTClassifier 4u9dktkb 70ba26b1-3b8e-4a13-a1de-01b370fcdbb3 -- POST / 200 252.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,175 mnist_classifier_MNISTClassifier 4u9dktkb f41b6b3b-3fe1-47c3-a02a-734e8fe0d362 -- POST / 200 242.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,175 mnist_classifier_MNISTClassifier 4u9dktkb 883365cc-d413-4f64-856a-73a4d9284f8a -- POST / 200 249.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,177 mnist_classifier_MNISTClassifier 4u9dktkb 245955f9-be72-4f71-9f90-f5d5e065e100 -- POST / 200 250.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,178 mnist_classifier_MNISTClassifier 4u9dktkb ed9cbfe7-5fa4-4ea9-b02e-ec172f085338 -- POST / 200 248.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,179 mnist_classifier_MNISTClassifier 4u9dktkb ade0ace3-a64b-41be-a8bf-e5f4078aec4c -- POST / 200 249.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,179 mnist_classifier_MNISTClassifier 4u9dktkb b916ead3-ee5c-4341-be46-a193892e35ca -- POST / 200 246.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,181 mnist_classifier_MNISTClassifier 4u9dktkb 8426d1e9-23f8-4cb5-80c0-660ba789654c -- POST / 200 248.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,181 mnist_classifier_MNISTClassifier 4u9dktkb 343888cf-abbb-436d-8a6f-582fd04458e1 -- POST / 200 248.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,182 mnist_classifier_MNISTClassifier 4u9dktkb 04172065-5da6-46e7-ab71-06f3bd753829 -- POST / 200 248.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,183 mnist_classifier_MNISTClassifier 4u9dktkb f1e31d4d-c32f-46c6-b425-fbd4cac8b943 -- POST / 200 249.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,183 mnist_classifier_MNISTClassifier 4u9dktkb e09e25e0-4bc9-4fde-b7a9-fdfd60fc8f81 -- POST / 200 246.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,184 mnist_classifier_MNISTClassifier 4u9dktkb 6ddab605-10df-4e1d-9f47-76ca1a8e1571 -- POST / 200 249.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,184 mnist_classifier_MNISTClassifier 4u9dktkb 0d162944-33b4-423d-b4c3-ac3843a97c6b -- POST / 200 249.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,184 mnist_classifier_MNISTClassifier 4u9dktkb 1e0429e3-e127-4576-be6a-d0122564c503 -- POST / 200 247.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,185 mnist_classifier_MNISTClassifier 4u9dktkb 8a63b509-1528-454d-99a2-8c7ed6e9eafd -- POST / 200 246.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,185 mnist_classifier_MNISTClassifier 4u9dktkb d49f4ac0-0358-426c-9954-ccbc3978ffcb -- POST / 200 248.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,186 mnist_classifier_MNISTClassifier 4u9dktkb f5e866df-c3f5-4fa4-a4ce-6c6595a831d3 -- POST / 200 247.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,187 mnist_classifier_MNISTClassifier 4u9dktkb 596e9269-2ad9-4021-940a-a05927c1739e -- POST / 200 248.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,194 mnist_classifier_MNISTClassifier 4u9dktkb 300a8118-607b-46bf-a8c2-6d7016e45ca0 -- POST / 200 252.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,195 mnist_classifier_MNISTClassifier 4u9dktkb 9cca9220-10c6-412c-bd3b-3b16e9996ab9 -- POST / 200 252.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,199 mnist_classifier_MNISTClassifier 4u9dktkb d597ac68-316c-4f33-a0e4-bc6af1f6729a -- POST / 200 254.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,200 mnist_classifier_MNISTClassifier 4u9dktkb 4d76f566-35e1-4e34-aeb1-e91cf9e650ea -- POST / 200 254.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,202 mnist_classifier_MNISTClassifier 4u9dktkb 2415c327-ef21-4656-9657-e6eaa547d19f -- POST / 200 255.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,202 mnist_classifier_MNISTClassifier 4u9dktkb 7d99df97-2944-41b8-adb9-1430b4afa5b6 -- POST / 200 251.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,202 mnist_classifier_MNISTClassifier 4u9dktkb 9d13891c-4b7a-44ca-8ee7-19e78198f51f -- POST / 200 250.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,203 mnist_classifier_MNISTClassifier 4u9dktkb 0d77b3d4-6ab2-4226-a2a3-f0e3e0e26274 -- POST / 200 249.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,203 mnist_classifier_MNISTClassifier 4u9dktkb 05220cfb-b1fe-4492-83e2-8cb14e6dd4ae -- POST / 200 251.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,204 mnist_classifier_MNISTClassifier 4u9dktkb 7acd2165-e91a-41a9-aac7-1607535c91f3 -- POST / 200 251.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,435 mnist_classifier_MNISTClassifier 4u9dktkb cfcec4be-cf1e-4e56-a4df-81afd03dad90 -- POST / 200 466.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,439 mnist_classifier_MNISTClassifier 4u9dktkb 49faa7cb-4bb6-4f27-8c9b-f29cfe93ee7d -- POST / 200 484.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,443 mnist_classifier_MNISTClassifier 4u9dktkb fd9436d4-00c7-4e3f-a666-94653ed3b450 -- POST / 200 488.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,444 mnist_classifier_MNISTClassifier 4u9dktkb 4beef7c0-493a-419c-bf6f-86e560b36d07 -- POST / 200 486.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,444 mnist_classifier_MNISTClassifier 4u9dktkb 67effca9-61b9-4948-9f0c-14bceb13d18a -- POST / 200 486.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,444 mnist_classifier_MNISTClassifier 4u9dktkb e9d6fe0a-8ecd-4d70-b883-df63e92f8bc9 -- POST / 200 486.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,445 mnist_classifier_MNISTClassifier 4u9dktkb 52e4d7ef-ea59-4962-9d0e-06dd01d28822 -- POST / 200 484.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,445 mnist_classifier_MNISTClassifier 4u9dktkb ab9274df-24b7-49b4-b597-7617a845b035 -- POST / 200 483.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,446 mnist_classifier_MNISTClassifier 4u9dktkb 0ba872fb-7292-4de9-b45c-03bf4513a598 -- POST / 200 484.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,446 mnist_classifier_MNISTClassifier 4u9dktkb c0280918-77a8-47cc-9ca7-c3a9e8dcbb32 -- POST / 200 483.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,448 mnist_classifier_MNISTClassifier 4u9dktkb c3a819de-5d43-4531-9f63-55caa36a8027 -- POST / 200 485.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,448 mnist_classifier_MNISTClassifier 4u9dktkb 56525873-6383-4f32-9786-6eef3b7de34e -- POST / 200 485.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,449 mnist_classifier_MNISTClassifier 4u9dktkb 39f09688-8c64-49cb-8c27-2317de312fb0 -- POST / 200 478.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,451 mnist_classifier_MNISTClassifier 4u9dktkb 764b4fb6-50f2-4b5d-b925-37dbfcdabde1 -- POST / 200 479.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,451 mnist_classifier_MNISTClassifier 4u9dktkb b0ce17d3-872e-49ce-94bf-90fbd81b784e -- POST / 200 480.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,452 mnist_classifier_MNISTClassifier 4u9dktkb 4ea8c533-22bf-4fb6-b718-ff5914b385e9 -- POST / 200 480.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,452 mnist_classifier_MNISTClassifier 4u9dktkb 0423098e-7ab0-47dc-8abd-596b482d3b2f -- POST / 200 479.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,453 mnist_classifier_MNISTClassifier 4u9dktkb c9dd2675-c4d3-4dbc-a1a3-55d3a8334cdd -- POST / 200 479.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,453 mnist_classifier_MNISTClassifier 4u9dktkb a6cf46ac-3959-400b-9467-8b2d29d17407 -- POST / 200 478.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,454 mnist_classifier_MNISTClassifier 4u9dktkb 96ce7a74-dc23-4d19-b2d8-63f5d5e798f0 -- POST / 200 477.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,454 mnist_classifier_MNISTClassifier 4u9dktkb 54f76450-7c3c-432d-b8e7-eca366bb45f1 -- POST / 200 477.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,455 mnist_classifier_MNISTClassifier 4u9dktkb ef4e6be0-688b-4ef1-b15b-64efe6e40bf2 -- POST / 200 477.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,457 mnist_classifier_MNISTClassifier 4u9dktkb 7ae64847-a1ea-4031-943a-3d694f2e6b2e -- POST / 200 459.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,457 mnist_classifier_MNISTClassifier 4u9dktkb 8bb1c8d3-ab68-43ca-86e5-7bfa231c3cb1 -- POST / 200 459.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,457 mnist_classifier_MNISTClassifier 4u9dktkb 1a5adea8-a39c-4c57-8596-228de09c46a6 -- POST / 200 458.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,460 mnist_classifier_MNISTClassifier 4u9dktkb 0bb1883e-db8d-44b5-843a-4d6587322c50 -- POST / 200 460.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,461 mnist_classifier_MNISTClassifier 4u9dktkb f4a3ad41-03ff-4759-9ebd-929dd72f8b72 -- POST / 200 460.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,462 mnist_classifier_MNISTClassifier 4u9dktkb 34c77a16-b4d3-4406-87c8-d8829f3501b1 -- POST / 200 461.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,463 mnist_classifier_MNISTClassifier 4u9dktkb 324d2729-bffe-43c0-8dd5-53114cbba39f -- POST / 200 431.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,464 mnist_classifier_MNISTClassifier 4u9dktkb 51b9d129-789c-40ee-9231-e0f4fd510995 -- POST / 200 421.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,465 mnist_classifier_MNISTClassifier 4u9dktkb f29b4b3d-5925-4cf7-9638-bc1dbc0b027e -- POST / 200 422.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,466 mnist_classifier_MNISTClassifier 4u9dktkb fca8ee2e-553b-4741-88c2-cdc09fce7683 -- POST / 200 419.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,466 mnist_classifier_MNISTClassifier 4u9dktkb 7f94284e-b75d-4aaf-bab1-89d4b4645a52 -- POST / 200 417.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,466 mnist_classifier_MNISTClassifier 4u9dktkb a602eaab-939f-439f-99be-8464859f5323 -- POST / 200 416.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,467 mnist_classifier_MNISTClassifier 4u9dktkb c6fecf6e-6cc3-4991-adb5-ef69d15d8f9f -- POST / 200 415.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,467 mnist_classifier_MNISTClassifier 4u9dktkb be3fbb40-8ddb-4e7c-979d-de5fc8fd5262 -- POST / 200 415.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,467 mnist_classifier_MNISTClassifier 4u9dktkb f311263b-c171-4066-b44b-3bca0a09d94e -- POST / 200 414.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,467 mnist_classifier_MNISTClassifier 4u9dktkb c95cf0d5-dd8f-4e60-bb34-a503d061a3b6 -- POST / 200 414.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,467 mnist_classifier_MNISTClassifier 4u9dktkb 14c597ed-7c87-4204-8fb9-a5810efab775 -- POST / 200 413.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,468 mnist_classifier_MNISTClassifier 4u9dktkb 5a081f77-53ed-4429-be45-bce6de779ac7 -- POST / 200 413.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,468 mnist_classifier_MNISTClassifier 4u9dktkb 2fd120ec-31a3-43a8-b619-cfdc97185648 -- POST / 200 413.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,470 mnist_classifier_MNISTClassifier 4u9dktkb 6fd35afc-9901-46fa-bd76-7f9e926c1d33 -- POST / 200 414.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,471 mnist_classifier_MNISTClassifier 4u9dktkb e09f0646-81bb-4575-a78c-530ed8073f54 -- POST / 200 416.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,471 mnist_classifier_MNISTClassifier 4u9dktkb 3ac601dd-238b-440b-99aa-7140d70292b3 -- POST / 200 414.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,471 mnist_classifier_MNISTClassifier 4u9dktkb 5ecc7f60-c4e9-4d04-86a5-d91c1a8ae904 -- POST / 200 411.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,472 mnist_classifier_MNISTClassifier 4u9dktkb f575c04f-c196-4f22-aeda-a96d7cf004a7 -- POST / 200 411.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,472 mnist_classifier_MNISTClassifier 4u9dktkb ea9cbc45-72c2-458c-887e-af5c457168a7 -- POST / 200 410.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,472 mnist_classifier_MNISTClassifier 4u9dktkb e8163f4f-fbad-4a01-a0aa-e123cc09f84b -- POST / 200 396.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,472 mnist_classifier_MNISTClassifier 4u9dktkb b71306c8-b02a-469b-924c-68b266a07016 -- POST / 200 395.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,473 mnist_classifier_MNISTClassifier 4u9dktkb 651c73c0-5776-4613-8ed3-06b28ea9037c -- POST / 200 381.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,473 mnist_classifier_MNISTClassifier 4u9dktkb cce64856-f8c6-4ee7-8013-8e7a48cf2ebe -- POST / 200 380.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,473 mnist_classifier_MNISTClassifier 4u9dktkb 37b6b689-e352-49ff-b031-6d41e3de4845 -- POST / 200 383.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,474 mnist_classifier_MNISTClassifier 4u9dktkb dc3d43b8-1824-4ceb-9bcc-74fc77909c15 -- POST / 200 380.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,474 mnist_classifier_MNISTClassifier 4u9dktkb 2d45a0a9-a59b-41ab-ac2f-2c965bc47cf3 -- POST / 200 376.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,476 mnist_classifier_MNISTClassifier 4u9dktkb 194dfa42-1344-4ddb-b0cd-e2415d0cfd13 -- POST / 200 376.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,478 mnist_classifier_MNISTClassifier 4u9dktkb 2cbffab5-cc40-4d6f-9535-1c062570d4a2 -- POST / 200 374.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,479 mnist_classifier_MNISTClassifier 4u9dktkb a4431801-b6ac-4412-b76d-9d07d51c94cd -- POST / 200 374.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,480 mnist_classifier_MNISTClassifier 4u9dktkb 29743cde-d3d7-4012-b4af-254a222f97f9 -- POST / 200 372.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,481 mnist_classifier_MNISTClassifier 4u9dktkb 8121547b-a48a-45d8-80fd-c179262a91ab -- POST / 200 374.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,483 mnist_classifier_MNISTClassifier 4u9dktkb 132f205f-034f-42bb-9584-dcc8643ae8fb -- POST / 200 373.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,484 mnist_classifier_MNISTClassifier 4u9dktkb b5a488e9-2f50-4725-955b-ec1a6efd8d94 -- POST / 200 374.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,484 mnist_classifier_MNISTClassifier 4u9dktkb 49a6a1d7-874a-47ac-b1ba-dc40af5d4dd0 -- POST / 200 368.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,484 mnist_classifier_MNISTClassifier 4u9dktkb a3269d54-d346-4f91-bf96-9fafb2239300 -- POST / 200 372.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,486 mnist_classifier_MNISTClassifier 4u9dktkb 9aeb46c3-5b2b-447e-bba2-61cc86f1cf5a -- POST / 200 375.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,488 mnist_classifier_MNISTClassifier 4u9dktkb 7fbac4cc-47a0-4f2e-883b-30231bd6c17b -- POST / 200 377.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,489 mnist_classifier_MNISTClassifier 4u9dktkb 2a895174-fd31-47ce-aa76-3058844dd056 -- POST / 200 375.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,489 mnist_classifier_MNISTClassifier 4u9dktkb 09915c33-fbbf-4693-bc84-393b2302efb5 -- POST / 200 375.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,489 mnist_classifier_MNISTClassifier 4u9dktkb bfd80ccf-365b-459e-bac0-ffb3df46b189 -- POST / 200 343.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,490 mnist_classifier_MNISTClassifier 4u9dktkb 7e5a11b3-3049-4ccb-a1db-a6e6ae2e06d1 -- POST / 200 346.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,490 mnist_classifier_MNISTClassifier 4u9dktkb c920379c-cf0f-499d-90ce-654ade409f13 -- POST / 200 339.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,490 mnist_classifier_MNISTClassifier 4u9dktkb 06fc58e8-50f5-447d-a77c-8b3c1f244991 -- POST / 200 345.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,490 mnist_classifier_MNISTClassifier 4u9dktkb 3c0a17bd-1501-4bbd-a123-3d4dfabc5447 -- POST / 200 340.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,491 mnist_classifier_MNISTClassifier 4u9dktkb 02d11154-dc41-4b5b-95e8-9b40826bbb65 -- POST / 200 269.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,538 mnist_classifier_MNISTClassifier 4u9dktkb bd471f5a-0ab2-4972-ad1b-32836f5ee6a5 -- POST / 200 315.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,553 mnist_classifier_MNISTClassifier 4u9dktkb 3d94606c-2782-4113-b32c-9f55477b7ae1 -- POST / 200 328.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,556 mnist_classifier_MNISTClassifier 4u9dktkb d260322c-deb6-478c-95e1-e493eb797aab -- POST / 200 329.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,556 mnist_classifier_MNISTClassifier 4u9dktkb 74175fd0-b585-4d0d-8f7c-93da9c01b7ca -- POST / 200 329.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,557 mnist_classifier_MNISTClassifier 4u9dktkb e1a77402-149b-43b6-b52f-54ff86056845 -- POST / 200 328.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,558 mnist_classifier_MNISTClassifier 4u9dktkb d3b4c1aa-1578-4bd8-9d98-9116d560941c -- POST / 200 328.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,558 mnist_classifier_MNISTClassifier 4u9dktkb 91e01abd-1ae6-42d3-9065-e2c2ed527a89 -- POST / 200 327.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,558 mnist_classifier_MNISTClassifier 4u9dktkb f0369d72-7067-4438-9472-7d4906d4c960 -- POST / 200 325.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,558 mnist_classifier_MNISTClassifier 4u9dktkb 29c238c5-3a0c-4226-81a8-6ffa77bb918a -- POST / 200 325.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,558 mnist_classifier_MNISTClassifier 4u9dktkb f8dbc371-4a04-422a-9277-60166fc64c63 -- POST / 200 324.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,559 mnist_classifier_MNISTClassifier 4u9dktkb 651da05b-af63-4a03-bc09-f4588d684441 -- POST / 200 324.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,559 mnist_classifier_MNISTClassifier 4u9dktkb 4ce46102-4ddf-457d-b407-ad9f70c18003 -- POST / 200 322.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,559 mnist_classifier_MNISTClassifier 4u9dktkb 5c17e2a2-ec57-4029-8e1e-efcebd595547 -- POST / 200 321.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,560 mnist_classifier_MNISTClassifier 4u9dktkb 489fec78-768c-4f85-92b2-6568ea37c75b -- POST / 200 321.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,560 mnist_classifier_MNISTClassifier 4u9dktkb aca7d66f-3a87-4ff6-b54b-8cbf47eb8398 -- POST / 200 322.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,561 mnist_classifier_MNISTClassifier 4u9dktkb c6db38a8-f796-4cef-aa8d-1dbe4472644b -- POST / 200 318.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,561 mnist_classifier_MNISTClassifier 4u9dktkb 473c1a99-5db6-4292-9690-e260889c4aad -- POST / 200 318.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,561 mnist_classifier_MNISTClassifier 4u9dktkb 640f158a-2085-4560-bd8a-f597d0e386ba -- POST / 200 317.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,561 mnist_classifier_MNISTClassifier 4u9dktkb 7ffe2166-1eb5-4ae7-a6ec-9831c5f2e979 -- POST / 200 316.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,561 mnist_classifier_MNISTClassifier 4u9dktkb c29ec5a3-79a8-4249-ac18-f91491cccd8b -- POST / 200 316.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,562 mnist_classifier_MNISTClassifier 4u9dktkb e2e5bd15-a956-465b-bbaa-8b2faee9c0b5 -- POST / 200 316.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,562 mnist_classifier_MNISTClassifier 4u9dktkb fd15e843-5b00-4f71-a449-fabc497efad6 -- POST / 200 316.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,562 mnist_classifier_MNISTClassifier 4u9dktkb 13bd8fed-b569-4920-a094-79182f7a21ae -- POST / 200 316.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,562 mnist_classifier_MNISTClassifier 4u9dktkb 80456fb6-eaed-4512-a3c8-0990a7bdae58 -- POST / 200 314.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,563 mnist_classifier_MNISTClassifier 4u9dktkb 264a48ef-57d6-4bf8-91f2-dcd94d4e7fc5 -- POST / 200 310.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,563 mnist_classifier_MNISTClassifier 4u9dktkb 8de716ca-4480-4e52-8669-ff61c2ab4424 -- POST / 200 310.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,563 mnist_classifier_MNISTClassifier 4u9dktkb c0b1b7d3-099c-406d-86d6-b5335478039c -- POST / 200 311.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,660 mnist_classifier_MNISTClassifier 4u9dktkb c0592f45-594e-471c-9d4e-626d2e2deb59 -- POST / 200 207.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,678 mnist_classifier_MNISTClassifier 4u9dktkb 89d07f0a-8b74-4760-bff2-41d438152512 -- POST / 200 215.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,683 mnist_classifier_MNISTClassifier 4u9dktkb 028fc606-2a87-4748-a31b-444df52e7d21 -- POST / 200 219.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,684 mnist_classifier_MNISTClassifier 4u9dktkb 0da91ed8-cc91-49fc-b81d-3f95bc290cc9 -- POST / 200 209.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,684 mnist_classifier_MNISTClassifier 4u9dktkb 06b3768d-e7aa-412d-82cf-f0bed77e6434 -- POST / 200 209.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,685 mnist_classifier_MNISTClassifier 4u9dktkb 4b6b5083-f15f-4b78-9a15-b7830596f1eb -- POST / 200 210.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,687 mnist_classifier_MNISTClassifier 4u9dktkb 991b54d0-d528-4e9e-aa55-734db1e375db -- POST / 200 212.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,689 mnist_classifier_MNISTClassifier 4u9dktkb 2bc0e2da-fa61-4850-89c3-4dea26675c7e -- POST / 200 187.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,691 mnist_classifier_MNISTClassifier 4u9dktkb 3d92a64f-7d70-43a1-8f61-ea7ab81316cb -- POST / 200 196.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,691 mnist_classifier_MNISTClassifier 4u9dktkb 7531fa38-321d-43e1-90ec-5900852881ee -- POST / 200 190.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,693 mnist_classifier_MNISTClassifier 4u9dktkb 7bde6c29-acb0-4bf0-b8de-0c9e8d707a4a -- POST / 200 197.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,693 mnist_classifier_MNISTClassifier 4u9dktkb fb5af760-8923-4743-ab1e-851811817903 -- POST / 200 191.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,822 mnist_classifier_MNISTClassifier 4u9dktkb 18c6bdf6-c35d-420e-91d1-55f6cfcb56f2 -- POST / 200 318.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,831 mnist_classifier_MNISTClassifier 4u9dktkb 4e1e5504-bb56-41d1-b333-9544812983aa -- POST / 200 325.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,831 mnist_classifier_MNISTClassifier 4u9dktkb 56997231-ab48-41c7-b32b-015c28986c7f -- POST / 200 325.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,832 mnist_classifier_MNISTClassifier 4u9dktkb 61efce9e-a6c4-4ccb-82cb-c7db33d4534e -- POST / 200 323.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,832 mnist_classifier_MNISTClassifier 4u9dktkb b1c0ff06-d9c3-436e-9344-4cca9cc18085 -- POST / 200 324.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,832 mnist_classifier_MNISTClassifier 4u9dktkb 39d63151-02c6-4ba9-a5de-cc7bcce59bce -- POST / 200 323.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,832 mnist_classifier_MNISTClassifier 4u9dktkb 42a7030d-495d-4f30-b0a7-0ff8967ffbe0 -- POST / 200 320.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,833 mnist_classifier_MNISTClassifier 4u9dktkb f00a7291-014f-416d-bd99-5032972daadf -- POST / 200 320.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,833 mnist_classifier_MNISTClassifier 4u9dktkb 78faa0f1-710b-4f64-a04a-c2b8fb2ebe17 -- POST / 200 320.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,833 mnist_classifier_MNISTClassifier 4u9dktkb 3453b167-7968-4655-b5b6-8bc3889563e9 -- POST / 200 321.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,833 mnist_classifier_MNISTClassifier 4u9dktkb 7ffa5fcd-a677-42e4-a700-702d7a13624e -- POST / 200 320.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,834 mnist_classifier_MNISTClassifier 4u9dktkb 0d5dcefe-e4f9-447c-924c-85e7ae8759ae -- POST / 200 317.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,834 mnist_classifier_MNISTClassifier 4u9dktkb 3a9528b0-b1f4-4dfd-9001-2cb5b090fb6a -- POST / 200 279.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,834 mnist_classifier_MNISTClassifier 4u9dktkb f8da2f54-f312-4eba-a382-4dfeaff40537 -- POST / 200 320.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,834 mnist_classifier_MNISTClassifier 4u9dktkb 6ffbc399-e106-47ff-9384-b961eefd9f1f -- POST / 200 320.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,835 mnist_classifier_MNISTClassifier 4u9dktkb 881147d5-dc1e-421d-8838-5f22ad8ad0cd -- POST / 200 319.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,835 mnist_classifier_MNISTClassifier 4u9dktkb 3e3e9e4e-dc3c-4e21-a461-2b6713d304b3 -- POST / 200 318.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,835 mnist_classifier_MNISTClassifier 4u9dktkb c4498b72-8ae4-4f25-8dd0-3f493d91e9f9 -- POST / 200 317.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,835 mnist_classifier_MNISTClassifier 4u9dktkb 18c0ff1d-0fe4-45f9-8511-4406a12338ea -- POST / 200 317.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,836 mnist_classifier_MNISTClassifier 4u9dktkb f238af1e-b100-4aa6-8398-e171f8c0906a -- POST / 200 271.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,836 mnist_classifier_MNISTClassifier 4u9dktkb c428ad67-6660-4ca9-b336-1f523499caaf -- POST / 200 282.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,837 mnist_classifier_MNISTClassifier 4u9dktkb d94c01ef-17d0-4c41-b108-177d9dcec709 -- POST / 200 272.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,837 mnist_classifier_MNISTClassifier 4u9dktkb e71742a1-a867-44ac-a168-c647c21a652d -- POST / 200 273.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,838 mnist_classifier_MNISTClassifier 4u9dktkb 86069395-4e7c-4cfe-a950-0ea0b1d38d56 -- POST / 200 273.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,838 mnist_classifier_MNISTClassifier 4u9dktkb 0a9b1f27-58f6-47fd-b172-630eccee7b8c -- POST / 200 273.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,839 mnist_classifier_MNISTClassifier 4u9dktkb d1243b32-c2b0-4886-861a-107eb3881ebb -- POST / 200 258.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,839 mnist_classifier_MNISTClassifier 4u9dktkb 00fb6302-266b-4b9f-87a3-40fb15511f8a -- POST / 200 273.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,840 mnist_classifier_MNISTClassifier 4u9dktkb 393f9436-36a4-4028-a0b9-a21e841ebe9e -- POST / 200 274.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,840 mnist_classifier_MNISTClassifier 4u9dktkb c592da59-9db6-4598-b289-2ff7c687cbe5 -- POST / 200 274.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,840 mnist_classifier_MNISTClassifier 4u9dktkb 04f90720-b507-440a-a56a-34ae05c08e0a -- POST / 200 274.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,841 mnist_classifier_MNISTClassifier 4u9dktkb 02680de4-a38c-4b02-8676-e2493c25c873 -- POST / 200 259.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,842 mnist_classifier_MNISTClassifier 4u9dktkb 422db2d9-73f4-4be0-bb87-e621d2207b49 -- POST / 200 273.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,843 mnist_classifier_MNISTClassifier 4u9dktkb d6a45f0a-c25f-48d7-aeea-407cd1a6f516 -- POST / 200 263.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,843 mnist_classifier_MNISTClassifier 4u9dktkb 1d44e2b2-2d6f-473e-8ed6-c2d287df75a7 -- POST / 200 263.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,843 mnist_classifier_MNISTClassifier 4u9dktkb b710e5bf-60a1-484b-abc6-d52f26603f38 -- POST / 200 260.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,843 mnist_classifier_MNISTClassifier 4u9dktkb 25413e6d-efb6-4fa5-9ffb-8c36b9b67015 -- POST / 200 260.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,844 mnist_classifier_MNISTClassifier 4u9dktkb 6cd2f41a-8d94-4762-9a86-77e35569703b -- POST / 200 260.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,844 mnist_classifier_MNISTClassifier 4u9dktkb e3b20238-5368-4b5d-a458-505aa0a0a452 -- POST / 200 260.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,845 mnist_classifier_MNISTClassifier 4u9dktkb 60bbc64c-e9d8-42a7-9e27-48b6d0004d60 -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,846 mnist_classifier_MNISTClassifier 4u9dktkb 0be5ac0d-4589-4180-9ae7-a16d98001a27 -- POST / 200 257.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,847 mnist_classifier_MNISTClassifier 4u9dktkb 290e3505-a39d-4e0a-950b-57e6e4b58d94 -- POST / 200 257.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,847 mnist_classifier_MNISTClassifier 4u9dktkb 0a2c0b3f-f29b-476f-a382-100e426679f4 -- POST / 200 256.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,848 mnist_classifier_MNISTClassifier 4u9dktkb 1af0c827-e748-4f09-9cf4-5c005cf01dee -- POST / 200 256.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,848 mnist_classifier_MNISTClassifier 4u9dktkb 1a440ed5-5571-4fd3-9ad5-03233074e4bd -- POST / 200 256.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,848 mnist_classifier_MNISTClassifier 4u9dktkb bf1bdc78-dd69-4577-9b50-157b434035c4 -- POST / 200 254.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,849 mnist_classifier_MNISTClassifier 4u9dktkb 993ad5fd-5836-4761-96d0-04cacc5d6260 -- POST / 200 251.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,849 mnist_classifier_MNISTClassifier 4u9dktkb 6db45536-0a17-4208-b4ca-3b6cef7c6da3 -- POST / 200 248.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,849 mnist_classifier_MNISTClassifier 4u9dktkb 3a44bd44-68a3-4c93-a232-c7c68bbfd98b -- POST / 200 247.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,945 mnist_classifier_MNISTClassifier 4u9dktkb c2ef92f6-3385-4729-a6cb-728c10d582b6 -- POST / 200 342.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,947 mnist_classifier_MNISTClassifier 4u9dktkb c3239423-dc09-431b-81ad-a351f545c183 -- POST / 200 344.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,947 mnist_classifier_MNISTClassifier 4u9dktkb 587a9fc8-99b7-48aa-99c4-aa08951fc383 -- POST / 200 344.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,947 mnist_classifier_MNISTClassifier 4u9dktkb 7e35c874-69b9-439f-a489-6a4b1c093103 -- POST / 200 344.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,948 mnist_classifier_MNISTClassifier 4u9dktkb 85b957e3-fa92-4b01-a325-52c8c5878b4f -- POST / 200 344.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,948 mnist_classifier_MNISTClassifier 4u9dktkb fac37a9e-8480-4cde-ab7a-ca8f0adf29ca -- POST / 200 343.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,948 mnist_classifier_MNISTClassifier 4u9dktkb 2bbde6e1-650e-4aa0-a307-8397b4eb59c0 -- POST / 200 343.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,949 mnist_classifier_MNISTClassifier 4u9dktkb a292ad73-1770-4b35-8c74-aaf2a50f2052 -- POST / 200 339.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,954 mnist_classifier_MNISTClassifier 4u9dktkb cacfb678-1087-430f-a59b-72da1e386aa9 -- POST / 200 343.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,954 mnist_classifier_MNISTClassifier 4u9dktkb eaaa2c23-c8c6-4247-bb37-c2dc6fd48fef -- POST / 200 343.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,956 mnist_classifier_MNISTClassifier 4u9dktkb deea5a04-efb8-4048-a4c3-1cf198238ac0 -- POST / 200 344.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,958 mnist_classifier_MNISTClassifier 4u9dktkb 6fc66e27-8665-46e5-9e8a-9a2f5fd8c363 -- POST / 200 345.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,959 mnist_classifier_MNISTClassifier 4u9dktkb 7344a390-e6c8-45c8-a323-334a865e4dec -- POST / 200 345.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,959 mnist_classifier_MNISTClassifier 4u9dktkb b8ff38a3-0979-456d-945f-b6318f848123 -- POST / 200 317.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,960 mnist_classifier_MNISTClassifier 4u9dktkb fd917a03-90d1-4408-a8d3-f1b1f76b8081 -- POST / 200 317.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,962 mnist_classifier_MNISTClassifier 4u9dktkb 112cf26a-0fd6-4f86-a1d0-9fd6943d3622 -- POST / 200 318.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,962 mnist_classifier_MNISTClassifier 4u9dktkb 3113545d-e2d2-4638-a0ca-2a3e541643b7 -- POST / 200 313.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,962 mnist_classifier_MNISTClassifier 4u9dktkb 6fe4e9ec-e595-48c3-a255-5af305c5e1a5 -- POST / 200 310.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,963 mnist_classifier_MNISTClassifier 4u9dktkb 9a76d0c5-dc70-4261-aa68-ca2ceeaa563f -- POST / 200 310.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,965 mnist_classifier_MNISTClassifier 4u9dktkb 9c33009e-4535-44e8-a9ff-eceae1ca37e1 -- POST / 200 310.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,966 mnist_classifier_MNISTClassifier 4u9dktkb 8a4b236f-e1b4-4426-b9f3-123b6cc82cf7 -- POST / 200 311.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,966 mnist_classifier_MNISTClassifier 4u9dktkb 7cd1d15d-02ae-49e2-bbda-0e78c11c661f -- POST / 200 311.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,967 mnist_classifier_MNISTClassifier 4u9dktkb 6db07994-0f33-4105-ab73-bdaa60e9b544 -- POST / 200 310.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,968 mnist_classifier_MNISTClassifier 4u9dktkb d65f9c1d-5a8c-4d49-928c-4cfaa54c4f54 -- POST / 200 273.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,968 mnist_classifier_MNISTClassifier 4u9dktkb fa441b0b-8bde-4376-a28e-36152f0ad1dd -- POST / 200 269.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,969 mnist_classifier_MNISTClassifier 4u9dktkb 32161a6a-8ece-4ba8-981e-3f36e5c4fd4e -- POST / 200 264.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,972 mnist_classifier_MNISTClassifier 4u9dktkb 33944504-589e-4289-83e7-d06adcba92da -- POST / 200 265.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,973 mnist_classifier_MNISTClassifier 4u9dktkb c973b810-a729-4a97-9b54-f4de2224ce7f -- POST / 200 266.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,973 mnist_classifier_MNISTClassifier 4u9dktkb 54e09ec5-3a8d-4c37-9b54-f06505a38149 -- POST / 200 266.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,974 mnist_classifier_MNISTClassifier 4u9dktkb 081e5309-6f8d-44cb-b202-9047c9c7ca46 -- POST / 200 267.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,975 mnist_classifier_MNISTClassifier 4u9dktkb 722dae66-bc11-4c1a-997a-aff0cee95b48 -- POST / 200 268.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,978 mnist_classifier_MNISTClassifier 4u9dktkb 46138941-6bf0-44b2-99d5-313d0aa91589 -- POST / 200 271.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,983 mnist_classifier_MNISTClassifier 4u9dktkb 63953daa-cc85-45a7-91b3-e487bfed47e9 -- POST / 200 275.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,983 mnist_classifier_MNISTClassifier 4u9dktkb 03349df9-db92-4624-b138-93a044d6d82b -- POST / 200 275.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,989 mnist_classifier_MNISTClassifier 4u9dktkb 1722e81b-c340-4fff-b9a6-2168553d99ff -- POST / 200 281.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,994 mnist_classifier_MNISTClassifier 4u9dktkb af40f789-d7ed-409e-8d07-4ddddbc5a84a -- POST / 200 286.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,994 mnist_classifier_MNISTClassifier 4u9dktkb ee05c379-b1d9-444a-8fb9-979ac126ef8e -- POST / 200 286.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,996 mnist_classifier_MNISTClassifier 4u9dktkb 7f17cb50-08d6-4840-a030-a3738b2a85b6 -- POST / 200 287.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,996 mnist_classifier_MNISTClassifier 4u9dktkb ec89a564-d9e1-4103-8f0d-9347a288ba62 -- POST / 200 288.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,997 mnist_classifier_MNISTClassifier 4u9dktkb 56708cd2-6969-4736-9b27-68053b3f72b3 -- POST / 200 288.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:49,998 mnist_classifier_MNISTClassifier 4u9dktkb 7243beb9-9c4d-47cc-bb96-9ace389d3ff4 -- POST / 200 286.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,002 mnist_classifier_MNISTClassifier 4u9dktkb f7acee64-2b9e-40f9-a81d-2658baf23b80 -- POST / 200 288.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,003 mnist_classifier_MNISTClassifier 4u9dktkb 555655db-04bd-4114-bffe-a3bc86ddd4d3 -- POST / 200 283.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,004 mnist_classifier_MNISTClassifier 4u9dktkb da90f207-5650-4f91-bea5-96ec45de1d5c -- POST / 200 284.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,006 mnist_classifier_MNISTClassifier 4u9dktkb c5cd28f5-4721-4c72-9409-6e3ad98b0453 -- POST / 200 285.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,007 mnist_classifier_MNISTClassifier 4u9dktkb b09ddcc1-1c3f-4de4-9d38-1d8ce702422e -- POST / 200 285.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,012 mnist_classifier_MNISTClassifier 4u9dktkb 136d6d9f-965d-4c56-ad7e-82e62ab66531 -- POST / 200 290.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,013 mnist_classifier_MNISTClassifier 4u9dktkb 00d5d733-d6c3-4482-8d60-f630aad45765 -- POST / 200 290.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,013 mnist_classifier_MNISTClassifier 4u9dktkb ee47165d-b1cd-4f21-9e9b-51dfa1ae4467 -- POST / 200 290.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,013 mnist_classifier_MNISTClassifier 4u9dktkb 1135e396-ed3d-4c0f-a1ba-d597ad81ef52 -- POST / 200 280.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,013 mnist_classifier_MNISTClassifier 4u9dktkb 98707146-af87-40c9-b472-6a54c8e2f696 -- POST / 200 264.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,014 mnist_classifier_MNISTClassifier 4u9dktkb fda4d3d1-0d62-427c-be84-4f24820d7595 -- POST / 200 264.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,102 mnist_classifier_MNISTClassifier 4u9dktkb 6f0cda24-4217-492d-8644-55092010fd1e -- POST / 200 251.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,104 mnist_classifier_MNISTClassifier 4u9dktkb 7a63a0c1-fb18-4415-9756-46f498aa26d1 -- POST / 200 257.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,104 mnist_classifier_MNISTClassifier 4u9dktkb 634c87c0-27ca-477d-b260-2b07393a5035 -- POST / 200 250.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,104 mnist_classifier_MNISTClassifier 4u9dktkb ef5789b5-e9a0-4313-9546-7e80413f951f -- POST / 200 248.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,105 mnist_classifier_MNISTClassifier 4u9dktkb 325c2d11-98ad-4444-98b1-9710e0b02129 -- POST / 200 248.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,106 mnist_classifier_MNISTClassifier 4u9dktkb 6700124c-b13d-40b6-8e18-e384e59d79e9 -- POST / 200 248.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,109 mnist_classifier_MNISTClassifier 4u9dktkb 9571251d-f210-419c-8a20-1df9e3e6aeb3 -- POST / 200 249.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,112 mnist_classifier_MNISTClassifier 4u9dktkb b0f74190-5dc7-4273-9fff-1014deefbea7 -- POST / 200 252.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,112 mnist_classifier_MNISTClassifier 4u9dktkb 18bcfa01-decd-4345-858e-29e70128101a -- POST / 200 251.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,112 mnist_classifier_MNISTClassifier 4u9dktkb 42b8a6c6-a380-4681-8a16-c068fe7a5d3a -- POST / 200 249.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,124 mnist_classifier_MNISTClassifier 4u9dktkb e7f5d478-520e-4f59-9b9a-1f245c911c02 -- POST / 200 260.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,127 mnist_classifier_MNISTClassifier 4u9dktkb 40d57b3d-35e2-46ef-b3d0-9ea18547b563 -- POST / 200 262.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,127 mnist_classifier_MNISTClassifier 4u9dktkb 91912bc3-a135-4760-bd31-37de08279a39 -- POST / 200 261.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,132 mnist_classifier_MNISTClassifier 4u9dktkb 05b46272-c7fd-4815-b0b8-14d9526597c2 -- POST / 200 265.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,133 mnist_classifier_MNISTClassifier 4u9dktkb d2a3a0cf-592f-4d35-a462-8bd5da1881c8 -- POST / 200 264.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,133 mnist_classifier_MNISTClassifier 4u9dktkb c6d1f8cc-fdbd-496a-8405-3226496caf65 -- POST / 200 264.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,138 mnist_classifier_MNISTClassifier 4u9dktkb d45e44b2-ad8f-4b43-9b7b-e4981f1908bc -- POST / 200 261.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,140 mnist_classifier_MNISTClassifier 4u9dktkb bf19de6b-17b1-4286-a018-28cd5e85c062 -- POST / 200 270.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,142 mnist_classifier_MNISTClassifier 4u9dktkb d27a27b6-61ca-4769-b247-74cb7a6a056b -- POST / 200 271.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,143 mnist_classifier_MNISTClassifier 4u9dktkb 18ba9f7e-a613-4906-971a-539ba3dd7f91 -- POST / 200 272.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,143 mnist_classifier_MNISTClassifier 4u9dktkb 2270fb49-6347-4f50-9f10-478b806d6d92 -- POST / 200 268.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,144 mnist_classifier_MNISTClassifier 4u9dktkb 232bbc97-25b4-445c-93f6-f3030d51b080 -- POST / 200 268.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,144 mnist_classifier_MNISTClassifier 4u9dktkb 5913352a-bfc4-493a-851e-6bc11d73bfb0 -- POST / 200 266.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,146 mnist_classifier_MNISTClassifier 4u9dktkb d924b325-65fc-41d0-b010-f7bc0782478d -- POST / 200 266.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,147 mnist_classifier_MNISTClassifier 4u9dktkb d9833f6e-4ec3-4785-96a5-96710c0e29a5 -- POST / 200 265.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,151 mnist_classifier_MNISTClassifier 4u9dktkb 210a421c-1a5e-4e73-9014-cada1e7b1e4a -- POST / 200 263.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,158 mnist_classifier_MNISTClassifier 4u9dktkb a9e106b8-7639-49ee-a3f4-5656cb7c0ea4 -- POST / 200 270.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,159 mnist_classifier_MNISTClassifier 4u9dktkb d5b321ae-2247-48e9-9bdd-25456e900725 -- POST / 200 269.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,160 mnist_classifier_MNISTClassifier 4u9dktkb 63dddae2-3c38-4611-88bf-f8e824716f44 -- POST / 200 264.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,160 mnist_classifier_MNISTClassifier 4u9dktkb b969fbb4-0670-4cbb-ac46-3a969eab5c48 -- POST / 200 262.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,160 mnist_classifier_MNISTClassifier 4u9dktkb cb586c66-cce3-4e31-9133-e2b4b986b865 -- POST / 200 261.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,161 mnist_classifier_MNISTClassifier 4u9dktkb 762a6785-e445-433d-89e1-be197afc26a3 -- POST / 200 260.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,162 mnist_classifier_MNISTClassifier 4u9dktkb d5ae005e-d96f-4b0c-8847-0920864b2e2a -- POST / 200 255.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,162 mnist_classifier_MNISTClassifier 4u9dktkb 141c0fd6-e0b8-497a-8988-81ac05e85c2c -- POST / 200 263.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,163 mnist_classifier_MNISTClassifier 4u9dktkb 459bd598-db39-4dc7-9f0f-07ab82985b09 -- POST / 200 256.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,164 mnist_classifier_MNISTClassifier 4u9dktkb 80d3365e-b495-4b98-b93b-a80ae67da1a9 -- POST / 200 257.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,164 mnist_classifier_MNISTClassifier 4u9dktkb cdb84ad1-8eaf-4e79-85a6-1fda8eac38c6 -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,165 mnist_classifier_MNISTClassifier 4u9dktkb 774b7ed0-7f45-4947-a702-eb2d76d3de3b -- POST / 200 253.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,166 mnist_classifier_MNISTClassifier 4u9dktkb f1636742-fb22-4c8c-8332-66a19cf40fff -- POST / 200 253.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,166 mnist_classifier_MNISTClassifier 4u9dktkb eb882e87-1cb3-4079-8e2a-a3c2cf36d974 -- POST / 200 252.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,167 mnist_classifier_MNISTClassifier 4u9dktkb ba85890d-ec37-4a2d-9689-0d51c59c8e33 -- POST / 200 252.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,167 mnist_classifier_MNISTClassifier 4u9dktkb 776dcef5-0e1a-4349-86ea-3855a5756a60 -- POST / 200 250.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,168 mnist_classifier_MNISTClassifier 4u9dktkb 97034984-bbc4-487f-ba47-44eae8393745 -- POST / 200 250.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,168 mnist_classifier_MNISTClassifier 4u9dktkb 6158c492-d087-4168-bd31-808b118f41fb -- POST / 200 253.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,169 mnist_classifier_MNISTClassifier 4u9dktkb 4e917340-c541-4e17-9989-d2d64592ffea -- POST / 200 249.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,169 mnist_classifier_MNISTClassifier 4u9dktkb 000825cd-57f8-496d-bb68-3c76a320dbdd -- POST / 200 248.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,169 mnist_classifier_MNISTClassifier 4u9dktkb 0bb3b630-1b4e-46ab-96e4-073b892c4043 -- POST / 200 248.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,170 mnist_classifier_MNISTClassifier 4u9dktkb e0b58e3c-90d6-4d61-975b-e8607ea33d7e -- POST / 200 249.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,421 mnist_classifier_MNISTClassifier 4u9dktkb 41da70c4-d232-42a3-96a0-f0fee9c32a45 -- POST / 200 427.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,422 mnist_classifier_MNISTClassifier 4u9dktkb 2a343b37-79d7-451f-b71f-fd88c5c037dd -- POST / 200 417.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,433 mnist_classifier_MNISTClassifier 4u9dktkb ac2b026b-1d3b-4a9b-96eb-83322fa2161f -- POST / 200 416.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,434 mnist_classifier_MNISTClassifier 4u9dktkb 0e2eb7a9-4b01-41f6-995e-e851f1445b57 -- POST / 200 420.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,438 mnist_classifier_MNISTClassifier 4u9dktkb 129e8ee6-da71-45fd-9244-0c916a6e9a10 -- POST / 200 416.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,445 mnist_classifier_MNISTClassifier 4u9dktkb 1cf394ab-86b6-4abd-972a-3c7d8e645978 -- POST / 200 423.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,445 mnist_classifier_MNISTClassifier 4u9dktkb 09f0e836-30ff-4b80-8399-7bb301648dac -- POST / 200 423.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,446 mnist_classifier_MNISTClassifier 4u9dktkb 371e635b-efd7-4c8e-abe3-a4137f1fbc82 -- POST / 200 422.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,446 mnist_classifier_MNISTClassifier 4u9dktkb e5a8b15b-8cda-45d9-948f-81bd31f4a110 -- POST / 200 422.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,447 mnist_classifier_MNISTClassifier 4u9dktkb 2ea17833-188f-44db-9bc3-23db1d7a5ac8 -- POST / 200 418.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,453 mnist_classifier_MNISTClassifier 4u9dktkb 4dab626d-bb4b-427c-a840-84c9f1bde057 -- POST / 200 422.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,454 mnist_classifier_MNISTClassifier 4u9dktkb 942de383-9916-42fb-81cd-b264119b9200 -- POST / 200 428.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,454 mnist_classifier_MNISTClassifier 4u9dktkb f3b1f3a7-2e3b-411e-ae2b-72d427d691a5 -- POST / 200 423.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,455 mnist_classifier_MNISTClassifier 4u9dktkb 82ea7b05-4948-41cd-8d17-fa8322300f45 -- POST / 200 423.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,455 mnist_classifier_MNISTClassifier 4u9dktkb aff213f0-8000-4c96-8988-dc56f5ae62c7 -- POST / 200 423.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,455 mnist_classifier_MNISTClassifier 4u9dktkb 333f9b9b-cb34-469b-82c5-abd1905a6553 -- POST / 200 422.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,455 mnist_classifier_MNISTClassifier 4u9dktkb 994d07a7-73ca-450c-9904-1bf8a8fed2c5 -- POST / 200 409.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,455 mnist_classifier_MNISTClassifier 4u9dktkb f934815b-31a5-4943-8c72-19f019edb94c -- POST / 200 406.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,456 mnist_classifier_MNISTClassifier 4u9dktkb 974028cc-fefc-43d4-99ed-ea4deaee4305 -- POST / 200 409.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,456 mnist_classifier_MNISTClassifier 4u9dktkb e4444d17-8b5e-4fa4-98a0-9db0a2ac0f1d -- POST / 200 421.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,456 mnist_classifier_MNISTClassifier 4u9dktkb 74abb6bf-d48c-4745-a2a1-25a61dc3b89d -- POST / 200 421.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,456 mnist_classifier_MNISTClassifier 4u9dktkb f76cc627-2095-4a20-929c-f904b56f433a -- POST / 200 419.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,457 mnist_classifier_MNISTClassifier 4u9dktkb 71343a89-2470-4e7b-8735-948e1ad458f2 -- POST / 200 415.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,457 mnist_classifier_MNISTClassifier 4u9dktkb cc1fe727-c83e-421a-87f7-28339ef3ad7f -- POST / 200 415.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,457 mnist_classifier_MNISTClassifier 4u9dktkb 73956375-dcaa-4e0d-b9dd-67b0dd1f716b -- POST / 200 414.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,457 mnist_classifier_MNISTClassifier 4u9dktkb 4389619e-10ac-4207-8a31-69f154de10f8 -- POST / 200 411.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,457 mnist_classifier_MNISTClassifier 4u9dktkb 5959960b-02b0-42d1-8fd2-1aa7e9fd6de9 -- POST / 200 408.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,458 mnist_classifier_MNISTClassifier 4u9dktkb c0cb4128-75f9-4de8-a4ee-788a9c9e85c0 -- POST / 200 407.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,458 mnist_classifier_MNISTClassifier 4u9dktkb 32b077dd-9523-4528-adf2-b0291cc470c6 -- POST / 200 403.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,458 mnist_classifier_MNISTClassifier 4u9dktkb 924136f6-173d-4db0-a916-2bf0dd56fb6e -- POST / 200 403.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,458 mnist_classifier_MNISTClassifier 4u9dktkb 02c1b59c-4023-4eea-808e-e0cfe1fc5bf1 -- POST / 200 403.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,458 mnist_classifier_MNISTClassifier 4u9dktkb 185739be-bfac-4d15-929d-ace29efdbadb -- POST / 200 403.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,458 mnist_classifier_MNISTClassifier 4u9dktkb c6410d26-1a62-4149-b0dc-c78061d034b5 -- POST / 200 402.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,459 mnist_classifier_MNISTClassifier 4u9dktkb e296279c-3d54-484e-a9f1-c2e1692d20a1 -- POST / 200 401.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,459 mnist_classifier_MNISTClassifier 4u9dktkb d456896e-db88-45d7-9745-442de5cf5f3d -- POST / 200 401.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,459 mnist_classifier_MNISTClassifier 4u9dktkb ca7f873e-8dee-4cd2-b5a4-e8c1d68df98f -- POST / 200 399.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,459 mnist_classifier_MNISTClassifier 4u9dktkb f954b4b1-b032-47a4-9862-62dfc0270f17 -- POST / 200 401.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,538 mnist_classifier_MNISTClassifier 4u9dktkb cd3be1ea-e364-40fb-b45a-dee06b97b69f -- POST / 200 473.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,540 mnist_classifier_MNISTClassifier 4u9dktkb 85f7952b-6d5f-4256-ac6c-cb5579635ab1 -- POST / 200 479.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,540 mnist_classifier_MNISTClassifier 4u9dktkb c9fac6f8-0f27-47d8-85ec-153257621ed1 -- POST / 200 475.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,546 mnist_classifier_MNISTClassifier 4u9dktkb 8b74ddc4-544c-41a4-a7e9-247605a00648 -- POST / 200 481.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,547 mnist_classifier_MNISTClassifier 4u9dktkb e9749562-dcb9-4ff1-baab-25848adfc36e -- POST / 200 480.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,556 mnist_classifier_MNISTClassifier 4u9dktkb 3d4448dc-c220-427e-afc7-8dc98d9daa0a -- POST / 200 488.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,558 mnist_classifier_MNISTClassifier 4u9dktkb 8056dd5a-7502-4f9f-931c-a26e8961755d -- POST / 200 489.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,558 mnist_classifier_MNISTClassifier 4u9dktkb 9defb832-98f9-4a3b-a370-3c98467e0157 -- POST / 200 488.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,558 mnist_classifier_MNISTClassifier 4u9dktkb 5b88dbe7-78f1-4f8f-bbcb-3be93a8cc07c -- POST / 200 488.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,559 mnist_classifier_MNISTClassifier 4u9dktkb 0b2525eb-9378-4ee4-97c7-52a49576886e -- POST / 200 488.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,559 mnist_classifier_MNISTClassifier 4u9dktkb e4b8d801-7fc5-4159-b51a-12c36d00e8e5 -- POST / 200 488.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,560 mnist_classifier_MNISTClassifier 4u9dktkb b9dfdd97-1529-4812-a353-9f0b67cdb1d9 -- POST / 200 488.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,562 mnist_classifier_MNISTClassifier 4u9dktkb eb5af63b-6a18-41bb-885d-8bf462ec78cb -- POST / 200 488.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,565 mnist_classifier_MNISTClassifier 4u9dktkb 3cfab2d0-bc7b-4685-aa08-fa12f08cc6cf -- POST / 200 486.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,566 mnist_classifier_MNISTClassifier 4u9dktkb 87eac2e4-24fb-4056-8e94-40030fa6e3ec -- POST / 200 485.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,566 mnist_classifier_MNISTClassifier 4u9dktkb b90cdfc0-a800-417a-b0d3-4216b5118db9 -- POST / 200 424.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,566 mnist_classifier_MNISTClassifier 4u9dktkb 65d4b3d7-6e61-4630-ba99-fda681a58677 -- POST / 200 408.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,567 mnist_classifier_MNISTClassifier 4u9dktkb c6ce5729-4755-47e8-a24d-94a50d4f60bf -- POST / 200 425.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,567 mnist_classifier_MNISTClassifier 4u9dktkb 6b5770cf-fe93-4622-a05b-6d18680867cb -- POST / 200 409.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,567 mnist_classifier_MNISTClassifier 4u9dktkb d2d504da-fb93-4270-8bed-fdd75f826386 -- POST / 200 409.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,567 mnist_classifier_MNISTClassifier 4u9dktkb 7809bff1-ce91-4870-8fae-3a33b486189a -- POST / 200 401.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,568 mnist_classifier_MNISTClassifier 4u9dktkb 443125d2-e552-46e9-8879-8c30377140db -- POST / 200 393.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,568 mnist_classifier_MNISTClassifier 4u9dktkb c3bd7d23-c7ea-4abc-98a2-b05b28e5d91b -- POST / 200 387.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,568 mnist_classifier_MNISTClassifier 4u9dktkb a759bbb9-fb73-4c57-b7de-2b70d67fdd1d -- POST / 200 386.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,568 mnist_classifier_MNISTClassifier 4u9dktkb 9e7c1fa4-ecc6-436b-8c2a-b29da9fe0d37 -- POST / 200 384.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,569 mnist_classifier_MNISTClassifier 4u9dktkb 1c660975-b169-450a-896d-5d04b2fbac2e -- POST / 200 383.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,569 mnist_classifier_MNISTClassifier 4u9dktkb 7f2a8de4-8e03-4cdc-909b-143e1da404d4 -- POST / 200 382.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,569 mnist_classifier_MNISTClassifier 4u9dktkb 3a76312d-4221-447f-a736-3adba6a17dda -- POST / 200 381.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,570 mnist_classifier_MNISTClassifier 4u9dktkb 86d81a83-e5a9-4edc-8460-446c3de92eac -- POST / 200 380.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,571 mnist_classifier_MNISTClassifier 4u9dktkb 16e75c6c-6c65-444f-a587-4c228338b9e9 -- POST / 200 384.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,574 mnist_classifier_MNISTClassifier 4u9dktkb 7b834e02-6a35-48c6-9f0b-c439ce74f01e -- POST / 200 384.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,575 mnist_classifier_MNISTClassifier 4u9dktkb 488c23e8-121f-4da9-8f3f-3841c7d98a5b -- POST / 200 381.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,576 mnist_classifier_MNISTClassifier 4u9dktkb e6d06084-1ffd-4093-99c5-62c59d0d8048 -- POST / 200 383.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,576 mnist_classifier_MNISTClassifier 4u9dktkb 56dbd9cb-1ebf-4a76-a15e-28934bc1dcaa -- POST / 200 379.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,576 mnist_classifier_MNISTClassifier 4u9dktkb f6da974d-a3d7-4a06-9479-ef30b335fc97 -- POST / 200 382.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,576 mnist_classifier_MNISTClassifier 4u9dktkb 065afe7f-09f1-4401-9ed7-974486295ede -- POST / 200 376.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,577 mnist_classifier_MNISTClassifier 4u9dktkb c31f558c-7a20-49fe-b00f-05de40adf84a -- POST / 200 376.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,577 mnist_classifier_MNISTClassifier 4u9dktkb 73e2e871-ad66-4dca-a9b4-03d95b45f26e -- POST / 200 375.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,577 mnist_classifier_MNISTClassifier 4u9dktkb f9ba967e-b5a0-4cd8-9b88-406822d913b8 -- POST / 200 375.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,578 mnist_classifier_MNISTClassifier 4u9dktkb a574f461-ca47-45c9-95f4-dce359a27abd -- POST / 200 375.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,578 mnist_classifier_MNISTClassifier 4u9dktkb 5e07ee5e-5e28-43bf-b3be-7b8260df4b78 -- POST / 200 375.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,578 mnist_classifier_MNISTClassifier 4u9dktkb 0f75ec22-f491-4b78-8585-7d8f066b136c -- POST / 200 374.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,579 mnist_classifier_MNISTClassifier 4u9dktkb ab66cc1f-327a-475b-85d1-6e811e480b5e -- POST / 200 374.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,579 mnist_classifier_MNISTClassifier 4u9dktkb 6623bdce-4b8f-469a-a0fc-5604bb9ce425 -- POST / 200 372.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,580 mnist_classifier_MNISTClassifier 4u9dktkb 6be54bb4-dee7-43ac-8ef1-3a96ed000b69 -- POST / 200 373.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,580 mnist_classifier_MNISTClassifier 4u9dktkb 45247299-6948-4d7a-9ff8-3b651039fa80 -- POST / 200 370.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,581 mnist_classifier_MNISTClassifier 4u9dktkb 9a4a8a11-459a-4de7-86f7-e798f7ef8571 -- POST / 200 368.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,581 mnist_classifier_MNISTClassifier 4u9dktkb 24f67052-2214-41e0-8de7-159ae992e2fb -- POST / 200 368.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,582 mnist_classifier_MNISTClassifier 4u9dktkb 016ad9a5-1866-4d37-acc6-b27f3f1484dc -- POST / 200 369.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,583 mnist_classifier_MNISTClassifier 4u9dktkb 54d7690a-aec2-4eec-af24-6815b94d82f6 -- POST / 200 370.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,583 mnist_classifier_MNISTClassifier 4u9dktkb 821e2b07-66f3-4218-a5f2-ab316713f69d -- POST / 200 367.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,584 mnist_classifier_MNISTClassifier 4u9dktkb 87b67989-4bcc-4eb4-a8dd-22afbe5aaa7d -- POST / 200 363.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,584 mnist_classifier_MNISTClassifier 4u9dktkb 767fd16f-da59-4481-b0e1-ca5b09d0f8f4 -- POST / 200 368.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,676 mnist_classifier_MNISTClassifier 4u9dktkb f6d77d7a-ea2f-4de3-9801-97ea7ed28ff1 -- POST / 200 456.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,676 mnist_classifier_MNISTClassifier 4u9dktkb 8c0445e2-3570-47af-9785-d30b6824c9c2 -- POST / 200 456.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,677 mnist_classifier_MNISTClassifier 4u9dktkb 58c411ce-5039-4d1c-9fb2-28e17d49ded3 -- POST / 200 270.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,677 mnist_classifier_MNISTClassifier 4u9dktkb 2fa80997-b873-4ecf-8346-c960adc38705 -- POST / 200 456.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,678 mnist_classifier_MNISTClassifier 4u9dktkb ed07b1ae-64d9-4d48-b40b-e523b929deeb -- POST / 200 457.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,679 mnist_classifier_MNISTClassifier 4u9dktkb 3b918708-5d94-4735-91f0-6f9b16e7081f -- POST / 200 457.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,679 mnist_classifier_MNISTClassifier 4u9dktkb 363bbaf9-f27c-4b93-ab19-2ab4204854b2 -- POST / 200 456.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,679 mnist_classifier_MNISTClassifier 4u9dktkb ad6e0d43-225c-40c3-8ec8-de255a595444 -- POST / 200 456.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,680 mnist_classifier_MNISTClassifier 4u9dktkb 63be7f66-a684-41c0-9c35-eb4acbd1c8b5 -- POST / 200 450.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,680 mnist_classifier_MNISTClassifier 4u9dktkb 9928ffc9-54eb-45e4-ad33-134588f35ced -- POST / 200 448.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,680 mnist_classifier_MNISTClassifier 4u9dktkb d11a5962-d609-4db0-a0e9-64bdbc7b6eae -- POST / 200 312.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,681 mnist_classifier_MNISTClassifier 4u9dktkb d8125f1a-5648-4e80-a664-8be85eecd23a -- POST / 200 277.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,682 mnist_classifier_MNISTClassifier 4u9dktkb 510bab53-0353-4b15-b48d-de00c551211b -- POST / 200 268.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,682 mnist_classifier_MNISTClassifier 4u9dktkb e5e6217d-ded4-497d-9b74-b153995a5358 -- POST / 200 267.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,683 mnist_classifier_MNISTClassifier 4u9dktkb 416f08ef-ea70-4fd1-a9cf-81d22dc7d980 -- POST / 200 267.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,685 mnist_classifier_MNISTClassifier 4u9dktkb 010956a4-9139-40b6-ae6f-e82ab9a4dda3 -- POST / 200 267.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,686 mnist_classifier_MNISTClassifier 4u9dktkb 47673dd6-3898-43e7-aef4-61b2797d6533 -- POST / 200 222.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,693 mnist_classifier_MNISTClassifier 4u9dktkb 688a87bc-fc6b-4517-a649-4f7506998da5 -- POST / 200 228.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,695 mnist_classifier_MNISTClassifier 4u9dktkb 16531e58-8519-4b36-ac09-465a6b8eeb3a -- POST / 200 230.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,695 mnist_classifier_MNISTClassifier 4u9dktkb 65620a80-e91d-4ffd-885e-b5105ac1fbef -- POST / 200 229.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,697 mnist_classifier_MNISTClassifier 4u9dktkb cd64c931-0901-448e-8984-5239064b9997 -- POST / 200 230.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,697 mnist_classifier_MNISTClassifier 4u9dktkb a4b4a44e-4435-4adc-afe4-4bb7b552205f -- POST / 200 230.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,698 mnist_classifier_MNISTClassifier 4u9dktkb 1f7f010d-41e6-4722-8698-8a2c203b3bb8 -- POST / 200 227.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,698 mnist_classifier_MNISTClassifier 4u9dktkb 4e8bd299-9e41-4251-a68b-390bb4c6a2d5 -- POST / 200 231.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,698 mnist_classifier_MNISTClassifier 4u9dktkb ee91809b-283d-4b83-86ed-86738d4441e8 -- POST / 200 228.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,710 mnist_classifier_MNISTClassifier 4u9dktkb 90647639-c32f-426b-abb9-23594c77c013 -- POST / 200 239.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,711 mnist_classifier_MNISTClassifier 4u9dktkb 23aaebfd-4601-49cf-ba69-5a22d827b5b8 -- POST / 200 238.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,711 mnist_classifier_MNISTClassifier 4u9dktkb 79e7efaf-328b-4635-a660-f9f11e53db00 -- POST / 200 238.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,712 mnist_classifier_MNISTClassifier 4u9dktkb 06b8ff34-1c5f-43ba-8957-eb5546d85e60 -- POST / 200 239.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,712 mnist_classifier_MNISTClassifier 4u9dktkb 06851952-c540-488c-85f1-6b490105ea3c -- POST / 200 239.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,715 mnist_classifier_MNISTClassifier 4u9dktkb a46d09f1-26f6-4e08-8740-3f75e910153a -- POST / 200 241.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,717 mnist_classifier_MNISTClassifier 4u9dktkb 30d9d54e-7590-45f8-91bc-bd58e0b328f8 -- POST / 200 243.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,723 mnist_classifier_MNISTClassifier 4u9dktkb eac7d953-6446-4299-ba16-dc9f9eea0fc3 -- POST / 200 247.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,723 mnist_classifier_MNISTClassifier 4u9dktkb 44324063-800d-4500-a7cd-1f96b776b310 -- POST / 200 247.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,723 mnist_classifier_MNISTClassifier 4u9dktkb b718ae55-5ecf-4ad5-9930-68385dbe844f -- POST / 200 247.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,723 mnist_classifier_MNISTClassifier 4u9dktkb 2481eb9f-5a6e-4d64-a9ce-df9a4ae05573 -- POST / 200 245.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,723 mnist_classifier_MNISTClassifier 4u9dktkb 046cb89b-bf41-47c3-b947-bdd2e24f5ad8 -- POST / 200 246.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,724 mnist_classifier_MNISTClassifier 4u9dktkb 4aa12f76-512f-403b-8e05-8bb234c3271c -- POST / 200 244.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,724 mnist_classifier_MNISTClassifier 4u9dktkb 560a2662-d5c4-450e-be62-b593c2297a7a -- POST / 200 244.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,724 mnist_classifier_MNISTClassifier 4u9dktkb 30213323-3e61-434b-a4b3-07a2222d1bf1 -- POST / 200 244.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,864 mnist_classifier_MNISTClassifier 4u9dktkb 8d819b80-3884-4207-ad60-ffdc8279a7d7 -- POST / 200 279.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,867 mnist_classifier_MNISTClassifier 4u9dktkb 8253224f-8548-422c-92b2-8934d06c52cd -- POST / 200 386.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,867 mnist_classifier_MNISTClassifier 4u9dktkb c4a22fff-60bf-4c2f-a9c7-ff97e60dfcbf -- POST / 200 385.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,868 mnist_classifier_MNISTClassifier 4u9dktkb 3547a9a8-2118-497d-97a3-24f0998153dd -- POST / 200 385.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,868 mnist_classifier_MNISTClassifier 4u9dktkb 0a868555-d082-4c58-899c-b737dfd29b03 -- POST / 200 384.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,869 mnist_classifier_MNISTClassifier 4u9dktkb 2adde737-65ca-4307-819a-d5b657b73769 -- POST / 200 384.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,869 mnist_classifier_MNISTClassifier 4u9dktkb 3fed3305-97ac-4da5-be22-25797b2b626d -- POST / 200 383.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,870 mnist_classifier_MNISTClassifier 4u9dktkb 281dd301-925b-4ef4-965d-3877e439c39e -- POST / 200 382.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,870 mnist_classifier_MNISTClassifier 4u9dktkb 03ce06ea-9675-4267-ac04-b29fd4af8c0c -- POST / 200 333.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,870 mnist_classifier_MNISTClassifier 4u9dktkb 366c1c95-644a-4bad-a54e-b7ebe13e4af3 -- POST / 200 333.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,870 mnist_classifier_MNISTClassifier 4u9dktkb 6410e052-31ed-4fe3-8683-d4524c880dcb -- POST / 200 285.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,870 mnist_classifier_MNISTClassifier 4u9dktkb 4268f6e0-e2ce-4852-a423-f1b55e4533d3 -- POST / 200 285.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,871 mnist_classifier_MNISTClassifier 4u9dktkb ddedd654-2fb3-4dc8-9601-920bc5841d1e -- POST / 200 281.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,871 mnist_classifier_MNISTClassifier 4u9dktkb 7147e616-bdd9-4e21-aac9-df6066485da3 -- POST / 200 280.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,871 mnist_classifier_MNISTClassifier 4u9dktkb 45cc018a-7cf5-4fe7-abc7-af39cc234b02 -- POST / 200 280.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,871 mnist_classifier_MNISTClassifier 4u9dktkb dfa535b2-6be0-4635-8679-046895b02be8 -- POST / 200 278.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,872 mnist_classifier_MNISTClassifier 4u9dktkb 1b787f2e-5c35-4e20-9c87-c65dca16427f -- POST / 200 277.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,872 mnist_classifier_MNISTClassifier 4u9dktkb 7b55c29f-cc35-4ba5-aa1e-47d853b0e28c -- POST / 200 277.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,872 mnist_classifier_MNISTClassifier 4u9dktkb a36fe5c3-ec49-4604-a616-5f84c73e280d -- POST / 200 276.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,872 mnist_classifier_MNISTClassifier 4u9dktkb e25b0144-f59c-495f-81a1-e45576629565 -- POST / 200 276.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,873 mnist_classifier_MNISTClassifier 4u9dktkb fd0b869b-af23-4fc4-b842-1fc0a6c04bd5 -- POST / 200 276.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,873 mnist_classifier_MNISTClassifier 4u9dktkb 827d534a-a2c7-4b03-98f0-a74dc392e8cc -- POST / 200 274.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,873 mnist_classifier_MNISTClassifier 4u9dktkb cc46ed84-4185-48ff-a511-5e54caa3aca3 -- POST / 200 274.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,874 mnist_classifier_MNISTClassifier 4u9dktkb e403f238-96c5-4637-8aaa-571967cceda2 -- POST / 200 271.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,874 mnist_classifier_MNISTClassifier 4u9dktkb c115b968-e536-4865-83d1-5b5c11426e79 -- POST / 200 270.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,874 mnist_classifier_MNISTClassifier 4u9dktkb d3ec797c-8575-46d5-b659-9898fb605aef -- POST / 200 270.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,875 mnist_classifier_MNISTClassifier 4u9dktkb 42c1f5e1-f10f-4e58-9043-75ab69931d75 -- POST / 200 270.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,876 mnist_classifier_MNISTClassifier 4u9dktkb d8b1cb84-4e56-494e-9e2b-dc045b57e3b4 -- POST / 200 256.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,877 mnist_classifier_MNISTClassifier 4u9dktkb 6911d6b8-9110-4fb1-8564-3b7867cffdfe -- POST / 200 272.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,878 mnist_classifier_MNISTClassifier 4u9dktkb cbe4110d-33e2-455e-af1c-43ce6f1234d1 -- POST / 200 272.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,878 mnist_classifier_MNISTClassifier 4u9dktkb bc5a8227-f9a5-475f-b611-c43479c20da3 -- POST / 200 271.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,879 mnist_classifier_MNISTClassifier 4u9dktkb f8b6f387-80f2-4d09-bedf-6659bbe191bf -- POST / 200 270.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,879 mnist_classifier_MNISTClassifier 4u9dktkb 25b847a1-4390-4c86-829b-94909655ec4b -- POST / 200 270.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,880 mnist_classifier_MNISTClassifier 4u9dktkb 3760d265-791f-4716-9586-ab96d0d21b3f -- POST / 200 270.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,880 mnist_classifier_MNISTClassifier 4u9dktkb d966d0c5-312c-4feb-86c9-743cda1d00ee -- POST / 200 269.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,881 mnist_classifier_MNISTClassifier 4u9dktkb 13f10f43-04a0-4e9f-998d-19ba73a7035c -- POST / 200 268.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,881 mnist_classifier_MNISTClassifier 4u9dktkb 4f7c6b62-8d9e-492c-b4ef-cc9f2f1bad38 -- POST / 200 268.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,882 mnist_classifier_MNISTClassifier 4u9dktkb 327631b5-2262-448d-94ad-c90c8770ff67 -- POST / 200 267.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,882 mnist_classifier_MNISTClassifier 4u9dktkb c5081964-09a7-485a-a881-43b0002de46e -- POST / 200 268.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,882 mnist_classifier_MNISTClassifier 4u9dktkb a2be1c42-49d3-4cfe-a2fa-66eea4bba16c -- POST / 200 267.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,883 mnist_classifier_MNISTClassifier 4u9dktkb 89342033-b281-4597-9d44-5f293094d197 -- POST / 200 264.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,883 mnist_classifier_MNISTClassifier 4u9dktkb 2a943b05-2f65-4812-a5ea-ec013f4f72ad -- POST / 200 263.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,883 mnist_classifier_MNISTClassifier 4u9dktkb 56a9392d-ac97-49fe-b7cd-75b5f901724c -- POST / 200 248.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,884 mnist_classifier_MNISTClassifier 4u9dktkb a799af9d-d090-4423-b95d-fd001d0ff0f9 -- POST / 200 263.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,884 mnist_classifier_MNISTClassifier 4u9dktkb 9d1e97b1-3638-471b-b108-a5a74a985cc5 -- POST / 200 263.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,884 mnist_classifier_MNISTClassifier 4u9dktkb 38a2293b-cc9d-47a1-8985-3543f9f72b15 -- POST / 200 262.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,885 mnist_classifier_MNISTClassifier 4u9dktkb 167dcd5e-52ec-433a-975e-5396e9d0d0dd -- POST / 200 262.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,885 mnist_classifier_MNISTClassifier 4u9dktkb ffa9fba8-7536-45c9-be9b-b96c318ae37a -- POST / 200 262.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,961 mnist_classifier_MNISTClassifier 4u9dktkb 7ee0a9cb-0965-4e4d-95a1-ac8ef63dd99b -- POST / 200 335.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,964 mnist_classifier_MNISTClassifier 4u9dktkb 46b37bd6-151d-492d-bb42-d0ce7c41bb30 -- POST / 200 336.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,965 mnist_classifier_MNISTClassifier 4u9dktkb 365caf6c-8829-4399-8b72-7f3f6f93f7a5 -- POST / 200 336.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,967 mnist_classifier_MNISTClassifier 4u9dktkb 694a459b-61fa-45b9-9d10-ecd4f6874e61 -- POST / 200 333.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,967 mnist_classifier_MNISTClassifier 4u9dktkb 9d34eabc-e491-49f3-862e-a8b4aef70db2 -- POST / 200 332.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,968 mnist_classifier_MNISTClassifier 4u9dktkb 8316316d-f349-4c18-9fff-c95c1fd8d4a3 -- POST / 200 331.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,968 mnist_classifier_MNISTClassifier 4u9dktkb 08d0835a-a7d3-4ae7-b66a-360e06139478 -- POST / 200 331.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,968 mnist_classifier_MNISTClassifier 4u9dktkb 8d11ee9a-e49a-4b9a-9753-46b8c1f0f094 -- POST / 200 323.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,969 mnist_classifier_MNISTClassifier 4u9dktkb d96fc106-d5ad-4f66-895f-060047919c6f -- POST / 200 323.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,970 mnist_classifier_MNISTClassifier 4u9dktkb 7fbaf76c-467c-4612-b4de-a8174b92b7cf -- POST / 200 324.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,970 mnist_classifier_MNISTClassifier 4u9dktkb cda9ca7b-cb23-4df4-8cff-cfac85e0a07a -- POST / 200 321.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,974 mnist_classifier_MNISTClassifier 4u9dktkb 4a3ce9bf-11a9-4b24-bb71-529aff58a8ea -- POST / 200 324.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,977 mnist_classifier_MNISTClassifier 4u9dktkb 2e3ecef1-30b8-4a87-892f-ec68c04f27ed -- POST / 200 248.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,979 mnist_classifier_MNISTClassifier 4u9dktkb 19c4561a-bc0c-4146-bbb9-ef621ee57e32 -- POST / 200 250.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,979 mnist_classifier_MNISTClassifier 4u9dktkb 35bb7f4d-1617-49e5-9072-c1701dc1c491 -- POST / 200 254.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,980 mnist_classifier_MNISTClassifier 4u9dktkb 7c6e4bb1-673b-4113-aa25-371538131452 -- POST / 200 254.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,982 mnist_classifier_MNISTClassifier 4u9dktkb 292db70a-8d0e-49ed-bccd-1bb098df02b0 -- POST / 200 253.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,983 mnist_classifier_MNISTClassifier 4u9dktkb 2b82369d-f900-4d3b-ae1c-98e0a3ffe364 -- POST / 200 254.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,984 mnist_classifier_MNISTClassifier 4u9dktkb 3e80549a-28fe-4b3d-b88c-d8cbef8d8d95 -- POST / 200 254.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,984 mnist_classifier_MNISTClassifier 4u9dktkb fb888508-04f8-4bf4-b927-139019eda69c -- POST / 200 253.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,984 mnist_classifier_MNISTClassifier 4u9dktkb 1331abb1-8618-46e7-a891-3c24ab25b1b9 -- POST / 200 253.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,984 mnist_classifier_MNISTClassifier 4u9dktkb 96ed6c32-b86a-4c46-b117-12863439653e -- POST / 200 251.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,985 mnist_classifier_MNISTClassifier 4u9dktkb db051514-5144-41bd-8d41-ac4a88408d2e -- POST / 200 251.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,985 mnist_classifier_MNISTClassifier 4u9dktkb 52f6ab66-cfba-42a1-9ad8-2f2bb7c2abde -- POST / 200 251.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,985 mnist_classifier_MNISTClassifier 4u9dktkb afc20e7d-9db6-40f1-a78e-21988f0db0a6 -- POST / 200 250.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,986 mnist_classifier_MNISTClassifier 4u9dktkb 4a1c6332-3f6e-4d0f-aa35-cb0db4010662 -- POST / 200 250.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,986 mnist_classifier_MNISTClassifier 4u9dktkb 173adcec-4046-446a-b17f-eeb63b9efe8d -- POST / 200 250.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,988 mnist_classifier_MNISTClassifier 4u9dktkb b66cbfcb-e110-46a9-bde5-b216d92e72cc -- POST / 200 250.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,988 mnist_classifier_MNISTClassifier 4u9dktkb 7a3ed6d3-3b04-43b0-b726-a5b890e6c1d5 -- POST / 200 245.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,989 mnist_classifier_MNISTClassifier 4u9dktkb d27fc5bd-6848-4cda-bc60-23cd81f414c0 -- POST / 200 245.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,989 mnist_classifier_MNISTClassifier 4u9dktkb c85e2b32-09a8-4d22-9f0a-f0a2d2a46f84 -- POST / 200 244.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,990 mnist_classifier_MNISTClassifier 4u9dktkb 1d29eaf7-0aa2-4c92-8d90-f467eac5616e -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,990 mnist_classifier_MNISTClassifier 4u9dktkb b420f0bb-c2cf-485d-83f7-16e7cd57ecf3 -- POST / 200 242.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,990 mnist_classifier_MNISTClassifier 4u9dktkb 8ab4feda-38a9-467a-a9ae-92ac44a100f0 -- POST / 200 242.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,994 mnist_classifier_MNISTClassifier 4u9dktkb e7f633ad-91a5-46de-91e3-98def4bfdfe9 -- POST / 200 244.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,995 mnist_classifier_MNISTClassifier 4u9dktkb 9bc27130-2967-4c5c-bfdd-7ed1b46d60f6 -- POST / 200 245.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:50,996 mnist_classifier_MNISTClassifier 4u9dktkb a9b8bc16-7783-4ce9-afad-146c77b6e916 -- POST / 200 246.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,005 mnist_classifier_MNISTClassifier 4u9dktkb fb4ce065-1935-484f-a363-79521d86957f -- POST / 200 255.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,006 mnist_classifier_MNISTClassifier 4u9dktkb 6b4a5942-9617-4670-9348-294ad2500fa8 -- POST / 200 254.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,006 mnist_classifier_MNISTClassifier 4u9dktkb 9f9151ef-bd9d-4493-b2ec-581f194d4734 -- POST / 200 246.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,006 mnist_classifier_MNISTClassifier 4u9dktkb 95a6580b-46a6-46e4-9f78-0fdd697bfd16 -- POST / 200 245.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,007 mnist_classifier_MNISTClassifier 4u9dktkb f78b4501-93c2-4abe-95ab-eeec7cbfdfe4 -- POST / 200 239.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,007 mnist_classifier_MNISTClassifier 4u9dktkb 379b97ff-49a5-4f7b-88e0-f15ea02ae1e7 -- POST / 200 234.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,008 mnist_classifier_MNISTClassifier 4u9dktkb 38d7b054-12e8-467c-b7b3-b5ab970abfe7 -- POST / 200 233.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,008 mnist_classifier_MNISTClassifier 4u9dktkb f703b154-492d-4b41-96c1-1bea8afecd59 -- POST / 200 223.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,009 mnist_classifier_MNISTClassifier 4u9dktkb ce79fbc3-e3a3-4019-aeec-6a006171cbb1 -- POST / 200 222.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,009 mnist_classifier_MNISTClassifier 4u9dktkb 01fa06ed-190e-4d1b-81c7-c0a96aa8ef5c -- POST / 200 222.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,009 mnist_classifier_MNISTClassifier 4u9dktkb bc368227-74af-47cc-9424-83f6cb35def5 -- POST / 200 222.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,010 mnist_classifier_MNISTClassifier 4u9dktkb 7f751d52-ff80-4925-ba1d-b2c80997007e -- POST / 200 223.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,010 mnist_classifier_MNISTClassifier 4u9dktkb bc5f66bc-f5e9-42b3-b837-55d6ea869964 -- POST / 200 223.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,011 mnist_classifier_MNISTClassifier 4u9dktkb c1212524-9dc7-4efd-b957-e761be72a645 -- POST / 200 223.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,011 mnist_classifier_MNISTClassifier 4u9dktkb 8ddb1fee-3e43-4cae-a6bd-e4d64d0c29d6 -- POST / 200 223.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,268 mnist_classifier_MNISTClassifier 4u9dktkb 0fee00a8-9a0f-4cf6-9a88-401fb0f1e51b -- POST / 200 378.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,268 mnist_classifier_MNISTClassifier 4u9dktkb ac27d778-a471-4ffb-b6b8-cfa6e0030721 -- POST / 200 432.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,269 mnist_classifier_MNISTClassifier 4u9dktkb 41a4fde9-54d1-459b-a8e2-fe9e6dbf2f1a -- POST / 200 429.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,270 mnist_classifier_MNISTClassifier 4u9dktkb 8804864f-223e-4be5-9bd5-ea7f3a3a912e -- POST / 200 382.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,270 mnist_classifier_MNISTClassifier 4u9dktkb 6015e920-c753-437a-96f7-8a97ebadb7c4 -- POST / 200 382.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,270 mnist_classifier_MNISTClassifier 4u9dktkb a1baaeda-fd56-40be-bdc7-e4959edca832 -- POST / 200 382.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,272 mnist_classifier_MNISTClassifier 4u9dktkb 378686e3-a03b-4f42-a2fd-b86d2d371b86 -- POST / 200 383.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,273 mnist_classifier_MNISTClassifier 4u9dktkb 7a052241-e0e6-4e34-a6c3-c2a0006df212 -- POST / 200 384.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,273 mnist_classifier_MNISTClassifier 4u9dktkb 977f8773-a0d2-4bf7-b9e2-7c9b446b1575 -- POST / 200 378.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,273 mnist_classifier_MNISTClassifier 4u9dktkb 898fec5f-6332-414b-82d3-20816dfdc49f -- POST / 200 378.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,274 mnist_classifier_MNISTClassifier 4u9dktkb 6eab0864-37f6-4c12-b753-5ebc47126f7c -- POST / 200 375.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,274 mnist_classifier_MNISTClassifier 4u9dktkb ebe5f18c-de9e-41f7-8865-107b5529d561 -- POST / 200 377.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,276 mnist_classifier_MNISTClassifier 4u9dktkb 85f9996a-2bbe-47ef-9a8f-28b13204233e -- POST / 200 379.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,281 mnist_classifier_MNISTClassifier 4u9dktkb bb795337-6125-4ee0-bb51-ebc56d1a5188 -- POST / 200 383.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,282 mnist_classifier_MNISTClassifier 4u9dktkb b26c2348-aa18-4e3d-9cdb-f688d6963f46 -- POST / 200 384.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,283 mnist_classifier_MNISTClassifier 4u9dktkb f36cd977-3fd7-4d8f-a3bd-5848325fc457 -- POST / 200 382.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,286 mnist_classifier_MNISTClassifier 4u9dktkb aec3f488-eb81-4ff4-b8db-a563e3d7ddad -- POST / 200 385.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,286 mnist_classifier_MNISTClassifier 4u9dktkb ae9bb240-67b9-40ea-9ec8-51f9a11ae5ab -- POST / 200 384.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,287 mnist_classifier_MNISTClassifier 4u9dktkb fb3fdba2-4982-4005-bf0b-46420cc12a6b -- POST / 200 385.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,288 mnist_classifier_MNISTClassifier 4u9dktkb 4c764a14-ca90-4dbd-bc7a-a2ce08114be1 -- POST / 200 386.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,289 mnist_classifier_MNISTClassifier 4u9dktkb c5b51880-e7b9-4ca6-b67a-f11c2237821a -- POST / 200 383.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,289 mnist_classifier_MNISTClassifier 4u9dktkb b1a4158d-29df-431c-b49d-7adfb97b4ac3 -- POST / 200 383.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,290 mnist_classifier_MNISTClassifier 4u9dktkb b7ea3a83-f255-4297-938c-ba9671fafe7a -- POST / 200 386.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,290 mnist_classifier_MNISTClassifier 4u9dktkb 2abb7c96-290f-47da-8bc5-09345884ac4b -- POST / 200 383.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,292 mnist_classifier_MNISTClassifier 4u9dktkb 68b93300-79ca-4e32-b060-47a780bf19f3 -- POST / 200 388.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,292 mnist_classifier_MNISTClassifier 4u9dktkb b7cc8bac-295e-433d-ac80-c4fd83387133 -- POST / 200 383.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,294 mnist_classifier_MNISTClassifier 4u9dktkb a860bbbd-8b39-4752-9efe-364da8997c66 -- POST / 200 385.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,294 mnist_classifier_MNISTClassifier 4u9dktkb d5f14b39-71df-4713-8016-6ae631cc276c -- POST / 200 385.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,295 mnist_classifier_MNISTClassifier 4u9dktkb b8bd6307-1972-4f25-937e-65ba404de7c6 -- POST / 200 386.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,296 mnist_classifier_MNISTClassifier 4u9dktkb 36bec0fc-22ab-4bc8-83fc-ebe8ec308ff3 -- POST / 200 386.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,297 mnist_classifier_MNISTClassifier 4u9dktkb ad912e13-8956-40b0-9e86-e10f489dd823 -- POST / 200 372.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,298 mnist_classifier_MNISTClassifier 4u9dktkb 9d65c7ec-c804-40a2-b29c-7cdf9ad05bc7 -- POST / 200 387.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,375 mnist_classifier_MNISTClassifier 4u9dktkb 62111237-7cd0-466e-89d3-c4ce2ba8d7c0 -- POST / 200 461.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,377 mnist_classifier_MNISTClassifier 4u9dktkb 96bde33c-2b41-4f91-b8cb-f8e30fa28176 -- POST / 200 461.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,378 mnist_classifier_MNISTClassifier 4u9dktkb ea4cd532-03de-4211-b871-0b682eee6249 -- POST / 200 457.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,379 mnist_classifier_MNISTClassifier 4u9dktkb 1995a527-b4a8-41eb-9e06-b823795fd1e0 -- POST / 200 458.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,382 mnist_classifier_MNISTClassifier 4u9dktkb 23d7f69f-373b-40bc-8dd1-c186fe4bc9c1 -- POST / 200 460.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,383 mnist_classifier_MNISTClassifier 4u9dktkb 3fa1c5f9-5d8a-43ba-bcb3-b07ab6fbb2b1 -- POST / 200 460.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,384 mnist_classifier_MNISTClassifier 4u9dktkb 94789836-1457-46db-ae81-7dbe19a2e5a0 -- POST / 200 461.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,386 mnist_classifier_MNISTClassifier 4u9dktkb 8637df5c-d49d-49a8-a059-fa666a01a626 -- POST / 200 461.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,388 mnist_classifier_MNISTClassifier 4u9dktkb aa67399c-af3d-41d7-97e9-f271ec978f79 -- POST / 200 447.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,389 mnist_classifier_MNISTClassifier 4u9dktkb 601436f3-cd8c-4552-8060-4f3a01a5cbd7 -- POST / 200 457.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,390 mnist_classifier_MNISTClassifier 4u9dktkb 795bc5cf-dd37-4251-84df-996d2326f460 -- POST / 200 448.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,390 mnist_classifier_MNISTClassifier 4u9dktkb 24158e7a-630f-4d4a-895c-07405c48a95a -- POST / 200 453.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,391 mnist_classifier_MNISTClassifier 4u9dktkb a2977ce5-5f18-4ec3-a04e-68b62e49d0c0 -- POST / 200 452.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,391 mnist_classifier_MNISTClassifier 4u9dktkb 7ca52835-52a9-48e5-bb23-1c98315eb75d -- POST / 200 450.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,391 mnist_classifier_MNISTClassifier 4u9dktkb 002005be-52a3-4f05-b250-fb1ec93bb65a -- POST / 200 449.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,393 mnist_classifier_MNISTClassifier 4u9dktkb 6fa7e051-d5c9-4992-98d7-1cc3ddc2b33f -- POST / 200 451.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,493 mnist_classifier_MNISTClassifier 4u9dktkb 0d9c4cba-a16e-4ddd-a0f8-76f9feb509fd -- POST / 200 473.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,494 mnist_classifier_MNISTClassifier 4u9dktkb a5814231-b7f2-4561-8342-d99031892092 -- POST / 200 481.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,494 mnist_classifier_MNISTClassifier 4u9dktkb 5a126b55-a895-450a-bdba-257a25579f11 -- POST / 200 480.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,495 mnist_classifier_MNISTClassifier 4u9dktkb 5a1fdb01-ff5d-4079-b897-d4ff0bf13bbd -- POST / 200 480.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,496 mnist_classifier_MNISTClassifier 4u9dktkb f41f0464-0920-4e68-988d-70364ff380d4 -- POST / 200 476.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,496 mnist_classifier_MNISTClassifier 4u9dktkb 698d43ba-0ac4-4671-b9cc-3d0d7f0f93a1 -- POST / 200 475.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,497 mnist_classifier_MNISTClassifier 4u9dktkb 225638cd-5ce7-4ec2-a4be-a17fb201a06a -- POST / 200 475.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,498 mnist_classifier_MNISTClassifier 4u9dktkb 3b882093-446b-4875-9725-b757add12598 -- POST / 200 476.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,498 mnist_classifier_MNISTClassifier 4u9dktkb 7f12a8e3-fa29-4a59-929a-ad5178b13400 -- POST / 200 471.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,499 mnist_classifier_MNISTClassifier 4u9dktkb e67a1d9d-44e1-4a08-9b0c-dd264ec102c1 -- POST / 200 471.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,501 mnist_classifier_MNISTClassifier 4u9dktkb 482f01ac-1631-4be3-9548-833afbd8a2c0 -- POST / 200 472.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,501 mnist_classifier_MNISTClassifier 4u9dktkb 6f01f239-fa5c-4bc0-9679-716e32e83148 -- POST / 200 472.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,501 mnist_classifier_MNISTClassifier 4u9dktkb 87e50830-d59a-4162-9f22-e2dae0ff7df6 -- POST / 200 465.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,502 mnist_classifier_MNISTClassifier 4u9dktkb ba445fa4-a6d5-46e8-b161-0497b217a7f6 -- POST / 200 464.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,503 mnist_classifier_MNISTClassifier 4u9dktkb 9ab3a0ec-812c-4a37-bf26-b89d4251fb32 -- POST / 200 463.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,503 mnist_classifier_MNISTClassifier 4u9dktkb f030d5a1-34ad-489a-915e-52503de8b7be -- POST / 200 463.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,504 mnist_classifier_MNISTClassifier 4u9dktkb bdd73e80-a160-4fad-9174-011bae3a0185 -- POST / 200 462.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,504 mnist_classifier_MNISTClassifier 4u9dktkb 3f66d8a9-7cbb-49d7-b193-24ea7662f699 -- POST / 200 462.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,505 mnist_classifier_MNISTClassifier 4u9dktkb ee1cf17a-edd5-4743-9f31-7d86a981bf4c -- POST / 200 458.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,505 mnist_classifier_MNISTClassifier 4u9dktkb 8cb30ef5-8b13-4979-8457-f6d2815d3890 -- POST / 200 458.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,505 mnist_classifier_MNISTClassifier 4u9dktkb acb56bc7-f978-4f3a-9ddb-746c237ccfe2 -- POST / 200 449.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,506 mnist_classifier_MNISTClassifier 4u9dktkb bf0d3832-4287-40e5-8e9c-5155e776cc58 -- POST / 200 449.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,506 mnist_classifier_MNISTClassifier 4u9dktkb c577e08a-f530-4ba5-b3a0-149e61282f08 -- POST / 200 447.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,506 mnist_classifier_MNISTClassifier 4u9dktkb 8defff16-1a69-4fa0-91ae-f91dfc999192 -- POST / 200 445.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,506 mnist_classifier_MNISTClassifier 4u9dktkb 812243d8-2a4d-4af9-9281-41b2df0c113a -- POST / 200 438.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,506 mnist_classifier_MNISTClassifier 4u9dktkb 23088ce5-4241-45c1-82f4-bd95114b6c53 -- POST / 200 437.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,507 mnist_classifier_MNISTClassifier 4u9dktkb f8c36e2c-ade5-467f-aaa5-df24c3bdad05 -- POST / 200 435.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,507 mnist_classifier_MNISTClassifier 4u9dktkb edfce2fb-f944-4a4c-be91-441942ed3b66 -- POST / 200 433.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,507 mnist_classifier_MNISTClassifier 4u9dktkb 18e792f1-9f83-457a-b339-5d3044ff3966 -- POST / 200 433.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,507 mnist_classifier_MNISTClassifier 4u9dktkb 5bd68152-9682-465a-b54a-c1c0348addf9 -- POST / 200 432.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,508 mnist_classifier_MNISTClassifier 4u9dktkb bc9eaa2b-31af-4f35-9f75-abe03b496b73 -- POST / 200 430.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,508 mnist_classifier_MNISTClassifier 4u9dktkb bd751ac2-6dbc-4dcb-87d3-644ae9b93c93 -- POST / 200 430.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,509 mnist_classifier_MNISTClassifier 4u9dktkb b9d7b92d-2d3a-4636-a289-c7cf0b74d734 -- POST / 200 430.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,509 mnist_classifier_MNISTClassifier 4u9dktkb 772ffde1-436a-4166-90d2-77a59ea258e3 -- POST / 200 430.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,509 mnist_classifier_MNISTClassifier 4u9dktkb 7820142b-bd38-4576-852d-631f15fc0fa2 -- POST / 200 425.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,509 mnist_classifier_MNISTClassifier 4u9dktkb 4de43d56-a483-4397-a388-9c8071f8eaeb -- POST / 200 429.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,510 mnist_classifier_MNISTClassifier 4u9dktkb 356b9dbe-0dc2-4757-b40e-ca653c06654a -- POST / 200 428.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,510 mnist_classifier_MNISTClassifier 4u9dktkb 66e32a03-e720-4ca5-a5c3-1db5099352dd -- POST / 200 424.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,511 mnist_classifier_MNISTClassifier 4u9dktkb 5d6439fb-a111-44bc-aeca-7b667f86ef77 -- POST / 200 425.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,511 mnist_classifier_MNISTClassifier 4u9dktkb 64140272-b755-41f5-81df-243dca54bedd -- POST / 200 425.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,511 mnist_classifier_MNISTClassifier 4u9dktkb bc34e9a6-4887-4a6f-babe-09076d62e1e9 -- POST / 200 425.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,512 mnist_classifier_MNISTClassifier 4u9dktkb 746be8c1-84e8-442f-89a0-b2de5f16a9be -- POST / 200 424.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,512 mnist_classifier_MNISTClassifier 4u9dktkb 0ba7ad77-23f0-4c0a-b6cf-59158f8b57de -- POST / 200 425.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,513 mnist_classifier_MNISTClassifier 4u9dktkb c1200fd2-156e-418a-a3fd-72e41821ab16 -- POST / 200 424.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,513 mnist_classifier_MNISTClassifier 4u9dktkb b0d6cc6b-2904-4cca-9929-d9d5fef0ff81 -- POST / 200 420.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,513 mnist_classifier_MNISTClassifier 4u9dktkb c8d85bc4-7998-411a-856b-ae9efc1fdcfb -- POST / 200 417.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,513 mnist_classifier_MNISTClassifier 4u9dktkb 9e045f25-a104-4cdd-ac74-bab87664b509 -- POST / 200 417.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,514 mnist_classifier_MNISTClassifier 4u9dktkb 983e8b4e-4a53-42b9-affe-e3232d760bac -- POST / 200 415.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,515 mnist_classifier_MNISTClassifier 4u9dktkb eabfe42d-d385-4e93-996b-609c3f876e90 -- POST / 200 418.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,523 mnist_classifier_MNISTClassifier 4u9dktkb 5b57df06-db2c-4000-b4e1-da6b31ee0687 -- POST / 200 423.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,525 mnist_classifier_MNISTClassifier 4u9dktkb fc3ce319-16ac-4af3-899c-349cd6df0369 -- POST / 200 427.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,526 mnist_classifier_MNISTClassifier 4u9dktkb 7791095a-6678-48ad-8e57-24a7a1925382 -- POST / 200 425.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,526 mnist_classifier_MNISTClassifier 4u9dktkb d6f01e07-1883-44ac-be4b-81214990c718 -- POST / 200 265.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,526 mnist_classifier_MNISTClassifier 4u9dktkb a36bda6e-f3cf-4b0c-b68d-cbd31e845d76 -- POST / 200 264.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,527 mnist_classifier_MNISTClassifier 4u9dktkb 95a4536a-9882-4fe8-93cd-3d07c887b0e0 -- POST / 200 265.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,527 mnist_classifier_MNISTClassifier 4u9dktkb 39d588dd-949d-453a-b852-89550b2f8dd1 -- POST / 200 227.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,528 mnist_classifier_MNISTClassifier 4u9dktkb af6552f3-9032-417b-947a-02dff35e779c -- POST / 200 219.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,528 mnist_classifier_MNISTClassifier 4u9dktkb 17b9c462-7fd2-4ac5-8027-093048879000 -- POST / 200 217.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,529 mnist_classifier_MNISTClassifier 4u9dktkb b9fe8a5c-3ac2-4864-8bc5-70ed2cdb9f3a -- POST / 200 217.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,529 mnist_classifier_MNISTClassifier 4u9dktkb 8276c54b-592b-4858-97cf-c26d6836c005 -- POST / 200 200.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,529 mnist_classifier_MNISTClassifier 4u9dktkb f6024c60-97a6-4f26-b382-7a9a68ba8299 -- POST / 200 217.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,530 mnist_classifier_MNISTClassifier 4u9dktkb 15ae3f57-f209-4cc9-a191-fb349887b08a -- POST / 200 201.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,530 mnist_classifier_MNISTClassifier 4u9dktkb 7c8ce5a8-8ce4-4d8c-8906-ec2f1c6d4905 -- POST / 200 200.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,530 mnist_classifier_MNISTClassifier 4u9dktkb ed81de67-5557-405d-b734-d7301d2d94f8 -- POST / 200 199.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,531 mnist_classifier_MNISTClassifier 4u9dktkb 7fcee227-d171-497c-8e04-d7bae22f608d -- POST / 200 199.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,531 mnist_classifier_MNISTClassifier 4u9dktkb 93e4b845-765a-4c8d-8c7c-0f1df700bdd8 -- POST / 200 200.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,532 mnist_classifier_MNISTClassifier 4u9dktkb 039fbab6-a246-41d8-bedb-f7c773c49622 -- POST / 200 200.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,532 mnist_classifier_MNISTClassifier 4u9dktkb 449ef6c0-cc73-4ab9-82c5-a8e8966f3822 -- POST / 200 200.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,532 mnist_classifier_MNISTClassifier 4u9dktkb ea7b9e52-a71e-4497-a1e9-99ee5eae95e1 -- POST / 200 199.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,532 mnist_classifier_MNISTClassifier 4u9dktkb cefc77c8-b413-404b-aa9e-a96d83634ab0 -- POST / 200 196.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,533 mnist_classifier_MNISTClassifier 4u9dktkb 7b265349-0161-4abc-a32b-426b5378df75 -- POST / 200 197.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,533 mnist_classifier_MNISTClassifier 4u9dktkb 947bdd6e-76a9-4413-8a32-6e4f6b6c4265 -- POST / 200 196.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,533 mnist_classifier_MNISTClassifier 4u9dktkb d7288c28-0057-4ec2-8569-aa554a5b0d18 -- POST / 200 196.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,533 mnist_classifier_MNISTClassifier 4u9dktkb 36f0f239-2b54-4f97-88bb-6add87e8af1e -- POST / 200 193.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,533 mnist_classifier_MNISTClassifier 4u9dktkb 3c22e0a1-52e2-403e-9bf9-b552382fab3a -- POST / 200 191.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,533 mnist_classifier_MNISTClassifier 4u9dktkb 7a3c0149-b30e-4d78-aa58-2a7c0178e11a -- POST / 200 193.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,534 mnist_classifier_MNISTClassifier 4u9dktkb bcb5b24a-3c83-4932-8824-672816f24178 -- POST / 200 193.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,534 mnist_classifier_MNISTClassifier 4u9dktkb 8b6f9b23-41b1-470d-8a78-d95585b985e0 -- POST / 200 191.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,534 mnist_classifier_MNISTClassifier 4u9dktkb 16872991-60b3-42aa-af3b-9d40cfd18e88 -- POST / 200 192.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,534 mnist_classifier_MNISTClassifier 4u9dktkb 50c605fc-1ca6-481a-8fb7-420a76a864c2 -- POST / 200 191.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,534 mnist_classifier_MNISTClassifier 4u9dktkb 7c8bef27-e4ed-4643-b6a8-0338ee6bc3cc -- POST / 200 189.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,534 mnist_classifier_MNISTClassifier 4u9dktkb 408f6d1a-c89b-43a0-8114-b568db40ec12 -- POST / 200 189.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,535 mnist_classifier_MNISTClassifier 4u9dktkb f0ae4ac0-e940-43ea-8a33-d6e86b8bdfa5 -- POST / 200 191.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,535 mnist_classifier_MNISTClassifier 4u9dktkb 1ad0f50c-b865-4ee6-9281-f776a258590a -- POST / 200 188.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,535 mnist_classifier_MNISTClassifier 4u9dktkb d773c2c2-0223-4a6b-a55f-c9c3a81135ff -- POST / 200 142.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,544 mnist_classifier_MNISTClassifier 4u9dktkb 0c535223-17a4-4299-bc67-873270dd9afe -- POST / 200 147.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,544 mnist_classifier_MNISTClassifier 4u9dktkb 14ffcaa1-6a51-4454-b99e-af7f8f17b8f2 -- POST / 200 137.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,544 mnist_classifier_MNISTClassifier 4u9dktkb f5a2b9ad-3aa0-445f-8a42-f7acc6bfce08 -- POST / 200 131.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,544 mnist_classifier_MNISTClassifier 4u9dktkb 4a75d33a-6d45-4403-8a37-520f724dcfb6 -- POST / 200 131.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,544 mnist_classifier_MNISTClassifier 4u9dktkb c477c2df-9420-493f-8a5b-4f73ac02b0f8 -- POST / 200 126.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,544 mnist_classifier_MNISTClassifier 4u9dktkb 1e470fa8-a64d-411b-b171-5f677e768db0 -- POST / 200 129.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,545 mnist_classifier_MNISTClassifier 4u9dktkb d486a32e-1acc-4e2d-973f-153fdf4914f2 -- POST / 200 124.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,545 mnist_classifier_MNISTClassifier 4u9dktkb fb493b93-52c0-4729-afa0-e849d839f8df -- POST / 200 126.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,545 mnist_classifier_MNISTClassifier 4u9dktkb 5ea1ad7d-91ed-41db-aa6a-b84a7a798e7e -- POST / 200 123.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,545 mnist_classifier_MNISTClassifier 4u9dktkb 0272e8f3-54ad-4e1b-a327-0062a990ea96 -- POST / 200 123.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,545 mnist_classifier_MNISTClassifier 4u9dktkb 9e5b961a-1fa9-46df-8fba-b84ab7208119 -- POST / 200 123.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,546 mnist_classifier_MNISTClassifier 4u9dktkb 1f13e5bc-a450-4ea8-82b4-5b620f4f6506 -- POST / 200 122.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,546 mnist_classifier_MNISTClassifier 4u9dktkb ab42788c-7ca9-4c89-9d7c-4eb2bf0ecfef -- POST / 200 119.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,546 mnist_classifier_MNISTClassifier 4u9dktkb 59eb4d1c-83f1-4f0d-b0c3-fc4d086d7974 -- POST / 200 121.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,546 mnist_classifier_MNISTClassifier 4u9dktkb 70aaaca7-04a5-4d09-8953-e44928345b46 -- POST / 200 120.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,756 mnist_classifier_MNISTClassifier 4u9dktkb 86aed0a8-5b21-4d79-835d-a48a623dadc9 -- POST / 200 241.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,758 mnist_classifier_MNISTClassifier 4u9dktkb d2e32216-bb72-4013-a652-2eabb3005cc6 -- POST / 200 210.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,758 mnist_classifier_MNISTClassifier 4u9dktkb 88482ab9-e964-49f9-a3dc-e73c66b954fe -- POST / 200 210.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,758 mnist_classifier_MNISTClassifier 4u9dktkb 923e7e23-c151-45dc-9373-4266832fd20f -- POST / 200 209.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,759 mnist_classifier_MNISTClassifier 4u9dktkb 6b20abbf-4932-456e-a5fc-e7d46637f391 -- POST / 200 205.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,761 mnist_classifier_MNISTClassifier 4u9dktkb babe4751-5404-4bbc-8914-033f393bffd1 -- POST / 200 198.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,762 mnist_classifier_MNISTClassifier 4u9dktkb a61214eb-cac4-4f62-9074-832aa9a964c8 -- POST / 200 198.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,763 mnist_classifier_MNISTClassifier 4u9dktkb ddae6ed7-d9c7-4db5-9dd4-0ac3d3ec52db -- POST / 200 204.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,763 mnist_classifier_MNISTClassifier 4u9dktkb bba9da5e-2170-4773-9d9e-5cd1bf7143ed -- POST / 200 203.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,763 mnist_classifier_MNISTClassifier 4u9dktkb b647ccf2-6f58-4447-826c-9a6beedbcd6a -- POST / 200 203.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,878 mnist_classifier_MNISTClassifier 4u9dktkb 2312a6f0-5e87-449a-ab98-2baeadaaa634 -- POST / 200 316.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,879 mnist_classifier_MNISTClassifier 4u9dktkb 07345bce-93da-4828-90a5-122b4df6f62f -- POST / 200 316.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,879 mnist_classifier_MNISTClassifier 4u9dktkb 759d925e-00db-4508-978f-f5c07234d6d4 -- POST / 200 314.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,880 mnist_classifier_MNISTClassifier 4u9dktkb 6789484b-e78e-45b1-9bd6-3b9e279193fe -- POST / 200 315.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,880 mnist_classifier_MNISTClassifier 4u9dktkb f5ea5a02-cf84-4cc1-87b9-d03129c1eee7 -- POST / 200 312.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,881 mnist_classifier_MNISTClassifier 4u9dktkb bb4d1434-6313-493b-9b6a-b044dbc9ef10 -- POST / 200 310.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,881 mnist_classifier_MNISTClassifier 4u9dktkb dbe101c3-6b5b-43ff-80e0-6268ae979eed -- POST / 200 310.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,881 mnist_classifier_MNISTClassifier 4u9dktkb c1254e0a-1352-41f9-ade9-59e7dd9b6bb2 -- POST / 200 307.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,882 mnist_classifier_MNISTClassifier 4u9dktkb 156c81d4-22c9-4222-bcfc-1e865a9becb5 -- POST / 200 294.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,883 mnist_classifier_MNISTClassifier 4u9dktkb 1de73726-f49f-49f3-b330-09e040c71c0f -- POST / 200 292.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,883 mnist_classifier_MNISTClassifier 4u9dktkb bbfec749-f053-45ba-8c8b-50c45b2e3a83 -- POST / 200 291.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,883 mnist_classifier_MNISTClassifier 4u9dktkb b38a042f-bae4-4574-a4f2-cd7d5535774c -- POST / 200 290.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,884 mnist_classifier_MNISTClassifier 4u9dktkb 6ae647aa-6a7b-46a6-9026-a342ff227a16 -- POST / 200 288.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,884 mnist_classifier_MNISTClassifier 4u9dktkb 20b72955-cff0-45e3-93ff-a0a3e5951417 -- POST / 200 285.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,888 mnist_classifier_MNISTClassifier 4u9dktkb 9491f971-601a-481f-849d-4cb82b8e5211 -- POST / 200 283.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,888 mnist_classifier_MNISTClassifier 4u9dktkb 5ec0f7be-372e-46a0-96c7-e9d47ca8398d -- POST / 200 287.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,889 mnist_classifier_MNISTClassifier 4u9dktkb 2526f250-464b-4b2f-9e38-80ae31e6b1ef -- POST / 200 283.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,889 mnist_classifier_MNISTClassifier 4u9dktkb a76bb100-d2d6-457c-8dd1-eb8241126f25 -- POST / 200 282.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,890 mnist_classifier_MNISTClassifier 4u9dktkb 1679d415-0c64-4a66-bc24-c7590d0014f9 -- POST / 200 281.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,890 mnist_classifier_MNISTClassifier 4u9dktkb b9c56ecd-5c0a-4096-aaf4-70f51abf3d45 -- POST / 200 288.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,890 mnist_classifier_MNISTClassifier 4u9dktkb f8985c73-846e-470b-b1fd-bc674be11791 -- POST / 200 281.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,890 mnist_classifier_MNISTClassifier 4u9dktkb df7425cc-c992-4dda-9aa2-72bc871ab53a -- POST / 200 279.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,891 mnist_classifier_MNISTClassifier 4u9dktkb 7f55a526-8b32-4494-8111-d5fe635f1ab1 -- POST / 200 268.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,891 mnist_classifier_MNISTClassifier 4u9dktkb 5c912f16-2ac3-41a4-ae83-70e16c1af59b -- POST / 200 281.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,891 mnist_classifier_MNISTClassifier 4u9dktkb fbd27b8f-3245-476b-9ed3-1205001afae9 -- POST / 200 268.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,891 mnist_classifier_MNISTClassifier 4u9dktkb 8457e16e-1908-4626-8642-768e646c4a8e -- POST / 200 266.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,891 mnist_classifier_MNISTClassifier 4u9dktkb 6024924c-4922-447a-b918-f593ea773137 -- POST / 200 244.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,892 mnist_classifier_MNISTClassifier 4u9dktkb c45f016d-5b7e-4248-a218-00621896afec -- POST / 200 246.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,892 mnist_classifier_MNISTClassifier 4u9dktkb 617c2aa8-4e8d-485a-934e-4a29c0b4ca6d -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,892 mnist_classifier_MNISTClassifier 4u9dktkb 1a1af11d-c74e-466f-84b4-2435764e9281 -- POST / 200 256.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,892 mnist_classifier_MNISTClassifier 4u9dktkb 1a056cfa-7188-4db6-9227-d9a125aa394f -- POST / 200 255.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,894 mnist_classifier_MNISTClassifier 4u9dktkb 0033b17d-812e-4a03-99ff-76ffec70045f -- POST / 200 254.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,894 mnist_classifier_MNISTClassifier 4u9dktkb d776218a-b2af-42fa-b55c-ce579c27348d -- POST / 200 250.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,895 mnist_classifier_MNISTClassifier 4u9dktkb 7b31f5eb-73f0-4fe0-871a-84b4a0519241 -- POST / 200 247.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,897 mnist_classifier_MNISTClassifier 4u9dktkb 99f93242-5f08-4bea-9da1-bebce6d123c6 -- POST / 200 251.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,898 mnist_classifier_MNISTClassifier 4u9dktkb 45da9bcc-5e33-4f9f-abbe-55693997ed72 -- POST / 200 251.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,899 mnist_classifier_MNISTClassifier 4u9dktkb 2ff0f38e-4929-4188-b395-4317c8ab3dca -- POST / 200 250.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,900 mnist_classifier_MNISTClassifier 4u9dktkb 1304bc98-9982-4059-b7c8-f0b3c4aeacae -- POST / 200 244.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,900 mnist_classifier_MNISTClassifier 4u9dktkb fcb4c52a-bf4c-4edd-a57f-c8a54620ec50 -- POST / 200 240.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,900 mnist_classifier_MNISTClassifier 4u9dktkb 84726186-3a37-4ae7-94fb-7c39e95bee03 -- POST / 200 240.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,901 mnist_classifier_MNISTClassifier 4u9dktkb 7425aca8-9451-4e48-b369-d4d570852044 -- POST / 200 239.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,901 mnist_classifier_MNISTClassifier 4u9dktkb 89c87c2c-b69b-45a9-bf6d-fd66a83bce96 -- POST / 200 239.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,902 mnist_classifier_MNISTClassifier 4u9dktkb f720b48d-21f8-4925-8e0f-d99a1ac4f6d7 -- POST / 200 237.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,903 mnist_classifier_MNISTClassifier 4u9dktkb b8db4c1c-5f93-4023-82ab-253b0fa6d1ac -- POST / 200 238.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,903 mnist_classifier_MNISTClassifier 4u9dktkb 63bd72f9-c45f-4012-a4b8-76e878e052fb -- POST / 200 237.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,904 mnist_classifier_MNISTClassifier 4u9dktkb 24a49419-4deb-4a3a-8163-eba16aa34e1d -- POST / 200 211.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,919 mnist_classifier_MNISTClassifier 4u9dktkb 446aaa67-d180-410a-b783-4c4eec07b191 -- POST / 200 223.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,919 mnist_classifier_MNISTClassifier 4u9dktkb 590cf585-eae7-4f13-a26b-e4a1590342d3 -- POST / 200 253.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,920 mnist_classifier_MNISTClassifier 4u9dktkb efe7dcb6-bb10-4c93-8e21-49c5dc126954 -- POST / 200 254.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,920 mnist_classifier_MNISTClassifier 4u9dktkb 4a856b96-9a50-4846-9836-c5ffdab81160 -- POST / 200 253.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,920 mnist_classifier_MNISTClassifier 4u9dktkb b1752d9e-6911-4da6-b695-dc5c49c8cde0 -- POST / 200 254.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,921 mnist_classifier_MNISTClassifier 4u9dktkb 8c8a425e-bb18-428a-9e53-1c3f43ac7147 -- POST / 200 252.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,921 mnist_classifier_MNISTClassifier 4u9dktkb 01c6084c-8954-4424-9bd3-f2943b11e440 -- POST / 200 249.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,921 mnist_classifier_MNISTClassifier 4u9dktkb b56445b8-983c-40a6-8196-31222a1f79b5 -- POST / 200 248.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,922 mnist_classifier_MNISTClassifier 4u9dktkb f4b7dbf5-15ff-42a7-b321-12df55fdc4ad -- POST / 200 246.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,922 mnist_classifier_MNISTClassifier 4u9dktkb cb3f3eb5-1f41-4532-927a-02a41dd1e6bc -- POST / 200 244.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,922 mnist_classifier_MNISTClassifier 4u9dktkb 0d0c7451-30d8-4ee2-adc4-c544dcf57690 -- POST / 200 244.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,923 mnist_classifier_MNISTClassifier 4u9dktkb 4ed74dad-a5eb-4382-b764-1ac9446f0d21 -- POST / 200 244.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,923 mnist_classifier_MNISTClassifier 4u9dktkb 333bf04e-31b3-4f36-8ad7-369e88e5becc -- POST / 200 242.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,923 mnist_classifier_MNISTClassifier 4u9dktkb a4fc550c-738b-447e-b39c-961a4d74c68e -- POST / 200 242.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,923 mnist_classifier_MNISTClassifier 4u9dktkb eee3bc75-0c13-4626-b7bf-3808a2c85cf7 -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,924 mnist_classifier_MNISTClassifier 4u9dktkb 15181712-4104-4f14-bc5e-8f595a46ebb1 -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,924 mnist_classifier_MNISTClassifier 4u9dktkb b6efd01f-7c4e-4ef3-902a-1a904faeb5d4 -- POST / 200 242.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,924 mnist_classifier_MNISTClassifier 4u9dktkb 7e9b856a-413d-41ac-87b5-53f17b258763 -- POST / 200 241.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,924 mnist_classifier_MNISTClassifier 4u9dktkb 4aed371d-213a-4bb5-810d-c487e888c972 -- POST / 200 240.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,925 mnist_classifier_MNISTClassifier 4u9dktkb b2ab1414-2093-453a-b870-b84e7ccc170a -- POST / 200 236.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,925 mnist_classifier_MNISTClassifier 4u9dktkb 2ffdcefe-4703-4f82-bf09-d129a5c96068 -- POST / 200 234.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,925 mnist_classifier_MNISTClassifier 4u9dktkb 44f6871f-610c-46da-a661-8572c20f2bfc -- POST / 200 232.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,925 mnist_classifier_MNISTClassifier 4u9dktkb 79099a9b-a361-4ef9-8729-c06346927e00 -- POST / 200 232.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,926 mnist_classifier_MNISTClassifier 4u9dktkb 6638e3f3-693b-4a82-83fe-44fc7831eb04 -- POST / 200 232.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,926 mnist_classifier_MNISTClassifier 4u9dktkb e9f34d98-d9af-44e2-99cb-16161f8d65f3 -- POST / 200 230.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,926 mnist_classifier_MNISTClassifier 4u9dktkb ac758d49-4045-4883-9e30-554ee4df13a7 -- POST / 200 230.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,927 mnist_classifier_MNISTClassifier 4u9dktkb c21d8bde-1952-4f0f-9161-a8f1d54ca561 -- POST / 200 230.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,927 mnist_classifier_MNISTClassifier 4u9dktkb 521cb3cc-4f04-4c85-911a-b24a8fb5f341 -- POST / 200 228.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,929 mnist_classifier_MNISTClassifier 4u9dktkb 3c425126-a46e-4a06-9934-a2f79821b1a2 -- POST / 200 230.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,929 mnist_classifier_MNISTClassifier 4u9dktkb c837a14d-7888-48e0-ba27-329b7652f46c -- POST / 200 230.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,929 mnist_classifier_MNISTClassifier 4u9dktkb d7e3bd40-273a-409c-91de-5817d0b811a7 -- POST / 200 229.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,929 mnist_classifier_MNISTClassifier 4u9dktkb d4d836ff-05c2-4deb-980d-8d0ec8edf6d1 -- POST / 200 229.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,929 mnist_classifier_MNISTClassifier 4u9dktkb a3469308-3ea3-4082-8b62-901f14cb4a58 -- POST / 200 229.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,929 mnist_classifier_MNISTClassifier 4u9dktkb 93515339-2da4-4675-812b-10fe1d784c80 -- POST / 200 228.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,930 mnist_classifier_MNISTClassifier 4u9dktkb 9ab75f56-9174-4bff-8949-972d162cda41 -- POST / 200 228.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,930 mnist_classifier_MNISTClassifier 4u9dktkb ad22c112-8a3a-4c47-9fbd-c1e46d400728 -- POST / 200 228.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,931 mnist_classifier_MNISTClassifier 4u9dktkb 7f574ec2-a493-48e9-b9e0-d1f3da529a20 -- POST / 200 228.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,931 mnist_classifier_MNISTClassifier 4u9dktkb 4e2e44e8-a378-4714-aab0-a2c86c54cb5b -- POST / 200 227.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,931 mnist_classifier_MNISTClassifier 4u9dktkb b9921bb2-5b61-4c72-a265-e2e459560bb1 -- POST / 200 215.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,931 mnist_classifier_MNISTClassifier 4u9dktkb e8e9e226-1c6f-438b-bdda-dde66ab2c0d5 -- POST / 200 212.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,931 mnist_classifier_MNISTClassifier 4u9dktkb c0ddc76b-f1b0-454d-bd7d-4a3cf8c794f0 -- POST / 200 212.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,931 mnist_classifier_MNISTClassifier 4u9dktkb b727180e-f577-48ad-af24-31ba02beb03c -- POST / 200 211.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,932 mnist_classifier_MNISTClassifier 4u9dktkb e8875f62-de82-4941-ab02-6987a8b283d2 -- POST / 200 210.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,932 mnist_classifier_MNISTClassifier 4u9dktkb 7807e8f5-5f76-4b88-8bd3-88d2672bf3ff -- POST / 200 210.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,932 mnist_classifier_MNISTClassifier 4u9dktkb f935e872-b62d-4603-965c-d69d7969142b -- POST / 200 162.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,932 mnist_classifier_MNISTClassifier 4u9dktkb 5466a932-85e1-4c29-ae0f-2fde456d28ec -- POST / 200 160.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,933 mnist_classifier_MNISTClassifier 4u9dktkb cefa8cec-7248-4583-aa2a-dd45db47b397 -- POST / 200 159.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,933 mnist_classifier_MNISTClassifier 4u9dktkb 875e111a-3c08-45e9-b908-f8cc93ef43e3 -- POST / 200 154.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,933 mnist_classifier_MNISTClassifier 4u9dktkb cd27de12-b76c-4908-9b6a-3548dc73ac32 -- POST / 200 154.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,933 mnist_classifier_MNISTClassifier 4u9dktkb 54f7612a-923c-43f7-a176-0dcd338092ff -- POST / 200 154.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,933 mnist_classifier_MNISTClassifier 4u9dktkb 1653b576-6cc7-4dc6-9c30-5fa021da5fdd -- POST / 200 154.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,937 mnist_classifier_MNISTClassifier 4u9dktkb 365d8d84-e602-427b-b5c2-c43dd6cb58e0 -- POST / 200 157.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,940 mnist_classifier_MNISTClassifier 4u9dktkb edcfcf23-acf6-4309-a071-bb6211a3aa77 -- POST / 200 160.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:51,944 mnist_classifier_MNISTClassifier 4u9dktkb 975200e9-bda7-49a5-b64d-e5c1b35aa44b -- POST / 200 163.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,219 mnist_classifier_MNISTClassifier 4u9dktkb 1a708d95-e7f3-4617-aeb0-9202dba41d4f -- POST / 200 326.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,220 mnist_classifier_MNISTClassifier 4u9dktkb 45bddefb-487f-4c9f-adeb-3ef596e99429 -- POST / 200 326.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,222 mnist_classifier_MNISTClassifier 4u9dktkb 172bcb14-cd84-491d-907a-2f5823c4d1d9 -- POST / 200 276.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,222 mnist_classifier_MNISTClassifier 4u9dktkb f015b6a0-6e39-475c-a064-cd37ca584cb9 -- POST / 200 276.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,223 mnist_classifier_MNISTClassifier 4u9dktkb ef23d721-a72f-4379-868d-657b2eb9ef63 -- POST / 200 276.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,223 mnist_classifier_MNISTClassifier 4u9dktkb e0db00f1-1348-46fa-8386-17006d12fa04 -- POST / 200 269.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,223 mnist_classifier_MNISTClassifier 4u9dktkb b3d399aa-0f59-4af3-8b54-5405f8cdd17a -- POST / 200 266.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,223 mnist_classifier_MNISTClassifier 4u9dktkb 371ec802-4b48-41fd-a022-924ca5d411ba -- POST / 200 255.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,224 mnist_classifier_MNISTClassifier 4u9dktkb 193531f1-5747-4640-bd8f-bd203d60d833 -- POST / 200 266.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,224 mnist_classifier_MNISTClassifier 4u9dktkb c997c151-8b7c-416d-9f3e-312937f5edb4 -- POST / 200 265.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,224 mnist_classifier_MNISTClassifier 4u9dktkb 807eb313-60f9-4b0e-87d8-682c1580c747 -- POST / 200 265.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,226 mnist_classifier_MNISTClassifier 4u9dktkb 2e99114b-b89c-4478-87f9-61bf99f115ca -- POST / 200 266.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,228 mnist_classifier_MNISTClassifier 4u9dktkb 5819d91a-46f6-4b0a-a769-63fb547946b1 -- POST / 200 266.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,228 mnist_classifier_MNISTClassifier 4u9dktkb 93371e04-0d6a-476d-a743-f5000ee33c1c -- POST / 200 263.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,228 mnist_classifier_MNISTClassifier 4u9dktkb d595e3aa-615d-4326-87ba-3a1c1bac851e -- POST / 200 261.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,230 mnist_classifier_MNISTClassifier 4u9dktkb 07e40c93-b7ae-4845-9f35-f4bdbf10def6 -- POST / 200 262.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,237 mnist_classifier_MNISTClassifier 4u9dktkb 4bb22657-d7e4-4724-a8f1-419b7b9edb40 -- POST / 200 268.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,237 mnist_classifier_MNISTClassifier 4u9dktkb 81a9f4b2-02d5-4512-9942-e8fa8d475973 -- POST / 200 268.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,325 mnist_classifier_MNISTClassifier 4u9dktkb bec30709-a0b8-411f-8326-a65b0b16481c -- POST / 200 355.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,325 mnist_classifier_MNISTClassifier 4u9dktkb 487fc05d-e5f8-4114-bf38-65a53f5752d3 -- POST / 200 355.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,326 mnist_classifier_MNISTClassifier 4u9dktkb 4880cd42-10b0-4083-8a23-d922d3a3d3d6 -- POST / 200 353.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,327 mnist_classifier_MNISTClassifier 4u9dktkb dbe3b8bb-744d-4544-9866-bbcf449fa072 -- POST / 200 352.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,328 mnist_classifier_MNISTClassifier 4u9dktkb 2cb2de56-06ea-408e-8d44-614086cc288e -- POST / 200 355.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,328 mnist_classifier_MNISTClassifier 4u9dktkb d82037e1-9a9b-41dd-8d71-2b6190e931b5 -- POST / 200 347.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,329 mnist_classifier_MNISTClassifier 4u9dktkb 265621c5-2800-451c-a3af-721b9453c546 -- POST / 200 347.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,329 mnist_classifier_MNISTClassifier 4u9dktkb 2240747d-1457-4112-aed8-b12e592cba85 -- POST / 200 346.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,330 mnist_classifier_MNISTClassifier 4u9dktkb 50b2f0c0-b561-4fb1-b0a2-28b53781a5c4 -- POST / 200 346.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,331 mnist_classifier_MNISTClassifier 4u9dktkb ed8c2d2e-9c59-40ab-be42-b156acaef5e6 -- POST / 200 346.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,331 mnist_classifier_MNISTClassifier 4u9dktkb 3e3934f7-0cf3-4531-ba05-8f9ca65ed802 -- POST / 200 346.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,331 mnist_classifier_MNISTClassifier 4u9dktkb ca5915fc-a99d-46ae-ae92-44b127efe0b3 -- POST / 200 344.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,332 mnist_classifier_MNISTClassifier 4u9dktkb 71704bb0-0668-47b6-ae25-9780ae605d81 -- POST / 200 342.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,332 mnist_classifier_MNISTClassifier 4u9dktkb beef5f1a-8555-4448-9e11-152661062036 -- POST / 200 342.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,332 mnist_classifier_MNISTClassifier 4u9dktkb 08a3604d-1215-4599-9418-ae2d3305afa3 -- POST / 200 342.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,333 mnist_classifier_MNISTClassifier 4u9dktkb 1cfb0735-fac1-4746-ab67-c7216ea7fbb8 -- POST / 200 342.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,334 mnist_classifier_MNISTClassifier 4u9dktkb 4e367b24-55f1-4542-8077-396eb2647baa -- POST / 200 343.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,335 mnist_classifier_MNISTClassifier 4u9dktkb 9d442ece-2315-47eb-8a97-095dede1a45d -- POST / 200 342.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,335 mnist_classifier_MNISTClassifier 4u9dktkb 0b1fafc0-51fb-47fa-8fe8-0217388731f1 -- POST / 200 344.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,336 mnist_classifier_MNISTClassifier 4u9dktkb 4a8c7e9c-b39c-44ad-84fc-b7e919f458fd -- POST / 200 337.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,337 mnist_classifier_MNISTClassifier 4u9dktkb c673445a-7ba1-4bd0-b596-6b4a6bf6c1ce -- POST / 200 342.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,337 mnist_classifier_MNISTClassifier 4u9dktkb 24d5efb5-240d-4062-b2d7-0a27aafc712d -- POST / 200 338.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,338 mnist_classifier_MNISTClassifier 4u9dktkb 4e99a228-6da3-4d21-9969-d14dd34e9a51 -- POST / 200 338.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,339 mnist_classifier_MNISTClassifier 4u9dktkb b8488d80-c956-46a5-954a-1dcf093ddabc -- POST / 200 333.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,340 mnist_classifier_MNISTClassifier 4u9dktkb 50d36067-f485-4a12-b937-3e4bfee0375b -- POST / 200 332.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,340 mnist_classifier_MNISTClassifier 4u9dktkb 53cb6adf-f6fb-4e82-a653-d041ae8f14c3 -- POST / 200 331.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,341 mnist_classifier_MNISTClassifier 4u9dktkb 2f955b67-74f6-4bb7-91d1-a7dc26203898 -- POST / 200 333.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,342 mnist_classifier_MNISTClassifier 4u9dktkb 0a8955b5-ee1e-4ebe-9bff-d1af98342150 -- POST / 200 332.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,342 mnist_classifier_MNISTClassifier 4u9dktkb 0046d873-0c48-416d-ac8f-719cb6b8c1df -- POST / 200 333.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,342 mnist_classifier_MNISTClassifier 4u9dktkb fbea86f9-5046-4d97-a57b-67634b080b74 -- POST / 200 329.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,342 mnist_classifier_MNISTClassifier 4u9dktkb eb30eeda-7551-4258-bd28-efab0347997a -- POST / 200 328.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,343 mnist_classifier_MNISTClassifier 4u9dktkb 3aee96f5-e5f3-450b-bad4-0e4d70e34e9e -- POST / 200 328.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,343 mnist_classifier_MNISTClassifier 4u9dktkb f65b48d2-400d-48bb-a7f2-46991ea543b6 -- POST / 200 327.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,343 mnist_classifier_MNISTClassifier 4u9dktkb bccc9cce-1ae8-41e3-b8e9-53d82def62af -- POST / 200 326.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,344 mnist_classifier_MNISTClassifier 4u9dktkb d0559687-deee-4089-80c3-1aa4cd4f95bf -- POST / 200 323.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,344 mnist_classifier_MNISTClassifier 4u9dktkb 2b2e4948-ba3e-4c3b-988b-02cbefddaa95 -- POST / 200 305.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,345 mnist_classifier_MNISTClassifier 4u9dktkb 24a00842-4100-4d4b-af26-32ed5eeaca1c -- POST / 200 174.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,345 mnist_classifier_MNISTClassifier 4u9dktkb 17ae929a-281d-4435-8acb-679511800ad3 -- POST / 200 173.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,346 mnist_classifier_MNISTClassifier 4u9dktkb 7373b019-f4e3-4e98-b606-e84ca2043efc -- POST / 200 173.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,346 mnist_classifier_MNISTClassifier 4u9dktkb 10ecfda1-6cbe-47e5-a70d-b18e47502312 -- POST / 200 173.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,347 mnist_classifier_MNISTClassifier 4u9dktkb 782f1226-a1f6-4829-9f2b-98cabca1b738 -- POST / 200 171.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,348 mnist_classifier_MNISTClassifier 4u9dktkb 68c56103-6ba7-4ade-8677-e08173c6aba1 -- POST / 200 171.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,348 mnist_classifier_MNISTClassifier 4u9dktkb 3332bbec-5708-45e4-9d53-0f1ea8236323 -- POST / 200 170.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,348 mnist_classifier_MNISTClassifier 4u9dktkb 035051d8-45c5-4233-821c-cc12eac652dc -- POST / 200 170.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,349 mnist_classifier_MNISTClassifier 4u9dktkb b9fadf0a-a44d-4192-978a-080f935d9f12 -- POST / 200 170.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,349 mnist_classifier_MNISTClassifier 4u9dktkb 71cb7cd2-3041-4cc1-a7cf-9c797faf8599 -- POST / 200 170.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,350 mnist_classifier_MNISTClassifier 4u9dktkb aa25ac49-1946-4995-b7da-3ceb05523770 -- POST / 200 169.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,350 mnist_classifier_MNISTClassifier 4u9dktkb 8e6795fc-be28-4841-b684-4038c25bef0c -- POST / 200 166.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,350 mnist_classifier_MNISTClassifier 4u9dktkb eee85e61-76fd-4188-b488-1dc5058fba5c -- POST / 200 166.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,350 mnist_classifier_MNISTClassifier 4u9dktkb d6344e6a-94b6-4c2c-b941-77aa14037a10 -- POST / 200 166.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,350 mnist_classifier_MNISTClassifier 4u9dktkb 79012e50-a7af-4b39-a27f-72859a3f2f31 -- POST / 200 166.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,351 mnist_classifier_MNISTClassifier 4u9dktkb 682817f4-7a93-4f75-a3b0-ff56c59a0421 -- POST / 200 164.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,351 mnist_classifier_MNISTClassifier 4u9dktkb 263ebd3d-cbab-4c5b-954e-c6eecb0b935a -- POST / 200 164.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,352 mnist_classifier_MNISTClassifier 4u9dktkb 3accb6e0-cee3-48c9-838c-1e45175ccf0a -- POST / 200 165.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,352 mnist_classifier_MNISTClassifier 4u9dktkb 209bf172-af03-4021-a1a2-07e97231ebee -- POST / 200 165.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,353 mnist_classifier_MNISTClassifier 4u9dktkb 702f1146-91ff-49e4-a41c-003865361009 -- POST / 200 166.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,353 mnist_classifier_MNISTClassifier 4u9dktkb b2399809-54f6-4e1a-97c3-99e9e3ba6610 -- POST / 200 165.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,354 mnist_classifier_MNISTClassifier 4u9dktkb 942a5de7-c5d0-4fb2-a412-f2f0b01d4109 -- POST / 200 166.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=4644) INFO 2026-04-27 13:41:52,354 mnist_classifier_MNISTClassifier 4u9dktkb 1fa2c6b8-3a09-437a-8b34-8ec00611238d -- POST / 200 166.0ms
Processed 1000 requests in 5.01 seconds
Throughput: 199.63 requests/second

Ray Serve automatically buffers and load balances requests across the replicas.

Fault tolerance

In production, process and machine failures are inevitable. Ray Serve is designed so that each major component in the Serve stack (the controller, replicas, and proxies) can fail and recover while your application continues to handle traffic.

Serve can also recover from larger infrastructure failures, such as entire nodes or pods failing. Serve can even recover from head node failures, or the entire head pod if deploying on KubeRay.

For more information about Ray Serve’s fault tolerance, see the Ray Serve fault-tolerance guide.

Monitor the deployment

Monitoring is critical when running large-scale deployments. The Ray dashboard displays Serve metrics like request throughput, latency, and error rates. It also shows cluster resource usage, replica status, and overall deployment health in real time. The dashboard also lets you inspect logs from individual replicas across the cluster.

For debugging, Ray offers distributed debugging tools that let you attach a debugger to running replicas across the cluster. For more information, see the Ray Serve monitoring documentation.

Conclusion

In this tutorial, you:

• Deployed a PyTorch model using Ray Serve with production best practices.

• Enabled dynamic request batching to optimize performance.

• Configured autoscaling and fractional GPU allocation to efficiently scale across a cluster.

• Tested the service with concurrent asynchronous requests.

Further reading

Ray Serve has more production features that are out of scope for this tutorial but are worth checking out:

• Specialized large language model (LLM) serving APIs that handle complexities like managing key-value (KV) caches and continuous batching.

• Model multiplexing to dynamically load and serve many different models on the same deployment. This is useful for serving per-user fine-tuned models, for example.

• Composed deployments to orchestrate multiple deployments into a single app.

For more information, see the Ray Serve documentation and Ray Serve examples.