beginner/serving_tutorial

Run in Google Colab

Colab

Download Notebook

Notebook

View on GitHub

GitHub

Serve PyTorch models at scale with Ray Serve

Author: Ricardo Decal

This tutorial shows how to deploy a PyTorch model using Ray Serve with production-ready features.

What you will learn

• How to create a production-ready PyTorch model deployment that can scale to thousands of nodes and GPUs

• How to configure an HTTP endpoint for the deployment using FastAPI

• Enable dynamic request batching for higher throughput

• Configure autoscaling and per-replica CPU/GPU resource allocation

• Load test the service with concurrent requests and monitor it with the Ray dashboard

• How Ray Serve deployments can self-heal from failures

• Ray Serve’s advanced features like model multiplexing and model composition.

Prerequisites

• PyTorch v2.9+ and torchvision

• Ray Serve (ray[serve]) v2.52.1+

• A GPU is recommended for higher throughput but is not required

Ray Serve is a scalable framework for serving machine learning models in production. It’s built on top of Ray, which is a unified framework for scaling AI and Python applications that simplifies the complexities of distributed computing. Ray is also open source and part of the PyTorch Foundation.

Setup

To install the dependencies, run:

pip install "ray[serve]" torch torchvision

Start by importing the required libraries:

import asyncio
import time
from typing import Any

from fastapi import FastAPI
from pydantic import BaseModel
import aiohttp
import numpy as np
import torch
import torch.nn as nn
from ray import serve
from torchvision.transforms import v2

Define a PyTorch model

Define a simple convolutional neural network for the MNIST digit classification dataset:

class MNISTNet(nn.Module):
    def __init__(self):
        super().__init__()
        self.conv1 = nn.Conv2d(1, 32, 3, 1)
        self.dropout1 = nn.Dropout(0.25)
        self.conv2 = nn.Conv2d(32, 64, 3, 1)
        self.fc1 = nn.Linear(9216, 128)
        self.dropout2 = nn.Dropout(0.5)
        self.fc2 = nn.Linear(128, 10)

    def forward(self, x):
        x = self.conv1(x)
        x = nn.functional.relu(x)
        x = self.conv2(x)
        x = nn.functional.relu(x)
        x = nn.functional.max_pool2d(x, 2)
        x = self.dropout1(x)
        x = torch.flatten(x, 1)
        x = self.fc1(x)
        x = nn.functional.relu(x)
        x = self.dropout2(x)
        x = self.fc2(x)
        return nn.functional.log_softmax(x, dim=1)

Define the Ray Serve deployment

To deploy this model with Ray Serve, wrap the model in a Python class and decorate it with @serve.deployment.

Processing requests in batches is more efficient than processing requests one by one, especially when using GPUs. Ray Serve provides built-in support for dynamic request batching, where individual incoming requests are opportunistically batched. Enable dynamic batching using the @serve.batch decorator as shown in the following code:

app = FastAPI()

class ImageRequest(BaseModel):  # Used for request validation and generating API documentation
    image: list[list[float]] | list[list[list[float]]]  # 2D or 3D array

@serve.deployment
@serve.ingress(app)
class MNISTClassifier:
    def __init__(self):
        self.device = torch.device("cuda" if torch.cuda.is_available() else "cpu")
        self.model = MNISTNet().to(self.device)
        # Define the transformation pipeline for the input images.
        self.transform = v2.Compose([
            v2.ToImage(),
            v2.ToDtype(torch.float32, scale=True),
            # Mean and standard deviation of the MNIST training subset.
            v2.Normalize(mean=[0.1307], std=[0.3013]),
        ])

        self.model.eval()

    # batch_wait_timeout_s is the maximum time to wait for a full batch,
    # trading off latency for throughput.
    @serve.batch(max_batch_size=128, batch_wait_timeout_s=0.1)
    async def predict_batch(self, images: list[np.ndarray]) -> list[dict[str, Any]]:
        # Stack all images into a single tensor.
        batch_tensor = torch.cat([
            self.transform(img).unsqueeze(0)
            for img in images
        ]).to(self.device).float()

        # Single forward pass on the entire batch at once.
        with torch.no_grad():
            logits = self.model(batch_tensor)
            predictions = torch.argmax(logits, dim=1).cpu().numpy()

        # Unbatch the results and preserve their original order.
        return [
            {
                "predicted_label": int(pred),
                "logits": logit.cpu().numpy().tolist()
            }
            for pred, logit in zip(predictions, logits)
        ]

    @app.post("/")
    async def handle_request(self, request: ImageRequest):
        """Handle an incoming HTTP request using FastAPI.

        Inputs are automatically validated using the Pydantic model.
        """
        # Process the single request.
        image_array = np.array(request.image)

        # Ray Serve's @serve.batch automatically batches requests.
        result = await self.predict_batch(image_array)

        return result

This is a FastAPI app, which extends Ray Serve with features like automatic request validation with Pydantic, auto-generated OpenAPI-style API documentation, and more.

Configure autoscaling and resource allocation

In production, traffic can vary significantly. Ray Serve’s autoscaling feature automatically adjusts the number of replicas based on traffic load, ensuring you have enough capacity during peaks while saving resources during quiet periods. Ray Serve scales to very large deployments with thousands of nodes and replicas.

You can also specify resource allocation per replica, such as the number of CPUs or GPUs. Ray Serve handles the orchestration of these resources across your cluster. Ray also supports fractional GPUs, allowing multiple replicas to share a single GPU when models are small enough to fit in memory together.

The following is a sample configuration with autoscaling and resource allocation:

num_cpus_per_replica = 1
num_gpus_per_replica = 1  # Set to 0 to run the model on CPUs instead of GPUs.
mnist_app = MNISTClassifier.options(
    autoscaling_config={
        "target_ongoing_requests": 50,  # Target 50 ongoing requests per replica.
        "min_replicas": 1,              # Keep at least 1 replica alive.
        "max_replicas": 80,             # Scale up to 80 replicas to maintain target_ongoing_requests.
        "upscale_delay_s": 5,           # Wait 5s before scaling up.
        "downscale_delay_s": 30,        # Wait 30s before scaling down.
    },
    # Max invocations to handle_request per replica to process simultaneously.
    # Requests exceeding this limit are queued by the router until capacity is available.
    max_ongoing_requests=200,
    # Max queue size for requests that exceed max_ongoing_requests.
    # If the queue is full, future requests are backpressured with errors until space is available.
    # -1 means the queue can grow until cluster memory is exhausted.
    max_queued_requests=-1,
    # Set the resources per replica.
    ray_actor_options={"num_cpus": num_cpus_per_replica, "num_gpus": num_gpus_per_replica}
).bind()

The app is ready to deploy. Suppose you ran this on a cluster of 10 machines, each with 4 GPUs. With num_gpus=0.5, Ray schedules 2 replicas per GPU, giving you 80 replicas across the cluster. This configuration permits the deployment to elastically scale up to 80 replicas as needed to handle traffic spikes and scale back down to 1 replica when traffic subsides.

Test the endpoint with concurrent requests

To deploy the app, use the serve.run function:

# Start the Ray Serve application.
handle = serve.run(mnist_app, name="mnist_classifier")

2026-07-31 18:48:50,074 WARNING services.py:2213 -- WARNING: The object store is using /tmp/ray instead of /dev/shm because /dev/shm has only 2147471360 bytes available. This will harm performance! You may be able to free up space by deleting files in /dev/shm. If you are inside a Docker container, you can increase /dev/shm size by passing '--shm-size=10.24gb' to 'docker run' (or add it to the run_options list in a Ray cluster config). Make sure to set this to more than 30% of available RAM.
2026-07-31 18:48:51,244 INFO worker.py:2003 -- Started a local Ray instance. View the dashboard at 127.0.0.1:8265
/usr/local/lib/python3.10/dist-packages/ray/_private/worker.py:2051: FutureWarning: Tip: In future versions of Ray, Ray will no longer override accelerator visible devices env var if num_gpus=0 or num_gpus=None (default). To enable this behavior and turn off this error message, set RAY_ACCEL_ENV_VAR_OVERRIDE_ON_ZERO=0
  warnings.warn(
(ProxyActor pid=5039) INFO 2026-07-31 18:48:53,695 proxy 172.17.0.2 -- Proxy starting on node 46cf88ed7deeeac4fcb97412b471a9c04f4fd40cb983fa7f44b64524 (HTTP port: 8000).
INFO 2026-07-31 18:48:53,763 serve 4224 -- Started Serve in namespace "serve".
(ServeController pid=5040) INFO 2026-07-31 18:48:53,774 controller 5040 -- Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
(ServeController pid=5040) INFO 2026-07-31 18:48:53,775 controller 5040 -- Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
(ProxyActor pid=5039) INFO 2026-07-31 18:48:53,759 proxy 172.17.0.2 -- Got updated endpoints: {}.
(ProxyActor pid=5039) INFO 2026-07-31 18:48:53,778 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
(ProxyActor pid=5039) INFO 2026-07-31 18:48:53,785 proxy 172.17.0.2 -- Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x7fa53c90a1d0>.
(ServeController pid=5040) INFO 2026-07-31 18:48:53,878 controller 5040 -- Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
(ProxyActor pid=5039) INFO 2026-07-31 18:48:57,996 proxy 172.17.0.2 -- Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=[])}.
INFO 2026-07-31 18:48:58,888 serve 4224 -- Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

You will see output similar to:

Started Serve in namespace "serve".
Registering autoscaling state for deployment Deployment(name='MNISTClassifier', app='mnist_classifier')
Deploying new version of Deployment(name='MNISTClassifier', app='mnist_classifier') (initial target replicas: 1).
Proxy starting on node ... (HTTP port: 8000).
Got updated endpoints: {}.
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=None)}.
Started <ray.serve._private.router.SharedRouterLongPollClient object at 0x73a53c52c250>.
Adding 1 replica to Deployment(name='MNISTClassifier', app='mnist_classifier').
Got updated endpoints: {Deployment(name='MNISTClassifier', app='mnist_classifier'): EndpointInfo(route='/', app_is_cross_language=False, route_patterns=['/', '/docs', '/docs/oauth2-redirect', '/openapi.json', '/redoc'])}.
Application 'mnist_classifier' is ready at http://127.0.0.1:8000/.

The app is now listening for requests on port 8000.

To test the deployment, you can send many requests concurrently using aiohttp. The following code demonstrates how to send 1000 concurrent requests to the app:

async def send_single_request(session, url, data):
    async with session.post(url, json=data) as response:
        return await response.json()

async def send_concurrent_requests(num_requests):
    image = np.random.rand(28, 28).tolist()

    print(f"Sending {num_requests} concurrent requests...")
    async with aiohttp.ClientSession() as session:
        tasks = [
            send_single_request(session, url="http://localhost:8000/", data={"image": image})
            for _ in range(num_requests)
        ]
        responses = await asyncio.gather(*tasks)

    return responses

# Run the concurrent requests.
start_time = time.time()
responses = asyncio.run(send_concurrent_requests(1000))
elapsed = time.time() - start_time

print(f"Processed {len(responses)} requests in {elapsed:.2f} seconds")
print(f"Throughput: {len(responses)/elapsed:.2f} requests/second")

Sending 1000 concurrent requests...
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:48:59,983 mnist_classifier_MNISTClassifier gls1eb0w c9d6d227-24b8-40e3-91fe-feb42bcaf7ae -- POST / 200 433.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:48:59,984 mnist_classifier_MNISTClassifier gls1eb0w 3852fa2a-74a0-41a8-abc8-bccf6b2be19e -- POST / 200 439.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:48:59,985 mnist_classifier_MNISTClassifier gls1eb0w 987904e4-dfff-48b8-a5c3-9bbbc25b34e0 -- POST / 200 435.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:48:59,985 mnist_classifier_MNISTClassifier gls1eb0w af823fe7-570f-47cd-bc81-52dce2709d0b -- POST / 200 433.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:48:59,986 mnist_classifier_MNISTClassifier gls1eb0w 06653ec4-8ad1-4c2e-81d8-1b5e8558f4c4 -- POST / 200 422.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:48:59,987 mnist_classifier_MNISTClassifier gls1eb0w fb0ac9c3-f5b9-49d6-a05e-a863ebcf0c53 -- POST / 200 420.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:48:59,987 mnist_classifier_MNISTClassifier gls1eb0w d3e7897d-94b8-4cd2-a124-dd5cff03edb8 -- POST / 200 419.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:48:59,987 mnist_classifier_MNISTClassifier gls1eb0w 55ba5d15-82a9-4fc9-9cfd-d33e13b30731 -- POST / 200 418.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:48:59,989 mnist_classifier_MNISTClassifier gls1eb0w ba3dc7ce-9cf8-4834-9c07-12e12ec307c5 -- POST / 200 414.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:48:59,990 mnist_classifier_MNISTClassifier gls1eb0w 0d43b9cd-a325-407f-a042-afcb89269cd9 -- POST / 200 416.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:48:59,990 mnist_classifier_MNISTClassifier gls1eb0w 226aa482-56ee-4e9c-b5fb-f044b97e9945 -- POST / 200 415.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:48:59,990 mnist_classifier_MNISTClassifier gls1eb0w 2dfb7c3c-0269-4532-839b-7e65eed7f579 -- POST / 200 414.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:48:59,991 mnist_classifier_MNISTClassifier gls1eb0w 17ccdbe7-5476-4a7c-ab1e-7e06c00f8c52 -- POST / 200 412.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:48:59,992 mnist_classifier_MNISTClassifier gls1eb0w b0ee41d0-3d4a-44cc-bcaf-e6b295c4b8ed -- POST / 200 413.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:48:59,993 mnist_classifier_MNISTClassifier gls1eb0w 8aa06e7d-2c7c-4d36-b6d0-698bca20c0c4 -- POST / 200 412.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:48:59,995 mnist_classifier_MNISTClassifier gls1eb0w b17e8a7e-22c7-4f5c-a943-51fd1e40e4f0 -- POST / 200 410.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:48:59,997 mnist_classifier_MNISTClassifier gls1eb0w 72320662-380f-4516-9812-10e3de79faab -- POST / 200 413.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:48:59,999 mnist_classifier_MNISTClassifier gls1eb0w 1ff33710-7fa3-4434-9c60-cbef5a479f53 -- POST / 200 413.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,001 mnist_classifier_MNISTClassifier gls1eb0w da8d5105-c838-4b39-99ac-bd0a202d2906 -- POST / 200 414.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,002 mnist_classifier_MNISTClassifier gls1eb0w f236d2c3-7481-47a1-9415-27fc2075a8b4 -- POST / 200 414.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,003 mnist_classifier_MNISTClassifier gls1eb0w 770f6ad6-f45c-4d04-9ee2-18e9e51120a7 -- POST / 200 415.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,004 mnist_classifier_MNISTClassifier gls1eb0w 4c84645f-1bb2-4a20-9e30-8de3bf68006c -- POST / 200 416.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,006 mnist_classifier_MNISTClassifier gls1eb0w 793a8c3e-f754-4b43-a0f4-9e0c46ef868a -- POST / 200 417.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,006 mnist_classifier_MNISTClassifier gls1eb0w 074ed14d-b6e1-4387-a2be-153a28e5ebdd -- POST / 200 416.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,006 mnist_classifier_MNISTClassifier gls1eb0w d282fbf8-8d72-462e-9c0d-d95409da2afe -- POST / 200 413.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,008 mnist_classifier_MNISTClassifier gls1eb0w f9d9ed0e-f36a-4fc9-8754-cf6acc38e642 -- POST / 200 415.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,009 mnist_classifier_MNISTClassifier gls1eb0w 29fe6d2f-261d-4142-a79a-c9893073a617 -- POST / 200 414.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,011 mnist_classifier_MNISTClassifier gls1eb0w c255abfc-efbf-48fb-8b79-42face923bae -- POST / 200 415.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,021 mnist_classifier_MNISTClassifier gls1eb0w 774eb58a-0cd0-491f-992a-9d52a410d47b -- POST / 200 425.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,023 mnist_classifier_MNISTClassifier gls1eb0w f97bc169-4b22-40e5-b0e9-3a11540f60b5 -- POST / 200 427.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,028 mnist_classifier_MNISTClassifier gls1eb0w ffbd05b8-409f-4d55-94a8-dd25b16f94b5 -- POST / 200 432.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,267 mnist_classifier_MNISTClassifier gls1eb0w 43eaee48-3092-4a8d-99cf-994812e4cece -- POST / 200 671.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,272 mnist_classifier_MNISTClassifier gls1eb0w bae79d99-8d25-490f-951d-19326ce82c38 -- POST / 200 675.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,274 mnist_classifier_MNISTClassifier gls1eb0w 25a9d55d-bb52-4081-8661-bfb9a3b08be5 -- POST / 200 675.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,275 mnist_classifier_MNISTClassifier gls1eb0w c32d5d6d-6b19-43e5-9f59-9ae966363e30 -- POST / 200 675.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,275 mnist_classifier_MNISTClassifier gls1eb0w 1d249666-dcac-4411-b643-bf2706d04120 -- POST / 200 674.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,277 mnist_classifier_MNISTClassifier gls1eb0w 440a6343-329e-42fa-bcf3-e1f35aefa825 -- POST / 200 674.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,277 mnist_classifier_MNISTClassifier gls1eb0w e436d49f-d051-4d2f-a00f-e1c11c27992f -- POST / 200 674.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,278 mnist_classifier_MNISTClassifier gls1eb0w d2c27598-ff59-4b82-a755-441c9234c074 -- POST / 200 675.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,278 mnist_classifier_MNISTClassifier gls1eb0w 7aee1078-a5cc-4869-9c83-f10e2b011a82 -- POST / 200 675.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,279 mnist_classifier_MNISTClassifier gls1eb0w 0b6317fc-c9d2-4ca0-a91d-308dfc013856 -- POST / 200 671.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,279 mnist_classifier_MNISTClassifier gls1eb0w 1e1ec445-d46c-4dbe-97ea-4e2b19b0ee51 -- POST / 200 670.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,281 mnist_classifier_MNISTClassifier gls1eb0w f66c8ac3-efc4-4a9c-a299-a72b4d63f442 -- POST / 200 668.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,282 mnist_classifier_MNISTClassifier gls1eb0w 1531590b-b5c5-4b2f-a7e5-0007fb3de459 -- POST / 200 668.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,282 mnist_classifier_MNISTClassifier gls1eb0w 2e28c32f-3a76-425a-b899-2aaeb3332757 -- POST / 200 668.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,286 mnist_classifier_MNISTClassifier gls1eb0w 1d3ba65a-4f13-41fe-a2e2-5eecc9a56106 -- POST / 200 670.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,288 mnist_classifier_MNISTClassifier gls1eb0w e022745e-49a6-4115-8de5-e9d315b64740 -- POST / 200 672.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,293 mnist_classifier_MNISTClassifier gls1eb0w 0e265d17-8bd8-4c96-9a38-d70d1b6d4711 -- POST / 200 675.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,295 mnist_classifier_MNISTClassifier gls1eb0w 0b9ae9eb-5c21-4072-9a58-01000f3c5ba0 -- POST / 200 678.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,298 mnist_classifier_MNISTClassifier gls1eb0w f986622b-62cd-4d94-89be-94dad57ba9bb -- POST / 200 678.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,299 mnist_classifier_MNISTClassifier gls1eb0w 5f479874-635b-46d4-83a7-3ed560e31066 -- POST / 200 676.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,300 mnist_classifier_MNISTClassifier gls1eb0w 30320821-1b6e-4d11-802d-5401e0391c57 -- POST / 200 673.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,302 mnist_classifier_MNISTClassifier gls1eb0w ab3ec4f4-4097-4b45-81d0-71eff6102843 -- POST / 200 680.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,303 mnist_classifier_MNISTClassifier gls1eb0w 144bd992-6607-46ba-94d9-6221f445c382 -- POST / 200 676.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,304 mnist_classifier_MNISTClassifier gls1eb0w 94eb3000-f9ea-46b8-9e31-dc0dccac34e4 -- POST / 200 677.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,304 mnist_classifier_MNISTClassifier gls1eb0w 19776c87-fcba-481d-a7db-42bb73c58da8 -- POST / 200 674.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,304 mnist_classifier_MNISTClassifier gls1eb0w 426463c4-0065-43fd-b066-bf88a78cec16 -- POST / 200 674.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,304 mnist_classifier_MNISTClassifier gls1eb0w 8aa19345-28b1-4fad-8a87-c88a0c189440 -- POST / 200 672.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,305 mnist_classifier_MNISTClassifier gls1eb0w 8fec7c46-e494-43f1-9bc0-b40e1707b3c0 -- POST / 200 672.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,305 mnist_classifier_MNISTClassifier gls1eb0w fc3e0a46-d2eb-4735-b6b8-1304ff9a5df9 -- POST / 200 672.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,305 mnist_classifier_MNISTClassifier gls1eb0w c86775f8-bf2a-495a-a529-c8b8c31ba3e4 -- POST / 200 671.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,305 mnist_classifier_MNISTClassifier gls1eb0w e126379d-ba55-434b-8e4b-797599ef0181 -- POST / 200 671.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,306 mnist_classifier_MNISTClassifier gls1eb0w 1c3570cf-5101-4e1a-878e-6596e44f059d -- POST / 200 670.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,307 mnist_classifier_MNISTClassifier gls1eb0w 47296a9a-62cd-4fd3-b425-204e7416bdc7 -- POST / 200 670.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,308 mnist_classifier_MNISTClassifier gls1eb0w 6b2f672b-5b07-45de-99bc-6ab26307c7f9 -- POST / 200 668.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,308 mnist_classifier_MNISTClassifier gls1eb0w ff99e130-6592-45fd-ad5c-4c68f25c0caa -- POST / 200 669.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,308 mnist_classifier_MNISTClassifier gls1eb0w 665adaeb-b06e-409d-a734-42dfcb1823f7 -- POST / 200 668.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,309 mnist_classifier_MNISTClassifier gls1eb0w 6b8afcbf-34e1-476d-aaef-841cbd5950d6 -- POST / 200 668.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,309 mnist_classifier_MNISTClassifier gls1eb0w fa33abed-c126-4647-a901-a55d3908092c -- POST / 200 666.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,309 mnist_classifier_MNISTClassifier gls1eb0w 07b1a952-3948-4741-b1e0-5cb6719de5cc -- POST / 200 666.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,310 mnist_classifier_MNISTClassifier gls1eb0w 56ca0e2c-f929-4a14-ad8e-f3ba2424010f -- POST / 200 667.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,311 mnist_classifier_MNISTClassifier gls1eb0w 84aa723d-bec5-4e2c-9315-1e1a6d19f073 -- POST / 200 665.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,311 mnist_classifier_MNISTClassifier gls1eb0w f62ff7d7-836c-4da8-8d0c-abb3bb150779 -- POST / 200 665.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,312 mnist_classifier_MNISTClassifier gls1eb0w 013e1dd9-ce97-4f60-87ef-91b999f07248 -- POST / 200 664.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,312 mnist_classifier_MNISTClassifier gls1eb0w d49254f6-9169-433b-9aea-8305b009b95a -- POST / 200 665.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,313 mnist_classifier_MNISTClassifier gls1eb0w 3d9473ef-8630-4f41-aa02-00d10df9e0db -- POST / 200 664.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,313 mnist_classifier_MNISTClassifier gls1eb0w d3844fb3-9985-49ea-b117-ba6539b2560c -- POST / 200 663.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,314 mnist_classifier_MNISTClassifier gls1eb0w 1019acfc-315f-4954-8e34-55fca7304ba4 -- POST / 200 664.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,315 mnist_classifier_MNISTClassifier gls1eb0w 465e50e6-1b41-4e7b-afae-3c230717a859 -- POST / 200 664.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,316 mnist_classifier_MNISTClassifier gls1eb0w f7152df3-7e97-4d68-8e03-1498e6c57889 -- POST / 200 664.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,316 mnist_classifier_MNISTClassifier gls1eb0w f96028fd-27f1-4992-b04c-e2bf066afe57 -- POST / 200 658.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,378 mnist_classifier_MNISTClassifier gls1eb0w c575ff09-425d-43dd-b836-58c21d55623e -- POST / 200 725.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,380 mnist_classifier_MNISTClassifier gls1eb0w 22220dd9-33dd-4b9f-85a7-275a636f1f7c -- POST / 200 721.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,381 mnist_classifier_MNISTClassifier gls1eb0w a49fa0d5-4bb8-40f1-bea9-f4f3d3b80c28 -- POST / 200 724.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,381 mnist_classifier_MNISTClassifier gls1eb0w 5b3079c5-b791-4689-b1ea-5ad07b7f8547 -- POST / 200 722.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,383 mnist_classifier_MNISTClassifier gls1eb0w 727a3624-543a-4f70-a7a0-2fa9550b81fd -- POST / 200 722.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,385 mnist_classifier_MNISTClassifier gls1eb0w 6b6b561e-c585-485f-91a0-fb723e8a5830 -- POST / 200 722.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,387 mnist_classifier_MNISTClassifier gls1eb0w 41ef222d-cead-462b-90bf-910085e407a6 -- POST / 200 724.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,388 mnist_classifier_MNISTClassifier gls1eb0w f9961451-e993-4572-9029-1f29b5db72e9 -- POST / 200 725.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,388 mnist_classifier_MNISTClassifier gls1eb0w 9f842d72-7d25-40ee-a2b6-f9ec5c73775e -- POST / 200 720.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,390 mnist_classifier_MNISTClassifier gls1eb0w 1524d217-2769-4add-9269-be051244e325 -- POST / 200 727.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,393 mnist_classifier_MNISTClassifier gls1eb0w f8e1949d-6211-4ef8-adf0-59218bc7f021 -- POST / 200 728.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,393 mnist_classifier_MNISTClassifier gls1eb0w 9bc5cfe1-8156-4ac9-a2c2-3763a869298c -- POST / 200 727.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,394 mnist_classifier_MNISTClassifier gls1eb0w d6ff87aa-fc28-43fe-9d1c-045dcf081f46 -- POST / 200 723.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,394 mnist_classifier_MNISTClassifier gls1eb0w 8b5185bd-fbf2-4fc8-8b1c-68d087c59d07 -- POST / 200 725.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,397 mnist_classifier_MNISTClassifier gls1eb0w eff2be9d-94e0-4881-87a0-a3c75fd85b49 -- POST / 200 723.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,397 mnist_classifier_MNISTClassifier gls1eb0w 262ad2da-9f9a-4c4e-ba48-14e9c7936951 -- POST / 200 723.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,397 mnist_classifier_MNISTClassifier gls1eb0w 7ea28674-e619-488e-9d94-89346f403ff9 -- POST / 200 723.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,401 mnist_classifier_MNISTClassifier gls1eb0w dca40343-47f0-4b16-aa93-bd338489973a -- POST / 200 726.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,402 mnist_classifier_MNISTClassifier gls1eb0w 45fcb83f-29e1-4e1b-a995-5893bbc59fd6 -- POST / 200 727.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,405 mnist_classifier_MNISTClassifier gls1eb0w e11e0c4b-c428-49eb-b1b8-18f21a67ccc8 -- POST / 200 399.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,405 mnist_classifier_MNISTClassifier gls1eb0w a1c1cb9d-6661-4791-b8d5-cc4e12231f45 -- POST / 200 385.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,406 mnist_classifier_MNISTClassifier gls1eb0w 83334567-1c58-4325-9c26-4e8477faf3b3 -- POST / 200 376.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,411 mnist_classifier_MNISTClassifier gls1eb0w 91cd5a73-95ad-42e3-a184-02884d2960e1 -- POST / 200 381.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,413 mnist_classifier_MNISTClassifier gls1eb0w 470430c1-a466-4721-a1bf-71f4f345a2dc -- POST / 200 381.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,413 mnist_classifier_MNISTClassifier gls1eb0w be318411-fb50-454e-99cb-f958858b1a3b -- POST / 200 380.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,414 mnist_classifier_MNISTClassifier gls1eb0w cea9694f-8cfb-4440-a2e3-7ccbb1852221 -- POST / 200 380.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,415 mnist_classifier_MNISTClassifier gls1eb0w 1911faa6-ea62-441f-ac70-0f2f45846f5e -- POST / 200 380.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,416 mnist_classifier_MNISTClassifier gls1eb0w 97378225-7f7f-4797-a723-571d6bdb1568 -- POST / 200 380.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,417 mnist_classifier_MNISTClassifier gls1eb0w 7b29ba4e-3a56-4124-b723-3d90db1a6ef8 -- POST / 200 381.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,417 mnist_classifier_MNISTClassifier gls1eb0w a6001b0b-a6d3-47a7-aacf-c295eef01a0a -- POST / 200 377.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,418 mnist_classifier_MNISTClassifier gls1eb0w f7864fbd-617d-42fa-b4a8-1c6c3f0d2ee4 -- POST / 200 381.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,419 mnist_classifier_MNISTClassifier gls1eb0w debc1eed-cd60-4bd0-af2b-319740dc885c -- POST / 200 378.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,419 mnist_classifier_MNISTClassifier gls1eb0w 1124b23c-cce1-4696-b32a-b1b014cdb99a -- POST / 200 377.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,424 mnist_classifier_MNISTClassifier gls1eb0w 0497f290-e6c2-4f61-9e83-d6daa3fed505 -- POST / 200 381.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,427 mnist_classifier_MNISTClassifier gls1eb0w ba356c2d-a3a7-4956-8a84-7e9eff51ecf0 -- POST / 200 382.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,429 mnist_classifier_MNISTClassifier gls1eb0w 570f126b-791a-4b43-b6c0-3235778ca46a -- POST / 200 383.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,429 mnist_classifier_MNISTClassifier gls1eb0w c41f8ef2-34d8-4d96-8364-6b381f9e1996 -- POST / 200 382.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,430 mnist_classifier_MNISTClassifier gls1eb0w 599d6c20-2a8d-4523-afa8-3d90605234d3 -- POST / 200 382.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,430 mnist_classifier_MNISTClassifier gls1eb0w 0a11bd3d-3da9-43ad-85e7-23d0704d408a -- POST / 200 383.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,431 mnist_classifier_MNISTClassifier gls1eb0w 97abe009-96af-4761-8ba9-f4fcce5c2904 -- POST / 200 382.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,432 mnist_classifier_MNISTClassifier gls1eb0w 46a006e2-f967-45e0-b394-a5416de04708 -- POST / 200 382.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,433 mnist_classifier_MNISTClassifier gls1eb0w 5dcaf268-6000-49bc-bdc5-9d78605723d3 -- POST / 200 379.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,435 mnist_classifier_MNISTClassifier gls1eb0w 37165613-e35d-4d23-a046-1f4ad64d07b1 -- POST / 200 381.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,435 mnist_classifier_MNISTClassifier gls1eb0w 18d8f33c-922a-4f85-9479-8eba1f5c4a12 -- POST / 200 233.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,436 mnist_classifier_MNISTClassifier gls1eb0w 1e9fd076-9582-4263-be83-9a0debf4fd23 -- POST / 200 231.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,436 mnist_classifier_MNISTClassifier gls1eb0w 021ae9d0-3bc2-460d-9781-d1592c0dcf78 -- POST / 200 233.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,436 mnist_classifier_MNISTClassifier gls1eb0w 0abcddab-0c31-42ae-8520-901b774ac4ea -- POST / 200 231.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,436 mnist_classifier_MNISTClassifier gls1eb0w df3bf1a6-da75-48d8-964b-281d87db3437 -- POST / 200 233.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,436 mnist_classifier_MNISTClassifier gls1eb0w ff984073-43fa-440f-837f-06212e9574a6 -- POST / 200 230.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,436 mnist_classifier_MNISTClassifier gls1eb0w c18e1577-0815-43ab-be4a-97e80c456008 -- POST / 200 229.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,528 mnist_classifier_MNISTClassifier gls1eb0w 5a7d94a4-b223-4349-b2a8-9691f12d2cf0 -- POST / 200 274.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,532 mnist_classifier_MNISTClassifier gls1eb0w a450e0ce-ba05-42d5-ab4a-b6f2cf434e70 -- POST / 200 274.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,535 mnist_classifier_MNISTClassifier gls1eb0w 57ba18b5-832f-4313-94a8-c7f9ca195b4a -- POST / 200 277.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,537 mnist_classifier_MNISTClassifier gls1eb0w e5cdc346-0964-4de0-95a0-a25862afb0a2 -- POST / 200 278.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,539 mnist_classifier_MNISTClassifier gls1eb0w 8f7d9c17-6981-45ee-96e9-eec783b11e5f -- POST / 200 277.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,540 mnist_classifier_MNISTClassifier gls1eb0w 693c1c92-7b4f-4a1e-9e06-029f7c723c89 -- POST / 200 277.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,541 mnist_classifier_MNISTClassifier gls1eb0w 41c11ba0-5ce3-4096-839c-aeb07864700b -- POST / 200 277.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,542 mnist_classifier_MNISTClassifier gls1eb0w fcbf2277-2759-49d0-869b-ac83fcf070bf -- POST / 200 224.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,545 mnist_classifier_MNISTClassifier gls1eb0w a204e59f-236d-40c6-ba69-b489c5b5afdd -- POST / 200 244.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,549 mnist_classifier_MNISTClassifier gls1eb0w 6fb6743d-7244-43c1-8e8f-c135bfec45c0 -- POST / 200 248.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,550 mnist_classifier_MNISTClassifier gls1eb0w 86d1971b-5e7d-425a-a16d-d28e3f2dc6e4 -- POST / 200 249.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,551 mnist_classifier_MNISTClassifier gls1eb0w 25ea5f6c-b244-4679-abfe-b7bb3a0557cf -- POST / 200 249.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,552 mnist_classifier_MNISTClassifier gls1eb0w 6b19b5c0-5f22-4947-9c70-ff3d9f2c9323 -- POST / 200 244.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,553 mnist_classifier_MNISTClassifier gls1eb0w e98c6033-ed0e-4c2c-9428-9a30e3a180ea -- POST / 200 234.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,554 mnist_classifier_MNISTClassifier gls1eb0w a8417b83-fbfe-4454-8012-044829eb24c1 -- POST / 200 223.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,554 mnist_classifier_MNISTClassifier gls1eb0w 9f59e927-aa9e-40a3-bccd-cd751015c4a1 -- POST / 200 222.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,555 mnist_classifier_MNISTClassifier gls1eb0w d5302e65-2a1f-4d0c-bf99-777c8519e52e -- POST / 200 223.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,556 mnist_classifier_MNISTClassifier gls1eb0w 78a42c13-d46c-4f27-bae0-2b783fbbb2be -- POST / 200 223.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,558 mnist_classifier_MNISTClassifier gls1eb0w 7d793aa5-e259-43f5-958f-c3f093098ad2 -- POST / 200 224.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,559 mnist_classifier_MNISTClassifier gls1eb0w 72496513-803e-45e6-bb20-9e04c9018ee4 -- POST / 200 219.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,560 mnist_classifier_MNISTClassifier gls1eb0w fc046d67-4f81-4328-a1d0-b977cd961865 -- POST / 200 220.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,561 mnist_classifier_MNISTClassifier gls1eb0w 5acf8ade-1325-4612-823f-f3d2bdf05d45 -- POST / 200 226.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,561 mnist_classifier_MNISTClassifier gls1eb0w fe3490cd-02c7-492b-af5d-20f9b64c3034 -- POST / 200 224.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,561 mnist_classifier_MNISTClassifier gls1eb0w 6f8aba04-1988-44c8-9629-d11219364ff8 -- POST / 200 221.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,561 mnist_classifier_MNISTClassifier gls1eb0w 4e20113d-0caa-4b25-abbe-b391794412fc -- POST / 200 221.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,561 mnist_classifier_MNISTClassifier gls1eb0w ffbb8f54-a26b-4410-a40c-cb14671f5b97 -- POST / 200 220.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,702 mnist_classifier_MNISTClassifier gls1eb0w 7281e481-bd4e-41f8-bd43-8b76d5326123 -- POST / 200 360.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,703 mnist_classifier_MNISTClassifier gls1eb0w 2d5aa86a-38f8-4e23-91f1-2d0cdbeb3f92 -- POST / 200 356.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,703 mnist_classifier_MNISTClassifier gls1eb0w 751a0f0b-7d8c-47ba-9c14-631c5c7e0a19 -- POST / 200 361.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,703 mnist_classifier_MNISTClassifier gls1eb0w ed2b28cb-4f13-439a-aca7-506fab09dece -- POST / 200 361.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,704 mnist_classifier_MNISTClassifier gls1eb0w cafe5cb1-027a-46c9-9c2f-623df87bce57 -- POST / 200 359.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,704 mnist_classifier_MNISTClassifier gls1eb0w 38109c35-8e5a-40fa-8053-fa09bdff971c -- POST / 200 357.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,706 mnist_classifier_MNISTClassifier gls1eb0w 222a1134-bf45-4268-a7f1-cd1d58cd8d28 -- POST / 200 358.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,706 mnist_classifier_MNISTClassifier gls1eb0w b4971ed4-42d2-4073-91ec-6b2307007677 -- POST / 200 354.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,707 mnist_classifier_MNISTClassifier gls1eb0w 957933ee-e4fd-4d25-99e4-c34ce5184351 -- POST / 200 354.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,707 mnist_classifier_MNISTClassifier gls1eb0w 1c9b2110-03ac-4ed1-a528-8ae08ff3c44e -- POST / 200 354.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,708 mnist_classifier_MNISTClassifier gls1eb0w 128e7a26-11e1-4608-9a5f-eaae7b3b8920 -- POST / 200 353.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,708 mnist_classifier_MNISTClassifier gls1eb0w dab5fe26-6567-4741-b3c2-20093765a085 -- POST / 200 354.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,709 mnist_classifier_MNISTClassifier gls1eb0w cffd8680-a64a-491c-a861-cf037ea7e349 -- POST / 200 349.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,709 mnist_classifier_MNISTClassifier gls1eb0w 8a17f6ef-b2b9-4f7b-9b76-9ff24435c99d -- POST / 200 348.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,710 mnist_classifier_MNISTClassifier gls1eb0w 26191f2e-e9f9-4cb4-afc2-73690f40c7f0 -- POST / 200 347.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,714 mnist_classifier_MNISTClassifier gls1eb0w fa79de78-3e82-40ea-9503-4933721b1733 -- POST / 200 336.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,715 mnist_classifier_MNISTClassifier gls1eb0w c3675f01-f847-4232-878f-047b8741271f -- POST / 200 336.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,715 mnist_classifier_MNISTClassifier gls1eb0w 22177542-3072-4df6-adee-5e21a997be92 -- POST / 200 337.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,716 mnist_classifier_MNISTClassifier gls1eb0w 2a8b1c10-e14c-40c3-ab9e-629ed4b1b19e -- POST / 200 292.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,716 mnist_classifier_MNISTClassifier gls1eb0w 3433f4e9-e272-4f12-9ecc-485218653df9 -- POST / 200 304.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,716 mnist_classifier_MNISTClassifier gls1eb0w 93f93b88-62ca-4c94-b8c7-3abd6861f469 -- POST / 200 279.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,717 mnist_classifier_MNISTClassifier gls1eb0w 1e94840b-9033-4b84-ac86-3364696e32a1 -- POST / 200 277.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,718 mnist_classifier_MNISTClassifier gls1eb0w 424e889f-84a4-423c-a0e8-7dba7a854580 -- POST / 200 274.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,718 mnist_classifier_MNISTClassifier gls1eb0w 8d05cfc7-cd89-4ff6-b446-8b045139a6a8 -- POST / 200 273.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,718 mnist_classifier_MNISTClassifier gls1eb0w 0e5b85ee-ddea-4592-a1dd-7510e9bfbe95 -- POST / 200 270.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,719 mnist_classifier_MNISTClassifier gls1eb0w 97d6ddc6-aa56-4045-9d2c-3ce9043283b8 -- POST / 200 258.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,719 mnist_classifier_MNISTClassifier gls1eb0w ca2f1a7f-b94a-415b-a7f0-3d1a6b8b7dfa -- POST / 200 259.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,719 mnist_classifier_MNISTClassifier gls1eb0w 1baf929c-9d42-44a9-83c2-3afcc7c594b5 -- POST / 200 268.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,720 mnist_classifier_MNISTClassifier gls1eb0w 6b2eb8b0-6a90-4164-bfe8-5d302327e1b2 -- POST / 200 268.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,720 mnist_classifier_MNISTClassifier gls1eb0w 9b947a74-fe63-4922-8619-f4046cb50752 -- POST / 200 268.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,720 mnist_classifier_MNISTClassifier gls1eb0w 45e10c79-f039-4ef0-ae70-86ffab923737 -- POST / 200 265.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,721 mnist_classifier_MNISTClassifier gls1eb0w e974d22b-6e3a-4ad7-a279-4971e510c017 -- POST / 200 266.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,722 mnist_classifier_MNISTClassifier gls1eb0w 0d30efd6-816a-456e-8ddb-02cc9badc8ee -- POST / 200 265.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,723 mnist_classifier_MNISTClassifier gls1eb0w 2120ffeb-e9ae-4b35-bbb5-5352e19ed8dc -- POST / 200 265.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,724 mnist_classifier_MNISTClassifier gls1eb0w cf724df9-e9da-4da8-8f40-29b1bf724040 -- POST / 200 266.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,725 mnist_classifier_MNISTClassifier gls1eb0w 6dd74679-1f8a-4033-9368-a79a0cb67b09 -- POST / 200 267.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,725 mnist_classifier_MNISTClassifier gls1eb0w bd2a4f29-e74e-4a82-a1fb-169f6faf81ff -- POST / 200 267.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,726 mnist_classifier_MNISTClassifier gls1eb0w 07303d50-7164-45ae-8d3d-9e7abf052fe0 -- POST / 200 267.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,727 mnist_classifier_MNISTClassifier gls1eb0w 58ed9df6-7ede-4779-8871-92108d41c78d -- POST / 200 267.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,727 mnist_classifier_MNISTClassifier gls1eb0w e33924d5-f777-465e-8930-d19dfa4ea849 -- POST / 200 267.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,728 mnist_classifier_MNISTClassifier gls1eb0w 6f0cb283-384d-4298-8e9d-97b59f2b23be -- POST / 200 265.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,728 mnist_classifier_MNISTClassifier gls1eb0w beb8cb08-caea-47b5-8a35-f072b12f9af2 -- POST / 200 264.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,728 mnist_classifier_MNISTClassifier gls1eb0w b01303f4-50cf-419a-b7fb-70e96e9cc600 -- POST / 200 264.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,729 mnist_classifier_MNISTClassifier gls1eb0w 7f8625fa-1930-41aa-81b9-3bb006a82180 -- POST / 200 264.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,729 mnist_classifier_MNISTClassifier gls1eb0w ee73fc7b-15c6-49f7-bc55-94131a08a9f8 -- POST / 200 257.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,730 mnist_classifier_MNISTClassifier gls1eb0w a1e07d43-f8db-49d3-9e9a-7124810a1249 -- POST / 200 258.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,730 mnist_classifier_MNISTClassifier gls1eb0w bcdb07f4-48e8-49fe-876e-308c840591c8 -- POST / 200 258.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,731 mnist_classifier_MNISTClassifier gls1eb0w 4f7212dd-effc-4f6e-97d0-ba18a538a03e -- POST / 200 258.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,731 mnist_classifier_MNISTClassifier gls1eb0w 2b857e90-2916-4211-8749-41f7472d0e39 -- POST / 200 245.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,733 mnist_classifier_MNISTClassifier gls1eb0w fd01b81f-289c-48ca-94b4-d25f4cd0f151 -- POST / 200 255.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,733 mnist_classifier_MNISTClassifier gls1eb0w bb66c85f-5227-469a-8f75-aba17e502c36 -- POST / 200 247.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,734 mnist_classifier_MNISTClassifier gls1eb0w 65fbb40e-32c9-4974-82b1-1068f6663c37 -- POST / 200 245.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,802 mnist_classifier_MNISTClassifier gls1eb0w 32f19896-449b-4065-83b9-e3c7dde8a877 -- POST / 200 313.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,816 mnist_classifier_MNISTClassifier gls1eb0w a414105b-f786-4673-84f8-a61c7ab3b950 -- POST / 200 326.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,819 mnist_classifier_MNISTClassifier gls1eb0w afc0f8f8-c012-4900-b449-a1891d499d6a -- POST / 200 328.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,821 mnist_classifier_MNISTClassifier gls1eb0w 0290c8e1-4cd9-4b30-b452-3ff2f9b7956d -- POST / 200 327.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,821 mnist_classifier_MNISTClassifier gls1eb0w 4318cfc4-b12f-46ed-8660-1ec8dd8e2e24 -- POST / 200 326.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,822 mnist_classifier_MNISTClassifier gls1eb0w 4ab2f2fc-b907-44d3-8a5a-a8c43b0e91b6 -- POST / 200 325.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,823 mnist_classifier_MNISTClassifier gls1eb0w deb42cd6-d96c-4371-8a2e-9510de8af23e -- POST / 200 323.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,823 mnist_classifier_MNISTClassifier gls1eb0w 2963e4a9-ccc3-4f5e-bf8b-f1ce3705e509 -- POST / 200 323.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,825 mnist_classifier_MNISTClassifier gls1eb0w ae77e4aa-1ab7-48aa-a614-8135aba831ec -- POST / 200 324.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,826 mnist_classifier_MNISTClassifier gls1eb0w 7aa45781-01d3-4f99-a089-355cdc2bf2e0 -- POST / 200 323.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,827 mnist_classifier_MNISTClassifier gls1eb0w 02164f29-735c-4b81-866d-597396b89251 -- POST / 200 322.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,829 mnist_classifier_MNISTClassifier gls1eb0w 63bb0037-f4ce-43d3-b7d3-73eb53940f19 -- POST / 200 322.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,829 mnist_classifier_MNISTClassifier gls1eb0w 3041b060-54cf-4977-b356-2e88ffb081e0 -- POST / 200 320.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,829 mnist_classifier_MNISTClassifier gls1eb0w 13429051-2db9-48a8-9207-453295cdc438 -- POST / 200 323.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,830 mnist_classifier_MNISTClassifier gls1eb0w 9e0bd460-218e-45ba-9959-3c07fffaf00a -- POST / 200 321.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,830 mnist_classifier_MNISTClassifier gls1eb0w 597b56f5-907c-4ab3-afa8-736b47fb5c75 -- POST / 200 317.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,830 mnist_classifier_MNISTClassifier gls1eb0w bd0aa145-fd24-4293-a62e-f0d0863476b1 -- POST / 200 309.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,830 mnist_classifier_MNISTClassifier gls1eb0w b156c84c-aea0-4e54-85af-289a90117149 -- POST / 200 309.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,831 mnist_classifier_MNISTClassifier gls1eb0w 9ab7f0af-2109-41e7-b57e-fc8adda4c7fb -- POST / 200 308.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,831 mnist_classifier_MNISTClassifier gls1eb0w 00e07b30-5ed5-4855-a2fe-20788cf00b84 -- POST / 200 303.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,831 mnist_classifier_MNISTClassifier gls1eb0w fbb16839-be83-45c8-93b3-48eca437baea -- POST / 200 303.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,831 mnist_classifier_MNISTClassifier gls1eb0w 2001b78c-c242-4681-8398-bf7ff36b6cb5 -- POST / 200 299.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,831 mnist_classifier_MNISTClassifier gls1eb0w 160fd13b-d09c-4f6a-a9ac-c54347fb467e -- POST / 200 268.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,831 mnist_classifier_MNISTClassifier gls1eb0w cfc1a949-b2d3-4a52-a4af-6eb9c227a9e3 -- POST / 200 263.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,832 mnist_classifier_MNISTClassifier gls1eb0w 1d27ccdd-2318-4ea5-8d95-8f89160499fe -- POST / 200 262.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,832 mnist_classifier_MNISTClassifier gls1eb0w fff90dec-2ddf-4f4d-b1b9-4e99f5f5edee -- POST / 200 248.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,832 mnist_classifier_MNISTClassifier gls1eb0w f314497a-0616-44fd-8d25-86914f5e3ec3 -- POST / 200 248.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,833 mnist_classifier_MNISTClassifier gls1eb0w 8403ee7b-5eb2-4120-ba89-9100b8ce9afd -- POST / 200 247.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,833 mnist_classifier_MNISTClassifier gls1eb0w 723bb830-f341-4fe5-9718-a2b32bb5e0d9 -- POST / 200 246.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,834 mnist_classifier_MNISTClassifier gls1eb0w 0f2d1319-0f21-4ed0-9210-a895cb73b0b0 -- POST / 200 245.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,834 mnist_classifier_MNISTClassifier gls1eb0w 99372a5e-1a25-4575-bc84-45ee6c30bfb7 -- POST / 200 245.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,834 mnist_classifier_MNISTClassifier gls1eb0w 40b998cf-d2b6-4efa-8a71-4ecee44c3f72 -- POST / 200 245.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,834 mnist_classifier_MNISTClassifier gls1eb0w 0d9ae7b6-a1a1-4842-810c-9c6e3d7e5fe5 -- POST / 200 243.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,834 mnist_classifier_MNISTClassifier gls1eb0w d6f10496-b0c9-42aa-8be4-348324506484 -- POST / 200 242.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,834 mnist_classifier_MNISTClassifier gls1eb0w aa26fd41-9d59-4528-9eb3-bf887c4dc659 -- POST / 200 241.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,835 mnist_classifier_MNISTClassifier gls1eb0w 70700a45-c8b1-4791-8c29-2439db03b30b -- POST / 200 241.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,835 mnist_classifier_MNISTClassifier gls1eb0w c232de72-8fa7-4d03-a509-a65b452fd0f2 -- POST / 200 240.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,835 mnist_classifier_MNISTClassifier gls1eb0w 9370fcac-ce99-4876-a3eb-95c84d3140b9 -- POST / 200 238.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,835 mnist_classifier_MNISTClassifier gls1eb0w e4c684ff-c39d-4f49-8ace-15fd87702554 -- POST / 200 236.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,835 mnist_classifier_MNISTClassifier gls1eb0w 0654eaff-a59c-4bed-be95-2bfe6fac02e8 -- POST / 200 235.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,836 mnist_classifier_MNISTClassifier gls1eb0w 7c7845ed-7bc5-4e4c-ab41-4a9ce03d06f1 -- POST / 200 235.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,837 mnist_classifier_MNISTClassifier gls1eb0w d0c8271a-7bb8-41ae-acec-27abaf01eaea -- POST / 200 227.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,837 mnist_classifier_MNISTClassifier gls1eb0w 82346efb-74f0-4128-9bc8-3b616b24f98b -- POST / 200 227.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,846 mnist_classifier_MNISTClassifier gls1eb0w 35cc16b8-dae9-4668-84df-d0cf67eef2e6 -- POST / 200 234.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,847 mnist_classifier_MNISTClassifier gls1eb0w afdc915c-5be9-4854-a2c2-5746d3ad511f -- POST / 200 231.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,849 mnist_classifier_MNISTClassifier gls1eb0w c6370d92-1417-46b0-8958-85fd598e8f3e -- POST / 200 233.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,851 mnist_classifier_MNISTClassifier gls1eb0w 1f54e2e5-ae97-46ff-a52c-619fe609457a -- POST / 200 233.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,852 mnist_classifier_MNISTClassifier gls1eb0w 2d3361f6-6ea6-4416-8e69-019d6df9ef46 -- POST / 200 232.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,852 mnist_classifier_MNISTClassifier gls1eb0w ffabebdb-876d-4cb6-8665-78903e78baa8 -- POST / 200 139.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,926 mnist_classifier_MNISTClassifier gls1eb0w af1d83dc-ba34-49c3-b827-1a0b9aa914e3 -- POST / 200 204.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,943 mnist_classifier_MNISTClassifier gls1eb0w d73c16f9-efd3-4033-96f9-b7dffb5755be -- POST / 200 229.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,944 mnist_classifier_MNISTClassifier gls1eb0w bc805340-ae8b-4b97-b63e-b8a80bea9afa -- POST / 200 220.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,944 mnist_classifier_MNISTClassifier gls1eb0w d6b75901-0e5a-45a4-be16-15422d4d099e -- POST / 200 210.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,946 mnist_classifier_MNISTClassifier gls1eb0w 12c0361c-c7b8-4332-807d-75777c3d0e7c -- POST / 200 211.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,946 mnist_classifier_MNISTClassifier gls1eb0w 43a206cd-f5d9-4e22-949c-4d287a3825ea -- POST / 200 211.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,946 mnist_classifier_MNISTClassifier gls1eb0w 5165f8dd-6a95-4b42-978e-59b58119e59b -- POST / 200 209.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,946 mnist_classifier_MNISTClassifier gls1eb0w 6bc19b80-3b8b-4c56-aad1-aacf5f5fbd0c -- POST / 200 204.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,947 mnist_classifier_MNISTClassifier gls1eb0w 4e41ccdf-4bd1-4d56-a5f3-c80cf9eb969e -- POST / 200 204.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,948 mnist_classifier_MNISTClassifier gls1eb0w a5c91c33-96fc-475a-8bbf-3dfb6afcb466 -- POST / 200 201.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,948 mnist_classifier_MNISTClassifier gls1eb0w 399f8d3d-c575-4602-b94a-7c7b271f8370 -- POST / 200 203.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,948 mnist_classifier_MNISTClassifier gls1eb0w 37ab8404-bda0-46f7-bb5d-637443b2d243 -- POST / 200 202.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,948 mnist_classifier_MNISTClassifier gls1eb0w 6cdaeb77-4398-41e9-8c09-c99774f346eb -- POST / 200 200.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,948 mnist_classifier_MNISTClassifier gls1eb0w ca1bcdee-3624-4e0a-9c1f-89719c25ab4e -- POST / 200 184.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,949 mnist_classifier_MNISTClassifier gls1eb0w b4034203-7618-420e-9849-3d4247b1b288 -- POST / 200 198.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,949 mnist_classifier_MNISTClassifier gls1eb0w c225d49b-ae0d-4f5a-bae1-66e1f7383074 -- POST / 200 171.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,949 mnist_classifier_MNISTClassifier gls1eb0w d0ecdd38-d5d9-472b-9550-58d6b9a45f8b -- POST / 200 168.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,949 mnist_classifier_MNISTClassifier gls1eb0w 31afff6e-fd9b-4702-bc62-abd4ee439039 -- POST / 200 161.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:00,950 mnist_classifier_MNISTClassifier gls1eb0w 6a5897f8-fcab-462b-99b0-c71bf2dbecac -- POST / 200 159.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,227 mnist_classifier_MNISTClassifier gls1eb0w 72401d76-9db8-4da3-8d72-e1cbf97e19c9 -- POST / 200 428.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,228 mnist_classifier_MNISTClassifier gls1eb0w d3a77efd-66d5-4b47-8089-e722c89c7b43 -- POST / 200 425.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,228 mnist_classifier_MNISTClassifier gls1eb0w 6307ff91-17d8-4483-88ac-26246fcc7431 -- POST / 200 384.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,228 mnist_classifier_MNISTClassifier gls1eb0w 87595809-b912-4013-b0d6-49ccd0c915c1 -- POST / 200 410.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,229 mnist_classifier_MNISTClassifier gls1eb0w 7b24c31c-8861-4a0c-a004-8911dee9a742 -- POST / 200 390.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,229 mnist_classifier_MNISTClassifier gls1eb0w 8a7df059-a5fa-405f-b84d-b4016964c388 -- POST / 200 390.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,230 mnist_classifier_MNISTClassifier gls1eb0w c02ac2eb-2623-4e69-a1a3-60868b836724 -- POST / 200 391.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,230 mnist_classifier_MNISTClassifier gls1eb0w 35248c38-cbc4-4a87-ac43-55e6386dc129 -- POST / 200 391.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,230 mnist_classifier_MNISTClassifier gls1eb0w 3d28747b-709e-4eda-b297-edfe1d38ba86 -- POST / 200 388.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,329 mnist_classifier_MNISTClassifier gls1eb0w c99a0e36-44a6-4171-811c-ef3d05dbd0c2 -- POST / 200 486.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,330 mnist_classifier_MNISTClassifier gls1eb0w abbbad08-075b-4bcc-b06b-e6ebdabc23e3 -- POST / 200 487.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,330 mnist_classifier_MNISTClassifier gls1eb0w de700284-6473-4613-8c7a-047aaf088813 -- POST / 200 487.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,331 mnist_classifier_MNISTClassifier gls1eb0w 9143aa1d-f7db-49c8-aa80-986410b0eb51 -- POST / 200 488.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,331 mnist_classifier_MNISTClassifier gls1eb0w f2268ffe-a015-4e92-9515-12c086c08825 -- POST / 200 488.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,332 mnist_classifier_MNISTClassifier gls1eb0w ce9a3de2-fc14-4140-b672-a5a859a683ac -- POST / 200 374.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,333 mnist_classifier_MNISTClassifier gls1eb0w d40c7ab0-33c2-4a8a-8ba4-e58a302f9df2 -- POST / 200 489.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,334 mnist_classifier_MNISTClassifier gls1eb0w 8e396abe-71ce-4330-9ba6-c5f554ac4aa4 -- POST / 200 379.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,335 mnist_classifier_MNISTClassifier gls1eb0w 22e1c8b5-aea8-440a-8953-fd41441aa82e -- POST / 200 491.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,336 mnist_classifier_MNISTClassifier gls1eb0w a1a91fb2-3166-41d3-b8b1-cd80ecd91837 -- POST / 200 491.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,337 mnist_classifier_MNISTClassifier gls1eb0w 9d43c40f-1997-4422-adb4-322301ef2cbb -- POST / 200 492.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,338 mnist_classifier_MNISTClassifier gls1eb0w 71c47c64-3721-414a-919b-85c40d35dd91 -- POST / 200 493.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,340 mnist_classifier_MNISTClassifier gls1eb0w fd3c9a2c-61df-4264-8945-11e7223d745a -- POST / 200 495.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,341 mnist_classifier_MNISTClassifier gls1eb0w 4e98e4cd-b686-4617-9a8e-3fe65aad3a89 -- POST / 200 495.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,342 mnist_classifier_MNISTClassifier gls1eb0w f7b3c674-f8e4-4e1d-bed7-742f48826277 -- POST / 200 496.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,342 mnist_classifier_MNISTClassifier gls1eb0w 32e8bbfb-02ac-4272-b051-5a1d41b8da99 -- POST / 200 496.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,343 mnist_classifier_MNISTClassifier gls1eb0w 178bdde7-0d89-4730-9e51-ce69de91c328 -- POST / 200 496.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,343 mnist_classifier_MNISTClassifier gls1eb0w 634ddba5-254d-4db5-8c7b-7a4943e81952 -- POST / 200 497.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,343 mnist_classifier_MNISTClassifier gls1eb0w cbcbfb21-7c8d-4502-9548-f6b8225a2a3b -- POST / 200 497.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,343 mnist_classifier_MNISTClassifier gls1eb0w 2fe7290a-2869-4297-a6e7-d30865cb0109 -- POST / 200 497.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,344 mnist_classifier_MNISTClassifier gls1eb0w 18e6eb87-a9ec-4866-a2db-48cb5cbe7b4d -- POST / 200 463.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,344 mnist_classifier_MNISTClassifier gls1eb0w 2b6155ee-0def-48a3-befb-e81e1c992ad0 -- POST / 200 462.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,344 mnist_classifier_MNISTClassifier gls1eb0w 0c548c71-097b-4324-98b7-137f3f1eea5f -- POST / 200 460.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,345 mnist_classifier_MNISTClassifier gls1eb0w 72a44764-3b92-4995-96ea-55d2c56b4b16 -- POST / 200 459.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,345 mnist_classifier_MNISTClassifier gls1eb0w 7282b402-6dcf-4491-80d8-738fa47c99da -- POST / 200 458.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,345 mnist_classifier_MNISTClassifier gls1eb0w a8056bb6-d0df-479f-b5f0-ff2512e822a9 -- POST / 200 457.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,345 mnist_classifier_MNISTClassifier gls1eb0w 98801fcb-4838-40c8-8277-38679e01a319 -- POST / 200 455.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,346 mnist_classifier_MNISTClassifier gls1eb0w e5a90335-14fd-4c84-8752-257c1aa25fe4 -- POST / 200 455.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,346 mnist_classifier_MNISTClassifier gls1eb0w 9bfd8053-e07d-435a-8a3a-d662565eacf3 -- POST / 200 455.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,346 mnist_classifier_MNISTClassifier gls1eb0w bdcc5823-3dfe-40f4-8d5a-a91faf8b533a -- POST / 200 453.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,347 mnist_classifier_MNISTClassifier gls1eb0w 11ee7d9f-f965-4b6c-b7b1-0ed85df42336 -- POST / 200 451.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,348 mnist_classifier_MNISTClassifier gls1eb0w 3ba18c46-3d76-4ea4-a28c-c59ec7730324 -- POST / 200 452.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,349 mnist_classifier_MNISTClassifier gls1eb0w 2a6a870d-cc7c-4db9-a7de-2cc728596787 -- POST / 200 452.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,349 mnist_classifier_MNISTClassifier gls1eb0w 0f4e9aa0-218e-4da7-8ae2-cee6aceeaf3d -- POST / 200 452.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,350 mnist_classifier_MNISTClassifier gls1eb0w 03dffc20-2a68-42a7-85c8-d01487f9e951 -- POST / 200 435.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,352 mnist_classifier_MNISTClassifier gls1eb0w 48cc91be-84e8-4353-9113-fd7376cbbad5 -- POST / 200 436.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,353 mnist_classifier_MNISTClassifier gls1eb0w 5a981298-68c5-4e95-a28d-66c4569c105c -- POST / 200 429.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,353 mnist_classifier_MNISTClassifier gls1eb0w 11bb5f39-5022-4691-a0f8-e524775067d4 -- POST / 200 429.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,353 mnist_classifier_MNISTClassifier gls1eb0w 35d7f6ec-88d0-4c03-88d1-7d8da02d3a55 -- POST / 200 429.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,354 mnist_classifier_MNISTClassifier gls1eb0w 142eddc3-3d02-4176-b420-f13a070ffa82 -- POST / 200 429.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,355 mnist_classifier_MNISTClassifier gls1eb0w 1d60a21c-967a-4504-ac16-416845dcb75e -- POST / 200 429.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,355 mnist_classifier_MNISTClassifier gls1eb0w 3d44e304-5dbb-4da7-96b5-3a1173665ccb -- POST / 200 429.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,355 mnist_classifier_MNISTClassifier gls1eb0w 0946938b-715c-470b-84ba-0af26436f901 -- POST / 200 396.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,355 mnist_classifier_MNISTClassifier gls1eb0w 6a84babb-ce2f-494e-9c53-a40b99bfcd0f -- POST / 200 396.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,356 mnist_classifier_MNISTClassifier gls1eb0w 285511a7-ad6b-4e73-bc26-d8903d703783 -- POST / 200 396.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,356 mnist_classifier_MNISTClassifier gls1eb0w 1e3bde03-9522-4332-b0e4-720be99b7f0e -- POST / 200 396.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,356 mnist_classifier_MNISTClassifier gls1eb0w 9c568927-a492-4501-bbd9-cfe2d0e05a0d -- POST / 200 396.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,358 mnist_classifier_MNISTClassifier gls1eb0w 0d16343c-1b21-4ea3-92f3-fd081d0f45c9 -- POST / 200 389.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,372 mnist_classifier_MNISTClassifier gls1eb0w b37f2fa4-d529-4878-8b2d-551895424964 -- POST / 200 402.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,376 mnist_classifier_MNISTClassifier gls1eb0w 0cea575e-64d8-4347-ab4d-0e88dc25419b -- POST / 200 404.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,376 mnist_classifier_MNISTClassifier gls1eb0w 9c4ed6bd-b78a-478c-b1bb-c08de2acdd97 -- POST / 200 404.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,377 mnist_classifier_MNISTClassifier gls1eb0w 9dc04c09-74ec-45a0-b91b-527deb150dcb -- POST / 200 404.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,377 mnist_classifier_MNISTClassifier gls1eb0w 121cf216-8e93-42fd-a272-c215ae616f49 -- POST / 200 403.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,378 mnist_classifier_MNISTClassifier gls1eb0w 3700fc38-353b-4235-af59-3270e235ec19 -- POST / 200 404.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,380 mnist_classifier_MNISTClassifier gls1eb0w d845ab98-b09a-47ad-9515-74dd262d7ec2 -- POST / 200 419.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,381 mnist_classifier_MNISTClassifier gls1eb0w 316da2df-e49d-4878-b550-a906c4aadee5 -- POST / 200 420.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,381 mnist_classifier_MNISTClassifier gls1eb0w d7c59575-9ab4-4b43-86cd-8170e259a412 -- POST / 200 420.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,382 mnist_classifier_MNISTClassifier gls1eb0w d823d753-546c-4f75-995e-3f5475ffb150 -- POST / 200 420.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,382 mnist_classifier_MNISTClassifier gls1eb0w c03017e9-cefe-45f8-829b-ad3c92be562b -- POST / 200 420.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,382 mnist_classifier_MNISTClassifier gls1eb0w a2eaa9f9-bb97-4590-9b19-7f47c71654b3 -- POST / 200 420.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,382 mnist_classifier_MNISTClassifier gls1eb0w f9355366-214d-47a8-b1a4-4667e73e9dad -- POST / 200 420.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,383 mnist_classifier_MNISTClassifier gls1eb0w 82c8530b-a66d-42ee-8f28-7aac8c554030 -- POST / 200 420.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,383 mnist_classifier_MNISTClassifier gls1eb0w e9448567-d735-459f-9d61-5bfb740726cf -- POST / 200 420.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,383 mnist_classifier_MNISTClassifier gls1eb0w 653e8945-8cda-4a2e-854c-3b4d127a4e2f -- POST / 200 420.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,383 mnist_classifier_MNISTClassifier gls1eb0w 83cf760a-f53a-4980-b850-2183eb2a714a -- POST / 200 420.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,383 mnist_classifier_MNISTClassifier gls1eb0w 33de70fb-61a0-460b-be3d-78095824d169 -- POST / 200 420.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,384 mnist_classifier_MNISTClassifier gls1eb0w aefca14d-3c1d-4e73-afcd-06fea8d2929e -- POST / 200 420.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,384 mnist_classifier_MNISTClassifier gls1eb0w 52aa4d7e-fb70-4d21-8a69-888d020c5c56 -- POST / 200 420.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,384 mnist_classifier_MNISTClassifier gls1eb0w 7f8ccf19-43cb-4d33-8678-4688003cc403 -- POST / 200 420.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,384 mnist_classifier_MNISTClassifier gls1eb0w feb11bb0-669b-4e71-b6c1-9d8267e80e47 -- POST / 200 419.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,384 mnist_classifier_MNISTClassifier gls1eb0w 3b04c559-ba41-427c-92a3-877a570158e1 -- POST / 200 417.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,384 mnist_classifier_MNISTClassifier gls1eb0w 714761a8-80b0-4ba7-bc79-d4e55d5b4438 -- POST / 200 410.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,384 mnist_classifier_MNISTClassifier gls1eb0w 18e3bbcd-6136-408c-ae22-ce8b2ca003aa -- POST / 200 231.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,385 mnist_classifier_MNISTClassifier gls1eb0w 35be0856-ee17-4411-ba28-a31a3b3df440 -- POST / 200 231.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,385 mnist_classifier_MNISTClassifier gls1eb0w 46b05ead-b6b8-4272-805e-81428028ebe9 -- POST / 200 231.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,385 mnist_classifier_MNISTClassifier gls1eb0w 100ed4ea-f462-4ad4-93ed-b0cf5fd4301a -- POST / 200 229.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,385 mnist_classifier_MNISTClassifier gls1eb0w 39c5c5a2-6f2c-44a4-a3be-ca3542973e4c -- POST / 200 229.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,385 mnist_classifier_MNISTClassifier gls1eb0w 1705b91f-2c5e-4be7-a7fd-8007932e776b -- POST / 200 229.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,385 mnist_classifier_MNISTClassifier gls1eb0w 4312d9db-b7a7-4130-b86d-a72d741c7b53 -- POST / 200 228.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,386 mnist_classifier_MNISTClassifier gls1eb0w f8156b31-f4db-4aec-af0d-09b0d0dd5966 -- POST / 200 228.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,386 mnist_classifier_MNISTClassifier gls1eb0w 6fdcdf21-07ac-41b8-96cf-28ace7e24759 -- POST / 200 227.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,386 mnist_classifier_MNISTClassifier gls1eb0w e7e79cb2-aee0-43cd-a62e-200800da3bbc -- POST / 200 227.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,386 mnist_classifier_MNISTClassifier gls1eb0w 59af55b6-8641-4043-b7df-1b54efa70280 -- POST / 200 226.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,386 mnist_classifier_MNISTClassifier gls1eb0w 30e3367b-2c3c-4b3c-9fed-97008ca16480 -- POST / 200 226.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,387 mnist_classifier_MNISTClassifier gls1eb0w 6c14c449-beb8-4032-9a8e-57c9fd9cab33 -- POST / 200 224.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,387 mnist_classifier_MNISTClassifier gls1eb0w 398d162b-0ab2-481a-be32-df4cfa984919 -- POST / 200 225.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,387 mnist_classifier_MNISTClassifier gls1eb0w 253262ec-70fd-4007-8f77-02e4aa915dac -- POST / 200 225.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,389 mnist_classifier_MNISTClassifier gls1eb0w 08ca2b0b-8623-416a-9de5-95d96b4757a1 -- POST / 200 226.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,392 mnist_classifier_MNISTClassifier gls1eb0w 0834e070-ecbe-4aeb-83a3-c574a2283dd5 -- POST / 200 228.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,394 mnist_classifier_MNISTClassifier gls1eb0w b5a70e82-b0ef-4337-878f-a2b745b4f436 -- POST / 200 230.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,394 mnist_classifier_MNISTClassifier gls1eb0w 97d85e85-c5b5-4a4a-867a-bc1be94122a3 -- POST / 200 230.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,394 mnist_classifier_MNISTClassifier gls1eb0w 04e1a7e2-6aff-4011-b024-d0813cc1419b -- POST / 200 194.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,395 mnist_classifier_MNISTClassifier gls1eb0w 123e2dae-bd96-44e9-b7bb-2b59df822afa -- POST / 200 191.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,396 mnist_classifier_MNISTClassifier gls1eb0w 245c9a26-9428-4cef-9e23-559d7ea5fd26 -- POST / 200 191.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,398 mnist_classifier_MNISTClassifier gls1eb0w 799e1a17-42cb-4bc2-b980-26fef2a3f05f -- POST / 200 190.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,399 mnist_classifier_MNISTClassifier gls1eb0w dfb91caa-b2ed-49ec-b534-3a6edd8fe43c -- POST / 200 190.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,399 mnist_classifier_MNISTClassifier gls1eb0w 15d98691-8330-4fb7-a5be-6205630dcb50 -- POST / 200 185.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,399 mnist_classifier_MNISTClassifier gls1eb0w 846e2b18-ad37-4c75-a23b-ffd2fa10a371 -- POST / 200 185.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,400 mnist_classifier_MNISTClassifier gls1eb0w 264200ff-5343-4e9b-af0c-5f0eab9acb63 -- POST / 200 185.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,400 mnist_classifier_MNISTClassifier gls1eb0w b2a55d92-245b-49d6-a82b-1cdc75ddeb3b -- POST / 200 181.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,599 mnist_classifier_MNISTClassifier gls1eb0w a48cdda7-7e26-47d1-8cc2-d7aac82f1461 -- POST / 200 266.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,606 mnist_classifier_MNISTClassifier gls1eb0w a8a71856-2613-4bf0-b263-ed39b555467d -- POST / 200 266.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,607 mnist_classifier_MNISTClassifier gls1eb0w bb7dc725-314e-48f5-9f4f-141a29970c56 -- POST / 200 249.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,607 mnist_classifier_MNISTClassifier gls1eb0w bff8b7c0-0521-4281-aaf9-5ddab85570cb -- POST / 200 205.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,608 mnist_classifier_MNISTClassifier gls1eb0w c83a4839-806a-4871-9e37-11b7cb34d627 -- POST / 200 206.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,609 mnist_classifier_MNISTClassifier gls1eb0w 2ff59269-90eb-408f-ab8b-f70215b47734 -- POST / 200 198.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,610 mnist_classifier_MNISTClassifier gls1eb0w 5bd49639-a1fb-4029-ace4-3f73a3708e8b -- POST / 200 204.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,737 mnist_classifier_MNISTClassifier gls1eb0w f9a3e52f-a9fd-4f9a-8238-611b53ad4587 -- POST / 200 317.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,738 mnist_classifier_MNISTClassifier gls1eb0w 660a2947-86f4-4988-9bfd-79d3f207190c -- POST / 200 324.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,738 mnist_classifier_MNISTClassifier gls1eb0w df4e7bdd-6537-4bfd-beb9-392ba42e7199 -- POST / 200 317.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,739 mnist_classifier_MNISTClassifier gls1eb0w c71279e8-126e-44a1-963b-de3ca230a678 -- POST / 200 325.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,739 mnist_classifier_MNISTClassifier gls1eb0w 2ee26f86-85aa-4738-9c2f-81b1a0c0a1ff -- POST / 200 324.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,740 mnist_classifier_MNISTClassifier gls1eb0w eaef08db-87f8-4706-8521-28fdc8538ba2 -- POST / 200 324.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,740 mnist_classifier_MNISTClassifier gls1eb0w 2914489f-8d90-4d3c-84ca-eef6b15543ac -- POST / 200 323.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,741 mnist_classifier_MNISTClassifier gls1eb0w c8e1c0c9-dd1a-45e0-bb9c-e99c11aa7fd5 -- POST / 200 322.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,741 mnist_classifier_MNISTClassifier gls1eb0w e9e04537-5448-4ae1-8a05-77eee85afe3c -- POST / 200 322.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,741 mnist_classifier_MNISTClassifier gls1eb0w b8d5c01a-82ac-4375-bf94-9d3d0e9f6102 -- POST / 200 320.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,742 mnist_classifier_MNISTClassifier gls1eb0w 41c992c7-95ce-4935-892e-d5dbecc1eacf -- POST / 200 319.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,743 mnist_classifier_MNISTClassifier gls1eb0w f2b4fd8d-f633-4856-a27b-7a58ab47ccc1 -- POST / 200 320.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,743 mnist_classifier_MNISTClassifier gls1eb0w 0eb64dfb-aa60-4faf-8d53-34256ffe529d -- POST / 200 317.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,746 mnist_classifier_MNISTClassifier gls1eb0w 8eba2914-a521-4530-a09d-7c54deaa5804 -- POST / 200 320.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,747 mnist_classifier_MNISTClassifier gls1eb0w ab6a599a-0474-4c20-add5-142b373c0754 -- POST / 200 321.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,748 mnist_classifier_MNISTClassifier gls1eb0w 1a7ec556-db3e-43f2-a09b-47be1f07715b -- POST / 200 319.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,748 mnist_classifier_MNISTClassifier gls1eb0w df2cbe3e-a87f-4452-b206-d9cb85252646 -- POST / 200 319.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,748 mnist_classifier_MNISTClassifier gls1eb0w 7d81d513-a921-4849-9f5f-19a82181df48 -- POST / 200 317.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,749 mnist_classifier_MNISTClassifier gls1eb0w f5cd9896-686f-4d5d-9a25-7f0c48b39f90 -- POST / 200 317.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,749 mnist_classifier_MNISTClassifier gls1eb0w 65ded482-e9bc-497c-aabb-0d20272764ad -- POST / 200 316.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,749 mnist_classifier_MNISTClassifier gls1eb0w 4cd3c97a-eeac-40d1-bffe-e9bba5e48eef -- POST / 200 317.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,750 mnist_classifier_MNISTClassifier gls1eb0w c5b1270d-75c2-45e4-8b9e-318369db3bc4 -- POST / 200 316.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,750 mnist_classifier_MNISTClassifier gls1eb0w 3157743d-230a-47d6-9b33-5f143f6cdce1 -- POST / 200 316.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,750 mnist_classifier_MNISTClassifier gls1eb0w 4d973c43-fde3-4d45-8141-98900495f336 -- POST / 200 315.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,750 mnist_classifier_MNISTClassifier gls1eb0w 90c28478-5667-41fc-8b66-10a0edaf3e24 -- POST / 200 314.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,751 mnist_classifier_MNISTClassifier gls1eb0w d8dc0656-1175-41d0-b073-c4221e1eb330 -- POST / 200 314.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,751 mnist_classifier_MNISTClassifier gls1eb0w f1913a9e-d8d4-41d2-b39d-5a84b3286851 -- POST / 200 314.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,751 mnist_classifier_MNISTClassifier gls1eb0w 16949e16-48f2-4379-ae45-25586f6d3491 -- POST / 200 314.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,751 mnist_classifier_MNISTClassifier gls1eb0w 1179b919-f66f-44c1-aa95-942d7ab9b90b -- POST / 200 310.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,752 mnist_classifier_MNISTClassifier gls1eb0w 08504b08-f6d8-4103-9545-fd334b999970 -- POST / 200 311.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,752 mnist_classifier_MNISTClassifier gls1eb0w 675318cd-6ad7-4fb9-a48e-3cfd83ccbcb9 -- POST / 200 310.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,752 mnist_classifier_MNISTClassifier gls1eb0w 04ec146e-227d-4941-9057-14b9ef96d9bc -- POST / 200 311.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,753 mnist_classifier_MNISTClassifier gls1eb0w dac73e67-8493-4478-abc1-b25cccadc432 -- POST / 200 304.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,753 mnist_classifier_MNISTClassifier gls1eb0w ec326664-4c17-4bc6-9cd8-9812e92d1399 -- POST / 200 302.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,758 mnist_classifier_MNISTClassifier gls1eb0w 96281e20-d27b-441b-8700-dbc5f8675a5f -- POST / 200 306.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,759 mnist_classifier_MNISTClassifier gls1eb0w f2e9ee3e-8e2a-4782-953d-fd705cd04a2b -- POST / 200 306.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,760 mnist_classifier_MNISTClassifier gls1eb0w 6fe84e13-bcad-42b5-b90a-1ddd2a4f62a8 -- POST / 200 306.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,760 mnist_classifier_MNISTClassifier gls1eb0w 3df7c2ff-c3c8-4543-8dbf-a99d3f677365 -- POST / 200 306.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,760 mnist_classifier_MNISTClassifier gls1eb0w b0295d26-1a0f-4751-b187-283c2e0a9d46 -- POST / 200 288.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,760 mnist_classifier_MNISTClassifier gls1eb0w 6ffb8f96-828e-4b7e-b2a4-42579c9a6f6c -- POST / 200 277.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,761 mnist_classifier_MNISTClassifier gls1eb0w f487d0b9-84ee-4c20-a483-d7d069e17a3a -- POST / 200 272.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,761 mnist_classifier_MNISTClassifier gls1eb0w 50ba29cd-c317-4946-9731-adb39266eb59 -- POST / 200 277.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,761 mnist_classifier_MNISTClassifier gls1eb0w 8bfc8153-06a8-486c-b768-9609316c6315 -- POST / 200 272.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,761 mnist_classifier_MNISTClassifier gls1eb0w 41e7d39b-e051-4595-ab8b-567c5a9e570a -- POST / 200 276.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,761 mnist_classifier_MNISTClassifier gls1eb0w 97ffead1-7352-4244-9e01-4e2ec199eec4 -- POST / 200 271.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,762 mnist_classifier_MNISTClassifier gls1eb0w 3eba6dc6-975c-40cd-995f-095d0e850dad -- POST / 200 271.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,762 mnist_classifier_MNISTClassifier gls1eb0w e34e8336-c3de-4f46-8592-e8d8f8cef27f -- POST / 200 271.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,762 mnist_classifier_MNISTClassifier gls1eb0w 7307239e-97c3-4290-b854-0b59592c72e0 -- POST / 200 271.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,763 mnist_classifier_MNISTClassifier gls1eb0w 08b1e3ec-6aef-4869-a6ef-ee4bba29fd3a -- POST / 200 230.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,767 mnist_classifier_MNISTClassifier gls1eb0w 5e3f694a-64c0-4273-8b0d-069f9ac0c830 -- POST / 200 234.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,768 mnist_classifier_MNISTClassifier gls1eb0w c904e9a9-daab-47b6-a168-22d7bdf9c032 -- POST / 200 233.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,768 mnist_classifier_MNISTClassifier gls1eb0w 90fee2e6-0577-4e78-b293-3d8214d74431 -- POST / 200 229.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,769 mnist_classifier_MNISTClassifier gls1eb0w b45eb835-0fba-4670-a366-97350b1296a3 -- POST / 200 229.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,769 mnist_classifier_MNISTClassifier gls1eb0w 46d59115-5a10-4d76-b724-32b5a5b1f07b -- POST / 200 229.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,769 mnist_classifier_MNISTClassifier gls1eb0w 3ca167aa-56c6-4102-9ee0-2d16a91bdbcb -- POST / 200 224.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,769 mnist_classifier_MNISTClassifier gls1eb0w 5615e553-0133-4a06-9476-3ddc44ebe261 -- POST / 200 226.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,770 mnist_classifier_MNISTClassifier gls1eb0w a5a2312a-5521-40c3-8f61-4f491c431bce -- POST / 200 224.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,770 mnist_classifier_MNISTClassifier gls1eb0w 794ff385-56aa-4fc3-b28a-fc20c14c8d1a -- POST / 200 226.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,770 mnist_classifier_MNISTClassifier gls1eb0w 0c33c819-27eb-4557-95ea-dc33c19823ec -- POST / 200 224.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,772 mnist_classifier_MNISTClassifier gls1eb0w 6c2b32a7-983d-40a6-85a7-5479cff4c29c -- POST / 200 222.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,773 mnist_classifier_MNISTClassifier gls1eb0w 65582f8b-cdee-42e5-9c66-ca33acef5732 -- POST / 200 221.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,774 mnist_classifier_MNISTClassifier gls1eb0w 01fa0106-abc5-4877-8cef-a44e8928b06c -- POST / 200 222.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,774 mnist_classifier_MNISTClassifier gls1eb0w 0652dddd-855e-4ef3-b2fe-addf2ee1d921 -- POST / 200 222.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,775 mnist_classifier_MNISTClassifier gls1eb0w 0c4a5a4b-9047-4940-87bd-9aa7ae2618c3 -- POST / 200 222.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,775 mnist_classifier_MNISTClassifier gls1eb0w 4ed43d6a-a99f-4203-aeae-1383d6c532c7 -- POST / 200 222.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,775 mnist_classifier_MNISTClassifier gls1eb0w fcd719e8-3732-47c9-9b82-798b1f427ceb -- POST / 200 222.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,777 mnist_classifier_MNISTClassifier gls1eb0w 12ece287-3d54-4383-b6b9-1ea046841e6b -- POST / 200 224.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,781 mnist_classifier_MNISTClassifier gls1eb0w c0279b72-36f0-43ae-b132-20716b29a604 -- POST / 200 226.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,781 mnist_classifier_MNISTClassifier gls1eb0w 520ec854-ff5d-461e-938e-e35d0471624c -- POST / 200 226.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,785 mnist_classifier_MNISTClassifier gls1eb0w 418e4f7a-52a2-4db1-ba8d-60f2f185c0d6 -- POST / 200 228.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,788 mnist_classifier_MNISTClassifier gls1eb0w 2395a493-844e-41cc-9a75-d2c54a413803 -- POST / 200 231.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,790 mnist_classifier_MNISTClassifier gls1eb0w 7ff945f3-d8d0-43ca-ab65-483b2d354c4a -- POST / 200 228.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,791 mnist_classifier_MNISTClassifier gls1eb0w 8eec10c0-a6b0-479c-8e2a-1b2cda5271a5 -- POST / 200 229.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,792 mnist_classifier_MNISTClassifier gls1eb0w 0ff17053-9d83-4e6b-a684-8ba7add58a79 -- POST / 200 228.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,792 mnist_classifier_MNISTClassifier gls1eb0w da203861-254f-4d01-b5bc-b1583816d88d -- POST / 200 228.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,796 mnist_classifier_MNISTClassifier gls1eb0w 2c24bfa3-5397-4a60-9678-153e89316854 -- POST / 200 183.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,797 mnist_classifier_MNISTClassifier gls1eb0w 3513fb8d-6e82-4558-a66f-7579a1955a72 -- POST / 200 173.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,799 mnist_classifier_MNISTClassifier gls1eb0w ea1b6ebf-3c49-4a80-8b48-1b27fa7f0d31 -- POST / 200 174.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,800 mnist_classifier_MNISTClassifier gls1eb0w b6554f13-4f5c-4b1d-9f7e-184057051dbc -- POST / 200 174.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,800 mnist_classifier_MNISTClassifier gls1eb0w d0b05b85-6ff3-4993-a06b-79879bc46844 -- POST / 200 174.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,810 mnist_classifier_MNISTClassifier gls1eb0w c2acb0a6-be85-45a4-8146-c52efb7b7dce -- POST / 200 318.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,811 mnist_classifier_MNISTClassifier gls1eb0w 52214c39-6a72-4a0b-92f2-2f9fc805c832 -- POST / 200 319.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,811 mnist_classifier_MNISTClassifier gls1eb0w a2e5bebc-f977-46ff-9f4c-552550e31ec9 -- POST / 200 313.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,812 mnist_classifier_MNISTClassifier gls1eb0w 68142662-4179-4bbb-abfd-d92e493b777c -- POST / 200 313.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,812 mnist_classifier_MNISTClassifier gls1eb0w c90f16dc-879e-48c1-aeec-55b19536fec7 -- POST / 200 312.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,812 mnist_classifier_MNISTClassifier gls1eb0w 368adaf7-df83-4ce8-8b60-6ca49458397c -- POST / 200 311.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,812 mnist_classifier_MNISTClassifier gls1eb0w 0945d437-3be1-499e-8880-8f8688926e49 -- POST / 200 310.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,813 mnist_classifier_MNISTClassifier gls1eb0w 6df86610-e7e6-40c7-bd67-5d2ce3581332 -- POST / 200 309.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,813 mnist_classifier_MNISTClassifier gls1eb0w 0178e1cc-da60-44fa-afee-b4a3a820df6d -- POST / 200 309.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,813 mnist_classifier_MNISTClassifier gls1eb0w 3e2dfd23-6374-412f-9a60-458cfa5793de -- POST / 200 309.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,814 mnist_classifier_MNISTClassifier gls1eb0w 9f2e2be2-2b3e-4c90-8707-71acfb2bbc79 -- POST / 200 302.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,814 mnist_classifier_MNISTClassifier gls1eb0w 674a4b5a-1dec-4e94-8f50-ef3b287676b6 -- POST / 200 301.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,814 mnist_classifier_MNISTClassifier gls1eb0w fe28805e-34c2-4a9f-9427-260f7851ce7c -- POST / 200 301.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,815 mnist_classifier_MNISTClassifier gls1eb0w 909dd58a-1601-4ffe-8c4c-6f24d9c7cd16 -- POST / 200 289.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,815 mnist_classifier_MNISTClassifier gls1eb0w 1464aa71-a300-4cd9-8865-4c5ec591adae -- POST / 200 289.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,816 mnist_classifier_MNISTClassifier gls1eb0w 8e03152a-5230-4ad8-b65d-79b6d0a95286 -- POST / 200 289.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,816 mnist_classifier_MNISTClassifier gls1eb0w 0cf4d771-e1f7-43d3-8cb4-2affebe2d258 -- POST / 200 289.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,816 mnist_classifier_MNISTClassifier gls1eb0w b8a89dab-30fd-402e-858c-a3c76d1c226d -- POST / 200 285.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,817 mnist_classifier_MNISTClassifier gls1eb0w a58bf5a4-19a6-4d7e-bc23-a377f853178e -- POST / 200 189.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:01,817 mnist_classifier_MNISTClassifier gls1eb0w 0f8942d9-cf1c-41f4-ba3d-261bb4ff294e -- POST / 200 189.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,186 mnist_classifier_MNISTClassifier gls1eb0w 5ccf7e9d-2ee9-4fa6-92bd-a3318fdaf645 -- POST / 200 418.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,187 mnist_classifier_MNISTClassifier gls1eb0w 9591d0a5-372c-44ec-951d-455ab4495952 -- POST / 200 418.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,187 mnist_classifier_MNISTClassifier gls1eb0w 2db34703-f793-49c4-8c30-925d38a8b3a9 -- POST / 200 362.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,188 mnist_classifier_MNISTClassifier gls1eb0w 34a3b749-4ba0-4f16-857f-481315182745 -- POST / 200 369.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,193 mnist_classifier_MNISTClassifier gls1eb0w 283bbe32-0e10-4124-9c71-ba10935f3190 -- POST / 200 372.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,201 mnist_classifier_MNISTClassifier gls1eb0w bb454687-31b9-496d-928b-a57c01b1125d -- POST / 200 375.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,203 mnist_classifier_MNISTClassifier gls1eb0w 54523309-75fc-4e20-8959-f1c63a40c5ab -- POST / 200 377.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,207 mnist_classifier_MNISTClassifier gls1eb0w ebcf5966-ba44-4b6a-adc6-f80279935fc2 -- POST / 200 378.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,207 mnist_classifier_MNISTClassifier gls1eb0w ae929ae1-6569-4efd-9fcf-06a41d7fbb83 -- POST / 200 378.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,208 mnist_classifier_MNISTClassifier gls1eb0w 36c6401d-8c51-4d43-a8f8-8a9a0e2b6921 -- POST / 200 378.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,209 mnist_classifier_MNISTClassifier gls1eb0w f48298f8-ef24-4338-ac4c-f20f050c1114 -- POST / 200 378.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,209 mnist_classifier_MNISTClassifier gls1eb0w 95751d88-3ca1-4d3a-8716-951b60e061e3 -- POST / 200 378.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,263 mnist_classifier_MNISTClassifier gls1eb0w c773592f-2e47-49e9-a542-d9527042625e -- POST / 200 428.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,264 mnist_classifier_MNISTClassifier gls1eb0w 9ee987db-5dc5-4dbc-9e66-7ed0212e3efb -- POST / 200 432.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,265 mnist_classifier_MNISTClassifier gls1eb0w 7cf4e6f2-7c1c-4144-8e83-ad2ebdebff26 -- POST / 200 432.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,265 mnist_classifier_MNISTClassifier gls1eb0w 69b79fc5-0ab7-4410-9672-97e186e593ea -- POST / 200 432.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,265 mnist_classifier_MNISTClassifier gls1eb0w ace6b1fb-65e1-4b6d-ab38-8974560e923c -- POST / 200 432.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,266 mnist_classifier_MNISTClassifier gls1eb0w 13ac81c6-e1fa-4e93-98ab-163a42d2fdfa -- POST / 200 431.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,267 mnist_classifier_MNISTClassifier gls1eb0w 588a9366-baeb-450a-b4e1-1e2e085b136d -- POST / 200 431.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,267 mnist_classifier_MNISTClassifier gls1eb0w 5d9fe2a6-5147-480b-b209-8d10c4229290 -- POST / 200 431.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,268 mnist_classifier_MNISTClassifier gls1eb0w c667878c-ad2b-4e40-90af-d5d56d914eb3 -- POST / 200 430.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,268 mnist_classifier_MNISTClassifier gls1eb0w 31a40b2b-fe82-4784-bc76-c7ddf2d97674 -- POST / 200 430.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,269 mnist_classifier_MNISTClassifier gls1eb0w 6ebaf232-a55b-4e0d-b547-9009d690a240 -- POST / 200 428.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,270 mnist_classifier_MNISTClassifier gls1eb0w 7ebca1b3-9583-4933-bef9-2f217b900866 -- POST / 200 432.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,271 mnist_classifier_MNISTClassifier gls1eb0w 1972e7c2-a23f-4c29-b8c9-e2889783d97f -- POST / 200 431.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,272 mnist_classifier_MNISTClassifier gls1eb0w 056878b9-8025-4913-b11d-4677a7788b20 -- POST / 200 429.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,272 mnist_classifier_MNISTClassifier gls1eb0w 2807e8a3-37de-4202-b01c-c55db7d7446d -- POST / 200 432.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,273 mnist_classifier_MNISTClassifier gls1eb0w 12c69c9b-e5eb-40e2-82ae-b725b8977a7c -- POST / 200 432.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,273 mnist_classifier_MNISTClassifier gls1eb0w d0353625-0802-4b32-91e7-6cbf3cb8689c -- POST / 200 429.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,273 mnist_classifier_MNISTClassifier gls1eb0w ef42fdf5-bf2e-4b52-b407-906522d2139c -- POST / 200 418.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,275 mnist_classifier_MNISTClassifier gls1eb0w 502411e4-8db7-4d6c-aa8f-7d52247e67a7 -- POST / 200 411.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,275 mnist_classifier_MNISTClassifier gls1eb0w e7db9ecf-86ca-4977-b03e-cc7af91ebf9f -- POST / 200 430.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,277 mnist_classifier_MNISTClassifier gls1eb0w 52354cf2-163e-44e8-819e-dcbfdab9ef76 -- POST / 200 432.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,281 mnist_classifier_MNISTClassifier gls1eb0w 67fd8575-57d3-483f-a779-ac300d5088f2 -- POST / 200 435.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,281 mnist_classifier_MNISTClassifier gls1eb0w 5c5e95a5-5de5-42ab-9258-2a810a8134fe -- POST / 200 435.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,282 mnist_classifier_MNISTClassifier gls1eb0w a84c2ed8-cda8-48c7-8e3a-398ffd2efd6a -- POST / 200 430.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,283 mnist_classifier_MNISTClassifier gls1eb0w fea65e2f-4d0a-4f6b-b0d1-8bc4933cc15b -- POST / 200 429.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,285 mnist_classifier_MNISTClassifier gls1eb0w 96e53fca-2d8e-48ae-bacc-cbd947e223b3 -- POST / 200 431.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,286 mnist_classifier_MNISTClassifier gls1eb0w 7f43c3c2-97ba-459d-97f1-47544a885231 -- POST / 200 431.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,286 mnist_classifier_MNISTClassifier gls1eb0w 4286522a-2913-4ec4-9341-2a2562ef8937 -- POST / 200 423.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,286 mnist_classifier_MNISTClassifier gls1eb0w 773a75cd-08cf-4317-8920-e325650466bd -- POST / 200 425.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,287 mnist_classifier_MNISTClassifier gls1eb0w 6515bd5a-1fd2-4065-8a6b-cea40abd1dd6 -- POST / 200 416.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,287 mnist_classifier_MNISTClassifier gls1eb0w 6e27df89-fa7d-4d1d-a007-950e9733789b -- POST / 200 424.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,287 mnist_classifier_MNISTClassifier gls1eb0w d4f745a9-816b-48a5-a06b-f5d117496ccd -- POST / 200 414.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,287 mnist_classifier_MNISTClassifier gls1eb0w 7806a46e-e237-4332-81df-a4bbffcc3076 -- POST / 200 414.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,287 mnist_classifier_MNISTClassifier gls1eb0w 8e1c2333-66e6-4655-8bcc-6865a77bb4d1 -- POST / 200 412.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,288 mnist_classifier_MNISTClassifier gls1eb0w 089993ba-3e66-42cb-8813-fff8ff9fab7c -- POST / 200 413.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,288 mnist_classifier_MNISTClassifier gls1eb0w 177dc52e-9994-4e19-a7bf-e4c09ba3ad6a -- POST / 200 408.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,288 mnist_classifier_MNISTClassifier gls1eb0w 92b7d92b-3996-4486-a163-ae6487c80de5 -- POST / 200 413.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,289 mnist_classifier_MNISTClassifier gls1eb0w fe6771c4-67ff-46c3-9e75-38dab9b6506e -- POST / 200 408.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,289 mnist_classifier_MNISTClassifier gls1eb0w cdc0e2c1-6cc8-45b3-beb5-a9a156ebc26f -- POST / 200 413.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,289 mnist_classifier_MNISTClassifier gls1eb0w 41cd9dd6-aaca-46bc-8fcb-6397f07626b9 -- POST / 200 411.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,289 mnist_classifier_MNISTClassifier gls1eb0w 75503959-0c14-49b4-8542-a2b7b492a080 -- POST / 200 411.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,289 mnist_classifier_MNISTClassifier gls1eb0w b9a1f8ab-ed97-42df-90c2-d98f41ae3aa4 -- POST / 200 407.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,290 mnist_classifier_MNISTClassifier gls1eb0w f8183359-a24f-4d3e-8290-018194a5d39b -- POST / 200 407.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,290 mnist_classifier_MNISTClassifier gls1eb0w 11018f9b-b7f6-4218-90e1-7c3104735d01 -- POST / 200 404.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,290 mnist_classifier_MNISTClassifier gls1eb0w e969c636-3f22-45bc-a7d9-0781049f5be1 -- POST / 200 404.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,290 mnist_classifier_MNISTClassifier gls1eb0w eeb6cbd2-7cf5-4c7d-9455-8d159917ee62 -- POST / 200 401.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,290 mnist_classifier_MNISTClassifier gls1eb0w 4a72a880-868e-4fee-8e6c-16d07b806245 -- POST / 200 392.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,291 mnist_classifier_MNISTClassifier gls1eb0w d1063225-3aab-4abd-bc1b-35bab8530ee4 -- POST / 200 386.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,291 mnist_classifier_MNISTClassifier gls1eb0w 07e250b0-6918-4a33-a5e1-c9aecbd0a254 -- POST / 200 383.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,291 mnist_classifier_MNISTClassifier gls1eb0w 3d11e703-f300-4c84-a48d-2e287943e745 -- POST / 200 382.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,291 mnist_classifier_MNISTClassifier gls1eb0w d6fcfdcf-6531-49ae-9843-f50372a10df7 -- POST / 200 381.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,292 mnist_classifier_MNISTClassifier gls1eb0w 9dc763d7-b6ca-4256-9460-9d4fdd144b98 -- POST / 200 381.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,292 mnist_classifier_MNISTClassifier gls1eb0w 923490a7-4e35-4311-b784-f08a97ac6102 -- POST / 200 381.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,292 mnist_classifier_MNISTClassifier gls1eb0w f1900774-69bc-4319-ae05-bf887e39c93c -- POST / 200 375.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,292 mnist_classifier_MNISTClassifier gls1eb0w d2462ad4-61e4-462e-be0e-783270776990 -- POST / 200 374.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,292 mnist_classifier_MNISTClassifier gls1eb0w 73c841ba-d04d-44d1-9089-331a90036eb6 -- POST / 200 374.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,292 mnist_classifier_MNISTClassifier gls1eb0w 71a7512b-6dc2-4a3a-935d-9bc55dca69ff -- POST / 200 373.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,293 mnist_classifier_MNISTClassifier gls1eb0w 9a318a29-22fe-4c96-a923-247039a5bf8c -- POST / 200 367.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,293 mnist_classifier_MNISTClassifier gls1eb0w e950b9ef-7cc3-4ec0-b4f5-4dd10f81165f -- POST / 200 367.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,293 mnist_classifier_MNISTClassifier gls1eb0w bcc7bce6-45af-465b-ac2a-bd72ca81ea4a -- POST / 200 367.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,294 mnist_classifier_MNISTClassifier gls1eb0w 806c01f1-767c-46a1-a672-36e539464264 -- POST / 200 368.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,295 mnist_classifier_MNISTClassifier gls1eb0w 2e36e53a-7028-462f-8aee-f22d343c2e41 -- POST / 200 361.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,296 mnist_classifier_MNISTClassifier gls1eb0w 1c0e1d6d-766a-4d8f-bd44-bb314d016e3e -- POST / 200 360.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,297 mnist_classifier_MNISTClassifier gls1eb0w 634f9bd1-40e1-4312-bcc1-b93dac00922c -- POST / 200 361.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,297 mnist_classifier_MNISTClassifier gls1eb0w 497d47c6-4632-4323-bd7c-60ff4b9855b0 -- POST / 200 360.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,298 mnist_classifier_MNISTClassifier gls1eb0w ef62b39d-b78a-434f-babf-8f8f47876d6b -- POST / 200 359.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,298 mnist_classifier_MNISTClassifier gls1eb0w 7245dd35-1ecf-444f-ae12-bd430ca6734d -- POST / 200 357.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,298 mnist_classifier_MNISTClassifier gls1eb0w 4906437a-6b26-4c4d-aff6-4f0a7f83d7cf -- POST / 200 357.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,299 mnist_classifier_MNISTClassifier gls1eb0w a9432a7b-25f5-4620-b534-e14d95ecf8b2 -- POST / 200 358.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,299 mnist_classifier_MNISTClassifier gls1eb0w 5b956ec2-1805-49c4-bc1e-4946d74a8fe5 -- POST / 200 355.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,299 mnist_classifier_MNISTClassifier gls1eb0w d96316bb-4bd7-4337-9fe4-a0ef24b6b79e -- POST / 200 355.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,299 mnist_classifier_MNISTClassifier gls1eb0w b9cbbf03-d88b-48ea-a99f-2eb114a51581 -- POST / 200 355.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,299 mnist_classifier_MNISTClassifier gls1eb0w 5d240938-bba6-471f-8dba-89c148c928c3 -- POST / 200 355.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,300 mnist_classifier_MNISTClassifier gls1eb0w 1ec43492-c88b-4267-8d3f-e9704ee30b1e -- POST / 200 353.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,301 mnist_classifier_MNISTClassifier gls1eb0w 8231252f-d832-46b0-9896-a4a662366cf0 -- POST / 200 354.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,302 mnist_classifier_MNISTClassifier gls1eb0w 7ac7cdb4-1d82-4e28-9fc5-48ef412908a0 -- POST / 200 354.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,302 mnist_classifier_MNISTClassifier gls1eb0w e5346b5b-96e7-4651-b302-c5afe0c9ddc6 -- POST / 200 355.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,304 mnist_classifier_MNISTClassifier gls1eb0w 2d5d43be-7dd7-4dc5-b8f8-223a5327c1f6 -- POST / 200 355.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,309 mnist_classifier_MNISTClassifier gls1eb0w f321b96c-e22c-47b0-9461-f69e0e953b34 -- POST / 200 358.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,309 mnist_classifier_MNISTClassifier gls1eb0w fc51da0f-1e6c-464c-83f9-868fdfda3ec9 -- POST / 200 358.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,310 mnist_classifier_MNISTClassifier gls1eb0w 4b1f366d-5c6a-40dc-9976-3d7500703088 -- POST / 200 357.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,310 mnist_classifier_MNISTClassifier gls1eb0w b409ae40-8f1d-44d8-93e0-fc9614b68912 -- POST / 200 356.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,310 mnist_classifier_MNISTClassifier gls1eb0w a60f74f4-fb02-4698-aae7-a8e54e03389c -- POST / 200 356.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,311 mnist_classifier_MNISTClassifier gls1eb0w 7dce5c3c-969a-4914-8dc1-f08b16c94ff4 -- POST / 200 356.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,311 mnist_classifier_MNISTClassifier gls1eb0w e3be3641-9e9d-4ac6-b9b7-508f5dd35551 -- POST / 200 355.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,311 mnist_classifier_MNISTClassifier gls1eb0w 5fb4d2ad-b987-46d2-bc22-50b7e646a471 -- POST / 200 197.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,312 mnist_classifier_MNISTClassifier gls1eb0w 9fe28e52-53d9-4290-86ce-ca9f3eb25b36 -- POST / 200 197.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,312 mnist_classifier_MNISTClassifier gls1eb0w dfe02cb6-faaf-421f-ab31-09c85a83b634 -- POST / 200 197.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,312 mnist_classifier_MNISTClassifier gls1eb0w 8ad6e95f-96ee-49c7-8b27-9b4cf578964a -- POST / 200 144.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,312 mnist_classifier_MNISTClassifier gls1eb0w 3a909b41-916c-4920-a54d-6116d0823333 -- POST / 200 144.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,313 mnist_classifier_MNISTClassifier gls1eb0w 642772b5-b6eb-4c49-8cce-0148def8374f -- POST / 200 144.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,313 mnist_classifier_MNISTClassifier gls1eb0w ddd01155-6c44-4525-9fd0-2f82cabc6c83 -- POST / 200 139.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,313 mnist_classifier_MNISTClassifier gls1eb0w 506f2d02-38d5-411c-8067-faceb3fbcdfd -- POST / 200 135.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,364 mnist_classifier_MNISTClassifier gls1eb0w 53558462-6f5b-4d2e-8ee4-685901acadfd -- POST / 200 147.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,424 mnist_classifier_MNISTClassifier gls1eb0w 19895e83-33b4-455a-91f2-bfc981b4da1d -- POST / 200 206.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,425 mnist_classifier_MNISTClassifier gls1eb0w cdb2dcff-a607-404b-b003-4fdec1100ffd -- POST / 200 206.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,425 mnist_classifier_MNISTClassifier gls1eb0w 40605a60-becf-4d44-983d-b27b86300533 -- POST / 200 203.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,425 mnist_classifier_MNISTClassifier gls1eb0w 0d471bbd-f19d-48ba-b106-e87166492642 -- POST / 200 206.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,426 mnist_classifier_MNISTClassifier gls1eb0w deb7dcc4-0b43-4e62-b645-8aa1e852b619 -- POST / 200 203.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,426 mnist_classifier_MNISTClassifier gls1eb0w 46bc67e2-9f23-41f5-a2da-c35520e59fae -- POST / 200 205.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,574 mnist_classifier_MNISTClassifier gls1eb0w 3442eca3-a0c4-40ad-8ac3-65b9c21157dd -- POST / 200 299.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,575 mnist_classifier_MNISTClassifier gls1eb0w 3aec86ba-2031-4b07-a3c3-4f8e62343f7a -- POST / 200 304.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,576 mnist_classifier_MNISTClassifier gls1eb0w 42edeb15-1549-4e28-9d62-1dffff254aee -- POST / 200 304.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,577 mnist_classifier_MNISTClassifier gls1eb0w b5b5148e-db3a-42f5-b2ad-a84b4288e597 -- POST / 200 293.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,578 mnist_classifier_MNISTClassifier gls1eb0w 5f1519ed-1dfd-442a-b9fe-9cd024a73c59 -- POST / 200 274.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,579 mnist_classifier_MNISTClassifier gls1eb0w 38e35486-8c63-44e7-99dd-9feb47d5fcd3 -- POST / 200 260.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,579 mnist_classifier_MNISTClassifier gls1eb0w 09ee9e06-74bb-4845-a9c7-b865036bccfb -- POST / 200 259.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,580 mnist_classifier_MNISTClassifier gls1eb0w 41855a1b-3048-4490-b548-6c421ae71c35 -- POST / 200 257.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,581 mnist_classifier_MNISTClassifier gls1eb0w 3882a96b-d1e3-49c9-8d99-fae5e91ecb74 -- POST / 200 257.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,582 mnist_classifier_MNISTClassifier gls1eb0w cd968912-d7e3-4a7f-9a15-ea8fc248ed7a -- POST / 200 257.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,583 mnist_classifier_MNISTClassifier gls1eb0w 863bb1d5-7431-4ca5-ae97-2a0b797eed52 -- POST / 200 258.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,584 mnist_classifier_MNISTClassifier gls1eb0w 5af92348-01b9-4795-85c8-960c85e76693 -- POST / 200 258.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,584 mnist_classifier_MNISTClassifier gls1eb0w 5bf0592f-b30a-4dac-8c83-6a75968f5638 -- POST / 200 258.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,584 mnist_classifier_MNISTClassifier gls1eb0w 89d83019-7b3d-483b-87ef-1f3572090f07 -- POST / 200 256.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,587 mnist_classifier_MNISTClassifier gls1eb0w 1f18955c-66ed-4bc0-a524-e6aaa4966c17 -- POST / 200 257.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,590 mnist_classifier_MNISTClassifier gls1eb0w 66fde6b0-d906-4d57-a816-adbfa8541ff4 -- POST / 200 260.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,591 mnist_classifier_MNISTClassifier gls1eb0w 6672e99a-180f-4d84-99f1-44cd33538cf7 -- POST / 200 259.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,591 mnist_classifier_MNISTClassifier gls1eb0w d67bbeb8-9caf-4de7-99b6-9811893cec55 -- POST / 200 259.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,592 mnist_classifier_MNISTClassifier gls1eb0w 1c0b7cae-7af2-427e-a757-3616374bcd2c -- POST / 200 260.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,593 mnist_classifier_MNISTClassifier gls1eb0w c631a27a-e5a8-49f5-a4f3-f651505de936 -- POST / 200 235.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,593 mnist_classifier_MNISTClassifier gls1eb0w 97b0b60a-86d4-4508-a939-6b84c467b692 -- POST / 200 260.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,594 mnist_classifier_MNISTClassifier gls1eb0w 25cc699b-0cce-414f-aea3-442c32aa44ae -- POST / 200 244.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,595 mnist_classifier_MNISTClassifier gls1eb0w 2999af7a-d413-404f-9813-01fc5b6e1b70 -- POST / 200 243.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,596 mnist_classifier_MNISTClassifier gls1eb0w 71855141-889f-4a67-95d8-48368bbc7e57 -- POST / 200 243.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,680 mnist_classifier_MNISTClassifier gls1eb0w a9d111a4-8434-4d3d-87b4-1e3defbd4126 -- POST / 200 326.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,682 mnist_classifier_MNISTClassifier gls1eb0w 14733df2-1247-485e-acbe-3be8d7180f66 -- POST / 200 326.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,682 mnist_classifier_MNISTClassifier gls1eb0w 7c5f4abc-541f-4b17-9bfd-b48008a9d8a5 -- POST / 200 323.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,682 mnist_classifier_MNISTClassifier gls1eb0w fbc1262d-8a04-46fc-9ecf-86d26bf6604f -- POST / 200 254.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,683 mnist_classifier_MNISTClassifier gls1eb0w 276e8828-d8c7-4b74-ae44-5967941b1c4c -- POST / 200 254.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,684 mnist_classifier_MNISTClassifier gls1eb0w e7621dd5-9472-4301-ab8a-62ea4e02db02 -- POST / 200 255.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,684 mnist_classifier_MNISTClassifier gls1eb0w 24c94576-3cb2-4662-9b82-cef9105ee3de -- POST / 200 255.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,686 mnist_classifier_MNISTClassifier gls1eb0w 788d07b7-9914-441e-9245-fb4f6081e475 -- POST / 200 256.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,687 mnist_classifier_MNISTClassifier gls1eb0w fe04114e-acd4-41db-95f5-8c1e0661dfeb -- POST / 200 257.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,688 mnist_classifier_MNISTClassifier gls1eb0w 93ef479b-0e06-4fcc-814c-2f9b3d987845 -- POST / 200 257.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,689 mnist_classifier_MNISTClassifier gls1eb0w 0fa5f75e-5c8a-4e10-bdfc-b9a4de8cb6af -- POST / 200 259.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,690 mnist_classifier_MNISTClassifier gls1eb0w 4a8927b4-07a0-41a7-9a09-71aa8bdd08c8 -- POST / 200 259.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,691 mnist_classifier_MNISTClassifier gls1eb0w 0d5dd3ba-b89b-4691-826d-5ddff1855b29 -- POST / 200 260.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,691 mnist_classifier_MNISTClassifier gls1eb0w f49b7c57-e6f7-4af5-acd7-5682dd7c26b8 -- POST / 200 260.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,694 mnist_classifier_MNISTClassifier gls1eb0w 1199e88e-54e0-4299-a228-d94aa854550f -- POST / 200 260.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,695 mnist_classifier_MNISTClassifier gls1eb0w 4a4c398c-f5be-4f90-b6a8-90928e63ece9 -- POST / 200 261.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,699 mnist_classifier_MNISTClassifier gls1eb0w e102d544-fee7-45dc-a69b-c6876a3f8002 -- POST / 200 268.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,701 mnist_classifier_MNISTClassifier gls1eb0w 0dac11aa-f5e5-4343-8f8c-3e12303c52fb -- POST / 200 270.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,703 mnist_classifier_MNISTClassifier gls1eb0w 11b98c36-1dda-4774-a974-b20f1be1b9e4 -- POST / 200 271.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,704 mnist_classifier_MNISTClassifier gls1eb0w fe20cb3b-8f51-4b1f-bf97-7a71f708cf3e -- POST / 200 267.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,707 mnist_classifier_MNISTClassifier gls1eb0w 04b86ffc-c8a7-4cd2-a002-540a4952b990 -- POST / 200 270.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,708 mnist_classifier_MNISTClassifier gls1eb0w 0b78ee5e-a159-4fc1-9185-8dae18f1a961 -- POST / 200 273.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,710 mnist_classifier_MNISTClassifier gls1eb0w c3a54d34-33db-4308-b94e-4b97116b9d8c -- POST / 200 272.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,713 mnist_classifier_MNISTClassifier gls1eb0w 7ed43647-12ab-41b0-804f-57819156888a -- POST / 200 273.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,715 mnist_classifier_MNISTClassifier gls1eb0w b1fd2899-9395-4fa2-8c63-2cd18d1ec8da -- POST / 200 277.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,716 mnist_classifier_MNISTClassifier gls1eb0w ac233cb1-a746-4de5-9749-a04e247b390b -- POST / 200 277.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,716 mnist_classifier_MNISTClassifier gls1eb0w e225bbf0-0262-42c7-949d-fb077164eb60 -- POST / 200 277.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,716 mnist_classifier_MNISTClassifier gls1eb0w 09af2d2b-d5af-425f-ad2c-6806adbe61ae -- POST / 200 276.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,717 mnist_classifier_MNISTClassifier gls1eb0w e08fce00-d9c9-4d87-a7b8-90c71e95dfc8 -- POST / 200 276.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,718 mnist_classifier_MNISTClassifier gls1eb0w 2edf3e20-6909-4929-8821-30517335e9e5 -- POST / 200 275.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,720 mnist_classifier_MNISTClassifier gls1eb0w 88a99a85-b1b0-48d8-adcc-2faf66901ebe -- POST / 200 277.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,722 mnist_classifier_MNISTClassifier gls1eb0w 59d20b7e-5cac-4cf7-bbdb-533cda5d6024 -- POST / 200 277.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,722 mnist_classifier_MNISTClassifier gls1eb0w a0dde793-358c-4820-8381-85327b3eac72 -- POST / 200 277.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,723 mnist_classifier_MNISTClassifier gls1eb0w bdadce8c-77b0-4b0a-919a-cd2674a5ae4a -- POST / 200 276.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,724 mnist_classifier_MNISTClassifier gls1eb0w e3176d9b-4421-4f23-a91e-6f815e373589 -- POST / 200 277.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,726 mnist_classifier_MNISTClassifier gls1eb0w 9d1167d7-11e6-45d2-8b9a-92fdb30d0bab -- POST / 200 277.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,728 mnist_classifier_MNISTClassifier gls1eb0w 5fccfcf6-fc25-49a9-8827-c356a3ad7d4b -- POST / 200 279.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,730 mnist_classifier_MNISTClassifier gls1eb0w a40b24c1-b29a-47c2-a4b6-d13dda2e12a3 -- POST / 200 279.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,731 mnist_classifier_MNISTClassifier gls1eb0w 0c3c2841-3f93-465c-b243-851d51e84f32 -- POST / 200 279.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,732 mnist_classifier_MNISTClassifier gls1eb0w 47f73bf0-5410-4665-a461-09d9ae4d8bd2 -- POST / 200 279.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,732 mnist_classifier_MNISTClassifier gls1eb0w 666929d9-cded-49c3-b745-ae1fb3f970a0 -- POST / 200 279.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,733 mnist_classifier_MNISTClassifier gls1eb0w d0666310-8d37-44a8-a527-5319da4d5999 -- POST / 200 280.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,735 mnist_classifier_MNISTClassifier gls1eb0w c6edb1ba-bae8-421e-8a32-40c677caa3e1 -- POST / 200 281.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,735 mnist_classifier_MNISTClassifier gls1eb0w e2c46d53-840d-4c2e-a53a-e7f9f5f05e41 -- POST / 200 279.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,736 mnist_classifier_MNISTClassifier gls1eb0w 6933d9ad-23b5-47d2-a781-26ef590a4601 -- POST / 200 280.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,737 mnist_classifier_MNISTClassifier gls1eb0w 29b1fa61-1ddd-4e85-a238-a4d310ae5460 -- POST / 200 277.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,738 mnist_classifier_MNISTClassifier gls1eb0w ce70012b-b001-4584-b2cd-73beb1c2b95e -- POST / 200 278.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,738 mnist_classifier_MNISTClassifier gls1eb0w 81deef19-2154-4262-a404-5e7fa1844ef5 -- POST / 200 278.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,738 mnist_classifier_MNISTClassifier gls1eb0w b13b0620-486e-4e0e-8788-dc9f14353cce -- POST / 200 278.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,738 mnist_classifier_MNISTClassifier gls1eb0w a140c3b3-4ca9-461d-9abe-a39bcf5b9538 -- POST / 200 278.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,739 mnist_classifier_MNISTClassifier gls1eb0w 60af03e1-1b46-4090-afb0-83c8ef29e61a -- POST / 200 277.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,743 mnist_classifier_MNISTClassifier gls1eb0w ac9232fc-eb59-46dc-b81e-0b8cd6bcfca1 -- POST / 200 281.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,744 mnist_classifier_MNISTClassifier gls1eb0w 3d3493e0-dfd2-496e-8303-3590782efa39 -- POST / 200 281.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,747 mnist_classifier_MNISTClassifier gls1eb0w 7f75dfc5-4ac0-41fc-8ac1-6e479e97cac9 -- POST / 200 284.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,748 mnist_classifier_MNISTClassifier gls1eb0w 7bedc01b-9111-4dfb-a6b0-40bd0a6cc474 -- POST / 200 282.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,748 mnist_classifier_MNISTClassifier gls1eb0w f4991c26-a7f4-42c0-8536-305f697716d3 -- POST / 200 283.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,749 mnist_classifier_MNISTClassifier gls1eb0w e3117918-3d13-4d48-93b1-0feaf2560e4a -- POST / 200 282.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,751 mnist_classifier_MNISTClassifier gls1eb0w 5fcad863-0103-45a2-867c-b8c2f711b002 -- POST / 200 283.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,751 mnist_classifier_MNISTClassifier gls1eb0w 96b1238f-fbe5-4e01-970d-aa408694ce60 -- POST / 200 283.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,751 mnist_classifier_MNISTClassifier gls1eb0w d1b2fd93-742e-4b39-878a-14ea23a0a2a1 -- POST / 200 281.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,752 mnist_classifier_MNISTClassifier gls1eb0w 4463fba8-5709-4c21-a5a6-7bb66e7e4266 -- POST / 200 278.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,753 mnist_classifier_MNISTClassifier gls1eb0w 79ef6615-f099-409c-835d-ad09aa4e0bf0 -- POST / 200 280.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,754 mnist_classifier_MNISTClassifier gls1eb0w e1f03fc9-6a4b-48eb-a501-313d651f6514 -- POST / 200 281.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,756 mnist_classifier_MNISTClassifier gls1eb0w 9aae2b10-95a7-4108-ab5f-3895988bc33d -- POST / 200 281.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,757 mnist_classifier_MNISTClassifier gls1eb0w 1774ec60-a9eb-41ed-a860-b87cccc4e41d -- POST / 200 282.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,757 mnist_classifier_MNISTClassifier gls1eb0w 8051ca6d-f026-470f-997d-9b36b051b802 -- POST / 200 282.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,758 mnist_classifier_MNISTClassifier gls1eb0w 75a7bd7d-a6c0-4518-83c6-339b12a92df7 -- POST / 200 284.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,762 mnist_classifier_MNISTClassifier gls1eb0w b05a0ca3-b27b-413b-b203-2f8ce8e3fa96 -- POST / 200 287.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,762 mnist_classifier_MNISTClassifier gls1eb0w dbb5c4dd-5493-4285-8a3f-2a22f61e9311 -- POST / 200 286.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,763 mnist_classifier_MNISTClassifier gls1eb0w e93e42f4-4bf6-44c5-b874-1ebede398bcf -- POST / 200 256.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,764 mnist_classifier_MNISTClassifier gls1eb0w d58af86f-d020-4bd6-9baa-36b252e0d953 -- POST / 200 256.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,764 mnist_classifier_MNISTClassifier gls1eb0w 23453ec5-67c9-4a83-8a65-2e6f2673b23a -- POST / 200 254.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,764 mnist_classifier_MNISTClassifier gls1eb0w b31f0c57-dccb-436d-8a8a-3be2315cc194 -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,764 mnist_classifier_MNISTClassifier gls1eb0w e82000a2-be8f-46a3-9787-df9c6b2fda01 -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,765 mnist_classifier_MNISTClassifier gls1eb0w a75ccedb-1e6e-444b-b780-ea52737b9286 -- POST / 200 249.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,765 mnist_classifier_MNISTClassifier gls1eb0w 834fb105-80a0-4941-a9f7-449e7952270b -- POST / 200 248.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,823 mnist_classifier_MNISTClassifier gls1eb0w 5f1130d8-43ba-4316-b7de-e01da8e0e201 -- POST / 200 254.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,846 mnist_classifier_MNISTClassifier gls1eb0w 51aa3ee6-6c9e-468e-b48d-eea3c75ce988 -- POST / 200 277.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,848 mnist_classifier_MNISTClassifier gls1eb0w 81810fe2-3db4-4172-a334-647e80e6bff6 -- POST / 200 284.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,849 mnist_classifier_MNISTClassifier gls1eb0w 57cdeb8e-abc4-4c4a-b9d4-2073a5bae380 -- POST / 200 284.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,849 mnist_classifier_MNISTClassifier gls1eb0w b6d78af4-fd14-41b6-a5ee-1dad3b1ddb53 -- POST / 200 281.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,849 mnist_classifier_MNISTClassifier gls1eb0w f8424dca-ec53-403b-a49a-e538ade27e9c -- POST / 200 280.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,850 mnist_classifier_MNISTClassifier gls1eb0w 495176c2-0b35-441f-a14f-b389e7563b6e -- POST / 200 227.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,850 mnist_classifier_MNISTClassifier gls1eb0w d52703c2-e094-4dfb-8930-2f758862a5cf -- POST / 200 216.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,850 mnist_classifier_MNISTClassifier gls1eb0w e48b2898-53d1-4060-b6de-3b23f5c53c17 -- POST / 200 214.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,850 mnist_classifier_MNISTClassifier gls1eb0w 5f9f2c35-cb7b-4666-b5c4-6efc8e0dbd08 -- POST / 200 214.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,850 mnist_classifier_MNISTClassifier gls1eb0w 0d0a5cca-af6c-4a05-8caa-4aad9d289004 -- POST / 200 214.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,851 mnist_classifier_MNISTClassifier gls1eb0w 39515287-3f39-4f34-b892-26798da691f2 -- POST / 200 213.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,851 mnist_classifier_MNISTClassifier gls1eb0w 801ea42c-a350-4831-9110-4725419b9879 -- POST / 200 213.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,851 mnist_classifier_MNISTClassifier gls1eb0w 8c2cca5b-d2e1-4886-969e-3572dd2c59f2 -- POST / 200 214.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,851 mnist_classifier_MNISTClassifier gls1eb0w ed56d37f-383d-45cb-8494-4b1d889a95a3 -- POST / 200 214.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,853 mnist_classifier_MNISTClassifier gls1eb0w d14828f6-fcae-4e4a-a559-bef157c4b961 -- POST / 200 215.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,857 mnist_classifier_MNISTClassifier gls1eb0w 177a2003-f324-4dc7-a26a-89c5da4ccc63 -- POST / 200 219.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,861 mnist_classifier_MNISTClassifier gls1eb0w aaf9a84e-738e-4c8a-b122-b321203fa0ac -- POST / 200 222.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,861 mnist_classifier_MNISTClassifier gls1eb0w 4667d8ce-eedb-41cc-8cb7-883550a7aab8 -- POST / 200 223.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,862 mnist_classifier_MNISTClassifier gls1eb0w 8d4bb15a-93e8-4bef-b0bb-7f73692691af -- POST / 200 222.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,862 mnist_classifier_MNISTClassifier gls1eb0w 32ddfd1d-32be-43e5-8c66-90d237cbc036 -- POST / 200 223.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,864 mnist_classifier_MNISTClassifier gls1eb0w b2253039-93a7-43c8-b916-44f241834a5b -- POST / 200 225.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,864 mnist_classifier_MNISTClassifier gls1eb0w 9a6d300c-2b49-4128-be6a-7f3157d5ab13 -- POST / 200 225.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:02,865 mnist_classifier_MNISTClassifier gls1eb0w 7394525a-4cd5-4fbc-8bc7-494b10b2b9a1 -- POST / 200 226.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,138 mnist_classifier_MNISTClassifier gls1eb0w 9ed80d91-87fd-4921-95fc-20201b93156e -- POST / 200 406.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,142 mnist_classifier_MNISTClassifier gls1eb0w 847df2b3-aa91-4329-8ecb-498ed4c98817 -- POST / 200 448.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,142 mnist_classifier_MNISTClassifier gls1eb0w 348fe5b3-12b5-4f9b-9da5-d2c3207dbe04 -- POST / 200 448.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,144 mnist_classifier_MNISTClassifier gls1eb0w a8cdd533-d8f6-4a8a-be16-42b716e543fa -- POST / 200 449.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,144 mnist_classifier_MNISTClassifier gls1eb0w b1311ad3-9028-4762-96c4-82b7d5fc1064 -- POST / 200 450.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,148 mnist_classifier_MNISTClassifier gls1eb0w 32fc93d1-e964-4b5c-bf20-cc1228264649 -- POST / 200 428.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,149 mnist_classifier_MNISTClassifier gls1eb0w ab5420c1-ee4f-42fc-82d3-ee9f148bd4a1 -- POST / 200 406.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,150 mnist_classifier_MNISTClassifier gls1eb0w e846f18a-5e6d-4038-b1a6-bbb49b8e8925 -- POST / 200 391.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,151 mnist_classifier_MNISTClassifier gls1eb0w 7ec43ad8-a03a-46e4-b749-a97e98cc4ea6 -- POST / 200 392.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,153 mnist_classifier_MNISTClassifier gls1eb0w 937b1fa2-737b-4661-91e2-c303acf7b0fb -- POST / 200 387.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,153 mnist_classifier_MNISTClassifier gls1eb0w f99aedb6-bc6a-490e-a2ae-f170ada92692 -- POST / 200 384.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,158 mnist_classifier_MNISTClassifier gls1eb0w 989628d4-77b6-4375-97b4-1058f9095840 -- POST / 200 389.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,163 mnist_classifier_MNISTClassifier gls1eb0w 085aa094-9142-4fba-8d43-6c7bb52e2ae6 -- POST / 200 394.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,165 mnist_classifier_MNISTClassifier gls1eb0w dd0c409b-8d88-4e3e-9749-8b265950d1f5 -- POST / 200 395.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,166 mnist_classifier_MNISTClassifier gls1eb0w 3547815f-57b2-498d-ac40-bdf563cc3837 -- POST / 200 391.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,166 mnist_classifier_MNISTClassifier gls1eb0w afe7c453-4b02-4ee8-853c-11027426bf5d -- POST / 200 392.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,167 mnist_classifier_MNISTClassifier gls1eb0w a669eb94-ca80-4562-af5d-4d3371fe3798 -- POST / 200 391.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,167 mnist_classifier_MNISTClassifier gls1eb0w 1627ba20-db89-45d6-a67f-765aa2500a8b -- POST / 200 390.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,167 mnist_classifier_MNISTClassifier gls1eb0w e1280146-3413-4a1b-9249-1c537be51095 -- POST / 200 389.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,168 mnist_classifier_MNISTClassifier gls1eb0w 913a82a1-aeb2-4bf5-aee2-3433e95d0cc4 -- POST / 200 389.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,169 mnist_classifier_MNISTClassifier gls1eb0w 8d7eba85-441d-4da8-b0c3-6235c2164af7 -- POST / 200 389.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,170 mnist_classifier_MNISTClassifier gls1eb0w 86d63a9b-11b0-4d43-8bc6-14d60fd88e29 -- POST / 200 389.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,171 mnist_classifier_MNISTClassifier gls1eb0w d333d494-c25a-4eaa-8a54-87969bf0c575 -- POST / 200 383.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,171 mnist_classifier_MNISTClassifier gls1eb0w 13ca7acf-85bd-4a5a-a748-9c76a9a366a2 -- POST / 200 390.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,172 mnist_classifier_MNISTClassifier gls1eb0w f96f1bf0-b967-4dd7-9d5f-162859dda368 -- POST / 200 389.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,223 mnist_classifier_MNISTClassifier gls1eb0w 6c5b364c-84cb-4804-afa8-16f26d157a3e -- POST / 200 440.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,226 mnist_classifier_MNISTClassifier gls1eb0w 2cd39f21-39c4-4cd7-9ea1-3caafe525128 -- POST / 200 442.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,228 mnist_classifier_MNISTClassifier gls1eb0w b982ac99-6cda-47e1-9584-cbf88c2f5f9d -- POST / 200 441.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,229 mnist_classifier_MNISTClassifier gls1eb0w 4ed6f125-fb32-42e9-81a2-f77f69bd3966 -- POST / 200 439.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,229 mnist_classifier_MNISTClassifier gls1eb0w 46e328dc-0df1-4503-ad70-cc3d7d007641 -- POST / 200 439.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,230 mnist_classifier_MNISTClassifier gls1eb0w a7171330-b31b-4955-80a2-25cd96e20c92 -- POST / 200 439.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,230 mnist_classifier_MNISTClassifier gls1eb0w 51ddb050-4308-4145-a7e7-c9621510320d -- POST / 200 424.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,234 mnist_classifier_MNISTClassifier gls1eb0w 00cb6e89-a688-47d9-a23a-cbab381c5f2a -- POST / 200 443.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,236 mnist_classifier_MNISTClassifier gls1eb0w dbec0bfc-1876-4e66-b521-0bae60c05d0f -- POST / 200 445.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,236 mnist_classifier_MNISTClassifier gls1eb0w 8260a5aa-49a0-4314-9eb7-5416ee4ae28b -- POST / 200 442.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,237 mnist_classifier_MNISTClassifier gls1eb0w dcaa1956-0b82-4925-bbcb-803321aec2aa -- POST / 200 440.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,238 mnist_classifier_MNISTClassifier gls1eb0w 9964083c-4e1a-4f63-9b3b-85e36ac3dfec -- POST / 200 440.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,239 mnist_classifier_MNISTClassifier gls1eb0w 59f4a504-5878-4d48-84ea-cce7920ef03f -- POST / 200 441.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,239 mnist_classifier_MNISTClassifier gls1eb0w 53c15727-71cb-4ad3-bf8e-e2bc513b2efc -- POST / 200 439.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,240 mnist_classifier_MNISTClassifier gls1eb0w 162d9072-eff5-44f2-bc6d-02e8581d4139 -- POST / 200 439.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,243 mnist_classifier_MNISTClassifier gls1eb0w defe728d-742f-4844-be20-57c57300b690 -- POST / 200 438.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,244 mnist_classifier_MNISTClassifier gls1eb0w 350617af-0279-4903-ab3c-cdc44047fca5 -- POST / 200 431.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,249 mnist_classifier_MNISTClassifier gls1eb0w 5d9b6208-2be5-41c2-86ca-db03e7dbb09f -- POST / 200 441.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,251 mnist_classifier_MNISTClassifier gls1eb0w 707f15f8-3dd2-4f2d-87a1-0d4715cf06dc -- POST / 200 439.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,251 mnist_classifier_MNISTClassifier gls1eb0w 76444874-78cc-4606-b6e3-4aa7aab028c3 -- POST / 200 435.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,252 mnist_classifier_MNISTClassifier gls1eb0w 469a1bc7-1e0f-4941-b476-e93396f19d4a -- POST / 200 432.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,252 mnist_classifier_MNISTClassifier gls1eb0w 1fbedd5a-ce75-4456-ae54-203fa135f4cc -- POST / 200 433.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,253 mnist_classifier_MNISTClassifier gls1eb0w d6323418-a5cd-4042-81fb-846d5d141448 -- POST / 200 408.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,254 mnist_classifier_MNISTClassifier gls1eb0w 322e6d39-ac3b-43a3-b9d7-3d7faa49f2a5 -- POST / 200 409.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,257 mnist_classifier_MNISTClassifier gls1eb0w 30c02628-2d51-49a2-bccc-f6cb997de4dd -- POST / 200 390.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,257 mnist_classifier_MNISTClassifier gls1eb0w 1d62275f-e69f-41ef-a21e-7b39ff652421 -- POST / 200 391.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,259 mnist_classifier_MNISTClassifier gls1eb0w 23b42c10-9e75-42dd-a149-f9481cd04c78 -- POST / 200 392.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,261 mnist_classifier_MNISTClassifier gls1eb0w a017f97a-eb74-4b80-b82a-40a9921a842f -- POST / 200 394.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,272 mnist_classifier_MNISTClassifier gls1eb0w 639c41c7-8d94-4332-906a-b7fbcc7e1da4 -- POST / 200 404.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,276 mnist_classifier_MNISTClassifier gls1eb0w dc3dd70a-4488-4182-845b-b8427adb7b5a -- POST / 200 406.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,292 mnist_classifier_MNISTClassifier gls1eb0w e27e67e2-dc99-47cc-b316-a994bdaf430c -- POST / 200 423.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,293 mnist_classifier_MNISTClassifier gls1eb0w 4bd471c3-b1d4-4995-a478-3e7d1fc5328a -- POST / 200 423.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,294 mnist_classifier_MNISTClassifier gls1eb0w 7ae4a585-bf7c-43c7-91ab-7e3e2ea3c59d -- POST / 200 423.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,294 mnist_classifier_MNISTClassifier gls1eb0w dd9d3536-76de-477a-84b5-1fe6b97cdf11 -- POST / 200 424.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,294 mnist_classifier_MNISTClassifier gls1eb0w c5413713-62e0-4a51-bb4f-82823ff351a6 -- POST / 200 424.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,295 mnist_classifier_MNISTClassifier gls1eb0w 57519ccd-b954-4ac8-9143-8ba9a6d52855 -- POST / 200 402.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,295 mnist_classifier_MNISTClassifier gls1eb0w fd36b39b-bf89-4143-9a32-909a211a3307 -- POST / 200 402.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,296 mnist_classifier_MNISTClassifier gls1eb0w 79a8e563-2d83-4b70-9201-e5ac94700185 -- POST / 200 399.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,296 mnist_classifier_MNISTClassifier gls1eb0w 8014c849-24d2-482c-8db0-6e9de64d1948 -- POST / 200 402.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,296 mnist_classifier_MNISTClassifier gls1eb0w 2a12b516-9adc-44da-bf04-2a36ca858103 -- POST / 200 400.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,297 mnist_classifier_MNISTClassifier gls1eb0w f08c1d99-8ead-4e4c-aeb9-be4c1cc3b349 -- POST / 200 402.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,297 mnist_classifier_MNISTClassifier gls1eb0w a0f414bd-69b3-4a6a-b679-c53ae1b056b8 -- POST / 200 400.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,300 mnist_classifier_MNISTClassifier gls1eb0w 6c779c4f-c48c-4130-a6e6-85a741059da2 -- POST / 200 401.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,300 mnist_classifier_MNISTClassifier gls1eb0w c6c2bd11-f157-4de3-97a8-4060dc9a77bc -- POST / 200 402.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,301 mnist_classifier_MNISTClassifier gls1eb0w 8fa14240-a105-4365-998d-5680099a3295 -- POST / 200 399.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,301 mnist_classifier_MNISTClassifier gls1eb0w d8c629dd-d886-4eb1-bb53-c45f0ba1b828 -- POST / 200 402.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,301 mnist_classifier_MNISTClassifier gls1eb0w 5ed56291-ee8f-4445-94b0-f3eea70adc71 -- POST / 200 399.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,301 mnist_classifier_MNISTClassifier gls1eb0w fe21eaf2-4ca4-402c-8e7c-a6e0b62a9c30 -- POST / 200 398.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,302 mnist_classifier_MNISTClassifier gls1eb0w 22c43247-b003-4a00-b2c9-c4f87c24dff2 -- POST / 200 397.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,303 mnist_classifier_MNISTClassifier gls1eb0w fabee695-4f9d-4f90-8575-96a4b87fab99 -- POST / 200 397.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,303 mnist_classifier_MNISTClassifier gls1eb0w 2ba6fa9b-28ea-4e02-a982-bef3ea3c8cfa -- POST / 200 391.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,386 mnist_classifier_MNISTClassifier gls1eb0w 6f967e36-7193-4625-82cf-86e1f1f88976 -- POST / 200 317.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,387 mnist_classifier_MNISTClassifier gls1eb0w 11e1b9fb-b51a-4c54-8950-4737ea8407cf -- POST / 200 317.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,388 mnist_classifier_MNISTClassifier gls1eb0w 6014da4a-dcdb-4fd9-ac09-4266ff1930ab -- POST / 200 317.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,390 mnist_classifier_MNISTClassifier gls1eb0w fb0d5ccd-8544-442d-9696-002eb94ce734 -- POST / 200 317.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,390 mnist_classifier_MNISTClassifier gls1eb0w 7fae93d4-d743-41c8-aad9-4c25293f097b -- POST / 200 319.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,391 mnist_classifier_MNISTClassifier gls1eb0w 8e81e57d-0c59-47d0-aacd-1b55e79ccb1c -- POST / 200 318.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,391 mnist_classifier_MNISTClassifier gls1eb0w b368015a-daa2-4209-970c-b3c30b7aace4 -- POST / 200 320.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,394 mnist_classifier_MNISTClassifier gls1eb0w 7505997e-3e06-4657-a594-b7c6ea1e64d1 -- POST / 200 315.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,394 mnist_classifier_MNISTClassifier gls1eb0w 85ac30d7-02d6-4b12-9756-ece7aff73c63 -- POST / 200 320.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,397 mnist_classifier_MNISTClassifier gls1eb0w d4e913e9-b624-4e9c-aa53-7e6802e33820 -- POST / 200 321.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,399 mnist_classifier_MNISTClassifier gls1eb0w 100957c6-1b96-418f-aa42-e0797fcf7d25 -- POST / 200 323.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,406 mnist_classifier_MNISTClassifier gls1eb0w df02c88e-f9fd-496f-8ae8-1dad992b06cd -- POST / 200 329.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,407 mnist_classifier_MNISTClassifier gls1eb0w 23ea379d-b38a-4d78-a0f8-5b32e5ef28a0 -- POST / 200 330.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,408 mnist_classifier_MNISTClassifier gls1eb0w 277220a8-6f7f-4e92-a748-02f9ff258ebe -- POST / 200 329.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,409 mnist_classifier_MNISTClassifier gls1eb0w 56c78db0-005d-47a7-a8d7-9177c01dc4d7 -- POST / 200 328.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,409 mnist_classifier_MNISTClassifier gls1eb0w b51f6981-060b-4ff8-921c-9c363e52401b -- POST / 200 328.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,411 mnist_classifier_MNISTClassifier gls1eb0w 944ad226-2e06-4a98-8a94-99fe71aceae5 -- POST / 200 331.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,413 mnist_classifier_MNISTClassifier gls1eb0w c9a8eee1-8a8f-4ea4-b091-02d2bc04371b -- POST / 200 332.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,415 mnist_classifier_MNISTClassifier gls1eb0w 577cd994-7ff2-4745-beac-7b0056c9edbc -- POST / 200 333.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,415 mnist_classifier_MNISTClassifier gls1eb0w 859ce968-4ec8-4169-a473-618092b770c5 -- POST / 200 333.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,416 mnist_classifier_MNISTClassifier gls1eb0w 9e543978-eac9-4866-a4d4-64ee7b3bfa99 -- POST / 200 290.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,417 mnist_classifier_MNISTClassifier gls1eb0w 7a0ee2e7-3347-4616-af7c-603377a8b19d -- POST / 200 334.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,417 mnist_classifier_MNISTClassifier gls1eb0w 218465dd-a588-4b3d-93cc-c10ec32a6cf3 -- POST / 200 334.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,418 mnist_classifier_MNISTClassifier gls1eb0w 4b401ba9-dfa6-4a1c-9811-60cdd789f39e -- POST / 200 334.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,419 mnist_classifier_MNISTClassifier gls1eb0w 40abd1a2-eb26-4277-8b6b-f9197982c390 -- POST / 200 335.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,420 mnist_classifier_MNISTClassifier gls1eb0w 9afe40fb-2f5f-4ca1-91e1-0f68d33d64b1 -- POST / 200 303.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,421 mnist_classifier_MNISTClassifier gls1eb0w 8e72f0c0-7747-4d7d-8cf5-e6061f438bc9 -- POST / 200 303.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,430 mnist_classifier_MNISTClassifier gls1eb0w 536ed6d0-affb-4cc0-a781-c6c70b78b060 -- POST / 200 306.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,431 mnist_classifier_MNISTClassifier gls1eb0w b4390348-bb96-4e4e-b7e2-e808a7a12e62 -- POST / 200 306.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,431 mnist_classifier_MNISTClassifier gls1eb0w 7717d80e-4c74-4c9e-94fe-9543d22bf15e -- POST / 200 306.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,433 mnist_classifier_MNISTClassifier gls1eb0w cdd0d0c8-f003-4b0a-b383-e12016c981e4 -- POST / 200 304.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,434 mnist_classifier_MNISTClassifier gls1eb0w a03f760b-b505-4836-8a2f-91625a809997 -- POST / 200 302.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,435 mnist_classifier_MNISTClassifier gls1eb0w 536e407e-74a0-49b6-aca1-2d5f3912a75e -- POST / 200 302.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,435 mnist_classifier_MNISTClassifier gls1eb0w 38ac8bfe-e47a-4efa-82ef-22866a7a580b -- POST / 200 298.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,439 mnist_classifier_MNISTClassifier gls1eb0w 37f4071d-b1b9-4e79-8454-fe8ad510fc8b -- POST / 200 301.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,441 mnist_classifier_MNISTClassifier gls1eb0w 6b2bb97d-8c4b-433a-b62b-44417ce805f0 -- POST / 200 264.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,443 mnist_classifier_MNISTClassifier gls1eb0w 7a4a8f60-9551-44b2-b173-bd8a120e8185 -- POST / 200 259.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,444 mnist_classifier_MNISTClassifier gls1eb0w 45b093c1-1e41-4063-8195-d96df284c854 -- POST / 200 260.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,448 mnist_classifier_MNISTClassifier gls1eb0w 68075d61-ffe4-4c5d-8626-d1ba04d1999e -- POST / 200 263.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,451 mnist_classifier_MNISTClassifier gls1eb0w 3a4436ed-2231-458e-9e6e-59d858475bc3 -- POST / 200 266.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,453 mnist_classifier_MNISTClassifier gls1eb0w d1a2d86d-8c73-4d26-bbc9-12468d335ae6 -- POST / 200 267.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,453 mnist_classifier_MNISTClassifier gls1eb0w f81c203d-259a-4a6d-91b5-76e08de9ba17 -- POST / 200 267.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,454 mnist_classifier_MNISTClassifier gls1eb0w f421b9af-9fcf-41c8-96a6-80fe6212c1c5 -- POST / 200 262.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,454 mnist_classifier_MNISTClassifier gls1eb0w d4fd5f63-b147-4fa3-8681-228c387ec864 -- POST / 200 267.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,456 mnist_classifier_MNISTClassifier gls1eb0w dc8d1b62-eed8-443f-ba40-fb10efd81b30 -- POST / 200 264.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,456 mnist_classifier_MNISTClassifier gls1eb0w 71df2f5a-7f2b-49bc-88e7-581a0b21e7d3 -- POST / 200 264.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,458 mnist_classifier_MNISTClassifier gls1eb0w 3bf7e863-20ea-43c4-83b6-7e638dd9f037 -- POST / 200 264.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,459 mnist_classifier_MNISTClassifier gls1eb0w 10fe8da4-49ee-4d6f-8082-fa9970d95660 -- POST / 200 264.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,459 mnist_classifier_MNISTClassifier gls1eb0w 518b34df-8cac-466d-8354-1f89ec1a0750 -- POST / 200 264.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,552 mnist_classifier_MNISTClassifier gls1eb0w ee6a98e2-066b-4605-a8fe-74b907457db6 -- POST / 200 253.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,553 mnist_classifier_MNISTClassifier gls1eb0w 05126ee3-3862-49f2-aeb5-a1165096032f -- POST / 200 331.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,554 mnist_classifier_MNISTClassifier gls1eb0w f02077da-7c73-4efe-9f25-83be4eeba7ee -- POST / 200 310.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,554 mnist_classifier_MNISTClassifier gls1eb0w 18f963e7-0331-4612-92fc-380a46ca7b76 -- POST / 200 311.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,555 mnist_classifier_MNISTClassifier gls1eb0w 19314868-692e-4a65-8fd4-c21a3d332bc1 -- POST / 200 306.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,557 mnist_classifier_MNISTClassifier gls1eb0w 99007365-5703-4da8-90c1-bf5d89ac0960 -- POST / 200 300.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,557 mnist_classifier_MNISTClassifier gls1eb0w 23aa4b5b-6ad8-42b1-a45e-b9f68dd5a626 -- POST / 200 265.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,558 mnist_classifier_MNISTClassifier gls1eb0w 349cddfc-68e4-4c0a-8183-d26125a8b172 -- POST / 200 259.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,559 mnist_classifier_MNISTClassifier gls1eb0w e1033677-a49f-48f4-865a-ca230bce241c -- POST / 200 260.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,560 mnist_classifier_MNISTClassifier gls1eb0w d423bcf7-f5e4-4024-9821-c05e3653d9f0 -- POST / 200 261.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,560 mnist_classifier_MNISTClassifier gls1eb0w 5abf9228-208b-4a5d-a7d0-713e6ff4cf20 -- POST / 200 261.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,561 mnist_classifier_MNISTClassifier gls1eb0w 2bbcd173-f083-4377-a9b0-3489aebab7fa -- POST / 200 262.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,561 mnist_classifier_MNISTClassifier gls1eb0w e93113d5-4534-4083-b369-134d12136463 -- POST / 200 261.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,563 mnist_classifier_MNISTClassifier gls1eb0w dafb6686-907d-4d6c-a328-19bc446baa59 -- POST / 200 263.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,566 mnist_classifier_MNISTClassifier gls1eb0w 356a93d1-050a-4fcd-b3a5-10b1f199a50a -- POST / 200 263.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,568 mnist_classifier_MNISTClassifier gls1eb0w 5b0b3a93-8901-431a-992b-5c3e4d3cb349 -- POST / 200 257.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,569 mnist_classifier_MNISTClassifier gls1eb0w 92c60a8d-7eb3-4a57-a9fe-ee1063215554 -- POST / 200 269.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,570 mnist_classifier_MNISTClassifier gls1eb0w d0fd78b4-061a-41fa-88c8-97b789a0f806 -- POST / 200 257.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,571 mnist_classifier_MNISTClassifier gls1eb0w 267a3153-8b9f-442b-99f7-e471cc37e607 -- POST / 200 248.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,572 mnist_classifier_MNISTClassifier gls1eb0w 3433357f-ad9a-4839-a3f5-8b488e8c8942 -- POST / 200 245.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,574 mnist_classifier_MNISTClassifier gls1eb0w 3389e66f-5a55-45e0-8f2e-c694ff196406 -- POST / 200 250.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,576 mnist_classifier_MNISTClassifier gls1eb0w 94a26857-a442-49b8-bd4f-86e4e4ae0f67 -- POST / 200 247.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,577 mnist_classifier_MNISTClassifier gls1eb0w 3361c90d-528f-4215-9dd4-6b58b051d6d9 -- POST / 200 251.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,577 mnist_classifier_MNISTClassifier gls1eb0w cb673c16-c777-474c-83ee-47dc0da9a080 -- POST / 200 248.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,578 mnist_classifier_MNISTClassifier gls1eb0w ea21ed9b-3b6e-48a2-ad6c-2ff70fdeda8c -- POST / 200 247.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,579 mnist_classifier_MNISTClassifier gls1eb0w 591123d4-78db-47b7-b939-b9bd378aee0a -- POST / 200 247.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,580 mnist_classifier_MNISTClassifier gls1eb0w be2249a9-5a13-4297-989e-5aca1700aace -- POST / 200 248.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,582 mnist_classifier_MNISTClassifier gls1eb0w 3f511153-8d66-485e-93bc-70869a7e27f2 -- POST / 200 249.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,583 mnist_classifier_MNISTClassifier gls1eb0w 3fef53d5-180c-40d6-a184-57e08ddd16ee -- POST / 200 249.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,585 mnist_classifier_MNISTClassifier gls1eb0w b779f6cb-16c3-43d3-915d-d21baadd00f5 -- POST / 200 251.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,593 mnist_classifier_MNISTClassifier gls1eb0w eacaa281-7532-4877-9ad2-f375a3920fd6 -- POST / 200 257.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,593 mnist_classifier_MNISTClassifier gls1eb0w 20206450-5cfa-4130-a504-c458423c53d4 -- POST / 200 257.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,599 mnist_classifier_MNISTClassifier gls1eb0w 68f024fb-af79-47db-b70d-a0f5bdc06b91 -- POST / 200 260.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,600 mnist_classifier_MNISTClassifier gls1eb0w b44afb02-7eef-474c-93a5-30bd572a8b91 -- POST / 200 258.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,616 mnist_classifier_MNISTClassifier gls1eb0w 9cbbb25c-d4bf-433a-887f-668c5be8de04 -- POST / 200 277.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,619 mnist_classifier_MNISTClassifier gls1eb0w 00ae3d8d-0d02-48b3-b429-b5e757852734 -- POST / 200 278.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,620 mnist_classifier_MNISTClassifier gls1eb0w 51f24dfe-b5fb-45ae-8680-5da997375227 -- POST / 200 278.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,621 mnist_classifier_MNISTClassifier gls1eb0w cb70e87f-2e97-41af-9b8e-bb97bfb651f5 -- POST / 200 279.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,621 mnist_classifier_MNISTClassifier gls1eb0w 93bf0de6-c253-4402-990e-aa6767583a5f -- POST / 200 270.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,623 mnist_classifier_MNISTClassifier gls1eb0w 9980fc53-54df-4cc0-ab99-aab63e8583e9 -- POST / 200 278.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,623 mnist_classifier_MNISTClassifier gls1eb0w 054e3da9-3796-4c5a-b2f8-0c32bdb0b93c -- POST / 200 279.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,623 mnist_classifier_MNISTClassifier gls1eb0w 26dea476-9973-45ee-8638-f02bbb90141f -- POST / 200 278.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,624 mnist_classifier_MNISTClassifier gls1eb0w f504af37-fa8d-4f14-a3db-2991932b2a2b -- POST / 200 278.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,624 mnist_classifier_MNISTClassifier gls1eb0w aa217aad-815b-4950-829b-e17d852b3596 -- POST / 200 278.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,624 mnist_classifier_MNISTClassifier gls1eb0w ddf900c3-1672-4437-92bc-fcccc0e3ef26 -- POST / 200 275.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,625 mnist_classifier_MNISTClassifier gls1eb0w 82353ee4-6dc6-4243-94ee-af57329358c1 -- POST / 200 273.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,626 mnist_classifier_MNISTClassifier gls1eb0w ca875c1f-c8be-4208-8553-6a497c0ebb7d -- POST / 200 274.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,626 mnist_classifier_MNISTClassifier gls1eb0w b35ef695-3e51-429e-a549-7653bd3e0d59 -- POST / 200 273.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,702 mnist_classifier_MNISTClassifier gls1eb0w 638741f7-d7ca-493d-b34e-d1024fff15a4 -- POST / 200 349.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,705 mnist_classifier_MNISTClassifier gls1eb0w 3eadfe20-7606-476b-9190-2a40f7b3bfca -- POST / 200 350.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,708 mnist_classifier_MNISTClassifier gls1eb0w 531aee15-310a-493d-90df-c0a8de3fcf49 -- POST / 200 352.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,709 mnist_classifier_MNISTClassifier gls1eb0w eb3d9b81-47b4-4bcf-aba0-a22e7e698827 -- POST / 200 297.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,710 mnist_classifier_MNISTClassifier gls1eb0w f3433334-4e2f-473a-b83c-a8f11788466d -- POST / 200 293.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,710 mnist_classifier_MNISTClassifier gls1eb0w 12e92a5a-0d49-4097-9c91-8eac6f812a81 -- POST / 200 275.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,711 mnist_classifier_MNISTClassifier gls1eb0w 03be4b44-93fa-4f79-b85b-c267fe8d9d59 -- POST / 200 255.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,711 mnist_classifier_MNISTClassifier gls1eb0w fb823ad9-555e-481c-96a1-f4c8ba89fe88 -- POST / 200 250.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,713 mnist_classifier_MNISTClassifier gls1eb0w 081e4e3c-885a-4204-a28e-8508e641cbbe -- POST / 200 248.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,714 mnist_classifier_MNISTClassifier gls1eb0w c807967f-9bc4-48b7-aee7-a316d040c308 -- POST / 200 248.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,717 mnist_classifier_MNISTClassifier gls1eb0w ea7caa57-7ad6-4b48-a30a-82570cafe7d9 -- POST / 200 250.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,720 mnist_classifier_MNISTClassifier gls1eb0w 9d985000-20c4-450b-9a78-fd85844a039c -- POST / 200 251.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,722 mnist_classifier_MNISTClassifier gls1eb0w a6059041-d343-4b82-891c-cab4248b3032 -- POST / 200 251.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,723 mnist_classifier_MNISTClassifier gls1eb0w a991e7c1-2128-435d-b0a6-c413b2902e9e -- POST / 200 247.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,724 mnist_classifier_MNISTClassifier gls1eb0w e020d694-2960-4541-b8a4-0bb8e7858d67 -- POST / 200 246.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,725 mnist_classifier_MNISTClassifier gls1eb0w ffde1c9c-2069-4f16-8511-b2b7970a76b7 -- POST / 200 247.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,726 mnist_classifier_MNISTClassifier gls1eb0w a54d7c00-eadb-4879-b825-be84e6b498e7 -- POST / 200 248.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,727 mnist_classifier_MNISTClassifier gls1eb0w 5d17a5c0-2796-4529-ac27-43b145d54f5a -- POST / 200 248.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,740 mnist_classifier_MNISTClassifier gls1eb0w 858e1890-925f-4acd-8239-f76e9da1a98d -- POST / 200 262.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,742 mnist_classifier_MNISTClassifier gls1eb0w 4c9f9e1f-55f9-40bd-860f-399731037465 -- POST / 200 262.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,742 mnist_classifier_MNISTClassifier gls1eb0w b5e200ea-20d2-463a-82cf-2197bfd34eb5 -- POST / 200 261.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,743 mnist_classifier_MNISTClassifier gls1eb0w a20acef9-46c8-4b8f-acee-a3eb25d871c0 -- POST / 200 259.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,743 mnist_classifier_MNISTClassifier gls1eb0w a5b2f42b-2bd7-4e17-89d6-715bbd94b683 -- POST / 200 256.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,743 mnist_classifier_MNISTClassifier gls1eb0w c43cdd27-78ab-4242-a47d-9c12dd75aad4 -- POST / 200 256.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,744 mnist_classifier_MNISTClassifier gls1eb0w a2ea8e8e-c041-4bd6-a648-bf8319c08232 -- POST / 200 256.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,744 mnist_classifier_MNISTClassifier gls1eb0w 5a1b27f7-2bf4-4a9c-8a8b-17e8e1ba017a -- POST / 200 254.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,745 mnist_classifier_MNISTClassifier gls1eb0w 89e1406b-503c-49f4-a5da-d5703da36a85 -- POST / 200 255.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,747 mnist_classifier_MNISTClassifier gls1eb0w a4da73f5-3d8e-44b3-be1c-4c42f7645269 -- POST / 200 254.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,747 mnist_classifier_MNISTClassifier gls1eb0w 6a886f01-5f0b-454b-bf7b-e2c0c9d7fc90 -- POST / 200 256.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,748 mnist_classifier_MNISTClassifier gls1eb0w 1097fc2d-179c-4bfb-8861-36dae5dd2527 -- POST / 200 255.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,749 mnist_classifier_MNISTClassifier gls1eb0w ecd24d9c-e224-4776-981b-7cc086370e1b -- POST / 200 256.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,749 mnist_classifier_MNISTClassifier gls1eb0w 9c3906c8-b779-40a0-8cca-ecd6d6b45ff7 -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,750 mnist_classifier_MNISTClassifier gls1eb0w 39f7f423-07ab-4e30-8906-edc500eb50ee -- POST / 200 256.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,750 mnist_classifier_MNISTClassifier gls1eb0w a268301f-ac4d-40f5-8f07-232556f17f68 -- POST / 200 257.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,751 mnist_classifier_MNISTClassifier gls1eb0w 494994de-d733-45f3-8760-ccca95d246b7 -- POST / 200 250.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,751 mnist_classifier_MNISTClassifier gls1eb0w 379efc06-36ac-4201-9fb9-c49440cfd03a -- POST / 200 251.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,752 mnist_classifier_MNISTClassifier gls1eb0w 113038a4-1565-45c1-8ceb-3cb894e9afab -- POST / 200 251.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,752 mnist_classifier_MNISTClassifier gls1eb0w 7ddcdc1f-2bb5-4088-8678-0f54c33f184a -- POST / 200 244.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,752 mnist_classifier_MNISTClassifier gls1eb0w 955aa286-50fd-47e6-acf4-b552fd4442d8 -- POST / 200 244.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,753 mnist_classifier_MNISTClassifier gls1eb0w c75457b3-9100-4e80-b61b-415f3f02ed36 -- POST / 200 252.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,754 mnist_classifier_MNISTClassifier gls1eb0w 7e57fd7f-bc75-47b4-b9cf-9b7c19f8c899 -- POST / 200 250.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,755 mnist_classifier_MNISTClassifier gls1eb0w 1d62e7d2-16c2-4346-a13d-dbe35fd6332a -- POST / 200 251.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,757 mnist_classifier_MNISTClassifier gls1eb0w 510afa78-2dbb-47a9-ae96-781614f89cb3 -- POST / 200 252.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,758 mnist_classifier_MNISTClassifier gls1eb0w ec37de29-15cb-436f-8e49-710dcde099ca -- POST / 200 250.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,759 mnist_classifier_MNISTClassifier gls1eb0w c5d75309-fa53-4b74-806b-2d316d5321a9 -- POST / 200 245.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,759 mnist_classifier_MNISTClassifier gls1eb0w 4a917c76-2f63-4e89-9a59-aa137105dcf2 -- POST / 200 250.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,760 mnist_classifier_MNISTClassifier gls1eb0w fb497d3e-0c94-499a-ad28-75cafe8b1333 -- POST / 200 245.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,761 mnist_classifier_MNISTClassifier gls1eb0w 5ff5009a-85a0-4afd-84e5-878de20b4fe8 -- POST / 200 252.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,761 mnist_classifier_MNISTClassifier gls1eb0w 922d77b5-a0cd-448c-86fd-0ba94da1c4e9 -- POST / 200 250.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,762 mnist_classifier_MNISTClassifier gls1eb0w ecd7f873-c68f-47d5-97fe-dfb85f5a43bd -- POST / 200 250.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,764 mnist_classifier_MNISTClassifier gls1eb0w f196316b-a24d-44db-a353-76a2619bed12 -- POST / 200 250.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,765 mnist_classifier_MNISTClassifier gls1eb0w 07482e3b-bdf1-4096-8b7d-073a97efdf68 -- POST / 200 251.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,843 mnist_classifier_MNISTClassifier gls1eb0w 7390ff85-75f5-4e24-8fb0-408d93399b7a -- POST / 200 284.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,843 mnist_classifier_MNISTClassifier gls1eb0w 831d8ade-44dd-44c0-9c82-28222886a93e -- POST / 200 294.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,844 mnist_classifier_MNISTClassifier gls1eb0w 6de0e1b5-90a3-4369-8a2f-90933698349c -- POST / 200 281.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,844 mnist_classifier_MNISTClassifier gls1eb0w 15fd1732-2a2f-42af-bf22-103094a8b6a9 -- POST / 200 270.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,845 mnist_classifier_MNISTClassifier gls1eb0w 62625b87-6719-4870-beb4-601cb3812703 -- POST / 200 262.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,845 mnist_classifier_MNISTClassifier gls1eb0w 0939ce24-0f28-4d4a-9927-2461eb110c0b -- POST / 200 229.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,846 mnist_classifier_MNISTClassifier gls1eb0w d1afe655-3137-44c3-aa60-da01b40ad91c -- POST / 200 218.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,847 mnist_classifier_MNISTClassifier gls1eb0w 7202408a-13c0-41df-8e71-fc7715f6e67e -- POST / 200 212.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,847 mnist_classifier_MNISTClassifier gls1eb0w 90634dc9-a070-4cd4-99eb-b7cb115b7b55 -- POST / 200 211.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,848 mnist_classifier_MNISTClassifier gls1eb0w 07f90ca5-e125-4b6b-8942-97d1e10ce938 -- POST / 200 213.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,849 mnist_classifier_MNISTClassifier gls1eb0w dd9898a9-dea3-425c-bcd3-93de23354332 -- POST / 200 211.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,849 mnist_classifier_MNISTClassifier gls1eb0w dddd5631-6ded-47b2-ad5c-45c14e26cd31 -- POST / 200 209.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,851 mnist_classifier_MNISTClassifier gls1eb0w 00df14a6-7d73-405b-a2c5-66fb0b0fbf02 -- POST / 200 210.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,851 mnist_classifier_MNISTClassifier gls1eb0w 354c8cdb-a3e8-42c9-8135-39f4e33a57b0 -- POST / 200 208.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,851 mnist_classifier_MNISTClassifier gls1eb0w e887383a-053c-4e80-886c-308e0c90842b -- POST / 200 205.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,852 mnist_classifier_MNISTClassifier gls1eb0w da9be102-1375-4635-9425-a97bc208338f -- POST / 200 206.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,852 mnist_classifier_MNISTClassifier gls1eb0w 6ac694c3-7b36-4d9d-bee3-c3f7af9a2c6f -- POST / 200 206.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,853 mnist_classifier_MNISTClassifier gls1eb0w b2597a28-d848-4947-a791-e4dbbfc6b2ae -- POST / 200 206.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,853 mnist_classifier_MNISTClassifier gls1eb0w 131e809a-270b-407e-a192-f0c8fd6b4352 -- POST / 200 206.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,853 mnist_classifier_MNISTClassifier gls1eb0w 82f1b0a8-c3a9-4bd4-8255-0854911251c2 -- POST / 200 205.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,854 mnist_classifier_MNISTClassifier gls1eb0w 676bfa1b-ff7e-4cdb-9393-d08f957a1f23 -- POST / 200 202.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,854 mnist_classifier_MNISTClassifier gls1eb0w 80eea1e2-285b-4b86-92c3-e88cc2282154 -- POST / 200 201.9ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,854 mnist_classifier_MNISTClassifier gls1eb0w 853b49d0-932d-4c87-92dd-7c2b7bac1e12 -- POST / 200 199.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,855 mnist_classifier_MNISTClassifier gls1eb0w e1ed075a-c0a4-47e5-9c11-9a7677d967e4 -- POST / 200 199.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,855 mnist_classifier_MNISTClassifier gls1eb0w 65a6a672-9361-422c-bcbe-2912343fe04f -- POST / 200 196.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,857 mnist_classifier_MNISTClassifier gls1eb0w 0dec4828-8ca5-4ca6-b8be-712e53ef34f9 -- POST / 200 198.0ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,858 mnist_classifier_MNISTClassifier gls1eb0w 798a7e9c-a6f8-4053-8b58-400b25c38fd2 -- POST / 200 198.7ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,858 mnist_classifier_MNISTClassifier gls1eb0w f03353cc-4b91-4c37-8634-b49cae06481a -- POST / 200 201.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,858 mnist_classifier_MNISTClassifier gls1eb0w f98021ed-b1d3-428f-9fa3-534cb44d2217 -- POST / 200 201.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,859 mnist_classifier_MNISTClassifier gls1eb0w 69c3feea-37e8-497c-9b79-ff79cd443ed8 -- POST / 200 201.8ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,859 mnist_classifier_MNISTClassifier gls1eb0w 0127977f-5b33-4e77-9954-a5423ce1413e -- POST / 200 199.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,859 mnist_classifier_MNISTClassifier gls1eb0w 28bf8767-8902-4e3f-a4d0-c187e3d0be7a -- POST / 200 199.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,860 mnist_classifier_MNISTClassifier gls1eb0w 5c51b291-2037-4dab-a759-6da067a24978 -- POST / 200 198.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,860 mnist_classifier_MNISTClassifier gls1eb0w 2ac2ea6a-1b6f-445f-9b86-b25ed4c9ccc1 -- POST / 200 197.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,860 mnist_classifier_MNISTClassifier gls1eb0w 87abe3f9-2dc5-4158-bb3b-93d9332c08e6 -- POST / 200 195.6ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,860 mnist_classifier_MNISTClassifier gls1eb0w fa8f780c-f5aa-4e2b-afca-42a4b79915ab -- POST / 200 196.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,861 mnist_classifier_MNISTClassifier gls1eb0w 0fecf7dd-161f-4673-991f-f0c8b39ae16d -- POST / 200 196.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,861 mnist_classifier_MNISTClassifier gls1eb0w b71a483c-7de7-488f-ab20-5aa193249121 -- POST / 200 196.2ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,861 mnist_classifier_MNISTClassifier gls1eb0w e0f339ee-1e07-433b-8dbd-3a5b065387a7 -- POST / 200 196.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,861 mnist_classifier_MNISTClassifier gls1eb0w 1b07652b-42d8-4c57-a307-06f147dd90d5 -- POST / 200 195.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,861 mnist_classifier_MNISTClassifier gls1eb0w a03a49aa-94aa-421f-808b-9883e0ae30b6 -- POST / 200 195.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,861 mnist_classifier_MNISTClassifier gls1eb0w 13ee54f5-6ca7-460d-b59a-e884c71a2756 -- POST / 200 195.5ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,862 mnist_classifier_MNISTClassifier gls1eb0w 87e2c3d6-d19b-4c83-857f-33533cb593fb -- POST / 200 193.4ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,862 mnist_classifier_MNISTClassifier gls1eb0w ba9dd01a-c7e4-4ef5-8e5e-bb51190e289e -- POST / 200 185.1ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,862 mnist_classifier_MNISTClassifier gls1eb0w 4f91fd58-4b4d-4b4e-91ca-90f63c2399fc -- POST / 200 184.3ms
(ServeReplica:mnist_classifier:MNISTClassifier pid=5033) INFO 2026-07-31 18:49:03,862 mnist_classifier_MNISTClassifier gls1eb0w 97d8aaf4-ae6b-4a5f-90bf-8d51c38247c8 -- POST / 200 184.3ms
Processed 1000 requests in 5.01 seconds
Throughput: 199.80 requests/second

Ray Serve automatically buffers and load balances requests across the replicas.

Fault tolerance

In production, process and machine failures are inevitable. Ray Serve is designed so that each major component in the Serve stack (the controller, replicas, and proxies) can fail and recover while your application continues to handle traffic.

Serve can also recover from larger infrastructure failures, such as entire nodes or pods failing. Serve can even recover from head node failures, or the entire head pod if deploying on KubeRay.

For more information about Ray Serve’s fault tolerance, see the Ray Serve fault-tolerance guide.

Monitor the deployment

Monitoring is critical when running large-scale deployments. The Ray dashboard displays Serve metrics like request throughput, latency, and error rates. It also shows cluster resource usage, replica status, and overall deployment health in real time. The dashboard also lets you inspect logs from individual replicas across the cluster.

For debugging, Ray offers distributed debugging tools that let you attach a debugger to running replicas across the cluster. For more information, see the Ray Serve monitoring documentation.

Conclusion

In this tutorial, you:

• Deployed a PyTorch model using Ray Serve with production best practices.

• Enabled dynamic request batching to optimize performance.

• Configured autoscaling and fractional GPU allocation to efficiently scale across a cluster.

• Tested the service with concurrent asynchronous requests.

Further reading

Ray Serve has more production features that are out of scope for this tutorial but are worth checking out:

• Specialized large language model (LLM) serving APIs that handle complexities like managing key-value (KV) caches and continuous batching.

• Model multiplexing to dynamically load and serve many different models on the same deployment. This is useful for serving per-user fine-tuned models, for example.

• Composed deployments to orchestrate multiple deployments into a single app.

For more information, see the Ray Serve documentation and Ray Serve examples.