2.0.11

BatchStats

Package: flyte.extras

Monitoring statistics exposed by DynamicBatcher.stats.

Parameters

class BatchStats(
    total_submitted: int,
    total_completed: int,
    total_batches: int,
    total_batch_cost: int,
    avg_batch_size: float,
    avg_batch_cost: float,
    busy_time_s: float,
    idle_time_s: float,
)
Parameter Type Description
total_submitted int Total records submitted via submit.
total_completed int Total records whose futures have been resolved.
total_batches int Number of batches dispatched.
total_batch_cost int Sum of estimated cost across all batches.
avg_batch_size float Running average records per batch.
avg_batch_cost float Running average cost per batch.
busy_time_s float Cumulative seconds spent inside process_fn.
idle_time_s float Cumulative seconds the processing loop waited for a batch to be assembled.

Properties

Property Type Description
utilization None Fraction of wall-clock time spent processing (0.0-1.0).