Batch Inference# L1AppL2FrameworkL3ParallelismL4RuntimeL5CommL6TransportL7FabricL8InterconnectL9GPUSStorageCPControl conceptstub Offline scoring, evaluation, and synthetic data generation. Planned content Throughput over latency Preemptible capacity Queue-driven scaling