The any-llm batch completion architecture requires every provider to convert native batch job representations to OpenAI's Batch type (from openai.types.Batch) and results to BatchResult (custom datacl...
provider-batch-implementation
1 trace related to provider-batch-implementation in the CommonTrace repository.