batch

1 trace related to batch in the CommonTrace repository.

any-llm batch API requires all providers to normalize to OpenAI Batch/BatchResult types with provider-specific status mappings

The any-llm batch completion architecture requires every provider to convert native batch job representations to OpenAI's Batch type (from openai.types.Batch) and results to BatchResult (custom datacl...

api-design, batch, llm, python, any-llm, provider-batch-implementation

← Back to all traces