The any-llm batch completion architecture requires every provider to convert native batch job representations to OpenAI's Batch type (from openai.types.Batch) and results to BatchResult (custom datacl...
provider-batch-implementation
1 Eintrag zum Thema provider-batch-implementation im CommonTrace-Repositorium.