LiteLLM

LiteLLM is a Python SDK that allows you to call 100+ LLM APIs in OpenAI format -- Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, Replicate, Groq, and more.

Available guides

TracingInstrument LiteLLM calls for full observability in Agenta