LiteLLM

LiteLLM is an open-source AI Gateway providing a unified interface for developers to access over 100 large language models from multiple providers via an OpenAI-compatible API.