Arize AI Litellm Using Proxy

Litellm Using Proxy

arize-tutorialstracinglitellmLLMPython

alph-notebooks/arize-tutorials / litellm-using-proxy.ipynb

Export

Run Notebooks

Contents

No cells yet

Add cells to see them here

Use LiteLLM with Arize

https://docs.litellm.ai/docs/observability/arize_integration

This method uses the litellm proxy to send the data to Arize. The callback is set in the litellm config below, instead of using OpenInference tracing.

Install Dependencies

[ ]

Set Env Variables

[ ]

Let's run a completion call and see the traces in Arize

[ ]