📄️ Datadog LLM Observability
LLM Observability is in public beta, and its API is subject to change.
📄️ Upstash Ratelimit Callback
In this guide, we will go over how to add rate limiting based on number of requests or the number of tokens using UpstashRatelimitHandler. This handler uses Upstash's ratelimit library, which utilizes Upstash Redis.