Analytics Dashboard: Centralized usage tracking

[Ayush8923]

Is your feature request related to a problem?
We lack a centralized analytics dashboard to track and analyze provider-wise usage, costs, LLM call usage, organization-level usage, and evals-related consumption. This requires manual data retrieval when organizations request their monthly usage or eval costs, leading to operational overhead.

Describe the solution you'd like

• Build backend APIs for a centralized analytics dashboard
• Show all relevant data in one dashboard

Original issue

Describe the current behavior
Currently, we do not have a centralized analytics dashboard where we can track and analyze:
• provider-wise usage,
• provider-wise costs,
• LLM Call Usage
• Organization-level usage,
• and evals-related consumption details.
Because of this, whenever organizations ask for their monthly usage or total evals cost, we currently need to manually calculate or fetch the data, which creates operational dependency and overhead.

To solve this, we need to build backend APIs for a centralized analytics dashboard that can provide usage and cost insights across providers, organizations, and different workflows.

Describe the enhancement you'd like

• Need to create the one dashboard where we can show all the data.