Tokenomics

Overview

The Tokenomics dashboard turns raw AI cost and usage data into unit economics - cost per request, cost per token, cache hit rates, and output-to-input ratios - so you can answer "is our AI spend efficient?" without building your own metrics layer.

Knowing your total AI spend is step one. Knowing whether that spend is efficient is what drives optimization decisions. A $50K monthly bill means something very different at $0.02 per request than at $0.08. The Tokenomics dashboard surfaces these ratios automatically, broken down by model, provider, and use case, so you can spot which models are overpriced for their workload and where caching is - or isn't - paying off.

Dashboard layout

The page is organized top to bottom: filters and controls, KPI summary cards, a trend chart, and detail panels.

Filters and controls

ControlWhat it does
ProviderScope to one or more AI providers (top filter bar). Default: All AI providers.
AgentFilter by agent. Default: All Agents.
ModelNarrow to specific models.
WorkspaceScope to a team or business unit.
CostSelect the cost basis - e.g. Amortized. Same options as the AI Cost & Usage Explorer.
GranularityToggle between Hourly, 1M (one month, default), and 3M (three months).

KPI summary cards

The top of the dashboard shows KPI cards - each displaying a metric value, a period-over-period trend (e.g. -4.2%), the underlying formula, and colored badges indicating which providers contribute data.

Cost efficiency KPIs:

KPIFormulaWhat it tells you
Blended Cost / 1M Tokenstotal_cost / ((input + output) / 1,000,000)Your all-in cost per million tokens across all models. The single best summary metric for AI unit cost.
Cost per Requesttotal_cost / request_countAverage cost of a single API call. Use this to compare models and set per-team budgets.
Cost per Messagetotal_cost / message_countCost per end-user message, useful for consumer-facing products.
Cost per Conversationtotal_cost / conversation_countCost for a full conversation session - relevant for chat and agent workloads.
Cost per Artifacttotal_cost / artifact_countCost to produce a single artifact (e.g. a generated document or code file).
Cost per Code Filetotal_cost / code_files_generatedCost per generated code file - tracks coding agent efficiency.
Cost per Tool Calltotal_cost / tool_call_countCost per tool invocation in agentic workflows.

Token and caching KPIs:

KPIFormulaWhat it tells you
Output:Input Ratiooutput_tokens / input_tokensHow many output tokens the model generates per input token. Low ratios on generative tasks may signal over-stuffed prompts.
Cache Hit Ratecached_input_tokens / total_input_tokensShare of input tokens served from cache. Higher is better - every cache hit avoids a full-price input charge.

Spend and productivity KPIs:

KPIFormulaWhat it tells you
Priority Tier Premiumpriority_cost / standard_cost - 1How much more you're paying for priority/elevated service tiers vs. standard.
Avg AI Spend per Active Usertotal_ai_cost / active_user_countPer-user AI cost, useful for per-seat budgeting and license decisions.
PRs per Engineertotal_pull_requests / active_engineer_countDeveloper throughput metric.
📘

Provider badges

Each KPI card shows colored badges (e.g. A for Anthropic, O for OpenAI, G for Google) indicating which providers contribute data to that metric. Not all providers report all metrics.

KPI trend chart

Below the summary cards, a trend line shows the selected KPI over time. You can overlay up to 2 KPIs on the same chart to compare trends (e.g. Blended Cost / 1M Tokens alongside Cache Hit Rate). Toggle between 30D and 90D windows.

Cost per 1M Tokens by Model

A horizontal bar chart ranking models by input and output token cost. Toggle the unit between KTok (per 1,000 tokens) and MTok (per 1,000,000 tokens). Each row shows the model name with separate INPUT and OUTPUT cost columns.

Use this panel to compare pricing across models at a glance - for example, if Claude Fable 5 costs $15 input / $75 output per MTok while Claude Sonnet 5 costs $3 / $15, switching lower-complexity tasks to Sonnet delivers immediate savings.

Cost per Request by Model

A horizontal bar chart showing the average cost per API request by model, calculated as total_cost / request_count. This combines token pricing and typical request size, so a cheap-per-token model that receives long prompts may still have a high cost per request.

Token Efficiency by Use Case

Cards showing the output-to-input token ratio for each use case category. Each card displays the ratio (e.g. 1:3.2 in:out for Code Generation) and a bar showing the input/output percentage split.

Use cases with high output ratios (Code Generation, Documentation, Test Writing) are generative workloads - they're expected to produce more output than input. Use cases with high input ratios (Code Review, Debugging) are analytical - they consume long contexts and produce short assessments. If an analytical use case shows unexpectedly high output, it may be generating verbose responses that could be trimmed with prompt tuning.

Input vs. Output Tokens

A daily volume bar chart showing total input and output tokens over time, broken down by provider. Use this to spot volume trends - a sudden spike in output tokens without a corresponding input increase may indicate a change in model behavior or prompt configuration.

Optimize model selection with Tokenomics

  1. Open the Tokenomics dashboard.
  2. Review the Cost per 1M Tokens by Model panel to identify which models are most and least expensive.
  3. Cross-reference with Cost per Request by Model - a model with low per-token cost but high per-request cost may be receiving unnecessarily long prompts.
  4. Check Token Efficiency by Use Case to understand which workloads are generative vs. analytical, and match model tier to workload complexity (e.g. route Code Review to a lighter model since it's input-heavy with short output).

Validate caching ROI

  1. Check the Cache Hit Rate KPI card. A rate above 50% means most repeated prompts are being served from cache.
  2. Compare the Blended Cost / 1M Tokens trend over 30D or 90D. If cache hit rate is rising and blended cost is falling, your caching investment is paying off.
  3. If cache hit rate is low, review the token breakdown in the AI Cost & Usage Explorer to see which token types (ephemeral 5m vs. 1h) are being created and whether cache reads are actually occurring.

Did this page help you?