ComponentWhy it is unattributedcalls$ / run
Model · 13%LLM inference (Claude Sonnet 4)Each Q&A round sends a stitched retrieval context plus the analyst question to the model and receives a structured answer with citations.tokens in: 42,000 · tokens out: 1,800Visible on the invoice.6$0.15
Prompt · 13%System prompt and few-shot examplesA 8,500-token reusable prefix defining output schema, citation format, and analyst persona is prepended to every model call without caching.tokens in: 51,000 · tokens out: 0Visible on the invoice.6$0.15
Orchestration · 2%Tool calls and agent framework hopsEach run triggers an extractor, router, and answerer tool chain; each hop is a billed LLM call. LangChain abstracts these into one logical invocation.tokens in: 6,000 · tokens out: 400Framework abstraction (LangChain / LlamaIndex) hides per-hop billing inside one logical call on the dashboard.8$0.024
Retrieval · 6%Vector search and embedding refreshEach query hits the vector store; new transcript chunks are re-embedded every cycle using text-embedding-3-large at $0.13/M tokens.tokens in: 9,500 · tokens out: 0Embedding bills land on a separate OpenAI invoice and never join the workflow P&L visible to the CTO.14$0.069
History · 61%Context re-injection across iterationsPrior Q&A turns are re-sent in full on every follow-up call to preserve thread state. Across 5 calls, accumulated thread tokens total 230k input with no pruning policy active.tokens in: 230,000 · tokens out: 0Pure overhead - the same tokens are billed again on every turn because no pruning or compression policy has been configured.5$0.69
Connectors · 4%Connector sync to Box, Salesforce, Tableau, and SlackThe workflow polls Box for new transcript packs, normalizes each into the ingestion schema, writes structured answers back to Salesforce covered-name records, refreshes the Tableau dashboard, and posts to Slack. Each system round-trip carries a small normalization LLM call to map external fields onto the internal schema.tokens in: 12,000 · tokens out: 900Connector traffic and its normalization calls are billed to the iPaaS / integration platform (and the Box and Salesforce API tiers), never to the AI workflow P&L the CTO reviews.10$0.048
A 30-analyst desk spends ~$68k/yr on earnings analysis; 73% is context re-injection, invisible orchestration hops, and connector sync to Box/Salesforce/Slack that no one set a policy on.