Multi-Agent Financial Research and Question Answering System

yahoo!_finance · Finance · 2024 · source Agentic: yes · promotional bias: med · source-backed · extracted with prompt 0.5.6 (schema v2)

Generated from extraction.json — do not edit by hand. Every claim cites verbatim source evidence; stated means the quote directly asserts the claim, implied means it supports it indirectly.

Problem

Domain: Financial research question answering

Yahoo! Finance needed to help retail users ask complex financial questions across structured market data, SEC filings, news, and APIs while maintaining accuracy, compliance boundaries, and production-scale latency/cost.

Constraints:

Architecture

Yahoo! Finance uses a supervisor-subagent architecture on Amazon Bedrock Agent Core. Specialized agents handle structured financial data, insider transactions, SEC filings through RAG, and news through RAG plus restricted web search. The system combines ReAct-style adaptive reasoning, ReWOO-style parallel planning, and Reflexion-style self-review, with hybrid human/AI evaluation for quality.

Diagram confidence: reconstructed (reconstructed from prose).

flowchart LR
  supervisor-agent["Supervisor Agent"] --> financial-data-agent["Financial Data Agent"]
  supervisor-agent --> insider-transaction-agent["Insider Transaction Agent"]
  supervisor-agent --> sec-filings-agent["SEC Filings Agent"]
  supervisor-agent --> news-agent["News Agent"]
  financial-data-agent --> financial-apis["Financial APIs"]
  insider-transaction-agent --> financial-apis
  sec-filings-agent --> sec-vector-knowledge-base["SEC Vector Knowledge Base"]
  news-agent --> news-knowledge-base["News Knowledge Base"]
Drag to pan · scroll or use +/− to zoom · reconstructed from the source's described component topology

Components

Component Role Interacts with
Supervisor Agent Coordinates specialized financial subagents and synthesizes answers. Financial Data Agent, Insider Transaction Agent, SEC Filings Agent, News Agent
Financial Data Agent Uses tool calls for prices, fundamentals, and key metrics. Financial APIs
Insider Transaction Agent Accesses insider trading data through tool calls. Financial APIs
SEC Filings Agent Retrieves and reasons over indexed SEC filings. SEC Vector Knowledge Base
News Agent Retrieves news evidence and uses restricted web search when licensed data is insufficient. News Knowledge Base
Financial APIs Internal and partner APIs for structured financial data. —
SEC Vector Knowledge Base Specialized vector store over SEC documents. —
News Knowledge Base News retrieval base augmented by restricted web search. —

Data flow

A user asks a financial research question. The supervisor decomposes and routes the request to specialized subagents for prices, fundamentals, filings, news, or APIs. Structured agents call internal/partner APIs, RAG agents retrieve SEC or news evidence, and the supervisor synthesizes a compliant answer while maintaining session context.

“The Yahoo! Finance implementation features a supervisor agent that coordinates multiple specialized subagents.”summary, stated
“specialized agents handle structured data (stock prices, financials), unstructured data (SEC filings, news), and various APIs.”summary, stated

Why this architecture

Yahoo chose supervisor-subagents because a single broad agent became error-prone when overloaded with overlapping tools and documentation. Separating structured-data, filings, news, and insider-transaction capabilities reduced tool confusion and let agents use reasoning patterns suited to financial research.

“single agents, while capable with modern LLMs, become error-prone when their scope expands.”summary, stated
“Providing too many tools to a single agent leads to confusion in tool selection, especially when tool definitions overlap”summary, stated

Models used: Amazon Bedrock Agent Core models

Scale

Alternatives considered (roads not taken)

Use one broad agent with all tools

Rejected because: Too many tools and overlapping definitions caused confusion and prompt bloat.

“Providing too many tools to a single agent leads to confusion in tool selection, especially when tool definitions overlap”summary, stated

Use only ReAct-style sequential tool use

Rejected because: Financial research benefits from upfront planning, parallel data gathering, and self-reflection.

“The Yahoo! Finance system leverages aspects of all three strategies: parallel execution for efficient data gathering, self-reflection for quality assurance”summary, stated

Patterns

multi-agent-orchestration (architecture)

A supervisor coordinates specialized agents for structured data, filings, news, and insider transactions.

“The system implements a supervisor-subagent pattern, one of the most common multi-agent orchestration approaches discussed in the presentation.”summary, stated

rag-retrieval (knowledge)

SEC filings and news agents use specialized vector knowledge bases.

“an SEC filings agent implemented as a RAG-style agent with access to a specialized vector knowledge base containing indexed SEC documents”summary, stated

tool-use-orchestration (execution)

Structured-data agents call internal and partner APIs for financial data.

“a financial data agent that handles structured data queries through tool calling to internal and partner APIs for stock prices, fundamentals, and key metrics”summary, stated

Tradeoffs

Use supervisor-subagent specialization

Chose Focused financial agents over A single all-purpose financial agent.

Rationale: Specialization reduces tool confusion and lets agents excel in focused domains.

“The multi-agent approach enables agenttic specialization where specific sub-agents excel in focused domains with manageable tool sets”summary, stated

Combine reasoning patterns

Chose ReAct, ReWOO, and Reflexion-style behaviors over One fixed reasoning loop.

Rationale: Financial research needs adaptive tool use, parallel gathering, and self-review.

“parallel execution for efficient data gathering, self-reflection for quality assurance, and ReAct's adaptive reasoning for complex multi-step processes.”summary, stated

Gotchas (what bit them)

A single agent became too broad for financial research.

Root cause: Many overlapping tools and API docs caused selection confusion and prompt bloat.

Resolution: Yahoo split the system into focused subagents under a supervisor.

“causes prompt bloat as all tool definitions and API documentation must be included in the agent's context.”summary, stated

Retail finance QA must avoid financial-advice boundary violations.

Root cause: The system answers investment research questions for a high-stakes financial domain.

Resolution: The stated goal includes maintaining accuracy and avoiding financial advice.

“all while maintaining accuracy, avoiding providing financial advice, and operating at production scale.”summary, stated

Evaluation

Yahoo uses a hybrid evaluation approach combining human and AI judges, with reported accuracy, coverage, latency, cost, and concurrency metrics.

Metrics: 5-50 seconds per query · 2-5 cents per query · 100+ concurrent users · human and AI judges

“Through a hybrid evaluation approach combining human and AI judges, the system achieves strong accuracy and coverage metrics”summary, stated

Outcomes

The case cites 150 million users, 4700 filings/day, 3000 news articles/day, 5-50 second latency, and 100+ concurrent users.

“demonstrating production viability at scale with support for 100+ concurrent users.”summary, stated