Corpus-Complete Problem Taxonomy
Snapshot: corpus-complete-20260711 (2026-07-11) · source commit 1737631198b184e05ba0a343d67df6fa9e71b938 Scope: 1780 approved schema-v2 extractions; 1754 deduped sources; 991 deduped agentic projects.
Corpus-complete analysis output. Counts are generated from extraction.json; citations link to deterministic report.md views. This is an input to, not the output of, Phase 4 synthesis.
This taxonomy uses an agent-authored rubric. Class names, descriptions, and signals are an explicit judgment layer; assignments are then computed deterministically for reproducibility. This is not embeddings-only clustering.
Assignments are multi-label. Each project keeps one primary class for ranking, while strong cross-cutting classes such as evaluation, safety, retrieval, context, and infrastructure are retained as secondary labels.
Denominator semantics: percentages use 1754 deduplicated sources. Any-label class counts overlap and therefore do not sum to the corpus size; primary counts form the partition.
Fallback primary assignments: 0 projects (0.0% raw-project rate). Near-tied top assignments: 416 projects (23.4%).
Taxonomy Classes
| Problem class | Any-label deduped | Any-label share | Primary deduped | Primary share | Secondary-only deduped | Industries | Year trend | Top matched signals | Representative projects |
|---|---|---|---|---|---|---|---|---|---|
| Evaluation, observability, and reliability governance Systems built to evaluate, monitor, trace, govern, or continuously improve LLM behavior. |
1326 | 75.6% | 296 | 16.9% | 1030 | 16 | 2021: 2 2022: 5 2023: 240 2024: 354 2025: 425 2026: 240 |
eval (1109) monitor (1081) evaluation (962) reliability (681) quality (584) observability (235) |
2x-engineering-throughput-through-ai-first-development-platform (intercom, 2026) a-practical-blueprint-for-evaluating-conversational-ai-at-scale (dropbox, 2025) abstractive-conversation-summarization-for-google-chat-spaces (google, 2022) accelerating-drug-development-with-ai-powered-clinical-trial-transformation (novartis, 2025) |
| Enterprise knowledge retrieval and RAG Knowledge assistants, search systems, and retrieval-grounded answers over enterprise content. |
1063 | 60.6% | 506 | 28.8% | 557 | 16 | 2022: 7 2023: 171 2024: 298 2025: 362 2026: 168 |
search (840) rag (739) semantic (735) document (717) embedding (495) question answering (422) |
a-practical-blueprint-for-evaluating-conversational-ai-at-scale (dropbox, 2025) abstractive-conversation-summarization-for-google-chat-spaces (google, 2022) adopting-model-context-protocol-mcp-in-financial-services-for-ai-system-integration (evergreen_wealth_/bloomberg/_saxo_bank, 2026) advanced-context-aware-code-generation-with-custom-infrastructure-and-parallel-llm-processing (codeium, 2024) |
| Coding-agent and software delivery automation AI systems that write, review, test, migrate, or operate software engineering work. |
1022 | 58.3% | 335 | 19.1% | 687 | 16 | 2021: 1 2022: 2 2023: 168 2024: 236 2025: 323 2026: 239 |
pr (1021) ci (959) code (619) test (499) developer (208) software (170) |
2x-engineering-throughput-through-ai-first-development-platform (intercom, 2026) accelerating-drug-development-with-ai-powered-clinical-trial-transformation (novartis, 2025) accelerating-sap-s-4hana-migration-and-custom-code-documentation-with-generative-ai (axfood_/_harman, 2025) actionable-ci-intelligent-analysis-and-auto-remediation-of-ci-pipeline-failures (block, 2026) |
| Infrastructure, cost, and latency optimization Serving, inference, scale, cost, latency, and infrastructure optimization problems. |
1010 | 57.6% | 184 | 10.5% | 826 | 16 | 2021: 2 2022: 8 2023: 158 2024: 248 2025: 339 2026: 204 |
deployment (775) latency (731) cost (700) scale (498) infrastructure (350) serving (236) |
2x-engineering-throughput-through-ai-first-development-platform (intercom, 2026) a-practical-blueprint-for-evaluating-conversational-ai-at-scale (dropbox, 2025) abstractive-conversation-summarization-for-google-chat-spaces (google, 2022) accelerating-drug-development-with-ai-powered-clinical-trial-transformation (novartis, 2025) |
| Context engineering and memory management Systems centered on context construction, memory, prompt state, long context, or context compression. |
754 | 43.0% | 29 | 1.7% | 725 | 16 | 2021: 1 2022: 2 2023: 97 2024: 172 2025: 249 2026: 192 |
prompt (723) context (604) state (199) memory (174) session (89) instructions (78) |
2x-engineering-throughput-through-ai-first-development-platform (intercom, 2026) accelerating-sap-s-4hana-migration-and-custom-code-documentation-with-generative-ai (axfood_/_harman, 2025) advanced-context-aware-code-generation-with-custom-infrastructure-and-parallel-llm-processing (codeium, 2024) advanced-prompt-engineering-techniques-for-production-llm-applications (instacart, 2023) |
| Safety, compliance, and trust controls Systems constrained by safety, moderation, privacy, regulated workflows, or policy enforcement. |
688 | 39.2% | 66 | 3.8% | 622 | 16 | 2021: 2 2022: 2 2023: 112 2024: 201 2025: 247 2026: 89 |
guardrail (501) security (496) compliance (473) risk (246) trust (189) moderation (150) |
a-practical-blueprint-for-evaluating-conversational-ai-at-scale (dropbox, 2025) accelerating-drug-development-with-ai-powered-clinical-trial-transformation (novartis, 2025) adopting-model-context-protocol-mcp-in-financial-services-for-ai-system-integration (evergreen_wealth_/bloomberg/_saxo_bank, 2026) advanced-embedding-based-retrieval-for-personalized-content-discovery (pinterest, 2024) |
| Customer support and conversational service Conversational assistants for support, service, sales, education, or customer-facing workflows. |
664 | 37.9% | 222 | 12.7% | 442 | 15 | 2022: 6 2023: 95 2024: 169 2025: 239 2026: 120 |
support (512) chat (499) customer (476) chatbot (468) service (362) conversation (243) |
2x-engineering-throughput-through-ai-first-development-platform (intercom, 2026) a-practical-blueprint-for-evaluating-conversational-ai-at-scale (dropbox, 2025) abstractive-conversation-summarization-for-google-chat-spaces (google, 2022) accelerating-llm-inference-with-speculative-decoding-for-ai-agent-applications (linkedin, 2025) |
| Document processing and structured extraction Pipelines that transform documents, forms, records, or unstructured content into structured outputs. |
391 | 22.3% | 67 | 3.8% | 324 | 16 | 2021: 2 2022: 2 2023: 74 2024: 91 2025: 128 2026: 61 |
document (322) form (316) structured (297) extraction (117) metadata (70) legal (60) |
advanced-prompt-engineering-techniques-for-production-llm-applications (instacart, 2023) agent-based-workflow-automation-in-spreadsheets-for-non-technical-users (otto, 2025) agentic-ai-architecture-for-investment-management-platform (blackrock, year n/a) agentic-ai-for-legal-research-building-deep-research-in-westlaw-and-cocounsel (thomson_reuters, 2025) |
| Agentic workflow automation and orchestration Cases whose central problem is turning multi-step operational work into coordinated agent workflows. |
338 | 19.3% | 23 | 1.3% | 315 | 15 | 2023: 22 2024: 59 2025: 129 2026: 116 |
agent (338) multi-agent (318) orchestration (252) workflow (245) tool (231) autonomous (86) |
advanced-agent-monitoring-and-debugging-with-langsmith-integration (replit, 2024) agent-based-workflow-automation-in-spreadsheets-for-non-technical-users (otto, 2025) agent-first-ai-development-platform-with-multi-surface-orchestration (google_deepmind, 2025) agent-identity-and-access-management-for-production-ai-systems (uber, 2026) |
| Domain-specific model adaptation Fine-tuning, distillation, continued pretraining, or domain adaptation for specialized tasks. |
67 | 3.8% | 5 | 0.3% | 62 | 14 | 2022: 2 2023: 6 2024: 21 2025: 19 2026: 14 |
fine-tun (61) training (57) distillation (28) domain-specific (23) small language model (5) continued pretraining (3) |
advanced-fine-tuning-techniques-for-multi-agent-orchestration-at-scale (amazon, 2026) agentic-news-analysis-platform-for-digital-asset-market-making (fsi, 2025) ai-powered-audio-enhancement-for-tv-and-movie-dialogue-clarity (amazon, 2025) ai-powered-contact-center-copilot-from-research-to-enterprise-scale-production (cresta_/_openai, 2025) |
| Multimodal, edge, and voice AI systems Systems involving audio, speech, vision, wearable, mobile, or edge deployment constraints. |
67 | 3.8% | 7 | 0.4% | 60 | 12 | 2021: 1 2023: 15 2024: 15 2025: 22 2026: 10 |
multimodal (36) edge (35) image (34) vision (30) speech (26) voice (26) |
advanced-speaker-diarization-and-attributed-transcription-using-deep-learning-models (pyannoteai, 2026) agent-first-ai-development-platform-with-multi-surface-orchestration (google_deepmind, 2025) ai-driven-media-analysis-and-content-assembly-platform-for-large-scale-video-archives (bloomberg_media, 2024) ai-enhanced-body-camera-and-digital-evidence-management-in-law-enforcement (an_garda_siochanna, 2023) |
| Data analytics and decision intelligence AI systems for analytics, business intelligence, data agents, forecasting, or decision support. |
57 | 3.2% | 5 | 0.3% | 52 | 10 | 2023: 5 2024: 19 2025: 22 2026: 7 |
sql (47) analytics (37) metrics (24) decision (19) dashboard (11) business intelligence (7) |
accelerating-drug-development-with-ai-powered-clinical-trial-transformation (novartis, 2025) advancing-patient-experience-and-business-operations-analytics-with-generative-ai-in-healthcare (huron, 2025) agentic-ai-manufacturing-reasoner-for-automated-root-cause-analysis (apollo_tyres, 2025) agentic-data-analyst-for-enterprise-analytics (ramp, 2025) |
| Search, ranking, and recommendation quality Search, discovery, recommendation, matching, and ranking systems enhanced with LLMs. |
50 | 2.9% | 0 | 0.0% | 50 | 6 | 2023: 4 2024: 14 2025: 21 2026: 5 |
recommend (44) recommendation (41) ranking (27) rerank (16) discovery (15) matching (15) |
ai-driven-user-memory-system-for-dynamic-real-estate-personalization (zillow, 2025) ai-powered-conversational-food-ordering-with-ilo (ifood, 2026) ai-powered-incident-response-system-with-multi-agent-investigation (incident.io, 2025) ai-powered-performance-optimization-system-for-go-code (uber, 2024) |
| Content generation, localization, and creative operations Marketing, translation, localization, content operations, and creative generation workflows. |
40 | 2.3% | 6 | 0.3% | 34 | 8 | 2023: 10 2024: 13 2025: 11 2026: 5 |
content (35) translation (22) marketing (17) copy (11) localization (9) creative (8) |
ai-assisted-product-attribute-extraction-for-e-commerce-content-creation (zalando, 2024) ai-enhanced-body-camera-and-digital-evidence-management-in-law-enforcement (an_garda_siochanna, 2023) ai-generated-trip-reports-for-outdoor-recreation-guides (guidesly, 2026) ai-powered-ad-description-generation-for-classifieds-platform (leboncoin, 2025) |
| Enterprise AI platform adoption and governance Internal platforms, operating models, and adoption programs for scaling AI across organizations. |
33 | 1.9% | 3 | 0.2% | 30 | 11 | 2023: 5 2024: 13 2025: 9 2026: 2 |
enterprise (26) adoption (25) governance (25) platform (23) internal (22) organization (17) |
ai-powered-customer-feedback-analysis-at-scale (github, 2024) ai-powered-developer-productivity-platform-with-mcp-servers-and-agent-based-automation (bloomberg, 2025) building-a-horizontal-enterprise-agent-platform-with-infrastructure-first-approach (dust.tt, 2024) building-a-multi-provider-genai-gateway-for-enterprise-scale-llm-access (grab, 2025) |
Rubric Rationale
Agentic workflow automation and orchestration
This class captures the agentic-systems core: decomposed tasks, agent handoffs, workflow state, and tool execution.
Signals: agent, workflow, orchestration, orchestrator, multi-agent, handoff, tool, task automation, autonomous
Coding-agent and software delivery automation
Coding-agent cases have distinct constraints: repositories, CI, PRs, test loops, merge conflicts, and developer context.
Signals: coding agent, code, software, developer, github, pull request, pr, ci, test, refactor, copilot, codex
Enterprise knowledge retrieval and RAG
These projects solve knowledge access problems by retrieving, ranking, grounding, and citing internal or external content.
Signals: rag, retrieval, knowledge, search, vector, embedding, semantic, document, question answering, faq
Evaluation, observability, and reliability governance
The problem is quality control under nondeterminism: eval harnesses, traces, judges, metrics, and release gates.
Signals: evaluation, eval, observability, monitor, tracing, metrics, quality, reliability, judge, benchmark, regression
Customer support and conversational service
These cases share user-facing dialogue constraints: escalation, tone, resolution quality, and support-channel integration.
Signals: customer, support, chatbot, chat, conversation, conversational, service, sales, assistant, call center
Domain-specific model adaptation
The central problem is model behavior adaptation, not just application orchestration.
Signals: fine-tun, continued pretraining, domain-specific, domain adapted, distillation, small language model, slm, training, model adaptation
Document processing and structured extraction
These cases are shaped by document layout, schema fidelity, extraction accuracy, and review loops.
Signals: document, pdf, form, contract, invoice, metadata, extraction, structured, ocr, legal
Search, ranking, and recommendation quality
The recurring problem is improving retrieval/relevance/ranking behavior rather than general knowledge access.
Signals: ranking, recommendation, recommend, rerank, retrieval ranking, matching, discovery, commerce search, product search
Safety, compliance, and trust controls
These cases are dominated by trust boundaries and require deterministic controls around probabilistic models.
Signals: safety, compliance, privacy, security, moderation, policy, guardrail, regulated, risk, trust
Enterprise AI platform adoption and governance
The problem is organizational deployment: platforms, governance, enablement, and shared infrastructure.
Signals: enterprise, platform, adoption, governance, internal, organization, company-wide, developer platform, enablement
Context engineering and memory management
These cases make context itself the design object: what to include, retain, compress, or retrieve.
Signals: context, memory, long context, prompt, instructions, compression, compaction, session, state
Data analytics and decision intelligence
The core problem is making data and metrics answerable or actionable through AI interfaces.
Signals: analytics, data analyst, business intelligence, dashboard, sql, forecast, decision, data warehouse, metrics
Infrastructure, cost, and latency optimization
These cases are primarily about production constraints around throughput, cost, latency, and deployment architecture.
Signals: latency, cost, inference, throughput, scale, rps, deployment, gpu, cpu, infrastructure, serving
Multimodal, edge, and voice AI systems
These cases introduce modality and device constraints that change system architecture.
Signals: voice, speech, audio, vision, image, multimodal, edge, mobile, wearable, camera
Content generation, localization, and creative operations
These cases share content-production constraints: brand quality, localization, review, and throughput.
Signals: content, marketing, translation, localization, creative, copy, campaign, product description
General production LLM systems
Kept explicit so low-confidence assignments are visible rather than forced into a false cluster.
Signals: fallback class when no narrower class scores.
Design Gaps
- Multi-label assignment is signal based and intentionally conservative; reviewer sampling should check whether the secondary threshold misses cross-cutting themes.
- Any-label counts are not additive across classes because a single deduped project can appear in several cross-cutting classes.
- 0 fallback projects and 416 near-tied assignments remain explicit for reviewer inspection.
- Problem statements do not carry separate evidence arrays, so taxonomy citations point to project reports and extracted fields rather than direct problem-level quotes.