Corpus-Complete Problem Taxonomy

Snapshot: corpus-complete-20260711 (2026-07-11) · source commit 1737631198b184e05ba0a343d67df6fa9e71b938 Scope: 1780 approved schema-v2 extractions; 1754 deduped sources; 991 deduped agentic projects.

Corpus-complete analysis output. Counts are generated from extraction.json; citations link to deterministic report.md views. This is an input to, not the output of, Phase 4 synthesis.

This taxonomy uses an agent-authored rubric. Class names, descriptions, and signals are an explicit judgment layer; assignments are then computed deterministically for reproducibility. This is not embeddings-only clustering.

Assignments are multi-label. Each project keeps one primary class for ranking, while strong cross-cutting classes such as evaluation, safety, retrieval, context, and infrastructure are retained as secondary labels.

Denominator semantics: percentages use 1754 deduplicated sources. Any-label class counts overlap and therefore do not sum to the corpus size; primary counts form the partition.

Fallback primary assignments: 0 projects (0.0% raw-project rate). Near-tied top assignments: 416 projects (23.4%).

Taxonomy Classes

Problem class Any-label deduped Any-label share Primary deduped Primary share Secondary-only deduped Industries Year trend Top matched signals Representative projects
Evaluation, observability, and reliability governance
Systems built to evaluate, monitor, trace, govern, or continuously improve LLM behavior.
1326 75.6% 296 16.9% 1030 16 2021: 2
2022: 5
2023: 240
2024: 354
2025: 425
2026: 240
eval (1109)
monitor (1081)
evaluation (962)
reliability (681)
quality (584)
observability (235)
2x-engineering-throughput-through-ai-first-development-platform (intercom, 2026)
a-practical-blueprint-for-evaluating-conversational-ai-at-scale (dropbox, 2025)
abstractive-conversation-summarization-for-google-chat-spaces (google, 2022)
accelerating-drug-development-with-ai-powered-clinical-trial-transformation (novartis, 2025)
Enterprise knowledge retrieval and RAG
Knowledge assistants, search systems, and retrieval-grounded answers over enterprise content.
1063 60.6% 506 28.8% 557 16 2022: 7
2023: 171
2024: 298
2025: 362
2026: 168
search (840)
rag (739)
semantic (735)
document (717)
embedding (495)
question answering (422)
a-practical-blueprint-for-evaluating-conversational-ai-at-scale (dropbox, 2025)
abstractive-conversation-summarization-for-google-chat-spaces (google, 2022)
adopting-model-context-protocol-mcp-in-financial-services-for-ai-system-integration (evergreen_wealth_/bloomberg/_saxo_bank, 2026)
advanced-context-aware-code-generation-with-custom-infrastructure-and-parallel-llm-processing (codeium, 2024)
Coding-agent and software delivery automation
AI systems that write, review, test, migrate, or operate software engineering work.
1022 58.3% 335 19.1% 687 16 2021: 1
2022: 2
2023: 168
2024: 236
2025: 323
2026: 239
pr (1021)
ci (959)
code (619)
test (499)
developer (208)
software (170)
2x-engineering-throughput-through-ai-first-development-platform (intercom, 2026)
accelerating-drug-development-with-ai-powered-clinical-trial-transformation (novartis, 2025)
accelerating-sap-s-4hana-migration-and-custom-code-documentation-with-generative-ai (axfood_/_harman, 2025)
actionable-ci-intelligent-analysis-and-auto-remediation-of-ci-pipeline-failures (block, 2026)
Infrastructure, cost, and latency optimization
Serving, inference, scale, cost, latency, and infrastructure optimization problems.
1010 57.6% 184 10.5% 826 16 2021: 2
2022: 8
2023: 158
2024: 248
2025: 339
2026: 204
deployment (775)
latency (731)
cost (700)
scale (498)
infrastructure (350)
serving (236)
2x-engineering-throughput-through-ai-first-development-platform (intercom, 2026)
a-practical-blueprint-for-evaluating-conversational-ai-at-scale (dropbox, 2025)
abstractive-conversation-summarization-for-google-chat-spaces (google, 2022)
accelerating-drug-development-with-ai-powered-clinical-trial-transformation (novartis, 2025)
Context engineering and memory management
Systems centered on context construction, memory, prompt state, long context, or context compression.
754 43.0% 29 1.7% 725 16 2021: 1
2022: 2
2023: 97
2024: 172
2025: 249
2026: 192
prompt (723)
context (604)
state (199)
memory (174)
session (89)
instructions (78)
2x-engineering-throughput-through-ai-first-development-platform (intercom, 2026)
accelerating-sap-s-4hana-migration-and-custom-code-documentation-with-generative-ai (axfood_/_harman, 2025)
advanced-context-aware-code-generation-with-custom-infrastructure-and-parallel-llm-processing (codeium, 2024)
advanced-prompt-engineering-techniques-for-production-llm-applications (instacart, 2023)
Safety, compliance, and trust controls
Systems constrained by safety, moderation, privacy, regulated workflows, or policy enforcement.
688 39.2% 66 3.8% 622 16 2021: 2
2022: 2
2023: 112
2024: 201
2025: 247
2026: 89
guardrail (501)
security (496)
compliance (473)
risk (246)
trust (189)
moderation (150)
a-practical-blueprint-for-evaluating-conversational-ai-at-scale (dropbox, 2025)
accelerating-drug-development-with-ai-powered-clinical-trial-transformation (novartis, 2025)
adopting-model-context-protocol-mcp-in-financial-services-for-ai-system-integration (evergreen_wealth_/bloomberg/_saxo_bank, 2026)
advanced-embedding-based-retrieval-for-personalized-content-discovery (pinterest, 2024)
Customer support and conversational service
Conversational assistants for support, service, sales, education, or customer-facing workflows.
664 37.9% 222 12.7% 442 15 2022: 6
2023: 95
2024: 169
2025: 239
2026: 120
support (512)
chat (499)
customer (476)
chatbot (468)
service (362)
conversation (243)
2x-engineering-throughput-through-ai-first-development-platform (intercom, 2026)
a-practical-blueprint-for-evaluating-conversational-ai-at-scale (dropbox, 2025)
abstractive-conversation-summarization-for-google-chat-spaces (google, 2022)
accelerating-llm-inference-with-speculative-decoding-for-ai-agent-applications (linkedin, 2025)
Document processing and structured extraction
Pipelines that transform documents, forms, records, or unstructured content into structured outputs.
391 22.3% 67 3.8% 324 16 2021: 2
2022: 2
2023: 74
2024: 91
2025: 128
2026: 61
document (322)
form (316)
structured (297)
extraction (117)
metadata (70)
legal (60)
advanced-prompt-engineering-techniques-for-production-llm-applications (instacart, 2023)
agent-based-workflow-automation-in-spreadsheets-for-non-technical-users (otto, 2025)
agentic-ai-architecture-for-investment-management-platform (blackrock, year n/a)
agentic-ai-for-legal-research-building-deep-research-in-westlaw-and-cocounsel (thomson_reuters, 2025)
Agentic workflow automation and orchestration
Cases whose central problem is turning multi-step operational work into coordinated agent workflows.
338 19.3% 23 1.3% 315 15 2023: 22
2024: 59
2025: 129
2026: 116
agent (338)
multi-agent (318)
orchestration (252)
workflow (245)
tool (231)
autonomous (86)
advanced-agent-monitoring-and-debugging-with-langsmith-integration (replit, 2024)
agent-based-workflow-automation-in-spreadsheets-for-non-technical-users (otto, 2025)
agent-first-ai-development-platform-with-multi-surface-orchestration (google_deepmind, 2025)
agent-identity-and-access-management-for-production-ai-systems (uber, 2026)
Domain-specific model adaptation
Fine-tuning, distillation, continued pretraining, or domain adaptation for specialized tasks.
67 3.8% 5 0.3% 62 14 2022: 2
2023: 6
2024: 21
2025: 19
2026: 14
fine-tun (61)
training (57)
distillation (28)
domain-specific (23)
small language model (5)
continued pretraining (3)
advanced-fine-tuning-techniques-for-multi-agent-orchestration-at-scale (amazon, 2026)
agentic-news-analysis-platform-for-digital-asset-market-making (fsi, 2025)
ai-powered-audio-enhancement-for-tv-and-movie-dialogue-clarity (amazon, 2025)
ai-powered-contact-center-copilot-from-research-to-enterprise-scale-production (cresta_/_openai, 2025)
Multimodal, edge, and voice AI systems
Systems involving audio, speech, vision, wearable, mobile, or edge deployment constraints.
67 3.8% 7 0.4% 60 12 2021: 1
2023: 15
2024: 15
2025: 22
2026: 10
multimodal (36)
edge (35)
image (34)
vision (30)
speech (26)
voice (26)
advanced-speaker-diarization-and-attributed-transcription-using-deep-learning-models (pyannoteai, 2026)
agent-first-ai-development-platform-with-multi-surface-orchestration (google_deepmind, 2025)
ai-driven-media-analysis-and-content-assembly-platform-for-large-scale-video-archives (bloomberg_media, 2024)
ai-enhanced-body-camera-and-digital-evidence-management-in-law-enforcement (an_garda_siochanna, 2023)
Data analytics and decision intelligence
AI systems for analytics, business intelligence, data agents, forecasting, or decision support.
57 3.2% 5 0.3% 52 10 2023: 5
2024: 19
2025: 22
2026: 7
sql (47)
analytics (37)
metrics (24)
decision (19)
dashboard (11)
business intelligence (7)
accelerating-drug-development-with-ai-powered-clinical-trial-transformation (novartis, 2025)
advancing-patient-experience-and-business-operations-analytics-with-generative-ai-in-healthcare (huron, 2025)
agentic-ai-manufacturing-reasoner-for-automated-root-cause-analysis (apollo_tyres, 2025)
agentic-data-analyst-for-enterprise-analytics (ramp, 2025)
Search, ranking, and recommendation quality
Search, discovery, recommendation, matching, and ranking systems enhanced with LLMs.
50 2.9% 0 0.0% 50 6 2023: 4
2024: 14
2025: 21
2026: 5
recommend (44)
recommendation (41)
ranking (27)
rerank (16)
discovery (15)
matching (15)
ai-driven-user-memory-system-for-dynamic-real-estate-personalization (zillow, 2025)
ai-powered-conversational-food-ordering-with-ilo (ifood, 2026)
ai-powered-incident-response-system-with-multi-agent-investigation (incident.io, 2025)
ai-powered-performance-optimization-system-for-go-code (uber, 2024)
Content generation, localization, and creative operations
Marketing, translation, localization, content operations, and creative generation workflows.
40 2.3% 6 0.3% 34 8 2023: 10
2024: 13
2025: 11
2026: 5
content (35)
translation (22)
marketing (17)
copy (11)
localization (9)
creative (8)
ai-assisted-product-attribute-extraction-for-e-commerce-content-creation (zalando, 2024)
ai-enhanced-body-camera-and-digital-evidence-management-in-law-enforcement (an_garda_siochanna, 2023)
ai-generated-trip-reports-for-outdoor-recreation-guides (guidesly, 2026)
ai-powered-ad-description-generation-for-classifieds-platform (leboncoin, 2025)
Enterprise AI platform adoption and governance
Internal platforms, operating models, and adoption programs for scaling AI across organizations.
33 1.9% 3 0.2% 30 11 2023: 5
2024: 13
2025: 9
2026: 2
enterprise (26)
adoption (25)
governance (25)
platform (23)
internal (22)
organization (17)
ai-powered-customer-feedback-analysis-at-scale (github, 2024)
ai-powered-developer-productivity-platform-with-mcp-servers-and-agent-based-automation (bloomberg, 2025)
building-a-horizontal-enterprise-agent-platform-with-infrastructure-first-approach (dust.tt, 2024)
building-a-multi-provider-genai-gateway-for-enterprise-scale-llm-access (grab, 2025)

Rubric Rationale

Agentic workflow automation and orchestration

This class captures the agentic-systems core: decomposed tasks, agent handoffs, workflow state, and tool execution.

Signals: agent, workflow, orchestration, orchestrator, multi-agent, handoff, tool, task automation, autonomous

Coding-agent and software delivery automation

Coding-agent cases have distinct constraints: repositories, CI, PRs, test loops, merge conflicts, and developer context.

Signals: coding agent, code, software, developer, github, pull request, pr, ci, test, refactor, copilot, codex

Enterprise knowledge retrieval and RAG

These projects solve knowledge access problems by retrieving, ranking, grounding, and citing internal or external content.

Signals: rag, retrieval, knowledge, search, vector, embedding, semantic, document, question answering, faq

Evaluation, observability, and reliability governance

The problem is quality control under nondeterminism: eval harnesses, traces, judges, metrics, and release gates.

Signals: evaluation, eval, observability, monitor, tracing, metrics, quality, reliability, judge, benchmark, regression

Customer support and conversational service

These cases share user-facing dialogue constraints: escalation, tone, resolution quality, and support-channel integration.

Signals: customer, support, chatbot, chat, conversation, conversational, service, sales, assistant, call center

Domain-specific model adaptation

The central problem is model behavior adaptation, not just application orchestration.

Signals: fine-tun, continued pretraining, domain-specific, domain adapted, distillation, small language model, slm, training, model adaptation

Document processing and structured extraction

These cases are shaped by document layout, schema fidelity, extraction accuracy, and review loops.

Signals: document, pdf, form, contract, invoice, metadata, extraction, structured, ocr, legal

Search, ranking, and recommendation quality

The recurring problem is improving retrieval/relevance/ranking behavior rather than general knowledge access.

Signals: ranking, recommendation, recommend, rerank, retrieval ranking, matching, discovery, commerce search, product search

Safety, compliance, and trust controls

These cases are dominated by trust boundaries and require deterministic controls around probabilistic models.

Signals: safety, compliance, privacy, security, moderation, policy, guardrail, regulated, risk, trust

Enterprise AI platform adoption and governance

The problem is organizational deployment: platforms, governance, enablement, and shared infrastructure.

Signals: enterprise, platform, adoption, governance, internal, organization, company-wide, developer platform, enablement

Context engineering and memory management

These cases make context itself the design object: what to include, retain, compress, or retrieve.

Signals: context, memory, long context, prompt, instructions, compression, compaction, session, state

Data analytics and decision intelligence

The core problem is making data and metrics answerable or actionable through AI interfaces.

Signals: analytics, data analyst, business intelligence, dashboard, sql, forecast, decision, data warehouse, metrics

Infrastructure, cost, and latency optimization

These cases are primarily about production constraints around throughput, cost, latency, and deployment architecture.

Signals: latency, cost, inference, throughput, scale, rps, deployment, gpu, cpu, infrastructure, serving

Multimodal, edge, and voice AI systems

These cases introduce modality and device constraints that change system architecture.

Signals: voice, speech, audio, vision, image, multimodal, edge, mobile, wearable, camera

Content generation, localization, and creative operations

These cases share content-production constraints: brand quality, localization, review, and throughput.

Signals: content, marketing, translation, localization, creative, copy, campaign, product description

General production LLM systems

Kept explicit so low-confidence assignments are visible rather than forced into a false cluster.

Signals: fallback class when no narrower class scores.

Design Gaps