GenAI-Powered Document Classification for Community Management

associa · Other · 2026 · source Agentic: no · promotional bias: med · source-backed · extracted with prompt 0.5.6 (schema v2)

Generated from extraction.json — do not edit by hand. Every claim cites verbatim source evidence; stated means the quote directly asserts the claim, implied means it supports it indirectly.

Problem

Domain: community-management document classification

Associa needed to classify and organize tens of millions of community-management documents across many document types because manual categorization was slow, error-prone, and created retrieval and operational bottlenecks.

Constraints:

Architecture

Associa and the AWS Generative AI Innovation Center built a GenAI-powered document-classification pipeline using the GenAI IDP Accelerator on AWS. The solution uses Pattern 2: Amazon Textract OCR and Amazon Bedrock classification. The team evaluated full-PDF versus first-page input, OCR+image versus image-only prompting, and multiple Bedrock models, selecting first-page-only OCR+image classification with Amazon Nova Pro because it delivered 95% overall accuracy and 85% Unknown accuracy at 0.55 cents per document.

Diagram confidence: explicit (topology described by the source).

flowchart LR
  document-management-system["Document management system"] --> genai-idp-accelerator["GenAI IDP Accelerator"]
  genai-idp-accelerator --> aws-cloudformation["AWS CloudFormation"]
  genai-idp-accelerator --> job-management-and-monitoring["Job management and monitoring"]
  genai-idp-accelerator --> amazon-textract["Amazon Textract"]
  amazon-textract --> amazon-bedrock["Amazon Bedrock"]
  amazon-bedrock --> amazon-nova-pro["Amazon Nova Pro"]
  amazon-bedrock --> model-evaluation["Model evaluation"]
  amazon-nova-pro --> document-management-system
  document-management-system --> human-review["Human review"]
Drag to pan · scroll or use +/− to zoom · reconstructed from the source's described component topology

Components

Component Role Interacts with
Document management system Existing repository containing Associa's community-management documents that need classification and retrieval. GenAI IDP Accelerator
GenAI IDP Accelerator Cloud-based AWS document-processing solution for extracting and organizing information from documents. AWS CloudFormation, Amazon Textract, Amazon Bedrock, Job management and monitoring
AWS CloudFormation Template-based deployment foundation for flexible, modular processing patterns and shared infrastructure. GenAI IDP Accelerator
Amazon Textract OCR/layout extraction component used in the selected OCR+image prompt design. Amazon Bedrock
Amazon Bedrock Model hosting layer for Amazon Nova and Anthropic Claude models used in classification experiments. Amazon Nova Pro, Model evaluation
Amazon Nova Pro Selected classifier model for the production configuration. Amazon Bedrock, Document management system
Model evaluation Evaluation harness comparing prompt input, prompt design, model choice, accuracy, Unknown accuracy, and cost. Amazon Bedrock
Human review Downstream review path for Unknown or insufficiently classifiable document types. Document management system
Job management and monitoring Shared accelerator infrastructure for job management, progress tracking, and system monitoring. GenAI IDP Accelerator

Data flow

Incoming documents enter the GenAI IDP Accelerator, which uses shared AWS infrastructure for job management, progress tracking, and monitoring. Pattern 2 extracts OCR/layout information with Amazon Textract, combines it with the first-page image in a multimodal prompt, and classifies the document with Amazon Nova Pro on Amazon Bedrock. Evaluation compares outputs against 465 labeled PDFs across eight document types plus Unknown, measuring overall accuracy, Unknown accuracy, and per-document classification cost.

3 supporting quotes
“The accelerator supports three processing patterns. We use Pattern 2 for this solution using OCR (Amazon Textract) and classification (Amazon Bedrock).”article, stated
“The evaluation dataset consists of 465 PDF documents across eight distinct document types.”article, stated
“we selected Amazon Nova Pro as the optimal model choice.”article, stated

Why this architecture

The team used the GenAI IDP Accelerator because it provided modular cloud document-processing infrastructure with OCR, classification, job tracking, and monitoring. They selected first-page OCR+image with Nova Pro because it improved accuracy and cost versus full PDFs, preserved Unknown-document performance versus image-only prompts, and balanced cost against higher-priced models.

3 supporting quotes
“The accelerator is built with a flexible, modular design using AWS CloudFormation templates”article, stated
“This comprehensive evaluation framework helped us identify the configuration that delivers the highest accuracy while minimizing processing inference costs”article, stated
“Considering the trade-offs between accuracy and cost, we selected Amazon Nova Pro as the optimal model choice.”article, stated

Models used: GenAI IDP Accelerator · Amazon Bedrock · Amazon Textract · Amazon Nova Pro · Amazon Nova Lite · Amazon Nova Premier · Anthropic Claude Sonnet 4 · AWS CloudFormation

Scale

Alternatives considered (roads not taken)

Full PDF prompt input

Rejected because: Using all pages reached 91% accuracy at 1.10 cents per document and performed poorly on Unknown documents.

“We observed an average classification accuracy of 91% considering the different document types with an average cost of 1.10 cents per document.”article, stated
“for the Unknown document type, it achieved only 40% accuracy, correctly classifying just 8 out of 20 documents.”article, stated

First-page-only input

Rejected because: This was not rejected; it was selected because it improved overall accuracy, Unknown accuracy, speed, and cost.

“This approach improved overall accuracy from 91% to 95% with 443 out of 465 documents classified correctly while reducing classification cost per document from 1.10 cents to 0.55 cents.”article, stated
“we selected the first-page-only approach for the subsequent evaluations.”article, stated

Image-only multimodal prompt without OCR

Rejected because: It reduced OCR cost but lowered overall accuracy and sharply reduced Unknown-document accuracy needed for human review.

“The image-only approach removes OCR costs but reduces overall accuracy from 95% to 93% and Unknown document accuracy from 85% to 50%.”article, stated
“Accurate Unknown document classification is critical for downstream human review and operational efficiency at Associa.”article, stated

Anthropic Claude Sonnet 4

Rejected because: It had the highest Unknown accuracy but more than doubled the per-document cost compared with Nova Pro.

“Anthropic’s Claude Sonnet 4 achieved the highest unknown document accuracy (95%)”article, stated
“However, Anthropic’s Claude Sonnet 4 increased classification cost from 0.55 cents to 1.21 cents per document.”article, stated

Amazon Nova Premier

Rejected because: It had the best overall accuracy but cost about twice as much per document as Nova Pro.

“Amazon Nova Premier achieved the best overall classification accuracy at 1.12 cents per document.”article, stated
“Considering the trade-offs between accuracy and cost, we selected Amazon Nova Pro as the optimal model choice.”article, stated

Patterns

eval-driven-development (model selection)

Associa and AWS systematically evaluated prompt input, prompt design, model choice, accuracy, Unknown accuracy, and cost before selecting the production configuration.

“We optimized the document classification workflow by evaluating three key aspects:”article, stated
“This comprehensive evaluation framework helped us identify the configuration that delivers the highest accuracy while minimizing processing inference costs”article, stated

cost-aware-routing (model operations)

Model and prompt choices were judged by accuracy and cents-per-document, leading to Nova Pro instead of more expensive Claude Sonnet 4 or Nova Premier options.

“We focus on overall classification performance, classification of unknown documents, and per-document classification costs.”article, stated
“Considering the trade-offs between accuracy and cost, we selected Amazon Nova Pro as the optimal model choice.”article, stated

latency-optimization (document processing)

The first-page-only approach was selected because first pages contained distinctive features while later pages added noise, and the approach improved processing speed and infrastructure cost.

“First pages typically contain the most distinctive document features, whereas later pages in drafts or email threads can introduce noise that confuses the classifier.”article, stated
“Combined with faster processing speeds and lower infrastructure costs, we selected the first-page-only approach”article, stated

structured-output-contract (classification)

The model classifies each PDF into a fixed set of document types plus Unknown, making outputs operationally usable in document-management workflows.

“The evaluation dataset consists of 465 PDF documents across eight distinct document types.”article, stated
“These samples are categorized as document type Unknown due to insufficient classification criteria.”article, stated

human-in-the-loop-gate (review routing)

Unknown classification is preserved because downstream human review depends on accurately identifying documents that lack sufficient classification criteria.

“Accurate Unknown document classification is critical for downstream human review and operational efficiency at Associa.”article, stated

Tradeoffs

Prompt input scope

Chose first page only over full PDF document.

Rationale: First-page classification improved accuracy from 91% to 95%, lowered cost from 1.10c to 0.55c, and improved Unknown accuracy from 40% to 85%.

“improved overall accuracy from 91% to 95% with 443 out of 465 documents classified correctly while reducing classification cost per document from 1.10 cents to 0.55 cents.”article, stated
“the first-page-only approach significantly improved Unknown document classification accuracy from 40% to 85%.”article, stated

Prompt modality

Chose OCR plus image over image-only multimodal prompting.

Rationale: Image-only was cheaper but reduced overall accuracy and especially Unknown accuracy, which was critical for downstream human review.

“The image-only approach removes OCR costs but reduces overall accuracy from 95% to 93% and Unknown document accuracy from 85% to 50%.”article, stated
“We selected the combined OCR and image approach to maintain this capability.”article, stated

Model choice

Chose Amazon Nova Pro over Nova Lite, Nova Premier, and Claude Sonnet 4.

Rationale: Nova Pro balanced 95% overall accuracy and 85% Unknown accuracy at 0.55c per document, while alternatives either lowered Unknown accuracy or increased cost.

“Amazon Nova Pro 95% 85% 0.55c Amazon Nova Lite 95% 50% 0.41c Amazon Nova Premier 96% 90% 1.12c”article, stated
“Considering the trade-offs between accuracy and cost, we selected Amazon Nova Pro as the optimal model choice.”article, stated

Gotchas (what bit them)

More document pages can reduce classification quality.

Root cause: Later pages in drafts or email threads can introduce noise that confuses the classifier.

Resolution: Use only the first page for classification because it contains the most distinctive document features.

“First pages typically contain the most distinctive document features, whereas later pages in drafts or email threads can introduce noise that confuses the classifier.”article, stated
“we selected the first-page-only approach for the subsequent evaluations.”article, stated

Removing OCR looked cheaper but harmed Unknown classification.

Root cause: Image-only prompting relies entirely on model visual understanding and missed Unknown document distinctions needed for review routing.

Resolution: Keep OCR plus image in the multimodal prompt despite higher per-document cost.

“This approach removes the Amazon Textract costs and relies entirely on the model’s understanding of visual features.”article, stated
“Unknown document accuracy from 85% to 50%. Accurate Unknown document classification is critical for downstream human review”article, stated

Overall accuracy can hide class-specific failure.

Root cause: Image-only and full-PDF configurations had acceptable-looking overall accuracy while Unknown accuracy was much lower.

Resolution: Evaluate both overall classification and Unknown-document classification when selecting the configuration.

“Although this method achieves an overall accuracy of 93%, for Unknown document types, it could classify only 10 out of 20 documents correctly with 50% accuracy.”article, stated
“We focus on overall classification performance, classification of unknown documents, and per-document classification costs.”article, stated

Class imbalance complicates evaluation.

Root cause: The dataset had document classes ranging from only 6 samples to 155 samples, making per-class performance important.

Resolution: Report class-level sample counts, correct classifications, accuracy, and cost rather than only aggregate accuracy.

“The distribution of document types across classes is unbalanced, ranging from 6 samples for Policies and Resolutions to 155 samples for Minutes.”article, stated
“The following table shows the accuracy for full PDF classification using Amazon Nova Pro with OCR and image.”article, stated

Evaluation

Associa evaluated 465 PDFs across eight document types plus Unknown, comparing full PDF versus first-page input, OCR+image versus image-only prompting, and Nova/Claude model options on overall accuracy, Unknown accuracy, and classification cost.

Metrics: overall classification accuracy · Unknown document classification accuracy · per-document classification cost · samples classified correctly · document type sample count · first-page versus full-PDF accuracy · OCR+image versus image-only accuracy

3 supporting quotes
“We optimized the document classification workflow by evaluating three key aspects:”article, stated
“The evaluation dataset consists of 465 PDF documents across eight distinct document types.”article, stated
“We focus on overall classification performance, classification of unknown documents, and per-document classification costs.”article, stated

Outcomes

Associa operates at very large document-management scale: 7.5 million homeowners, 15,000 employees, more than 300 branches, approximately 48 million documents, and 26 TB of data. The evaluated configuration uses 465 labeled PDFs and achieves 95% accuracy at 0.55 cents per document.

3 supporting quotes
“using Amazon Nova Pro on Amazon Bedrock that achieves 95% accuracy at an average cost of 0.55 cents per document.”article, stated
“The GenAI IDP Accelerator facilitates reliable performance scaling to high volume of documents across their branches.”article, stated
“The document classification system provides substantial cost savings and operational improvements”article, stated