AI-Powered Marketing Compliance Automation System

remitly · Finance · year n/a · source Agentic: no · promotional bias: med · source-backed · extracted with prompt 0.5.4 (schema v2)

Generated from extraction.json — do not edit by hand. Every claim cites verbatim source evidence; stated means the quote directly asserts the claim, implied means it supports it indirectly.

Problem

Domain: Financial-services marketing compliance

Remitly needed to reduce slow, repetitive legal review cycles for marketing content across regulated money-transfer markets while preserving compliance with country-specific rules and keeping legal review as the final approval step.

Constraints:

Architecture

Remitly built a self-service GenAI compliance checker for English marketing text. Marketers upload content, and the system analyzes it against internal compliance guidelines derived from regulations and best practices. The analysis identifies the exact text that may violate a guideline, names the violated guideline, and suggests a compliant revision. Marketers iterate on the content until issues are resolved, then submit to legal for approval. Under the hood, the system combines Confluence/doc guideline sources, engineered prompts, and an AI analysis layer. A structured training/evaluation corpus was created from previously unstructured legal feedback, and the team optimized precision/recall through model iterations and beta usability feedback.

Diagram confidence: reconstructed (reconstructed from prose).

flowchart LR
  historical-feedback-sources["historical-feedback-sources"] --> training-evaluation-corpus["training-evaluation-corpus"]
  training-evaluation-corpus --> evaluation-loop["evaluation-loop"]
  compliance-guidelines["compliance-guidelines"] --> prompt-guidance-layer["prompt-guidance-layer"]
  compliance-guidelines --> ai-analysis-engine["ai-analysis-engine"]
  prompt-guidance-layer --> ai-analysis-engine
  marketing-content-upload["marketing-content-upload"] --> ai-analysis-engine
  ai-analysis-engine --> structured-guidance-output["structured-guidance-output"]
  structured-guidance-output --> marketer-review-loop["marketer-review-loop"]
  marketer-review-loop --> legal-approval["legal-approval"]
  evaluation-loop --> ai-analysis-engine
  future-native-tool-integrations["future-native-tool-integrations"] --> marketing-content-upload
Drag to pan · scroll or use +/− to zoom · reconstructed from the source's described component topology

Components

Component Role Interacts with
marketing-content-upload Self-service entry point where marketers submit English text content for compliance review. ai-analysis-engine
compliance-guidelines Confluence pages and documents containing internal rules distilled from country regulations and best practices. prompt-guidance-layer, ai-analysis-engine
prompt-guidance-layer Engineer-authored prompts that instruct the model how to analyze content against guidelines. compliance-guidelines, ai-analysis-engine
ai-analysis-engine Generative AI analysis system that detects guideline issues and suggests revisions. marketing-content-upload, compliance-guidelines, prompt-guidance-layer, structured-guidance-output
structured-guidance-output Output containing the problematic text, violated guideline, and suggested correction. ai-analysis-engine, marketer-review-loop
marketer-review-loop Human marketer iteration step that applies judgment, revises content, and reruns checks. structured-guidance-output, legal-approval
legal-approval Final legal review and approval step before marketing use. marketer-review-loop
historical-feedback-sources Prior legal comments from Google Docs, Slides, Slack, and meetings. training-evaluation-corpus
training-evaluation-corpus Structured content-and-feedback examples used for model training and evaluation. historical-feedback-sources, evaluation-loop
evaluation-loop Precision/recall and marketer usability evaluation used before beta and rollout. training-evaluation-corpus, ai-analysis-engine
future-native-tool-integrations Planned Adobe/Figma integration to check compliance inside creative workflows. marketing-content-upload

Data flow

A marketer uploads English text content. The system combines engineered prompts with internal compliance guidelines stored in Confluence pages and documents. The AI analysis engine checks claims, disclaimers, IP, spelling, grammar, and other compliance categories. It returns structured guidance: offending text, violated guideline, and a suggested change. The marketer edits and reruns checks until confident, then sends the content to legal for final approval. Training and evaluation data come from structured pairs of marketing content and historical legal feedback collected from prior review channels.

5 supporting quotes
“the marketer uploads the content uh the system does the analysis it identifies the issues and it provides guidance”transcript, stated
“This is the guideline that it is not meeting and this is a suggestion on how you can change it.”transcript, implied
“Our guidelines um are in confluence pages and documents”transcript, stated
“the prompts that our engineers have written and the third is actually the system that takes both these prompts the guidelines”transcript, stated
“they would submit it to the legal team for approval.”transcript, stated

Why this architecture

Remitly scoped the first version to English text because the full marketing surface includes audio, images, video, and 18+ languages. A self-service checker addressed the biggest workflow pain: marketers could resolve likely issues before legal submission rather than waiting through multiple review rounds. The system returns structured guidance instead of a binary pass/fail so marketers can understand and fix issues. Historical legal feedback had to be transformed into a structured corpus because the old process stored expertise in scattered comments, Slack messages, and meetings. Legal approval remains in place because compliance accountability cannot be delegated entirely to the model.

5 supporting quotes
“we had to start small. We said we will start with English and text only.”transcript, stated
“The marketers should be able to access a tool that would help them become compliant uh by themselves.”transcript, stated
“the system does the analysis it identifies the issues and it provides guidance so the guidance is of the type this is the particular piece of text that is not uh meeting the guidelines.”transcript, implied
“you didn't have these uh examples in a structured format.”transcript, stated
“then they would submit it to the legal team for approval.”transcript, stated

Models used: generative AI · large language models

Scale

Alternatives considered (roads not taken)

Continue manual legal review loops

Rejected because: The two-to-four-cycle process slowed communications and forced marketers to context-switch back to prior projects.

“this cycle goes on for like you know two to four times.”transcript, stated
“This context switching leads to both inefficiency as well as dissatisfaction.”transcript, stated

Start with all content formats and languages

Rejected because: The team deliberately scoped the first version to English text before expanding to audio, images, video, and more languages.

“we had to start small. We said we will start with English and text only.”transcript, stated
“We want to go ahead. We want to say like you know whatever content that you create we'll be able to check”transcript, implied

Use a separate compliance tool forever

Rejected because: The roadmap is to integrate checks into native creative tools such as Adobe and Figma to remove tool context switching.

“we don't want this to be a separate tool that the marketer use.”transcript, stated
“integrated into their native tools whether it's Adobe, Figma or so on”transcript, stated

Let AI replace legal approval

Rejected because: The target workflow keeps legal review as a final quality check even after marketer self-service iteration.

“then they would submit it to the legal team for approval.”transcript, stated
“the legal review becomes more of a rubber stamp as a final quality check.”transcript, stated

Patterns

safety-policy-enforcement (safety)

The tool checks marketing content against internal compliance guidelines distilled from regulations and best practices.

“we have taken all the regulations from these countries and came up with internal guidelines”transcript, stated
“This is the guideline that it is not meeting”transcript, stated

structured-output-contract (contracts)

The model output is structured as offending text, violated guideline, and suggested change.

“the system does the analysis it identifies the issues and it provides guidance so the guidance is of the type this is the particular piece of text that is not uh meeting the guidelines.”transcript, stated
“This is the guideline that it is not meeting and this is a suggestion on how you can change it.”transcript, stated

human-in-the-loop-gate (control)

Marketers apply judgment to AI guidance, and legal remains the final approval gate.

“The marketer looks to takes the guidance, uses their judgment and makes necessary changes”transcript, stated
“then they would submit it to the legal team for approval.”transcript, stated

eval-driven-development (evaluation)

The team used precision, recall, beta usability feedback, and multiple model iterations before rollout.

“We had the subject objective measures that I mentioned earlier the precession and recall.”transcript, stated
“we went through a couple of iterations of the model before we even released it uh to our beta testers”transcript, stated

data-quality-loop (learning)

Unstructured legal comments were converted into content-feedback pairs for training and evaluation.

“you didn't have these uh examples in a structured format.”transcript, stated
“we developed a good corpus of these training materials to be used both for training the model and the second in evaluating the model”transcript, stated

confidence-thresholding (evidence)

The team explicitly tuned the precision/recall balance for a compliance use case where recall matters strongly.

“we had to balance between precision and recall”transcript, stated
“around 97% uh of identification of the issues.”transcript, stated

Tradeoffs

Start with English text

Chose narrow text-only MVP over all languages and multimodal marketing assets on day one.

Rationale: The full surface was too broad for the first release, and images/video introduce extra checks such as disclaimer font size.

“we had to start small. We said we will start with English and text only.”transcript, stated
“images and videos also come up with other challenges that text doesn't have.”transcript, stated

Use self-service marketer checks before legal review

Chose marketer iteration with AI guidance over legal-only review after creative completion.

Rationale: Self-service checks reduce the back-and-forth and context switching before final legal approval.

“it should be self-service. The marketers should be able to access a tool that would help them become compliant”transcript, stated
“This context switching leads to both inefficiency as well as dissatisfaction.”transcript, stated

Keep legal as final quality gate

Chose AI-assisted precheck plus legal approval over full AI approval of marketing compliance.

Rationale: The desired state is a lighter legal review, not removal of accountability from legal.

“they would submit it to the legal team for approval.”transcript, stated
“the legal review becomes more of a rubber stamp as a final quality check.”transcript, stated

Invest in structured examples

Chose content-feedback training/evaluation corpus over training directly from scattered historical comments.

Rationale: The model and evaluator needed explicit examples of content and corresponding legal guideline feedback.

“what is the content and what is the feedback from legal”transcript, stated
“we developed a good corpus of these training materials to be used both for training the model and the second in evaluating the model”transcript, stated

Gotchas (what bit them)

The most time-consuming part was not model coding but training-data creation.

Root cause: Legal feedback lived in Google Docs, Slides, Slack, and meetings rather than structured examples.

Resolution: The team converted historical content and legal feedback into a corpus usable for both training and evaluation.

“The first and the biggest one was getting the training data.”transcript, stated
“the comments from the legal team would be either in terms of comments on Google Docs or Slides, they could be Slack messages”transcript, stated

The first version deliberately excluded most of Remitly's communication surface.

Root cause: Audio, image, video, and non-English support add additional compliance and perception problems, such as disclaimer font size.

Resolution: Start with English text, then expand to multimodal and multilingual checks once core behavior works.

“we started with English text”transcript, stated
“a trivial example would be font size of disclaimers and images.”transcript, stated

Compliance automation must balance false positives and missed issues.

Root cause: Over-flagging creates alert fatigue and inefficiency, but missed violations create regulatory risk.

Resolution: The team measured precision and recall and iterated to reach the reported 95% accuracy and 97% issue identification.

“we had to balance between precision and recall”transcript, stated
“we achieved 95% accuracy and around 97% uh of identification of the issues.”transcript, stated

A separate compliance tool still creates workflow friction.

Root cause: Marketers would have to leave their native creative environment to run checks.

Resolution: The roadmap is to integrate compliance checking directly into tools such as Adobe and Figma.

“we don't want this to be a separate tool that the marketer use.”transcript, stated
“integrated into their native tools whether it's Adobe, Figma or so on”transcript, stated

Evaluation

Remitly evaluated the system with quantitative precision/recall metrics, a structured content-and-legal-feedback corpus, several model iterations before beta, and usability feedback from marketers about language and issue-presentation structure.

Metrics: accuracy · issue identification rate · precision · recall · marketer usability feedback · beta readiness

4 supporting quotes
“we achieved 95% accuracy and around 97% uh of identification of the issues.”transcript, implied
“We had the subject objective measures that I mentioned earlier the precession and recall.”transcript, stated
“We also got feedback from uh one of the marketers to say how usable is the system.”transcript, implied
“we made iterations on the language that we are presenting and also on the structure in which we're presenting the issues.”transcript, stated

Outcomes

The transcript reports 170 countries, around 8 million active customers, more than 18 languages, two-to-four manual review cycles, English text as first scope, 15 development days over 3 months, 95% accuracy, around 97% issue identification, and planned expansion to audio, image, video, and native tools.

5 supporting quotes
“we will start with English and text only.”transcript, stated
“we achieved 95% accuracy and around 97% uh of identification of the issues.”transcript, stated
“we are in the stage of u sharing it with all of marketing uh we will be training them”transcript, stated
“the legal review becomes more of a rubber stamp as a final quality check.”transcript, stated
“we want to expand to audio, image and video.”transcript, stated