Rebuilding an AI SDR Agent with Multi-Agent Architecture for Enterprise Sales Automation

11x · Tech · 2024 · source Agentic: yes · promotional bias: med · source-backed · extracted with prompt 0.5.6 (schema v2)

Generated from extraction.json — do not edit by hand. Every claim cites verbatim source evidence; stated means the quote directly asserts the claim, implied means it supports it indirectly.

Problem

Domain: Enterprise sales automation and AI SDR campaign creation

11x needed to rebuild Alice from a button-heavy outreach workflow into a production AI SDR that could guide campaign creation, source and research leads, personalize outbound messages, and eventually learn from campaigns like a digital worker.

Constraints:

Architecture

11x rebuilt Alice 2 around LangGraph/LangChain with a hierarchical multi-agent campaign-creation graph. A supervisor node interacts with the user and routes work to specialist subagents for research, positioning, LinkedIn messaging, and email writing, while audience creation remains separate. This replaced failed experiments with a single ReAct agent and a rigid 15-node workflow, keeping the flexibility of conversational agents while adding task specialization.

Diagram confidence: reconstructed (reconstructed from prose).

flowchart LR
  A["Alice chat interface"] --> B["Supervisor node"]
  B --> C["Researcher subagent"]
  B --> D["Positioning report subagent"]
  B --> E["LinkedIn message writer"]
  B --> F["Email writer"]
  C --> G["Lead and web research tools"]
  D --> G
  E --> H["Messaging and database tools"]
  F --> H
  B --> I["LangGraph runtime"]
Drag to pan · scroll or use +/− to zoom · reconstructed from the source's described component topology

Components

Component Role Interacts with
Alice chat interface User-facing campaign-creation surface for interacting with Alice like a human team member. Supervisor node
Supervisor node Routes campaign-creation tasks to specialist agents and handles user interaction. Alice chat interface, Researcher subagent, Positioning report subagent, LinkedIn message writer, Email writer, LangGraph runtime
Researcher subagent Performs lead research to support campaign personalization. Supervisor node, Lead and web research tools
Positioning report subagent Builds a positioning report for how to frame the offer to a specific lead. Supervisor node, Lead and web research tools
LinkedIn message writer Drafts LinkedIn outreach as one specialized campaign-creation task. Supervisor node, Messaging and database tools
Email writer Drafts personalized email outreach. Supervisor node, Messaging and database tools
Lead and web research tools External tools for fetching leads, researching people, and accessing information outside model context. Researcher subagent, Positioning report subagent
Messaging and database tools Tools for inserting entities, drafting messages, and executing campaign actions. LinkedIn message writer, Email writer
LangGraph runtime Agent framework, cloud hosting, and observability substrate for production Alice 2. Supervisor node

Data flow

A user starts campaign creation through chat. The supervisor manages the campaign-creation graph, delegates lead research, positioning, LinkedIn-message writing, and email writing to specialist subagents, then receives their completed work. Those agents use tools and vendor infrastructure to fetch or write outside-world data. LangGraph hosting and observability support production execution, while separate audience creation and future self-learning feed campaign performance back into the product.

3 supporting quotes
“the supervisor is responsible for interacting with the user and for routing tasks to sub aents.”transcript, stated
“we have four specialist sub aents. We have a researcher. We have something that that generates something called a positioning report”transcript, stated
“When the sub aents will then fulfill those tasks and they'll escalate back to the supervisor when they're complete.”transcript, stated

Why this architecture

11x chose the multi-agent hierarchy because the ReAct prototype was flexible but weak at tool ordering and output quality, while the workflow prototype was high quality but too rigid and coupled to the UI. Specialized subagents gave campaign subtasks their own prompts and tools without freezing the entire conversation into a fixed user flow.

3 supporting quotes
“We got the flexibility of the React agent and then we got the the performance of the workflow.”transcript, stated
“we had different mental models. We thought that the the agent was a was a user flow within our product or a directed graph and those were the wrong mental models”transcript, stated
“You should also break big tasks down into small tasks. Uh in our case, the big task was the campaign creation”transcript, stated

Models used: Claude models · GPT-4 · Claude 2 · Claude 3 · GPT-4o

Scale

Alternatives considered (roads not taken)

A single ReAct campaign-creation agent with many tools

Rejected because: It stayed flexible, but struggled with tool choice/order, could loop until recursion-limit errors, and produced mediocre campaign outputs.

“the React agent was kind of bad at tools. We had attached a lot of tools and uh as you know that can what can sometimes happen”transcript, stated
“this would sometimes lead to infinite loops where the agent is repeatedly trying to accomplish some part of campaign creation but not succeeding.”transcript, stated

A predefined workflow graph for campaign creation

Rejected because: It improved tool discipline and output quality, but coupled product UX to graph structure and blocked jumping around the campaign flow.

3 supporting quotes
“it only runs to completion once for the entire campaign creation process.”transcript, stated
“our front-end campaign creation flow experience was coupled with the the architecture of our agent”transcript, stated
“It also didn't support jumping around within the campaign creation flow”transcript, stated

Building non-essential infrastructure internally

Rejected because: The team intentionally leaned on vendors and a vanilla stack to move quickly and avoid adding unfamiliar infrastructure risk.

“we wanted to leverage vendors as much as possible to move really quickly. We didn't want to be building non-essential components.”transcript, stated
“we chose a very vanilla tech stack.”transcript, stated

Patterns

multi-agent-orchestration (architecture)

Alice 2 uses one supervisor and multiple specialist subagents for campaign-creation work, separating research, positioning, LinkedIn messaging, and email writing.

“there's one supervisor and there are many sub aents that are specialized.”transcript, stated
“we have four specialist sub aents. We have a researcher. We have something that that generates something called a positioning report”transcript, stated

tool-use-orchestration (architecture)

The team modeled external actions and information access as tools, including lead fetching, database writes, email drafting, and information retrieval beyond the model context.

“there are lots of different things that need to happen in campaign creation. We need to fetch leads from our database.”transcript, stated
“They're also necessary to access information beyond the context window.”transcript, stated

observability-tracing (operations)

11x selected LangChain/LangGraph partly because cloud hosting and observability made it possible to understand how Alice performed in production.

“That agent framework had cloud hosting and observability. So we knew we were going to be able to get produ get to production”transcript, stated
“once our agent was in production we would understand how it's performing.”transcript, stated

human-in-the-loop-gate (interaction)

The workflow prototype used LangGraph node interrupts to collect user input or feedback at specific graph steps, making human feedback an explicit pause point.

“the way that we get user input or feedback at certain points within the graph execution is through the use of something called node interrupts”transcript, stated

Tradeoffs

Campaign-creation architecture

Chose hierarchical multi-agent graph over single ReAct agent or fixed workflow.

Rationale: The hierarchy preserved conversational flexibility while giving each campaign subtask a specialist role and avoiding workflow rigidity.

“And this multi- aent architecture, it gave us the best of both worlds. We got the flexibility of the React agent and then we got the the performance of the workflow.”transcript, stated

Implementation strategy during a risky rebuild

Chose vanilla stack and vendor leverage over building unfamiliar or non-essential components internally.

Rationale: The rebuild already carried agent and knowledge-base risk, so the team reduced unrelated infrastructure risk and moved faster.

“We were going to be taking on a lot of risk with some unfamiliar technologies like the agent and the knowledge base.”transcript, stated
“We didn't want to add additional risk through technologies that we didn't understand.”transcript, stated

Handling agent capability

Chose tools for external actions and knowledge access over making the model rely on internal skill alone.

Rationale: The team viewed tools as the preferred way to act in the outside world and reduce context-token burden.

“Tools are preferable over skills. Uh don't try to make your agent too smart. Just give it uh the right tools and tell it how to use them.”transcript, stated
“in general, it's better to use a tool and then to than to use a skill because this uh minimizes the amount of of tokens”transcript, stated

Gotchas (what bit them)

Large tool sets made the ReAct agent unreliable.

Root cause: One general agent had to decide which tool to call and in what order across the whole campaign-creation process.

Resolution: The team moved toward structured nodes and then specialist subagents so each task had clearer responsibility.

“We had attached a lot of tools and uh as you know that can what can sometimes happen when you do that is the agent will struggle with which tool to call and and in what order”transcript, stated
“In our case, we chose to add structure which led us to implementing a workflow.”transcript, stated

The ReAct prototype could spin into recursion-limit failures.

Root cause: The agent repeatedly tried to complete a campaign-creation step without succeeding.

Resolution: The workflow prototype fixed this with a clearly defined execution flow and fixed number of steps.

“this would sometimes lead to infinite loops where the agent is repeatedly trying to accomplish some part of campaign creation but not succeeding.”transcript, stated
“And we've also got a a clearly defined execution flow with a fixed number of steps. So no more infinite loops, no more recursion limit errors.”transcript, stated

A rigid workflow improved quality but made product iteration laborious.

Root cause: The campaign-creation front-end flow became coupled to graph structure.

Resolution: The team abandoned the workflow as the final architecture and adopted a multi-agent hierarchy.

“our front-end campaign creation flow experience was coupled with the the architecture of our agent”transcript, stated
“we came across a blog post by Langchain uh that explained how to build a customer support agent using a multi- aent architecture.”transcript, stated

Thinking of an agent as a product user flow led to the wrong architecture.

Root cause: The team initially framed Alice as either a user flow or directed graph instead of a team of specialized coworkers.

Resolution: They reframed the system as a team of coworker-like agents and broke big tasks into smaller tasks.

“we had different mental models. We thought that the the agent was a was a user flow within our product or a directed graph and those were the wrong mental models”transcript, stated
“It's also useful to think of your agent as a human co-orker or a team of co-workers.”transcript, stated

Evaluation

The talk evaluates Alice 2 through production migration and business metrics rather than a formal offline benchmark: migration speed, customers migrated, leads sourced, messages sent, replies generated, and reply rate compared with human SDRs.

Metrics: Three months from first commit to last business-customer migration · About 300 customers migrated · Close to two million leads sourced · Close to three million messages sent · About 21,000 replies generated · Around 2% reply rate, on par with a human SDR

3 supporting quotes
“it took us just three months from the first commit to migrating our last business customer.”transcript, stated
“she's now sourced close to two million leads. I think these numbers are a little out of date.”transcript, stated
“We've sent uh close to three million messages and generated about 21,000 replies.”transcript, stated

Outcomes

The production system was already handling millions of leads/messages and hundreds of migrated customers, but the source frames self-learning and cross-channel agent integration as still in progress.

3 supporting quotes
“Alice 2 went live in January and now the results have been pretty exciting.”transcript, stated
“we're excited to integrate Alice and Julian, our voice agent, so that uh these two agents can uh engage leads across multiple channels”transcript, stated
“we're really excited about applications of new technologies like computer use and memory and reinforcement learning.”transcript, stated