Field AI Assistant for Sales Team Automation

databricks · Tech · 2025 · source Agentic: yes · promotional bias: med · source-backed · extracted with prompt 0.5.6 (schema v2)

Generated from extraction.json — do not edit by hand. Every claim cites verbatim source evidence; stated means the quote directly asserts the claim, implied means it supports it indirectly.

Problem

Domain: enterprise sales workflow automation

Databricks sales teams needed a governed assistant that could retrieve account and opportunity knowledge from siloed structured and unstructured systems, then automate repetitive seller actions without forcing sellers to jump across multiple applications.

Constraints:

Architecture

Databricks built a Field AI Assistant on its Agent Bricks Custom Agents framework. A driver agent interprets seller requests, uses tools and functions to retrieve structured Lakehouse data, CRM data, sales collateral, Google Docs, and other indexed collaboration content, calls Azure OpenAI GPT-4 for language reasoning, and routes deterministic actions such as CRM updates, prospecting emails, proposals, and meeting preparation through governed Databricks tools and Unity Catalog.

Diagram confidence: explicit (topology described by the source).

flowchart LR
  seller-crm-interface["Seller CRM interface"] --> driver-agent["Driver agent"]
  driver-agent --> data-foundation["Data foundation"]
  driver-agent --> tool-and-function-layer["Tool and function layer"]
  driver-agent --> azure-openai-gpt-4["Azure OpenAI GPT-4"]
  data-foundation --> unity-catalog-governance["Unity Catalog governance"]
  tool-and-function-layer --> unity-catalog-governance
  tool-and-function-layer --> ai-gateway["AI Gateway"]
  azure-openai-gpt-4 --> ai-gateway
  ai-gateway --> evaluation-layer["Evaluation layer"]
  evaluation-layer --> driver-agent
Drag to pan · scroll or use +/− to zoom · reconstructed from the source's described component topology

Components

Component Role Interacts with
Seller CRM interface Provides seeded prompts, page context, and chat-like interaction for sales users. Driver agent
Driver agent Interprets seller intent, chooses tools, retrieves data, and assembles responses or actions. Seller CRM interface, Data foundation, Tool and function layer, Azure OpenAI GPT-4
Data foundation Holds Lakehouse, CRM, sales collateral, Google Docs, and collaboration data for retrieval. Driver agent, Unity Catalog governance
Tool and function layer Executes deterministic SQL queries, Python functions, APIs, and CRM or document actions. Driver agent, Unity Catalog governance, AI Gateway
Azure OpenAI GPT-4 Provides foundational language reasoning, function selection, and formatted response generation. Driver agent, AI Gateway
AI Gateway Provides access controls, rate limiting, payload logging, monitoring, and guardrails. Tool and function layer, Azure OpenAI GPT-4, Evaluation layer
Evaluation layer Defines criteria and uses LLM-as-judge scoring to evaluate assistant responses. AI Gateway, Driver agent
Unity Catalog governance Governs data, agents, and tools for discoverability, permissions, and cataloging. Data foundation, Tool and function layer

Data flow

A seller interacts with the assistant from CRM or chat. The driver agent interprets intent, retrieves facts from Lakehouse, CRM, and collaboration sources, calls deterministic tools or SQL/Python functions where needed, uses GPT-4 to assemble the response, and routes action outputs such as CRM field updates, outbound emails, proposals, and meeting-prep artifacts through governed Databricks infrastructure.

“Our “Field AI Assistant” is built on the Databricks agentic framework and provides a way for sellers to query and interact with data across multiple data sources.”article, stated
“The field AI assistant has 1 driver agent and multiple tools and functions that perform the deterministic processing.”article, stated

Why this architecture

Databricks chose a compound agent with deterministic tools because seller requests need language understanding, but the underlying work depends on governed enterprise data retrieval, tool execution, and traceable actions. The Databricks-native stack also let the assistant use existing Lakehouse data, Unity Catalog governance, model evaluation, gateway controls, and future model flexibility.

“Human inputs are inherently ambiguous; LLMs have now given us the ability to use context to interpret the intent of a request and convert this into something more deterministic.”article, stated
“our solution architecture is designed to allow for flexibility in adopting new models as they become available in our Agent Bricks Custom Agents.”article, stated

Models used: Azure OpenAI GPT-4 · Databricks Agent Bricks Custom Agents · Databricks AI Search · Databricks Function Calling · MLflow LLMOps · DSPy · Agent Bricks AI Gateway · Unity Catalog

Scale

Alternatives considered (roads not taken)

Leave sellers to manually search siloed systems.

Rejected because: The business problem was that sellers were overwhelmed by scattered information and repetitive tasks.

“Sellers are typically overwhelmed with the volume of information thrown at them. They need access to data residing in various siloed applications”article, stated

Use an LLM-only assistant without deterministic tools.

Rejected because: The source says requests may need fact retrieval, code execution, deterministic processing, and reassembly into a formatted output.

“it might be necessary to retrieve specific facts, execute code, and apply a reasoning framework based on previously learned transformation.”article, stated

Standardize permanently on one model.

Rejected because: Databricks explicitly designed the architecture to evaluate model capabilities by use case and adopt new models.

“the framework supports a multi-model approach where the specific capabilities of each model is evaluated with respect to how it deals with specific use cases.”article, stated

Patterns

tool-use-orchestration (agentic sales assistant)

A driver agent calls SQL, Python, APIs, and other tools to convert ambiguous seller requests into deterministic retrieval and action workflows.

“The field AI assistant has 1 driver agent and multiple tools and functions that perform the deterministic processing.”article, stated

rag-retrieval (enterprise knowledge access)

The assistant retrieves account intelligence, CRM data, playbooks, collateral, Google Docs, and collaboration content as context for seller answers.

“This is the set of data sources that the agent interacts with. In our solution, this data foundation includes data in our Lakehouse, sales collateral, Google docs as well as data that resides in our CRM”article, stated

llm-as-judge (response evaluation)

Databricks defines evaluation criteria and uses LLM-as-judge scoring for assistant responses.

“we have defined evaluation criteria and we leverage LLM-as-a-judge capability to score the application responses.”article, stated

guardrails-io-filtering (enterprise AI gateway)

The AI Gateway enforces access controls, rate limits, logging, monitoring, and guardrails around assistant traffic.

“provides access controls, rate limiting, payload logging, and guardrails (filtering for system inputs and outputs).”article, stated

Tradeoffs

Use a compound agent with deterministic tools rather than free-form chat alone.

Chose Driver agent plus SQL, Python, APIs, and governed functions over Single LLM chat over sales documents.

Rationale: Seller requests require facts, actions, and correctly formatted outputs, not just conversational answers.

“To service the request, it might be necessary to retrieve specific facts, execute code, and apply a reasoning framework”article, stated

Use Azure OpenAI GPT-4 while retaining model flexibility.

Chose GPT-4 as current foundational model with multi-model evaluation over Static model commitment.

Rationale: GPT-4 met groundedness, factuality, tool selection, and formatting needs, but the framework stays adaptable.

“we chose Azure Open AI - GPT 4 as the model for our solution based on the groundedness of the model, its ability to generate factual and relevant content”article, stated

Govern agents and tools through Unity Catalog.

Chose Unity Catalog governance over unmanaged tool/data access over Ungoverned agent access to enterprise systems.

Rationale: Discoverability, governance, and cataloging are required for underlying datasets, agents, and tools.

“Unity Catalog for discoverability, governance, and cataloging of the underlying data set, agent and tools”article, stated

Gotchas (what bit them)

Enterprise sales data needed cleanup before agent workflows could be reliable.

Root cause: The assistant depended on messy internal data spread across sales and account systems.

Resolution: Databricks focused on data-engineered pipelines and GOLD single-source-of-truth datasets.

“Leveraged Lakehouse, iterative expansion of datasets, focused on data-engineered pipelines and building clean, GOLD Single Source of Truth datasets”article, stated

ROI measurement for a sales assistant was hard.

Root cause: Model effectiveness evaluation datasets were difficult to build and needed experimentation strategy.

Resolution: The team recommended small pilot focus groups and evaluation datasets supporting rapid experimentation.

“Be prepared to experiment with small focus groups in the pilot. Building evaluation datasets for measuring model effectiveness is hard”article, stated

Governance had to be designed early rather than added later.

Root cause: The assistant touches sales data, tools, agents, and potentially sensitive enterprise workflows.

Resolution: Databricks engaged security, privacy, legal, and Unity Catalog governance early.

“Engage early with Enterprise Security, Privacy, and Legal teams. Build a strong governance model on Unity Catalog for the data as well as the agents and tools”article, stated

Evaluation

Databricks defined evaluation criteria for the assistant and used LLM-as-judge scoring, while also noting that ROI evaluation requires focused datasets and small pilot groups.

Metrics: LLM-as-judge response scores · Model groundedness · Factual and relevant content generation · Tool/function selection quality · Output-format adherence · Pilot ROI

“we have defined evaluation criteria and we leverage LLM-as-a-judge capability to score the application responses.”article, stated
“Building evaluation datasets for measuring model effectiveness is hard and requires focused effort and a strategy that supports rapid experimentation”article, stated

Outcomes

The public post does not disclose adoption counts or quantified ROI, but it describes an internal assistant for sellers across the sales lifecycle with on-demand CRM availability.

“help the sellers in the day-to-day tasks including information retrieval, distilling the insights from the information, and performing actions based on those insights.”article, stated
“AI agents can significantly transform and assist every aspect of the seller journey”article, stated