Scaling AI Coding Assistant Adoption Across Engineering Organization

hubspot · Tech · 2025 · source Agentic: yes · promotional bias: med · source-backed · extracted with prompt 0.5.6 (schema v2)

Generated from extraction.json — do not edit by hand. Every claim cites verbatim source evidence; stated means the quote directly asserts the claim, implied means it supports it indirectly.

Problem

Domain: Engineering-wide AI coding adoption

HubSpot needed to move AI coding assistants from cautious experimentation to near-universal engineering adoption while preserving code quality, proving safety with data, tailoring tools to HubSpot's opinionated stack, and turning AI fluency into an organizational baseline.

Constraints:

Architecture

HubSpot scaled AI coding by combining a large GitHub Copilot pilot, executive sponsorship, enablement channels, engineering velocity measurement, and a dedicated Developer Experience AI team. The team then broadened adoption through peer validation, high-level quantitative proof, multiple coding-assistant POCs, a curated local MCP server with default rules and configuration, AI community advocacy, faster procurement, and AI-fluency expectations in hiring.

Diagram confidence: reconstructed (reconstructed from prose).

flowchart LR
  A["HubSpot engineers"] --> B["AI coding tools"]
  C["Developer Experience AI team"] --> B
  C --> D["Metrics and evaluation"]
  C --> E["AI community"]
  B --> F["Local MCP server"]
  F --> G["Internal MCP tool ecosystem"]
  G --> B
  E --> A
  D --> C
Drag to pan · scroll or use +/− to zoom · reconstructed from the source's described component topology

Components

Component Role Interacts with
HubSpot engineers Engineering organization adopting coding assistants, agents, and AI fluency practices. AI coding tools, Local MCP server
Developer Experience AI team Dedicated team owning adoption, evaluation, advocacy, procurement speed, and curated tool experience. AI coding tools, Metrics and evaluation, AI community
AI coding tools GitHub Copilot, Cursor, coding agents, and related assistants used by engineers. Local MCP server, HubSpot engineers
Local MCP server Default per-machine context/configuration layer tailored to HubSpot architecture, rules, libraries, and best practices. Internal MCP tool ecosystem
Internal MCP tool ecosystem OpenAI, Anthropic, and internal MCP servers exposing hundreds of tools to agents. AI coding tools
Metrics and evaluation Adoption, review burden, cycle time, velocity, incident, and pilot-comparison measurements. Developer Experience AI team
AI community Open forum, peer videos, weekly examples, and advocacy content used to spread adoption. HubSpot engineers

Data flow

The DevEx AI team pilots tools, aligns legal/security/procurement, measures adoption and engineering outcomes, curates rules and MCP configuration for HubSpot's stack, and feeds learning back through enablement channels, videos, community posts, and hiring expectations. Engineers use coding assistants and agents, while metrics such as review burden, cycle time, velocity, adoption, and incident rates guide rollout decisions.

3 supporting quotes
“We began experimenting with GitHub Copilot in the Summer of 2023.”article, stated
“We pulled metrics on code review burden, cycle time, velocity comparisons before and after adoption, and production incident rates.”article, stated
“We transparently set up a local MCP server on every machine with default rules and configuration optimized for our development environment.”article, stated

Why this architecture

HubSpot treated adoption as an engineering platform problem rather than a license rollout. A dedicated DevEx AI team created leverage by measuring impact, curating context for the internal stack, speeding procurement, building community, and reducing friction as adoption moved from early adopters to skeptics.

3 supporting quotes
“Central infrastructure teams create leverage for product teams in every facet of their daily work. AI is no different.”article, stated
“The latter stages of adoption are where you face skeptics, start to better understand the limitations of the current tools, and see higher levels of change/risk aversion”article, stated
“HubSpot has a very opinionated stack and we wanted our generated code to reflect these opinions as much as possible.”article, stated

Models used: GitHub Copilot · Cursor · OpenAI models · Anthropic models · coding agents

Scale

Alternatives considered (roads not taken)

License-request guardrails for every user

Rejected because: Conservative usage rules slowed adoption once HubSpot had enough data and experience.

“Users had to request a license and agree to follow strict guardrails.”article, stated

Qualitative feedback alone

Rejected because: HubSpot wanted empirical data to combat skepticism and compare tools on merit.

“We didn't want to rely solely on qualitative feedback, so we came up with ways to run pilots and compare tools on merit.”article, stated

Generic AI tool defaults

Rejected because: HubSpot needed generated code to follow its specific stack and best practices.

“This gave every engineer an experience tailored to our specific stack and best practices right out of the box.”article, stated

Patterns

context-engineering (context)

HubSpot curates rules, local MCP configuration, and deep architectural context so generated code reflects its internal stack.

“This started very simply with the sharing of Cursor rules files, but quickly evolved to more complex tools that gave agents deep context about our architecture, libraries, and best practices. (More to come on this in the future)”article, stated
“* Curated experience: We transparently set up a local MCP server on every machine with default rules and configuration optimized for our development environment. This gave every engineer an experience tailored to our specific stack and best practices right out of the box.”article, stated

tool-use-orchestration (orchestration)

HubSpot exposes hundreds of tools through MCP servers that agents can use across internal, OpenAI, and Anthropic contexts.

“400+ tools that our agents can leverage across our internal, OpenAI, and Anthropic MCP servers.”article, stated

eval-driven-development (evaluation)

HubSpot uses engineering velocity metrics, incident data, pilot comparisons, and tool evaluation capabilities to guide rollout.

“* We measured everything. We applied our existing engineering velocity measurement methods to the pilot. This helped us check our biases. We were skeptical at the outset but seeing measured impact chipped away at our skepticism.”article, stated
“The data consistently showed the same thing: AI adoption wasn't creating the problems we were initially worried about.”article, stated

human-in-the-loop-gate (governance)

Adoption relied on peer validation, forums, videos, and engineering community review rather than a top-down mandate alone.

“* Peer validation: Whenever we heard someone did something interesting with AI, we asked them to record a video and share it. We also began recording weekly videos ourselves showing new features and real usage.”article, stated
“* Advocacy: We wanted to build a community around AI, by collecting and disseminating what was working for people. We created an open forum for people to post about AI and seeded content to drive engagement. We saw a vibrant community slowly spring up as adoption grew.”article, stated

Tradeoffs

Adoption rollout

Chose large team-based pilot with measurement over small individual-only experiment.

Rationale: Including full teams with varied experience let people learn together and produced enough data to validate impact.

“* We ran a pilot that was sufficiently large: Our strategy was to include entire teams so they could adopt and learn together that had different experience levels, different missions, and worked in different domains. We gave teams over two months to try it..”article, stated
“* We measured everything. We applied our existing engineering velocity measurement methods to the pilot. This helped us check our biases. We were skeptical at the outset but seeing measured impact chipped away at our skepticism.”article, stated

Adoption expectation

Chose AI fluency as a baseline expectation over optional specialist skill.

Rationale: After 90% adoption, HubSpot judged AI fluency necessary for engineers' growth and hiring expectations.

“Once we hit 90% adoption, we made AI fluency a baseline expectation for engineers by adding it to job descriptions and hiring expectations.”article, stated

Procurement mode

Chose faster month-to-month experimentation over longer-term negotiated agreements before pilots.

Rationale: AI tools change quickly and HubSpot wanted to try new tools without waiting for traditional procurement.

“We wanted month-to-month contracts and to get started ASAP.”article, stated

Gotchas (what bit them)

Demand can outgrow adjacent teams that only partly own AI adoption.

Root cause: GitHub-adjacent teams initially drove adoption, but demand exploded and their backlog grew.

Resolution: HubSpot created a dedicated Developer Experience AI team in October 2024.

“When generative AI emerged, we initially relied on teams adjacent to these areas (specifically teams that managed our GitHub setup) to drive adoption. But as demand exploded, the backlog grew exponentially. We realized it was time to create a dedicated team.”article, stated
“We created a Developer Experience AI team in October 2024, with an initial focus on:”article, stated

Late-adoption skeptics need different proof than early adopters.

Root cause: After 60% adoption, remaining engineers had more skepticism, risk aversion, and awareness of tool limitations.

Resolution: HubSpot used peer videos, broad quantitative proof, better tools, curated MCP setup, and AI fluency expectations.

“The latter stages of adoption are where you face skeptics, start to better understand the limitations of the current tools, and see higher levels of change/risk aversion”article, stated
“Adoption slowed again as it increased beyond 60%. The latter stages of adoption are where you face skeptics, start to better understand the limitations of the current tools, and see higher levels of change/risk aversion, so we had to change our approach:”article, stated

Generic assistants do not know an opinionated internal stack.

Root cause: HubSpot wanted generated code to reflect its architecture, libraries, and practices.

Resolution: The DevEx AI team provided Cursor rules, local MCP configuration, and deeper architectural context.

“This started very simply with the sharing of Cursor rules files, but quickly evolved to more complex tools that gave agents deep context about our architecture, libraries, and best practices.”article, stated

Evaluation

HubSpot evaluated adoption and safety with engineering velocity methods, qualitative feedback, code review burden, cycle time, before/after velocity comparisons, production incident rates, broad adoption data, and pilot comparisons.

Metrics: AI coding adoption percentage · Code review burden · Cycle time · Velocity before and after adoption · Production incident rates · Pilot feedback · Tool comparison results

“We pulled metrics on code review burden, cycle time, velocity comparisons before and after adoption, and production incident rates.”article, stated
“The data consistently showed the same thing: AI adoption wasn't creating the problems we were initially worried about. The scatter plot above shows one example, showing that there was no correlation between AI adoption and production incidents.”article, stated

Outcomes

HubSpot reports adoption above 90%, a two-month-plus pilot, GitHub Copilot's $19/month business-user pricing at the time, adoption slowdown after 60%, and 400-plus tools across internal/OpenAI/Anthropic MCP servers.

“AI has fundamentally transformed how we build software at HubSpot. Over the past two years, we've gone from cautious experimentation to achieving near universal adoption of AI coding tools across our engineering organization.”article, stated
“Adoption was the beginning and opened the door to everything that followed”article, stated