Grassroots AI Skills Marketplace: Scaling AI Capabilities Through Bottom-Up Engineering

uber · Tech · 2026 · source Agentic: yes · promotional bias: high · source-backed · extracted with prompt 0.5.6 (schema v2)

Generated from extraction.json — do not edit by hand. Every claim cites verbatim source evidence; stated means the quote directly asserts the claim, implied means it supports it indirectly.

Problem

Domain: enterprise agentic engineering enablement

Uber needed to scale AI-assisted engineering across a large global SDLC without creating chaos, stale skills, unsafe code changes, or a top-down adoption program that engineers would ignore.

Constraints:

Architecture

The source describes Uber's AI skills marketplace as a two-tier system. A Golden Marketplace auto-loads curated skills for all engineers and requires manual code review, CI/CD checks, and LLM-as-judge evaluation before deployment; a Personal Sandbox lets teams share experimental skills by URL without central governance. Claude acts as the general agent, skills provide task specialization, and verification skills run simulators, tests, CI/CD telemetry, and deterministic output reporting so engineers remain final reviewers.

Diagram confidence: reconstructed (reconstructed from prose).

flowchart LR
  uber_engineer["Uber engineer"] --> claude_general_agent["Claude general agent"]
  claude_general_agent --> skill_cartridges["Skill cartridges"]
  uber_engineer --> personal_sandbox["Personal Sandbox"]
  personal_sandbox --> skill_cartridges
  uber_engineer --> golden_marketplace["Golden Marketplace"]
  skill_cartridges --> golden_marketplace
  governance_pipeline["Governance pipeline"] --> golden_marketplace
  llm_as_judge_evaluator["LLM-as-judge evaluator"] --> governance_pipeline
  ci_cd_checks["CI/CD checks"] --> governance_pipeline
  skill_cartridges --> verification_skills["Verification skills"]
  verification_skills --> ci_cd_checks
  skill_cartridges --> tribal_knowledge_skills["Tribal knowledge skills"]
  recall_graph_memory["Recall graph memory"] --> skill_cartridges
Drag to pan · scroll or use +/− to zoom · reconstructed from the source's described component topology

Components

Component Role Interacts with
Uber engineer Developer who creates, uses, reviews, and promotes AI skills from daily engineering workflows. Claude general agent, Personal Sandbox, Golden Marketplace
Claude general agent General AI coding agent that gains task-specific behavior by loading skills. Skill cartridges, Uber engineer
Skill cartridges Specialized skill packs for code review, CI repair, verification, tribal knowledge, data science, and other engineering tasks. Claude general agent, Verification skills, Tribal knowledge skills
Golden Marketplace Curated company-wide skill hub with strict governance and auto-loading for engineers. Governance pipeline, Skill cartridges, Uber engineer
Personal Sandbox Ungoverned experimental tier where teams share skills by URL and iterate quickly. Skill cartridges, Uber engineer
Governance pipeline Manual code review, CI/CD checks, and LLM-as-judge evaluation before a skill ships to the Golden Marketplace. LLM-as-judge evaluator, CI/CD checks, Golden Marketplace
LLM-as-judge evaluator Second AI that runs tests against candidate skills and compares outputs with expected baselines. Governance pipeline
CI/CD checks Build/test infrastructure used to verify skill behavior and support self-healing telemetry experiments. Governance pipeline, Verification skills
Verification skills Skills that run simulators, switch modes/languages, run tests, and report exact outcomes. CI/CD checks, Skill cartridges
Tribal knowledge skills Markdown-based skill encodings of senior engineers' debugging frameworks and mental models. Skill cartridges
Recall graph memory Experimental Graph RAG memory over architectural decisions, failed experiments, and Slack debates. Skill cartridges

Data flow

An engineer creates or uses a Claude skill inside the existing workflow. Experimental skills can live in team repos and be shared manually; mature skills can be promoted into the Golden Marketplace, where manual review, CI/CD checks, and LLM-as-judge evaluation run before company-wide auto-loading. At execution time, a skill performs a bounded task such as code review, CI triage, simulator testing, or tribal-knowledge guidance, then reports what it attempted, what succeeded, what failed, and the exact diff for engineer review.

"The Golden Marketplace

- Auto-loaded for all engineers, works out of the box"

“Strict governance: manual code review, CI/CD checks, LLM-as-a-Judge evaluation before deployment”article, stated
“A skill can’t say “I optimized your code, looks great!” Enterprise skills must report exactly what they attempted, what succeeded, what failed, and the exact diff.”article, stated

Why this architecture

The architecture separates safe defaults from exploration. The Golden Marketplace gives every engineer a curated baseline of reviewed skills, while the Personal Sandbox lets bottom-up teams experiment quickly. Deterministic output contracts, CI/CD verification, LLM-as-judge checks, and human final review address production-risk concerns without blocking the grassroots demand loop that made skills spread.

3 supporting quotes
“Uber’s fix: a two-tier marketplace. App Store governance for the core, open-source GitHub freedom at the edges.”article, stated
“The dual structure keeps the default experience clean while letting a junior developer in Toronto build a tool”article, stated
“Engineers stay as the final reviewer. The AI shows its work.”article, stated

Models used: Claude · Claude Code · LLM-as-a-Judge

Scale

Alternatives considered (roads not taken)

Run AI adoption through top-down mandates

Rejected because: The source argues leadership-driven licenses and mandates stall, while Uber's adoption spread from engineers solving immediate workflow problems.

“Most tech companies run AI transformation the other way: leadership buys enterprise licenses, mandates adoption, and watches it stall.”article, stated
“Uber did the opposite, and it scaled.”article, stated

Put all skills under strict central governance

Rejected because: Strict governance is appropriate for company-wide defaults, but experimental and team-specific skills need low-friction creation.

“Golden tier: strict governance for company-wide tools. Wild West tier: no governance for personal experimentation.”article, stated
“Built for speed, creativity, and team-specific problems”article, stated

Use one generic code review skill

Rejected because: Uber reportedly built a tiered code-review family so trivial fixes and payment-processing changes receive different scrutiny.

“No single “Review Code” button. Uber built a tiered family.”article, stated
“A typo fix gets a lightweight review. A change to payment processing logic triggers a deep architectural audit.”article, stated

Build bespoke AI agents from scratch for every capability

Rejected because: The source frames the emerging model as a general agent plus specialized skills loaded on demand.

“In 2024, the industry was building bespoke AI agents from scratch using complex SDKs.”article, stated
“The new model: general agent + skills = specialization on demand.”article, stated

Patterns

multi-agent-orchestration (skill-based specialization)

Uber's reported model combines a general Claude agent with many specialized skills, plus a second AI evaluator for governed marketplace deployment.

“The new model: general agent + skills = specialization on demand.”article, stated
“Before any skill ships to the Golden Marketplace, a second AI runs a battery of tests against it”article, stated

eval-driven-development (skill governance)

Golden Marketplace skills require manual review, CI/CD checks, LLM-as-judge evaluation, expected-baseline tests, and deterministic result reporting before deployment.

“Strict governance: manual code review, CI/CD checks, LLM-as-a-Judge evaluation before deployment”article, stated
“checking outputs against expected baselines.”article, stated

structured-output-contract (deterministic skill reporting)

Enterprise skills must report attempted actions, successes, failures, and exact diffs rather than vague qualitative claims.

“Enterprise skills must report exactly what they attempted, what succeeded, what failed, and the exact diff.”article, stated
“3. Require deterministic outputs. If a skill touches code, it must report what it attempted, what worked, and what failed.”article, stated

human-in-the-loop-gate (engineering review)

Engineers remain the final reviewers of AI-generated skill outputs, especially for code changes.

“Engineers stay as the final reviewer. The AI shows its work.”article, stated

safety-policy-enforcement (marketplace governance)

The two-tier marketplace enforces compliance at the curated core while allowing ungoverned experimentation at the edges.

“Enforce compliance at the core, not the edges.”article, stated
“Strict governance: manual code review, CI/CD checks, LLM-as-a-Judge evaluation before deployment”article, stated

agent-memory (corporate memory)

The experimental Recall skill uses Graph RAG over architectural decisions, failed experiments, and Slack debates to help new hires query organizational memory.

“Corporate Memory via Graph RAG: A new hire joins and instead of reading stale Confluence pages, queries a “Recall” skill.”article, stated
“The AI pulls from a graph database of past architectural decisions, failed experiments, and Slack debates”article, stated

tool-use-orchestration (verification automation)

Verification skills operate external developer tools such as iOS simulators, mode/language toggles, and tests to prove generated code works.

“For mobile teams, a skill spins up iOS simulators, toggles dark/light mode, switches languages, and runs tests”article, stated
“AI agents rely on them to verify their own work.”article, stated

Tradeoffs

Adopt bottom-up skill creation.

Chose Engineer-led marketplace growth from immediate workflow pain over Top-down AI mandate and steering committee rollout.

Rationale: The source attributes adoption to engineers using skills to finish work that previously took hours, not to centralized planning.

“The growth was organic — a demand loop driven by engineers, not management.”article, stated
“The growth didn’t come from a training seminar. It came from the first time an engineer used a skill to finish something that previously took hours”article, stated

Split governed and experimental skills.

Chose Golden Marketplace plus Personal Sandbox over One marketplace policy for every skill.

Rationale: A curated default experience protects production workflows, while open team repos preserve speed and creativity.

“App Store governance for the core, open-source GitHub freedom at the edges.”article, stated
“The dual structure keeps the default experience clean while letting a junior developer in Toronto build a tool that eventually gets promoted to the Golden Marketplace.”article, stated

Use general agent plus skills.

Chose Claude as general intelligence with skill cartridges over Bespoke custom agents built from scratch.

Rationale: Skills provide specialization on demand and are easier to scale across domains than building separate agents with complex SDKs.

“The new model: general agent + skills = specialization on demand.”article, stated
“Claude is the general intelligence. Skills are the cartridges.”article, stated

Govern code-touching skills with deterministic reporting.

Chose Exact attempted/succeeded/failed/diff output over Natural-language confidence or generic success statements.

Rationale: Deterministic outputs make skill behavior auditable and keep engineers in control of production-impacting changes.

“3. Require deterministic outputs. If a skill touches code, it must report what it attempted, what worked, and what failed.”article, stated
“Engineers stay as the final reviewer. The AI shows its work.”article, stated

Gotchas (what bit them)

A fast-growing skill ecosystem can become chaotic.

Root cause: Hundreds of skills create overlapping tools, stale code, and conflicting prompts if all of them are treated as equal defaults.

Resolution: Use a two-tier marketplace with a curated Golden Marketplace and a free-form Personal Sandbox.

“With 500 skills running across infrastructure, the risk is chaos: overlapping tools, stale code, conflicting prompts.”article, stated
“Uber’s fix: a two-tier marketplace.”article, stated

AI code generation is not useful if engineers cannot tell whether the result works.

Root cause: The model can write code but correctness is hidden unless verification runs against actual environments and tests.

Resolution: Assign AI to verification through simulator runs, UI mode/language checks, tests, CI/CD checks, and exact outcome reporting.

“The common AI pain point: the model writes code, but you can’t tell if it works.”article, stated
“Uber assigned AI to verification.”article, stated

Vague AI success claims are unsafe for production engineering.

Root cause: A skill saying code looks good gives no audit trail of what changed, what failed, or what was attempted.

Resolution: Require deterministic outputs with exact diffs and success/failure reporting.

“A skill can’t say “I optimized your code, looks great!””article, stated
“Enterprise skills must report exactly what they attempted, what succeeded, what failed, and the exact diff.”article, stated

Tribal knowledge remains trapped in senior engineers' heads.

Root cause: Specialized debugging frameworks and mental models often live with a few experts rather than the whole organization.

Resolution: Encode senior-engineer expertise into Markdown-based skills that junior engineers can run.

“Every engineering org has senior engineers whose expertise lives in their heads”article, stated
“two of those engineers encoded their knowledge into a Claude Skill.”article, stated

Skills can go stale when internal APIs and environments change.

Root cause: Code breaks when environments change, and skill instructions can fail when dependencies are deprecated.

Resolution: Experiment with self-healing skills that monitor CI/CD failure rates, analyze errors, and rewrite their own instructions.

“Code breaks when environments change.”article, stated
“When a skill breaks because an internal API was deprecated, the AI analyzes the error, rewrites its own instructions, and fixes itself.”article, stated

Evaluation

The source describes marketplace growth metrics, Golden Marketplace governance checks, LLM-as-judge evaluation against expected baselines, CI/CD verification, deterministic output contracts, and human reviewer oversight.

Metrics: growth from 2 skills to 500+ skills in five months · 20 skills by December 2024 · 200+ curated skills and 300+ experimental tools by March 2025 · 20 new skills per week · Golden Marketplace cap of 100-200 essential skills · CI/CD checks before deployment · LLM-as-judge tests against expected baselines

3 supporting quotes
“December 2024: A handful of engineers poked around. The marketplace grew to about 20 skills.”article, stated
“March 2025: 200+ curated skills in the main hub. 300+ experimental tools in team repos.”article, stated
“a second AI runs a battery of tests against it, checking outputs against expected baselines.”article, stated

Outcomes

The article claims adoption across thousands of engineers, 200+ microservices, 500+ skills, and about twenty new skills per week, but it is a secondary writeup and should be treated as high-promotional-bias evidence until corroborated by primary Uber materials.

3 supporting quotes
“That repo now powers 500+ specialized AI skills across Uber’s engineering org”article, stated
“handling everything from code reviews to production monitoring.”article, stated
“The shift to agentic engineering won’t come from a CEO memo.”article, stated