Scaling AI Assistants Across Swedish Government Offices Through Rapid Experimentation and Business-Led Innovation

government_of_sweden · Government · 2024 · source Agentic: no · promotional bias: low · source-backed · extracted with prompt 0.5.6 (schema v2)

Generated from extraction.json — do not edit by hand. Every claim cites verbatim source evidence; stated means the quote directly asserts the claim, implied means it supports it indirectly.

Problem

Domain: Government knowledge work and policy analysis

The Government Offices of Sweden needed to help civil servants analyze large volumes of documents and internal knowledge faster while preserving accountability, transparency, public-sector governance, and human responsibility for decisions.

Constraints:

Architecture

Sweden's Government Offices run an innovation-incubator model that rapidly prototypes assistants, kills weak pilots, scales useful ones, and centers civil servants as accountable users. Assistants are built in Intric as packages of prompts, knowledge, data, and RAG databases sent to selectable language models, with civil servants trained in prompting and core-business teams deciding which assistants should scale to department, ministerial, or office-wide use.

Diagram confidence: reconstructed (reconstructed from prose).

flowchart LR
  A["Civil servants"] --> B["Intric assistant platform"]
  C["Innovation incubator"] --> D["AI pilots"]
  D --> B
  B --> E["RAG knowledge base"]
  B --> F["Language model providers"]
  C --> G["Center of excellence"]
  G --> H["Capability council"]
  H --> A
Drag to pan · scroll or use +/− to zoom · reconstructed from the source's described component topology

Components

Component Role Interacts with
Civil servants Accountable users who prompt, review, and use assistant outputs inside government workflows. Intric assistant platform, Capability council
Innovation incubator Digitalization unit that finds ideas, prototypes assistants, kills weak pilots, and scales working ones. AI pilots, Center of excellence
AI pilots Early adopters and change actors drawn from core business teams. Intric assistant platform, Civil servants
Intric assistant platform Cloud platform for packaging prompts, knowledge sources, data, RAG databases, and model choices. Language model providers, RAG knowledge base
RAG knowledge base Uploaded knowledge sources used by assistants for retrieval-backed responses. Intric assistant platform
Language model providers Anthropic, OpenAI, and Sweden-hosted open-source models chosen by use case and sensitivity. Intric assistant platform
Center of excellence Phase-two organization for turning successful pilots into broader assistants. Capability council
Capability council Core-business body deciding whether assistants should operate at department, ministerial, or government-office level. Civil servants

Data flow

Civil servants identify a knowledge-intensive workflow, structure and upload knowledge sources into an Intric assistant, encode the manual analytical framework as prompt/context, optionally use RAG over uploaded material, and review the assistant's output before it moves further in the public process. Pilots that work are candidates for broader rollout through a center of excellence and capability council.

3 supporting quotes
“we take uh new ideas, new projects and and uh try them out. Uh if it works, we'll you know put it into the ordinary kind of uh line of business.”transcript, stated
“an AI assistance is bas basically a package of information and prompts and um data that you pack together and send off to the language model”transcript, stated
“It's the same workflow, but they put it in the system prompt.”transcript, stated

Why this architecture

The architecture keeps AI behind accountable civil servants because public processes require clear responsibility and transparency. It uses a cloud assistant platform and multiple model choices because the organization wants rapid experimentation without a large GPU team, while preserving future flexibility for sensitive-information handling.

3 supporting quotes
“what we call assistant is cognitively enhancing people.”transcript, stated
“we can choose between uh language models from Antropic or OpenAI. We also have the the open source models which are hosted here in Sweden.”transcript, stated
“we want to use cloud services as as far as it's possible. Uh one, we don't really have the the knowledge how to handle the the GPUs in in inhouse.”transcript, stated

Models used: Anthropic models · OpenAI models · Llama · Sweden-hosted open-source models · Intric assistants

Scale

Alternatives considered (roads not taken)

IT-led technology push

Rejected because: The early digitalization strategy was criticized as too technology-oriented and was turned toward business focus.

“we were critical to the early on um uh strategy because it were very tech oriented. So we managed to sort of turn it around to make it more business focused.”transcript, stated

One fixed language model

Rejected because: The team wants model agnosticism so sensitivity, storage, cost, and capability tradeoffs can be handled by use case.

“we want to be language agnostic all the way.”transcript, stated

Automated decision-making first

Rejected because: For current assistants, the government keeps civil servants accountable and avoids transferring agency.

“You're not changing agency.”transcript, stated

Patterns

human-in-the-loop-gate (governance)

Assistant outputs remain behind civil servants, who retain accountability before results move through government processes.

“because then you have responsible civil servants that will take responsibility for what comes out of the assistant before they take it further in the process.”transcript, stated
“you're always having the human in the end that is accountable for everything.”transcript, stated

rag-retrieval (retrieval)

Intric assistants package uploaded knowledge sources and RAG databases for civil-servant analysis workflows.

“part of that is um a rag uh database with the knowledge that you want to be part of your uh analytical stack”transcript, stated
“structure your knowledge sources, upload them into the assistant and then prompt the assistant to do what you want.”transcript, stated

model-routing (model-ops)

The platform can choose Anthropic, OpenAI, or Sweden-hosted open-source models depending on sensitivity and storage constraints.

“we can choose between uh language models from Antropic or OpenAI. We also have the the open source models which are hosted here in Sweden.”transcript, stated
“we can start to see if we can handle more sensitive information depending on what what model we choose and and uh where it's stored.”transcript, stated

eval-driven-development (evaluation)

The incubator rapidly prototypes assistants, kills those that fail or are too risky, and scales those that work.

“we do fail fast. I think that's >> fail fast. The whole fail we're going to be the best at failing fast.”transcript, stated
“we've killed some of them that hasn't worked and and some that has worked we've built upon.”transcript, stated

context-engineering (context)

The company-analysis assistant encodes a long manual analytical and judgment framework into the system prompt.

“the prompt when we look at it is I think it's 6 and a half A4 pages long”transcript, stated
“It's the same workflow, but they put it in the system prompt.”transcript, stated

Tradeoffs

Adoption strategy

Chose early adopters and workshops over PowerPoint persuasion.

Rationale: The team believes practical demonstrations and early adopters convert civil servants more effectively than presentations.

“we we we single out and focus on early adopters.”transcript, stated
“you cannot convince people by powerpoints. You need to make you need to make you need to show in practice”transcript, stated

Model deployment

Chose cloud and selectable providers over in-house GPU operation.

Rationale: The government offices lacked GPU expertise and personnel, and wanted easy access and faster experimentation.

“we don't really have the the knowledge how to handle the the GPUs in in inhouse. uh we also don't really have the the personnel to do it.”transcript, stated

Automation boundary

Chose cognitive enhancement of civil servants over automated decision making.

Rationale: This keeps responsibility and accountability in the public process while still giving assistants more retrieval and tool capability.

“They still there still the coworker, the servant civil servant. So the assistant sits behind the civil servant.”transcript, stated

Gotchas (what bit them)

Public-sector assistants can lose accountability if agency transfers too early.

Root cause: Government processes require clear responsibility for information handling and decisions.

Resolution: Keep assistants behind accountable civil servants while governance matures for more tool use.

“especially within public processes where you have accountability. Um you need to make sure that you stay within um the account the the accountability process.”transcript, stated
“you can still have the human having the overall responsibility”transcript, stated

Complex assistants require prompt and RAG literacy.

Root cause: Users need to know how the RAG database works and when to trust it.

Resolution: Train civil servants in the craft of prompting and knowledge-source structuring.

“what we've been doing is teaching the civil servants the craft of prompting”transcript, stated
“you need to know how a rag database work. Um and then you know when to trust it and not to trust it.”transcript, stated

Scaling many assistants requires organizational ownership.

Root cause: Successful pilots raise questions about department, ministerial, or office-wide scope and responsibility.

Resolution: Create a center of excellence and capability council with core business in the room.

“what we're setting up is um the center of excellence.”transcript, stated
“core business sitting together in the room discussing on what organizational level should that aa AI editor work”transcript, stated

Evaluation

The initiative evaluates assistants through rapid pilot outcomes, risk screening, business usefulness, early-adopter workshops, measurable workflow reductions such as company analysis time, and decisions about which pilots become department, ministerial, or government-office-wide capabilities.

Metrics: Assistants created and killed · 24-to-6-week company-analysis cycle reduction · Early-adopter workshop conversion · Risk under AI Act and sensitivity constraints · Department/minister/government-office scaling level · Potential 20-30% civil-servant efficiency gain

“If we can make our our civil servants 20 or 30% more efficient,”transcript, stated
“what works you scale and what doesn't work doesn't scale.”transcript, stated

Outcomes

The source reports roughly 6,500 employees, at least 30 assistants, a 24-to-6-week workflow reduction, 40 companies with 850 billion kronor turnover and 122,000 employees, and a target of potentially hundreds of assistants.

“potentially hundreds of AI assistants in an orderly fashion with responsibility uh very clearly”transcript, stated
“what we call assistant is cognitively enhancing people.”transcript, stated