AI-Powered Video Analysis and Highlight Generation Platform

accenture · Media & Entertainment · 2025 · source Agentic: yes · promotional bias: med · source-backed · extracted with prompt 0.5.4 (schema v2)

Generated from extraction.json — do not edit by hand. Every claim cites verbatim source evidence; stated means the quote directly asserts the claim, implied means it supports it indirectly.

Problem

Domain: Video highlight generation and media operations

Accenture wanted to automate long-form video analysis and short-form highlight creation without losing editorial quality, brand alignment, or human review control.

Constraints:

Architecture

Accenture Spotlight uses Amazon Nova foundation models and Amazon Bedrock Agents in a multi-layered agent workflow. A central orchestrator decomposes the work and coordinates three specialized super agents. The video processing agent extracts metadata using research, visual analysis, and audio analysis utility agents. The short video generation agent selects sections of interest, builds the clip sequence, and postprocesses output for publishing. A reviewer agent validates quality, accuracy, brand alignment, and user requirements, with optional human-in-the-loop review.

Diagram confidence: explicit (topology described by the source).

flowchart LR
  central-orchestrator-agent["central-orchestrator-agent"] --> video-processing-agent["video-processing-agent"]
  central-orchestrator-agent["central-orchestrator-agent"] --> short-video-generation-agent["short-video-generation-agent"]
  central-orchestrator-agent["central-orchestrator-agent"] --> reviewer-agent["reviewer-agent"]
  central-orchestrator-agent["central-orchestrator-agent"] --> task-driven-model-selector["task-driven-model-selector"]
  video-processing-agent["video-processing-agent"] --> research-agent["research-agent"]
  video-processing-agent["video-processing-agent"] --> visual-analysis-agent["visual-analysis-agent"]
  video-processing-agent["video-processing-agent"] --> audio-analysis-agent["audio-analysis-agent"]
  video-processing-agent["video-processing-agent"] --> short-video-generation-agent["short-video-generation-agent"]
  research-agent["research-agent"] --> visual-analysis-agent["visual-analysis-agent"]
  visual-analysis-agent["visual-analysis-agent"] --> section-of-interest-agent["section-of-interest-agent"]
  short-video-generation-agent["short-video-generation-agent"] --> section-of-interest-agent["section-of-interest-agent"]
  short-video-generation-agent["short-video-generation-agent"] --> video-generation-agent["video-generation-agent"]
  short-video-generation-agent["short-video-generation-agent"] --> video-postprocessing-agent["video-postprocessing-agent"]
  short-video-generation-agent["short-video-generation-agent"] --> reviewer-agent["reviewer-agent"]
  video-generation-agent["video-generation-agent"] --> reviewer-agent["reviewer-agent"]
  video-postprocessing-agent["video-postprocessing-agent"] --> reviewer-agent["reviewer-agent"]
  reviewer-agent["reviewer-agent"] --> human-reviewer["human-reviewer"]
Drag to pan · scroll or use +/− to zoom · reconstructed from the source's described component topology

Components

Component Role Interacts with
central-orchestrator-agent Coordinates task breakdown, data flow, model selection, and inter-agent communication. video-processing-agent, short-video-generation-agent, reviewer-agent, task-driven-model-selector
task-driven-model-selector Chooses traditional AI models or Amazon Nova FMs based on task complexity and latency requirements. central-orchestrator-agent
video-processing-agent Analyzes long-form video and generates metadata for short-form creation. research-agent, visual-analysis-agent, audio-analysis-agent, short-video-generation-agent
research-agent Analyzes high-performing short-form videos and produces recipes for successful clips. video-processing-agent, visual-analysis-agent
visual-analysis-agent Identifies matching segments, people, timestamps, and fine-grained visual details. video-processing-agent, section-of-interest-agent
audio-analysis-agent Performs speech diarization and transcription for audio context. video-processing-agent
short-video-generation-agent Builds the short-form output by integrating segments and refining sequence. section-of-interest-agent, video-generation-agent, video-postprocessing-agent, reviewer-agent
section-of-interest-agent Selects candidate segments using genre, target length, featured performers, and metadata. short-video-generation-agent, visual-analysis-agent
video-generation-agent Constructs the video sequence from segment recommendations and content recipes. short-video-generation-agent, reviewer-agent
video-postprocessing-agent Crops, subtitles, adds music, and applies brand overlays for publishing. short-video-generation-agent, reviewer-agent
reviewer-agent Validates quality, accuracy, brand alignment, and user requirements before final output. central-orchestrator-agent, short-video-generation-agent, video-generation-agent, video-postprocessing-agent, human-reviewer
human-reviewer Optional editorial quality assurance and collaborative refinement checkpoint. reviewer-agent

Data flow

Long-form or live video enters Spotlight. The orchestrator selects traditional AI or Nova models based on task complexity and latency needs, then invokes video processing agents to extract recipes, visual segments, people tags, timestamps, diarization, and transcripts. The short-video generation agent identifies sections of interest, assembles a sequence, and postprocesses for mobile formats or branded overlays. Reviewer agents and optional human review check quality before output is distributed.

4 supporting quotes
“The orchestrator agent manages task breakdown, data flow, and inter-agent communication.”article, stated
“Spotlight uses three specialized “super agents” that work in coordination under a central orchestrator agent’s supervision.”article, stated
“It identifies matching segments, tags key individuals, and timestamps relevant moments.”article, stated
“This agent orchestrates the actual creation of the short-form video by integrating relevant segments and refining the sequence.”article, stated

Why this architecture

Spotlight uses agent decomposition because highlight creation is not one task: it needs research into what makes clips perform, multimodal video/audio understanding, segment selection, clip construction, post-processing, review, and optional human oversight. Task-driven model selection lets fast traditional models handle simple or time-sensitive operations while Nova handles deeper multimodal reasoning.

3 supporting quotes
“Spotlight dynamically selects between traditional AI models and Amazon Nova FMs based on a given task’s complexity and latency requirements.”article, stated
“deploying deeper multimodal reasoning where sophisticated analysis is needed”article, stated
“These agents work together to understand video content, generate high-quality highlights, and maintain alignment with user requirements and brand standards.”article, stated

Models used: Amazon Nova · Amazon Bedrock Agents · traditional AI models · person recognition and tracking · speech diarization · transcription

Scale

Alternatives considered (roads not taken)

Manual highlight creation

Rejected because: Manual review, cutting, transitions, narration, checks, and formatting preserve control but create scaling bottlenecks.

“Editors must manually review footage, identify significant moments, cut clips, and add transitions or narration”article, stated

This post showcases how Accenture Spotlight delivers a scalable, cost-effective video highlight generation solution using [Amazon Nova"

— article, stated

One generic model for every video task

Rejected because: Spotlight dynamically chooses task-specific models or Nova FMs depending on latency and reasoning depth.

“* Task-driven model selection – Spotlight dynamically selects between traditional AI models and Amazon Nova FMs based on a given task’s complexity and latency requirements.”article, stated

Pure automation without editorial review

Rejected because: The platform preserves human-in-the-loop quality assurance and collaborative refinement for brand and accuracy needs.

“offering a human-in-the-loop option for quality assurance and collaborative refinement.”article, stated

Patterns

multi-agent-orchestration (agent architecture)

A central orchestrator coordinates three super agents and utility agents across analysis, generation, and review.

“Specialized agents, each purpose-built for specific analysis tasks, operate across the end-to-end workflow under the direction of a central orchestrator agent.”article, stated

model-routing (model operations)

Spotlight routes between traditional AI and Nova foundation models based on complexity and latency.

“Spotlight dynamically selects between traditional AI models and Amazon Nova FMs based on a given task’s complexity and latency requirements.”article, stated

human-in-the-loop-gate (quality)

Content owners can use human review for quality assurance, editorial oversight, and brand alignment.

“human-in-the-loop option for quality assurance and collaborative refinement.”article, stated

structured-output-contract (workflow)

Agents pass metadata, section-of-interest recommendations, segment patterns, and review results through defined workflow roles.

“Identifies potential segments based on video genre, target length, featured performers, and JSON metadata from the visual analysis agent.”article, stated

Tradeoffs

Use agent orchestration instead of a monolithic pipeline.

Chose Central orchestrator plus specialized agents over Single large model or one fixed pipeline.

Rationale: Specialized agents let Spotlight handle research, visual analysis, audio context, generation, post-processing, and review separately.

“The workflow consists of the following super agents and utility agents”article, stated

Deploy serverless and on-demand.

Chose Serverless scalable LLM invocation over Resource-heavy statically provisioned infrastructure.

Rationale: Video workloads can be bursty and cross-industry, so on-demand deployment reduces idle infrastructure cost.

“It is entirely serverless and on-demand, minimizing idle infrastructure costs and maximizing utilization”article, stated

Gotchas (what bit them)

Manual video editing preserves quality but does not scale.

Root cause: Editors must inspect footage, identify moments, cut clips, add narration/transitions, and run manual checks.

Resolution: Decompose the workflow into specialized agents while preserving reviewer and human-in-loop checks.

“Although this provides editorial control, it creates bottlenecks that don’t scale efficiently.”article, stated

Different video tasks need different latency/intelligence tradeoffs.

Root cause: Retail offers at the edge and complex video processing have different response-time and reasoning requirements.

Resolution: Use task-driven model selection between traditional AI and Nova models.

“balancing speed and intelligence across applications from real-time retail offers to complex video processing.”article, stated

Evaluation

Spotlight evaluates clips through reviewer-agent checks for quality, accuracy, brand alignment, and user requirements, with an optional human-in-the-loop review path. The article also reports comparative operational metrics for latency and cost.

Metrics: quality · accuracy · brand alignment · user requirement fit · video processing latency · highlight review cost · overall generation cost

3 supporting quotes
“It also validates each highlight’s quality and accuracy, streamlining editorial workflows as a result.”article, stated
“maintain alignment with user requirements and brand standards.”article, stated
“Highlight Review Cost (3–5 minutes) 10 times lower with Amazon Nova”article, stated

Outcomes

The case reports minutes for 2-3-hour sessions, 10x lower review and generation cost, and cross-industry use cases rather than customer deployment counts.

3 supporting quotes
“Spotlight has been applied across a range of industry scenarios”article, stated
“Video Processing Latency Minutes for 2–3-hour sessions Hours to days”article, stated
“Overall Highlight Generation Cost 10 times lower using serverless and on-demand LLM deployment”article, stated