agentic workload

Definition of agentic workload

1. : the pattern of computing work produced when an AI agent pursues a goal through many dependent model calls, tool calls, and state updates, often involving long contexts, repeated prefixes, irregular pauses, and bursts of parallel activity

   • The benchmark replayed an agentic workload with hundreds of model calls, compiler runs, and pauses for tool results.
   • Serving the agentic workload efficiently required enough cache capacity to preserve shared prefixes across a long session.

2. : a task or business process assigned to one or more AI agents that can plan and act across multiple steps rather than return a single response

   • The insurer treated claims intake as an agentic workload involving document retrieval, policy checks, escalation, and human approval.
   • A travel-planning agentic workload may combine web search, comparison, booking tools, and exception handling.