Skip to content
context Business and investment

AWS released a guide for managing Amazon Bedrock costs for agentic workloads

only one source so far

AWS has published a five-level FinOps model (attribution, observability, enforcement, optimization, operations) for managing Amazon Bedrock costs, aimed at agentic workloads with high token and context consumption.

AWS has published a guide for FinOps and platform engineering teams on how to comprehensively manage costs for the Amazon Bedrock service. According to the company, the model consists of five interconnected steps: attributing costs to a specific identity, observability of every request, budget enforcement, optimization of platform default settings, and regular operational review. Attribution and review are to be handled by FinOps, while observability, enforcement, and optimization fall to platform engineering, with the final review being a joint effort.

The reason, according to the company, lies in the different nature of agentic workloads compared to conversational assistants: while a typical chatbot generates one model call per one user input, an agentic workflow (e.g., an AI coding assistant that plans a change, reads files, and calls tools) performs many calls for a single task, and each of them carries a larger context. Token consumption, according to AWS, therefore grows with the degree of autonomy of the workflow and the size of its context, not with the number of user interactions.

In the area of attribution, Amazon Bedrock automatically assigns inference costs to the IAM principal that made the call, across all models, without the need for custom infrastructure. This information appears in the line_item_iam_principal column in the AWS Cost and Usage Report 2.0 and is available for IAM users, roles, federated identities, and API keys. For cases where multiple users call Bedrock through a single shared IAM role (typically with an LLM gateway), the article describes a solution using per-user session management with AWS STS, where the gateway assumes the role once per user and passes their identity as the session name and tags. Other attribution mechanisms include application inference profiles (for a stable set of applications and models) and Projects/workspaces on the bedrock-mantle endpoint for OpenAI-compatible workloads.

The rest of the guide (observability, enforcement, optimization, and operational review) is not available from the source. See the source article for details.

What changed

Why it matters

Companies running agentic AI applications on Amazon Bedrock often lose track of which team or application is generating costs, especially when traffic goes through a shared gateway with a single IAM role. The described procedure makes it possible to attribute costs to a specific identity, team, or application directly in the billing pipeline and to set budgets with enforcement before overruns accumulate.

Two audiences, two different impacts

What this means

01

For individuals

Developers and platform engineers building an AI gateway on top of Amazon Bedrock need to implement per-user session management (assuming a role with session tags via STS), otherwise cost attribution is lost behind the shared role.

What to do Check whether your custom AI gateway on Amazon Bedrock passes per-user identity via session tags, or calls the service under a single shared IAM role without attribution.
More practical updates →
02

For a business

Companies using Amazon Bedrock for agentic workloads can implement granular cost allocation at the identity, team, and application level directly in the AWS Cost and Usage Report, which forms the basis for chargeback and budget enforcement.

Processes
What to decide Enable granular cost allocation (cost allocation tags, IAM principal in CUR 2.0) for Amazon Bedrock and connect it to internal FinOps reporting.
More business impacts →
AI agents Amazon Bedrock AWS FinOps řízení nákladů

Check the original

Event sources

only one source so far · 1 publisher, 0 independent. We count feeds from the same owner only once.

1
AWS Machine Learning Blog primary source · first detected Managing Amazon Bedrock costs end to end: A playbook for FinOps and platform teams