Skip to content
context Tools and apps

AWS described an architecture for institutional knowledge management with Bedrock Knowledge Bases and an AI avatar

only one source so far

AWS described a reference architecture for institutional knowledge management combining Bedrock Knowledge Bases (RAG) with a voice-based AI avatar; deployment within hours through CloudFormation, but with an ongoing fixed cost for OpenSearch Serverless.

AWS published a reference architecture on its Machine Learning Blog for an institutional knowledge management system that combines Bedrock Knowledge Bases (managed RAG) with a voice and text interface through a configurable AI avatar. The solution is intended to address the problem of so-called tribal knowledge – experience and knowledge that organizations lose when key employees leave, because traditional documentation is often outdated or difficult to find.

According to the company, the architecture works by having knowledge owners upload existing documents (Word, PDF, plain text, Markdown, JSON) to Amazon S3, where automated synchronization splits them into chunks and creates embeddings from them using Amazon Titan Text Embeddings; these are stored in the Amazon OpenSearch Serverless vector store. Amazon Cognito and Amazon API Gateway provide access, AWS Lambda orchestrates the workflow, and Amazon DynamoDB caches responses, which is intended to reduce variable inference costs – the company states that in testing, it achieved a cache hit rate of 50 to 70 percent for tasks with a high proportion of repeated queries.

According to AWS, the solution differs from alternatives (custom architectures built on Bedrock or text chat agents such as Amazon Q) in three ways: voice and avatar interaction suitable for field workers without technical knowledge, simple content management without the need for restructuring or tagging, and rapid prototype deployment within hours. The company states that the OpenSearch Serverless vector store is billed based on OpenSearch Compute Unit with an ongoing minimum independent of query volume, which the company describes as the largest fixed cost component – on the order of hundreds of dollars per month at the default minimum.

The source text is incomplete, and further details on deployment and use case scenarios are missing from the available portion. You can find details in the source article.

What changed

Why it matters

For companies dealing with the departure of experienced workers and the loss of informal knowledge (manufacturing, healthcare, energy, public administration), this is a ready-made building block in place of custom development that, according to the company, takes weeks to months. According to the source, the decisive factor for deployment is the balance between savings from caching repeated queries and the ongoing fixed cost of the OpenSearch Serverless vector store, which accrues independently of actual usage.

Relevant practical impact

What this means

01

For a business

Companies dealing with the departure of experienced employees and the loss of tribal knowledge gain a ready-made reference architecture that can be deployed within hours through CloudFormation, but must account for an ongoing fixed cost for OpenSearch Serverless that is independent of query volume.

Processes
What to decide When considering deployment, verify with AWS the expected fixed costs of OpenSearch Serverless (on the order of hundreds of USD per month even without usage) and the actual frequency of repeated queries, which determines the savings from caching.
More business impacts →
AWS Bedrock generative AI knowledge management RAG Knowledge management

Check the original

Event sources

only one source so far · 1 publisher, 0 independent. We count feeds from the same owner only once.

1
AWS Machine Learning Blog primary source · first detected Democratizing institutional knowledge: Building an AI-powered knowledge management system with AWS