I Built My First AWS Agent Workflow, and the Hardest Part Was Getting It to Stop Assuming Things

The useful part

I built a customer support agent using Amazon Bedrock AgentCore, AgentCore Gateway, AWS Lambda, DynamoDB, and an FAQ. I finished it in about two days and passed on my first attempt with a correctness score of 0.83. I did not have enough time to go back and refine it or run another evaluation round because there was a lot happening in my life at the time.

How it works

• I am still learning too, so this is simply my experience of building this project, what confused me, what the evaluation showed me, and what I would do differently next time.
• For a bug report, I had told the agent that it needed 3 things before creating a ticket: a description of the problem, steps to reproduce it, and the environment where it happened.
• In 2 test cases, the model understood what the customer was talking about and created the ticket even though one of those required pieces of information was missing.
• That made me realize something I had not thought about enough before: understanding a request is not the same as having enough information to safely take an action.
• It is also about being clear about when it should act, when it should ask for more information, and when it should stop and hand the request to a person.