Home
BlogTalksPapersAbout
Nikita Kozodoi

Blog

27Posts
Nikita Kozodoi

Boost Your LLM Performance on Amazon Bedrock with Self-Reflection

Home
Blog
Boost Your LLM Performance on Amazon Bedrock with Self-Reflection
Nikita KozodoiJanuary 2026

Trading extra inference passes for accuracy on Amazon Bedrock

Read the full post on Builder Center

When an LLM isn't accurate enough, the usual move is to reach for a bigger model and pay more per call. Self-reflection offers a third option: let the model read its own answer, spot the problems, and revise. Two or three passes of a small model can often land where one pass of a large one does, and cost less doing it. GenAI Reflection for Amazon Bedrock is the open-source library we built for this. It wraps the Bedrock client, so adding reflection is a config change rather than a rewrite.

The verifier earns its keep the fastest. You supply a function that checks the output and feeds the result into the next round, which for text-to-SQL means running the query and returning either the error or the rows. Reflecting against real feedback beats reflecting in isolation, because the model has something to correct against other than its own judgement.

How much it helps depends on the task, and the spread is wider than we expected. Mathematical reasoning improved by up to 220% after one or two rounds, sentiment classification and some localisation work gained, and translation and text-to-SQL were mixed. Smaller models gained more than larger ones throughout, and returns flatten after three or four rounds. That variation is why the library ships an optimiser: give it a small labelled set and it searches combinations of model and reflection count against accuracy, cost and latency. The paper has the full benchmark across 10 models and 4 domains.

Related content

Talk

Finding the Sweet Spot: Trading Quality, Cost, and Speed During Inference-Time LLM Reflection

2025
Blog

Detect Hallucinations for RAG-Based Systems

2025
Talk

How Lounge by Zalando Innovates Content Localization with Generative AI

2025

© 2026 Nikita Kozodoi. All opinions are my own. RSS