Home
WorkBlogTalksPapersAbout
Nikita Kozodoi

Nikita Kozodoi, PhD

Senior Scientist at AWS FDE. I publish applied AI research and embed with engineering teams to build custom AI systems, from experimentation to production deployment.

8+ years in AI/ML ยท Focused on LLMs and agentic systems

CV
29
Blog Posts
36
Public Talks
18
Papers
659
Paper Citations
405
GitHub Stars
18
Kaggle Medals

What's new

Blog

SWE-InfraBench + Kiro: What Happens When a Coding Agent Tackles IaC?

Builder Center

Language models solved only 34% of SWE-InfraBench's infrastructure-as-code tasks in one attempt. We ran Kiro over all 100 and found that a full agent loop with Sonnet 5 reaches 82%, with partially correct answers converging once the agent can re-run the tests itself.

View all 29 blog posts
Talk

Red Teaming LLMs - Practical Defense Strategies

AWS Summit ยท Zurich

Learn to secure LLM applications through red teaming. We will explore prompt injection, jailbreaking, toxic output generation, and secure code execution risks in AI agents. See live attack demos and hands-on threat modeling. Discover how Amazon Bedrock Guardrails, Amazon Bedrock AgentCore, and monitoring tools can help defend against vulnerabilities. Leave with actionable strategies for hardening generative AI systems and conducting security assessments.

View all 36 talks
Paper

Beyond Frequency: Output-Vocabulary Pruning by Log-Mass Maximization

COLM 2026 Workshop on Tokenization

A tokenizer defines the vocabulary a language model scores at every decoding step. Output-vocabulary pruning modifies this vocabulary after training: it keeps the model and tokenizer fixed and restricts the set of output tokens scored at inference, compressing the vocabulary-sized output layer. The dominant approach, frequency-based pruning, optimizes average token coverage, which may lead to stripping the tokens that minority languages and specialized domains depend on. We address this by giving the selection problem an explicit objective: the expected log retained probability mass under the deployment distribution, which we show is equivalent to minimizing reverse KL to the teacher and is monotone submodular. We therefore select the retained tokens by greedy maximization of this objective, which inherits a (1 - 1/e)-approximation guarantee. Frequency pruning is its linear surrogate, optimal only when contexts agree on a common token ranking. Across synthetic and multilingual deployments, greedy outperforms both frequency- and magnitude-based pruning, with the largest gains where that agreement breaks down. Under English-dominant calibration, greedy cuts Arabic reverse KL by 0.53 nats and improves Russian generation by +1.4 chrF, at negligible cost to English; the same support raises speculative-decoding draft acceptance by +5.4pp on Arabic. Our main experiments use Qwen3.5-0.8B, and a cross-family check on Gemma-3-1B confirms the qualitative pattern.

View all 18 papers

Latest on LinkedIn

Follow on LinkedIn
24 Sept 2026

Meet us at AWS Summit Dubai next week! ๐Ÿ‡ฆ๐Ÿ‡ช Our team will demo custom solutions we built for real business use cases, including voice and video AI, deep research agents, and physical AI. If you want to learn more about AWS Forward Deployed Engineering, and chat about agentic AI and model customization - find us at the AI/ML zone! ๐Ÿ“… September 30, Dubai World Trade Centre ๐Ÿ”— Register: https://lnkd.in/ehjXFrW3

1700
3 Sept 2026

๐Ÿ‡จ๐Ÿ‡ญ Great time at AWS Summit Zurich! Philipp Kaindl and I gave a talk on red teaming. As more applications rely on LLMs and AI agents, it becomes critical to know how to protect them against adversarial attacks like prompt injection, agent goal hijacking, context poisoning and many others. Always happy to discuss this topic with the community!

4602
31 Aug 2026

๐ŸŽ“ I completed all four Anthropic certifications this month: Associate, Developer, Architect Foundations, and Architect Professional. The material generalizes well beyond Claude. Context management, tool and prompt design, MCP, evaluation, and cost and latency tradeoffs are the same problems whether you build on Claude, Codex, Kiro, or anything else. I face most of these regularly in customer projects. I would recommend these exams to two groups: anyone building AI agents, and engineers who use coding assistants daily and want to get more out of them. Preparing for the exams showed me a few gaps in my own setup.

5860

Selected work

All 8 case studies
AUMOVIO

Multi-agent defect detection for automotive software

Agentic code scanning system that found 30+ high-priority defects in a production automotive codebase.

Toyota Motor Europe

Recovering business logic from a mainframe

Agentic pipelines that recovered the business logic buried in 1.3 million lines of mainframe code, now moving to production rollout.

Lounge by Zalando

Localizing marketing content across 17 European markets

Test-time self-reflection for content localization across 17 European markets, tuned for quality, cost and latency.

Get in touch

Open to collaboration, speaking invitations, and conversations about applied AI.

Contact

Pages

  • Work
  • Blog
  • Talks
  • Papers
  • About

Social

  • LinkedIn
  • GitHub
  • Google Scholar
  • X / Twitter
  • Instagram

Contact

  • n.kozodoi@icloud.com
  • Buy me a coffee
  • Download CV
  • RSS feed
  • Impressum

ยฉ 2026 Nikita Kozodoi. All opinions are my own.