Khush Patel · Portfolio

Agent Simulation Engine

A CI/CD-style testing and improvement platform for AI agents, created at Lyzr AI.

The Agent Simulation Engine is a platform I created at Lyzr AI that brings CI/CD discipline to AI agents. Before an agent reaches production, the engine tests it against realistic simulated scenarios, evaluates the results with AI-powered judgment, analyzes failure patterns, and, through its companion Agent Improvement Engine, automatically improves the agent's configuration using reinforcement learning techniques.

Press coverage of Lyzr's fundraising has repeatedly highlighted the engine. Indian Startup News' story on Lyzr's $8M Series A described it as inspired by Yann LeCun's JEPA research, letting enterprises run over 10,000 simulations per agent before real-world rollout. The Next Web's coverage of Lyzr's $100M Series B raise cited the same capability as a core differentiator for regulated industries.

I presented the engine publicly in "Behind the Scenes of Lyzr Agent Evals" and the "Mastering Evals" session of the Lyzr Agent Building Workshop Series, walking through how to run meaningful evals, harden agents, and build reusable eval loops.

Khush Patel, speaker on the Behind the Scenes of Lyzr Agent Evals live webinar

Links

← Back to the full portfolio