System / 01Oware Engine and a Ladder of RL Agents
2026A custom Oware engine and evaluation ladder for DQN, PPO, AlphaZero-lite, and Minimax agents, including the training strategies that failed.
I’m a systems engineer and ai/robotics researcher. I build autonomous systems and study the places where machine learning, software engineering, and design meet.
This site is my working archive: research notes, open-source systems, long-form essays, and manuscripts shaped by the questions I’m currently following.
At the moment, I’m teaching a practical course on robotics and continuing work across robot learning, perception, and infrastructure for intelligent systems.
01 / Journal
02 / Research
03 / Systems
System / 01A custom Oware engine and evaluation ladder for DQN, PPO, AlphaZero-lite, and Minimax agents, including the training strategies that failed.
System / 02A two-stage pipeline for traffic monitoring. The first stage pairs an object detector with a spatial logic layer that filters detections against a precomputed road mask, so only on-road vehicles contribute to density measurements.
System / 03A stabilizing control policy for the 29-DOF Unitree G1 humanoid trained with PPO and a small Actor-Critic network (512 → 256 → 128). Built on the mjlab framework with MuJoCo Warp to simulate 4,096 parallel environments directly on the GPU, bypassing CPU bottlenecks.