03 / 05 · AI / Developer Tools

AHAL AI

Through-lineNo LLM judges an LLM.

Category
AI / Developer Tools
Role
Designer
Status
Design and whitepaper

01 / 07Context

01Context

AHAL AI is an engineering risk intelligence platform. It predicts the blast radius of a pull request, diagnoses production root causes, and stages autonomous remediation.

02Approach

Every LLM-proposed change is gated behind deterministic Tree-sitter and AST verification. There is no LLM-judges-LLM step anywhere in the loop. This is the deterministic core and LLM language layer split applied to code changes.

03System

Diagram · Where the LLM stops and verification starts
  1. 01

    Multi-agent repository ingestion

    Triggered by GitHub webhooks

  2. 02

    LLM-proposed change

    Remediation is proposed, never trusted

  3. 03

    Tree-sitter / AST verification

    Deterministic gate on every proposed change

  4. 04

    Staged autonomous remediation

    Only verified changes proceed

Deterministic coreLLM language layer

04Build

  • PR blast-radius prediction
  • Production root-cause diagnosis
  • Staged autonomous remediation
  • Multi-agent repository ingestion with GitHub webhook automation
  • Technical whitepaper, benchmarked against a competing multi-agent code-review system

05Challenges

  • Letting an LLM propose changes without letting it approve them: every proposal goes through deterministic Tree-sitter and AST verification.
  • Ingesting a whole repository across multiple agents, then reacting to GitHub webhooks as changes arrive.
  • Showing the design holds up by benchmarking it against a competing multi-agent code-review system.

06Result

Designed the platform and authored the technical whitepaper, benchmarking the design against a competing multi-agent code-review system.

07Learnings

A verifier that shares the generator's failure modes is not a verifier. Determinism is what makes the gate worth having.

AI / SYSTEMS / PRODUCT ENGINEERING
SHREEKUMAR.B000