InferGate
A distributed LLM inference gateway built for low latency, provider efficiency, and graceful failure.
sde-1 · systems & applied ai
Builds systems that have to work.
Distributed infrastructure, agentic AI, and full-stack products. Engineered with evidence behind every claim, not adjectives.
01 · positioning
I care about what happens after the prototype works: latency, reliability, architecture, edge cases, and everything required to turn an experiment into a system somebody can depend on. Most of my work sits where a model, a cache, and a user all have to agree on what “correct” means at the same time.
verified benchmarks
02 · featured work
A distributed LLM inference gateway built for low latency, provider efficiency, and graceful failure.
A citation-grounded research assistant with hybrid retrieval, calibrated abstention, and reproducible evaluation.
A real-time safety system that detects compound plant hazards missed by isolated threshold alarms.
A no-lookahead equity research pipeline that reports both signal and failure honestly.
03 · how I think
This is the actual request path from InferGate, one of the four projects below. Hover a stage to see the decision behind it. Every case study gets its own version of this diagram, built from what was actually shipped.
Incoming inference request hits the gateway.
04 · stack
A backend-first stack for building, measuring, shipping, and operating AI products end to end. Hover a skill to see which project actually used it.
Languages & Backend
AI & Retrieval
Data & Infrastructure
Frontend & Product
Engineering Practice
05 · experience
From AI product infrastructure to SQL performance and clinical machine learning.
Mentoria
Promoted from Full-Stack & Agentic AI Development Intern - Project Arya
Mentoria
Project Arya - AI-powered job search platform
SkyHigh Travels
Production operations and analytics
NMIMS MPSTME
Under Dr. Mahesh Patil - 1,166-patient tuberculosis cohort
Education
NMIMS - Mukesh Patel School of Technology Management & Engineering
B.Tech in Computer Engineering · Aug 2023 - May 2027
Pace Junior Science College, Mumbai
HSC - Science · 2021 - 2023
I.E.S. Secondary School, Mumbai
SSC · 2021
Recognition
AWS Certified Cloud Practitioner
CLF-C02 - Amazon Web Services - 2025
Top 100 of 1,000+ teams
ZS Campus Beats 2026 - ZS Associates
National Conference Presenter
Alcohol Use and Tuberculosis Severity - TCSC - Dec 2024
06 · about
I’m a Computer Engineering student at NMIMS and an SDE-1 at Mentoria, working across production APIs, retrieval systems, background pipelines, and the React frontends that sit on top of them.
I care about the numbers behind a claim: p95 latency under concurrency, benchmark quality, test coverage, provider-call reduction, or an honest negative result. The goal is never a clever demo. It’s a system whose behavior can be explained and trusted.
Outside of that: usually somewhere between an architecture diagram and a debugger, occasionally a chessboard, and reliably a few chapters into an Agatha Christie novel.
07 · contact
Tell me what you are building, where it is getting stuck, or what role you have in mind. This form sends directly to my inbox, no email-app redirect needed.
garyphadale@gmail.com