Rohit Kumar

Projects

The through-line is agents that have to survive contact with a real system — a Kubernetes cluster, a live interview, someone's supply chain. Everything below was built end to end rather than as a notebook demo.

Kubeflow docs-agent

2026 · Python · MCP · Agentic RAG · Kubeflow Pipelines · KServe · Istio · Helm · Terraform · OKE · GitHub Actions

Agentic RAG over the whole Kubeflow surface — docs, GitHub issues, manifests and source — served as an MCP toolset behind the Kubeflow website.

My Google Summer of Code 2026 project, and the thing I spend most of my open source time on. The starting point was a documentation chatbot that could only read Markdown. A Kubeflow user with a broken pipeline does not have a documentation problem, they have a "this exact error appeared in an issue eighteen months ago" problem, so the agent needed to read more than prose.

I added ingestion pipelines for GitHub issues, application code and Kubernetes manifests, and exposed them as separate MCP tools so the agent can choose where to look instead of retrieving from one undifferentiated blob. Every chunk carries path, product area, version and source metadata, which is what makes filtered retrieval possible at query time.

The largest application change was merged as a single 5.4k-line PR covering a three-tool MCP server, TEI embeddings, the issues and code pipelines, Terraform for embeddings/Milvus/KServe/Pipelines, and GitHub Actions that compile, test, and optionally deploy to OKE. Since then the infra work has moved to the edge: rate limits, CORS lockdown and session-JWT auth, with Istio configuration migrated into a Helm chart so the guardrails ship with the deployment rather than living as unreviewed YAML heredocs in Terraform.

RepositoryMy pull requestsOpen source page

Deploy Kubeflow on OCI

2026 · Terraform · OCI · OKE · Kubeflow · Istio · KServe · Kustomize

Terraform modules that provision an OKE cluster and install a full Kubeflow platform on Oracle Cloud — networking through Pipelines and KServe.

Built for jaiakash/deploy-kubeflow so someone can stand up Kubeflow on OCI without hand-assembling VCN rules and kustomize applies. Two Terraform modules: oke-cluster (VCN, IGW/NAT/Service gateways, three subnets, Flannel-tuned security lists, E5.Flex node pool) and kubeflow-platform (cert-manager, Istio, Dex, Knative, KServe, Pipelines, Central Dashboard, Profiles).

The install path is the unglamorous part that actually matters: CRI-O short-name image patching, MySQL PVC auto-creation on oci-bv, webhook-aware retries, server-side apply with force-conflicts, plus OCI auth / cluster / install / troubleshooting guides.

RepositoryMerged PR

MacBatch

2026 · TypeScript · Python · FastAPI · Ollama · Apple Silicon · npm

Batch AI workloads on a pool of idle Apple Silicon machines — a job queue, lease scheduler and worker CLI for embedding, OCR and classification that can wait.

Offline AI work is usually billed like interactive traffic. Re-embedding a corpus, OCR over an archive, or overnight classification does not need a latency SLA — it needs cheap throughput on hardware that is already paid for and often idle overnight.

macbatch is three moving parts: a FastAPI control plane that holds the queue, workers that lease shards (600s lease, then reassign), and Ollama on each Mac running a whole model locally. Workers pull; the control plane never opens a connection inbound, so a laptop behind home NAT can join with outbound HTTPS only.

Measured 252,686 embed items/hour on one MacBook Air with shard batching (2.8× from batching alone on the same machine). The CLI and control plane are open source; a hosted product surface sits at macbatch.vercel.app.

ProductDocsSource

CrackRound

2025 · Next.js · TypeScript · GPT-4o · WebSockets · Prisma · PostgreSQL · Sarvam

An agentic mock-interview platform: five streaming interviewer personas, a real-time voice loop, and a live code judge wired into the model context.

Built end to end, from an empty repository to something people pay per session to use. The interviewer is not a chat window with a prompt — it is a persona that holds a rubric, drives the round, interrupts, and follows up on a weak answer.

The voice loop is the part I am most happy with: streaming speech-to-text into GPT-4o and back out through streamed TTS over a WebSocket, at roughly 1.5 seconds end to end. Anything slower and the conversation stops feeling like an interview.

A DSA judge and a system-design whiteboard both feed into the model context, so the interviewer can see what you actually wrote rather than what you claimed. Scoring is JSON-schema constrained across five dimensions, with latency tracing and a hard $2-per-session cost ceiling.

AirCab

2025 · Python · LLM tool calling · STT/TTS · FastAPI

A voice-first booking agent that turns a spoken request into a confirmed ride, with the whole conversation under one tool-calling loop.

An experiment in how far you can push a voice agent when the task has real side effects. Booking a ride is a good test case because it is short, has a clear success condition, and punishes a model that hallucinates a confirmation.

The interesting problem was not the speech pipeline but the state machine underneath it: what the agent is allowed to assume, when it must read back a detail before committing, and how to recover when the user changes their mind three turns in.

FlowForge

2025 · TypeScript · React · ReactFlow · LangGraph · FastAPI

A node-based canvas for composing LLM workflows, where the graph you draw is the execution plan the runtime actually walks.

Visual agent builders usually stop at demo quality because the canvas and the runtime drift apart. FlowForge keeps one representation: the graph is compiled straight into the execution plan, so what runs is what you drew.

Nodes cover the usual set — prompts, tools, retrievers, branches, loops — and the runtime handles fan-out and joins. It exists because I got tired of rewriting the same orchestration glue by hand for every new agent idea.

AI Learn

2026 · Next.js · FastAPI · Sarvam · PWA

Voice-to-voice learning platform that teaches interview topics in Hinglish, built as a Next.js PWA over a FastAPI provider layer.

Most tutoring products assume you want to read. This one assumes you are commuting. The teaching style is deliberately Hinglish because that is how the explanation actually sounds when a senior engineer walks a junior through a concept in an Indian office.

STT, TTS and the LLM sit behind swappable adapters, so the same session logic runs against mocks in tests and Sarvam in production.

LiveSource

© Rohit Kumar 2026