Skip to content
View Vinay-15's full-sized avatar
:octocat:
:octocat:

Highlights

  • Pro

Block or report Vinay-15

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. Markdown is supported. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
Vinay-15/README.md

header

Typing SVG

👨‍💻 About Me

I'm a Software Engineer working on AI infrastructure, currently an MS in Data Science student at CU Boulder (GPA 3.99/4.0). Two years of production engineering at Oracle. Now I work on the systems layer underneath LLM applications: how models get served, how agents get evaluated, and how GPUs get shared.

  • 🔭 Building multi-LoRA serving, agent evaluation harnesses, and KV-cache-aware inference on vLLM
  • 🛠️ Interested in inference performance, GPU resource sharing, and serving-stack reliability
  • 🏥 Ex-Stanford Health Care (AI Developer Intern) · 🏦 Ex-Oracle (2 yrs, core banking at scale)
  • 🏆 Red Bull Innovation Track Winner, HackCU12
  • 📬 Open to AI infrastructure / ML platform roles from May 2027
Terminal GIF

🔨 What I'm Building

Multi-LoRA Serving Platform (in progress) Serving many LoRA adapters from one shared base model on pooled GPUs, with an adapter-aware request router that sends each request to an instance already holding the adapter it needs, cutting adapter load overhead. vLLM for serving, Kafka for job queueing, Redis for adapter and job state, Spark for dataset preprocessing, Kubernetes for GPU fine-tuning jobs, GCS for adapter storage.

Agent Harness Evaluation (in progress) Running an open-source coding agent on Harbor evaluation tasks against a self-hosted vLLM endpoint, measuring how harness design (full conversation history vs. summarized context) trades serving cost against task success.

KV-Cache-Aware LLM Serving (in progress) Benchmarking vLLM under multi-turn agent traffic on a MIG-partitioned A100, instrumenting TTFT, p99 latency, cache occupancy and queue depth to find where throughput and tail latency break down.


🧰 Toolkit

Serving & GPU: vLLM · LoRA/PEFT · PagedAttention · CUDA · NVIDIA A100/MIG · Slurm · Apptainer · PyTorch · Prometheus Agents & LLMs: LangGraph · LangChain · Tool-Calling · ReAct · Pydantic · Multi-Agent Systems · Claude Code · Devin Data & Platform: Kafka · Spark · Airflow · Redis · Kubernetes · Docker · PostgreSQL · FastAPI · GCP · AWS · Azure Languages: Python · C/C++ · SQL · PL/SQL · Scala · Shell/UNIX


💼 Experience

🏥 AI Developer Intern, Stanford Health Care (May 2026 – Aug 2026)

  • Built a real-time BACnet/IP telemetry pipeline and database from scratch for hospital infrastructure, feeding ML and agentic workflows
  • Deployed on-premise LLM agents with tool-calling and hardened error handling, and owned serving-stack uptime and health monitoring in a regulated environment

🏦 Software Developer, Oracle Financial Services (Aug 2023 – Aug 2025)

  • Owned core banking modules serving 600+ institutions (UBS, Access Bank), building data pipelines in Python, PL/SQL, Shell and REST
  • Automated an ETL and validation framework over 10K+ daily transactions, cutting defects 30%, and ran containerized deployments at 99.9% uptime

📊 Data Engineer Intern, The Thick Shake Factory (May 2022 – Jul 2022)

  • Built Kafka streaming and Airflow ingestion pipelines consolidating 40+ outlets into columnar storage, powering real-time dashboards over 100K+ daily transactions

🤝 Connect with Me

footer

Pinned Loading

  1. Smart-Glove-Sign-Language-Interpreter Smart-Glove-Sign-Language-Interpreter Public

    Developed a smart glove using Arduino and Flex sensors which interprets the sign language through the movement of flex sensors.

    C++ 2 1

  2. KV_Cache_LLM_Serving KV_Cache_LLM_Serving Public

    KV-cache-aware LLM serving on GPU/HPC

    Python

  3. llm-semantic-book-recommender llm-semantic-book-recommender Public

    Forked from t-redactyl/llm-semantic-book-recommender

    The code to accompany the freeCodeCamp tutorial explaining how to use large language models to build a semantic book recommender.

    Jupyter Notebook

  4. Plant-Disease-Detection Plant-Disease-Detection Public

    Jupyter Notebook

  5. Ricoh_GPT_RAG Ricoh_GPT_RAG Public

    Forked from DaSSA-Hackathon-2026/Ricoh_GPT_Data_Dons

    Hybrid RAG Retrieval Pipeline for Ricoh Technical Documentation

    Python

  6. Technical_analyst_Agentic_AI Technical_analyst_Agentic_AI Public

    Python