AI / ML Engineer Software Engineer

Raj Tibarewala

I build intelligent software systems — machine learning and the backend it runs inside — for places with real constraints: drone telemetry, aerial imagery and edge hardware, where the code has to work outside the notebook.

B.Tech CSE (Cyber Security) at VIT Vellore, class of 2028. Software & R&D at Team Ardra, building autonomous drone systems.

Focus
Anomaly detection · computer vision · backend · edge inference
Learning
LLMs · RAG · LangChain · inference optimization
Open to
ML / AI and software engineering internships

01 Selected work

Systems I've built, and how I checked they work.

Featured · Currently building

AegisFlight

ML-based intrusion detection for drones

AI/ML Software Systems Security

Status
Ongoing Stage 1 submitted
Year
2026
Context
IIT Bombay TechFest 2026 — PUSHPAK Grand Challenge (Security of Drones)
Team
Team Ardra
  • Python
  • scikit-learn
  • NumPy
  • Pandas
  • pymavlink
  • FastAPI
  • WebSockets
  • React
  • pytest

An explainable intrusion-detection system for drones commanded over MAVLink 2. Four independent detectors watch the telemetry and command link; an evidence-fusion engine turns what they see into one severity-rated alert that says why it fired. Security is the problem it watches for — but machine learning, systems work and a real backend are what it's built from.

Problem

A drone trusts its telemetry and command link. GPS spoofing, forged telemetry, injected commands, link flooding and tampered firmware each leave different traces — and a single classifier trained on simulated attacks risks learning the simulator instead of the attack. Operators also need to know why an alert fired, not just that it did.

Approach

  1. Input Simulated flight emitting MAVLink 2, with injected attacks
  2. Features Decoded into 11 online features: network, navigation, sensor, command
  3. Detectors
    • Protocol rules
    • Physics consistency
    • ML anomaly
    • Firmware integrity
  4. Fusion Severity, attack class and evidence per decision
  5. Output Hash-chained event log · FastAPI / WebSocket · React dashboard
Pipeline as implemented in the Stage 1 repository.
Alert format · from the demo runbook HIGH · GPS_SPOOFING — position residual > 12 m (reported track diverges from velocity)
How each detector works
  • Protocol rules — message rate, sequence gaps, rogue sources, liveness and command provenance.
  • Physics consistency — cross-checks physically coupled signals: position against the velocity-implied track, GPS against barometric altitude, heading against course, battery dynamics. Needs no attack data.
  • ML anomaly detection — an Isolation Forest + Mahalanobis ensemble trained only on benign flights.
  • Firmware integrity — SHA-256 manifest verification.
  • Evidence fusion — alerts carry human-readable evidence, are written to a SHA-256 hash-chained log, and stream to the dashboard over WebSockets.

How it's evaluated

  • Leakage control

    Session-level splits, and the anomaly model never sees an attack during training.

  • Reproducibility

    Scripted benchmark across multiple random seeds and attack scenarios — 23k+ scored decisions. Results come straight from the scripts; nothing is hand-entered.

  • Ablation

    The same benchmark with ML switched off, to isolate what the model actually adds.

  • Real flights

    Public PX4 and ALFA flight logs replayed through the pipeline for false-alarm analysis.

  • Sim-to-real shift

    Kolmogorov–Smirnov tests measure how far real telemetry features drift from the simulator's.

  • Tests

    pytest suite across unit, integration, end-to-end and API paths.

Status

Stage 1 submitted; development is ongoing. Results so far come from a reproducible local simulation, so detection of real attacks has not been validated yet — the real-log replay exists to show where simulator-tuned thresholds stop transferring. Next: live MAVLink ingestion, then SITL and hardware-in-the-loop validation.

IIT Bombay TechFest 2025 · Finalist

GeoAI

Rooftop mapping from drone orthophotos

AI/ML Computer Vision Software

Status
Finalist Completed 2025
Year
2025
Context
IIT Bombay TechFest 2025 — GeoAI hackathon
Team
Team Ardra
  • Python
  • Ultralytics YOLOv8
  • SegFormer
  • OpenCV
  • rasterio
  • Shapely
  • Docker

A geospatial computer-vision pipeline that turns village-scale drone orthophotos and GIS shapefiles into training data, then detects and classifies rooftops and utilities and segments water bodies and roads.

Problem

Village orthophotos arrive as very large GeoTIFFs; the ground truth arrives as shapefiles in their own coordinate reference system. Roof types look alike from above and the classes are imbalanced. None of it is model-ready.

Approach

  1. Input GeoTIFF orthophotos + shapefiles
  2. Align & tile CRS alignment, 640×640 tiles, empty-tile filtering
  3. Labels Labels from shapefiles, 70 / 20 / 10 split, label & CRS validation
  4. Models
    • YOLOv8 · roof type + utilities
    • SegFormer · water, roads
  5. Ship Visual QA and Dockerized inference
Pipeline stages as built for the hackathon.
Pipeline details
  • Data engineering — reprojected vector labels to the raster CRS, tiled orthophotos to 640×640, filtered empty tiles, generated labels from shapefiles and split 70 / 20 / 10.
  • Detection — YOLOv8 rooftop detection with four roof classes (RCC, Tin, Tiled, Others), plus utility detection.
  • Segmentation — SegFormer semantic segmentation to extract water bodies and roads.
  • Quality gates — label validation, CRS validation and visual QA; Dockerized inference for reproducible deployment.

Outcome

Finalist at IIT Bombay TechFest 2025, with an end-to-end pipeline from raw GeoTIFFs to a containerized inference service.

Computer vision · Side project

Infinity-Snap

Gesture-based file automation

Computer Vision Software

Status
Completed
Year
2025
  • Python
  • OpenCV
  • MediaPipe
  • NumPy

A real-time computer-vision pipeline that maps a webcam-detected hand gesture to an OS-level file operation.

Problem

Trigger a system action with a deliberate hand gesture, using nothing but a webcam.

Approach

Tracks hand landmarks from the webcam and detects a finger snap from how the thumb–middle-finger distance changes between frames, with a guard against double triggers. Detection, command mapping and execution are separate, logged modules.

Outcome

A Thanos-style snap that sends a random half of a target folder's files to the Recycle Bin — recoverable by design, never a hard delete.

Also built

  • SIEM-Lite Python · Streamlit · 2026

    Linux auth-log monitoring with rule- and correlation-based detection of SSH brute force and privilege escalation, surfaced in a real-time Streamlit dashboard.

    Security Software

  • VTOP GPA Calculator JavaScript · 2025

    A GPA calculator that reads VIT's VTOP timetable directly, so courses and credits are extracted instead of typed in. A public web tool for VIT students.

    Software

02 Experience

Onboard, under real constraints.

Sep 2025 – Present

Team Ardra

Software & R&D — Autonomous Drone Systems

Where
VIT Vellore
Hardware
NVIDIA Jetson Orin Nano · Raspberry Pi
  • Latency
  • Power
  • Compute
  • Integration

Team Ardra builds autonomous drones. I work on the software that runs on the aircraft itself, where ML has to share a small computer with everything else and still keep up.

What I do

  • Build and validate embedded Linux software for onboard compute — NVIDIA Jetson Orin Nano and Raspberry Pi.
  • Deploy onboard ML inference pipelines within latency, power and compute budgets.
  • Debug integration problems that cross sensor, compute and control boundaries.
  • Prototyped an onboard vision-serving architecture (FastAPI, PyTorch, Hugging Face DETR) that decouples camera capture, threaded model inference and live video streaming, so slow inference never stalls the feed.

Vision-serving prototype

  1. Camera thread Overwrites a single latest-frame slot — newest wins, no queue
  2. Independent loops
    • Inference worker · runs DETR on the newest frame and publishes the latest detections
    • Stream loop · live MJPEG that never waits on inference
  3. Ground station Smooth video, with detections delivered as structured data
Prototype built on a laptop standing in for the Jetson; the question it answers is architectural — capture, inference and streaming must not block each other.

Earlier

  • Pinnacle Labs — Cybersecurity Intern Remote · Feb – Mar 2026

    Built Python security tooling: a hybrid AES + RSA encryption tool and an input-capture research tool for studying interception techniques.

  • India Space Academy — Astronomy & Astrophysics Intern Remote · 2025

    Structured program followed by an independent data-analysis project: estimating the Hubble constant from Type Ia supernova data (see Research).

03 About

Where machine learning meets software, systems and research.

I'm a computer-science undergraduate at VIT Vellore. Most of my time goes into machine learning built for somewhere real — a drone's companion computer, a MAVLink telemetry link, or a village's worth of aerial imagery — and the backend that turns a model into a running service. My degree specialization is cyber security.

That security background shapes how I build ML. Before asking how accurate a model is, I ask how the system fails, how it could be fooled, and whether my evaluation would notice. That's why AegisFlight ships with an ML-off ablation and a real-flight replay, not just a headline number.

Away from the software, I do science. I estimated the Hubble constant from Type Ia supernova data with India Space Academy, and co-authored a paper on nuclear-thermal-rocket design. The same habit — get the data honest, then let it decide — runs through everything above.

Raj Tibarewala, in a white shirt, photographed in black and white
  • AI / ML

    Anomaly detection, object detection and segmentation — with evaluation built to catch leakage before it flatters the numbers.

    AegisFlight · GeoAI
  • Software / Backend

    APIs, real-time services, dashboards and test suites — the software that makes a model usable and a tool shippable.

    AegisFlight · GeoAI · VTOP
  • Systems / Edge

    Onboard compute under latency, power and memory budgets, where inference shares one small computer with everything else.

    Team Ardra · AegisFlight
  • Computer Vision

    Detection and segmentation on real imagery — aerial orthophotos and live camera feeds.

    GeoAI · Team Ardra · Infinity-Snap
  • Research

    Estimating the Hubble constant from Type Ia supernovae, and co-authoring a nuclear-thermal-rocket study.

    Hubble analysis · NTR paper
  • Security

    Intrusion detection and threat modeling for cyber-physical systems — one lens on how systems fail.

    AegisFlight · SIEM-Lite

04 Skills

What I work with — and where I've used it.

Languages

  • Python
  • C++
  • C
  • Java
  • JavaScript
  • SQL

Used in Python in every ML project here

ML & data

  • scikit-learn
  • NumPy
  • Pandas
  • SciPy
  • Matplotlib
  • Jupyter

Anomaly detection · feature engineering · model evaluation · ablation studies · statistical analysis

Used in AegisFlight, Hubble analysis

Deep learning & vision

  • PyTorch
  • Ultralytics YOLO
  • Hugging Face Transformers
  • OpenCV
  • rasterio
  • Shapely

Object detection · semantic segmentation · geospatial imagery

Used in GeoAI, Team Ardra, Infinity-Snap

Deployment & systems

  • FastAPI
  • Docker
  • Linux
  • Git / GitHub
  • pytest
  • NVIDIA Jetson Orin Nano
  • Raspberry Pi

Used in Team Ardra, AegisFlight, GeoAI

Frontend

  • React
  • JavaScript

Used in AegisFlight dashboard, VTOP GPA Calculator

Security

Intrusion detection · threat modeling · log analysis & attack correlation · Linux security

Used in AegisFlight, SIEM-Lite

Currently learning — not yet production experience

  • LLMs
  • RAG
  • LangChain
  • Inference optimization

05 Research & science

Beyond the software stack.

Paper · Co-author

Nuclear Thermal Rocket: Design Considerations and Efficiency Optimization for Deep-Space Explorations

Co-authored under faculty supervision.

My contribution

  • Literature review and background research on nuclear thermal propulsion
  • Technical structuring of the paper
  • Manuscript preparation

Astrophysics data analysis · 2025

Estimating the Hubble constant from Type Ia supernovae

Completed India Space Academy project

Problem
Measure the universe's expansion rate, H0 — and from it the age of the universe — from observational supernova data.
Approach
Cleaned the Type Ia supernova dataset, removed outliers and fit the distance–redshift relation in Python.
Outcome
Estimated H0 and the corresponding age of the universe, and compared the result against Planck 2018 cosmological parameters.
  • Python
  • NumPy
  • Pandas
  • Matplotlib
Repository

06 Contact

Let's talk.

Email is the fastest way to reach me. I'm open to ML / AI and software engineering internships, and to research collaborations in computer vision, anomaly detection and autonomous systems.

GitHub
github.com/RajTib
LinkedIn
in/raj-tibarewala
Resume
Download PDF · View online
Phone
+91 91298 37866
Location
Vellore, India · IST