The models below run in live broadcast pipelines. My work on them is the same output, faster:
profiling, FP16 precision, and GPU-pipeline optimization that lifts throughput while the
predictions stay identical. Methods stay under the hood — the numbers are the point.
EdgeTAM
45 → 61 FPS
real-time tracking · basketball dunk
Optimized the sequential tracking pipeline for the live dunk-show metrics — throughput rose from 45 to 61 FPS with accuracy held, so metrics land in real time for the show's team.
DAM4SAM · SAM 2.1
~79 FPS · RTX 6000
fine-tuned tracker · skateboarding
Fine-tuned and profiled the autonomous skater tracker to reach up to ~79 FPS on an RTX 6000 with exact output parity — same masks, same decisions, just fast enough for live X Games judging.
TrackNetV5
F1 95.1 → 99.1
ball tracking · pickleball line calling
Fine-tuned TrackNetV5 for broadcast ball tracking — F1 climbed from 95.1% to 99.1% — and served it under TensorRT at 120 FPS live, keeping ball detection reliable enough to stand behind on-air in/out calls.
SAM 3
FP16
fine-tuned segmentation
Fine-tuned for broadcast segmentation and moved to FP16 precision — smaller, faster inference with equivalent output quality.
SAM 3 · video tracker
60 FPS · 2× RTX 6000
video object tracking
Ran the SAM 3 video tracker at 60 FPS across a 2× RTX 6000 setup — a 3× throughput gain — keeping temporal tracking real-time on broadcast footage.
Custom temporal model
45 → 68 FPS
causal · snowboarding trick delimiting
Built a custom causal temporal model for snowboarding — it consumes only past frames (no lookahead, so it is real-time safe) and outputs a per-frame probability the rider is airborne, cleanly marking trick start and end. Optimized from 45 to 68 FPS.
YOLO26x
pose
pose estimation
Pose estimation inside the real-time tracking stacks, supplying keypoints that drive trick and metric computation.
ViTPose
pose · model zoo
transformer pose estimation
Transformer-based pose estimation in the Triton-hosted broadcast model zoo, feeding athlete keypoints to the trick- and metric-computation stacks alongside the detection and segmentation models.
YOLO-E
fine-tuned
semantic segmentation
Fine-tuned semantic segmentation that holds up in cluttered broadcast scenes — props, crowds, and occlusions in the dunk and skate pipelines.
Sapiens-2
fine-tuned
human-centric vision
Fine-tuned human-centric vision for athlete body understanding, feeding the pose and metric layers of the sports pipelines.
SAM · RF-DETR · YOLO
line-calling stack
detection & segmentation
The detection-and-segmentation backbone of the live pickleball line-calling stack — ball tracking and bounce localization behind the near-perfect on-air in/out calls.
Audio & speech
crowd-pulse
Whisper · SAM Audio · Qwen TTS · VibeVoice
Speech and audio models reading venue sound at live events to gauge audience pulse — crowd reaction and excitement signals — from the arena's own soundtrack. The same stack drives a motocross rebroadcast-dubbing pipeline: ASR + speaker diarization, staged LLM translation (~99% accurate), and per-commentator TTS voices timing-fit to the original broadcast windows.
Distributed GPU data-curation pipeline
−90% annotation
applied-ML infrastructure · multi-GPU
Orchestrates multimodal models — Qwen-3VL, NVIDIA Cosmos, SAM and SAM Audio, plus VLMs that detect and segment action sequences into ground-truth clip datasets — across multi-GPU systems with chunked, round-robin inference scheduling. Auto-labeling cut manual annotation time 90%+, turning raw broadcast footage into training-ready signals for every model above.