gpt-6VIDEO

Using GPT-6 Astra to log every ingredient on a taco plate

A case study where RF-DETR locates the plate and tracks hand keypoints, sending only frames where a hand moves from the buffet to the plate to Astra, which returns a JSON event log with timestamp, dish, ingredient and confidence.

Erik Kokalj

@erik_kokaljArchived 2026.09.28Originally posted 2026.09.27

Erik Kokalj @erik_kokaljOriginally posted 2026.09.27

Open original on X

GPT-6 Astra for video analytics: logging every ingredient that lands on a taco plate 🌮 - @roboflow RF-DETR finds the plate + tracks hands via keypoints - only frames where a hand moves from buffet to plate get sent to Astra (cost optimization) - Astra returns JSON event logs with timestamp, dish, ingredient, confidence

x.com/erik_kokalj/status/2104225394299703734Archived 2026.09.28 10:03