用 Astra 从单张图零样本生成可交互仿真环境
作者让 GPT-6 Astra 把一张图片直接变成可交互的物理仿真场景,连液体颜色都对上了,称过去这需要整篇论文。
Seeing a lot of cool applications of GPT 6 Astra so i gave it a go and it kinda blew my mind. There has been a lot of amazing research recently for real2sim. Going from a single image/video to an interactive simulation environment unlocks evaluation and training capabilities easily (SimFoundry from NVIDIA is a great example, I was waiting for months for the code to be released lol). I asked Astra to create an environment from a single image to see how good it would do 0 shot and i am 🤯. It even got the color of the liquid so close (although it couldn’t simulate the reaction). There used to be whole research papers dedicated to getting remotely close to these abilities. Astra can do this 0 shot. Truly crazy times we live in.