Zen Garden: Opus 5.5 builds a real-time 3D garden entirely in code
A thread on building the Zen Garden app with Opus 5.5, where moss, rocks, water and blossoms are computed per frame by Metal shaders, plus life-size birds with their own calls.
A thread on how Zen Garden came to be. Built completely with Opus 5.5. 25 billion tokens later 🧵 It all started about 2 weeks ago when @Nalden shared @gwern's essay on samon, the patterns raked into the sand of zen gardens. I got hooked right away with the story behind it. Being a Codex stan, I wanted to try out Opus 5.5 see what all the buzz was about, so I gave it a simple prompt to get a quick vibe check to see if we should pursue it further to turn this into our next app. In mere minutes I had a working prototype. It was fine. It was very flat. Nothing special. Then something happened that I hadn't felt in almost four years of building apps with AI. I simply asked Claude to make the scenery more realistic. It started working for a while, then it came back and my jaw dropped. Given how good these models are now at using Blender, I sorta expected it to create 3D models. Instead it told me: "There are no images, textures or 3D models anywhere in this. Every pixel is calculated from scratch by maths, every frame." Moss, rocks, water, cherry blossoms. All of it just straight up code. Metal shaders. I would not have even considered that as an option. Which became the pattern of my experience building Zen Garden with Opus 5.5. Taking the unexpected harder route to get to a better result. No shortcuts. So when @michelelings suggested "would be cool if a bird came flying into the garden." Opus came back with the birds that actually visit Japanese gardens, life-size, each with its own call sounds. It calculated where it could land, its motions. It opened a garden on my screen and a kingfisher landed on the bridge, watched the koi, and dove in the pond to catch a little fish. I f***ing lost it. I didn't ask for that. I just asked to 'add a bird'. Every time I did ask for something, it did it in a way I simply didn't consider it would be able to do at the level and in the way it did. Better than what I had in mind. It changed how I now build. Giving me a different perspective of what an app should feel like when made by people who care about every detail. Just asking it to do more, go even harder on the tiniest details. Just because you can. For the love of the game. In June, after we won the Apple Design Award with grug, I wrote that AI can't care, and that you have to bring the taste. I still believe that, mostly. But this was the first time the model actually kept pushing me to be more creative, in a different way than before, challenging me to think much bigger. Crazy how much can change in a just few months. This new way of building gives me so much energy all over again to build more and more. The new outcomes that are now possible. Bigger. Bolder. More creative. For designers like me, Opus 5.5 is the best model out there by a long stretch. And here is the crazy part. With how fast AI is progressing, it will be the worst model in a year. Think about that. But more importantly: plan ahead for that to become reality. Our process to build our apps keeps changing every day, learning new things. Redefining what a "designer" is day to day. And with the latest models it really allows us to be even more creative, more ambitious. "Shoot for the moon. Even if you miss, you'll land among the stars." Two weeks. Twenty-five billion tokens. Zen Garden started as a quick burst of inspiration, but shipped as a piece of art. Thanks to Claude. Receipts below 🧾