Gemini 4 Pro / Flash: benchmarks, hands-on tests and leaks

A Chinese post says Gemini 4 Pro generated a three.js mechanical butterfly in ten minutes while Fable 5.1 took about half an hour, and claims Google used recursive self-improvement in training.

A single prompt produced a fully procedural, disassemblable two-spool turbofan demo with FADEC and N1/N2/EGT gauges, leading the author to suspect the model is actually the unreleased Gemini 4 Pro.

The poster compares GPT-6 Astra with Gemini 4 Pro and says Astra delivered better results right from the start, without giving specific tests.

LuminaBench says that in Arena comparisons, Gemini 4 Pro outperforms GPT-6 Astra on some specific SVG generation requests and vice versa, and that it is not identical to muse spark 1.3.

The author argues Google doesn't need an Astra-level model to recover: Gemini 4 Pro only needs to match Opus 5 and GPT-5.6 Sol while being cheaper, faster, and offering higher limits to win back market share.

With Opus 5 running at Max effort on the same prompt, Gemini 4 Pro still kept up, which the author sees as a sign it is now competitive for complex visual coding.

A butterfly video generated with Gemini 4 Pro, shown as a demonstration of its video generation output.

Based on the outputs seen so far, the poster says Gemini 4 Pro already matches GPT-6 Astra, and if true, upcoming GPT-6 family models are in trouble.

A tester says Gemini 4 Pro and GPT-6 Astra Pro are basically tied on SVG generation, calling the results the best seen from any model so far, without giving specific examples.

The poster notes that GPT-6 Pro was evaluated in the ChatGPT harness and Gemini 4 Pro in the arena.ai harness, yet the two different models produced basically identical results, and questions the evaluation method.

The poster says Gemini 4 Pro's SVG output beats GPT-6 Astra and Claude Fable, while citing a LuminaBench post that the model's release has been delayed.

In an interview, Google DeepMind's Koray Kavukcuoglu says being at the frontier is the team's only goal and that he is 100% certain it will get there, with a link to a roundup of Gemini 4 progress.