Bloomberg: Google employees question Gemini 4's real-world coding performance
Bloomberg reports that some Google employees with access to Gemini 4 say its strong benchmarks don't fully carry over to real coding and front-end design, and that the model is very large and costly to run; Google denies it is behind.
$GOOGL EMPLOYEES RAISE CONCERNS OVER GEMINI 4 CODING PERFORMANCE Google is preparing to launch Gemini 4, but some employees with access to the model say its strong benchmark results aren’t fully translating into real-world performance, according to Bloomberg. The main concerns are around coding. Some internal testers say Gemini 4 struggles with certain coding tasks and front-end design, while the model is also said to be very large, potentially making it more expensive to run. Google disputes that Gemini 4 is underperforming and says there is broad internal consensus that the model is at the frontier. Bloomberg also reports Google abandoned Gemini 3.5 Pro after previously planning to release it in June. Internally, views appear mixed: some employees believe Gemini 4 still trails the latest models from OpenAI and Anthropic in certain areas, while others believe it has caught up. Gemini 4 is said to perform particularly well on multimodal tasks, including understanding video, along with safety, cybersecurity and natural communication. Source: Bloomberg