Bloomberg: Google staff doubt Gemini 4's coding ability despite strong benchmarks
Bloomberg reports that Gemini 4 scores well on industry benchmarks but employees with direct access say it struggles with certain coding tasks, fueling internal skepticism ahead of launch.
HOLY CRAP. Bloomberg has the goods on Gemini 4! "it does less well when employees actually put it to work .. The model struggles to handle certain coding tasks" Bloomberg: "As Alphabet Inc.’s Google prepares for the coming launch of Gemini 4, it’s grappling with internal skepticism over how well the flagship artificial intelligence model performs in key areas, such as coding. While Gemini 4 has performed well on benchmarks the industry uses to gauge model efficacy, it does less well when employees actually put it to work, according to people with direct access to the effort. The model struggles to handle certain coding tasks, said the people, who requested anonymity to discuss an internal matter."
This post quotes another post: x.com/firstadopter/status/2105389006678577395