Nine archival research tests give Gemini 4 Argon a 4/10, user says
A user ran nine historical and archival research tasks with Gemini 4 Argon and Spark and reports fabricated findings, nonexistent source links, contradictory reports, unreliable self-audits and ignored custom instructions.
Hi Philipp, I’ve now run 9 tests with Gemini 4 Argon + Spark (8 serious historical/archival research missions + one more today). Initial rating: 4/10. Main issues: fabricated discoveries, nonexistent source links, contradictory reports, and unreliable self-audits. Today’s test was especially frustrating — I asked a simple question about yesterday’s conversations. Argon jumped back to September, mixed up dates, and kept inventing explanations instead of saying “I don’t know / I don’t have access to that.” My custom 10-point instructions based on Heuer’s analysis methodology are also not being followed. I want Gemini to succeed, but following instructions, verifying evidence, and knowing when to say “I don’t know” should be basic. Happy to share the full findings with your team.