9 轮档案研究实测给 Gemini 4 Argon 打 4/10
用户用 Gemini 4 Argon + Spark 跑了 9 次历史档案研究任务,抱怨编造发现、假来源链接、报告自相矛盾且不遵守自定义指令。
Hi Philipp, I’ve now run 9 tests with Gemini 4 Argon + Spark (8 serious historical/archival research missions + one more today). Initial rating: 4/10. Main issues: fabricated discoveries, nonexistent source links, contradictory reports, and unreliable self-audits. Today’s test was especially frustrating — I asked a simple question about yesterday’s conversations. Argon jumped back to September, mixed up dates, and kept inventing explanations instead of saying “I don’t know / I don’t have access to that.” My custom 10-point instructions based on Heuer’s analysis methodology are also not being followed. I want Gemini to succeed, but following instructions, verifying evidence, and knowing when to say “I don’t know” should be basic. Happy to share the full findings with your team.