kwindla 谈 evals 为何成为 LLM 工程核心，并提到 Jev
作者认为 evals 是当下 LLM 系统规模化的关键能力，并分享 Typesafe/Jev 如何嵌入现有工具链与 eval 流程的笔记。
Almost everyone I know is spending more time thinking about evals, these days, than we did a year ago. For the past two years, we've been speed-running computer science/software engineering history, trying to figure out how to build useful, robust, real-world systems that leverage LLMs. (Re-inventing lots of wheels, as always happens during a big computing transition.) Last year at this time, it seemed like the big, general questions we were asking mostly revolved around how to think about the loops, tool calls, and context management triad of problems. Now, a lot of my conversations are about evals. Evals unlock scaling, maintainability, modularity, cost management, legal/compliance, and research into new architecture directions. Probably a bunch of other stuff, too. But building good evals is not a competence that most software engineers have (yet). Some really helpful notes on how Typesafe/Jev might fit into our toolkits, below, including some thoughts on evals ...
这条是引用着另一条写的：x.com/fleetingbits/status/2100292587621863590