Migrating the AI evals course repo to a Pydantic stack and adding Jev

Wayde Gilliam @waydegilliamOriginally posted 2026.09.22

Open original on X

In the process of migrating the repo I built at Braintrust for @HamelHusain and @sh_reya's AI evals course (https://github.com/braintrustdata/ai-evals-course-2025) to an all-@pydantic stack: PydanticAI + Logfire + pydantic-evals. Been living in these tools for a while now and the progress on observability and evals is impressive. I'll be blogging and posting findings here as I go, including where I think models like @typesafeai's Jev fit into the end-to-end evals pipeline. Stay tuned ...