Bruin 上线 inference assets,可在数据管道里逐行调用 Jev 分类
Bruin 把模型推理做成管道一等公民:指向一张 Snowflake 表、给每列写提示词,就能用 Claude、GPT 或 Jev 逐行生成新列,自动处理批处理与缓存。
Launching inference assets in @getbruin. 🚀 There are a lot of cases where you have some data that lives inside Snowflake, and you want to enrich it using language models. This might be a call to a Haiku model to check if a ticket needs attention, or @typesafeai's Jev to categorize the issue. Good luck if you want to do this inside your data pipeline. You will either have to run your dbt pipelines first and then do the enhancement, essentially splitting your pipelines and dependencies, or have to build a brand new Airflow pipeline. I think that's stupid. We are making inference a first-class primitive inside Bruin pipelines today. They allow bringing language models into your data pipelines. You can run models on every row in any table and produce additional tables with new columns. You can use Claude, GPT, Jev, or any other model on the planet. Point your inference asset to a table, give the prompts for each column to be generated, and watch Bruin fill out all the columns you have as efficiently as possible. It takes care of compatibility across providers, preserving caches, and batching requests where possible. This is all open-source and available today. You can point your agent to our docs and tell it to build a quick inference pipeline over your Snowflake/Databricks/BigQuery tables. Super excited to launch this, and I'd love to hear what you all think!