Anthropic open-sources inference optimization code for 30+ biology models
Anthropic used Claude to optimize inference for more than 30 open-source biology models, making them about 4x faster on average, and is open-sourcing all the optimization code.
Biologists use specialized open-source models for tasks like modeling the structure of molecular systems, designing drug-like molecules, and predicting the effects of genetic mutations. But these models are often expensive to run, potentially limiting their impact. In our latest Science Blog, we share how Claude was able to optimize inference for more than 30 open-source models, making them 4x faster on average, partly by writing custom software for GPUs. We’re open sourcing all of the optimization code. Read more: https://t.co/qiuN1jpgpA