Meta alum launches AI biology model that simulates 500 million years of evolution

As the world continues to explore the potential of GPT-4o beating Claude 3.5 Sonnet, EvolutionaryScale, an AI research lab founded by former Meta engineers, who ran the company’s now-disbanded protein-folding team, is moving in a completely different domain: making biology programmable.

The task sounds complicated, but the year-old company is already making waves. Today, it announced the launch of ESM3, a natively multimodal and generative language model that can follow prompts and design novel proteins. In tests, the model was able to generate a novel green fluorescent protein (esmGFP), which would have taken hundreds of millions of years to evolve naturally.

“esmGFP…has a sequence that is only 58% similar to the closest known fluorescent protein. From the rate of diversification of GFPs found in nature, we estimate that this generation of a new fluorescent protein is equivalent to simulating over 500 million years of evolution,” the company wrote in a pre-print paper posted on its website on Tuesday.

In addition to the new model, which comes in three sizes, the startup announced it has raised $142 million in a seed round of funding, led by Nat Friedman, Daniel Gross and Lux Capital. AWS and Nvidia’s venture capital arm also participated in the round. The smallest model has also been open-sourced to accelerate research with the new models.

However, building the model is just the start and it remains to be seen how impactful it will be in the real world.

Why EvolutionaryScale is targeting biology with AI

While generative AI models have evolved a lot, especially in understanding and reasoning with human language, many have wondered if we can train these models to decipher the core language of life and then use them to develop novel molecules. The core molecules of life — RNA, proteins and DNA – evolved over the last 3.5 billion years through natural chemical reactions. So, having a way to program biology and design new molecules could pave the way to solve some of the biggest challenges faced by humanity, including climate change, plastic pollution and conditions like cancer.

Multiple organizations, including Google Deepmind and Isomorphic Labs, are already in this space, and the latest one to join the fray is EvolutionaryScale. The company, founded in 2023, developed a few protein language models over the last few months, but its latest offering, ESM3, is the largest of all — and natively multimodal and generative.

Described as a frontier generative model for biology, ESM3 was trained with 1 trillion teraflops of computing power on 2.78 billion natural proteins sampled from various organisms and biomes and 771 billion unique tokens. It can jointly reason across three fundamental biological properties of proteins: sequence, structure and function. These three data modalities are represented as tracks of discrete tokens at the input and output of ESM3. As a result, the user can present the model with a combination of partial inputs across the tracks, and the model will provide output predictions for all the tracks, generating novel proteins.

“ESM3’s multimodal reasoning power enables scientists to generate new proteins with an unprecedented degree of control. For example, the model can be prompted to combine structure, sequence and function to propose a potential scaffold for the active site of PETase, an enzyme that degrades polyethylene terephthalate (PET), a target of interest to protein engineers for breaking down plastic waste,” the company explained.