01AgentFold turns protein-model development into a closed-loop agent search
Evidence class: reported fact plus editorial synthesis
Source tier: Tier A primary manuscript indexed by arXiv; fresh preprint
Affected topics: AI for science; agent planning and cognitive architectures; reliability and evaluation
What changed. AgentFold coordinates agents that propose, implement, debug, evaluate, and analyze executable modifications to ESMFold. The authors report exploring roughly 80 variants with about 5,000 GPU-hours and 170 million LLM tokens. Under matched compute, the best discovered variant improved lDDT by 7.5 percent over independent Codex proposals and outperformed random search.
Why it matters. The system tests whether agents can search a real research codebase, retain failed and successful interventions, and allocate compute toward promising branches. Its most useful contribution may be the experimental record: early, soft, learnable priors and gated refinement were more stable than direct geometric perturbations and feedback.
Bottleneck and caveat. This is one codebase and one scientific domain. The comparison is against independent proposals and random search, not an expert protein-modeling team. The compute budget is substantial, and neither the search process nor the reported gains has independent replication.
Historical grounding. AgentFold extends automated scientific discovery from Meta-DENDRAL and BACON, blackboard systems, program search, evolutionary computation, and Monte Carlo tree search. Its modern lineage includes AlphaFold and tool-using scientific agents. See AI for Science (opens in a new tab) and Agent Planning & Cognitive Architectures (opens in a new tab).
Reproduce, test, and falsify. Re-run the public workflow with fixed seeds, equal compute, and blinded expert proposals. Report the full distribution rather than only the best variant, ablate the memory of failed interventions, and test a second research codebase. The broad claim would weaken if gains vanish against expert-guided search or fail to transfer beyond ESMFold.
Teams to monitor: AgentFold authors, Isomorphic Labs, Google DeepMind, Arc Institute, FutureHouse, AI2, and scientific-agent groups.
Direct source: AgentFold arXiv record (opens in a new tab).
Reproduce Tutorial: AgentFold closed-loop searchReproduction level: mechanism demo, with an optional paper-artifact smoke test.
