In its March 12, 2024 launch post for Devin, marketed as “the first AI software engineer,” Cognition stated that on the SWE-bench coding benchmark “Devin correctly resolves 13.86% of the issues end-to-end, far exceeding the previous state-of-the-art of 1.96%.”