Skip to content
anthropic.com·

🔒AI Proves Security Properties for 123 Open-Source Libraries

AI is now finding bugs in assembly code at scale

TL;DR

AI can now produce formal proofs at scale, proving security properties in assembly code for 123 open-source libraries. This marks a significant step in making formal verification more accessible and practical for developers.

AI is now capable of proving security properties in assembly code for 123 open-source libraries, marking the first large-scale effort to use AI for formal verification. This development is crucial for developers who are concerned about the security and reliability of their code. Claude, an LLM, has successfully verified security properties in RISC-V assembly, proving that certain programs will exit normally without triggering memory-safety errors or failing assertions for every input less than 64 MB. This breakthrough reduces the risk of bugs being exploited by AI, making software more secure and reliable. Developers can now explore formal verification with LLMs, which can handle millions of lines of code, making the process far more accessible and efficient.

AI Proves Security Properties for 123 Open-Source Libraries — anthropic.com

Key Points

1

Claude proved security properties for 123 open-source libraries, marking the first large-scale AI effort in formal verification.

2

Claude verified security properties in RISC-V assembly, ensuring programs exit normally without memory-safety errors or failing assertions.

3

Claude's proofs cover every input less than 64 MB and every modeled Linux OS response and memory layout, enhancing security.

4

LLMs can handle millions of lines of code, making formal verification more accessible and efficient for developers.

5

OSS-Fuzz contains thousands of developer-authored entry points that look for broken code properties by crashing, now made superfluous by AI proofs.

Why It Matters

If you're working on security-critical applications or open-source projects, Claude's ability to prove security properties in assembly code is a game-changer. For example, the Linux kernel had over 1,000 vulnerabilities disclosed, and now AI can verify these properties at scale. This reduces the risk of bugs being exploited and makes software more secure and reliable. Developers can now explore formal verification with LLMs, which can handle millions of lines of code, making the process far more accessible and efficient.

AILLMsecurityformal-verificationassembly-code

Comments

Subscribe to join the conversation...

Be the first to comment

Enjoyed this article?

Get it daily. 7am. Free. Reads in 5 minutes.

Join 3,569 builders reading daily.

Also get