Mysten Labs has taken a significant step forward in the world of blockchain technology by open-sourcing Narwhal & Tusk, their high-throughput mempool and consensus engine. Narwhal & Tusk is a critical component of Mysten Labs' smart contract platform, Sui, and is responsible for a range of functions, including ordering transactions, composing protocols, and sequencing transactions to guarantee the security of Sui.

The naming of Narwhal & Tusk reflects the system's split responsibilities, with Narwhal ensuring the availability of data submitted to consensus and Tusk agreeing on the specific ordering of this data. The system is the result of decades of work on multi-proposer, high-throughput consensus algorithms, and has achieved impressive throughputs of more than 130,000 transactions per second on a WAN network.

One of the primary motivations behind open-sourcing Narwhal & Tusk was to share Mysten Labs' learnings with the wider blockchain community and to help accelerate the development of other scalability solutions. The team at Mysten Labs believe that open-sourcing their code will lead to active engagement across teams working on similar engineering challenges and help to advance the overall state of web3 technology.

The codebase for Narwhal & Tusk has been designed to be small, efficient, and easy to modify, with a focus on real cryptography, networking, and storage. The core protocols are written in Rust, while benchmarking scripts are written in Python and run using Fabric. To run a local benchmark, users need to clone the repository, install Python dependencies, and run the "fab local" command.

Mysten Labs has also made extensive resources available for those interested in understanding and using Narwhal & Tusk. This includes a range of README files, as well as several academic papers that provide in-depth explanations of the underlying technologies and algorithms.