The ICP Cyclotron Milestone: On-Chain Facial Recognition AI Interface

July 24, 2024

The ICP Cyclotron Milestone: On-Chain Facial Recognition AI Interface

The updated roadmap for ICP was recently released and one of its key focus was the Cyclotron milestone. It is exciting to announce that the Internet Computer Protocol (ICP) recently achieved this significant milestone known as Cyclotron. This development represents a substantial leap towards enabling sophisticated AI applications directly on the blockchain. The successful completion of the Cyclotron milestone, approved in Proposal 13094, underscores ICP’s commitment to revolutionising the integration of AI and blockchain.

Here’s a Facial Recognition Demo by Dominic Williams

The Cyclotron Milestone

The Cyclotron milestone is a big step towards running powerful AI directly on the blockchain. It increases the processing power of the network by ten times, allowing complex AI tasks like facial recognition and image classification to happen on-chain for the first time. This paves the way for even more advanced AI on the blockchain, where models with millions of parameters can be trained and run entirely within the network. In simpler terms, Cyclotron makes the blockchain powerful enough to handle complex AI tasks, opening doors for exciting future applications.

The Cyclotron milestone hinges on optimizing ICP's virtual machine (VM) – the software that executes smart contract code. Unlike traditional blockchain VMs, ICP's WebAssembly virtual machine VM is specifically designed for near-native performance and crucially, supports floating-point arithmetic, essential for AI tasks.

To unlock this power, the engineers implemented several key optimizations. They ensured reliable calculations by making floating-point operations deterministic, guaranteeing consistent results across different computers. They also unlocked the parallel processing power of modern CPUs by enabling SIMD (Single instruction, multiple data) instructions within Wasm, allowing smart contracts to perform multiple calculations simultaneously. Finally, they further optimized AI computations by adding SIMD support to popular AI libraries, benefiting not just ICP but the broader developer community.

The results are impressive. Basic AI calculations run significantly faster, and real-world tasks like image classification see substantial improvements. For example, the number of instructions needed for image classification tasks dropped by over 85%. Facial detection and recognition also saw dramatic speed boosts, with the latter becoming feasible to run directly on the mainnet.

These advancements demonstrate ICP's newfound ability to handle complex AI applications on-chain, opening doors for exciting future collaborations between AI and blockchain technologies.


Implications for Developers and Users

The Cyclotron milestone is a game-changer for developers and users considering a transition to ICP. It offers a robust platform for deploying AI applications that require substantial computational power. The ability to run AI inference on-chain ensures greater security, transparency, and trust, addressing critical issues associated with off-chain AI computations.

Moreover, the open-source nature of the smart contracts used in these benchmarks allows developers to replicate and verify the results, fostering a collaborative and innovative environment. The significant performance gains achieved through Cyclotron make ICP an attractive option for projects aiming to leverage AI capabilities within a blockchain framework.


Looking Ahead: The Gyrotron Milestone

The next milestone on ICP’s roadmap, Gyrotron, aims to scale beyond the limitations of CPU performance by enabling smart contracts to perform compute- and memory-intensive operations on specialized hardware like GPUs. This advancement will further enhance the ability to run large AI models fully on-chain, solving AI’s trust problem and opening new avenues for innovation.

Conclusion

The Cyclotron milestone showcases a vital moment in the integration of AI and blockchain, positioning ICP at the forefront of this integration technology and also creating a space for developers who want to transition their projects to ICP. The Internet Computer Protocol provides a compelling platform for developers and users looking to harness the power of AI within a secure, decentralised framework by simply boosting computational power and optimizing AI workloads. The journey towards on-chain AI computation is just beginning, and with milestones like Gyrotron on the horizon, the future looks promising for ICP and its community.