Submitted by OKG Research

作宇|Hedy Bi

The Hong Kong Web3 Carnival has come to an end, but the pulse of Web3 freedom is still beating and constantly penetrating into other industries. Compared with the previous cycle, the logic of this round of bull market has changed from "native innovation narrative" to "mainstream recognition, capital-driven" mode. The Web3 development stage observed by the author has also evolved from a "closed and niche absolute freedom" to a "relative freedom under true tolerance" stage.

Under this logic, if we don’t jump out of the box to analyze, the narrative of waiting for native innovation can no longer adapt to the current development of Web3. Since the entire Web3 embraced compliance, Web3 has refocused on the financial field under the continuous promotion of the Hong Kong government. Mainstream financial institutions have also accelerated their participation in Web3 through RWA and spot ETFs.

In addition to mainstream financial institutions entering Web3, we also saw an opportunity to connect Web2 and Web3 at this conference - the DePIN track. In particular, the development of large AI models has made the sub-track of DePIN - the redistribution of computing power - a hot topic again.

Source: OKG Research

Computing power is a bait, but AI large model training is not the best scenario for DePIN

"Blockchain builds trust through technology, and AI is an industry that extremely requires trust." Haseed Qureshi, managing partner of Dragonfly Capital, said at the conference.

DePIN is not a new track, it was proposed several years ago. It is the outbreak of AI big models that has led to a lot of discussions in the industry about computing power and data. It is estimated that the cost of large model computing increases 31 times each year. There is a global shortage of GPUs, and companies like NVIDIA are at the top of the food chain of current market demand and have great pricing power. Monopoly or decentralization, the debate about cost has become the reason why the Web3 DePIN track is hotly discussed again.

Although AI big model training is the cause, Rome was not built in a day, and AI big model training is not the best landing scenario for DePIN at present. The requirements for computing power for AI big model production mainly revolve around two aspects: reasoning and training. In the training phase, a complex neural network model is trained by feeding a large amount of data. In the reasoning phase, the trained model is used to infer various conclusions using a large amount of data.

Source: NVIDIA

The combination of decentralization and computing power, the difficulty coefficient decreases layer by layer from training to fine-tuning training to inference. In DePIN, we can see that more projects in the industry are focused on inference rather than training. The main reason why most companies use NVIDIA GPU clusters for AI training is that they have their own powerful parallel computing capabilities and memory bandwidth. Compared with the inference link, the requirements for parallel computing power and bandwidth are much lower. And large model training pays more attention to stability, because once the training is interrupted, it needs to be retrained. If a decentralized computing power application is built on Ethereum for GPT to use, a single matrix multiplication operation alone will consume up to $10 billion in gas fees and take 1 month.

In addition, the author analyzed the current status of several popular projects at the conference, showing a trend of supply exceeding demand, that is, the supply of computing power distributed around the world exceeds the demand of AI developers for AI model training or reasoning tasks. It is not to say that the demand does not exist. Sam Altman, the founder of OpenAI, proposed to raise 7 trillion US dollars to build an advanced chip factory that is 10 times the size of TSMC and used for chip production and model training. Stanford University research also shows that no matter which language model, when the scale of training parameters exceeds the critical value of that scale, its performance (such as accuracy) will increase dramatically. This is completely opposite to the law of "great effort makes miracles", and it also means that in reality, the idea of ​​decentralized computing power still has many problems to solve.

The "historical origin" of the DePIN track can be traced back to the "sharing economy"

The concept of DePIN itself is not difficult to understand, and can even be traced back to Web2. Looking back at the Internet industry, for at least 15 years, Web2 players have been immersed in aggregating personal tangible assets to create a "sharing economy." If intangible assets (such as idle servers, etc.) are redistributed directly to the demand side in the form of Peer to peer (P2P) or Peer to business (P2B), decentralized technology blockchain can optimize production relations through incentive mechanisms. This is what DePIN is going to do.

Therefore, everyone is very enthusiastic about the supply side of the DePIN track. In fact, Web2 has been preparing for "redistribution" for a long time, but this time, the intermediary is directly removed. There are nearly a thousand DePIN projects, especially the Solana ecosystem. According to Messari statistics, the Solana ecosystem is in a leading position in DePIN infrastructure, which is due to the high infrastructure integration and performance of the Solana public chain. In terms of regional distribution, it is expected that many of the top 10 DePINs will come from Asia from 2024 to 2025.

Source: Messari

Web3 and AI have many intersections. As the universal currency of the future digital world, computing power is the first thing people pay attention to. However, decentralized computing power, the most reasonable landing scenario, is not the easiest to land.

At the intersection of Web3 and AI, in addition to overcoming technical difficulties and continuously breaking through such problems, there are many other branches such as AI agents giving creators ownership and small AI model computing scenarios that are worth exploring and will be more practical. There will always be a balance between the success of business models and technological breakthroughs. DePIN is accelerating this process, and DePIN's "hunting trip" will also be rewarding.