According to TechFlow, ZhenFund announced a donation to the open source AI project vLLM. ZhenFund said the donation is intended to promote the popularization of AI technology and benefit more people.
It is reported that vLLM was developed by a three-person team from the University of California, Berkeley. It is the world's most popular open source large model inference acceleration framework, supporting more than 30 latest open source LLMs including Mistral and Llama, and is compatible with multiple hardware architectures. Since its open source release in June last year, vLLM has exceeded 21.8k stars on GitHub.