China’s leading search engine Baidu announced that its ChatGPT-style service outperformed OpenAI’s chatbot on several measures. The company said its latest Ernie AI model, Ernie 3.5, had exceeded ChatGPT (GPT-3.5) in comprehensive ability scores and outperformed GPT-4 in Chinese language tests.

One test used to evaluate Ernie 3.5 was based on standard exams for college admission or professional certification, such as law. In the test released by Microsoft, Ernie 3.5 outperformed ChatGPT and GPT-4 in Chinese, but lagged behind GPT-4 in English while still ahead of ChatGPT.

Another test was in Chinese and consisted of more than 13,000 multiple-choice questions from over 50 different domains. Ernie 3.5 scored higher than ChatGPT and GPT-4 in this test.

A third test, developed by US universities, included questions from various fields, such as science and humanities. Ernie 3.5 scored lower than both ChatGPT and GPT-4 in this test.

In a statement, Haifeng Wang (CTO of Baidu) said:

“Just three months after the beta release of Ernie Bot, Baidu’s large language model (LLM) built on Ernie 3.0, Ernie 3.5 has achieved broad enhancements in efficacy, functionality, and performance. These improvements are evident in creative writing, Q&A, reasoning, and code generation, as well as in training performance and inference performance.”

According to Baidu, its new model has improved training and inference, which enables it to achieve more rapid and cost-effective updates. Baidu also announced that its new model would support external plugins. Plugins are additional applications that allow Baidu’s AI to handle more specialized situations, such as condensing lengthy text and producing more accurate answers.

In March, Baidu became the first major Chinese tech company to introduce an AI product, the Ernie Bot, as a competitor to ChatGPT in AI language models. Other prominent Chinese technology companies, such as Alibaba, Tencent, and SenseTime, have also unveiled their own AI models.

In May, Baidu announced a $145 million VC fund through Baidu Ventures (BV) to support AI-focused startups in China. Baidu Ventures aims to become a leading VC in the AI era and has already invested in over 100 tech companies. In addition, Baidu plans to hold a competition for developers to build applications using its ERNIE language model.

Read more:

  • Best 3 Chinese AI Chatbots in 2023: Ernie Bot, Tongyi Qianwen, HunyuanAide

  • ChatGPT Defeats the Chinese Chatbot Ernie in All AI Benchmarks

  • Secoo Group to Combine OpenAI’s GPT-4 and Baidu’s ERNIE Bot Technologies to Boost Luxury Retail Platform

  • GPT-4-Based ChatGPT Outperforms GPT-3 by a Factor of 57

The post Can Baidu’s AI Chatbot Ernie Outperform OpenAI’s ChatGPT? appeared first on Metaverse Post.