Alibaba’s AI model outperforms Chinese rivals, ranks just behind OpenAI, Anthropic

Alibaba’s Qwen2-72B-Instruct ranked behind only GPT-4o and Claude 3.5 Sonnet – both closed-source – based on metrics such as coding and text comprehension

Reading Time:2 minutes

The most advanced version of Alibaba’s Qwen family of open-source models is ranked third globally in a new benchmark test, behind only the latest models from OpenAI and Anthropic. Photo: Shutterstock

Published: 8:00pm, 11 Jul 2024

Alibaba Group Holding has emerged as a front runner among Chinese artificial intelligence (AI) developers, with one of its Qwen models outperforming those from domestic rivals to rank third globally behind only OpenAI and Anthropic.

Qwen2-72B-Instruct – the most advanced version of the Hangzhou-based e-commerce giant’s Qwen family of large language models (LLMs), the open source version of Tongyi Qianwen – came in just behind OpenAI’s GPT-4o and Anthropic’s Claude 3.5 Sonnet in a ranking from SuperClue, a benchmarking platform that evaluates models based on metrics such as calculations, logic reasoning, coding, and text comprehension, among others.

Five Chinese models – from Alibaba, start-up Deepseek, Hong Kong-listed SenseTime, smartphone vendor Oppo, and a collaborative effort between Tsinghua University and start-up Zhipu AI – outperformed GPT-4 Turbo, one of the best models from Microsoft-backed OpenAI, according to SuperClue.

The gap between Chinese and US AI models appears to be narrowing, according to SuperClue, which said China made significant progress in advancing domestic LLMs in the first half of the year.

The ranking comes just a couple of weeks after the same model topped a ranking of open-source models from the machine-learning developer platform Hugging Face, with three Qwen models making the top 10.

Hugging Face co-founder and CEO Clement Delangue commended the progress made by Chinese AI firms in a post on X. “Qwen 72B is the king and Chinese open models are dominating overall,” he wrote.