Qwen
Qwen
Main page
2372436

Qwen

logo
Community Hub0 subscribers
What are your thoughts?
Be the first to start a discussion here.
Be the first to start a discussion here.
Qwen

Qwen (also known as Tongyi Qianwen, Chinese: 通义千问; pinyin: Tōngyì Qiānwèn) is a family of large language models developed by Alibaba Cloud. Many Qwen variants are distributed as open‑weight models under the Apache‑2.0 license, while others are served through Alibaba Cloud.

In July 2024, South China Morning Post reported that benchmarking platform SuperCLUE ranked Qwen2‑72B‑Instruct behind OpenAI's GPT‑4o and Anthropic’s Claude 3.5 Sonnet and ahead of other Chinese models.

Alibaba launched a beta of Qwen in April 2023 under the name Tongyi Qianwen, then opened it for public use in September 2023 after regulatory clearance.

The model's architecture was based on the Llama architecture developed by Meta AI. In December 2023, it released its 72B and 1.8B models for download, while Qwen 7B weights were released in August. Their models are sometimes described as open source, but the training code has not been released nor has the training data been documented, and they do not meet the terms of either the Open Source AI Definition or the Model Openness Framework from the Linux Foundation.

In June 2024 Alibaba launched Qwen2 and in September it released some of its models with open weights, while keeping its most advanced models proprietary. Qwen2 contains both dense and sparse models.

In November 2024, QwQ-32B-Preview, a model focusing on reasoning similar to OpenAI's o1, was released under the Apache 2.0 License, although only the weights were released, not the dataset or training method. QwQ has a 32K token context length and performs better than o1 on some benchmarks.

The Qwen-VL series is a line of visual language models that combines a vision transformer with a LLM. Alibaba released Qwen2-VL with variants of 2 billion and 7 billion parameters.

In January 2025, Qwen2.5-VL was released with variants of 3, 7, 32, and 72 billion parameters. All models except the 72B variant are licensed under the Apache 2.0 license. Qwen-VL-Max is Alibaba's flagship vision model as of 2024, and is sold by Alibaba Cloud at a cost of US$0.41 per million input tokens.

See all
User Avatar
No comments yet.