BAAI/bge-m3 vs Qwen3 Embedding 0.6B

Detailed comparison between BAAI/bge-m3 and Qwen3 Embedding 0.6B. See which embedding best meets your accuracy and performance needs. If you want to compare these models on your data, try Agentset.

Model Comparison

BAAI/bge-m3 takes the lead.

Both BAAI/bge-m3 and Qwen3 Embedding 0.6B are powerful embedding models designed to improve retrieval quality in RAG applications. However, their performance characteristics differ in important ways.

Why BAAI/bge-m3:

  • BAAI/bge-m3 has 60 higher ELO rating
  • BAAI/bge-m3 delivers better accuracy (nDCG@10: 0.674 vs 0.656)
  • BAAI/bge-m3 has a 8.7% higher win rate

Overview

Key metrics

ELO Rating

Overall ranking quality

Model ELO Rating
BAAI/bge-m3 1480
Qwen3 Embedding 0.6B 1420

Win Rate

Head-to-head performance

Model Win Rate
BAAI/bge-m3 44.3%
Qwen3 Embedding 0.6B 35.7%

Accuracy (nDCG@10)

Ranking quality metric

Model nDCG@10
BAAI/bge-m3 0.674
Qwen3 Embedding 0.6B 0.656

Average Latency

Response time

Model Average Latency
BAAI/bge-m3 34ms
Qwen3 Embedding 0.6B 25ms

Visual Performance Analysis

Performance

ELO Rating Comparison

Qwen3 Embedding 0.6B BAAI/bge-m3 4000 8000 12000 15000

Win/Loss/Tie Breakdown

  • BAAI/bge-m3
  • Qwen3 Embedding 0.6B

Accuracy Across Datasets (nDCG@10)

  • BAAI/bge-m3
  • Qwen3 Embedding 0.6B

DBPedia FiQa SciFact MSMARCO ARCD 0.25 0.50 0.75 nDCG@10

Latency Distribution (ms)

  • BAAI/bge-m3
  • Qwen3 Embedding 0.6B

Mean P50 P90 918 2736 Latency (ms)

Breakdown

How the models stack up

Metric BAAI/bge-m3 Qwen3 Embedding 0.6B Description
Overall Performance
ELO Rating 1480 1420 Overall ranking quality based on pairwise comparisons
Win Rate 44.3% 35.7% Percentage of comparisons won against other models
Pricing & Availability
Price per 1M tokens $0.010 $0.010 Cost per million tokens processed
Dimensions 1024 1024 Vector embedding dimensions (lower is more efficient)
Release Date 2024-01-27 2025-06-06 Model release date
Accuracy Metrics
Avg nDCG@10 0.674 0.656 Normalized discounted cumulative gain at position 10
Performance Metrics
Avg Latency 34ms 25ms Average response time across all datasets

Dataset Performance

By field

Comprehensive comparison of accuracy metrics (nDCG, Recall) and latency percentiles for each benchmark dataset.

business reports

Metric BAAI/bge-m3 Qwen3 Embedding 0.6B Description
Accuracy Metrics
nDCG@5 0.000 0.000 Ranking quality at top 5 results
nDCG@10 0.000 0.000 Ranking quality at top 10 results
Recall@5 0.000 0.000 % of relevant docs in top 5
Recall@10 0.000 0.000 % of relevant docs in top 10
Latency Metrics
Mean 27ms 21ms Average response time
P50 27ms 21ms 50th percentile (median)
P90 27ms 21ms 90th percentile

DBPedia

Metric BAAI/bge-m3 Qwen3 Embedding 0.6B Description
Accuracy Metrics
nDCG@5 0.801 0.716 Ranking quality at top 5 results
nDCG@10 0.785 0.730 Ranking quality at top 10 results
Recall@5 0.061 0.053 % of relevant docs in top 5
Recall@10 0.122 0.105 % of relevant docs in top 10
Latency Metrics
Mean 21ms 13ms Average response time
P50 21ms 13ms 50th percentile (median)
P90 21ms 13ms 90th percentile

FiQa

Metric BAAI/bge-m3 Qwen3 Embedding 0.6B Description
Accuracy Metrics
nDCG@5 0.743 0.755 Ranking quality at top 5 results
nDCG@10 0.755 0.755 Ranking quality at top 10 results
Recall@5 0.608 0.591 % of relevant docs in top 5
Recall@10 0.667 0.683 % of relevant docs in top 10
Latency Metrics
Mean 22ms 19ms Average response time
P50 22ms 19ms 50th percentile (median)
P90 22ms 19ms 90th percentile

SciFact

Metric BAAI/bge-m3 Qwen3 Embedding 0.6B Description
Accuracy Metrics
nDCG@5 0.571 0.658 Ranking quality at top 5 results
nDCG@10 0.599 0.666 Ranking quality at top 10 results
Recall@5 0.645 0.718 % of relevant docs in top 5
Recall@10 0.759 0.779 % of relevant docs in top 10
Latency Metrics
Mean 37ms 62ms Average response time
P50 37ms 62ms 50th percentile (median)
P90 37ms 62ms 90th percentile

MSMARCO

Metric BAAI/bge-m3 Qwen3 Embedding 0.6B Description
Accuracy Metrics
nDCG@5 0.956 0.943 Ranking quality at top 5 results
nDCG@10 0.941 0.933 Ranking quality at top 10 results
Recall@5 0.121 0.122 % of relevant docs in top 5
Recall@10 0.219 0.215 % of relevant docs in top 10
Latency Metrics
Mean 51ms 15ms Average response time
P50 51ms 15ms 50th percentile (median)
P90 51ms 15ms 90th percentile

ARCD

Metric BAAI/bge-m3 Qwen3 Embedding 0.6B Description
Accuracy Metrics
nDCG@5 0.879 0.757 Ranking quality at top 5 results
nDCG@10 0.879 0.763 Ranking quality at top 10 results
Recall@5 0.960 0.880 % of relevant docs in top 5
Recall@10 0.960 0.900 % of relevant docs in top 10
Latency Metrics
Mean 48ms 18ms Average response time
P50 48ms 18ms 50th percentile (median)
P90 48ms 18ms 90th percentile

Code Example

TypeScript

import { Agentset } from "agentset";

const agentset = new Agentset();
const ns = agentset.namespace("ns_1234");

const results = await ns.search(
  "What is multi-head attention?"
);

for (const result of results) {
  console.log(result.text);
}

Python

# Python example to query the models
# Add your implementation here