WMT22: Biomedical Translation Task

This task aims to evaluate systems on the translation of documents from the biomedical domain. The test data will consist of biomedical abstracts and summaries of proposals for animal experiments

Website: https://statmt.org/wmt22/biomedical-translation-task.html

Download test sets Register your team Create submission Competition updates

Leaderboard of WMT22: Biomedical Translation Task

biomedical.wmttest2022.de-en test set (de-en)

# Name BLEU chrF Date
1 Anonymous submission #537 45.6 0.7 July 29, 2022, 2:56 a.m.
2 Anonymous submission #411 45.6 0.7 July 28, 2022, 11:28 a.m.
3 Anonymous submission #481 45.6 0.7 July 28, 2022, 2:33 p.m.
4 Anonymous submission #252 45.4 0.7 July 27, 2022, 11:44 a.m.
5 Anonymous submission #473 44.9 0.7 July 28, 2022, 2:10 p.m.
6 Anonymous submission #139 44.6 0.7 July 26, 2022, 8:36 a.m.
7 Anonymous submission #357 43.5 0.7 July 28, 2022, 8:25 a.m.
8 Anonymous submission #104 42.7 0.7 July 26, 2022, 5:05 a.m.
9 Anonymous submission #200 42.8 0.7 July 26, 2022, 3:35 p.m.
10 Anonymous submission #472 26.0 0.6 July 28, 2022, 2:07 p.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

biomedical.wmttest2022.en-de test set (en-de)

# Name BLEU chrF Date
1 Anonymous submission #360 38.3 0.7 July 28, 2022, 8:28 a.m.
2 Anonymous submission #837 38.7 0.7 July 29, 2022, 2:54 p.m.
3 Anonymous submission #832 38.2 0.6 July 29, 2022, 2:42 p.m.
4 Anonymous submission #395 37.6 0.6 July 28, 2022, 11:02 a.m.
5 Anonymous submission #520 37.5 0.6 July 29, 2022, 1:56 a.m.
6 Anonymous submission #251 37.6 0.6 July 27, 2022, 11:39 a.m.
7 Anonymous submission #480 37.7 0.6 July 28, 2022, 2:29 p.m.
8 Anonymous submission #140 37.4 0.6 July 26, 2022, 8:39 a.m.
9 Anonymous submission #201 35.0 0.6 July 26, 2022, 3:36 p.m.
10 Anonymous submission #115 34.6 0.6 July 26, 2022, 5:49 a.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

biomedical.wmttest2022.en-es test set (en-es)

# Name BLEU chrF Date
1 Anonymous submission #291 52.2 0.7 July 28, 2022, 4:40 a.m.
2 Anonymous submission #283 52.2 0.7 July 28, 2022, 2:42 a.m.
3 Anonymous submission #62 41.2 0.7 July 25, 2022, 3:28 p.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

biomedical.wmttest2022.en-fr test set (en-fr)

# Name BLEU chrF Date
1 Anonymous submission #774 38.8 0.6 July 29, 2022, 12:24 p.m.
2 Anonymous submission #416 38.5 0.6 July 28, 2022, 11:42 a.m.
3 Anonymous submission #645 38.2 0.6 July 29, 2022, 9:49 a.m.
4 Anonymous submission #124 38.2 0.6 July 26, 2022, 7:24 a.m.
5 Anonymous submission #544 38.1 0.6 July 29, 2022, 3:23 a.m.
6 Anonymous submission #569 38.1 0.6 July 29, 2022, 4:14 a.m.
7 Anonymous submission #542 37.9 0.6 July 29, 2022, 3:22 a.m.
8 Anonymous submission #277 37.9 0.6 July 28, 2022, 1:44 a.m.
9 Anonymous submission #579 37.9 0.6 July 29, 2022, 4:37 a.m.
10 Anonymous submission #543 37.0 0.6 July 29, 2022, 3:23 a.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

biomedical.wmttest2022.en-it test set (en-it)

# Name BLEU chrF Date
1 Anonymous submission #304 53.8 0.8 July 28, 2022, 6:42 a.m.
2 Anonymous submission #418 52.2 0.7 July 28, 2022, 11:46 a.m.
3 Anonymous submission #449 29.9 0.6 July 28, 2022, 1:32 p.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

biomedical.wmttest2022.en-pt test set (en-pt)

# Name BLEU chrF Date
1 Anonymous submission #305 52.0 0.7 July 28, 2022, 6:44 a.m.
2 Anonymous submission #421 40.6 0.7 July 28, 2022, 11:49 a.m.
3 Anonymous submission #450 25.4 0.6 July 28, 2022, 1:33 p.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

biomedical.wmttest2022.en-ru test set (en-ru)

# Name BLEU chrF Date
1 Anonymous submission #369 45.8 0.7 July 28, 2022, 8:53 a.m.
2 Anonymous submission #352 45.4 0.7 July 28, 2022, 8:18 a.m.
3 Anonymous submission #663 45.1 0.7 July 29, 2022, 9:57 a.m.
4 Anonymous submission #345 43.3 0.7 July 28, 2022, 7:57 a.m.
5 Anonymous submission #659 43.1 0.7 July 29, 2022, 9:56 a.m.
6 Anonymous submission #113 43.1 0.7 July 26, 2022, 5:46 a.m.
7 Anonymous submission #671 43.3 0.7 July 29, 2022, 10 a.m.
8 Anonymous submission #163 43.3 0.7 July 26, 2022, 11:30 a.m.
9 Anonymous submission #155 42.8 0.7 July 26, 2022, 9:40 a.m.
10 Anonymous submission #198 42.4 0.7 July 26, 2022, 3:32 p.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

biomedical.wmttest2022.en-zh test set (en-zh)

# Name BLEU chrF Date
1 Anonymous submission #846 49.9 0.5 July 30, 2022, 12:44 a.m.
2 Anonymous submission #355 49.3 0.5 July 28, 2022, 8:21 a.m.
3 Anonymous submission #90 48.3 0.4 July 26, 2022, 3:09 a.m.
4 Anonymous submission #249 48.3 0.4 July 27, 2022, 11:31 a.m.
5 Anonymous submission #636 48.2 0.4 July 29, 2022, 9:43 a.m.
6 Anonymous submission #396 48.2 0.4 July 28, 2022, 11:04 a.m.
7 Anonymous submission #722 48.1 0.4 July 29, 2022, 10:57 a.m.
8 Anonymous submission #478 48.0 0.4 July 28, 2022, 2:25 p.m.
9 Anonymous submission #536 47.8 0.4 July 29, 2022, 2:53 a.m.
10 Anonymous submission #93 47.8 0.4 July 26, 2022, 3:29 a.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

biomedical.wmttest2022.es-en test set (es-en)

# Name BLEU chrF Date
1 Anonymous submission #303 59.0 0.8 July 28, 2022, 6:34 a.m.
2 Anonymous submission #174 46.5 0.7 July 26, 2022, 1:34 p.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

biomedical.wmttest2022.fr-en test set (fr-en)

# Name BLEU chrF Date
1 Anonymous submission #732 54.1 0.7 July 29, 2022, 11:13 a.m.
2 Anonymous submission #306 46.5 0.7 July 28, 2022, 6:46 a.m.
3 Anonymous submission #750 48.6 0.7 July 29, 2022, 11:54 a.m.
4 Anonymous submission #580 46.5 0.7 July 29, 2022, 4:38 a.m.
5 Anonymous submission #422 48.4 0.7 July 28, 2022, 11:53 a.m.
6 Anonymous submission #565 48.0 0.7 July 29, 2022, 4:11 a.m.
7 Anonymous submission #125 47.7 0.7 July 26, 2022, 7:25 a.m.
8 Anonymous submission #567 47.4 0.7 July 29, 2022, 4:12 a.m.
9 Anonymous submission #646 47.8 0.7 July 29, 2022, 9:50 a.m.
10 Anonymous submission #317 47.0 0.7 July 28, 2022, 7:15 a.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

biomedical.wmttest2022.it-en test set (it-en)

# Name BLEU chrF Date
1 Anonymous submission #307 51.4 0.7 July 28, 2022, 6:48 a.m.
2 Anonymous submission #423 47.7 0.7 July 28, 2022, 11:56 a.m.
3 Anonymous submission #452 27.3 0.6 July 28, 2022, 1:35 p.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

biomedical.wmttest2022.pt-en test set (pt-en)

# Name BLEU chrF Date
1 Anonymous submission #308 54.4 0.8 July 28, 2022, 6:50 a.m.
2 Anonymous submission #425 53.1 0.8 July 28, 2022, 11:59 a.m.
3 Anonymous submission #453 25.4 0.6 July 28, 2022, 1:36 p.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

biomedical.wmttest2022.ru-en test set (ru-en)

# Name BLEU chrF Date
1 Anonymous submission #371 52.8 0.7 July 28, 2022, 8:57 a.m.
2 Anonymous submission #353 52.8 0.7 July 28, 2022, 8:20 a.m.
3 Anonymous submission #601 50.3 0.7 July 29, 2022, 5:49 a.m.
4 Anonymous submission #597 50.3 0.7 July 29, 2022, 5:27 a.m.
5 Anonymous submission #596 49.4 0.7 July 29, 2022, 5:26 a.m.
6 Anonymous submission #600 50.0 0.7 July 29, 2022, 5:40 a.m.
7 Anonymous submission #156 49.6 0.7 July 26, 2022, 9:42 a.m.
8 Anonymous submission #145 49.8 0.7 July 26, 2022, 8:46 a.m.
9 Anonymous submission #346 49.1 0.7 July 28, 2022, 7:58 a.m.
10 Anonymous submission #105 43.3 0.7 July 26, 2022, 5:06 a.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

biomedical.wmttest2022.zh-en test set (zh-en)

# Name BLEU chrF Date
1 Anonymous submission #825 46.5 0.7 July 29, 2022, 2:26 p.m.
2 Anonymous submission #724 42.3 0.7 July 29, 2022, 10:57 a.m.
3 Anonymous submission #781 42.7 0.7 July 29, 2022, 12:36 p.m.
4 Anonymous submission #17 42.4 0.7 July 25, 2022, 2:10 a.m.
5 Anonymous submission #638 42.9 0.7 July 29, 2022, 9:44 a.m.
6 Anonymous submission #523 42.5 0.7 July 29, 2022, 2:05 a.m.
7 Anonymous submission #95 42.5 0.7 July 26, 2022, 3:31 a.m.
8 Anonymous submission #397 43.0 0.7 July 28, 2022, 11:05 a.m.
9 Anonymous submission #21 43.1 0.7 July 25, 2022, 7:16 a.m.
10 Anonymous submission #250 42.5 0.7 July 27, 2022, 11:33 a.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.