WMT22: Unsup and Very Low Res Task

There is no machine translation available for most of the ~7000 languages spoken on the planet Earth. This is because very limited or no parallel corpora are available. Research on unsupervised and very low resource machine translation is important for alleviating this problem. Unsupervised machine translation requires only monolingual data, while very low resource supervised machine translation uses very limited parallel data.

Like last year, the task includes building supervised and unsupervised translation systems of Upper and Lower Sorbian.

Website: https://statmt.org/wmt22/unsup_and_very_low_res.html

Download test sets Register your team Create submission Competition updates

Leaderboard of WMT22: Unsup and Very Low Res Task

lowres22.de-dsb test set (de-dsb)

# Name BLEU chrF Date
1 Anonymous submission #1054 73.9 87.1 Aug. 29, 2022, 1:32 p.m.
2 Anonymous submission #1017 73.9 86.9 Aug. 29, 2022, 8:28 a.m.
3 Anonymous submission #1050 73.5 86.9 Aug. 29, 2022, 1:31 p.m.
4 Anonymous submission #993 58.2 79.5 Aug. 25, 2022, 6:46 a.m.
5 Anonymous submission #997 50.5 74.1 Aug. 26, 2022, 10:17 p.m.
6 Anonymous submission #1058 48.2 73.0 Aug. 29, 2022, 1:49 p.m.
7 Anonymous submission #1042 46.0 71.3 Aug. 29, 2022, 1:13 p.m.
8 Anonymous submission #1035 42.0 68.3 Aug. 29, 2022, 12:44 p.m.
9 Anonymous submission #1001 20.8 44.1 Aug. 29, 2022, 5:49 a.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

lowres22.dsb-de test set (dsb-de)

# Name BLEU chrF Date
1 Anonymous submission #1053 62.5 80.9 Aug. 29, 2022, 1:32 p.m.
2 Anonymous submission #1049 62.4 80.8 Aug. 29, 2022, 1:30 p.m.
3 Anonymous submission #1018 62.4 80.8 Aug. 29, 2022, 8:29 a.m.
4 Anonymous submission #992 61.5 80.4 Aug. 25, 2022, 6:46 a.m.
5 Anonymous submission #996 49.5 73.0 Aug. 26, 2022, 10:16 p.m.
6 Anonymous submission #989 47.4 71.8 Aug. 24, 2022, 9:24 p.m.
7 Anonymous submission #1057 39.4 66.2 Aug. 29, 2022, 1:48 p.m.
8 Anonymous submission #1041 37.3 64.4 Aug. 29, 2022, 1:13 p.m.
9 Anonymous submission #1034 33.1 60.8 Aug. 29, 2022, 12:44 p.m.
10 Anonymous submission #1000 25.4 51.3 Aug. 29, 2022, 5:48 a.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

lowres22.dsb-hsb test set (dsb-hsb)

# Name BLEU chrF Date
1 Anonymous submission #1048 86.8 94.0 Aug. 29, 2022, 1:30 p.m.
2 Anonymous submission #1013 85.6 93.5 Aug. 29, 2022, 8:23 a.m.
3 Anonymous submission #991 72.8 87.7 Aug. 25, 2022, 6:46 a.m.
4 Anonymous submission #1021 72.2 87.5 Aug. 29, 2022, 9:17 a.m.
5 Anonymous submission #1056 65.8 83.9 Aug. 29, 2022, 1:48 p.m.
6 Anonymous submission #1040 65.0 83.3 Aug. 29, 2022, 1:12 p.m.
7 Anonymous submission #1033 63.0 82.4 Aug. 29, 2022, 12:43 p.m.
8 Anonymous submission #999 49.1 65.5 Aug. 29, 2022, 5:47 a.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

lowres22.hsb-dsb test set (hsb-dsb)

# Name BLEU chrF Date
1 Anonymous submission #1012 88.0 94.4 Aug. 29, 2022, 8:22 a.m.
2 Anonymous submission #1047 87.6 94.3 Aug. 29, 2022, 1:29 p.m.
3 Anonymous submission #990 72.2 87.6 Aug. 25, 2022, 6:45 a.m.
4 Anonymous submission #1022 72.3 87.5 Aug. 29, 2022, 9:18 a.m.
5 Anonymous submission #1020 71.5 87.3 Aug. 29, 2022, 8:51 a.m.
6 Anonymous submission #1055 66.6 84.3 Aug. 29, 2022, 1:47 p.m.
7 Anonymous submission #1062 65.6 83.6 Aug. 29, 2022, 1:58 p.m.
8 Anonymous submission #1039 64.6 83.3 Aug. 29, 2022, 1:11 p.m.
9 Anonymous submission #1032 62.2 81.9 Aug. 29, 2022, 12:42 p.m.
10 Anonymous submission #998 50.7 66.9 Aug. 29, 2022, 5:44 a.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

lowres22b.de-hsb test set (de-hsb)

# Name BLEU chrF Date
1 Anonymous submission #1015 70.7 85.5 Aug. 29, 2022, 8:28 a.m.
2 Anonymous submission #1052 70.1 85.2 Aug. 29, 2022, 1:31 p.m.
3 Anonymous submission #995 67.3 83.9 Aug. 25, 2022, 6:47 a.m.
4 Anonymous submission #1060 51.0 73.7 Aug. 29, 2022, 1:50 p.m.
5 Anonymous submission #1044 48.3 72.0 Aug. 29, 2022, 1:15 p.m.
6 Anonymous submission #1037 45.3 69.8 Aug. 29, 2022, 12:45 p.m.
7 Anonymous submission #1019 25.7 49.1 Aug. 29, 2022, 8:40 a.m.
8 Anonymous submission #1009 0.1 12.8 Aug. 29, 2022, 6:05 a.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

lowres22b.hsb-de test set (hsb-de)

# Name BLEU chrF Date
1 Anonymous submission #1051 71.9 85.3 Aug. 29, 2022, 1:31 p.m.
2 Anonymous submission #1016 71.6 85.2 Aug. 29, 2022, 8:28 a.m.
3 Anonymous submission #994 71.2 85.1 Aug. 25, 2022, 6:47 a.m.
4 Anonymous submission #1059 47.5 71.4 Aug. 29, 2022, 1:49 p.m.
5 Anonymous submission #1043 46.6 70.4 Aug. 29, 2022, 1:14 p.m.
6 Anonymous submission #1036 42.5 67.6 Aug. 29, 2022, 12:45 p.m.
7 Anonymous submission #1014 29.7 53.8 Aug. 29, 2022, 8:27 a.m.
8 Anonymous submission #1008 0.1 16.7 Aug. 29, 2022, 6:01 a.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

unsup22.de-dsb test set (de-dsb)

# Name BLEU chrF Date
1 Anonymous submission #1029 9.0 32.6 Aug. 29, 2022, 12:19 p.m.
2 Anonymous submission #1031 1.2 22.1 Aug. 29, 2022, 12:39 p.m.
3 Anonymous submission #1023 1.2 22.1 Aug. 29, 2022, 12:06 p.m.
4 Anonymous submission #1002 0.2 8.1 Aug. 29, 2022, 5:50 a.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

unsup22.dsb-de test set (dsb-de)

# Name BLEU chrF Date
1 Anonymous submission #1045 11.5 33.9 Aug. 29, 2022, 1:24 p.m.
2 Anonymous submission #1024 4.0 26.9 Aug. 29, 2022, 12:07 p.m.
3 Anonymous submission #1003 0.0 5.0 Aug. 29, 2022, 5:52 a.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

unsup22.dsb-hsb test set (dsb-hsb)

# Name BLEU chrF Date
1 Anonymous submission #1025 44.2 72.9 Aug. 29, 2022, 12:08 p.m.
2 Anonymous submission #1004 10.4 48.6 Aug. 29, 2022, 5:53 a.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

unsup22.hsb-dsb test set (hsb-dsb)

# Name BLEU chrF Date
1 Anonymous submission #1026 35.9 67.4 Aug. 29, 2022, 12:09 p.m.
2 Anonymous submission #1005 9.3 44.2 Aug. 29, 2022, 5:55 a.m.
3 Anonymous submission #1061 2.4 16.1 Aug. 29, 2022, 1:53 p.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

unsup22b.de-hsb test set (de-hsb)

# Name BLEU chrF Date
1 Anonymous submission #1028 17.9 48.5 Aug. 29, 2022, 12:10 p.m.
2 Anonymous submission #1038 10.4 33.4 Aug. 29, 2022, 12:54 p.m.
3 Anonymous submission #1011 0.5 14.3 Aug. 29, 2022, 7:18 a.m.
4 Anonymous submission #1030 0.3 13.7 Aug. 29, 2022, 12:20 p.m.
5 Anonymous submission #1007 0.0 10.2 Aug. 29, 2022, 5:59 a.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.

unsup22b.hsb-de test set (hsb-de)

# Name BLEU chrF Date
1 Anonymous submission #1027 18.0 46.9 Aug. 29, 2022, 12:10 p.m.
2 Anonymous submission #1046 13.5 35.8 Aug. 29, 2022, 1:24 p.m.
3 Anonymous submission #1010 0.3 13.6 Aug. 29, 2022, 6:47 a.m.
4 Anonymous submission #1006 0.0 10.0 Aug. 29, 2022, 5:57 a.m.
BLEU and ChrF are sacreBLEU scores. Systems in bold face are your submissions. We only display the top-10 submissions per language pair. Submission validation errors denoted by -1.0 score.

Click on the column header to sort the table. Hold down the Shift key and select a second column to sort by multiple criteria.