WMT22: Unsup and Very Low Res Task
There is no machine translation available for most of the ~7000 languages spoken on the planet Earth. This is because very limited or no parallel corpora are available. Research on unsupervised and very low resource machine translation is important for alleviating this problem. Unsupervised machine translation requires only monolingual data, while very low resource supervised machine translation uses very limited parallel data.
Like last year, the task includes building supervised and unsupervised translation systems of Upper and Lower Sorbian.
Website: https://statmt.org/wmt22/unsup_and_very_low_res.html
Leaderboard of WMT22: Unsup and Very Low Res Task
lowres22.de-dsb test set (de-dsb)
# | Name | BLEU | chrF | Date |
---|---|---|---|---|
1 | Anonymous submission #1054 | 73.9 | 87.1 | Aug. 29, 2022, 1:32 p.m. |
2 | Anonymous submission #1017 | 73.9 | 86.9 | Aug. 29, 2022, 8:28 a.m. |
3 | Anonymous submission #1050 | 73.5 | 86.9 | Aug. 29, 2022, 1:31 p.m. |
4 | Anonymous submission #993 | 58.2 | 79.5 | Aug. 25, 2022, 6:46 a.m. |
5 | Anonymous submission #997 | 50.5 | 74.1 | Aug. 26, 2022, 10:17 p.m. |
6 | Anonymous submission #1058 | 48.2 | 73.0 | Aug. 29, 2022, 1:49 p.m. |
7 | Anonymous submission #1042 | 46.0 | 71.3 | Aug. 29, 2022, 1:13 p.m. |
8 | Anonymous submission #1035 | 42.0 | 68.3 | Aug. 29, 2022, 12:44 p.m. |
9 | Anonymous submission #1001 | 20.8 | 44.1 | Aug. 29, 2022, 5:49 a.m. |
lowres22.dsb-de test set (dsb-de)
# | Name | BLEU | chrF | Date |
---|---|---|---|---|
1 | Anonymous submission #1053 | 62.5 | 80.9 | Aug. 29, 2022, 1:32 p.m. |
2 | Anonymous submission #1049 | 62.4 | 80.8 | Aug. 29, 2022, 1:30 p.m. |
3 | Anonymous submission #1018 | 62.4 | 80.8 | Aug. 29, 2022, 8:29 a.m. |
4 | Anonymous submission #992 | 61.5 | 80.4 | Aug. 25, 2022, 6:46 a.m. |
5 | Anonymous submission #996 | 49.5 | 73.0 | Aug. 26, 2022, 10:16 p.m. |
6 | Anonymous submission #989 | 47.4 | 71.8 | Aug. 24, 2022, 9:24 p.m. |
7 | Anonymous submission #1057 | 39.4 | 66.2 | Aug. 29, 2022, 1:48 p.m. |
8 | Anonymous submission #1041 | 37.3 | 64.4 | Aug. 29, 2022, 1:13 p.m. |
9 | Anonymous submission #1034 | 33.1 | 60.8 | Aug. 29, 2022, 12:44 p.m. |
10 | Anonymous submission #1000 | 25.4 | 51.3 | Aug. 29, 2022, 5:48 a.m. |
lowres22.dsb-hsb test set (dsb-hsb)
# | Name | BLEU | chrF | Date |
---|---|---|---|---|
1 | Anonymous submission #1048 | 86.8 | 94.0 | Aug. 29, 2022, 1:30 p.m. |
2 | Anonymous submission #1013 | 85.6 | 93.5 | Aug. 29, 2022, 8:23 a.m. |
3 | Anonymous submission #991 | 72.8 | 87.7 | Aug. 25, 2022, 6:46 a.m. |
4 | Anonymous submission #1021 | 72.2 | 87.5 | Aug. 29, 2022, 9:17 a.m. |
5 | Anonymous submission #1056 | 65.8 | 83.9 | Aug. 29, 2022, 1:48 p.m. |
6 | Anonymous submission #1040 | 65.0 | 83.3 | Aug. 29, 2022, 1:12 p.m. |
7 | Anonymous submission #1033 | 63.0 | 82.4 | Aug. 29, 2022, 12:43 p.m. |
8 | Anonymous submission #999 | 49.1 | 65.5 | Aug. 29, 2022, 5:47 a.m. |
lowres22.hsb-dsb test set (hsb-dsb)
# | Name | BLEU | chrF | Date |
---|---|---|---|---|
1 | Anonymous submission #1012 | 88.0 | 94.4 | Aug. 29, 2022, 8:22 a.m. |
2 | Anonymous submission #1047 | 87.6 | 94.3 | Aug. 29, 2022, 1:29 p.m. |
3 | Anonymous submission #990 | 72.2 | 87.6 | Aug. 25, 2022, 6:45 a.m. |
4 | Anonymous submission #1022 | 72.3 | 87.5 | Aug. 29, 2022, 9:18 a.m. |
5 | Anonymous submission #1020 | 71.5 | 87.3 | Aug. 29, 2022, 8:51 a.m. |
6 | Anonymous submission #1055 | 66.6 | 84.3 | Aug. 29, 2022, 1:47 p.m. |
7 | Anonymous submission #1062 | 65.6 | 83.6 | Aug. 29, 2022, 1:58 p.m. |
8 | Anonymous submission #1039 | 64.6 | 83.3 | Aug. 29, 2022, 1:11 p.m. |
9 | Anonymous submission #1032 | 62.2 | 81.9 | Aug. 29, 2022, 12:42 p.m. |
10 | Anonymous submission #998 | 50.7 | 66.9 | Aug. 29, 2022, 5:44 a.m. |
lowres22b.de-hsb test set (de-hsb)
# | Name | BLEU | chrF | Date |
---|---|---|---|---|
1 | Anonymous submission #1015 | 70.7 | 85.5 | Aug. 29, 2022, 8:28 a.m. |
2 | Anonymous submission #1052 | 70.1 | 85.2 | Aug. 29, 2022, 1:31 p.m. |
3 | Anonymous submission #995 | 67.3 | 83.9 | Aug. 25, 2022, 6:47 a.m. |
4 | Anonymous submission #1060 | 51.0 | 73.7 | Aug. 29, 2022, 1:50 p.m. |
5 | Anonymous submission #1044 | 48.3 | 72.0 | Aug. 29, 2022, 1:15 p.m. |
6 | Anonymous submission #1037 | 45.3 | 69.8 | Aug. 29, 2022, 12:45 p.m. |
7 | Anonymous submission #1019 | 25.7 | 49.1 | Aug. 29, 2022, 8:40 a.m. |
8 | Anonymous submission #1009 | 0.1 | 12.8 | Aug. 29, 2022, 6:05 a.m. |
lowres22b.hsb-de test set (hsb-de)
# | Name | BLEU | chrF | Date |
---|---|---|---|---|
1 | Anonymous submission #1051 | 71.9 | 85.3 | Aug. 29, 2022, 1:31 p.m. |
2 | Anonymous submission #1016 | 71.6 | 85.2 | Aug. 29, 2022, 8:28 a.m. |
3 | Anonymous submission #994 | 71.2 | 85.1 | Aug. 25, 2022, 6:47 a.m. |
4 | Anonymous submission #1059 | 47.5 | 71.4 | Aug. 29, 2022, 1:49 p.m. |
5 | Anonymous submission #1043 | 46.6 | 70.4 | Aug. 29, 2022, 1:14 p.m. |
6 | Anonymous submission #1036 | 42.5 | 67.6 | Aug. 29, 2022, 12:45 p.m. |
7 | Anonymous submission #1014 | 29.7 | 53.8 | Aug. 29, 2022, 8:27 a.m. |
8 | Anonymous submission #1008 | 0.1 | 16.7 | Aug. 29, 2022, 6:01 a.m. |
unsup22.de-dsb test set (de-dsb)
# | Name | BLEU | chrF | Date |
---|---|---|---|---|
1 | Anonymous submission #1029 | 9.0 | 32.6 | Aug. 29, 2022, 12:19 p.m. |
2 | Anonymous submission #1031 | 1.2 | 22.1 | Aug. 29, 2022, 12:39 p.m. |
3 | Anonymous submission #1023 | 1.2 | 22.1 | Aug. 29, 2022, 12:06 p.m. |
4 | Anonymous submission #1002 | 0.2 | 8.1 | Aug. 29, 2022, 5:50 a.m. |
unsup22.dsb-de test set (dsb-de)
# | Name | BLEU | chrF | Date |
---|---|---|---|---|
1 | Anonymous submission #1045 | 11.5 | 33.9 | Aug. 29, 2022, 1:24 p.m. |
2 | Anonymous submission #1024 | 4.0 | 26.9 | Aug. 29, 2022, 12:07 p.m. |
3 | Anonymous submission #1003 | 0.0 | 5.0 | Aug. 29, 2022, 5:52 a.m. |
unsup22.dsb-hsb test set (dsb-hsb)
# | Name | BLEU | chrF | Date |
---|---|---|---|---|
1 | Anonymous submission #1025 | 44.2 | 72.9 | Aug. 29, 2022, 12:08 p.m. |
2 | Anonymous submission #1004 | 10.4 | 48.6 | Aug. 29, 2022, 5:53 a.m. |
unsup22.hsb-dsb test set (hsb-dsb)
# | Name | BLEU | chrF | Date |
---|---|---|---|---|
1 | Anonymous submission #1026 | 35.9 | 67.4 | Aug. 29, 2022, 12:09 p.m. |
2 | Anonymous submission #1005 | 9.3 | 44.2 | Aug. 29, 2022, 5:55 a.m. |
3 | Anonymous submission #1061 | 2.4 | 16.1 | Aug. 29, 2022, 1:53 p.m. |
unsup22b.de-hsb test set (de-hsb)
# | Name | BLEU | chrF | Date |
---|---|---|---|---|
1 | Anonymous submission #1028 | 17.9 | 48.5 | Aug. 29, 2022, 12:10 p.m. |
2 | Anonymous submission #1038 | 10.4 | 33.4 | Aug. 29, 2022, 12:54 p.m. |
3 | Anonymous submission #1011 | 0.5 | 14.3 | Aug. 29, 2022, 7:18 a.m. |
4 | Anonymous submission #1030 | 0.3 | 13.7 | Aug. 29, 2022, 12:20 p.m. |
5 | Anonymous submission #1007 | 0.0 | 10.2 | Aug. 29, 2022, 5:59 a.m. |
unsup22b.hsb-de test set (hsb-de)
# | Name | BLEU | chrF | Date |
---|---|---|---|---|
1 | Anonymous submission #1027 | 18.0 | 46.9 | Aug. 29, 2022, 12:10 p.m. |
2 | Anonymous submission #1046 | 13.5 | 35.8 | Aug. 29, 2022, 1:24 p.m. |
3 | Anonymous submission #1010 | 0.3 | 13.6 | Aug. 29, 2022, 6:47 a.m. |
4 | Anonymous submission #1006 | 0.0 | 10.0 | Aug. 29, 2022, 5:57 a.m. |