Corpus ID: 10544802
Overview of the IWSLT 2012 evaluation campaign
Marcello Federico, M. Cettolo, +2 authors S. Stüker
Published in IWSLT 2012
Computer Science, History
We report on the ninth evaluation campaign organized by the IWSLT workshop. This year, the evaluation offered multiple tracks on lecture translation based on the TED corpus, and one track on dialog… Expand
View On ACL
Hltc.Cs.Ust.Hk
Share This Paper
97 Citations
Highly Influential Citations
6
Background Citations
25
Methods Citations
52
Results Citations
2
Figures, Tables, and Topics from this paper
Table 1
Figure 1
Table 2
Figure 2
Table 3
Table 4
Table 5
Table 6
Table 7
Table 8
Table 9
Table 10
Table 11
Table 12
Crowdsourcing
dialog
Transcription (software)
Part-of-speech tagging
97 Citations
Report on the 10th IWSLT evaluation campaign
M. Cettolo, J. Niehues, S. Stüker, L. Bentivogli, Marcello Federico
Computer Science
IWSLT

2013
TLDR
The paper overviews the tenth evaluation campaign organized by the IWSLT workshop, which offered multiple tracks on lecture transcription and translation based on the TED Talks corpus and evaluated the progresses against systems of the previous years. Expand
142 Citations
PDF
Report on the 11th IWSLT evaluation campaign
M. Cettolo, J. Niehues, S. Stüker, L. Bentivogli, Marcello Federico
Computer Science
IWSLT

2014
TLDR
The paper overviews the 11th evaluation campaign organized by the IWSLT workshop, which offered multiple tracks on lecture transcription and translation based on the TED Talks corpus and included three automatic speech recognition tracks and five speech translation tracks. Expand
176 Citations
PDF
The IWSLT 2015 Evaluation Campaign
M. Cettolo, J. Niehues, S. Stüker, L. Bentivogli, R. Cattoni, Marcello Federico
Computer Science
IWSLT

2015
TLDR
The IWSLT 2015 Evaluation Campaign featured three tracks: automatic speech recognition (ASR), spoken language translation (SLT), and machine translation (MT), which involved the transcription or translation of TED talks, either made available by the official TED website or by other TEDx events. Expand
119 Citations
PDF
The IWSLT Evaluation Campaign: Challenges, Achievements, Future Directions
L. Bentivogli, Marcello Federico, S. Stüker, M. Cettolo, J. Niehues
Computer Science
2016
TLDR
The main characteristics of the tasks offered within the International Workshop on Spoken Language Translation, as well as the evaluation framework adopted and the data made available to the research community are presented. Expand
The KIT translation systems for IWSLT 2015
Mohammed Mediani, Yuqi Zhang, +5 authors A. Waibel
Computer Science
IWSLT

2015
TLDR
This paper presents the KIT systems participating in the TED translation tasks of the IWSLT 2015 machine translation evaluation, and improves their systems’ performance over last year through n-best list rescoring using neural networkbased translation and language models and novel discriminative models based on different source-side features and classification methods. Expand
28 Citations
PDF
Euronews: a multilingual benchmark for ASR and LID
R. Gretter
Computer Science
INTERSPEECH

2014
TLDR
These are the first recognition experiments on a multilingual speech corpus, designed for Automatic Speech Recognition (ASR) and Language IDentification (LID) purposes, and performance is evaluated on a subset of the test data. Expand
22 Citations
PDF
The NICT translation system for IWSLT 2012
A. Finch, Ohnmar Htun, E. Sumita
Computer Science
IWSLT

2012
TLDR
NICT’s participation in the IWSLT 2012 evaluation campaign for the TED speech translation RussianEnglish shared-task showed that an improvement in BLEU score can be gained in translation performance by encouraging the alignment of cognates and transliterations during word alignment.Expand
13 Citations
PDF
Euronews: a multilingual speech corpus for ASR
R. Gretter
Computer Science
LREC

2014
TLDR
A multilingual speech corpus, designed for Automatic Speech Recognition (ASR) purposes, which includes data in 10 languages and was designed both to train AMs and to evaluate ASR performance.Expand
13 Citations
PDF
Overview of the IWSLT 2017 Evaluation Campaign
M. Cettolo, Marcello Federico, +5 authorsFedermann Christian
Computer Science
2017
TLDR
The IWSLT 2017 evaluation campaign has organised three tasks, which offers the challenge of automatically transcribing and translating real-life university lectures and the integration of context information in machine translation. Expand
82 Citations
PDF
The RWTH Aachen speech recognition and machine translation system for IWSLT 2012
Stephan Peitz, Saab Mansour, +6 authors H. Ney
Computer Science
IWSLT

2012
In this paper, the automatic speech recognition (ASR) and statistical machine translation (SMT) systems of RWTH Aachen University developed for the evaluation campaign of the International Workshop… Expand
10 Citations
PDF
...
1
2
3
4
...
References
SHOWING 1-10 OF 49 REFERENCES
Overview of the IWSLT 2009 evaluation campaign
Michael Paul
Computer Science
IWSLT

2009
TLDR
An overview of the evaluation campaign results of the International Workshop on Spoken Language Translation (IWSLT) 2009 is given to investigate the impact of task-oriented human dialogs on automatic speech recognition (ASR) and machine translation (MT) system performance, as well as the robustness of state-of-the-art MT systems for speech-tospeech translation in a dialog scenario.Expand
40 Citations
PDF
Overview of the IWSLT 2010 evaluation campaign
Michael Paul, Marcello Federico, S. Stüker
Computer Science
IWSLT

2010
TLDR
An overview of the evaluation campaign results of the 7th International Workshop on Spoken Language Translation (IWSLT 2010) is given in order to investigate the impact of different communication modalities, spoken language styles and semantic context on automatic speech recognition (ASR) and machine translation (MT) system performances. Expand
83 Citations
PDF
Overview of the IWSLT 2011 evaluation campaign
Marcello Federico, L. Bentivogli, Michael Paul, S. Stüker
Computer Science
IWSLT

2011
TLDR
This paper provides an overview of the IWSLT 2011 Evaluation Campaign, which includes descriptions of the supplied data and evaluation specifications of each track, the list of participants specifying their submitted runs, a detailed description of the subjective evaluation carried out, and several detailed tables reporting all the evaluation results.Expand
82 Citations
PDF
The IWSLT 2011 Evaluation Campaign on Automatic Talk Translation
Marcello Federico, S. Stüker, +5 authors Giovanni Moretti
Computer Science
LREC

2012
TLDR
An overview of the IWSLT 2011 evaluation campaign is provided and the data supplied, the evaluation infrastructure made available to participants, and the subjective evaluation carried out are described. Expand
37 Citations
PDF
The NICT translation system for IWSLT 2012
A. Finch, Ohnmar Htun, E. Sumita
Computer Science
IWSLT

2012
TLDR
NICT’s participation in the IWSLT 2012 evaluation campaign for the TED speech translation RussianEnglish shared-task showed that an improvement in BLEU score can be gained in translation performance by encouraging the alignment of cognates and transliterations during word alignment.Expand
13 Citations
PDF
The RWTH Aachen speech recognition and machine translation system for IWSLT 2012
Stephan Peitz, Saab Mansour, +6 authors H. Ney
Computer Science
IWSLT

2012
In this paper, the automatic speech recognition (ASR) and statistical machine translation (SMT) systems of RWTH Aachen University developed for the evaluation campaign of the International Workshop… Expand
10 Citations
PDF
FBK@IWSLT 2012 - ASR track
D. Falavigna, R. Gretter, F. Brugnara, D. Giuliani
Computer Science
IWSLT

2012
This paper reports on the participation of FBK at the IWSLT2013 evaluation campaign on automatic speech recognition (ASR): precisely on both English and German ASR track. Only primary submissions… Expand
10 Citations
PDF
The LIG English to French machine translation system for IWSLT 2012
L. Besacier, B. Lecouteux, Marwen Azouzi, N. Luong
Computer Science
IWSLT

2012
TLDR
The results show that the approach allows a significant improvement in BLEU score using Google translate to guide the LIG participation to the E-F MT task of IWSLT 2012. Expand
13 Citations
PDF
Comparative study on corpora for speech translation
Gen-ichiro Kikui, Seiichi Yamamoto, T. Takezawa, E. Sumita
Computer Science
IEEE Transactions on Audio, Speech, and Language Processing
2006
TLDR
It is found that the first corpus is effective for covering utterances in the second corpus if complimented with a small number of utterances taken from monolingual dialogs, and the possibility of a bootstrap-style of development of corpora and S2ST systems is suggested. Expand
59 Citations
Getting Expert Quality from the Crowd for Machine Translation Evaluation
L. Bentivogli, Marcello Federico, Giovanni Moretti, Michael Paul
Computer Science
MTSUMMIT

2011
TLDR
This paper replicated the ranking evaluation of the ArabicEnglish BTEC task proposed at the IWSLT 2010 Workshop by hiring non-experts through the CrowdFlower interface to Amazon's Mechanical Turk, and confirmed that crowdsourcing is an effective way to reduce the costs of MT evaluation without sacrificing quality. Expand
25 Citations
PDF
...
1
2
3
4
...
SORT BY
Related Papers
Report on the 10th IWSLT evaluation campaign
M. Cettolo, J. Niehues, S. Stüker, L. Bentivogli, Marcello Federico
Computer Science
IWSLT

2013
TLDR
The paper overviews the tenth evaluation campaign organized by the IWSLT workshop, which offered multiple tracks on lecture transcription and translation based on the TED Talks corpus and evaluated the progresses against systems of the previous years.
142 Citations
Report on the 11th IWSLT evaluation campaign
M. Cettolo, J. Niehues, S. Stüker, L. Bentivogli, Marcello Federico
Computer Science
IWSLT

2014
TLDR
The paper overviews the 11th evaluation campaign organized by the IWSLT workshop, which offered multiple tracks on lecture transcription and translation based on the TED Talks corpus and included three automatic speech recognition tracks and five speech translation tracks.
176 Citations
Show More
2/10
Abstract
Figures, Tables, and Topics
97 Citations
49 References
Related Papers
Stay Connected With Semantic Scholar
What Is Semantic Scholar?
Semantic Scholar is a free, AI-powered research tool for scientific literature, based at the Allen Institute for AI.
Learn More
About
About Us
Publishers
Beta Program
Contact
Research
Team
Datasets
Open Corpus
Supp.ai
Resources
Librarians
Tutorials
FAQ
API
Proudly built by AI2
Terms of ServicePrivacy Policy
By clicking accept or continuing to use the site, you agree to the terms outlined in our Privacy Policy, Terms of Service, and Dataset License
ACCEPT & CONTINUE