TY - T1 - An Evaluation of Language-Agnostic Inner-Attention-Based Representations in Machine Translation SN - / UR - http://hdl.handle.net/10138/305136 T3 - A1 - Raganato, Alessandro; Vázquez, Raúl; Creutz, Mathias; Tiedemann, Jörg A2 - Augenstein, Isabelle; Gella, Spandana; Ruder, Sebastian; Kann, Katharina; Can, Burcu; Welbl, Johannes; Conneau, Alexis; Ren, Xiang; Rei, Marek PB - The Association for Computational Linguistics Y1 - 2019 LA - eng AB - In this paper, we explore a multilingual translation model with a cross-lingually shared layer that can be used as fixed-size sentence representation in different downstream tasks. We systematically study the impact of the size of the shared layer and the effect of including additional languages in the model. In contrast to related previous work, we demonstrate that the performance in translation does correlate with trainable downstream tasks. In particular, we show that larger intermediate laye... VO - IS - SP - OP - KW - 6121 Languages; 113 Computer and information sciences N1 - PP - ER -