Đang chuẩn bị nút TẢI XUỐNG, xin hãy chờ
Tải xuống
Translating compounds is an important problem in machine translation. Since many compounds have not been observed during training, they pose a challenge for translation systems. Previous decompounding methods have often been restricted to a small set of languages as they cannot deal with more complex compound forming processes. We present a novel and unsupervised method to learn the compound parts and morphological operations needed to split compounds into their compound parts. | Language-independent Compound Splitting with Morphological Operations Klaus Macherey1 Andrew M. Dai2 David Talbot1 Ashok C. Popat1 Franz Och1 1 Google Inc. 1600 Amphitheatre Pkwy. Mountain View CA 94043 USA kmach talbot popat och @google.com 2University of Edinburgh 10 Crichton Street Edinburgh UK EH8 9AB a.dai@ed.ac.uk Abstract Translating compounds is an important problem in machine translation. Since many compounds have not been observed during training they pose a challenge for translation systems. Previous decompounding methods have often been restricted to a small set of languages as they cannot deal with more complex compound forming processes. We present a novel and unsupervised method to learn the compound parts and morphological operations needed to split compounds into their compound parts. The method uses a bilingual corpus to learn the morphological operations required to split a compound into its parts. Furthermore monolingual corpora are used to learn and filter the set of compound part candidates. We evaluate our method within a machine translation task and show significant improvements for various languages to show the versatility of the approach. 1 Introduction A compound is a lexeme that consists of more than one stem. Informally a compound is a combination of two or more words that function as a single unit of meaning. Some compounds are written as space-separated words which are called open compounds e.g. hard drive while others are written as single words which are called closed compounds e.g. wallpaper . In this paper we shall focus only on closed compounds because open compounds do not require further splitting. The objective of compound splitting is to split a compound into its corresponding sequence of constituents. If we look at how compounds are created from lexemes in the first place we find that for some languages compounds are formed by concatenating 1395 existing words while in other languages compounding additionally involves .