ParaCrawl Corpus version 1.0

  Authors

Koehn, Philipp ; et al.show everyone

Koehn, Philipp ; Heafield, Kenneth ; Forcada, Mikel L. ; Esplà-Gomis, Miquel ; Ortiz-Rojas, Sergio ; Sánchez, Gema Ramírez ; Cartagena, Víctor M. Sánchez ; Haddow, Barry ; Bañón, Marta ; Střelec, Marek ; Samiotou, Anna ; Kamran, Amir

  Item identifier

http://hdl.handle.net/11372/LRT-2610

 Project URL

http://paracrawl.eu

 Date issued

2018-01-14

 Type

corpus, text

 Language(s)

Czech , Dutch , English , Estonian , Finnish , French , German , Italian , Latvian , Polish , Portuguese , Romanian , Russian , Spanish

 Description

The January 2018 release of the ParaCrawl is the first version of the corpus. It contains parallel corpora for 11 languages paired with English, crawled from a large number of web sites. The selection of websites is based on CommonCrawl, but ParaCrawl is extracted from a brand new crawl which has much higher coverage of these selected websites than CommonCrawl. Since the data is fairly raw, it is released with two quality metrics that can be used for corpus filtering. An official "clean" version of each corpus uses one of the metrics. For more details and raw data download please visit: http://paracrawl.eu/releases.html

 Publisher

ParaCrawl

 Acknowledgement

European Union

Project code: CEF-TC-2016-3 / Action No: 2016-EU-IA-0114

Project name: Connecting Europe Facility (CEF)

 Subject(s)

ParaCrawl parallel corpus CommonCrawl machine translation text corpora

 Collection(s)

LRT + Open Submissions Data & Tools

Show full item record