Skip to search
Skip to main content
Skip to first result
Search
Search Results
Creator:
Koehn, Philipp , Heafield, Kenneth , Forcada, Mikel L. , Esplà-Gomis, Miquel , Ortiz-Rojas, Sergio , Sánchez, Gema Ramírez , Cartagena, Víctor M. Sánchez , Haddow, Barry , Bañón, Marta , Střelec, Marek , Samiotou, Anna , and Kamran, Amir
Publisher:
ParaCrawl
Type:
text and corpus
Subject:
ParaCrawl , parallel corpus , CommonCrawl , machine translation , and text corpora
Language:
English , German , French , Spanish , Italian , Portuguese , Dutch , Polish , Czech , Romanian , Finnish , Latvian , Russian , and Estonian
Description:
The January 2018 release of the ParaCrawl is the first version of the corpus. It contains parallel corpora for 11 languages paired with English, crawled from a large number of web sites. The selection of websites is based on CommonCrawl, but ParaCrawl is extracted from a brand new crawl which has much higher coverage of these selected websites than CommonCrawl. Since the data is fairly raw, it is released with two quality metrics that can be used for corpus filtering. An official "clean" version of each corpus uses one of the metrics. For more details and raw data download please visit: http://paracrawl.eu/releases.html
Rights:
Public Domain Dedication (CC Zero) , http://creativecommons.org/publicdomain/zero/1.0/ , and PUB
Creator:
Tesser, Johannes Hermanus Maria,
Type:
text and monografie
Subject:
Latinská literatura, latinsky psaná (o ní) , Petr Kanisius, , humanisté , dějiny ideí, ideologie , and světové dějiny novověku (1492-1918)
Language:
Dutch
Rights:
unknown
Creator:
Rosa, Rudolf
Publisher:
Charles University, Faculty of Mathematics and Physics, Institute of Formal and Applied Linguistics (UFAL)
Type:
text and corpus
Subject:
Wikipedia , text corpora , and monolingual corpus
Language:
Abkhazian , Achinese , Adyghe , Afrikaans , Akan , Tosk Albanian , Amharic , Old English (ca. 450-1100) , Arabic , Official Aramaic (700-300 BCE) , Aragonese , Egyptian Arabic , Assamese , Asturian , Atikamekw , Avaric , Aymara , South Azerbaijani , Azerbaijani , Bashkir , Bambara , Bavarian , Central Bikol , Belarusian , Bengali , Bislama , Banjar , Tibetan , Bosnian , Bishnupriya , Breton , Buginese , Bulgarian , Russia Buriat , Catalan , Min Dong Chinese , Cebuano , Czech , Chamorro , Chechen , Cherokee , Church Slavic , Chuvash , Cheyenne , Central Kurdish , Cornish , Corsican , Cree , Crimean Tatar , Kashubian , Welsh , Danish , German , Dinka , Dimli (individual language) , Dhivehi , Lower Sorbian , Dzongkha , Modern Greek (1453-) , English , Esperanto , Estonian , Basque , Ewe , Extremaduran , Faroese , Persian , Fijian , Finnish , French , Arpitan , Northern Frisian , Western Frisian , Fulah , Friulian , Gagauz , Gan Chinese , Scottish Gaelic , Irish , Galician , Gilaki , Manx , Goan Konkani , Gothic , Guarani , Gujarati , Hakka Chinese , Haitian , Hausa , Hawaiian , Serbo-Croatian , Hebrew , Herero , Fiji Hindi , Hindi , Hiri Motu , Croatian , Upper Sorbian , Hungarian , Armenian , Igbo , Ido , Inuktitut , Interlingue , Iloko , Interlingua (International Auxiliary Language Association) , Indonesian , Inupiaq , Icelandic , Italian , Jamaican Creole English , Javanese , Lojban , Japanese , Kara-Kalpak , Kabyle , Kalaallisut , Kannada , Kashmiri , Georgian , Kanuri , Kazakh , Kabardian , Kabiyè , Khmer , Kikuyu , Kinyarwanda , Kirghiz , Komi-Permyak , Komi , Kongo , Korean , Karachay-Balkar , Kölsch , Kurdish , Ladino , Lao , Latin , Latvian , Lak , Lezghian , Ligurian , Limburgan , Lingala , Lithuanian , Lombard , Northern Luri , Latgalian , Luxembourgish , Ganda , Literary Chinese , Marshallese , Maithili , Malayalam , Marathi , Moksha , Eastern Mari , Minangkabau , Macedonian , Malagasy , Maltese , Mongolian , Maori , Western Mari , Malay (macrolanguage) , Creek , Mirandese , Burmese , Erzya , Mazanderani , Min Nan Chinese , Neapolitan , Nauru , Navajo , Ndonga , Low German , Nepali (macrolanguage) , Newari , Dutch , Norwegian Nynorsk , Norwegian , Novial , Pedi , Nyanja , Occitan (post 1500) , Livvi , Oriya (macrolanguage) , Oromo , Ossetian , Pangasinan , Pampanga , Panjabi , Papiamento , Picard , Pennsylvania German , Pfaelzisch , Pitcairn-Norfolk , Pali , Piemontese , Western Panjabi , Pontic , Polish , Portuguese , Pushto , Quechua , Vlax Romani , Romansh , Romanian , Rusyn , Rundi , Macedo-Romanian , Russian , Sango , Yakut , Sanskrit , Sicilian , Scots , Samogitian , Sinhala , Slovak , Slovenian , Northern Sami , Samoan , Shona , Sindhi , Somali , Southern Sotho , Spanish , Albanian , Sardinian , Sranan Tongo , Serbian , Swati , Saterfriesisch , Sundanese , Swahili (macrolanguage) , Swedish , Silesian , Tahitian , Tamil , Tatar , Tulu , Telugu , Tama (Colombia) , Tetum , Tajik , Tagalog , Thai , Tigrinya , Tonga (Tonga Islands) , Tok Pisin , Tswana , Tsonga , Turkmen , Tumbuka , Turkish , Twi , Tuvinian , Udmurt , Uighur , Ukrainian , Urdu , Uzbek , Venetian , Venda , Veps , Vietnamese , Vlaams , Volapük , Võro , Waray (Philippines) , Walloon , Wolof , Wu Chinese , Kalmyk , Xhosa , Mingrelian , Yiddish , Yoruba , Yue Chinese , Zeeuws , Zhuang , Chinese , Zulu , and Dotyali
Description:
Wikipedia plain text data obtained from Wikipedia dumps with WikiExtractor in February 2018.
The data come from all Wikipedias for which dumps could be downloaded at [https://dumps.wikimedia.org/]. This amounts to 297 Wikipedias, usually corresponding to individual languages and identified by their ISO codes. Several special Wikipedias are included, most notably "simple" (Simple English Wikipedia) and "incubator" (tiny hatching Wikipedias in various languages).
For a list of all the Wikipedias, see [https://meta.wikimedia.org/wiki/List_of_Wikipedias].
The script which can be used to get new version of the data is included, but note that Wikipedia limits the download speed for downloading a lot of the dumps, so it takes a few days to download all of them (but one or a few can be downloaded fast).
Also, the format of the dumps changes time to time, so the script will probably eventually stop working one day.
The WikiExtractor tool [http://medialab.di.unipi.it/wiki/Wikipedia_Extractor] used to extract text from the Wikipedia dumps is not mine, I only modified it slightly to produce plaintext outputs [https://github.com/ptakopysk/wikiextractor].
Rights:
Attribution-ShareAlike 3.0 Unported (CC BY-SA 3.0) , http://creativecommons.org/licenses/by-sa/3.0/ , and PUB
Publisher:
Meertens Institute KNAW The Netherlands
Type:
corpus
Language:
Dutch
Description:
Plant names in Dutch dialect
Rights:
Not specified
Creator:
Rock, Paul
Type:
text and monografie
Subject:
Mezinárodní vztahy, světová politika , vztahy československo-belgické , vztahy mezinárodní , Belgie , zahraniční politika, mezinárodní vztahy , přehledná zpracování dějin českých zemí (chronologicky) , and přehledná zpracování světových dějin (chronologicky)
Language:
Dutch
Rights:
unknown
Creator:
Schönfeld, Moritz,
Type:
text and monografie
Subject:
Lingvistika. Jazyky , jména národů , jména osobní , jazyky germánské , starověk , antika , and antický svět
Language:
Dutch
Description:
Ukázka kritického sebrání germánských jmen národů a osob, obsažených v literárním i nápisovém podání řeckého a římského starověku. Dizertace.
Rights:
unknown
Type:
corpus
Language:
Danish , Dutch , English , Finnish , French , German , Italian , Latin , Portuguese , Russian , Spanish , Swedish , and Telugu
Description:
Possibility to download or to browse free electronic books; Angebot: Download von und Online-Zugang zu frei verfügbaren E-Books; deutschsprachige Literatur stellt nur einen Teilbereich der verfügbaren E-Books dar
Rights:
Not specified
Type:
text and prameny
Subject:
Dějiny ostatních evropských států , rezoluce , stavy generální , politika zahraniční , vztahy česko-nizozemské , Nizozemí , politické dějiny, politici , and světové dějiny 1492-1648
Language:
Dutch
Rights:
unknown
Type:
text , rozhovory , and sborníky
Subject:
Dějiny Česka a Slovenska , Pražské jaro (1968) , Češi , Holanďané , Československo 1948-1969 , and Mnichov 1938, Pražské jaro 1968, okupace 1939, 1968
Language:
Dutch and Czech
Rights:
unknown
Creator:
Zacharias van Haarlem,
Type:
text and studie
Subject:
Dějiny Evropy , řád, kapucíni , vztahy česko-ruské , Rusko , církevní řády a kongregace, náboženská bratrstva, kláštery , světové dějiny 1648-1789 , and české země 1740-1792
Language:
Dutch
Rights:
unknown