C4Corpus (CC-BY part)

Title:

C4Corpus (CC-BY part)

Creator:

Gurevych, Iryna, Habernal, Ivan, and Zayed, Omnia

Contributor:

German Research Foundation (DFG)@@DIP DA 1600/1-1@@Information Consolidation: A New Paradigm in Knowledge Search@@nationalFunds@@ and Amazon@@Amazon Web Services in Education Grant@@Web Services in Education Grant@@Other@@

Publisher:

Technische Universität Darmstadt

Identifier:

http://hdl.handle.net/11372/LRT-2203

Subject:

CommonCrawl, Creative Commons, Web corpus, and Amazon Web Services

Type:

text and corpus

Description:

A large web corpus (over 10 billion tokens) licensed under CreativeCommons license family in 50+ languages that has been extracted from CommonCrawl, the largest publicly available general Web crawl to date with about 2 billion crawled URLs.

Language:

Afrikaans, Arabic, Bengali, Bulgarian, Czech, Danish, German, Modern Greek (1453-), English, Estonian, Persian, Finnish, French, Gujarati, Hebrew, Hindi, Croatian, Hungarian, Indonesian, Italian, Japanese, Kannada, Korean, Latvian, Lithuanian, Malayalam, Marathi, Macedonian, Nepali (macrolanguage), Dutch, Norwegian, Panjabi, Polish, Portuguese, Romanian, Russian, Slovak, Slovenian, Somali, Spanish, Albanian, Swahili (macrolanguage), Swedish, Tamil, Telugu, Tagalog, Thai, Turkish, Ukrainian, Undetermined, Urdu, Vietnamese, and Chinese

Rights:

Creative Commons - Attribution 4.0 International (CC BY 4.0)
http://creativecommons.org/licenses/by/4.0/
PUB

Relation:

http://www.lrec-conf.org/proceedings/lrec2016/pdf/388_Paper.pdf

Source:

https://dkpro.github.io/dkpro-c4corpus/

Harvested from:

LINDAT/CLARIAH-CZ repository

Metadata only:

false

Date:

2016-04-14