WaCKy

WaCky - The Web-As-Corpus Kool Yinitiative

eros (eros@undisclosed.example.com) — 2022-12-05T10:57:49+00:00

WaCky - The Web-As-Corpus Kool Yinitiative Welcome to WaCky! We are a community of linguists and information technology specialists who got together to develop a set of tools (and interfaces to existing tools) that will allow linguists to crawl a section of the web, process the data, index and search them.

Publications

eros (eros@undisclosed.example.com) — 2022-07-11T08:05:00+00:00

Publications * M. Baroni, S. Bernardini, A. Ferraresi and E. Zanchetta. 2009. The WaCky Wide Web: A Collection of Very Large Linguistically Processed Web-Crawled Corpora. Language Resources and Evaluation 43(3): 209-226 ([PDF]). * M. Baroni and S. Bernardini (eds.). 2006.

Use the corpus directly (no download necessary) - [Use the corpus directly (no download necessary)]

eros (eros@undisclosed.example.com) — 2021-09-13T08:20:06+00:00

Use the corpus directly (no download necessary) * The wacky corpora are available on our official corpus repository here: Other free web interfaces: * the Jožef Stefan Institute hosts a web interface where many of our corpora can be used directly for free:

Tools - [Boilerplate removal]

eros (eros@undisclosed.example.com) — 2016-02-25T14:20:37+00:00

Tools This is an incomplete list of tools you can use to build corpora from the web. Complete pipelines * BootCaT -- bootstrap specialized corpora and terms from the web De-duplication * [Shared ngram collector] -- Perl script useful for near-duplicate detection * Onion -- a tool for removing duplicate parts from large collections of texts.

Frequency lists - [Repubblica (Italian)]

eros (eros@undisclosed.example.com) — 2014-03-27T09:45:38+00:00

Frequency lists Frequency lists extracted from the WaCky corpora. Lists of words and lemmas are provided, sorted by frequency. All the lists are in '.7z' compressed format. * Unigram lists. These are the complete lists, i.e. we did not perform any post-processing on them.

it.repubblica.lemma.unigrams.7z - created

eros (eros@undisclosed.example.com) — 2014-03-27T09:45:11+00:00

it.repubblica.word.unigrams.7z - created

eros (eros@undisclosed.example.com) — 2014-03-27T09:37:00+00:00

Corpora - [English]

eros (eros@undisclosed.example.com) — 2013-11-04T14:37:43+00:00

Corpora The resources below are large corpora build by downloading text from the web. See the Publications section for further details, and the Use the corpus directly (no download necessary) section for information on how to get them: English * PukWaC: the same as ukWaC, but with a further layer of annotation added, i.e. a full dependency parse. The parsing was performed with the

conll-syntax.pdf - created

eros (eros@undisclosed.example.com) — 2013-11-04T14:36:46+00:00

sorted.uk.word.unigrams.7z

eros (eros@undisclosed.example.com) — 2013-04-04T11:08:48+00:00

sorted.uk.lemma.unigrams.7z

eros (eros@undisclosed.example.com) — 2013-04-04T11:08:29+00:00

sorted.it.word.unigrams.7z

eros (eros@undisclosed.example.com) — 2013-04-04T11:07:59+00:00

sorted.it.lemma.unigrams.7z

eros (eros@undisclosed.example.com) — 2013-04-04T11:07:29+00:00

sorted.de.word.unigrams.7z

eros (eros@undisclosed.example.com) — 2013-04-04T11:06:57+00:00

sorted.de.lemma.unigrams.7z

eros (eros@undisclosed.example.com) — 2013-04-04T11:06:28+00:00

ukwac_tagset.txt - created

eros (eros@undisclosed.example.com) — 2013-03-20T11:24:46+00:00

sdewac-description.pdf - created

eros (eros@undisclosed.example.com) — 2012-03-21T08:50:27+00:00

shared_ngram_collector.tgz

eros (eros@undisclosed.example.com) — 2011-05-19T14:16:30+00:00

ferraresi_et_al_2010.pdf

adriano (adriano@undisclosed.example.com) — 2010-04-07T11:19:45+00:00