Differences

This shows you the differences between two versions of the page.

--- download [2013/03/14 10:26] – [Corpus building tools] eros
+++ download [2021/09/13 10:20] (current) – [Use the corpus directly (no download necessary)] eros
@@ Line 1: / Line 1: @@
+===== Use the corpus directly (no download necessary) =====
+  * The wacky corpora are available on our **official corpus repository** here: http://corpora.dipintra.it
-===== Free web interfaces =====
+Other free web interfaces:
   * the Jožef Stefan Institute hosts a web interface where many of our corpora can be used directly for free: http://nl.ijs.si/noske/wacs.cgi/first_form
-  * the University of Lancaster hosts ItWaC and a sample of UkWaC (registration is required but the service is free): http://cqpweb.lancs.ac.uk/
+  * the University of Lancaster hosts (among other corpora) ItWaC and a 50% sample of UkWaC (registration is required but the service is free): http://cqpweb.lancs.ac.uk/
+  * the Charles University in Prague also hosts DeWaC, FrWaC, ItWaC and UkWaC (here again registration is required but the service is free): http://korpus.cz/english/index.php
 ===== Download =====
-  * if you are interested in downloading and using the corpora described [[corpora|here]] (for free, we're not selling them) please [[people|contact us]].
+**NB**: when you download the corpora, you need to use your own tools to consult them. If you don't know what this means, then you probably don't want to download them and should use an online tools instead (see the secion "Free Web Interfaces" above).
+  * if you are interested in **downloading** the corpora described [[corpora|here]] (for free, we're not selling them) please [[people|contact us]]
   * the semantically and syntactically annotated Italian Wikipedia is available for direct download from here:
@@ Line 20: / Line 25: @@
   * [[Frequency lists]]
   * [[Keyword lists: ukWaC vs. the BNC]]
-===== Tools =====
-This is an incomplete list of tools used to build corpora from the web
-==== Complete pipelines ====
-  * [[http://bootcat.sslmit.unibo.it/|BootCaT toolkit]] -- bootstrap specialized corpora and terms from the web
-==== De-duplication ====
-  * {{:shared_ngram_collector.tgz|Shared ngram collector}} -- Perl script useful for near-duplicate detection
-  * [[http://code.google.com/p/onion/|Onion]] -- a tool for removing duplicate parts from large collections of texts.
-==== Boilerplate removal ====
-  * [[http://code.google.com/p/justext/|jusText]] -- a tool for removing boilerplate content
-  * [[http://www.nljubesic.net/resources/tools/webcontentextractor/|WebContentExtractor]] -- a tool for content extraction from web pages for building web corpora
-  * the **PotaModule** (a Perl module that is intended to perform "boilerplate" stripping and other forms of HTML document filtering and extraction) is available in the BootCaT toolkit (see link above).