Overview
This is the website for downloading the datasets used in the editions of the ImageCLEF Scalable Concept Annotation evaluation campaigns from 2012 to 2015. To review the task for which the datasets were intended and the respective evaluation protocols, please refer to the papers mentioned below or go to the ImageCLEF webpages: 2012, 2013, 2014 and 2015.
Citation
If you use this data, please cite the corresponding papers as explained in the README.txt file and also cite at least one of the following papers:
@inproceedings{Gilbert15_CLEF,
author = {Andrew Gilbert and
Luca Piras and
Josiah Wang and
Fei Yan and
Emmanuel Dellandrea and
Robert Gaizauskas and
Mauricio Villegas and
Krystian Mikolajczyk},
title = {{Overview of the ImageCLEF 2015 Scalable Image Annotation,
Localization and Sentence Generation task}},
booktitle = {CLEF2015 Working Notes},
series = {{CEUR} Workshop Proceedings},
year = {2015},
publisher = {CEUR-WS.org},
issn = {1613-0073},
month = {September 8-11},
address = {Toulouse, France},
}
@inproceedings{Villegas14_CLEF,
author = {Mauricio Villegas and Roberto Paredes},
title = {{Overview of the ImageCLEF 2014 Scalable Concept Image Annotation Task}},
booktitle = {CLEF2014 Working Notes},
series = {{CEUR} Workshop Proceedings},
year = {2014},
volume = {1180},
publisher = {CEUR-WS.org},
issn = {1613-0073},
pages = {308-328},
month = {September 15-18},
address = {Sheffield, UK},
url = {http://mvillegas.info/pub/Villegas14_CLEF_Annotation-Overview.pdf},
}
@inproceedings{Villegas13_CLEF,
author = {Mauricio Villegas and Roberto Paredes and Bart Thomee},
title = {{Overview of the ImageCLEF 2013 Scalable Concept Image Annotation Subtask}},
booktitle = {CLEF 2013 Evaluation Labs and Workshop, Online Working Notes},
year = {2013},
month = {September 23-26},
address = {Valencia, Spain},
isbn = {978-88-904810-5-5},
issn = {2038-4963},
url = {http://mvillegas.info/pub/Villegas13_CLEF_Annotation-Overview.pdf},
}
Data Download
The files available for download can be browsed here. In the README.txt file there is additional information about the data.
When downloading the data, the system will ask you to accept the Data Usage Agreement presented below. It will only work if you have Javascript and cookies enabled in your browser. Alternatively, the data can be downloaded using a command line tool by setting a cookie as "webupv-datasets_accept_agreement=yes". For example using wget, a file could be downloaded as follows:
$ wget --header "Cookie: webupv-datasets_accept_agreement=yes" ${FILE_URL}
Usage Agreement
This dataset is available under a Creative Commons
Attribution-NonCommercial-ShareAlike 3.0 Unported License. Before
downloading the data, please read and accept the Creative
Commons License and the following usage agreement:
Data Usage Agreement ImageCLEF 2012/2013/2014/2015/2016 WEBUPV Image
Annotation Datasets
By downloading the "Dataset", you (the "Researcher") agrees to the
following terms.
* The Researcher will only use the Dataset for non-commercial
research and/or educational purposes.
* The Researcher will cite one of the following papers in any
publication that makes use of the Dataset.
Gilbert, A., Piras, L., Wang, J., Yan, F., Ramisa, A.,
Dellandrea, E., Gaizauskas, R., Villegas, M., Mikolajczyk, K.:
Overview of the ImageCLEF 2016 scalable concept image
annotation task. In: CLEF2016 Working Notes, CEUR Workshop
Proceedings, CEUR-WS.org, Évora, Portugal, 5–8 September 2016
Gilbert, A., Piras, L., Wang, J., Yan, F., Dellandrea, E.,
Gaizauskas, R., Villegas, M., Mikolajczyk, K.: Overview of the
ImageCLEF 2015 Scalable Image Annotation, Localization and
Sentence Generation task. In: CLEF2015 Working Notes. CEUR
Workshop Proceedings, CEUR-WS.org, Toulouse, France (September
8-11 2015)
Villegas, M., Paredes, R.: Overview of the ImageCLEF 2014
Scalable Concept Image Annotation Task. In: CLEF2014 Working
Notes. CEUR Workshop Proceedings, vol. 1180, pp. 308–328.
CEUR-WS.org, Sheffield, UK (September 15-18 2014)
Villegas, M., Paredes, R., Thomee, B.: Overview of the ImageCLEF
2013 Scalable Concept Image Annotation Subtask. In: CLEF 2013
Evaluation Labs and Workshop, Online Working Notes. Valencia,
Spain (September 23-26 2013)
* The Researcher may provide research associates and colleagues a
copy of the Dataset provided that they also agree to this Data
Usage Agreement.
* The Researcher will assume all responsibility against any claims
arising from Researcher's use of the Dataset.
