Overview
This is the website for downloading the datasets used in the editions of the ImageCLEF Scalable Concept Annotation evaluation campaigns from 2012 to 2015. To review the task for which the datasets were intended and the respective evaluation protocols, please refer to the papers mentioned below or go to the ImageCLEF webpages: 2012, 2013, 2014 and 2015.
Citation
If you use this data, please cite the corresponding papers as explained in the README.txt file and also cite at least one of the following papers:
@inproceedings{Gilbert15_CLEF, author = {Andrew Gilbert and Luca Piras and Josiah Wang and Fei Yan and Emmanuel Dellandrea and Robert Gaizauskas and Mauricio Villegas and Krystian Mikolajczyk}, title = {{Overview of the ImageCLEF 2015 Scalable Image Annotation, Localization and Sentence Generation task}}, booktitle = {CLEF2015 Working Notes}, series = {{CEUR} Workshop Proceedings}, year = {2015}, publisher = {CEUR-WS.org}, issn = {1613-0073}, month = {September 8-11}, address = {Toulouse, France}, } @inproceedings{Villegas14_CLEF, author = {Mauricio Villegas and Roberto Paredes}, title = {{Overview of the ImageCLEF 2014 Scalable Concept Image Annotation Task}}, booktitle = {CLEF2014 Working Notes}, series = {{CEUR} Workshop Proceedings}, year = {2014}, volume = {1180}, publisher = {CEUR-WS.org}, issn = {1613-0073}, pages = {308-328}, month = {September 15-18}, address = {Sheffield, UK}, url = {http://mvillegas.info/pub/Villegas14_CLEF_Annotation-Overview.pdf}, } @inproceedings{Villegas13_CLEF, author = {Mauricio Villegas and Roberto Paredes and Bart Thomee}, title = {{Overview of the ImageCLEF 2013 Scalable Concept Image Annotation Subtask}}, booktitle = {CLEF 2013 Evaluation Labs and Workshop, Online Working Notes}, year = {2013}, month = {September 23-26}, address = {Valencia, Spain}, isbn = {978-88-904810-5-5}, issn = {2038-4963}, url = {http://mvillegas.info/pub/Villegas13_CLEF_Annotation-Overview.pdf}, }
Data Download
The files available for download can be browsed here. In the README.txt file there is additional information about the data.
When downloading the data, the system will ask you to accept the Data Usage Agreement presented below. It will only work if you have Javascript and cookies enabled in your browser. Alternatively, the data can be downloaded using a command line tool by setting a cookie as "webupv-datasets_accept_agreement=yes". For example using wget, a file could be downloaded as follows:
$ wget --header "Cookie: webupv-datasets_accept_agreement=yes" ${FILE_URL}
Usage Agreement
This dataset is available under a Creative Commons
Attribution-NonCommercial-ShareAlike 3.0 Unported License. Before
downloading the data, please read and accept the Creative
Commons License and the following usage agreement:
Data Usage Agreement ImageCLEF 2012/2013/2014/2015/2016 WEBUPV Image Annotation Datasets By downloading the "Dataset", you (the "Researcher") agrees to the following terms. * The Researcher will only use the Dataset for non-commercial research and/or educational purposes. * The Researcher will cite one of the following papers in any publication that makes use of the Dataset. Gilbert, A., Piras, L., Wang, J., Yan, F., Ramisa, A., Dellandrea, E., Gaizauskas, R., Villegas, M., Mikolajczyk, K.: Overview of the ImageCLEF 2016 scalable concept image annotation task. In: CLEF2016 Working Notes, CEUR Workshop Proceedings, CEUR-WS.org, Évora, Portugal, 5–8 September 2016 Gilbert, A., Piras, L., Wang, J., Yan, F., Dellandrea, E., Gaizauskas, R., Villegas, M., Mikolajczyk, K.: Overview of the ImageCLEF 2015 Scalable Image Annotation, Localization and Sentence Generation task. In: CLEF2015 Working Notes. CEUR Workshop Proceedings, CEUR-WS.org, Toulouse, France (September 8-11 2015) Villegas, M., Paredes, R.: Overview of the ImageCLEF 2014 Scalable Concept Image Annotation Task. In: CLEF2014 Working Notes. CEUR Workshop Proceedings, vol. 1180, pp. 308–328. CEUR-WS.org, Sheffield, UK (September 15-18 2014) Villegas, M., Paredes, R., Thomee, B.: Overview of the ImageCLEF 2013 Scalable Concept Image Annotation Subtask. In: CLEF 2013 Evaluation Labs and Workshop, Online Working Notes. Valencia, Spain (September 23-26 2013) * The Researcher may provide research associates and colleagues a copy of the Dataset provided that they also agree to this Data Usage Agreement. * The Researcher will assume all responsibility against any claims arising from Researcher's use of the Dataset.