Overview

This is the website for downloading the datasets used in the editions of the ImageCLEF Scalable Concept Annotation evaluation campaigns from 2012 to 2015. To review the task for which the datasets were intended and the respective evaluation protocols, please refer to the papers mentioned below or go to the ImageCLEF webpages: 2012, 2013, 2014 and 2015.

Citation

If you use this data, please cite the corresponding papers as explained in the README.txt file and also cite at least one of the following papers:

@inproceedings{Gilbert15_CLEF,
  author = {Andrew Gilbert and
    Luca Piras and
    Josiah Wang and
    Fei Yan and
    Emmanuel Dellandrea and
    Robert Gaizauskas and
    Mauricio Villegas and
    Krystian Mikolajczyk},
  title = {{Overview of the ImageCLEF 2015 Scalable Image Annotation,
    Localization and Sentence Generation task}},
  booktitle = {CLEF2015 Working Notes},
  series = {{CEUR} Workshop Proceedings},
  year = {2015},
  publisher = {CEUR-WS.org},
  issn = {1613-0073},
  month = {September 8-11},
  address = {Toulouse, France},
}

@inproceedings{Villegas14_CLEF,
  author = {Mauricio Villegas and Roberto Paredes},
  title = {{Overview of the ImageCLEF 2014 Scalable Concept Image Annotation Task}},
  booktitle = {CLEF2014 Working Notes},
  series = {{CEUR} Workshop Proceedings},
  year = {2014},
  volume = {1180},
  publisher = {CEUR-WS.org},
  issn = {1613-0073},
  pages = {308-328},
  month = {September 15-18},
  address = {Sheffield, UK},
  url = {http://mvillegas.info/pub/Villegas14_CLEF_Annotation-Overview.pdf},
}

@inproceedings{Villegas13_CLEF,
  author = {Mauricio Villegas and Roberto Paredes and Bart Thomee},
  title = {{Overview of the ImageCLEF 2013 Scalable Concept Image Annotation Subtask}},
  booktitle = {CLEF 2013 Evaluation Labs and Workshop, Online Working Notes},
  year = {2013},
  month = {September 23-26},
  address = {Valencia, Spain},
  isbn = {978-88-904810-5-5},
  issn = {2038-4963},
  url = {http://mvillegas.info/pub/Villegas13_CLEF_Annotation-Overview.pdf},
}
  

Data Download

The files available for download can be browsed here. In the README.txt file there is additional information about the data.

When downloading the data, the system will ask you to accept the Data Usage Agreement presented below. It will only work if you have Javascript and cookies enabled in your browser. Alternatively, the data can be downloaded using a command line tool by setting a cookie as "webupv-datasets_accept_agreement=yes". For example using wget, a file could be downloaded as follows:

$ wget --header "Cookie: webupv-datasets_accept_agreement=yes" ${FILE_URL}

Usage Agreement

Creative Commons License
This dataset is available under a Creative Commons Attribution-NonCommercial-ShareAlike 3.0 Unported License. Before downloading the data, please read and accept the Creative Commons License and the following usage agreement:

  Data Usage Agreement ImageCLEF 2012/2013/2014/2015/2016 WEBUPV Image
  Annotation Datasets

  By downloading the "Dataset", you (the "Researcher") agrees to the
  following terms.

  * The Researcher will only use the Dataset for non-commercial
  research and/or educational purposes.

  * The Researcher will cite one of the following papers in any
  publication that makes use of the Dataset.

    Gilbert, A., Piras, L., Wang, J., Yan, F., Ramisa, A.,
    Dellandrea, E., Gaizauskas, R., Villegas, M., Mikolajczyk, K.:
    Overview of the ImageCLEF 2016 scalable concept image
    annotation task. In: CLEF2016 Working Notes, CEUR Workshop
    Proceedings, CEUR-WS.org, Évora, Portugal, 5–8 September 2016

    Gilbert, A., Piras, L., Wang, J., Yan, F., Dellandrea, E.,
    Gaizauskas, R., Villegas, M., Mikolajczyk, K.: Overview of the
    ImageCLEF 2015 Scalable Image Annotation, Localization and
    Sentence Generation task. In: CLEF2015 Working Notes. CEUR
    Workshop Proceedings, CEUR-WS.org, Toulouse, France (September
    8-11 2015)

    Villegas, M., Paredes, R.: Overview of the ImageCLEF 2014
    Scalable Concept Image Annotation Task. In: CLEF2014 Working
    Notes. CEUR Workshop Proceedings, vol. 1180, pp. 308–328.
    CEUR-WS.org, Sheffield, UK (September 15-18 2014)

    Villegas, M., Paredes, R., Thomee, B.: Overview of the ImageCLEF
    2013 Scalable Concept Image Annotation Subtask. In: CLEF 2013
    Evaluation Labs and Workshop, Online Working Notes. Valencia,
    Spain (September 23-26 2013)

  * The Researcher may provide research associates and colleagues a
  copy of the Dataset provided that they also agree to this Data
  Usage Agreement.

  * The Researcher will assume all responsibility against any claims
  arising from Researcher's use of the Dataset.

Contact

For any questions or comments please feel free to contact us: