Supervision : Marcin DETYNIECKI

Co-supervision : TOLLARI Sabrina

Diversity by Clustering in Image Retrieval: Experimental Study

Conventional search engines return relevant results but often the retrieved items are similar. Moreover, the similar results tend to appear together. The user may be interested to find documents that are relevant and diverse at the same time. In this thesis, we consider the problem of the diversity in image retrieval. We have focused our attention on diversity by clustering, especially in an approach based on an agglomerative hierarchical clustering (AHC) to address the hierarchical nature of the diversity. Furthermore, we propose a novel approach for exploiting richer description resources, such as a «tree of concepts», to increase the diversity. The different approaches are compared on a highly relevant and manually annotated benchmark: the XiloDiv benchmark; and on the most general: ImageClef2008 and MediaEval2013 benchmarks. The experimental results show that a hierarchical exploitation of the results of the AHC increases the diversity in comparison with two flat clustering methods and a method of diversity by optimization. The results also show that it is better to use concept features than visual features from a diversity point of view. In addition, on the Mediaeval2013 benchmark, we show that an interesting strategy to improve diversity is to increase the relevance using the text, and then to exploit visual based clustering to diversify the results. Finally, we developed a complete prototype in particular taking into account the strong constraints of response time which makes it suitable to be used in the company's search engine.

2013-2015 Publications

• 2015
  • Ch. Kuoman Mamani : “Diversité par Clustering pour la Recherche d’Images : Étude Expérimentale”, thesis, phd defence 08/31/2015, supervision Detyniecki, Marcin, co-supervision : Tollari, Sabrina (2015)
• 2013
  • Ch. Kuoman Mamani, S. Tollari, M. Detyniecki : “UPMC at MediaEval 2013: Relevance by Text and Diversity by Visual Clustering”, MediaEval 2013 Multimedia Benchmark Workshop, vol. 1043, CEUR Workshop Proceedings, Barcelona, Spain, (CEUR-ws.org) (2013)
  • Ch. Kuoman Mamani, S. Tollari, M. Detyniecki : “Using Tree of Concepts and Hierarchical Reordering for Diversity in Image Retrieval”, CBMI 2013 - 11^th International Workshop on Content-Based Multimedia Indexing, Veszprém, Hungary, pp. 251-256, (IEEE) (2013)
  • Ch. Kuoman Mamani, S. Tollari, M. Detyniecki : “Diversité hiérarchique et utilisation d’arbres de concepts pour la recherche d’images”, Conference en Recherche d'Information et Applications (CORIA 2013), Neuchâtel, Switzerland (2013)