Information Retrieval
A Query-by-Example Content-Based Image Retrieval System of Non-Melanoma Skin Lesions
Lucia Ballerini1 , Xiang Li1 , Robert B. Fisher1 , and Jonathan Rees2
School of Informatics, University of Edinburgh, UK x.li-29@sms.ed.ac.uk, lucia.ballerini@ed.ac.uk, rbf@inf.ed.ac.uk 2 Dermatology, University of Edinburgh, UK jonathan.rees@ed.ac.uk
1
Abstract. This paper proposes a content-based image retrieval system for skin lesion images as a diagnostic aid. The aim is to support decision making by retrieving and displaying relevant past cases visually similar to the one under examination. Skin lesions of five common classes, including two non-melanoma cancer types are used. Colour and texture features are extracted from lesions. Feature selection is achieved by optimising a similarity matching function. Experiments on our database of 208 images are performed and results evaluated.
1
Introduction
Research in content-based image retrieval (CBIR) today is an extremely active discipline. There are already review articles containing references to a large number of systems and description of the technology implemented [1, 2]. A more recent review [3] reports a tremendous growth in publications on this topic. Applications of CBIR systems to medical domains already exist [4], although most of the systems currently available are based on radiological images. Most of the work in dermatology has focused on skin cancer detection. Different techniques for segmentation, feature extraction and classification have been reported by several authors. Concerning segmentation, Celebi et al. [5] presented a systematic overview of recent border detection methods: clustering followed by active contours are the most popular. Numerous features have been extracted from skin images, including shape, colour, texture and border properties [6–8]. Classification methods range from discriminant analysis to neural networks and support vector machines [9–11]. These methods are mainly developed for
Lucia Ballerini1 , Xiang Li1 , Robert B. Fisher1 , and Jonathan Rees2
School of Informatics, University of Edinburgh, UK x.li-29@sms.ed.ac.uk, lucia.ballerini@ed.ac.uk, rbf@inf.ed.ac.uk 2 Dermatology, University of Edinburgh, UK jonathan.rees@ed.ac.uk
1
Abstract. This paper proposes a content-based image retrieval system for skin lesion images as a diagnostic aid. The aim is to support decision making by retrieving and displaying relevant past cases visually similar to the one under examination. Skin lesions of five common classes, including two non-melanoma cancer types are used. Colour and texture features are extracted from lesions. Feature selection is achieved by optimising a similarity matching function. Experiments on our database of 208 images are performed and results evaluated.
1
Introduction
Research in content-based image retrieval (CBIR) today is an extremely active discipline. There are already review articles containing references to a large number of systems and description of the technology implemented [1, 2]. A more recent review [3] reports a tremendous growth in publications on this topic. Applications of CBIR systems to medical domains already exist [4], although most of the systems currently available are based on radiological images. Most of the work in dermatology has focused on skin cancer detection. Different techniques for segmentation, feature extraction and classification have been reported by several authors. Concerning segmentation, Celebi et al. [5] presented a systematic overview of recent border detection methods: clustering followed by active contours are the most popular. Numerous features have been extracted from skin images, including shape, colour, texture and border properties [6–8]. Classification methods range from discriminant analysis to neural networks and support vector machines [9–11]. These methods are mainly developed for
References: 1. Rui, Y., Huang, T.S., Chang, S.F.: Image retrieval: Current techniques, prominsign directions, and open issues. Journal of Visual Communication and Image Representation 10 (1999) 39–62 2. Smeulders, A.W.M., Member, S., Worring, M., Santini, S., Gupta, A., Jain, R.: Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence 22(12) (2000) 1349–1380 3. Datta, R., Joshi, D., Li, J., Wang, J.Z.: Image retrieval: Ideas, influences, and trends of the new age. ACM Computing Surveys 40(2) (April 2008) 5:1–5:60 4. M¨ller, H., Michoux, N., Bandon, D., Geissbuhler, A.: A review of content-based u image retrieval systems in medical applications - clinical benefits and future directions. International Journal of Medical Informatics 73 (2004) 1–23 5. Celebi, M.E., Iyatomi, H., Schaefer, G., Stoecker, W.V.: Lesion border detection in dermoscopy images. Computerized Medical Imaging and Graphics 33(2) (2009) 148–153 6. Wollina, U., Burroni, M., Torricelli, R., Gilardi, S., Dell’Eva, G., Helm, C., Bardey, W.: Digital dermoscopy in clinical practise: a three-centre analysis. Skin Research and Technology 13 (May 2007) 133–142(10) 7. Seidenari, S., Pellacani, G., Pepe, P.: Digital videomicroscopy improves diagnostic accuracy for melanoma. Journal of the American Academy of Dermatology 39(2) (1998) 175–181 8. Lee, T.K., Claridge, E.: Predictive power of irregular border shapes for malignant melanomas. Skin Research and Technology 11(1) (2005) 1–8 9. Schmid-Saugeons, P., Guillod, J., Thiran, J.P.: Towards a computer-aided diagnosis system for pigmented skin lesions. Computerized Medical Imaging and Graphics 27 (2003) 65–78 10. Maglogiannis, I., Pavlopoulos, S., Koutsouris, D.: An integrated computer supported acquisition, handling, and characterization system for pigmented skin lesions in dermatological images. IEEE Transactions on Information Technology in Biomedicine 9(1) (2005) 86–98 11. Celebi, M.E., Kingravi, H.A., Uddin, B., Iyatomi, H., Aslandogan, Y.A., Stoecker, W.V., Moss, R.H.: A methodological approach to the classification of dermoscopy images. Computerized Medical Imaging and Graphics 31(6) (2007) 362 – 373 12. Chung, S.M., Wang, Q.: Content-based retrieval and data mining of a skin cancer image database. In: International Conference on Information Technology: Coding and Computing (ITCC’01), Los Alamitos, CA, USA, IEEE Computer Society (2001) 611–615 13. Celebi, M.E., Aslandogan, Y.A.: Content-based image retrieval incorporating models of human perception. Information Technology: Coding and Computing, International Conference on 2 (2004) 241 14. Rahman, M.M., Desai, B.C., Bhattacharya, P.: Image retrieval-based decision support system for dermatoscopic images. In: IEEE Symposium on ComputerBased Medical Systems, Los Alamitos, CA, USA, IEEE Computer Society (2006) 285–290 15. Dorileo, E.A.G., Frade, M.A.C., Roselino, A.M.F., Rangayyan, R.M., AzevedoMarques, P.M.: Color image processing and content-based image retrieval techniques for the analysis of dermatological lesions. 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS 2008) (August 2008) 1230–1233 16. : Dermnet: the dermatologist’s image resource (2007) Dermatology Image Altas, available at: http://www.dermnet.com/. 17. Cohen, B.A., Lehmann, C.U.: Dermatlas (2000-2009) Dermatology Image Altas, available at: http://dermatlas.med.jhmi.edu/derm/. 18. Johr, R.H.: Dermoscopy: alternative melanocytic algorithms–the abcd rule of dermatoscopy, menzies scoring method, and 7-point checklist. Clinics in Dermatology 20(3) (May-June 2002) 240–247 19. Ohta, Y.I., Kanade, T., Sakai, T.: Color information for region segmentation. Computer Graphics and Image Processing 13(1) (July 1980) 222 – 241 20. Haralick, R.M., Shanmungam, K., Dinstein, I.: Textural features for image classification. IEEE Transactions on Systems, Man and Cybernetics 3(6) (1973) 610–621 21. Unser, M.: Sum and difference histograms for texture classification. IEEE Transactions on Pattern Analysis and Machine Intelligence 8(1) (January 1986) 118–125 22. Munzenmayer, C., Wilharm, S., Hornegger, J., Wittenberg, T.: Illumination invariant color texture analysis based on sum- and difference-histograms. In: 27th, Vienna, Austria, August 31 - September 2, 2005. Springer BibRef LNCS3663 German Pattern Recognition Symposium. (2005) 17–24 23. Goldberg, D.E.: Genetic Algorithms in Search, Optimization, and Machine Learning. Addison-Wesley, Reading, MA (1989)