Publications by Costantino Grana

Distributed video surveillance has a direct application in intelligent home automation or domotics (from the Latin word domus, that means “home”, and informatics); in particular, in-house videosurveillance can provide good support for people with some difficulties (e.g., elderly or disabled people) living alone and with a limited autonomy. New hardware technologies for surveillance are now affordable and provide high reliability. Problems related to reliable software solutions are not completely solved, especially concerning the application of general-purpose computer vision techniques in indoor environments. Indeed, assuming the objective is to detect the presence of people, track them, and recognize dangerous behaviours by means of abrupt changes in their posture, robust techniques must cope with non-trivial difficulties. In particular, luminance changes and shadows must be taken into account, frequent posture changes must be faced, and large and long-lasting occlusions are common due to the vicinity of the cameras and the presence of furnitureand doors that can often hide parts of the person’s body. These problems are analyzed and solutions based on background suppression, appearance-based probabilistic tracking, and probabilistic reasoning for posture recognition are described.

In this work, we present a general purpose system for hierarchical structural segmentation and automatic annotation of video clips, by means of standardized low level features. We propose to automatically extract some prototypes for each class with a context based intra-class clustering. Clips are annotated following the MPEG-7 standard directives to provide easier portability. Results of automatic annotation and semiautomatic metadata creation are provided

Background Semiquantitative algorithms were applied to dermoscopic images to improve the clinical diagnosis for melanoma. Objective The aim of the study was to develop a computerized method for automated quantification of the 'A' (asymmetry) and 'B' (border cut-off) parameters, according to the ABCD rule for dermoscopy, thus reproducing human evaluation. Methods Three hundred and thirty-one melanocytic lesion images, referring to 113 melanomas and 218 melanocytic nevi, acquired by means of a digital videodermatoscope, were considered. Images were evaluated by two experienced observers and by using computer algorithms developed by us. Clinical evaluation of asymmetry was performed by attributing scores to shape asymmetry and asymmetry of pigment distribution and structures, whereas computer evaluation of shape and pigment distribution asymmetries were based on the assessment of differences in area and lightness in the two halves of the image, respectively. Borders were evaluated both by clinicians and by the computer, by attributing a score to each border segment ending abruptly. Differences between nevus and melanoma values were evaluated using the chi-square test, while Cohen's Kappa index for agreement was employed for the evaluation of the concordance between human and computer. Results Pigment distribution asymmetry appears the most striking parameter for melanoma diagnosis both for human and for automated diagnosis. A good concordance between clinicians and computer evaluation was achieved for all asymmetry parameters, and was excellent for border cut-off evaluation. Conclusions These algorithms enable a good reproduction of the 'A' and 'B' parameters of the ABCD rule for dermoscopy, and appear useful for diagnostic and learning purposes.

Digital dermoscopy improves the accuracy of melanoma diagnosis. The aim of this study was to develop and validate software for assessment of asymmetry in melanocytic lesion images, based on evaluation of colour symmetry, and to compare it with assessment by human observers. An image analysis program enabling numerical assessment of asymmetry in melanocytic lesions, based on the evaluation and comparison of CIE L*a*b* colour components (CIE L*a*b* is the name of a colour space defined by the Commission Internationale de l'Eclairage) inside image colour blocks, was employed on the recorded lesion images. Clinical evaluation of asymmetry in dermoscopic images was performed on the same image set employing a 0-1 scoring system. Asymmetry judgement was expressed by the clinicians for 12.8% of benign naevi, 44.7% of atypical naevi and 64.2% of malignant melanomas, whereas the computer identified as asymmetric 6.3%, 33.3% and 82.2%, respectively. Numerical parameters referring to malignant melanomas were significantly higher, both with respect to benign naevi and atypical naevi. The numerical parameters produced could be effectively employed for computer-aided melanoma diagnosis.

In this paper an automated assessment of pigment distribution and color areas for melanoma diagnosis is described.

Automatic segmentation of skin lesions in clinical images is a very challenging task; it is necessary for visual analysis of the edges, shape and colors of the lesions to support the melanoma diagnosis, but, at the same time, it is cumbersome since lesions (both naevi and melanomas) do not have regular shape, uniform color, or univocal structure. Most of the approaches adopt unsupervised color clustering. This works compares the most spread color clustering algorithms, namely median cut, k-means, fuzzy-c means and mean shift applied to a method for automatic border extraction, providing an evaluation of the upper bound in accuracy that can be reached with these approaches. Different tests have been performed to examine the influence of the choice of the parameter settings with respect to the performances of the algorithms. Then a new supervised learning phase is proposed to select the best number of clusters and to segment the lesion automatically. Examples have been carried out in a large database of medical images, manually segmented by dermatologists. From these experiments mean shift was resulted the best technique, in term of sensitivity and specificity. Finally, a qualitative evaluation of the goodness of segmentation has been validated by the human experts too, confirming the results of the quantitative comparison.

In this paper we focus on the problem of automatically registering dermatological images, because even if different products are available, most of them share the problem of a limited field of view on the skin. A possible solution is then the composition of multiple takes of the same lesion with digital software, such as that for panorama images creation.In this work, to perform an automatic selection of matching points the Harris Corner Detector is used, and to cope with outlier couples we employed the RANSAC method. Projective mapping is then used to match the two images. Given a set of correspondence points, Singular Value Decomposition was used to compute the transform parameters.At this point the two images need to be blended together. One initial assumption is often implicitly made: the aim is to merge two rectangular images. But when merging occurs between more than two images iteratively, this assumption will fail. To cope with differently shaped images, we employed the Distance Transform and provided a weighted merging of images. Different tests were conducted with dermatological images, both with standard rectangular frame and with not typical shapes, as for example a ring due to the objective and lens selection. The successive composition of different circular images with other blending functions, such as the Hat function, doesn’t correctly get rid of the border and residuals of the circular mask are still visible. By applying Distance Transform blending, the result produced is insensitive of the outer shape of the image.

This paper describes a complete approach to detect, localize and describe network patterns. Such texture is automatically detected with Gaussian derivative kernels and Fisher linear discriminant analysis; line closure and thinning is provided by morphological masking and line luminance profile fitting provides width estimation. Detection results on dermatological images are reported and discussed.

Effective usage of multimedia digital libraries has to deal with the problem of building efficient content annotation and retrieval tools. MOM (Multimedia Ontology Manager) is a complete system that allows the creation of multimedia ontologies, supports automatic annotation and creation of extended text (and audio) commentaries of video sequences, and permits complex queries by reasoning on the ontology.

A system for the automatic creation of Pictorially Enriched Ontologies is presented, that is ontologies for context-based video digital libraries, enriched by pictorial concepts for video annotation, summarization and similarity-based retrieval. Extraction of pictorial concepts with video clips clustering, ontology storing with MPEG-7, and the use of the ontology for stored video annotation are described. Re-sults on sport videos and TRECVID2005 video material are reported.