A clinical trial on the autofluorescence imaging of skin lesions comprising 16 dermatologically confirmed pigmented nevi, 15 seborrheic keratosis, 2 dysplastic nevi, histologically confirmed 17 basal cell carcinomas and 1 melanoma was performed. The autofluorescence spatial properties of the skin lesions were acquired by smartphone RGB camera under 405 nm LED excitation. The diagnostic criterion is based on the calculation of the mean autofluorescence intensity of the examined lesion in the spectral range of 515 nm–700 nm. The proposed methodology is able to differentiate seborrheic keratosis from basal cell carcinoma, pigmented nevi and melanoma. The sensitivity and specificity of the proposed method was estimated as being close to 100%. The proposed methodology and potential clinical applications are discussed in this article.
© 2018 Optical Society of America under the terms of the OSA Open Access Publishing Agreement
Skin cancer is an increasing problem for light skinned populations worldwide. Depending on the melanin concentration, skin tumors are broadly classified into two types - malignant melanomas (MM) and non-melanoma skin cancer (NMSC). MM is the most aggressive skin cancer modality with the death rate 85% of all fatal skin cancer cases . The most common NMSC are basal cell carcinoma (BCC, about 80% of new cases) and squamous cell carcinoma (SCC, about 20% of new cases) derived from the basal and squamous cells of the epidermis, respectively. BCC is characterized by very slow growth tendency, low mortality rate, and high risk of recurrence, while SCC is more aggressive and associated with the risk of metastasis . Early detection and removal of skin cancer can significantly increase the 5-year survival rate.
Currently, the technique most widely used by dermatologists for the detection of skin cancer is visual examination in combination with dermoscope. A serious limitation of this technique is a large number of false positive results leading to unnecessary tumor removal, high direct costs of the treatment and negative cosmetic and psycho-emotional consequences for patients. In particular, the diagnostic accuracy of skin cancer mainly depends on dermatologist’s experience and can vary according to different estimates in range 29-88% . According to the literature data, the most frequently misdiagnosed BCC’s have been confirmed as 21.7% squamous cell carcinoma (SCC), 21.7% seborrheic keratosis (SK), 13.0% actinic keratosis and 8.6% lichenoid reaction . In comparison, misdiagnosed superficial spreading melanomas have been confirmed as 42% BCC, 19% SCC, 33% nevus and 23% seborrheic keratosis . In accordance to the literature, the seborrheic keratosis (SK) often is suspected as cancerous lesion (BCC or MM), which is explained by SK color variabilities from white to black [5,6]. Development of non-invasive methods that could improve diagnostic accuracy of skin cancer is still a topical challenge for dermatology worldwide. The morphological and functional properties of skin cancer such as altered chromophore and fluorophore content, metabolic rate, melanin concentration, blood perfusion, as well as increased generation of reactive oxygen species should be determined with a higher accuracy [7–11]. From this point biophotonic techniques can contribute to improved non-invasive diagnostics and monitoring of skin cancer. Optical methods providing cellular level resolution, such as confocal reflectance microscopy or multiphoton fluorescence microscopy are expensive and therefore available mainly in large clinics and university hospitals [12,13]. Commercial devices exploiting skin multispectral reflectance and fluorescence features such as MelaFind, SIAscope, Velscope are suitable for non-invasive cancer diagnostics. However, their insufficient specificity is the main limiting factor for wide clinical implementation in routine clinical praxis [14,15]. Thanks to wide accessibility and rapid development of computing power and the integrated camera image quality, smartphone applications for skin cancer diagnostics is an emerging field of studies . Wide clinical implementation of smartphones is still limited by several technical problems, such as non-polarized white light illumination, low infrared sensitivity, unalterable lens focal length, insufficient dynamic range of sensor brightness, insufficient resolution, etc . These technical problems can be partially solved by attaching add-on devices to the smartphone. Such external devices can provide sufficient improvement of optical image quality and adequate imaging of in-vivo skin autofluorescence and multi-spectral diffuse reflectance by means of spectrally specific illumination [18,19].
The aim of the present study is to evaluate clinical efficiency of the smartphone add-on illumination device for acquisition of skin autoflorescence RGB images under 405 nm LED excitation . Clinical results related to autofluorescence intensity spatial properties of skin benign and malignant lesions are presented; they illustrate the possibility to differentiate seborrheic keratosis from basal cell carcinoma, pigmented nevi and melanoma. Potential improvements of skin cancer diagnostics accuracy have been considered.
2. Materials and methods
In-vivo skin autofluorescence images under 405 nm LED excitation (model LED Engin LZ1-00UA00-U8, spectral band half-width 30 nm) were recorded and further analyzed. External LED illumination device ensured fixed 60 mm distance between the smartphone camera and the examined skin area (diameter 40 mm) which was evenly irradiated with average power density of 20 mW/cm2. A long pass filter (>515 nm) was placed in front of smartphone camera to prevent detection of the LED emission. The recorded RGB images were further separated to exploit R- and G-band signals for analysis of skin tissue AF intensity in the red and green spectral bands, respectively. The Nexus5 smartphone with integrated CMOS RGB image sensor with resolution of 13 MP was used for image acquisition. All images were taken using the following settings: ISO—100, white balance—daylight, focus—manual, exposure time—fixed 200 ms. The detailed description of the prototype device can be found in [18,19]. Referring to manufacturer's data (Sony LSI Design Incorporated, private correspondence) and with respect to the cut-off filter, the G-band sensitivity covered the spectral range ~515-650nm with maximum at 530 nm and the R-band sensitivity - the range ~570-700 nm with maximum at 600 nm. Due to the spectral cutoff by 515 nm long pass filter, the Blue- band image signal is close to sensor noise level and the resulting RGB image represents the sum of AF signal detected by Green and Red channels. For better color representation of skin AF color variabilities all images included to the study are showed in RGB mode. The G-band images represent a maximum of skin autofluorescence emission under 405 nm excitation and have been selected for the further analysis of autofluorescence intensity. R-band images mostly visualize red autofluorescence of skin attributed to endogenous porphyrins [20,21]. To avoid induced autofluorescence intensity decrease caused by photobleaching process , all images were taken during the first second of LED's exposure. Further the ROI of G-band images (visible lesion area) were manually selected, with subsequent calculation of the mean intensity of the selected area. The visible lesion area (ROI) was manually selected and defined as an internal part of area with substantially different AF intensity in comparison with healthy surrounding skin. The mean AF intensity was calculated from the whole lesion including areas of low and high fluorescence intensity. To obtain the mean AF intensities of healthy skin, an unpigmented skin area with uniform distribution of intensity values was selected outside the lesion. In cases where it was not possible to mark the healthy skin area in the same image, a separate healthy skin image was taken outside the lesion. The determination and selection of the lesion area with subsequent calculation of AF mean value was performed by the same person for all the clinical cases. Mean intensity of ROI is expressed as intensity sum of selected pixels divided by a number of pixels. Image processing as well as calculation of the mean intensity were enabled by the Matlab software. All RGB images presented in the paper represent the skin surface with the relevant size of 2x2cm.
This study was approved by the Ethics Committee of the University of Latvia. All involved volunteers were informed about the study and signed the required consent. The lesions were diagnosed by competent (clinical experience more than 20 years) oncologists of Oncology Center of Latvia, using a commercial dermoscope, Heine Delta 20, HEINE USA LTD. Overall 51 different skin lesion were included to the study: 16 dermatologically confirmed pigmented nevi, 15 dermatologically confirmed seborrheic keratosis, 2 dermatologically confirmed dysplastic nevi, 17 histologically basal cell carcinomas and 1 histologically confirmed melanoma.
3. Results and discussion
The RGB images presenting spatial distribution of autofluorescence intensity in the range 515-700 nm for pigmented and dysplastic nevi are shown in Fig. 1 and Fig. 2. Visually pigmented and dysplastic nevi show similar features - AF intensity in the lesion is lower in comparison with the surrounding healthy skin. Decreased autofluorescence intensity correlates mainly with the changes in the collagen structures [22,23]. Some of the nevi expressed shining inclusions, for example, 5 of 16 pigmented nevi cases (Fig. 1(a)) and 1 of 2 dysplastic nevi cases (Fig. 2(a). These inclusions might be associated with increased keratin content on the lesion’s surface . In some cases (Fig. 2(a) evenly distributed red and green spots were observed on the skin surface. The red spots most probably represent porphyrins which are bacterial excretions that can become lodged in pores [20,21]. The G-band autofluorescence from surrounding skin mainly originates from endogenous fluorophores, such as elastin cross links, NADH, flavins, keratins .
Filtered RGB autofluorescence images of multiple basal cell carcinomas from one patient are illustrated in Fig. 3. Visually it is not possible to distinguish BCC from the nevi groups (Fig. 1 and Fig. 2) - AF intensity from the lesion is always lower in comparison with the surrounding healthy skin.
Figure 4 shows the AF intensity spatial distribution of ulcerating malignant melanoma (MM). It has been noticed that intensity of the MM image is much lower than it has been observed in other groups of skin malformations.
Three examples of AF spatial distributions for seborrheic keratosis are shown in Fig. 5. All (15 of 15) seborrheic keratosis showed similar features - most of the lesion area emitted more intensive AF signal compared to other lesion groups.
For quantitative assessment of the studied 5 lesion groups; the mean AF intensity was calculated within the visual area of the lesion. The box-of-whiskers plot of AF intensity mean values for seborrheic keratosis, pigmented nevi, BCC, and healthy skin has been depicted in Fig. 6. As the results include only 2 dysplastic nevi (mean value- 23.7 a.u. and 43.8 a.u.) and one melanoma (mean value- 8.9 a.u.) data, they are not depicted in box-of-whiskers plot (Fig. 6).
Using the analysis of the mean value calculations obtained from the lesion area, it was observed (Fig. 6) that it is possible to separate seborrheic keratosis from BCC and Nevi groups with sensitivity and specificity close to 100%, as all the measured mean AF intensities from seborrheic keratosis exceeded those from all the other lesions considered in this study. Testing the sensitivity and specificity of the method for seborrheic keratosis separation from other lesion groups, the following values have been obtained; true positives (TP) were 15, true negatives (TN) were 36, false positives (FP) were 0 and false negatives (FN) were 0. Respectively, the Sensitivity is TP / (TP + FN) = 15 / (15 + 0) = 100%, Specificity is TN / (TN + FP) = 36 / (36 + 0) = 100%. The obtained high diagnostic parameters are strictly theoretical, since the groups of SK and nevi do not overlap. On the other hand, the boundary values of those groups are very close, and the reliable specificity and sensitivity of the method most probably is in range of 90 - 100%. Our results also show that the only one melanoma case had a significantly lower AF intensity than all other lesion groups and it is possible to separate it from the other skin malformations. Since the number of melanoma and dysplastic nevi don't provide statistically reliable data, further study is necessary to collect more clinical cases. However, according to literature data, highly pigmented lesions, such as melanoma and dysplastic nevi are commonly characterized by low autofluorescence intensity under violet-blue excitation [7,9]. Therefore we can assume that the proposed method also may be valid for discrimination of seborrheic keratosis from melanoma and dysplastic nevi. Despite the high sensitivity/specificity of the proposed methodology, further studies including more clinical cases are required. Especially, cases of squamous cell carcinoma and keratoacanthoma that are characterized by increased autofluorescence intensity under violet-blue excitation  should be involved to the study. The obtained results represent absolute values of autofluorescence intensity captured by RGB image sensor under specific LED illumination. Besides, the evaluated diagnostics threshold is valid only for this particular case which is depending on a set of factors: LED intensity, exposition time, RGB sensor spectral sensitivity and illumination/detecting geometry. Another issue of further improvements should be focused on the development of algorithms for determination borders of the lesions, thereby reducing the variabilities of diagnostic values affected by subjective choice. Further studies are needed to determine the calibration algorithm eliminating the above mentioned factors. For example, LED illumination inhomogeneities as well as exposition time can be calibrated by a fluorescing etalon, which would allow the use of proposed diagnostics method for wide range of image sensors in combination with spectrally specific LED illumination.
The reported results demonstrate that sensitivity and specificity of the skin lesion diagnostics by smartphone-detected AF images can be very high. In particular, the analysis of 405 nm LED excited autofluorescences images captured by smartphone-integrated RGB camera enabled to discriminate seborrheic keratoses from BCC, MM, pigmented and dysplastic nevi with sensitivity and specificity close to 100%. In spite of the fact that seborrheic keratosis is benign, it is frequently mistakenly suspected as a malignant lesion during BCC and MM visual diagnostics, leading to unnecessary excision. The proposed approach further can be implemented as a routine method for increasing the diagnostic accuracy of suspicious lesions that is crucial in skin cancer diagnostics, as well as for full body examination for timely detection of tumor recurrence. Undoubtedly, additional studies are needed to collect more clinical data for determination of the diagnostic thresholds and for full automatization of the diagnostic algorithms.
Latvian National research program SOPHIS (No. 10-4/VPP-4/11); European Regional Development Fund (220.127.116.11/16/A/197, 18.104.22.168/16/1/001 agreement No. 22.214.171.124/VIAA/1/16/052).
References and links
1. American Cancer Society, “Cancer Facts and Figures 2017,” (American Cancer Society, 2017) http://www.cancer.org/acs/groups/content/@editorial/documents/document/acspc-048738.pdf.
2. D. S. Rigel, J. Robinson, M. Ross, R. Friedman, C. Cockerell, H. Lim, and J. Kirkwood, Cancer of the Skin: 2nd Edition (Saunders, 2011), Chap. 11.
4. E. A. Mohammad, M. Mansour, K. Parichehr, D. Farideh, R. Amirhossein, and S. A. Ahmad, “Assessment of clinical diagnostic accuracy compared with pathological diagnosis of basal cell carcinoma,” Indian Dermatol. Online J. 6(4), 258–262 (2015). [CrossRef] [PubMed]
5. J. Lin, S. Han, L. Cui, Z. Song, M. Gao, G. Yang, Y. Fu, and X. Liu, “Evaluation of dermoscopic algorithm for seborrhoeic keratosis: a prospective study in 412 patients,” J. Eur. Acad. Dermatol. Venereol. 28(7), 957–962 (2014). [CrossRef] [PubMed]
6. A. Oakley, “Dermoscopy of seborrhoeic keratosis CME,” (DermNet NZ, 2008) https://www.dermnetnz.org/cme/dermoscopy-course/dermoscopy-of-seborrhoeic-keratosis/.
7. G. Zonios, A. Dimou, I. Bassukas, D. Galaris, A. Tsolakidis, and E. Kaxiras, “Melanin absorption spectroscopy: new method for noninvasive skin investigation and melanoma detection,” J. Biomed. Opt. 13(1), 014017 (2008). [CrossRef] [PubMed]
8. C. Gerhäuser, “Cancer cell metabolism, epigenetics and the potential influence of dietary components – A perspective,” Biomed. Res. 23(1), 1–21 (2012). [PubMed]
9. E. G. Borisova, L. P. Angelova, and E. P. Pavlova, “Endogenous and exogenous fluorescence skin cancer diagnostics for clinical applications,” IEEE J. Quantum Electron. 20(2), 7100412 (2014).
11. M. Platkov, R. Tirosh, M. Kaufman, N. Zurgil, and M. Deutsch, “Photobleaching of fluorescein as a probe for oxidative stress in single cells,” J. Photochem. Photobiol. B 140, 306–314 (2014). [CrossRef] [PubMed]
13. M. Balu, C. B. Zachary, R. M. Harris, T. B. Krasieva, K. König, B. J. Tromberg, and K. M. Kelly, “In Vivo Multiphoton Microscopy of Basal Cell Carcinoma,” JAMA Dermatol. 151(10), 1068–1074 (2015). [CrossRef] [PubMed]
14. J. March, M. Hand, and D. Grossman, “Practical application of new technologies for melanoma diagnosis: Part I. Noninvasive approaches,” J. Am. Acad. Dermatol. 72(6), 929–941 (2015). [CrossRef] [PubMed]
15. R. S. Ganga, D. Gundre, S. Bansal, P. M. Shirsat, P. Prasad, and R. S. Desai, “Evaluation of the diagnostic efficacy and spectrum of autofluorescence of benign, dysplastic and malignant lesions of the oral cavity using VELscope,” Oral Oncol. 75, 67–74 (2017). [CrossRef] [PubMed]
16. J. P. Hilgefort, S. Fitzpatrick, D. Lycans, T. Wilson-Byrne, C. Fisher, and F. D. Shuler, “Smartphone mobile application to enhance diagnosis of skin cancer: A guide for the rural practitioner,” W. V. Med. J. 110(5), 40–44 (2014). [PubMed]
18. A. Lihachev, A. Derjabo, I. Ferulova, M. Lange, I. Lihacova, and J. Spigulis, “Autofluorescence imaging of basal cell carcinoma by smartphone RGB camera,” J. Biomed. Opt. 20(12), 120502 (2015). [CrossRef] [PubMed]
20. I. Seo, S. H. Tseng, G. O. Cula, P. R. Bargo, and N. Kollias, “Fluorescence spectroscopy for endogenous porphyrins in human facial skin,” Proc. SPIE 7161, 716103 (2009). [CrossRef]
22. S. Pratavieira, C. T. Andrade, A. G. Salvio, V. S. Bagnato, and C. Kurachi, “Optical Imaging as auxiliary tool in skin cancer diagnosis,” in Skin Cancers – Risk Factors, Prevention and Therapy, C. A. M. La Porta, ed. (In tech, 2011).
24. I. Bliznakova, E. Borisova, and L. Avramov, “Autofluorescence spectroscopy of human skin in dependence on excitation wavelengths,” Acta Phys. Pol. A 112(5), 1131–1136 (2007). [CrossRef]
25. L. Ghervase, D. Savastru, S. Dontu, A. Forsea, and E. Borisova, “Characterization of human skin by fluorescence, exemplified by dermatofibroma, keratoacanthoma, and seborrheic keratosis,” Anal. Lett. 49(3), 342–349 (2016). [CrossRef]