For the first time, researchers have demonstrated that artificial intelligence can identify skin cancer more accurately than dermatologists.The small study, published this month in the journal Annals of Oncology, compared the performance of a form of AI called deep learning convolutional neural network (CNN) to a group of 58 dermatologists.Researchers found that the CNN was more reliable at identifying melanoma, an aggressive form of skin cancer, and benign moles (called nevi) than even experienced dermatologists.

“I expected only a performance on an even level with the physicians. The outperformance even of the average experienced and trained dermatologists was a major surprise,” first author Dr. Holger Haenssle, a senior physician at the department of dermatology, University of Heidelberg, Germany, told Healthline.

The study builds off a landmark paper from researchers at Stanford in 2017 that first proposed that artificial intelligence could, through machine learning, visually identify skin cancer after examining thousands of pictures of the disease. Machine learning is a process through which artificial intelligence “learns” and improves its performance at a given task based on past performance and data.

The process that the CNN used in this research is based on an algorithm developed by Google that allows artificial intelligence to visually differentiate between thousands of different objects.

However, until now the accuracy of the process had not been compared to a large group of human dermatologists.

To conduct the study, Haenssle and his team assembled a test set of one-hundred dermoscopic images that included melanomas and benign nevi.

Dermoscopic images are magnified, high-resolution images created with a tool known as a dermoscope. They allow for easier diagnoses than inspection with the naked eye.

The images were analyzed both by the CNN and the group of 58 dermatologists from around the world.

Dermatologists from 17 different countries and different skill levels, from beginner to expert, took part. Of the dermatologists, 17 (roughly one-third) were “beginner,” meaning less than two years of experience in dermoscopy; 11 were “skilled,” with 2 to 5 years of experience; and 30 (more than half) were considered “experts,” with over five years of experience.

In the first stage of the study, dermatologists were given just the images alone and asked to diagnose whether it was a melanoma or benign nevi. They were then asked to indicate their decision for subsequent action: Whether surgery (excision), short- or long-term follow-up required, or no action needed.

After the first round of analysis, researchers gave the dermatologists additional close-up images of the same areas and clinical information, such as age and sex of the patient and where the lesion was located on the body.

During the first portion of the study, the dermatologists identified 86.6 percent of melanomas, although the more experienced doctors scored higher at 89 percent. On average, the group accurately identified 71.3 percent of the benign moles.

When artificial intelligence was put to the same task, it correctly identified 95 percent of melanomas.