5 publicaciones etiquetados con "Automatic Scoring Systems"

Introduction​

The future of dermatology has arrived thanks to Legit.Health's revolutionary application of the PASI system: APASI (Automatic Psoriasis Area and Severity Index). Using computer vision algorithms, the researchers have created a tool that processes smartphone images and automatically translates them into the domain of the PASI.

It is widely known that objective, reliable, and precise outcome measures are key to evidence-based medicine. When considering psoriasis, the PASI has the best measurement properties and is the most recommended for clinical trials. That is why we automated the PASI to help patients and doctors achieve better health outcomes.

The origins of the PASI​

This scoring system for psoriasis was first published in a paper by T. Fredericksson and U. Pettersson in 1978, where they explored the validity of a new treatment for the disease.

Their formula for assessing the severity of the condition would go on to become the gold standard for dermatologists around the globe and is still widely used to this day.

In order to calculate the PASI, the sum of the severity of these three main changes was multiplied with the numerical value of the areas involved and with the various percentages of the four body areas. These values were then added in order to obtain the PASI.

The shortfalls of the pen-and-paper PASI​

The main goal of PASI is to provide a tool to record data precisely and consistently for routine evaluations and clinical studies. However, it carries a set of problems and limitations.

We found substantial variation [in the results] between experienced and inexperienced physicians using PASI

In other words, there is a high inter-observer variability, that is most pronounced when compared between experienced and inexperienced practitioners.

Aside from the inter-observer variation, many physicians have reported that filling up the paper sheet is too tedious and time-consuming and that they don't really use it on a day-to-day basis.

Digital calculators: A half-baked solution to the problem​

With the advent of basic computation, several digitalized versions of the PASI scoring system were developed, in an attempt to reduce the time wasted in calculations. These online calculators tackle, although inefficiently, just one of the issues the traditional PASI has. While the formula is calculated automatically, the doctor still has to fill in the value for each parameter.

This not only still requires the time and attention of the physician, but does nothing to address the multiple issues of lack of objectivity and reproducibility within the PASI system.

¿Cómo sabemos si un sistema de puntuación es bueno?​

Cuando se trata de evaluaciones dermatológicas, la efectividad de un sistema de puntuación es primordial. Pero, ¿qué es exactamente lo que hace que un sistema de puntuación sea fiable y útil? A través del consenso científico, se han identificado varios factores clave que contribuyen a la robustez de estas escalas. Vamos a profundizar en los elementos cruciales:

• Facilidad de uso: Este factor considera si el sistema puede aplicarse sin esfuerzo dentro de las limitaciones de tiempo y recursos financieros. Que un sistema sea fácil de usar es crucial para su adopción generalizada en entornos clínicos.
• Sensibilidad al cambio: Un sistema de puntuación efectivo debe ser capaz de detectar cambios clínicamente significativos a lo largo del tiempo. Esta sensibilidad asegura que cualquier progreso o deterioro en la condición de un paciente se captura con precisión.
• Fiabilidad interobservador: Esto se refiere a la consistencia de los resultados cuando diferentes observadores utilizan el sistema de puntuación. Una alta fiabilidad interobservador significa que diferentes dermatólogos llegarán a conclusiones similares, mejorando la credibilidad del sistema.
• Variabilidad intraobservador: Esto analiza la consistencia de los resultados cuando el mismo observador utiliza el sistema de puntuación varias veces. Una baja variabilidad intraobservador indica que el sistema proporciona resultados similares todas las veces que un mismo dermatólogo evalúe un mismo caso.
• Interpretabilidad: Un sistema de puntuación práctico debería proporcionar interpretaciones cualitativas significativas de sus puntuaciones, como categorizar la gravedad de una condición como leve, moderada o severa.

Estos criterios no solo aseguran la efectividad del sistema de puntuación sino también su aplicabilidad y fiabilidad en diversos escenarios clínicos.

Adaptado de "Methods and definitions to rate the quality of outcome measures". Schmitt, J., Langan, S., Deckert, S., Svensson, A., von Kobyletzki, L., Thomas, K., & Spuls, P. (2013). Assessment of clinical signs of atopic dermatitis: A systematic review and recommendation. Journal of Allergy and Clinical Immunology, 132(6), 1337--1347. doi:10.1016/j.jaci.2013.07.008.

Six ways in which APASI is better​

Legit.Health is the revolutionary Clinical Data and Communication tool for Next-generation dermatologists that triples the empowerment of patients.

After 12 months using Legit.Health, in which we analysed the applicability of the tool at our hospital, we have drawn conclusions that help to propose a new care paradigm in the follow-up of psoriasis.

The purpose of the deep learning algorithms is to relieve doctors from the tedious manual calculation of scoring systems and allow the practice of more objective evidence-based dermatology while speeding up the pathology reporting process and increasing patients' autonomy and control.

Legit.Health's algorithms automatically grade lesions just by looking at smartphone images and small patient-reported outcome measures (PROMs). In other words: the tool will automatically fill in most of the dermatology scoring systems, such as PASI, SCORAD, UAS, GAGS, and many more.

Esto significa que la nueva versión de este sistema de puntuación extrae datos de manera precisa y consistente, tanto durante evaluaciones rutinarias como en investigación clínica. La mejora se puede ver en la siguiente tabla, que compara las métricas de rendimiento de la forma más común de utilizar los sistemas de puntuación:

	Papel y lápiz	Digital	Automático (IA)
Auto-supervisión	-	-	Realiza diagnóstico
Facilidad de uso	≈ 600 segundos	≈ 420 segundos	≈ 23 segundos
Sensibilidad al cambio	0 a 4	0 a 4	0 a 100
Variabilidad interobservador	Media (20%)	Media (20%)	La más baja (8%)
Variabilidad intraobservador	Alta	Alta	Cero

Gracias a los algoritmos de aprendizaje profundo, Legit.Health libera a los médicos de la tediosa tarea de calcular manualmente los sistemas de puntuación y permite la práctica de una dermatología basada en evidencia más objetiva. Además, al utilizar algoritmos para medir la sequedad, la liquenificación, el eritema, el exudado, el edema y muchos más signos, la herramienta puede calcular signos visuales de manera más fiable y consistente.

1. Easier to use and faster than any other existing method​

While an experienced physician might take six to seven minutes to completely fill in and calculate the PASI score of a patient, an inexperienced one will need ten minutes. Meanwhile, Legit.Health's algorithm only takes 23 seconds to get the final score, including capturing the image.

This is key both from a time management perspective, allowing the doctors better use their time with the patient, and from a clinical perspective. The fact that many physicians won't fill in any scoring system for considering the process too tedious and time-consuming and would rather make a gut estimate of the severity of the disease is incompatible with the modern idea of practising evidence-based medicine.

2. APASI assists the doctor in the diagnosis of the disease​

The algorithm developed by Legit.Health isn't limited to simply measuring the severity, like the PASI does. It can also help assess whether or not the condition is actually psoriasis. The APASI has been trained using the input of top dermatologists to distinguish between hundreds of conditions, including most types of psoriasis.

This means that APASI will distinguish between several types of psoriasis and assist the doctor in the disease assessment process, not only making it quicker by providing relevant information but improving the rate of correct diagnosis by 23%

3. APASI can detect small changes in the evolution of the pathology​

Legit.Health's tool analyzes the pathologies using a validated scoring system that has both the lowest MID (Minimal important Difference) and is sensible to the lowest LDC (Lowest Detectable Change), which means the algorithm analyzes every image with more precision and attention to detail than any human observer would.

In clinical trials, quantification of the disease is critical to measure the efficacy of an investigational treatment by comparing the severity of disease before therapy to that measured after treatment.

Furthermore, it has a higher validity and reliability while maintaining comparable clinimetric properties, thanks to the intrinsic functioning of computer vision algorithms.

4. Greatly reduces inter-observer variability​

Our data indicate that even experienced investigators had difficulty with PASI in rating the area of involvement […], especially among patients with more severe psoriasis.

The experimental results show that APASI outperforms the baseline methods when it comes to inter-observer variability, achieving a mean absolute percentage of error of just 13%, way below the usual 20% that can be observed in the classical application of the traditional scoring systems.

5. Zero intra-observer variability​

The algorithmic nature of the APASI eliminates entirely, and without question, the intra-observer variability, as every reading is reliably consistent.

This allows the doctor to not rely on his memory when assessing the severity of the psoriasis, so they can focus on the analysis of the contextual information. In this sense, the more objective data reduces considerably the risk of misdiagnosing, providing a more objective, accurate, and precise way of tracing the development of the disease.

To judge a treatment effect, the variation in rating a patient from time to time should be low

This becomes especially important in clinical trials, where reducing this kind of variability is key to gathering the precise data required in this kind of study.

6. More accessible and easier-to-read data​

Last but not least, Legit.Health's interface provides access to all the relevant information about the patient in an easy-to-read manner.

Every data derived from the APASI is clearly displayed on the screen, showing the severity of the affection and the different factors considered by the algorithm when analyzing the image and their scores.

The app also provides a handy graff that shows the evolution of the disease across time and makes following the healing process and the effectiveness of the treatment really easy.

In conclusion​

The revolutionary and innovative APASI represents the future of dermatology. We are giving doctors access to the best tool for the diagnosis of psoriasis and allowing them to practice evidence-based medicine and improve the communication between doctor and patient.

Thanks to Legit.Health, doctors across the globe can improve their correct diagnosis rate by 23% and make treatment easier to follow for the patient by making them active participants in their own recovery.

There is no denying that the use of algorithms that estimate the severity of the disease represents a bright future for the practice of dermatology and that will, without doubt, help advance the field.

Get access now​

This free 23-day trial of Legit.Health gives clinics and hospitals a hands-on look at how to drive increased adherence and improve patient outcomes, as well as improving efficiency and overall quality of life.