CN114882018A - Psoriasis severity evaluation system based on images - Google Patents
Psoriasis severity evaluation system based on images Download PDFInfo
- Publication number
- CN114882018A CN114882018A CN202210756235.8A CN202210756235A CN114882018A CN 114882018 A CN114882018 A CN 114882018A CN 202210756235 A CN202210756235 A CN 202210756235A CN 114882018 A CN114882018 A CN 114882018A
- Authority
- CN
- China
- Prior art keywords
- area
- skin damage
- severity
- psoriasis
- score
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/44—Detecting, measuring or recording for evaluating the integumentary system, e.g. skin, hair or nails
- A61B5/441—Skin evaluation, e.g. for skin disorder diagnosis
- A61B5/445—Evaluating skin irritation or skin trauma, e.g. rash, eczema, wound, bed sore
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/12—Edge-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/13—Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
- G06V10/764—Arrangements for image or video recognition or understanding using pattern recognition or machine learning using classification, e.g. of video objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30088—Skin; Dermal
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V2201/00—Indexing scheme relating to image or video recognition or understanding
- G06V2201/07—Target detection
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Pathology (AREA)
- Public Health (AREA)
- Dermatology (AREA)
- Radiology & Medical Imaging (AREA)
- Biophysics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Quality & Reliability (AREA)
- Veterinary Medicine (AREA)
- Artificial Intelligence (AREA)
- Computing Systems (AREA)
- Databases & Information Systems (AREA)
- Evolutionary Computation (AREA)
- Software Systems (AREA)
- Multimedia (AREA)
- Geometry (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The application relates to an image-based psoriasis severity assessment system, which comprises a data acquisition module, a detection classification module and a calculation assessment module; roughly dividing a human body into a plurality of first-level parts based on the characteristics of psoriasis, finely dividing the first-level parts into a plurality of second-level parts, and acquiring pictures of the second-level parts of a patient based on contour information; and (3) segmenting a secondary part region from the picture by using an example segmentation model, identifying the type of the skin damage region by using a YoloV4 target detection model, scoring and calculating the area of the skin damage regions of different types, and finishing the psoriasis severity evaluation of the patient according to the scoring score and the area. According to the method and the device, the problem of low evaluation accuracy in psoriasis severity evaluation is solved, the consistency of the collected pictures of the initial diagnosis and the follow-up diagnosis of the patient is improved by combining contour information, and the precision of skin damage area calculation is improved by integrating the two-stage part finely divided by the psoriasis characteristics.
Description
Technical Field
The application relates to the technical field of image processing, in particular to an image-based psoriasis severity evaluation system.
Background
The method for calculating the severity of the disease of the psoriasis patient in the early stage comprises the steps of dividing a human body into four parts, namely a head part, a neck part, a trunk part, an upper limb part and a lower limb part, respectively calculating erythema, scale, infiltration severity score and skin damage area ratio of each part by a doctor, adding the three skin damage severity scores and multiplying the three skin damage area ratios to obtain the severity score of each part of psoriasis, then adding the four parts of scores to obtain the total severity score of the psoriasis patient.
In the prior art, patent application No. 2022102158103 discloses an intelligent decision system for evaluating the severity of psoriasis based on skin images, and in the specifically disclosed scheme, images of four parts of the head, upper limbs, trunk and lower limbs of a human body are collected, a psoriasis skin lesion area is identified from the four part images through an inclusion ResNet V2 model, erythema, infiltration and scale in the skin lesion area are identified according to colors, erythema is scored by using a K-neighbor algorithm, the skin lesion is segmented into different color channels by using a Gaussian mixture model, and then the erythema is scored through the channel depth of three color bands.
It can be seen that the technical solution disclosed in the patent has the following problems:
firstly, in the process of image acquisition of a body part of a patient, due to the shooting angle or the distance relationship, the same part image acquired by an initial visit and a repeated visit is greatly different, the calculation of the skin damage area of the part is influenced twice before and after, the condition of illness improvement after treatment is easily caused, but the repeated visit evaluation shows deterioration and the like.
Secondly, the human body is divided into four parts of a head and neck, an upper limb, a trunk and a lower limb, the differentiation is relatively extensive, a set of standard psoriasis part division standards are not formulated aiming at the factors of psoriasis incidence characteristics, easily-occurring part regions and the like, and the calculation precision of the skin damage area is influenced.
And thirdly, the InceptitionResNet V2 model is a semantic segmentation model, and when the skin damage area appears at the boundary of the part, the area part of the segmented skin damage area is identified to be missing, so that the skin damage area calculation accuracy is influenced.
And fourthly, scoring is carried out on the basis of the color of the skin damage region by a traditional machine learning K-nearest neighbor algorithm or a Gaussian mixture model, the interference of the brightness and the definition of picture shooting is large, the scoring precision of the severity degree is influenced, meanwhile, the scoring is only carried out on erythema, and the scoring of infiltration and scales is not disclosed in the patent.
Furthermore, the publication is evaluated in conjunction with the DLQI scale, which is known to be generated based on subjective emotional feelings of patients during the course of illness, and the feelings of patients on psoriasis are different due to their age groups, e.g. the illness response in children is more dramatic compared to adults; meanwhile, differences can be caused due to different constitutions, namely, the problem that the final evaluation result is inaccurate and unpredictable due to subjective will of a patient exists in the evaluation combined with the DLQI scale.
At present, no effective solution is provided aiming at the problem of low evaluation accuracy in the severity evaluation of psoriasis in the related art.
Disclosure of Invention
The embodiment of the application provides an image-based psoriasis severity evaluation system, which is used for at least solving the problem of low evaluation accuracy in psoriasis severity evaluation in the related art.
In a first aspect, an embodiment of the present application provides an image-based psoriasis severity assessment system, which includes a data acquisition module, a detection classification module, and a calculation assessment module;
the data acquisition module is used for roughly dividing a human body into a plurality of first-level parts according to the characteristics of psoriasis, and then finely dividing the first-level parts into a plurality of second-level parts, wherein the first-level parts comprise head and neck, upper limbs, trunk and lower limbs, and the second-level parts comprise the forehead, the vertex, the front of the neck, the back of the neck, the front of the right arm, the front of the left arm, the back of the right arm, the back of the left arm, the palms, the backs of the two hands, the thoracoabdominal part, the back, the perineum, the buttocks, the front of the thighs, the back of the thighs, the backs of the feet and the soles of the feet;
the data acquisition module is also used for judging whether the acquisition of the secondary part of the patient is the first acquisition when acquiring the picture of the secondary part of the patient; if so, directly acquiring the picture of the secondary part of the patient, segmenting the outline information of the secondary part from the acquired picture, and storing the outline information in association with the secondary part and the patient; if not, acquiring contour information of the secondary part of the patient according to the associated storage, and acquiring a picture of the secondary part of the patient based on the contour information;
the detection classification module is used for segmenting a secondary part region from the picture through a SwinTransformMaskrcnn example segmentation model; detecting the secondary part area through a YoloV4 target detection model, and identifying a skin damage area of psoriasis, wherein the skin damage area comprises an erythema skin damage area, a scaling skin damage area and an infiltration skin damage area; classifying the severity of the skin damage region to obtain the severity score of the skin damage region, and calculating to obtain the area of the skin damage region;
and the calculation and evaluation module is used for finishing the psoriasis severity evaluation of the patient according to the severity score and the area of the skin damage area.
In some of these embodiments, calculating the area of the lesion area comprises:
and the detection classification module judges whether the identified erythema skin damage area, scale skin damage area and infiltration skin damage area have area overlapping or not, and if so, the areas of the overlapped skin damage areas are fused.
In some of these embodiments, classifying the severity of the lesion area, and deriving the severity score for the lesion area comprises:
the detection classification module classifies the severity of the erythema skin damage area, the scale skin damage area and the infiltration skin damage area through a ResNet model to obtain severity scores of the corresponding skin damage areas, wherein the severity is divided into 4 grades which respectively correspond to the 4 severity scores.
In some of these embodiments, completing the psoriasis severity assessment for the patient based on the severity score and area of the skin lesion comprises:
the calculation and evaluation module calculates a first severity score of the primary part according to the severity score of the secondary part;
the calculation and evaluation module is used for calculating the skin damage area ratio of the primary part according to the areas of the secondary part area and the skin damage area;
and the calculation and evaluation module calculates a second severity score of the primary part according to the first severity score and the skin damage area ratio.
In some of these embodiments, calculating a first severity score for the primary site based on the severity score for the secondary site comprises:
the calculation and evaluation module calculates a first severity score of each primary part through linear regression according to the severity scores of the erythema skin damage area, the scale skin damage area and the infiltration skin damage area of each secondary part, wherein the first severity score comprises an erythema dimension score, a scale dimension score and an infiltration dimension score.
In some embodiments, calculating the ratio of skin lesion area to skin lesion area of the primary site based on the secondary site area and the area of skin lesion area comprises:
the calculation and evaluation module calculates the sum of the skin damage area of all the secondary parts in each primary part and the sum of the area of the secondary part;
and the calculation and evaluation module calculates the skin damage area ratio of each primary part according to the sum of the skin damage area and the sum of the area of the secondary part.
In some of these embodiments, calculating a second severity score for the primary site based on the first severity score and the skin lesion area ratio comprises:
the calculation evaluation module passes the formula
Calculating a second severity score for 4 primary sites, wherein a i As erythema dimension score, b i Is the scale dimension fraction, c i Is the fractional number of the infiltration dimension, s i The fraction of the area of the skin damage is the corresponding fraction.
In some of these embodiments, after calculating a second severity score for the primary site based on the first severity score and the lesion area ratio, comprises:
by the formula
Calculating the psoriasis severity score of said human wherein g n Is the second severity score of the first order site.
In some of these embodiments, prior to detecting the secondary site region by the YoloV4 target detection model, comprising:
based on a YoloV4 target detection algorithm, a preset number of marked psoriasis pictures are learned, and YoloV4 target detection models corresponding to different skin lesion regions and different part types are generated.
Compared with the related art, the psoriasis severity evaluation system based on the image provided by the embodiment of the application roughly divides a human body into a plurality of first-level parts based on the characteristics of psoriasis, finely divides the first-level parts into a plurality of second-level parts, and acquires the pictures of the second-level parts of the patient based on the contour information; the method comprises the steps of segmenting a secondary part region from a picture through an example segmentation model, identifying the type of a skin damage region through a YoloV4 target detection model, scoring and calculating the area of the skin damage regions of different types, finishing the psoriasis severity evaluation of a patient according to the scoring score and the area, solving the problem of low evaluation accuracy in the psoriasis severity evaluation, improving the consistency of collected pictures for first diagnosis and second diagnosis of the patient by combining contour information, improving the skin damage area calculation accuracy by integrating the finely divided secondary part of the psoriasis characteristics, effectively shielding the interference of external factors such as the illumination condition of the picture by using the example segmentation model and the target detection model, and improving the identification accuracy and speed.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the application and together with the description serve to explain the application and not to limit the application. In the drawings:
fig. 1 is a block diagram of the structure of an image-based psoriasis severity assessment system according to an embodiment of the present application;
fig. 2 is a flow chart of steps of an image-based psoriasis severity assessment method according to an embodiment of the present application;
FIG. 3 is a schematic view of identification of a lesion area according to an embodiment of the present application;
FIG. 4 is a schematic illustration of a calculation of the area of a skin lesion area according to an embodiment of the present application;
fig. 5 is an internal structural diagram of an electronic device according to an embodiment of the present application.
Description of the drawings: 11. a data acquisition module; 12. a detection classification module; 13. and a calculation evaluation module.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application will be described and illustrated below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments provided in the present application without any inventive step are within the scope of protection of the present application.
It is obvious that the drawings in the following description are only examples or embodiments of the present application, and that it is also possible for a person skilled in the art to apply the present application to other similar contexts on the basis of these drawings without inventive effort. Moreover, it should be appreciated that in the development of any such actual implementation, as in any engineering or design project, numerous implementation-specific decisions must be made to achieve the developers' specific goals, such as compliance with system-related and business-related constraints, which may vary from one implementation to another.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one embodiment of the specification. The appearances of the phrase in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of ordinary skill in the art will explicitly and implicitly appreciate that the embodiments described herein may be combined with other embodiments without conflict.
Unless defined otherwise, technical or scientific terms referred to herein shall have the ordinary meaning as understood by those of ordinary skill in the art to which this application belongs. Reference to "a," "an," "the," and similar words throughout this application are not to be construed as limiting in number, and may refer to the singular or the plural. The present application is directed to the use of the terms "including," "comprising," "having," and any variations thereof, which are intended to cover non-exclusive inclusions; for example, a process, method, system, article, or apparatus that comprises a list of steps or modules (elements) is not limited to the listed steps or elements, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus. Reference to "connected," "coupled," and the like in this application is not intended to be limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The term "plurality" as referred to herein means two or more. "and/or" describes an association relationship of associated objects, meaning that three relationships may exist, for example, "A and/or B" may mean: a exists alone, A and B exist simultaneously, and B exists alone. The character "/" generally indicates that the former and latter associated objects are in an "or" relationship. Reference herein to the terms "first," "second," "third," and the like, are merely to distinguish similar objects and do not denote a particular ordering for the objects.
An image-based psoriasis severity assessment system is provided in an embodiment of the present application, fig. 1 is a block diagram of a structure of an image-based psoriasis severity assessment system according to an embodiment of the present application, and as shown in fig. 1, the system includes a data acquisition module 11, a detection classification module 12, and a calculation assessment module 13; meanwhile, fig. 2 is a flowchart of steps of an image-based psoriasis severity assessment method according to an embodiment of the present application, as shown in fig. 2, the method including the steps of:
step S202, roughly dividing a human body into a plurality of first-level parts based on the characteristics of psoriasis, and finely dividing the first-level parts into a plurality of second-level parts;
specifically, the data acquisition module 11 divides the human body into a plurality of first-level parts according to the human body part division standard, divides the first-level parts into a plurality of second-level parts, and acquires pictures of the second-level parts, wherein the head and neck (the first-level parts) comprise a frontal plane, a prefrontal plane, a postforehead and a vertex (the second-level parts); the upper limbs (the first-level parts) comprise the front part of the right arm, the back part of the right arm, the front part of the left arm, the back part of the left arm, the palms and the dorsum of the hands (the second-level parts); the trunk (primary part) comprises a chest, an abdomen, a back and a perineum (secondary part); the lower limbs (the first-level parts) comprise buttocks, the front part of thighs, the back part of thighs, the front part and the outer part of shanks, the back part of shanks, double instep and double soles (the second-level parts).
The psoriasis treating method comprises the steps of preparing a psoriasis treating solution, and preparing a psoriasis treating solution according to the psoriasis treating solution.
Step S204, acquiring a picture of a second-level part of the patient based on the contour information;
specifically, when the data acquisition module 11 acquires the picture of the second-level part of the patient, it is determined whether the acquisition of the second-level part of the patient is the first acquisition:
if yes, directly acquiring the picture of the secondary part of the patient, segmenting the outline information of the secondary part from the acquired picture, and storing the outline information in association with the secondary part and the patient;
if not, acquiring the contour information of the secondary part of the patient according to the associated storage, and acquiring a picture of the secondary part of the patient based on the contour information.
Step S206, a secondary part area is segmented from a picture of a secondary part through a SwinTransformMaskrcnn example segmentation model;
it should be noted that the segmentation algorithm in the deep learning includes example segmentation emission and semantic segmentation algorithm. Representative of example segmentation algorithms: maskrcnn, Yolact, and Solo, a representation of the semantic segmentation algorithm: u-net, Inceptation and Deeplap. Further, in step S106, if the acquired picture with the blocked or missing secondary part appears, the swintransormmaskrcnn example segmentation model can better handle the situation, and in contrast, the robustness of the inclusion rennetv 2 semantic segmentation model in the background art is not as good as that of the example segmentation model.
Step S208, detecting the secondary part area through a YoloV4 target detection model, and identifying a skin damage area of psoriasis;
specifically, fig. 3 is a schematic diagram of identifying skin lesion areas according to an embodiment of the present application, and as shown in fig. 3, the detection classification module 12 detects a picture of a secondary site through a YoloV4 target detection model to distinguish different types of skin lesion areas of psoriasis, where the skin lesion areas include an erythema skin lesion area, a scaling skin lesion area, and an infiltration skin lesion area.
Before step S104 is executed, a predetermined number of labeled psoriasis images need to be learned based on a yoolov 4 target detection algorithm, so as to generate a yoolov 4 target detection model corresponding to different skin lesion regions and part types. Preferably, the preset number is a number greater than 1000.
Step S210, calculating to obtain a severity fraction and an area of the skin damage area;
specifically, the detection classification module 12 classifies the severity of the erythema skin damage area, the scale skin damage area and the infiltration skin damage area through a ResNet model to obtain severity scores corresponding to the skin damage area, wherein the severity is divided into 4 grades corresponding to the 4 severity scores respectively.
Specifically, it is determined whether there is a regional overlap between the identified erythematous skin damage region, the identified scaly skin damage region, and the identified infiltrated skin damage region, and if so, the areas of the overlapped skin damage regions are fused, fig. 4 is a schematic diagram of calculation of the skin damage region area according to the embodiment of the present application, and as shown in fig. 4, in the diagram, a region 1 represents the erythematous skin damage region, a region 2 represents the scaly skin damage region, and regions 1 and 2 represent the regions where the two overlap, and the area of the skin damage region after fusion is calculated as a region 0, that is, the skin damage region.
It should be noted that step S106 and step S110 combine the advantages of machine learning and deep learning. Firstly, the positions of the erythema, the scale and the infiltration area are judged by depending on the detection of the body part area, the interference of background factors and illumination conditions is reduced, and the identification accuracy and speed are improved.
And step S212, finishing the psoriasis severity evaluation of the patient according to the severity score and the area of the skin damage area.
Specifically, the calculation and evaluation module 13 calculates a first severity score corresponding to the primary site according to the severity score of the secondary site.
Preferably, the first severity score of each primary site is calculated by linear regression based on the severity scores of the erythemal lesion area, the squamous lesion area and the infiltrated lesion area of each secondary site, wherein the first severity score comprises an erythemal dimension score, a squamous dimension score and an infiltrated dimension score. Head and neck: erythema dimension score (a) 1 ) Scale dimensional fraction (b) 1 ) Wetting dimension fraction (c) 1 ) (ii) a Upper limb: erythema dimension score (a) 2 ) Dimension of scaleNumber (b) 2 ) Wetting dimension fraction (c) 2 ) (ii) a Trunk: erythema dimension score (a) 3 ) Scale dimensional fraction (b) 3 ) Wetting dimension fraction (c) 3 ) (ii) a Lower limb: erythema dimension score (a) 4 ) Scale dimensional fraction (b) 4 ) Wetting dimension fraction (c) 4 ）。
Specifically, the calculation and evaluation module 13 calculates the ratio of the skin damage area corresponding to the primary site according to the secondary site area and the skin damage area.
Preferably, the sum of the skin damage area of all the secondary parts in each primary part and the sum of the area of the secondary parts are calculated; and calculating the ratio of the skin damage area of each primary part according to the sum of the skin damage area and the area of the secondary part. Such as: area of skin lesion in each primary site (head and neck: d) 1 Upper limb: d 2 The trunk: d 3 And lower limbs: d 4 ) And the area of the secondary site region of each primary site (head and neck: e.g. of the type 1 Upper limb: e.g. of the type 2 The trunk: e.g. of the type 3 And lower limbs: e.g. of the type 4 ) (ii) a The ratio of the skin damage area of each primary site (neck: r) 1 =d 1 /e 1 Upper limb: r is 2 =d 2 /e 2 The trunk: r is 3 =d 3 /e 3 And lower limbs: r is 4 =d 4 /e 4 ）。
Specifically, the calculation and evaluation module 13 calculates a second severity score of the primary site according to the first severity score and the skin lesion area ratio.
Preferably by means of a formula
Calculating a second severity score for 4 primary sites, wherein a i As the erythema dimension score, b i Is the scale dimension fraction, c i Is the fractional number of the infiltration dimension, s i The fraction of the area of the skin damage is the corresponding fraction.
Further, table 1 is an example table of the score corresponding to the skin damage area ratio.
TABLE 1
It should be noted that, after step S112 is executed, the formula is used
Calculating psoriasis severity score of human body, wherein g n Is the second severity score of the first order site. Further, the weight coefficients are 10% for head and neck, 20% for upper limbs, 30% for trunk and 40% for lower limbs
Through the data acquisition module 11, the detection classification module 12, the calculation evaluation module 13 and the steps S102 to S112 in the embodiment of the application, the problem of low evaluation accuracy in evaluation of the severity of psoriasis is solved, the consistency of the images acquired by the initial diagnosis and the follow-up diagnosis of a patient is improved by combining contour information, the precision of skin damage area calculation is improved by integrating two-stage parts finely divided by psoriasis characteristics, the application of an example segmentation model and a target detection model effectively shields the interference of external factors such as the illumination condition of a photo, and the identification accuracy and speed are improved.
It should be noted that the steps illustrated in the above-described flow diagrams or in the flow diagrams of the figures may be performed in a computer system, such as a set of computer-executable instructions, and that, although a logical order is illustrated in the flow diagrams, in some cases, the steps illustrated or described may be performed in an order different than here.
Meanwhile, the modules may be functional modules or program modules, and may be implemented by software or hardware. For a module implemented by hardware, the modules may be located in the same processor; or the modules can be respectively positioned in different processors in any combination.
The present embodiment also provides an electronic device comprising a memory having a computer program stored therein and a processor arranged to run the computer program to perform the steps of any of the system embodiments described above.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
It should be noted that, for specific examples in this embodiment, reference may be made to examples described in the foregoing embodiments and optional implementations, and details of this embodiment are not described herein again.
In addition, in combination with the image-based psoriasis severity assessment system in the above embodiments, the embodiments of the present application may be implemented by providing a storage medium. The storage medium having stored thereon a computer program; the computer program, when executed by a processor, implements any of the image-based psoriasis severity assessment systems of the above embodiments.
In one embodiment, a computer device is provided, which may be a terminal. The computer device includes a processor, a memory, a network interface, a display screen, and an input device connected by a system bus. Wherein the processor of the computer device is configured to provide computing and control capabilities. The memory of the computer device comprises a nonvolatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of an operating system and computer programs in the non-volatile storage medium. The network interface of the computer device is used for communicating with an external terminal through a network connection. The computer program is executed by a processor to implement an image-based psoriasis severity assessment system. The display screen of the computer equipment can be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer equipment can be a touch layer covered on the display screen, a key, a track ball or a touch pad arranged on the shell of the computer equipment, an external keyboard, a touch pad or a mouse and the like.
In one embodiment, fig. 5 is a schematic diagram of an internal structure of an electronic device according to an embodiment of the present application, and as shown in fig. 5, an electronic device is provided, where the electronic device may be a server, and the internal structure diagram may be as shown in fig. 5. The electronic device comprises a processor, a network interface, an internal memory and a non-volatile memory connected by an internal bus, wherein the non-volatile memory stores an operating system, a computer program and a database. The processor is used for providing calculation and control capability, the network interface is used for communicating with an external terminal through network connection, the internal memory is used for providing an environment for an operating system and the running of a computer program, the computer program is executed by the processor to realize an image-based psoriasis severity assessment system, and the database is used for storing data.
Those skilled in the art will appreciate that the configuration shown in fig. 5 is a block diagram of only a portion of the configuration associated with the present application, and does not constitute a limitation on the electronic device to which the present application is applied, and a particular electronic device may include more or less components than those shown in the drawings, or may combine certain components, or have a different arrangement of components.
It will be understood by those skilled in the art that all or part of the processes in the system implementing the embodiments described above can be implemented by the relevant hardware instructed by a computer program, which can be stored in a non-volatile computer-readable storage medium, and when executed, can include the processes of the embodiments of the systems described above. Any reference to memory, storage, database, or other medium used in the embodiments provided herein may include non-volatile and/or volatile memory, among others. Non-volatile memory can include read-only memory (ROM), Programmable ROM (PROM), Electrically Programmable ROM (EPROM), Electrically Erasable Programmable ROM (EEPROM), or flash memory. Volatile memory can include Random Access Memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in a variety of forms such as Static RAM (SRAM), Dynamic RAM (DRAM), Synchronous DRAM (SDRAM), Double Data Rate SDRAM (DDRSDRAM), Enhanced SDRAM (ESDRAM), Synchronous Link DRAM (SLDRAM), Rambus Direct RAM (RDRAM), direct bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
It should be understood by those skilled in the art that various features of the above-described embodiments can be combined in any combination, and for the sake of brevity, all possible combinations of features in the above-described embodiments are not described in detail, but rather, all combinations of features which are not inconsistent with each other should be construed as being within the scope of the present disclosure.
The above-mentioned embodiments only express several embodiments of the present application, and the description thereof is more specific and detailed, but not construed as limiting the scope of the invention. It should be noted that, for a person skilled in the art, several variations and modifications can be made without departing from the concept of the present application, which falls within the scope of protection of the present application. Therefore, the protection scope of the present patent application shall be subject to the appended claims.
Claims (9)
1. An image-based psoriasis severity assessment system, comprising a data acquisition module, a detection classification module and a calculation assessment module;
the data acquisition module is used for roughly dividing a human body into a plurality of first-level parts according to the characteristics of psoriasis, and then finely dividing the first-level parts into a plurality of second-level parts, wherein the first-level parts comprise head and neck, upper limbs, trunk and lower limbs, and the second-level parts comprise the forehead, the vertex, the front of the neck, the back of the neck, the front of the right arm, the front of the left arm, the back of the right arm, the back of the left arm, the palms, the backs of the two hands, the thoracoabdominal part, the back, the perineum, the buttocks, the front of the thighs, the back of the thighs, the backs of the feet and the soles of the feet;
the data acquisition module is also used for judging whether the acquisition of the secondary part of the patient is the first acquisition when acquiring the picture of the secondary part of the patient; if so, directly acquiring the picture of the secondary part of the patient, segmenting the outline information of the secondary part from the acquired picture, and storing the outline information in association with the secondary part and the patient; if not, acquiring contour information of the secondary part of the patient according to the associated storage, and acquiring a picture of the secondary part of the patient based on the contour information;
the detection classification module is used for segmenting a secondary part region from the picture through a SwinTransformMaskrcnn example segmentation model; detecting the secondary part area through a YoloV4 target detection model, and identifying a skin damage area of psoriasis, wherein the skin damage area comprises an erythema skin damage area, a scaling skin damage area and an infiltration skin damage area; classifying the severity of the skin damage region to obtain the severity score of the skin damage region, and calculating to obtain the area of the skin damage region;
and the calculation and evaluation module is used for finishing the psoriasis severity evaluation of the patient according to the severity score and the area of the skin damage area.
2. The system of claim 1, wherein calculating the area of the skin lesion region comprises:
and the detection classification module judges whether the identified erythema skin damage area, scale skin damage area and infiltration skin damage area have area overlapping or not, and if so, the areas of the overlapped skin damage areas are fused.
3. The system of claim 1, wherein classifying the severity of the lesion area, and wherein obtaining the severity score for the lesion area comprises:
the detection classification module classifies the severity of the erythema skin damage area, the scale skin damage area and the infiltration skin damage area through a ResNet model to obtain severity scores of the corresponding skin damage areas, wherein the severity is divided into 4 grades which respectively correspond to 4 severity scores.
4. The system of claim 1, wherein performing the psoriasis severity assessment of the patient based on the severity score and the area of the skin lesion region comprises:
the calculation and evaluation module calculates a first severity score of the primary part according to the severity score of the secondary part;
the calculation and evaluation module is used for calculating the skin damage area ratio of the primary part according to the areas of the secondary part area and the skin damage area;
and the calculation and evaluation module calculates a second severity score of the primary part according to the first severity score and the skin damage area ratio.
5. The system of claim 4, wherein calculating a first severity score for the primary site based on the severity score for the secondary site comprises:
the calculation and evaluation module calculates a first severity score of each primary part through linear regression according to the severity scores of the erythema skin damage area, the scale skin damage area and the infiltration skin damage area of each secondary part, wherein the first severity score comprises an erythema dimension score, a scale dimension score and an infiltration dimension score.
6. The system of claim 4, wherein calculating the area-to-skin-lesion ratio for the primary site based on the secondary site area and the area-to-skin-lesion comprises:
the calculation and evaluation module calculates the sum of the skin damage area of all the secondary parts in each primary part and the sum of the area of the secondary part;
and the calculation and evaluation module calculates the skin damage area ratio of each primary part according to the sum of the skin damage area and the sum of the area of the secondary part.
7. The system of claim 4, wherein calculating a second severity score for the primary site based on the first severity score and the skin lesion area ratio comprises:
the calculation evaluation module passes the formula
Calculating a second severity score for 4 primary sites, wherein a i As the erythema dimension score, b i Is the scale dimension fraction, c i Is the fractional number of the infiltration dimension, s i The fraction of the area of the skin damage is the corresponding fraction.
8. The system of claim 4, wherein after calculating a second severity score for the primary site based on the first severity score and the lesion area ratio, the system comprises:
by the formula
Calculating the psoriasis severity score of said human wherein g n Is the second severity score of the first order site.
9. The system of claim 1, wherein prior to detecting the secondary site region by a YoloV4 target detection model, the system comprises:
based on a YoloV4 target detection algorithm, a preset number of marked psoriasis pictures are learned, and YoloV4 target detection models corresponding to different skin lesion regions and different part types are generated.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210756235.8A CN114882018B (en) | 2022-06-30 | 2022-06-30 | Psoriasis severity evaluation system based on images |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202210756235.8A CN114882018B (en) | 2022-06-30 | 2022-06-30 | Psoriasis severity evaluation system based on images |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN114882018A true CN114882018A (en) | 2022-08-09 |
| CN114882018B CN114882018B (en) | 2022-10-25 |
Family
ID=82683189
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202210756235.8A Active CN114882018B (en) | 2022-06-30 | 2022-06-30 | Psoriasis severity evaluation system based on images |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114882018B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108154503A (en) * | 2017-12-13 | 2018-06-12 | 西安交通大学医学院第附属医院 | A kind of leucoderma state of an illness diagnostic system based on image procossing |
| US20190053750A1 (en) * | 2017-08-18 | 2019-02-21 | Massachusetts Institute Of Technology | Automated surface area assessment for dermatologic lesions |
| CN112419286A (en) * | 2020-11-27 | 2021-02-26 | 苏州斯玛维科技有限公司 | Method and device for segmenting skin mirror image |
| US20210174512A1 (en) * | 2019-12-09 | 2021-06-10 | Janssen Biotech, Inc. | Method for Determining Severity of Skin Disease Based on Percentage of Body Surface Area Covered by Lesions |
| CN113159227A (en) * | 2021-05-18 | 2021-07-23 | 中国医学科学院皮肤病医院(中国医学科学院皮肤病研究所) | Acne image recognition method, system and device based on neural network |
| CN114224289A (en) * | 2021-12-16 | 2022-03-25 | 苏州体素信息科技有限公司 | Psoriasis image processing method and system based on deep learning |
| CN114299068A (en) * | 2022-03-07 | 2022-04-08 | 中南大学湘雅医院 | Intelligent decision-making system for evaluating psoriasis severity degree based on skin image |
-
2022
- 2022-06-30 CN CN202210756235.8A patent/CN114882018B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20190053750A1 (en) * | 2017-08-18 | 2019-02-21 | Massachusetts Institute Of Technology | Automated surface area assessment for dermatologic lesions |
| CN108154503A (en) * | 2017-12-13 | 2018-06-12 | 西安交通大学医学院第附属医院 | A kind of leucoderma state of an illness diagnostic system based on image procossing |
| US20210174512A1 (en) * | 2019-12-09 | 2021-06-10 | Janssen Biotech, Inc. | Method for Determining Severity of Skin Disease Based on Percentage of Body Surface Area Covered by Lesions |
| CN112419286A (en) * | 2020-11-27 | 2021-02-26 | 苏州斯玛维科技有限公司 | Method and device for segmenting skin mirror image |
| CN113159227A (en) * | 2021-05-18 | 2021-07-23 | 中国医学科学院皮肤病医院(中国医学科学院皮肤病研究所) | Acne image recognition method, system and device based on neural network |
| CN114224289A (en) * | 2021-12-16 | 2022-03-25 | 苏州体素信息科技有限公司 | Psoriasis image processing method and system based on deep learning |
| CN114299068A (en) * | 2022-03-07 | 2022-04-08 | 中南大学湘雅医院 | Intelligent decision-making system for evaluating psoriasis severity degree based on skin image |
Non-Patent Citations (2)
| Title |
|---|
| RITESH RAJ 等: ""Deep Learning based Multi-Segmentation for Automatic Estimation of Psoriasis Area Score"", 《IEEE》 * |
| 杨正生 等: ""斑块状银屑病严重程度评价及皮肤镜表现分析"", 《医学综述》 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN114882018B (en) | 2022-10-25 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Lee et al. | Automated mammographic breast density estimation using a fully convolutional network | |
| Cardoso et al. | Towards an intelligent medical system for the aesthetic evaluation of breast cancer conservative treatment | |
| Nowak et al. | Fully automated segmentation of connective tissue compartments for CT-based body composition analysis: a deep learning approach | |
| CN110415792B (en) | Image detection method, image detection device, computer equipment and storage medium | |
| Farahani et al. | Lung nodule diagnosis from CT images based on ensemble learning | |
| Shrivastava et al. | First review on psoriasis severity risk stratification: An engineering perspective | |
| Laibacher et al. | M2U-Net: Effective and efficient retinal vessel segmentation for resource-constrained environments | |
| US9092867B2 (en) | Methods for segmenting images and detecting specific structures | |
| Campomanes-Alvarez et al. | Hierarchical information fusion for decision making in craniofacial superimposition | |
| JP2006325937A (en) | Image determination device, image determination method, and program therefor | |
| Hsieh et al. | Bone age estimation based on phalanx information with fuzzy constrain of carpals | |
| JP2006006359A (en) | Image generator, image generator method, and its program | |
| CN111681205B (en) | Image analysis method, computer device, and storage medium | |
| Wu et al. | Diabetic macular edema grading based on improved Faster R-CNN and MD-ResNet | |
| CN114947756B (en) | Atopic dermatitis severity intelligent evaluation decision-making system based on skin image | |
| CN112819818A (en) | Image recognition module training method and device | |
| CN112950546A (en) | Esophagus cancer detection method and system of barium meal radiography image | |
| Li et al. | ECA-CBAM: Classification of Diabetic Retinopathy: Classification of diabetic retinopathy by cross-combined attention mechanism | |
| CN114882018B (en) | Psoriasis severity evaluation system based on images | |
| Anantharajan et al. | MRI brain tumor detection using deep learning and machine learning approaches | |
| CN111292299A (en) | Mammary gland tumor identification method and device and storage medium | |
| Zieliński et al. | Computer aided erosions and osteophytes detection based on hand radiographs | |
| Wu et al. | Oval Shape Constraint based Optic Disc and Cup Segmentation in Fundus Photographs. | |
| Tsunoda et al. | Pseudo-normal image synthesis from chest radiograph database for lung nodule detection | |
| US20230394783A1 (en) | Feature amount acquisition device, similar image search device, display device, feature amount acquisition method, similar image search method, display method, and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |