CN111767963A - Method and device for improving quality assessment based on endoscope screening - Google Patents

Method and device for improving quality assessment based on endoscope screening Download PDF

Info

Publication number
CN111767963A
CN111767963A CN202010645905.XA CN202010645905A CN111767963A CN 111767963 A CN111767963 A CN 111767963A CN 202010645905 A CN202010645905 A CN 202010645905A CN 111767963 A CN111767963 A CN 111767963A
Authority
CN
China
Prior art keywords
information
image
region
obtaining
interest
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202010645905.XA
Other languages
Chinese (zh)
Inventor
顾诗枢
杜燕飞
王立翔
桂伟
石磊
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Second Peoples Hospital of Nantong
Original Assignee
Second Peoples Hospital of Nantong
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Second Peoples Hospital of Nantong filed Critical Second Peoples Hospital of Nantong
Priority to CN202010645905.XA priority Critical patent/CN111767963A/en
Publication of CN111767963A publication Critical patent/CN111767963A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/00002Operational features of endoscopes
    • A61B1/00004Operational features of endoscopes characterised by electronic signal processing
    • A61B1/00009Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/25Determination of region of interest [ROI] or a volume of interest [VOI]
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
    • A61B1/273Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor for the upper alimentary canal, e.g. oesophagoscopes, gastroscopes
    • A61B1/2736Gastroscopes

Landscapes

  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Surgery (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Biology (AREA)
  • Pathology (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Biophysics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Optics & Photonics (AREA)
  • Evolutionary Computation (AREA)
  • Radiology & Medical Imaging (AREA)
  • Artificial Intelligence (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Endoscopes (AREA)

Abstract

The invention discloses a method and a device for improving quality assessment based on endoscope screening, relating to the technical field of data processing and comprising the following steps: obtaining real-time image information of an endoscope; the real-time image information input training model with the scope, wherein, training model obtains through the training of multiunit training data, and every group training data in the multiunit all includes: real-time image information and a preset evaluation standard of an endoscope; obtaining output information of a training model, wherein the output information comprises image information of a region of interest; acquiring image category information and image exposure area information of the region of interest; acquiring first association factor information according to the image information of the region of interest and the image category information; acquiring second correlation factor information according to the image information of the region of interest and the image exposure region information; and obtaining first quality evaluation image information according to the first relevant factor information and the second relevant factor information.

Description

Method and device for improving quality assessment based on endoscope screening
Technical Field
The application relates to the technical field of data processing, in particular to a method and a device for improving quality assessment based on endoscope screening.
Background
With the population change of the old people in China, the number of the old people and the people over 45 years old who take gastrointestinal endoscope examination is increased in a blowout mode every year. However, endoscopes are invasive, and in the case of a gastroscope, the patient's discomfort is inevitably caused by the taking of the gastroscope from the mouth, to the esophagus, to the stomach, through the pylorus, and to the duodenum, which is unacceptable for many patients. Although this is related to the sensitivity and tolerance of the patient, it is also inseparable from the skill of the physician, and each step of the endoscopic procedure is likely to cause injury to the patient.
However, in the process of implementing the technical solution in the embodiment of the present application, the inventor of the present application finds that the above prior art has at least the following technical problems:
in the prior art, a doctor evaluates according to an image through an endoscope afterwards, and the technical problems of poor timeliness and large error exist.
Content of application
The embodiment of the application provides a method and a device for improving quality assessment based on endoscope screening, and the method and the device are used for solving the technical problems that in the prior art, doctors assess images through endoscopes afterwards, timeliness is poor, errors are large, the purpose of assessing the images in real time is achieved, endoscope image information can be conveniently and rapidly evaluated, and powerful evidence is provided for diagnosing and treating focuses.
In order to solve the above problem, in a first aspect, an embodiment of the present application provides a method for improving quality assessment based on endoscopic screening, the method including: obtaining real-time image information of an endoscope; inputting real-time image information of the endoscope into a training model, wherein the training model is obtained by training a plurality of groups of training data, and each group of training data in the plurality of groups comprises: real-time image information and a preset evaluation standard of the endoscope; obtaining output information of the training model, wherein the output information comprises region-of-interest image information; obtaining image category information and image exposure area information of the region of interest; obtaining first associated factor information according to the image information of the region of interest and the image category information; obtaining second correlation factor information according to the image information of the region of interest and the image exposure area information; and obtaining first quality evaluation image information according to the first relevant factor information and the second relevant factor information.
Further, the real-time image information of the endoscope is input into a training model, wherein the training model is obtained by training a plurality of sets of training data, and each set of training data in the plurality of sets includes: the real-time image information and the preset evaluation standard of the endoscope comprise:
obtaining a predetermined evaluation criterion; and inputting the preset evaluation standard as supervision data into each group of training data to train the real-time image information of the endoscope.
Further, the obtaining the first correlation factor information according to the image information of the region of interest and the image category information includes:
obtaining the pH value information, enzyme information and bacteria information of the region of interest; obtaining first index information according to the pH value information, the enzyme information and the bacteria information; determining first characteristic information according to the image category information and the first index information; and obtaining first association factor information according to the image information of the region of interest and the first characteristic information.
Further, the obtaining second correlation factor information according to the image information of the region of interest and the image exposure area information includes:
determining a first high exposure area and a first low exposure area at the region of interest according to the image exposure area information; and obtaining second correlation factor information according to the image information of the interested area and the first high exposure area and/or the first low exposure area.
In a second aspect, the present application further provides a device for improving quality assessment based on endoscopic screening, where the device includes:
the first obtaining unit is used for obtaining real-time image information of the endoscope;
a first training unit, configured to input real-time image information of the endoscope into a training model, where the training model is obtained by training multiple sets of training data, and each set of training data in the multiple sets includes: real-time image information and a preset evaluation standard of the endoscope;
a second obtaining unit, configured to obtain output information of the training model, where the output information includes region-of-interest image information;
a third obtaining unit, configured to obtain image category information and image exposure area information at the region of interest;
a fourth obtaining unit, configured to obtain first associated factor information according to the region-of-interest image information and the image category information;
a fifth obtaining unit, configured to obtain second correlation factor information according to the image information of the region of interest and the image exposure area information;
a sixth obtaining unit configured to obtain first quality-evaluation image information from the first correlation factor information and the second correlation factor information.
Preferably, the apparatus comprises:
a seventh obtaining unit configured to obtain a predetermined evaluation criterion;
and the second training unit is used for inputting the preset evaluation standard as supervision data into each group of training data and training the real-time image information of the endoscope.
Preferably, the apparatus comprises:
an eighth obtaining unit, configured to obtain information on ph, enzyme, and bacteria at the region of interest;
a ninth obtaining unit, configured to obtain first index information according to the ph information, the enzyme information, and the bacteria information;
a first determination unit configured to determine first feature information from the image category information and the first index information;
a tenth obtaining unit, configured to obtain first correlation factor information according to the region of interest image information and the first feature information.
Preferably, the apparatus comprises:
the second determining unit is used for determining a first high exposure area and a first low exposure area at the region of interest according to the image exposure area information;
an eleventh obtaining unit, configured to obtain second correlation factor information according to the region of interest image information and the first high exposure region and/or the first low exposure region.
In a third aspect, an embodiment of the present application further provides an apparatus for improving quality assessment based on endoscope screening, including a memory, a processor, and a computer program stored in the memory and executable on the processor, where the processor executes the computer program to implement the following steps: obtaining real-time image information of an endoscope; inputting real-time image information of the endoscope into a training model, wherein the training model is obtained by training a plurality of groups of training data, and each group of training data in the plurality of groups comprises: real-time image information and a preset evaluation standard of the endoscope; obtaining output information of the training model, wherein the output information comprises region-of-interest image information; obtaining image category information and image exposure area information of the region of interest; obtaining first associated factor information according to the image information of the region of interest and the image category information; obtaining second correlation factor information according to the image information of the region of interest and the image exposure area information; and obtaining first quality evaluation image information according to the first relevant factor information and the second relevant factor information.
In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored, where the computer program is executed by a processor to implement the following steps: obtaining real-time image information of an endoscope; inputting real-time image information of the endoscope into a training model, wherein the training model is obtained by training a plurality of groups of training data, and each group of training data in the plurality of groups comprises: real-time image information and a preset evaluation standard of the endoscope; obtaining output information of the training model, wherein the output information comprises region-of-interest image information; obtaining image category information and image exposure area information of the region of interest; obtaining first associated factor information according to the image information of the region of interest and the image category information; obtaining second correlation factor information according to the image information of the region of interest and the image exposure area information; and obtaining first quality evaluation image information according to the first relevant factor information and the second relevant factor information.
One or more technical solutions in the embodiments of the present application have at least one or more of the following technical effects:
the embodiment of the application provides a method and a device for improving quality assessment based on endoscope screening, wherein the method comprises the following steps: obtaining real-time image information of an endoscope; inputting real-time image information of the endoscope into a training model, wherein the training model is obtained by training a plurality of groups of training data, and each group of training data in the plurality of groups comprises: real-time image information and a preset evaluation standard of the endoscope; obtaining output information of the training model, wherein the output information comprises region-of-interest image information; obtaining image category information and image exposure area information of the region of interest; obtaining first associated factor information according to the image information of the region of interest and the image category information; obtaining second correlation factor information according to the image information of the region of interest and the image exposure area information; and obtaining first quality evaluation image information according to the first relevant factor information and the second relevant factor information. The technical problems that in the prior art, a doctor evaluates according to an image through an endoscope afterwards, timeliness is poor, and errors are large are solved, the image information of an interested region, the image category information and the image exposure region information are integrated, real-time evaluation of the image is achieved, and the technical effect of conveniently and quickly evaluating the image information of the endoscope is achieved.
The foregoing description is only an overview of the technical solutions of the present application, and the present application can be implemented according to the content of the description in order to make the technical means of the present application more clearly understood, and the following detailed description of the present application is given in order to make the above and other objects, features, and advantages of the present application more clearly understandable.
Drawings
FIG. 1 is a schematic flow chart illustrating a method for improving quality assessment based on endoscopic screening according to an embodiment of the present invention;
FIG. 2 is a schematic structural diagram of an apparatus for improving quality assessment based on endoscopic screening according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of another apparatus for improving quality assessment based on endoscopic screening according to an embodiment of the present invention.
Description of reference numerals: a first obtaining unit 11, a first training unit 12, a second obtaining unit 13, a third obtaining unit 14, a fourth obtaining unit 15, a fifth obtaining unit 16, a sixth obtaining unit 17, a bus 300, a receiver 301, a processor 302, a transmitter 303, a memory 304, and a bus interface 306.
Detailed Description
The embodiment of the application provides a method and a device for improving quality assessment based on endoscope screening, and solves the technical problems that in the prior art, a doctor assesses according to an image through an endoscope afterwards, timeliness is poor, and errors are large.
In order to solve the technical problems, the technical scheme provided by the application has the following general idea: obtaining real-time image information of an endoscope; inputting real-time image information of the endoscope into a training model, wherein the training model is obtained by training a plurality of groups of training data, and each group of training data in the plurality of groups comprises: real-time image information and a preset evaluation standard of the endoscope; obtaining output information of the training model, wherein the output information comprises region-of-interest image information; obtaining image category information and image exposure area information of the region of interest; obtaining first associated factor information according to the image information of the region of interest and the image category information; obtaining second correlation factor information according to the image information of the region of interest and the image exposure area information; and obtaining first quality evaluation image information according to the first relevant factor information and the second relevant factor information. The method achieves the technical effects of integrating the image information of the region of interest, the image category information and the image exposure area information, realizing real-time evaluation of the image and conveniently and quickly evaluating the image information of the endoscope.
The technical solutions of the present application are described in detail below with reference to the drawings and specific embodiments, and it should be understood that the specific features in the embodiments and examples of the present application are detailed descriptions of the technical solutions of the present application, and are not limitations of the technical solutions of the present application, and the technical features in the embodiments and examples of the present application may be combined with each other without conflict.
Example one
Fig. 1 is a schematic flow chart of a method for improving quality assessment based on endoscopic screening according to an embodiment of the present invention, where the method includes:
step 110: obtaining real-time image information of an endoscope;
in particular, in the embodiment of the present application, suitable endoscopes include esophagoscope, gastroscope, duodenoscope, enteroscope, colonoscope, ultrasonic endoscope, choledochoscope, capsule endoscope, laryngoscope, bronchoscope, laparoscope, choledochoscope, colposcope, hysteroscope, intravascular scope, and arthroscope. Including traditional electron invasive scope and capsule gastroscope, shoot the real-time image information in the human organ intracavity through the scope. And inputting real-time image information of the endoscope into a training model after image preprocessing, wherein the real-time image information of the endoscope is image information with the same size, proportion and pixels.
Step 120: inputting real-time image information of the endoscope into a training model, wherein the training model is obtained by training a plurality of groups of training data, and each group of training data in the plurality of groups comprises: real-time image information and a preset evaluation standard of the endoscope;
further, the real-time image information of the endoscope is input into a training model, wherein the training model is obtained by training a plurality of sets of training data, and each set of training data in the plurality of sets includes: the real-time image information and the preset evaluation standard of the endoscope comprise: obtaining a predetermined evaluation criterion; and inputting the preset evaluation standard as supervision data into each group of training data to train the real-time image information of the endoscope.
Step 130: obtaining output information of the training model, wherein the output information comprises region-of-interest image information;
specifically, a training model, namely a Neural network model in machine learning, a Neural Network (NN) is a complex network system formed by a large number of simple processing units (called neurons) which are widely connected with each other, reflects many basic features of human brain functions, and is a highly complex nonlinear dynamical learning system. The neural network has the capabilities of large-scale parallel, distributed storage and processing, self-organization, self-adaptation and self-learning, and is particularly suitable for processing inaccurate and fuzzy information processing problems which need to consider many factors and conditions simultaneously. Neural network models are described based on mathematical models of neurons. Artificial Neural Networks (Artificial Neural Networks) are a description of the first-order properties of the human brain system. Briefly, it is a mathematical model. The neural network model is represented by a network topology, node characteristics, and learning rules. In the embodiment of the application, real-time image information of an endoscope is used as input data and is input into a training model, each set of input training data comprises the real-time image information of the endoscope and a preset evaluation standard, and the preset evaluation standard is used as supervision data, so that the real-time image information of the endoscope is trained, and output data is obtained. The predetermined evaluation criteria may be predetermined criteria for different disease manifestations of images within the organ cavity of the human body, for example, the predetermined evaluation criteria for internal images of the stomach include typical images of different types of disease conditions, such as healthy stomach internal cavities, polyps, ulcer points, inflammation, cancer, etc., as the predetermined evaluation criteria. The embodiment of the application takes the image information of the endoscope as an example for explanation, but the embodiment is not limited to the image information acquired by the endoscope, and also comprises the image information of the food endoscope, the image information of the plant endoscope and the image information of the fabric endoscope. The real-time image information of the endoscope is used as input data, a preset evaluation standard is used as supervision data, and the input data is input into a neural network model for training, namely the real-time image information of the endoscope is compared with the image information in the preset evaluation standard for judgment training, so that the image information of a region of interest is obtained, wherein the image information of the region of interest can be the image information in the preset evaluation standard, such as focus image information of gastric polyps, ulcer points, inflammations, cancers and the like.
Step 140: obtaining image category information and image exposure area information of the region of interest;
step 150: and obtaining first associated factor information according to the image information of the region of interest and the image category information.
Further, the obtaining the first correlation factor information according to the image information of the region of interest and the image category information includes: obtaining the pH value information, enzyme information and bacteria information of the region of interest; obtaining first index information according to the pH value information, the enzyme information and the bacteria information; determining first characteristic information according to the image category information and the first index information; and obtaining first association factor information according to the image information of the region of interest and the first characteristic information.
In particular, since the result of a diagnostic evaluation for an endoscope may be affected by various factors, in order to ensure the accuracy of the result of the diagnostic evaluation for an endoscope, factors affecting the result of the endoscopic evaluation, such as clinical image category information of a lesion and image exposure area information at the time of an endoscopic examination, are taken into consideration. The image category information comprises clinical diagnosis images of different focuses and a database of pH value information, enzyme information and bacteria information of corresponding parts of a human body so as to meet the diversity of the focuses and the difference of individuals. And determining first index information of the region of interest by detecting and comparing the pH value information, the enzyme information and the bacteria information of the region of interest with the pH value information, the enzyme information and the bacteria information of corresponding parts in a healthy human body, wherein the first index information can be certain enzyme information, bacteria information or body fluid pH value information of the focus. For example, the gastric flora is used to detect whether the patient contains helicobacter pylori, and then the patient is found to have a focus of gastric ulcer. And determining first characteristic information by combining the image category information of the region of interest and the first index information, wherein the first characteristic information is characteristic information of a focus and comprises ulcer information, tumor information, polyp information, cancer information and the like. The first associated factor information is obtained according to the image information of the region of interest and the first characteristic information, the first associated factor information is association degree information of the image information of the region of interest and the first characteristic information, and in a simple manner, the first associated factor information is one of factors for evaluating the quality of a diagnosis result according to the image information of the region of interest, so that the image information of the region of interest can be rapidly matched with the clinical image category information of a focus, and the comprehensive evaluation can be efficiently and rapidly carried out on the endoscope image information.
Step 160: obtaining second correlation factor information according to the image information of the region of interest and the image exposure area information;
further, the obtaining second correlation factor information according to the image information of the region of interest and the image exposure area information includes: determining a first high exposure area and a first low exposure area at the region of interest according to the image exposure area information; and obtaining second correlation factor information according to the image information of the interested area and the first high exposure area and/or the first low exposure area.
Step 170: and obtaining first quality evaluation image information according to the first relevant factor information and the second relevant factor information.
Specifically, since the focus has clinical diversity and individual difference, and may not completely conform to a predetermined evaluation standard, in order to provide sufficient diagnosis information for diagnosis, the quality of the diagnosis result is evaluated according to the correspondence between the first high exposure area and/or the first low exposure area in the image exposure area and the image information of the region of interest by analyzing and comparing the correlation factor information between the image information of the region of interest and the image exposure area information. Wherein, the first high exposure area and the first low exposure area at the focus can be determined through the image exposure area information, for example, the exposure degree of polyps of 0.2-0.9cm, 1cm-2 cm and more than 2cm in the cecum at the colon part is different, and the exposure degree of the spot positions of gastric perforation and gastric hemorrhage is different. The second correlation factor information is correlation degree information between the image information of the region of interest and the first high exposure area and/or the first low exposure area, and in brief, the second correlation factor information is one of the factors for evaluating the quality of the diagnostic result according to the image information of the region of interest, so that a sufficient evaluation basis is provided for evaluating the diagnostic result, and accurate evaluation can be obtained in a short time. According to the first relevant factor information determined by the image information of the region of interest and the image category information and the second relevant factor information determined by the image information of the region of interest and the image exposure area information, the first quality evaluation image information can be obtained by integrating the first relevant factor information and the second relevant factor information, the first quality evaluation image information is evaluation information of a diagnosis result obtained according to the image information of the region of interest, namely, the diagnosis result can be efficiently and accurately evaluated through the first quality evaluation image information. The technical problems that in the prior art, a doctor evaluates according to an image through an endoscope afterwards, timeliness is poor, and errors are large are solved, real-time evaluation of the image is achieved, and the technical effect of conveniently and quickly evaluating endoscope image information is achieved.
Further, the method further comprises: obtaining first shadow information at the region of interest; obtaining first obstacle information at the region of interest; determining a first target area and a surrounding tissue area of the first target area according to the first light and shadow information and the first obstacle information; obtaining a first region area of the first target region; judging whether the area of a first region of the first target region exceeds a first preset threshold value or not; when the area of a first region of the first target region exceeds a first preset threshold value, first early warning information of a surrounding tissue region of the first target region is obtained.
Specifically, when the endoscope shoots an image of a region of interest in the moving process, the deviation of the positioning of the region of interest occurs due to the movement of the endoscope, so that the estimation error of a doctor according to the image through the endoscope is large afterwards, and the estimation of the surrounding tissue region of a focus is not detailed from the overall estimation of the region of interest, which causes inaccurate estimation of the development trend of the focus. In the embodiment of the application, the endoscope is combined with the photoelectric emitter to further obtain first light and shadow information of the region of interest, wherein the first light and shadow information is the light and shadow information of the region of interest obtained by monitoring of the photoelectric emitter, and a light and shadow image of the region of interest can be obtained by combining the endoscope. And then obtaining first obstacle information at the interested area through the combination of the endoscope and the photoelectric transmitter, wherein the first obstacle information comprises information such as tumors, polyps, ulcers and the like. And determining a first target area in the region of interest and a surrounding tissue area of the first target area according to the first light and shadow information and the first obstacle information. That is, the focal region of the lesion, i.e., the expression region of the lesion and the region around the lesion can be determined by the shadow part in the first shadow information and the first obstacle, and the surrounding tissue region of the first target region may not yet express the disease phenomenon, so the region of interest is divided into the first target region and the surrounding tissue region of the first target region, and the regions are evaluated for different lesion expression regions. A first region area of the first target region is obtained according to the image information of the region of interest obtained by the endoscope. And setting a first preset threshold of the area of the first area, wherein the first preset threshold is 2 cm. Whether the area of the first region of the first target region exceeds a first preset threshold value or not is judged, when the area of the first region of the first target region exceeds the first preset threshold value, first early warning information of a surrounding tissue region of the first target region is obtained, namely when the area of a lesion shown in the first target region exceeds the first preset threshold value, if the size of a tumor is large, the first early warning information of the surrounding tissue region of the first target region is judged by combining the characteristics of the tumor, namely, the possibility that the area of the lesion shown in the first target region spreads to the surrounding tissue region exists, and therefore the accuracy of image evaluation of an endoscope is improved.
Further, the determining a first target area and a surrounding tissue area of the first target area according to the first light and shadow information and the first obstacle information includes: obtaining a second area of the first obstacle according to the first light and shadow information and the image information of the region of interest; defining the second region area as the first target region; and obtaining a surrounding tissue area of the first target area according to the second area of the first obstacle.
Further, the method further comprises: obtaining first coordinate system information of the image information of the region of interest; determining first unit vector information according to the first coordinate system information; obtaining second coordinate information of the first light and shadow information; and calculating to obtain a second area of the first obstacle according to the first unit vector information and the second coordinate information.
Specifically, in the determination of the first target region and the peripheral tissue region of the first target region through the first light and shadow information and the first obstacle information, the area of an obstacle in an image is calculated by combining image information of a region of interest, the first target region is determined in a delineating manner, and the peripheral tissue region is determined according to the area of the first target region. By establishing two-dimensional first coordinate system information on the region-of-interest image and determining first unit vector information according to the first coordinate system information, if the first unit vector is 1, the first coordinate system information includes a grid coordinate system with 1 as a unit. The first light and shadow information presents a shadow part in the image of the region of interest, so that second coordinate information of the first light and shadow information is obtained in a first coordinate system of the image of the region of interest, a second area of the first obstacle is obtained by calculation according to first unit vector information set in the first coordinate system and the second coordinate information, and the area of the second area is defined as a first target area, namely, an expression area of a focus is defined as the first target area. And the surrounding tissue area of the first target area is obtained according to the size evaluation of the area of the second area of the first obstacle, so that the accuracy of evaluating the endoscopic image information can be improved.
Example two
Based on the same inventive concept as the method for improving quality assessment based on endoscope screening in the foregoing embodiments, the present invention further provides a device for improving quality assessment based on endoscope screening, as shown in fig. 2, the device includes:
the first obtaining unit is used for obtaining real-time image information of the endoscope;
a first training unit, configured to input real-time image information of the endoscope into a training model, where the training model is obtained by training multiple sets of training data, and each set of training data in the multiple sets includes: real-time image information and a preset evaluation standard of the endoscope;
a second obtaining unit, configured to obtain output information of the training model, where the output information includes region-of-interest image information;
a third obtaining unit, configured to obtain image category information and image exposure area information at the region of interest;
a fourth obtaining unit, configured to obtain first associated factor information according to the region-of-interest image information and the image category information;
a fifth obtaining unit, configured to obtain second correlation factor information according to the image information of the region of interest and the image exposure area information;
a sixth obtaining unit configured to obtain first quality-evaluation image information from the first correlation factor information and the second correlation factor information.
Further, the apparatus comprises:
a seventh obtaining unit configured to obtain a predetermined evaluation criterion;
and the second training unit is used for inputting the preset evaluation standard as supervision data into each group of training data and training the real-time image information of the endoscope.
Further, the apparatus comprises:
an eighth obtaining unit, configured to obtain information on ph, enzyme, and bacteria at the region of interest;
a ninth obtaining unit, configured to obtain first index information according to the ph information, the enzyme information, and the bacteria information;
a first determination unit configured to determine first feature information from the image category information and the first index information;
a tenth obtaining unit, configured to obtain first correlation factor information according to the region of interest image information and the first feature information.
Further, the apparatus comprises:
the second determining unit is used for determining a first high exposure area and a first low exposure area at the region of interest according to the image exposure area information;
an eleventh obtaining unit, configured to obtain second correlation factor information according to the region of interest image information and the first high exposure region and/or the first low exposure region.
Various modifications and specific examples of the method for improving quality assessment based on endoscope screening in the first embodiment of fig. 1 are also applicable to the apparatus for improving quality assessment based on endoscope screening in the present embodiment, and the implementation method of the apparatus for improving quality assessment based on endoscope screening in the present embodiment is clear to those skilled in the art from the foregoing detailed description of the method for improving quality assessment based on endoscope screening, so for the brevity of the description, detailed descriptions are omitted here.
EXAMPLE III
Based on the same inventive concept as the method for improving quality assessment based on endoscope screening in the previous embodiment, the present invention further provides a device for improving quality assessment based on endoscope screening, wherein a computer program is stored thereon, and when the program is executed by a processor, the program realizes the steps of any one of the methods for improving quality assessment based on endoscope screening.
Where in fig. 3 a bus architecture (represented by bus 300), bus 300 may include any number of interconnected buses and bridges, bus 300 linking together various circuits including one or more processors, represented by processor 302, and memory, represented by memory 304. The bus 300 may also link together various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. A bus interface 306 provides an interface between the bus 300 and the receiver 301 and transmitter 303. The receiver 301 and the transmitter 303 may be the same element, i.e., a transceiver, providing a means for communicating with various other apparatus over a transmission medium.
The processor 302 is responsible for managing the bus 300 and general processing, and the memory 304 may be used for storing data used by the processor 302 in performing operations.
Example four
Based on the same inventive concept as the method for improving quality assessment based on endoscopic screening in the previous embodiments, the present invention further provides a computer-readable storage medium having a computer program stored thereon, which when executed by a processor, performs the steps of:
obtaining real-time image information of an endoscope; inputting real-time image information of the endoscope into a training model, wherein the training model is obtained by training a plurality of groups of training data, and each group of training data in the plurality of groups comprises: real-time image information and a preset evaluation standard of the endoscope; obtaining output information of the training model, wherein the output information comprises region-of-interest image information; obtaining image category information and image exposure area information of the region of interest; obtaining first associated factor information according to the image information of the region of interest and the image category information; obtaining second correlation factor information according to the image information of the region of interest and the image exposure area information; and obtaining first quality evaluation image information according to the first relevant factor information and the second relevant factor information.
In a specific implementation, when the program is executed by a processor, any method step in the first embodiment may be further implemented.
One or more technical solutions in the embodiments of the present application have at least one or more of the following technical effects:
the embodiment of the application provides a method and a device for improving quality assessment based on endoscope screening, wherein the method comprises the following steps: obtaining real-time image information of an endoscope; inputting real-time image information of the endoscope into a training model, wherein the training model is obtained by training a plurality of groups of training data, and each group of training data in the plurality of groups comprises: real-time image information and a preset evaluation standard of the endoscope; obtaining output information of the training model, wherein the output information comprises region-of-interest image information; obtaining image category information and image exposure area information of the region of interest; obtaining first associated factor information according to the image information of the region of interest and the image category information; obtaining second correlation factor information according to the image information of the region of interest and the image exposure area information; and obtaining first quality evaluation image information according to the first relevant factor information and the second relevant factor information. The technical problems that in the prior art, a doctor evaluates according to an image through an endoscope afterwards, timeliness is poor, and errors are large are solved, the image information of an interested region, the image category information and the image exposure region information are integrated, real-time evaluation of the image is achieved, and the technical effect of conveniently and quickly evaluating the image information of the endoscope is achieved.
As will be appreciated by one skilled in the art, embodiments of the present invention may be provided as a method, system, or computer program product. Accordingly, the present invention may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.
The present invention is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart flow or flows and/or block diagram block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart flow or flows and/or block diagram block or blocks.
It will be apparent to those skilled in the art that various changes and modifications may be made in the present invention without departing from the spirit and scope of the invention. Thus, if such modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include such modifications and variations.

Claims (10)

1. A method for improving quality assessment based on endoscopic screening, the method comprising:
obtaining real-time image information of an endoscope;
inputting real-time image information of the endoscope into a training model, wherein the training model is obtained by training a plurality of groups of training data, and each group of training data in the plurality of groups comprises: real-time image information and a preset evaluation standard of the endoscope;
obtaining output information of the training model, wherein the output information comprises region-of-interest image information;
obtaining image category information and image exposure area information of the region of interest;
obtaining first associated factor information according to the image information of the region of interest and the image category information;
obtaining second correlation factor information according to the image information of the region of interest and the image exposure area information;
and obtaining first quality evaluation image information according to the first relevant factor information and the second relevant factor information.
2. The method of claim 1, wherein the inputting of the real-time image information of the endoscope into a training model, wherein the training model is obtained by training a plurality of sets of training data, each set of training data in the plurality of sets comprising: the real-time image information and the preset evaluation standard of the endoscope comprise:
obtaining a predetermined evaluation criterion;
and inputting the preset evaluation standard as supervision data into each group of training data to train the real-time image information of the endoscope.
3. The method of claim 1, wherein the obtaining first correlation factor information from the region of interest image information and the image category information comprises:
obtaining the pH value information, enzyme information and bacteria information of the region of interest;
obtaining first index information according to the pH value information, the enzyme information and the bacteria information;
determining first characteristic information according to the image category information and the first index information;
and obtaining first association factor information according to the image information of the region of interest and the first characteristic information.
4. The method of claim 1, wherein the obtaining second correlation factor information from the region-of-interest image information and the image exposure area information comprises:
determining a first high exposure area and a first low exposure area at the region of interest according to the image exposure area information;
and obtaining second correlation factor information according to the image information of the interested area and the first high exposure area and/or the first low exposure area.
5. An apparatus for improving quality assessment based on endoscopic screening, the apparatus comprising:
the first obtaining unit is used for obtaining real-time image information of the endoscope;
a first training unit, configured to input real-time image information of the endoscope into a training model, where the training model is obtained by training multiple sets of training data, and each set of training data in the multiple sets includes: real-time image information and a preset evaluation standard of the endoscope;
a second obtaining unit, configured to obtain output information of the training model, where the output information includes region-of-interest image information;
a third obtaining unit, configured to obtain image category information and image exposure area information at the region of interest;
a fourth obtaining unit, configured to obtain first associated factor information according to the region-of-interest image information and the image category information;
a fifth obtaining unit, configured to obtain second correlation factor information according to the image information of the region of interest and the image exposure area information;
a sixth obtaining unit configured to obtain first quality-evaluation image information from the first correlation factor information and the second correlation factor information.
6. The apparatus of claim 5, wherein the apparatus comprises:
a seventh obtaining unit configured to obtain a predetermined evaluation criterion;
and the second training unit is used for inputting the preset evaluation standard as supervision data into each group of training data and training the real-time image information of the endoscope.
7. The apparatus of claim 5, wherein the apparatus comprises:
an eighth obtaining unit, configured to obtain information on ph, enzyme, and bacteria at the region of interest;
a ninth obtaining unit, configured to obtain first index information according to the ph information, the enzyme information, and the bacteria information;
a first determination unit configured to determine first feature information from the image category information and the first index information;
a tenth obtaining unit, configured to obtain first correlation factor information according to the region of interest image information and the first feature information.
8. The apparatus of claim 5, wherein the apparatus comprises:
the second determining unit is used for determining a first high exposure area and a first low exposure area at the region of interest according to the image exposure area information;
an eleventh obtaining unit, configured to obtain second correlation factor information according to the region of interest image information and the first high exposure region and/or the first low exposure region.
9. An apparatus for improving quality assessment based on endoscopic screening, comprising a memory, a processor and a computer program stored on the memory and executable on the processor, wherein the processor when executing the program implements the steps of:
obtaining real-time image information of an endoscope;
inputting real-time image information of the endoscope into a training model, wherein the training model is obtained by training a plurality of groups of training data, and each group of training data in the plurality of groups comprises: real-time image information and a preset evaluation standard of the endoscope;
obtaining output information of the training model, wherein the output information comprises region-of-interest image information;
obtaining image category information and image exposure area information of the region of interest;
obtaining first associated factor information according to the image information of the region of interest and the image category information;
obtaining second correlation factor information according to the image information of the region of interest and the image exposure area information;
and obtaining first quality evaluation image information according to the first relevant factor information and the second relevant factor information.
10. A computer-readable storage medium, on which a computer program is stored, which program, when executed by a processor, carries out the steps of:
obtaining real-time image information of an endoscope;
inputting real-time image information of the endoscope into a training model, wherein the training model is obtained by training a plurality of groups of training data, and each group of training data in the plurality of groups comprises: real-time image information and a preset evaluation standard of the endoscope;
obtaining output information of the training model, wherein the output information comprises region-of-interest image information;
obtaining image category information and image exposure area information of the region of interest;
obtaining first associated factor information according to the image information of the region of interest and the image category information;
obtaining second correlation factor information according to the image information of the region of interest and the image exposure area information;
and obtaining first quality evaluation image information according to the first relevant factor information and the second relevant factor information.
CN202010645905.XA 2020-07-07 2020-07-07 Method and device for improving quality assessment based on endoscope screening Pending CN111767963A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010645905.XA CN111767963A (en) 2020-07-07 2020-07-07 Method and device for improving quality assessment based on endoscope screening

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010645905.XA CN111767963A (en) 2020-07-07 2020-07-07 Method and device for improving quality assessment based on endoscope screening

Publications (1)

Publication Number Publication Date
CN111767963A true CN111767963A (en) 2020-10-13

Family

ID=72724093

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010645905.XA Pending CN111767963A (en) 2020-07-07 2020-07-07 Method and device for improving quality assessment based on endoscope screening

Country Status (1)

Country Link
CN (1) CN111767963A (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112263376A (en) * 2020-10-27 2021-01-26 南通市第一人民医院 Intelligent management method and system for patient stoma
CN112401846A (en) * 2020-11-20 2021-02-26 南通市第二人民医院 Nursing system and method for mucosa in oral cavity
CN112927803A (en) * 2021-01-30 2021-06-08 西安交通大学医学院第一附属医院 Consciousness assessment method and system for cerebrovascular patient
CN112991333A (en) * 2021-04-21 2021-06-18 强基(上海)医疗器械有限公司 Image processing method and system based on voice analysis in endoscopic surgery
CN113076636A (en) * 2021-03-29 2021-07-06 南京贝迪新材料科技股份有限公司 Evaluation method and system for cutting quality of optical film
CN113284616A (en) * 2021-03-08 2021-08-20 陕西省肿瘤医院 Method and system for evaluating body of oncology patient before chemotherapy
CN113873196A (en) * 2021-03-08 2021-12-31 南通市第一人民医院 Method and system for improving infection prevention and control management quality
CN114049934A (en) * 2021-11-10 2022-02-15 富士胶片(中国)投资有限公司 Auxiliary diagnosis method, device, system, equipment and medium

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109146884A (en) * 2018-11-16 2019-01-04 青岛美迪康数字工程有限公司 Endoscopy monitoring method and device
CN109247914A (en) * 2018-08-29 2019-01-22 百度在线网络技术(北京)有限公司 Illness data capture method and device
CN111292328A (en) * 2020-05-09 2020-06-16 上海孚慈医疗科技有限公司 Image information processing method and device based on endoscope screening

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109247914A (en) * 2018-08-29 2019-01-22 百度在线网络技术(北京)有限公司 Illness data capture method and device
CN109146884A (en) * 2018-11-16 2019-01-04 青岛美迪康数字工程有限公司 Endoscopy monitoring method and device
CN111292328A (en) * 2020-05-09 2020-06-16 上海孚慈医疗科技有限公司 Image information processing method and device based on endoscope screening

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112263376A (en) * 2020-10-27 2021-01-26 南通市第一人民医院 Intelligent management method and system for patient stoma
CN112401846A (en) * 2020-11-20 2021-02-26 南通市第二人民医院 Nursing system and method for mucosa in oral cavity
CN112401846B (en) * 2020-11-20 2021-09-21 南通市第二人民医院 Nursing system and method for mucosa in oral cavity
CN112927803A (en) * 2021-01-30 2021-06-08 西安交通大学医学院第一附属医院 Consciousness assessment method and system for cerebrovascular patient
CN113284616A (en) * 2021-03-08 2021-08-20 陕西省肿瘤医院 Method and system for evaluating body of oncology patient before chemotherapy
CN113873196A (en) * 2021-03-08 2021-12-31 南通市第一人民医院 Method and system for improving infection prevention and control management quality
CN113076636A (en) * 2021-03-29 2021-07-06 南京贝迪新材料科技股份有限公司 Evaluation method and system for cutting quality of optical film
CN113076636B (en) * 2021-03-29 2022-03-11 南京贝迪新材料科技股份有限公司 Evaluation method and system for cutting quality of optical film
CN112991333A (en) * 2021-04-21 2021-06-18 强基(上海)医疗器械有限公司 Image processing method and system based on voice analysis in endoscopic surgery
CN112991333B (en) * 2021-04-21 2021-08-10 强基(上海)医疗器械有限公司 Image processing method and system based on voice analysis in endoscopic surgery
CN114049934A (en) * 2021-11-10 2022-02-15 富士胶片(中国)投资有限公司 Auxiliary diagnosis method, device, system, equipment and medium

Similar Documents

Publication Publication Date Title
CN111767963A (en) Method and device for improving quality assessment based on endoscope screening
CN111292328B (en) Image information processing method and device based on endoscope screening
CN110600122B (en) Digestive tract image processing method and device and medical system
JP6657480B2 (en) Image diagnosis support apparatus, operation method of image diagnosis support apparatus, and image diagnosis support program
CN111278348A (en) Diagnosis support method, diagnosis support system, diagnosis support program, and computer-readable recording medium storing diagnosis support program for disease based on endoscopic image of digestive organ
WO2021054477A2 (en) Disease diagnostic support method using endoscopic image of digestive system, diagnostic support system, diagnostic support program, and computer-readable recording medium having said diagnostic support program stored therein
CN111403029B (en) Information processing method and device for improving evaluation quality
Ali et al. Endoscopy disease detection challenge 2020
Kodogiannis et al. A neuro-fuzzy-based system for detecting abnormal patterns in wireless-capsule endoscopic images
CN113112449A (en) Intestinal cancer auxiliary diagnosis model construction and auxiliary diagnosis method and system
Lei et al. Automated detection of retinopathy of prematurity by deep attention network
Miwa et al. Application of artificial intelligence using a convolutional neural network for detecting cholesteatoma in endoscopic enhanced images
Kodogiannis et al. The usage of soft-computing methodologies in interpreting capsule endoscopy
Alam et al. SR-AttNet: An interpretable stretch–relax attention based deep neural network for polyp segmentation in colonoscopy images
KR20210016171A (en) The method of providing disease information using medical image
Vania et al. Recent advances in applying machine learning and deep learning to detect upper gastrointestinal tract lesions
Mascarenhas et al. Deep learning and minimally invasive endoscopy: Automatic classification of pleomorphic gastric lesions in capsule endoscopy
Li et al. Computer-aided Diagnosis (CAD) for cervical cancer screening and diagnosis: a new system design in medical image processing
Kusuma et al. A hybrid model for skin disease classification using transfer learning
Hui et al. Machine learning for tongue diagnosis
Gatoula et al. Enhanced CNN-based gaze estimation on wireless capsule endoscopy images
Musha et al. Deep Learning-Based Comparative Study to Detect Polyp Removal in Endoscopic Images
CN112426119B (en) Endoscope screening processing method and device
Kodogiannis et al. Neural network-based approach for the classification of wireless-capsule endoscopic images
US20230320562A1 (en) Estimating the adequacy of a procedure

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20201013

RJ01 Rejection of invention patent application after publication