CN107610081B - Endoscope signal processing method and system - Google Patents
Endoscope signal processing method and system Download PDFInfo
- Publication number
- CN107610081B CN107610081B CN201710822093.XA CN201710822093A CN107610081B CN 107610081 B CN107610081 B CN 107610081B CN 201710822093 A CN201710822093 A CN 201710822093A CN 107610081 B CN107610081 B CN 107610081B
- Authority
- CN
- China
- Prior art keywords
- image
- main
- module
- images
- main image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Abstract
The invention relates to an endoscope signal processing method and system, which are characterized in that whether foreign matters exist on a lens is judged firstly, if foreign matters exist, a picture corresponding to the foreign matters of a main image in a picture group is captured and spliced with the main image, the spliced goodness of fit is detected, and a synthesized main image with the highest goodness of fit is selected as an output image. The method can reduce the influence of foreign matters on the lens on the endoscope picture, so that medical staff can obtain a more clear and comprehensive picture, and the diagnosis and treatment are facilitated.
Description
Technical Field
The invention relates to the technical field of endoscopes, in particular to an endoscope signal processing method and system.
Background
In recent years, surgical operations using endoscopes, such as laparoscopic operations and thoracoscopic operations, have been receiving attention. Endoscopic surgery is advantageous in that it does not require laparotomy, thoracotomy, or the like, and only two or three holes having a diameter of several centimeters need to be made for inserting an endoscope and a surgical tool, thus significantly reducing the burden imposed on the patient. However, it is highly difficult to perform a surgical operation with a very limited field of view of the endoscope, and a foreign object in a patient inevitably sticks to a lens of the endoscope, and sometimes, a foreign object cannot be washed away by a washing system of the endoscope, so that an originally narrow sight line becomes more blurred, and the judgment of a doctor is affected.
Disclosure of Invention
In order to overcome the above disadvantages, the present invention provides an endoscope signal processing method.
The technical scheme adopted by the invention is as follows: comprises the following steps: 1. image generation that generates a plurality of images by time-series imaging of an object; 2. determining a main image and a sub image, selecting one image as a main image according to a static image generation instruction, and using a plurality of images as a sub image group; 3. extracting contours, namely extracting contour components from the main image and the auxiliary image; 4. judging foreign matters on the lens, judging whether foreign matters exist on the lens according to the relative position of the contour components in the image, if so, executing step 5, if not, determining the main image as a final image and executing step 9; 5. selecting and recording the peripheral characteristics of the main image foreign matter; 6. extracting images at the corresponding positions of the secondary image group, determining the corresponding positions of the parts, which are shielded by the foreign matters, on the primary image on the secondary image group according to the peripheral characteristics of the foreign matters of the primary image, and extracting the images at the corresponding positions; 7. synthesizing the images at the corresponding positions with the main images, splicing the images at the corresponding positions to foreign matters of the main images, and generating a plurality of synthesized main images; 8. judging the texture of the synthesized main image, detecting the goodness of fit of the synthesized position of the main image, and selecting one of a plurality of synthesized main images with the highest goodness of fit as a final image; 9. and storing and outputting the final image, and storing a plurality of combined main images, main images and sub image groups.
The present invention also provides an endoscope signal processing system comprising:
an image generation module that generates a plurality of images by time-series imaging of an object;
the main and auxiliary image determining module selects one image as a main image according to the static image generation instruction, and a plurality of images as an auxiliary image group;
a contour extraction module for extracting contour components from the main image and the sub-image;
the foreign matter judging module is used for judging whether foreign matters exist on the lens according to the relative positions of the contour components in the image, if so, the main image foreign matter surrounding characteristic selecting module is activated, and if not, the main image is determined to be a final image and the storage output module is activated;
the main image foreign matter surrounding characteristic selecting module selects and records the characteristics of the main image foreign matter surrounding;
the image extraction module at the corresponding position of the secondary image group determines the corresponding position of the part of the primary image, which is blocked by the foreign matter, on the secondary image group according to the peripheral characteristics of the foreign matter of the primary image, and extracts the image at the corresponding position;
the composite main image module splices the images at the corresponding positions to the foreign matters of the main image to generate a plurality of composite main images;
the texture judging module is used for detecting the goodness of fit of the combined position of the main images and selecting one image with the highest goodness of fit in a plurality of combined main images as a final image;
and a storage output module for storing and outputting the final image and storing the plurality of synthesized main images, the main image and the sub image group.
The invention has the following effects: the endoscope signal processing method and the endoscope signal processing system can reduce the influence of foreign matters on the lens on the endoscope picture, so that medical staff can obtain a more clear and comprehensive picture, and the diagnosis and treatment are facilitated.
Drawings
FIG. 1 is a flow chart of a method for processing endoscope signals according to the present invention;
FIG. 2 is a block diagram of an endoscope signal processing system according to the present invention;
FIG. 3 is a block diagram of the primary and secondary image determination modules of FIG. 2;
FIG. 4 is a block diagram of a foreign object determination module shown in FIG. 2;
FIG. 5 is a block diagram of an image extraction module corresponding to the sub-image group shown in FIG. 2;
FIG. 6 is a block diagram of the texture decision module shown in FIG. 2;
in the figure: the endoscope image processing system comprises a 1-endoscope signal processing system, 11-an image generating module, 12-a main and auxiliary image determining module, 121-an instruction receiving module, 122-a main image selecting module, 123-an auxiliary image selecting module, 13-a contour extracting module, 14-a foreign matter judging module, 141-a contour shape comparing module, 142-a contour position comparing module, 15-a main image foreign matter surrounding characteristic selecting module, 16-an auxiliary image group corresponding image extracting module, 161-a comparing characteristic module, 162-an image intercepting module, 17-a synthesized main image module, 18-a texture distinguishing module, 181-a contour re-extracting module, 182-an expansion processing module, 183-an goodness of fit detecting module, 184-a goodness of fit comparing module and 19-a storage output module.
Detailed Description
The invention provides an endoscope signal processing method which is described by combining the accompanying drawings as follows:
referring to fig. 1, an endoscope signal processing method provided by the present invention includes the following steps:
s1, image generation, a plurality of images generated by time-series image capture of an object;
s2, determining a main image and a sub image, selecting one image as a main image and a plurality of images as a sub image group according to the static image generation instruction;
s3, extracting the contour, namely extracting contour components from the main image and the auxiliary image;
s4, judging foreign matters on the lens, judging whether foreign matters exist on the lens according to the relative position of the contour components in the image, if so, executing step S5, if not, determining the main image as a final image and executing step S9;
s5, selecting the peripheral characteristics of the main image foreign matter, and selecting and recording the peripheral characteristics of the main image foreign matter;
s6, extracting the image corresponding to the sub-image group, determining the corresponding position of the part of the main image blocked by the foreign matter on the sub-image group according to the peripheral characteristics of the foreign matter of the main image, and extracting the image at the corresponding position;
s7, synthesizing the images at the corresponding positions with the main image, splicing the images at the corresponding positions to the foreign matters of the main image, and generating a plurality of synthesized main images;
s8, judging the texture of the synthesized main image, detecting the goodness of fit of the synthesized main image, and selecting one of the multiple synthesized main images with the highest goodness of fit as a final image;
and S9, storing and outputting the final image, and storing a plurality of combined main images, main images and sub image groups.
In the endoscope signal processing method according to the present invention, the step of determining the primary and secondary images in step S2 includes:
s21, receiving a static image generation instruction;
s22, receiving the last frame image before the static image generation instruction as the main image;
and S23, taking a plurality of frame images before the last frame image as a secondary image group.
In the endoscope signal processing method according to the present invention, the step of determining a foreign substance on the lens in step S4 includes:
s41, comparing the shape of each contour component of the main image with that of each contour component in the sub image group, and if the shape of the contour component of the main image is the same as that of the contour component in the sub image group, judging that the contour components are the same;
s42, measuring and comparing the lengths of the same contour component from the edge of the main image and the sub-image group in the main image and the sub-image group, and if the lengths of the same contour component from the edge of the main image and the sub-image group in the main image and the sub-image group are equal, determining that the same contour component is a foreign object.
In the endoscope signal processing method according to the present invention, the step of extracting the image corresponding to the sub-image group in step S6 includes:
s61, searching an image area with the peripheral characteristics of the main image foreign matter on the secondary image group;
and S62, intercepting the image area.
In the endoscope signal processing method according to the present invention, the step of discriminating the texture of the synthesized main image in step S8 includes:
s81, re-extracting contour components at the composite splicing position of the composite main image;
s82, performing expansion processing on the contour components at the splicing position of the synthesized main image to generate an expanded synthesized main image;
s83, detecting the goodness of fit of lines at the splicing part of the expanded composite main image;
and S84, comparing the goodness of fit of the multiple expanded composite main images, and selecting the composite main image with the highest goodness of fit as a final image.
Referring to fig. 2, the present invention further provides an endoscope signal processing system 1, comprising:
an image generation module 11 that generates a plurality of images by time-series imaging of an object;
the main and auxiliary image determining module 12 selects one image as a main image and a plurality of images as an auxiliary image group according to the static image generation instruction;
a contour extraction module 13 for extracting contour components from the main image and the sub-image;
the foreign matter judging module 14 is used for judging whether foreign matters exist on the lens according to the relative positions of the contour components in the image, if so, activating the main image foreign matter surrounding characteristic selecting module, and if not, determining the main image as a final image and activating the storage output module;
a main image foreign matter surrounding feature selection module 15 for selecting and recording features around the main image foreign matter;
the image extraction module 16 at the corresponding position of the secondary image group determines the corresponding position of the part of the primary image blocked by the foreign matter on the secondary image group according to the peripheral features of the foreign matter of the primary image, and extracts the image at the corresponding position;
the composite main image module 17 splices the images at the corresponding positions to the foreign matters of the main image to generate a plurality of composite main images;
the texture judging module 18 is used for detecting the goodness of fit of the combined position of the main images and selecting one image with the highest goodness of fit in a plurality of combined main images as a final image;
and a storage output module 19 that stores and outputs the final image, and stores the plurality of combined main images, the main image, and the sub-image group.
Referring to fig. 3, in an endoscope signal processing system 1 according to the present invention, a primary-secondary image determining module 12 includes:
an instruction receiving module 121 that receives a still image generation instruction;
a main image selecting module 122 for selecting the last frame image before receiving the still image generation instruction as the main image;
the sub-image selecting module 123 selects a plurality of frames of images before the last frame of image as a sub-image group.
Referring to fig. 4, in the endoscope signal processing system 1 according to the present invention, the foreign object determination module 14 includes:
the contour shape comparison module 141 compares the shape of each contour component of the main image with that of each contour component in the sub-image group, and determines that the contour components are the same if the contour components of the main image have the same shape as the contour components in the sub-image group;
the contour position comparing module 142 measures and compares the lengths of the same contour component from the edges of the main image and the sub-image group in the main image and the sub-image group, and determines that the same contour component is a foreign object if the lengths of the same contour component from the edges of the main image and the sub-image group in the main image and the sub-image group are equal.
Referring to fig. 5, in the endoscope signal processing system 1 according to the present invention, the image extracting module 16 at the position corresponding to the sub image group includes:
a comparison feature module 161 for searching an image region having the peripheral features of the main image foreign matter on the sub image group;
and an image intercepting module 162 intercepting the image area.
Referring to fig. 6, in the endoscope signal processing system 1 according to the present invention, the texture determining module 18 includes:
the contour re-extraction module 181 is used for re-extracting contour components at the synthesized and spliced position of the synthesized main image;
an expansion processing module 182 for performing expansion processing on the contour component at the splicing position of the synthesized main image to generate an expanded synthesized main image;
the goodness of fit detection module 183 is used for detecting the goodness of fit of lines at the splicing part of the expanded synthesized main image;
the goodness of fit comparison module 184 compares the goodness of fit of the multiple expanded composite main images, and selects one composite main image with the highest goodness of fit as a final image.
The endoscope signal processing method and the endoscope signal processing system firstly judge whether foreign matters exist on a lens or not, if the foreign matters exist, then a picture corresponding to the foreign matters of a main image on a frame image group is captured and spliced with the main image, the spliced goodness of fit is detected, and a synthesized main image with the highest goodness of fit is selected as an output image. The endoscope signal processing method and the endoscope signal processing system can reduce the influence of foreign matters on the lens on the endoscope picture, so that medical staff can obtain a more clear and comprehensive picture, and the diagnosis and treatment are facilitated.
The above description is only for the purpose of illustrating the preferred embodiments of the present invention and is not to be construed as limiting the invention, and any modifications, equivalents, improvements and the like that fall within the spirit and principle of the present invention are intended to be included therein.
Claims (6)
1. An endoscope signal processing method comprising the steps of:
s1, image generation, a plurality of images generated by time-series image capture of an object;
s2, determining a main image and a sub image, selecting one image as a main image and a plurality of images as a sub image group according to the static image generation instruction;
s3, extracting contour components from the main image and the sub-image;
s4, judging foreign matters on the lens, judging whether foreign matters exist on the lens according to the relative position of the contour components in the image, if so, executing step S5, if not, determining the main image as a final image and executing step S9;
s5, selecting the peripheral characteristics of the main image foreign matter, and selecting and recording the peripheral characteristics of the main image foreign matter;
s6, extracting images corresponding to the sub-image group, determining the corresponding position of the part of the main image blocked by the foreign matter on the sub-image group according to the peripheral features of the foreign matter of the main image, and extracting the images at the corresponding position;
s7, synthesizing the corresponding images and the main images, splicing the images at the corresponding positions to the foreign matters of the main images, and generating a plurality of synthesized main images;
s8, judging the texture of the synthesized main image, detecting the coincidence degree of the synthesized position of the main image, and selecting one of the synthesized main images with the highest coincidence degree as a final image;
s9, storing and outputting the final image, and storing the multiple synthesized main images, the main images and the sub image groups;
the step of judging the foreign substance on the lens in step S4 includes:
s41, comparing the shape of each contour component of the main image with that of each contour component in the sub image group, and if the shape of the contour component of the main image is the same as that of the contour component in the sub image group, judging that the contour components are the same;
s42, measuring and comparing the lengths of the same contour components from the edges of the main image and the sub-image group on the main image and the sub-image group, if the lengths of the same contour components from the edges of the main image and the sub-image group on the main image and the sub-image group are equal, judging that the same contour components are foreign matters;
the step of discriminating the texture of the synthesized main image in step S8 includes:
s81, re-extracting contour components at the composite splicing position of the composite main image;
s82, performing expansion processing on the contour components at the splicing position of the synthesized main image to generate an expanded synthesized main image;
s83, detecting the goodness of fit of lines at the splicing part of the expanded composite main image;
and S84, comparing the goodness of fit of the multiple expanded composite main images, and selecting the composite main image with the highest goodness of fit as a final image.
2. The endoscope signal processing method according to claim 1, wherein the step of determining the primary and secondary images in step S2 includes:
s21, receiving a static image generation instruction;
s22, receiving the last frame image before the static image generation instruction as the main image;
and S23, taking a plurality of frame images before the last frame image as a secondary image group.
3. The endoscope signal processing method according to claim 2, wherein said step S6 of extracting the image corresponding to the sub-image group comprises:
s61, searching an image area with the peripheral characteristics of the main image foreign matter on the secondary image group;
and S62, intercepting the image area.
4. An endoscope signal processing system, comprising:
an image generation module that generates a plurality of images by time-series imaging of an object;
the main and auxiliary image determining module selects one image as a main image according to the static image generation instruction, and a plurality of images as an auxiliary image group;
a contour extraction module for extracting contour components from the main image and the sub-image;
the foreign matter judging module is used for judging whether foreign matters exist on the lens according to the relative positions of the contour components in the image, if so, the main image foreign matter surrounding characteristic selecting module is activated, and if not, the main image is determined to be a final image and the storage output module is activated;
the main image foreign matter surrounding characteristic selecting module selects and records the characteristics of the main image foreign matter surrounding;
the image extraction module at the corresponding position of the secondary image group determines the corresponding position of the part of the primary image, which is blocked by the foreign matter, on the secondary image group according to the peripheral characteristics of the foreign matter of the primary image, and extracts the image at the corresponding position;
the composite main image module splices the images at the corresponding positions to the foreign matters of the main image to generate a plurality of composite main images;
the texture judging module is used for detecting the goodness of fit of the combined position of the main images and selecting one image with the highest goodness of fit in a plurality of combined main images as a final image;
a storage output module for storing and outputting the final image, and storing the plurality of synthesized main images, the main image, and the sub-image group;
the foreign matter determination module includes:
the contour shape comparison module is used for comparing the shape of each contour component of the main image with that of each contour component in the sub image group, and if the contour component of the main image is the same as the contour component in the sub image group, the main image is judged to be the same contour component;
the outline position comparison module is used for measuring and comparing the lengths of the same outline components from the edges of the main image and the sub-image group on the main image and the sub-image group, and if the lengths of the same outline components from the edges of the main image and the sub-image group on the main image and the sub-image group are equal, the same outline components are judged to be foreign matters;
the texture discriminating module includes:
the contour re-extraction module re-extracts contour components at the synthesized and spliced part of the synthesized main image;
the expansion processing module is used for performing expansion processing on the contour components at the splicing position of the synthesized main image to generate an expanded synthesized main image;
the goodness of fit detection module is used for detecting the goodness of fit of lines at the splicing part of the expanded synthesized main image;
and the goodness of fit contrast module is used for comparing the goodness of fit of the multiple expanded synthesized main images and selecting one synthesized main image with the highest goodness of fit as a final image.
5. The endoscopic signal processing system of claim 4 wherein said primary and secondary image determination module comprises:
an instruction receiving module which receives a static image generation instruction;
a main image selection module for selecting the last frame image before receiving the static image generation instruction as the main image;
and the secondary image selection module selects a plurality of frames of images before the last frame of image as a secondary image group.
6. The endoscopic signal processing system as defined in claim 4, wherein said sub image group corresponding image extracting module comprises:
the comparison characteristic module is used for searching an image area with the peripheral characteristics of the foreign matters of the main image on the auxiliary image group;
and the image intercepting module intercepts the image area.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710822093.XA CN107610081B (en) | 2017-09-13 | 2017-09-13 | Endoscope signal processing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710822093.XA CN107610081B (en) | 2017-09-13 | 2017-09-13 | Endoscope signal processing method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107610081A CN107610081A (en) | 2018-01-19 |
| CN107610081B true CN107610081B (en) | 2020-10-27 |
Family
ID=61063615
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710822093.XA Active CN107610081B (en) | 2017-09-13 | 2017-09-13 | Endoscope signal processing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107610081B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080068454A1 (en) * | 2005-04-18 | 2008-03-20 | Olympus Medical Systems Corp. | Image display apparatus |
| US20170155804A1 (en) * | 2014-07-07 | 2017-06-01 | Sony Corporation | Image processing apparatus, image processing method, program, and endoscope system |
| CN107133941A (en) * | 2017-04-18 | 2017-09-05 | 重庆金山医疗器械有限公司 | A kind of Wireless capsule endoscope image protrudes the display methods of blood vessel very change and boss |
-
2017
- 2017-09-13 CN CN201710822093.XA patent/CN107610081B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080068454A1 (en) * | 2005-04-18 | 2008-03-20 | Olympus Medical Systems Corp. | Image display apparatus |
| US20170155804A1 (en) * | 2014-07-07 | 2017-06-01 | Sony Corporation | Image processing apparatus, image processing method, program, and endoscope system |
| CN107133941A (en) * | 2017-04-18 | 2017-09-05 | 重庆金山医疗器械有限公司 | A kind of Wireless capsule endoscope image protrudes the display methods of blood vessel very change and boss |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107610081A (en) | 2018-01-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11642004B2 (en) | Image processing device, image processing method and recording medium | |
| JP5080944B2 (en) | Panorama fundus image synthesis apparatus and method | |
| JP4537104B2 (en) | Marker detection method, marker detection device, position and orientation estimation method, and mixed reality space presentation method | |
| JP6600356B2 (en) | Image processing apparatus, endoscope apparatus, and program | |
| US20180108138A1 (en) | Method and system for semantic segmentation in laparoscopic and endoscopic 2d/2.5d image data | |
| SA516371399B1 (en) | Wide Field Retinal Image Capture System and Method | |
| JP6020950B1 (en) | Endoscope system, operation method of endoscope system, and program | |
| US11141050B2 (en) | Autofocus control device, endoscope apparatus, and operation method of autofocus control device | |
| JP2019092076A (en) | Image processing system, image processing method, and program | |
| US20180342079A1 (en) | Image processing apparatus, image processing method, and computer readable recording medium | |
| JP2014153890A5 (en) | ||
| US20130016198A1 (en) | Image processing device, endoscope apparatus, information storage device, and image processing method | |
| CN105009581B (en) | Stereoscopic endoscope system | |
| EP2916286A1 (en) | Camera calibration method and apparatus using a color-coded structure | |
| JP5134287B2 (en) | Medical image display device, medical image display method, program, storage medium, and mammography device | |
| Tchoulack et al. | A video stream processor for real-time detection and correction of specular reflections in endoscopic images | |
| CN107610081B (en) | Endoscope signal processing method and system | |
| CN112971688A (en) | Image processing method and device and computer equipment | |
| JP2002042109A (en) | Medical image synthetic processor, method, and storage medium | |
| CN108510497B (en) | Method and device for displaying focus information of retina image | |
| CN113887545B (en) | Laparoscopic surgical instrument identification method and device based on target detection model | |
| JPWO2018158817A1 (en) | Image diagnostic apparatus, image diagnostic method, and program | |
| CN108510446A (en) | The stacking method of retinal images and the stacking apparatus of retinal images | |
| JP6942892B2 (en) | Endoscope device, operation method and program of the endoscope device | |
| JPH10146330A (en) | X-ray stereoscopic image display device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |