CN107610081A - A kind of endoscope signal processing method and system - Google Patents
A kind of endoscope signal processing method and system Download PDFInfo
- Publication number
- CN107610081A CN107610081A CN201710822093.XA CN201710822093A CN107610081A CN 107610081 A CN107610081 A CN 107610081A CN 201710822093 A CN201710822093 A CN 201710822093A CN 107610081 A CN107610081 A CN 107610081A
- Authority
- CN
- China
- Prior art keywords
- image
- master image
- master
- sub
- foreign matter
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The present invention relates to a kind of endoscope signal processing method and system, first judge whether there is foreign matter on camera lens, if there is foreign matter to intercept picture corresponding with master image foreign matter in width image sets again and splice with master image, the spliced goodness of fit is detected, goodness of fit highest is chosen and synthesizes master image as output image.This method can reduce influence of the foreign matter to endoscope picture on camera lens, medical worker is obtained relatively sharp comprehensive picture, contribute to the progress of diagnosis and treatment.
Description
Technical field
The present invention relates to endoscopic technique field, specifically a kind of endoscope signal processing method and system.
Background technology
In recent years, it is constantly subjected to pay close attention to using the surgical operation such as laparoscopic surgery and thoracoscopic operation of endoscope.It is interior
Sight glass surgical operation is favourable, because it does not need laparotomy, throacotomy etc., and only needs to make for inserting endoscope
With two or three a diameter of several centimeters of Surigical tool of hole, therefore significantly mitigate and be applied to burden on patient.However, with
It is great difficulty that the pole Limited eyeshot of endoscope, which carries out surgical operation, and the foreign matter of patient's body can be adhered to inevitably
On the camera lens of endoscope, sometimes, the rinse-system of endoscope occurs that the situation of foreign matter can't is washed off in punching again, causes originally just very narrow
Small sight becomes more fuzzy, can influence the judgement of doctor.
The content of the invention
In order to overcome disadvantages mentioned above, the present invention provides a kind of endoscope signal processing method.
The technical solution adopted by the present invention is：Include following step：1st, image generates, and passes through the time series of subject
Shooting and the multiple images that generate；2nd, major-minor image determines, generating instruction according to still image chooses an image as master
Image, multiple images are as sub-picture group；3rd, contours extract, profile composition is extracted from master image and sub-picture；4th, on camera lens
Foreign matter judges, judges whether there is foreign matter on camera lens according to the relative position of profile composition in the picture, if there is foreign matter, performs step
5, if foreign, assert that master image is final image and performs step 9；5th, master image foreign matter surrounding features are chosen, and choose and remember
Record the feature around master image foreign matter；6th, sub-picture group corresponding position image zooming-out, determine to lead according to master image foreign matter surrounding features
Correspondence position on image by the part that foreign matter blocks in sub-picture group, and extract the image of the correspondence position；7th, corresponding position
The image put synthesizes with master image, at the foreign matter of the image mosaic of correspondence position to master image, generates multiple synthesis master images；
8th, synthesize master image texture discrimination, detect master image synthesis at the goodness of fit, and choose multiple synthesis master images in the goodness of fit most
High one is used as final image；9th, preserve and export final image, preserve multiple synthesis master image, master image and sub-pictures
Group.
The present invention also provides a kind of endoscope signal processing system, comprising：
Image generation module, by the shooting of the time series of subject and the multiple images that generate；
Major-minor image determining module, instruction is generated according to still image and chooses an image as master image, multiple images
As sub-picture group；
Profile extraction module, profile composition is extracted from the master image and the sub-picture；
Foreign matter judge module, judge whether there is foreign matter on camera lens according to the relative position of profile composition in the picture, if having
Foreign matter, activation master image foreign matter surrounding features choose module, if foreign, it is defeated to assert that master image is that final image and activating preserves
Go out module；
Master image foreign matter surrounding features choose module, choose and record the feature around the master image foreign matter；
Sub-picture group corresponding position image zooming-out module, is determined in the master image according to the master image foreign matter surrounding features
By correspondence position of the part that the foreign matter blocks in the sub-picture group, and extract the image of the correspondence position；
Master image module is synthesized, at the foreign matter of the image mosaic of correspondence position to the master image, generates multiple synthesis
Master image；
Texture discrimination module, the goodness of fit at the master image synthesis is detected, and chosen in multiple described synthesis master images
Goodness of fit highest one is opened as final image；
Output module is preserved, preserves and exports the final image, preserves described multiple synthesis master image, described master images
And the sub-picture group.
The present invention effect be：A kind of endoscope signal processing method of the present invention and system, can reduce on camera lens
Influence of the foreign matter to endoscope picture, medical worker is obtained relatively sharp comprehensive picture, contribute to the progress of diagnosis and treatment.
Brief description of the drawings
Fig. 1 show a kind of flow chart of endoscope signal processing method provided by the invention；
Fig. 2 show a kind of structured flowchart of endoscope signal processing system provided by the invention；
Fig. 3 show the structured flowchart of major-minor image determining module in Fig. 2；
Fig. 4 show the structured flowchart of foreign matter judge module in Fig. 2；
Fig. 5 show the structured flowchart of sub-picture group corresponding position image zooming-out module in Fig. 2；
Fig. 6 show the structured flowchart of texture discrimination module in Fig. 2；
In figure：1-endoscope signal processing system, 11-image generation module, 12-major-minor image determining module,
121-command reception module, 122-master image chosen module, 123-sub-picture chosen module, 13-profile extraction module,
14-foreign matter judge module, 141-contour shape contrast module, 142-outline position comparing module, 15-master image foreign matter week
Enclose characteristic selecting module, 16-sub-picture group corresponding position image zooming-out module, 161-comparison characteristic module, 162-image interception
Module, 17-synthesis master image module, 18-texture discrimination module, 181-profile extraction module again, 182-expansion process
Module, 183-goodness of fit detection module, 184-goodness of fit contrast module, 19-preserve output module.
Embodiment
A kind of endoscope signal processing method provided by the invention is introduced below in conjunction with the accompanying drawings：
Referring to Fig. 1, be a kind of endoscope signal processing method provided by the invention, the step of comprising following order：
S1, image generation, by the shooting of the time series of subject and the multiple images that generate；
S2, major-minor image determine that generating instruction according to still image chooses an image as master image, multiple images work
For sub-picture group；
S3, contours extract, profile composition is extracted from master image and sub-picture；
Foreign matter judges on S4, camera lens, judges whether there is foreign matter on camera lens according to the relative position of profile composition in the picture,
If there is foreign matter, step S5 is performed, if foreign, assert that master image is final image and performs step S9；
S5, master image foreign matter surrounding features are chosen, and choose and record the feature around master image foreign matter；
S6, sub-picture group corresponding position image zooming-out, determine to be hidden by foreign matter in master image according to master image foreign matter surrounding features
Correspondence position of the part of gear in sub-picture group, and extract the image of the correspondence position；
S7, the image of correspondence position synthesize with master image, raw at the foreign matter of the image mosaic of correspondence position to master image
Into multiple synthesis master images；
S8, synthesis master image texture discrimination, detect the goodness of fit at master image synthesis, and choose in multiple synthesis master images
Goodness of fit highest one is opened as final image；
S9, preservation simultaneously export final image, preserve multiple synthesis master image, master image and sub-picture groups.
A kind of endoscope signal processing method of the present invention, the step of major-minor image determines in step S2, include：
S21, receive still image generation instruction；
S22, the last frame image before still image generation indicates is received as master image；
Some two field pictures before before S23, last frame image are as sub-picture group.
A kind of endoscope signal processing method of the present invention, the step of foreign matter judges on camera lens in step S4, include：
S41, each profile composition on each profile composition and sub-picture group of master image is subjected to shape contrast, if master map
As there is profile composition identical with the profile composition shape in sub-picture group, then it is determined as same profile composition；
S42, measurement simultaneously contrast same profile composition in master image and sub-picture group apart from master image and sub-picture group side
The length on edge, if there is length phase of the same profile composition apart from master image and sub-picture group edge in master image and sub-picture group
Deng it is foreign matter then to judge the same profile composition.
A kind of endoscope signal processing method of the present invention, the step of step S6 sub-picture group corresponding position image zooming-outs
Including：
S61, the image-region with master image foreign matter surrounding features is searched in sub-picture group；
S62, intercept the image-region.
A kind of endoscope signal processing method of the present invention, step S8 synthesis master image texture discrimination the step of wrap
Include：
The profile composition of S81, again extraction synthesis master image synthesis stitching portion；
S82, the profile composition to synthesis master image stitching portion carry out expansion process, the expansion synthesis master image of generation one；
S83, detection expansion synthesize the goodness of fit of the stitching portion lines of master image；
S84, the goodness of fit for contrasting multiple expansion synthesis master images, choose the opening and closing of goodness of fit highest one into master image conduct
Final image.
Referring to Fig. 2, the present invention also provides a kind of endoscope signal processing system 1, comprising：
Image generation module 11, by the shooting of the time series of subject and the multiple images that generate；
Major-minor image determining module 12, instruction is generated according to still image and chooses an image as master image, multiple figures
As being used as sub-picture group；
Profile extraction module 13, profile composition is extracted from the master image and the sub-picture；
Foreign matter judge module 14, judge whether there is foreign matter on camera lens according to the relative position of profile composition in the picture, if
There is foreign matter, activation master image foreign matter surrounding features choose module, if foreign, assert that master image is final image and activates preservation
Output module；
Master image foreign matter surrounding features choose module 15, choose and record the feature around the master image foreign matter；
Sub-picture group corresponding position image zooming-out module 16, the master image is determined according to the master image foreign matter surrounding features
On correspondence position by the part that the foreign matter blocks in the sub-picture group, and extract the image of the correspondence position；
Master image module 17 is synthesized, at the foreign matter of the image mosaic of correspondence position to the master image, generates more opening and closing
Into master image；
Texture discrimination module 18, the goodness of fit at the master image synthesis is detected, and choose multiple described synthesis master images
Middle goodness of fit highest one is opened as final image；
Output module 19 is preserved, preserves and exports the final image, preserves described multiple synthesis master image, described master maps
Picture and the sub-picture group.
Referring to Fig. 3, a kind of endoscope signal processing system 1 of the present invention, major-minor image determining module 12 include：
Command reception module 121, receive still image generation instruction；
Master image chosen module 122, the last frame image before receiving still image generation instruction is selected as master image；
Sub-picture chosen module 123, some two field pictures before selecting before last frame image are as sub-picture group.
Referring to Fig. 4, a kind of endoscope signal processing system 1 of the present invention, the foreign matter judge module 14 include：
Contour shape contrast module 141, each profile composition of master image and each profile composition in sub-picture group are entered
Row shape contrasts, if master image has profile composition identical with the profile composition shape in sub-picture group, is determined as same profile
Composition；
Outline position comparing module 142, measure and contrast same profile composition distance master in master image and sub-picture group
The length of image and sub-picture group edge, if there is same profile composition in master image and sub-picture group apart from master image and secondary figure
As the equal length at group edge, then it is foreign matter to judge the same profile composition.
Referring to Fig. 5, a kind of endoscope signal processing system 1 of the present invention, the sub-picture group corresponding position image carries
Modulus block 16 includes：
Characteristic module 161 is compared, the image-region with master image foreign matter surrounding features is searched in sub-picture group；
Image interception module 162, intercept the image-region.
Referring to Fig. 6, a kind of endoscope signal processing system 1 of the present invention, the texture discrimination module 18 include：
Again extraction module 181, again extraction synthesize the profile composition of master image synthesis stitching portion to profile；
Expansion process module 182, expansion process is carried out to the profile composition of synthesis master image stitching portion, the expansion of generation one is closed
Into master image；
Goodness of fit detection module 183, the goodness of fit of the stitching portion lines of detection expansion synthesis master image；
Goodness of fit contrast module 184, the goodness of fit of multiple expansion synthesis master images is contrasted, goodness of fit highest one is chosen and opens
Master image is synthesized as final image.
A kind of endoscope signal processing method of the present invention and system, first judge whether there is foreign matter on camera lens, if having
Foreign matter intercepts picture corresponding with master image foreign matter in width image sets and spliced with master image again, detects spliced coincide
Degree, choose goodness of fit highest and synthesize master image as output image.The endoscope signal processing method and system can reduce mirror
Influence of the foreign matter to endoscope picture on head, medical worker is obtained relatively sharp comprehensive picture, contribute to the progress of diagnosis and treatment.
The foregoing is only presently preferred embodiments of the present invention, be not intended to limit the invention, it is all the present invention spirit and
Within principle, any modification, equivalent substitution and improvements made etc., it should be included in the scope of the protection.
Claims (10)
1. a kind of endoscope signal processing method, it is characterised in that include following step：
S1, image generation, by the shooting of the time series of subject and the multiple images that generate；
S2, major-minor image determine that generating instruction according to still image chooses an image as master image, and multiple images are as secondary
Image sets；
S3, contours extract, profile composition is extracted from the master image and the sub-picture；
Foreign matter judges on S4, camera lens, judges whether there is foreign matter on camera lens according to the relative position of profile composition in the picture, if having
Foreign matter, step S5 is performed, if foreign, assert that master image is final image and performs step S9；
S5, master image foreign matter surrounding features are chosen, and choose and record the feature around the master image foreign matter；
S6, sub-picture group corresponding position image zooming-out, are determined in the master image by institute according to the master image foreign matter surrounding features
The correspondence position of part that foreign matter blocks in the sub-picture group is stated, and extracts the image of the correspondence position；
S7, corresponding position image synthesize with master image, and at the foreign matter of the image mosaic of correspondence position to the master image, generation is more
Opening and closing are into master image；
S8, synthesis master image texture discrimination, detect the goodness of fit at the master image synthesis, and choose multiple described synthesis master maps
Goodness of fit highest one is opened as final image as in；
S9, preservation simultaneously export the final image, preserve described multiple synthesis master image, the master image and described sub-pictures
Group.
2. endoscope signal processing method as claimed in claim 1, it is characterised in that major-minor image determines in the step S2
The step of include：
S21, receive still image generation instruction；
S22, the last frame image before still image generation indicates is received as master image；
Some two field pictures before before S23, last frame image are as sub-picture group.
3. endoscope signal processing method as claimed in claim 2, it is characterised in that foreign matter is sentenced on camera lens in the step S4
Disconnected step includes：
S41, each profile composition on each profile composition and sub-picture group of master image is subjected to shape contrast, if master image has
Profile composition is identical with the profile composition shape in sub-picture group, then is determined as same profile composition；
S42, measurement simultaneously contrast same profile composition in master image and sub-picture group apart from master image and sub-picture group edge
Length, if there is equal length of the same profile composition apart from master image and sub-picture group edge in master image and sub-picture group,
It is foreign matter then to judge the same profile composition.
4. endoscope signal processing method as claimed in claim 3, it is characterised in that the step S6 sub-picture groups corresponding position
The step of image zooming-out, includes：
S61, the image-region with master image foreign matter surrounding features is searched in sub-picture group；
S62, intercept the image-region.
5. endoscope signal processing method as claimed in claim 3, it is characterised in that the step S8 synthesizes master image texture
The step of differentiation, includes：
The profile composition of S81, again extraction synthesis master image synthesis stitching portion；
S82, the profile composition to synthesis master image stitching portion carry out expansion process, the expansion synthesis master image of generation one；
S83, detection expansion synthesize the goodness of fit of the stitching portion lines of master image；
S84, the goodness of fit for contrasting multiple expansion synthesis master images, choose the opening and closing of goodness of fit highest one into master image as final
Image.
6. a kind of endoscope signal processing system, it is characterised in that include：
Image generation module, by the shooting of the time series of subject and the multiple images that generate；
Major-minor image determining module, instruction is generated according to still image and chooses an image as master image, multiple image conducts
Sub-picture group；
Profile extraction module, profile composition is extracted from the master image and the sub-picture；
Foreign matter judge module, judge whether there is foreign matter on camera lens according to the relative position of profile composition in the picture, if there is foreign matter,
Activate master image foreign matter surrounding features and choose module, if foreign, assert that master image is final image and activates preservation output mould
Block；
Master image foreign matter surrounding features choose module, choose and record the feature around the master image foreign matter；
Sub-picture group corresponding position image zooming-out module, is determined in the master image by institute according to the master image foreign matter surrounding features
The correspondence position of part that foreign matter blocks in the sub-picture group is stated, and extracts the image of the correspondence position；
Master image module is synthesized, at the foreign matter of the image mosaic of correspondence position to the master image, generates multiple synthesis master maps
Picture；
Texture discrimination module, the goodness of fit at the master image synthesis is detected, and choose in multiple described synthesis master images and coincide
Degree highest one is opened as final image；
Output module is preserved, preserves and exports the final image, preserves described multiple synthesis master image, the master image and institutes
State sub-picture group.
7. endoscope signal processing system as claimed in claim 6, it is characterised in that the major-minor image determining module bag
Include：
Command reception module, receive still image generation instruction；
Master image chosen module, the last frame image before receiving still image generation instruction is selected as master image；
Sub-picture chosen module, some two field pictures before selecting before last frame image are as sub-picture group.
8. endoscope signal processing method as claimed in claim 6, it is characterised in that the foreign matter judge module includes：
Contour shape contrast module, each profile composition on each profile composition of master image and sub-picture group is subjected to shape pair
Than if master image has profile composition identical with the profile composition shape in sub-picture group, being determined as same profile composition；
Outline position comparing module, measure and contrast same profile composition in master image and sub-picture group apart from master image and pair
The length at image sets edge, if there is same profile composition in master image and sub-picture group apart from master image and sub-picture group edge
Equal length, then it is foreign matter to judge the same profile composition.
9. endoscope signal processing system as claimed in claim 6, it is characterised in that the sub-picture group corresponding position image carries
Modulus block includes：
Characteristic module is compared, the image-region with master image foreign matter surrounding features is searched in sub-picture group；
Image interception module, intercept the image-region.
10. endoscope signal processing system as claimed in claim 6, it is characterised in that the texture discrimination module includes：
Again extraction module, again extraction synthesize the profile composition of master image synthesis stitching portion to profile；
Expansion process module, expansion process, the expansion synthesis master map of generation one are carried out to the profile composition of synthesis master image stitching portion
Picture；
Goodness of fit detection module, the goodness of fit of the stitching portion lines of detection expansion synthesis master image；
Goodness of fit contrast module, the goodness of fit of multiple expansion synthesis master images is contrasted, chooses the opening and closing of goodness of fit highest one into master
Image is as final image.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710822093.XA CN107610081B (en) | 2017-09-13 | 2017-09-13 | Endoscope signal processing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201710822093.XA CN107610081B (en) | 2017-09-13 | 2017-09-13 | Endoscope signal processing method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN107610081A true CN107610081A (en) | 2018-01-19 |
| CN107610081B CN107610081B (en) | 2020-10-27 |
Family
ID=61063615
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201710822093.XA Active CN107610081B (en) | 2017-09-13 | 2017-09-13 | Endoscope signal processing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN107610081B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080068454A1 (en) * | 2005-04-18 | 2008-03-20 | Olympus Medical Systems Corp. | Image display apparatus |
| US20170155804A1 (en) * | 2014-07-07 | 2017-06-01 | Sony Corporation | Image processing apparatus, image processing method, program, and endoscope system |
| CN107133941A (en) * | 2017-04-18 | 2017-09-05 | 重庆金山医疗器械有限公司 | A kind of Wireless capsule endoscope image protrudes the display methods of blood vessel very change and boss |
-
2017
- 2017-09-13 CN CN201710822093.XA patent/CN107610081B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20080068454A1 (en) * | 2005-04-18 | 2008-03-20 | Olympus Medical Systems Corp. | Image display apparatus |
| US20170155804A1 (en) * | 2014-07-07 | 2017-06-01 | Sony Corporation | Image processing apparatus, image processing method, program, and endoscope system |
| CN107133941A (en) * | 2017-04-18 | 2017-09-05 | 重庆金山医疗器械有限公司 | A kind of Wireless capsule endoscope image protrudes the display methods of blood vessel very change and boss |
Also Published As
| Publication number | Publication date |
|---|---|
| CN107610081B (en) | 2020-10-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9547940B1 (en) | Systems and methods for providing augmented reality in minimally invasive surgery | |
| US9402690B2 (en) | Efficient 3-D telestration for local and remote robotic proctoring | |
| US8639000B2 (en) | Robust sparse image matching for robotic surgery | |
| Nishiyama | From exoscope into the next generation | |
| CN105469379B (en) | Video target area shielding method and device | |
| US20220095903A1 (en) | Augmented medical vision systems and methods | |
| CN105550631B (en) | A kind of iris image acquiring method and device | |
| US20150339817A1 (en) | Endoscope image processing device, endoscope apparatus, image processing method, and information storage device | |
| WO2013187116A1 (en) | Image processing device and three-dimensional image observation system | |
| US20130259315A1 (en) | Methods for generating stereoscopic views from monoscopic endoscope images and systems using the same | |
| US20080108873A1 (en) | System and method for the automated zooming of a surgical camera | |
| US20190328208A1 (en) | Image processing device, image processing method and recording medium | |
| US10904437B2 (en) | Control apparatus and control method | |
| de Iorio et al. | Automatic detection of intestinal juices in wireless capsule video endoscopy | |
| WO2013179855A1 (en) | Stereoscopic endoscope system | |
| US9560965B2 (en) | Method for determining the azimuthal orientation of a patient eye and eye surgical apparatus therefor | |
| US20220265125A1 (en) | Wireless swivel camera laparoscopic instrument with a virtual mapping and guidance system | |
| CN110099599A (en) | Medical Image Processing equipment, medical image processing method and program | |
| EP3070941A1 (en) | Stereoscopic endoscope image processing apparatus | |
| Lin et al. | Efficient vessel feature detection for endoscopic image analysis | |
| CN105009581B (en) | Stereoscopic endoscope system | |
| JPWO2018221041A1 (en) | Medical observation system and medical observation device | |
| Zhou et al. | Visual tracking of laparoscopic instruments | |
| Kanakatte et al. | Surgical tool segmentation and localization using spatio-temporal deep network | |
| CN107610081A (en) | A kind of endoscope signal processing method and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |