CN102551646A - Electronic endoscope system and processor thereof, high-sensitivity method for fluorescence image - Google Patents
Electronic endoscope system and processor thereof, high-sensitivity method for fluorescence image Download PDFInfo
- Publication number
- CN102551646A CN102551646A CN2011103199564A CN201110319956A CN102551646A CN 102551646 A CN102551646 A CN 102551646A CN 2011103199564 A CN2011103199564 A CN 2011103199564A CN 201110319956 A CN201110319956 A CN 201110319956A CN 102551646 A CN102551646 A CN 102551646A
- Authority
- CN
- China
- Prior art keywords
- light
- image
- observation
- pixel
- white light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Endoscopes (AREA)
Abstract
The invention relates to an electronic endoscope system and a processor thereof, and a high-sensitivity method for fluorescence images, wherein white light and excitation light are alternately illuminated into a body cavity. The electronic endoscope photographs the white light in the body cavity through CCD so as to obtain the image of the white light. Then through the CCD photographing with excitation light, the self-body fluorescence image is obtained. The movement of the observed object in the cavity is observed through the image of the white light. In order to improve the brightness of the self-body fluorescence image, the self-body fluorescence image is subjected to frame adding and pixel mixing operation.
Description
Technical field
The present invention relates to observe electronic endoscope system and the high sensitivity method of processor device and fluoroscopic image thereof of the fluorescence of AF of sending from endoceliac bio-tissue etc.
Background technology
At medical field in recent years, the diagnosis and the treatment of electronic endoscope system have been used in a large number.In electronic endoscope system, come irradiation body intracavity from blue light belt up to the white light of red light belt with wavelength, take in endoceliac reflection image with the imaging apparatus of CCD etc.Then, will be through taking the pictorial display obtained in monitor.Thus, owing to can confirm endoceliac image in real time, therefore can diagnose reliably etc.
Though from the photographed images that irradiation obtains during white light, can grasp roughly and taken the photograph soma's integral body, it is still difficult that quilt such as sag and swell that clearly observe blood capillary, deep-level blood vessel, gland degree of lip-rounding attitude (pit pattern), are called depression and protuberance are taken the photograph soma.Owing to take the photograph the probability that hiding pathological changes portion is arranged in the soma at such quilt, therefore, just constantly require from photographed images, also can grasp blood capillary, depression and convexity etc. reliably.
For example; Method as the neoplastic lesion of observing cancer etc.; Such shown in TOHKEMY 2009-34224 communique; Make the endogenous fluorescent material in the bio-tissue send AF through the exciting light that is limited to specific wavelength, the AFI (Auto Fluorescence Imaging, AF imaging) that catches this AF with imaging apparatus is widely known by the people.In AFI, the intensity of the AF that normal portion sent of the non-pathological changes of the strength ratio portion of the AF that sends from pathological changes portions such as cancers is utilized this character a little less than wanting, and on picture, comes lesions showed portion and normal portion with various colors.Therefore, through this AFI, even the pathological changes portion that almost is difficult to distinguish with normal portion also can observe.
But,, can not directly carry out useful diagnostic imaging based on the AF image of this AF because the light quantity of AF is faint.Therefore, in order in diagnosis, to effectively utilize the AF image, need make AF image high image qualityization with some method.For example; In TOHKEMY 2009-34224 communique; At the leading section of fujinon electronic video endoscope, except the common illuminating window that irradiation white light and exciting light are set, exciting light dedicated illumination window is set in addition also; Through shining exciting light respectively, make bio-tissue shine sufficient exciting light from these two illuminating windows.But, at the leading section of fujinon electronic video endoscope the special-purpose illuminating window of exciting light being set, and will the photoconduction (light guide) to the special-purpose illuminating window guiding exciting light of exciting light being assembled in the insertion section of fujinon electronic video endoscope, this can cause the increase of cost.
Summary of the invention
The objective of the invention is to not increase cost and can make the fluoroscopic image high image qualityization of AF image etc.
In order to achieve the above object, electronic endoscope system of the present invention is characterised in that to possess: light supply apparatus, and it sends and is used for from the exciting light of endoceliac bio-tissue activating fluorescent and the illumination light different with the wave-length coverage of this exciting light; Fujinon electronic video endoscope; It is through taking with imaging apparatus because the said exciting light of irradiation sends in the said body cavity of said fluorescence; Obtaining fluoroscopic image, and through taking with said imaging apparatus in the said body cavity that is thrown light on by said illumination light, to obtain the subject image; Motion detection unit, it detects the motion of the said endoceliac object of observation from said subject image; The high sensitivity processing unit, it implements frame addition and pixel mixed processing to said fluoroscopic image; Change the unit with handling, it changes the contents processing of said frame addition and said pixel mixed processing according to the motion of the said object of observation.
Preferred said frame addition is the processing of the fluoroscopic image of the said fluoroscopic image of the synthetic multiframe high image quality that generates 1 frame, and said pixel mixed processing is in said fluoroscopic image, the software pixel of the pixel value addition of a plurality of pixels to be mixed.Preferred said high sensitivity processing unit makes the frame addition number of the frame number of answering addition in the said frame addition of expression and representes that the pixel mixed number of answering the added pixels number in the said software pixel mixing changes according to the quantity of motion of the object of observation.When preferred said high sensitivity processing unit does not move in the said object of observation, said frame addition number is increased along with the process of time.Preferred said high sensitivity processing unit changes the content of said pixel mixed processing according to the size of the said object of observation.The size input block that preferably possesses the size of the said object of observation of input.Preferably under the original state of the shooting that has begun said fluoroscopic image, decide said frame addition number and said pixel mixed number according to the fluorescence intensity of said fluoroscopic image.
Preferred said pixel mixed processing is controlled to be the hardware pixel of in said imaging apparatus, the pixel value phase adduction of a plurality of pixels being exported with imaging apparatus and mixes.
Preferred said illumination light be wavelength from the white light of blue light belt up to red light belt, said subject image is through to taking the white light image that obtains in the body cavity that has shone white light.In addition, preferred said motion detection unit detects the motion of the said object of observation from the white light image that obtains taking in the body cavity that has shone white light.
Preferred said fluoroscopic image is the AF image that obtains with AFI.In addition, preferred said fluoroscopic image is to observe and acquisition medicament fluoroscopic image with PDD or near-infrared fluorescent.
The processor device of electronic endoscope system of the present invention is connected with fujinon electronic video endoscope; This fujinon electronic video endoscope is used for taking from said endoceliac back light with imaging apparatus from the exciting light of endoceliac bio-tissue activating fluorescent and the illumination light different with the wave-length coverage of this exciting light to the body cavity internal radiation.This processor device is characterised in that; Possess: receiving element, its from said fujinon electronic video endoscope receive through receive with imaging apparatus said fluorescence take the fluoroscopic image that obtains and through with imaging apparatus to taking the subject image that obtains in the said body cavity that has shone said illumination light; Motion detection unit, it detects the motion of the said endoceliac object of observation from said subject image; The high sensitivity processing unit, it implements frame addition and pixel mixed processing to said fluoroscopic image; Change the unit with handling, it changes the contents processing of said frame addition and said pixel mixed processing according to the motion of the said object of observation.
The high sensitivity method feature of fluoroscopic image of the present invention is to have: alternately be used for from the step of the exciting light of endoceliac bio-tissue activating fluorescent and the illumination light different with the wave-length coverage of this exciting light to the body cavity internal radiation; Through obtaining the step of fluoroscopic image in the said body cavity that sends said fluorescence with the imaging apparatus shooting owing to the said exciting light of irradiation; Through with imaging apparatus to taking the step that obtains the subject image in the said body cavity that has shone said illumination light; From said subject image, detect the step of the motion of the said endoceliac object of observation; Said fluoroscopic image is implemented the step of frame addition and pixel mixed processing; With the step that changes the content of said frame addition and said pixel mixed processing according to the motion of the said object of observation.
According to the present invention, in electronic endoscope system,, can not increase into this locality and carry out the high sensitivity processing through fluoroscopic image being applied frame addition and the pixel mixed processing that has possessed.In addition, owing to change the content of these frame additions and pixel mixed processing according to the motion of the endoceliac object of observation, so when realizing the high sensitivity of fluoroscopic image, in the picture of the object of observation, can not produce shake, resolution is reduced.
Description of drawings
Fig. 1 is the skeleton diagram of the electronic endoscope system of expression the 1st embodiment.
Fig. 2 is the block diagram of electric structure in the electronic endoscope system of expression the 1st embodiment.
Fig. 3 is the chart of the spectrophotometric intensity of expression exciting light, AF and white light.
Fig. 4 is the axonometric chart of leading section of the fujinon electronic video endoscope of expression the 1st embodiment that trocar sheath (overtube) and outer housing (hood) are installed.
Fig. 5 is the vertical view of the range of exposures of expression white light.
Fig. 6 A is the vertical view of the rotary shutter (rotary shutter) of expression white light between the light period time.
Fig. 6 B is the vertical view of the rotary shutter during the expression white light shading time.
Fig. 7 is used to explain the sequential chart of method of controlling the light quantity of exciting light according to the light quantity of white light.
Fig. 8 is the figure of the range of exposures of expression exciting light.
Fig. 9 is the profile of a part of the 1st light projector unit and the outer housing and the trocar sheath of expression exciting light irradiation usefulness.
Figure 10 A is the sequential chart that is used to explain the shooting control of the CCD under the normal light observing pattern.
Figure 10 B is the sequential chart that is used to explain the shooting control of the CCD under the AF observing pattern.
Figure 11 is the process chart at signal processing part.
Figure 12 draws the chart that initial set value is arranged.
Figure 13 is the chart that is used to explain the high sensitivity processing under the resting state continued case.
Figure 14 is the chart of the high sensitivity processing when being used to the resting state different with Figure 13 is described.
Figure 15 is used for explaining the chart that changes to the high sensitivity processing under the situation of the kinestate that object of observation generation is moved from resting state.
Figure 16 is that the table that quantity of motion and frame addition number and pixel are mixed the LUT of (binning) several corresponding relation has been stored in expression.
Figure 17 is used to explain the key diagram based on the high sensitivity processing of frame addition.
Figure 18 is the vertical view of the rotary shutter that uses in the irradiation of frame sequence light of RGB.
Figure 19 is that expression possesses the block diagram of electric structure that shines the unitary electronic endoscope system of light projector of white light through blue exciting light and fluorescence part.
Figure 20 is the axonometric chart of exciting light with probe, outer housing and leading section.
The specific embodiment
As shown in Figure 1, electronic endoscope system 10 of the present invention possesses: the imaging apparatus with CCD etc. is taken seized intravital fujinon electronic video endoscope 11; Insert the trocar sheath 13 of the insertion section 20 of logical this fujinon electronic video endoscope 11; Be installed on the outer housing 14 of the leading section 24a of insertion section 20; Generate the seized intravital treatment of picture apparatus 15 of being taken the photograph soma according to the signal that obtains by shooting; Improve the light supply apparatus 16 of the white light that shines seized intravital white light; Be provided for from the exciting light light supply apparatus 17 of the exciting light of seized intravital bio-tissue excitation AF to fujinon electronic video endoscope 11; With the monitor 18 that shows seized intravital image.
Fujinon electronic video endoscope 11 possesses: be inserted into endoceliac flexible insertion section 20; Be located at the operating portion 21 of the cardinal extremity part of insertion section; Linked the general cable 23 between the light supply apparatus 16 of operating portion 21 and processor device 15 and white light.20 front end is formed with the bend 24 that links a plurality of bending sections (the bent coltfoal in gulf) in the insertion section.Bending section 24 is through the operation of the angulation knob 26 of operating portion, in the enterprising line bend action of direction up and down.
Front end at bending section 24 is provided with the leading section 24a that is built-in with the optical system of photography usefulness in the body cavity.Leading section 24a through bending section 24 flexure operation and towards endoceliac desired direction.As shown in Figure 4,24a is provided with at leading section: two the 1st and the 2nd illuminating window 57,59 of irradiation white light, exciting light; Acceptance is from the observation window 62 of endoceliac white light, AF; To supplying gas/delivery nozzle 63 of observation window injection water or air; With the pliers outlet 64 that becomes the outlet of inserting the processing apparatus that leads to the pliers pipeline in insertion section 20.
In operating portion 21, be provided with and switch to the normal light observing pattern of using white light to carry out endoceliac observation and use exciting light to observe any observing pattern switching push button 28 of the AF observing pattern of the AF that sends in the bio-tissue.The handover information of this observing pattern switching push button 28 is sent to the controller 113 (with reference to Fig. 2) of processor device.
At this; Under the situation that is set to the normal light observing pattern; Be shown in monitor 18 through taking the white light image that endoceliac reflection image obtains; Under the situation that is set in the AF observing pattern, be shown in monitor 18 through taking the AF image that AF obtains or the composograph of synthetic white light image and AF image.
The end of light supply apparatus 16 sides of processor device 15 in general cable 23 and white light is equipped with adapter 30.Adapter 30 is the compound adapters that are made up of with adapter with adapter and light source communication, and fujinon electronic video endoscope 11 is via this adapter 30, and dismounting freely is connected in the light supply apparatus 16 of processor device 15 and white light.
Said outer housing 14 possesses exciting light cut-off filter 32.This exciting light cut-off filter 32 is located at the observation window 62 (with reference to Fig. 4) of leading section 24a through covering, can by or reduce the light of the exciting light wave band of the light before entering into observation window 62.The exciting light that energy is very high ends in observation window 62 fronts, does not get into the CCD100 (with reference to Fig. 2) of the inboard of being located at observation window 62 through making this exciting light, can prevent that the pixel of CCD100 from becoming the electric charge saturation and causing picture to help white halation.
Trocar sheath 13 possesses: trocar sheath main body 35; Be located in this trocar sheath main body 35, and insert the slotting siphunculus road 37 of endoscope of the insertion section 29 of the sub-endoscope 11 of energising; Be located at this endoscope insert siphunculus road 37 around, guiding is from two article the 1st and the 2nd optical fiber 38,39 of the exciting light of the light supply apparatus 17 of exciting light.
Endoscope inserts siphunculus road 37 to be possessed: the base end side opening 37a of insertion mouth that becomes the insertion section 20 of fujinon electronic video endoscope; Front opening 37b with the outlet that becomes this insertion section 20.Therefore, insertion section 20 is being inserted logical endoscopies when inserting siphunculus road 37, the outer housing 14 that exposes the leading section 24a of fujinon electronic video endoscope and be installed on this leading section 24a from front opening 37b.When the insertion section 20 of fujinon electronic video endoscope is inserted in the body cavity, make insertion section 20 insert logical trocar sheath 13.In addition, at the outer peripheral face of outer housing 14, fixedly mount the 1st and 2nd light projector unit 41,42 of oriented body cavity internal radiation from the exciting light of the 1st and the 2nd optical fiber 38,39.
As shown in Figure 2, the light supply apparatus 16 of white light possesses: white light light source 45; Aperture governor motion 46; White light control part 47; Rotary shutter 48; Position detection part 49 and Spin Control portion 50.During the power supply of the light supply apparatus 16 of white light anastomosing, white light light source 45 is energized, and sends white light.White light be wavelength from the broadband light of blue light belt up to red light belt, for example as shown in Figure 3, have the wave band of 400nm～700nm.As white light light source 45, for example use neon lamp, Halogen light, LED (light emitting diode), fluorescence radiation element etc. or LD (laser diode) etc.The white light that sends from white light light source 45 is by lens 53 optically focused.Incided the 1st and the 2nd photoconduction 55,56 via aperture governor motion 46 by the light of lens 53 optically focused.
The the 1st and the 2nd photoconduction 55,56 is made up of bigbore optical fiber etc.The light incident side end of the 1st and the 2nd photoconduction 55,56 is connected in the light supply apparatus 16 of white light.On the other hand, the exiting side end of the 1st photoconduction 55 towards the exiting side end of the 1st illuminating window 57, the 2 photoconductions 55 of the leading section 24a of fujinon electronic video endoscope 11 towards the 2nd illuminating window 59 of leading section 24a.Respectively from the 1st and the 2nd illuminating window 57,59 outgoing white light in body cavity.
As shown in Figure 4, the 1st illuminating window 57 and the 2nd illuminating window 59 are arranged on respect to be located on the symmetric position of exciting light cut-off filter 32 (or observation window 62) difference of outer housing 14.In addition, as shown in Figure 5, roughly overlap with range of exposures WL2 from the range of exposures WL1 of the white light of the 1st illuminating window 57 outgoing from the white light of the 2nd illuminating window 59 outgoing.Therefore, with leading section 24a during towards the object of observation, object of observation T roughly enters in the repetition scope WLR of these ranges of exposures WL1, WL2.Thus, can fully and less than illumination shine white light faintly to object of observation T.
In addition, outer housing 14 only covers the observation window 62 among the leading section 24a, and remaining part is exposed from peristome 14a.Therefore, outer housing 14 can not hamper the irradiation from the white light of the 1st and the 2nd illuminating window 57,59.In addition, can from supply gas/air of delivery nozzle 63 or the excitation cut-off filter 32 that water is ejected into outer housing on.And then, can make the processing apparatus projecting inward to body cavity from pliers outlet 64.
As shown in Figure 2, aperture governor motion 46 is disposed between lens 53 and the rotary shutter 48, regulates the light quantity of the white light that sends from white light light source 45.Aperture governor motion 46 for example by make the variable a plurality of aperture blades of aperture bore and drive this aperture blades on-off action motor etc. constitute.Control the aperture amount (being the light quantity of white light) of aperture governor motion via driver 47a by white light control part 47.White light control part 47 is controlled aperture amount according to the white light image that obtains through the signal processing in the processor device 15.
Shown in Fig. 6 A and Fig. 6 B, rotary shutter 48 has segmental notch portion in the part of circular plate shape.Notch portion in the rotary shutter 48 becomes the 48a of light transmission portion through white light, and remaining part becomes the dark slide 48b that covers white light.Rotary shutter 48 is installed in the rotating shaft 70a with the motor 70 of the optical axis configured in parallel of white light light source 45.Through the driving of this motor 70, make rotary shutter 48 rotations, thereby 48a of light transmission portion and dark slide 48b alternately are positioned on the light path P of white light light source.
Detect the 48a of light transmission portion, light shielding part 48b through the position detection part 49 that constitutes by optical sensor etc. which be positioned on the light path P.At this, in Fig. 2, Fig. 6 A and Fig. 6 B, position detection part 49 is configured near the periphery of rotary shutter, but also can be the optional position, for example in the inside of rotary shutter.
Shown in Fig. 6 A, the 48a of light transmission portion be positioned on the light path P during because white light incides the 1st and the 2nd photoconduction 55,56, so white light shines in the body cavity.With being made as white light this period between the light period.On the other hand, shown in Fig. 6 B, light shielding part 48b be positioned on the light path P during because white light do not incide the 1st and the 2nd photoconduction 55,56, therefore, in body cavity, white light is in by the light blocking state.With during being made as the white light shading this period.Position detection part 49 will be in white light between the light period with the white light shading during the relevant information of which state suitably send to exciting light control part 75 and the controller 113 of processor device in the light supply apparatus of exciting light.
White light between the light period with the white light shading during because of observing pattern is different, when being set to the normal light observing pattern during during the AF observing pattern each 2 times.Therefore, Spin Control portion 50 when the AF observing pattern, the rotary speed when making the rotary speed of rotary shutter 48 be the normal light observing pattern half the.In addition, Spin Control portion 50 controls the rotary speed of rotary shutter 8 through the driver 50a that is connected with motor 70.
As shown in Figure 2, the light supply apparatus 17 of exciting light possesses the 1st and the 2nd LASER Light Source 72,73, exciting light control part 75.The the 1st and the 2nd LASER Light Source 72,73 is made up of light emitting diode etc., sends the exciting light of the wavelength of 405 ± 10nm with that kind shown in Figure 3.Through have the exciting light of such wave band to the body cavity internal radiation, can make that the endogenous fluorescent material in the bio-tissue sends the AF that wavelength is 420nm～650nm.
The the 1st and the 2nd LASER Light Source 72,73 always sends exciting light under the situation that is set to the AF observing pattern.Thus, always send AF from bio-tissue.As shown in Figure 3, the exciting light that turns back to the leading section 24a of fujinon electronic video endoscope is energized the light cut-off filter to be ended, and in addition, the light quantity of the leading section 24a of AF is compared faint with white light.Therefore, in body cavity, not only exist white light also to exist under the state of exciting light or AF,, in the white light image that this is obtained, also can not receive the influence of exciting light and AF fully even obtain the white light image.
Exciting light control part 75 is controlled the light quantity of the exciting light of the 1st and the 2nd LASER Light Source 72,73 via driver 75a, 75b.Exciting light control part 75 is connected with white light control part 47, according to the fader control of the white light of white light control part 47, controls the light quantity of exciting light.The control of the light quantity of exciting light has relevant mode, a for example exciting light of regulation according to white light and exciting light the light amount ratio of light quantity of light quantity and white light is kept 1/10 etc. mode changes the light quantity of exciting light.
So, under the situation of the light quantity of white light change, the exciting light control part is also followed this change and is automatically changed the light quantity of exciting light, therefore, can the exposure balance of white light image and AF image be always maintained at suitable state.In addition, the fader control that yet can be exciting light is not that the fader control with white light links and carries out, but as shown in Figure 7, from white light switches to the white light shading between the light period during the time, is controlled to be white light and keeps the relevant of regulation with exciting light.
The exciting light that sends from the 1st LASER Light Source 72 incides the 1st optical fiber 38 of trocar sheath.The exciting light that sends from the opposing party's the 2nd LASER Light Source 73 incides the 2nd optical fiber 39 of trocar sheath.And the exciting light EL in the 1st optical fiber 38 is from the 1st light projector unit 41 outgoing of outer housing 14, and the exciting light EL in the 2nd optical fiber 39 is from the 2nd light projector unit 42 outgoing of outer housing 14.These the 1st and the 2nd optical fiber 38,39 use bigbore single-mode fiber.
As shown in Figure 4, the 1st and the 2nd light projector unit 41,42 is arranged on the symmetric position of exciting light cut-off filter 32 (or observation window 62) difference with respect to outer housing 14.In addition, as shown in Figure 8, roughly overlap (repeat region ELR) from the range of exposures EL2 of the exciting light of the range of exposures EL1 of the exciting light of the 1st light projector unit 41 outgoing and 42 outgoing of the 2nd light projector unit.And then this repeat region ELR is contained among the repeat region WLR that the range of exposures of 2 white lights overlaps.
Because range of exposures EL1, EL2 with above that kind, therefore with leading section 24a during towards object of observation T, object of observation T roughly gets among the repeat region ELR of these ranges of exposures EL1, EL2.Thus, can shine fully and the exciting light that does not have illumination to blur object of observation T.Therefore, for example, be under the situation of normal portion in the integral body of object of observation T, send the AF of roughly the same intensity from the Zone Full of this object of observation.And then because the repeat region ELR that the range of exposures of 2 exciting lights overlaps is contained among the repeat region WLR of range of exposures of 2 white lights, therefore in object of observation T integral body, the light amount ratio of white light and exciting light is kept constant.
As shown in Figure 9, the 1st light projector unit 41 that is disposed at the periphery of outer housing 14 possesses: light diffusing member 90; Cover the sleeve member 91 of tubular of the periphery of this light diffusing member 90; Distolateral cover glass 92 with this sleeve member 91 of sealing.At light diffusing member 90, the exciting light that penetrates from the exit end of optical fiber 94 incides light diffusing member 90.This optical fiber 94 is introduced in the outer housing 14, at its incident end lasso 93 is installed.
Outside in the sleeve pipe 13, lasso 40 is installed at the exit end of the 1st optical fiber 38.Through this lasso 40 and lasso 93, the 1st optical fiber 38 in the trocar sheath 13 contacts with outer housing 14 interior optical fiber 94 optics.In addition, the unitary formation of the 2nd light projector is identical with the unitary formation of the 1st light projector, therefore omits explanation.
As shown in Figure 2, fujinon electronic video endoscope 11 possesses CCD100, logic processing circuit 104 (AFE:Analog Front End) and imaging control part 106.CCD100 accepts to see through the light of exciting light cut-off filter 32, observation window 62 and collecting lens 102 with shooting face 100a.Then, in CCD100, the light that shooting face 100a is received carries out light-to-current inversion, thereby puts aside signal charge, and accumulative signal charge is read as image pickup signal.The image pickup signal of reading is delivered to AFE104.
CCD100 is a colored CCD, is arranged with R pixel, the G pixel of the color filter that is provided with R color, G color, B color, three color pixels of B pixel at shooting face 100a.At this and since the wave band of white light be from blue light belt up to red light belt, therefore, when white light incided the shooting face of CCD, R pixel, G pixel, B pixel were all responded to.Therefore, in white light receives image pickup signal that the light time obtains, comprise image pickup signal from the output of R pixel, from the image pickup signal of G pixel output and from these three kinds of image pickup signals of image pickup signal of B pixel output.
On the other hand, the main wave band of AF is green light belt, also relates to the blue light belt or the red light belt of a part.Therefore, when AF incided the shooting face 100a of CCD, the G pixel can be responded to AF reliably.
AFE104 is made up of correlated double sample circuit (CDS) and automatic gain control circuit (AGC).CDS eliminates the noise that driving produced of CCD100 to implementing the correlated double sampling processing from the image pickup signal from CCD.AGC amplifies by CDS except that the image pickup signal behind the denoising.
At this, shown in Figure 10 A, under the situation that is set to the normal light observing pattern, when white light is between the light period, thereby carry out white light is carried out the step that light-to-current inversion is put aside signal charge.Then, from white light switches to the white light shading between the light period during the time, send the image pickup signal read pulse to CCD100 from imaging control part 106.When CCD100 receives the image pickup signal read pulse, will export to AFE104 as image pickup signal at the accumulative signal charge of CCD100.Then, during the white light shading, switch to white light between the light period time, thereby carrying out white light is carried out the step of light-to-current inversion savings signal charge once more.Be set at the normal light image model during, carry out above a series of actions repeatedly.
Relative therewith, under the situation that is set to the AF observing pattern, shown in Figure 10 B, when white light is between the light period, thereby carry out white light is carried out the step that light-to-current inversion is put aside signal charge.Then, from white light switches to the white light shading between the light period during the time, the image pickup signal read pulse is sent to CCD100 from imaging control part 106.When CCD100 receives the image pickup signal read pulse, will export to AFE104 as image pickup signal at the accumulative signal charge of CCD100.Almost meanwhile, thus carry out AF is carried out the step of light-to-current inversion savings signal charge.Though AF is faint; But during the white light shading when the AF viewing duration is set at the normal light observing pattern during the white light shading through with the AF observing pattern time 2 times can accept to form the light quantity of AF image degree reliably with CCD100.
Then, passed through certain hour after from white light switches to the white light shading between the light period during after, from imaging control part 106 the image pickup signal read pulse is sent to CCD100.In view of the above, will export to AFE104 as image pickup signal at the accumulative signal charge of CCD100.Then, during the white light shading, switch to white light between the light period time, thereby carrying out white light is carried out the step of light-to-current inversion savings signal charge once more.Be set at the AF observing pattern during, carry out above a series of action repeatedly.
As shown in Figure 2; The light supply apparatus 16 of processor device 15 and fujinon electronic video endoscope 11, white light, the light supply apparatus 17 of exciting light, monitor 18, keyboard (diagram is omitted), printer (diagram is omitted) etc. are electrically connected, and control electronic endoscope system 10 integral body uniformly.Processor device 15 possesses signal processing part 110, frame memory 112, controller 113.
110 pairs of signal processing parts are implemented various processing from the image pickup signals of the AFE104 output of fujinon electronic video endoscope 11 with A/D transformation component 115, tone compensation section 116 and image processing part 117, thus the generation signal of video signal that can show at monitor 118.Then, according to this signal of video signal with various pictorial display in monitor 118.In addition, tone compensation section 116 and image processing part 117 for example wait the storage device formation by carrying out corresponding processing software separately and the EPROM that holds this software (can rewriting type ROM).In addition, the view data of the numeral after the A/D conversion or temporary transient or be stored in the frame memory 112 whenever implementing through the signal of video signal after the Flame Image Process in image processing part with handling.
A/D transformation component 115 will be transformed to the view data of numeral from the image pickup signal of AFE104.In view data, comprise based on from the B image of the image pickup signal of the B pixel of CCD100, based on from the G image of the image pickup signal of G pixel, based on R image from the image pickup signal of R pixel.In addition, in the view data after the A/D conversion, have when the normal light observing pattern or the view data of the view data of the white light image of when the AF observing pattern, obtaining, the AF image when the AF observing pattern, obtained.
The compensation of the B image of white light image is carried out as follows.At first, before using endoscope, ask for the light quantity B ' of the B image of the white light image under the situation that exciting light cut-off filter 32 is not installed in advance, ask for the light quantity B of B ' image of the white light image of the gas phase that exciting light cut-off filter 32 is installed.The relation of representing B and B ' with following formula (1).
B＝B′×α…(1)
At this, α is based on the light quantity cutoff rate of exciting light cut-off filter.Therefore, can ask for B ' with following formula (2).
B′＝B/α…(2)
Shown in (2); In the relation of B and B ' is under the situation of linear relation; The light quantity B of the B image of the white light image that is obtained when using endoscope with alpha divided by reality asks for the light quantity B ' of the part of being ended through exciting light cut-off filter 32.Then, the light quantity B through part that the quilt in the B image of white light is ended is replaced into light quantity B ', can obtain the white light image identical with the situation that exciting light cut-off filter 32 is installed.
In addition, not under the situation of linear relation in the relation of B and B ', through the for example calculation process of multiplication, addition, matrixing etc., can increase the light quantity of the part that the quilt that is equivalent to the B image ends.In addition, also can reduce the G image of the component that the quilt that is equivalent to the B image ends and the component of R image.And then, identical with the situation of B image under the situation of the component of the part of the lower frequency side in the G image being ended through exciting light cut-off filter 32, preferably carry out the tone compensation.
Carry out balance adjustment through the using compensation data, for example make pathological changes portion and normal portion in the white light image contrast, with the AF image in pathological changes portion and normally the contrast of portion become and equate.For example, be under 1/5 the situation in the contrast of AF image with respect to the contrast of white light image, it is 5 times balance adjustment that tone compensation section 116 makes the contrast of AF image according to offset data.In addition, as stated, keep constant, can precision carry out the balance adjustment well through light amount ratio with white light and exciting light.
Because the balance of white light image and AF image depends on the characteristic of CCD etc., therefore preferred dispatching from the factory of electronic endoscope system preceding or use electronic endoscope system for the first time before, implement 1 balance at least and adjust.
In high sensitivity handling part 121,, carry out the high sensitivityization of AF image through the AF image being implemented frame addition and the mixing of software pixel.The frame addition is the AF image through the interior multiframe that obtains during synthetic certain shooting, obtains the AF treatment of picture of the high image quality of 1 frame.At this, the synthetic of the AF image of multiframe is that the pixel value phase Calais of body fluoroscopic image carries out through inciting somebody to action separately.It is to be the processing that unit carries out the pixel value of AF image addition with a plurality of pixels that the software pixel is mixed.At this, M, N are the natural number more than 2.In addition, the high sensitivity processing also can not only be implemented the AF image, also the white light image is implemented.
In the explanation below, in the frame addition, will in the generation of the AF image of the high image quality of 1 frame, be called the frame addition number by the frame number of employed AF image.In addition, in the software pixel is mixed, pixel value added pixels unit is called as the pixel mixed number.In addition, multiplying each other of the pixel count that the pixel count that the pixel mixed number shows as vertically configuration and along continuous straight runs dispose for example shows as 2 * 2.Be that the pixel unit of the mixed AF image of software pixel becomes 2 * 2 pixel group under 2 * 2 the situation in the pixel mixed number, in addition, the pixel value in this pixel group becomes the value that obtains after pixel value with 4 pixels of total of 2 * 2 adds up to.
Frame addition and software pixel are mixed the brightness value that can both realize improving in the AF image, can be realized high sensitivityization.On the other hand, the frame addition shows number through increasing frame, can further realize high sensitivityization, and on the other hand, because the needed frame number of frame addition becomes big, so can reduce frame rate and can in picture, produce shake.In addition, the software pixel is mixed through making the pixel mixed number become big, can further improve lightness, and on the other hand, because the demonstration of integral image becomes coarse, so the resolution of AF image can reduce.
Therefore, when carrying out the high sensitivity processing, need carry out mixing with corresponding suitable frame addition and the software pixel of endoceliac photography situation.In this embodiment, after just switching to the AF observing pattern, decide the initial set value of frame addition number and pixel mixed number at once according to the fluorescence intensity of AF.Fluorescence intensity is calculated according to the AF image.
Then, because if the fluorescence intensity of calculating is bigger, then the blended necessity of frame addition and software pixel reduces, so initial set value can make the frame addition number diminish and the pixel mixed number is also diminished.Therefore, the initial set value Pa1 of this moment is depicted in the bottom left section on the chart shown in Figure 12.On the other hand, because if the fluorescence intensity of calculating is less, then frame addition and the blended necessity of software pixel are higher, so initial set value can make the frame addition number become big and make the pixel mixed number become big.Therefore, the initial set value Pa2 of this moment is depicted in the upper right portion on the chart shown in Figure 12.
After the decision initial set value, through handling change unit 121b frame addition number and pixel mixed number are changed, so that can not have shake and resolution not to realize the high sensitivityization of AF with reducing.At this, frame addition number and pixel mixed number are changed according to the quantity of motion as the size and the object of observation of the object of observation.The size of the object of observation obtains from white light image or AF image, or obtains from the size input part 125 (with reference to Fig. 2) that is connected in processor device 15.At this, if the size of the object of observation more then increases the pixel mixed number from initial set value, if the less initial set value of then keeping of size of the object of observation.In addition, also can be to the distance of size input part 125 input multiplying powers or the object of observation and leading section.
On the other hand, the quantity of motion of the object of observation obtains from the white light image through the 121a of motion detection portion in the high sensitivity handling part.Because it is higher that white light image and AF image are compared the overall brightness value, so from the white light image, be easier to obtain the quantity of motion of the object of observation.At this, when quantity of motion is " 0 ", promptly during resting state, is accompanied by the process of time and increases the frame addition number from initial set value.Increase the frame addition number through such in resting state, make AF image high sensitivityization.On the other hand, when producing motion, the frame addition number is reduced according to this quantity of motion.Thus, can prevent the generation of the picture shake of the object of observation.
In addition, as the designation method of the object of observation in the image, for example except coming manually to specify, can also come to specify automatically through the Flame Image Process of processor device 15 through the object of observation input controller (diagram is omitted) that is connected in processor device 15.In this case; Also in advance in the memorizer in processor device 15 (diagram omit) the typical form (pattern) of storage cancer etc. as template; When in image, detecting the form similar, should detect form and specify as the object of observation with template through the form matching treatment.In addition, also can utilize the pathological changes portion of cancer etc. to have the characteristic of the distinctive color of the tone different, when going out the peculiar color of this cancer, the object of observation is appointed as in this detected color zone partly with the color detection processing and detecting with normal portion.
In addition, in the motion of the object of observation, have 2 kinds of forms: the situation that the object of observation moves from body; With in the object of observation under as immobilized state, make the CCD100 motion through flexure operation with the leading section 24a of fujinon electronic video endoscope, thus the situation that the object of observation moves on image.In addition,, preferably each pixel of the image taken in different time is carried out template matching and handle and ask for motion vector, with the meansigma methods of the component motion of this motion vector quantity of motion as the object of observation about the quantity of motion of the object of observation.
Next, the concrete example with the processing in the high sensitivity handling part is divided into (A), (B) two kinds of situations are explained, wherein do not have motion in (A) object of observation and the situation of lasting resting state; (B) through behind the certain hour, from the situation of resting state to the change of state of generation motion the object of observation.
The processing of situation (A) is carried out according to the straight line 130～132 of Figure 13.These straight lines 130～132 are corresponding with the size of the object of observation respectively, dispose according to the larger-size mode that is positioned at the right side of the object of observation.Therefore, in straight line 130～132, straight line 132 is corresponding with maximum size, and straight line 131 is corresponding with intermediary size, and straight line 131 is corresponding with minimum size.Then, when conducting frame addition and software pixel are mixed, from these straight lines 130～132, select 1 chart corresponding with the size of the object of observation.
In addition, in Figure 13, Pa representes frame addition number and the pixel mixed number under the initial set value.Px representes frame addition number and the pixel mixed number under the stipulated time, and this Px is accompanied by the process of time and moves to upper right along straight line 130～132.Then, behind the process certain hour, Px arrives stationary value Pb.If size and motion through the object of observation behind the certain hour do not change, then keep frame addition number and pixel mixed number under this stationary value Pb.The size of the object of observation is big more, and then stationary value Pb is set greatly more.Through frame addition number and pixel mixed number are changed, can guarantee and the corresponding appropriate sensitivity of the size of the object of observation, and make the increase of frame addition number can realize high image qualityization through process along with the time.
In addition, in the processing of the situation of (A),, then shown in the curve 133～135 of Figure 14, increase the frame addition number along with the process of time, reduce the pixel mixed number on the other hand if the size of the object of observation is little.In this case, when conducting frame addition and software pixel are mixed, from curve shown in Figure 14 133～135, select 1 other corresponding curve of condition with the size of the object of observation.In addition, Pa, Pb, Px shown in Figure 14 are identical with Figure 13.
The processing of situation (B) is carried out according to the straight line 136～138 of Figure 15.These straight lines 136～138 are corresponding with the size of the object of observation, and the configuration sequence of these charts is identical with the situation of Figure 13.On the other hand, in the straight line 136～138 of Figure 15, under static state, the frame addition number under the expression stipulated time and the Px of pixel mixed number have arrived stationary value Pb.Then, when in the object of observation, producing motion, Px moves down to the right along straight line according to the amount of this motion.
At this, in quantity of motion hour, the amount of movement of Px diminishes, and when quantity of motion was big, it is big that the amount of movement of Px also becomes.And, carry out frame addition and the mixing of software pixel according to frame addition number shown in this Px and pixel mixed number.In addition, the momental detection of the object of observation is carried out at regular intervals, and according to testing result, Px also moves.Therefore, Px through the object of observation quantity of motion and on straight line to bottom right or upper left moving.As stated; Through frame addition number and pixel mixed number are changed; Can guarantee and the corresponding appropriate sensitivity of the size of the object of observation, and can increase and decrease the frame addition number, therefore can prevent the generation of the picture shake of the object of observation according to the quantity of motion of the object of observation.
In addition; Though making frame addition number and pixel mixed number is to change according to Figure 13～straight line, curve shown in Figure 15; But also can replace; According to LUT140 shown in figure 16 frame addition number and pixel mixed number are changed, employed frame addition number and pixel mixed number when wherein LUT140 stores quantity of motion and this quantity of motion of the object of observation.In addition, also can in the high sensitivity handling part, in the object of observation, comprise under the situation of high frequency structure morely, reduce the pixel mixed number, high frequency is constructed under the less situation in the object of observation, increases the pixel mixed number.In addition, also can under the big situation of pixel mixed number change, carry out the high frequency emphasis signal processing.
In display gray scale handling part 122, carry out white light image or AF image transformation are become can be shown in the display gray scale of the signal of video signal of monitor and handle.In this display gray scale is handled, comprise the γ compensation deals corresponding, grey level compensation processing with monitor.In this display gray scale is handled; Be set under the situation of common observing pattern; B channel signal to signal of video signal distributes the B image in the white light image, and the G image in the G channel signal distribution white light image of signal of video signal distributes the R image in the white light image to the R channel signal.
On the other hand; Under the situation that is set at the AF observing pattern; The B channel signal of signal of video signal is distributed the B image of white light image, the R channel signal of signal of video signal is distributed the R image of white light image, the G channel signal of signal of video signal is distributed the G image of AF image.Thus, obtain to have synthesized the composograph of white light image and AF image.Through such composograph is shown in monitor 18, can show normal portion with green, with magenta lesions showed portion.
In addition, the brightness degree step-down of AF, except being the reason of pathological changes portion, it far also is one of reason that camera distance becomes.Therefore, image processing part shows in monitor before the magenta, and the brightness degree with the G image of the G image of white light image and AF image compares earlier.At its comparative result is under the lower situation of both, is judged as not to be pathological changes portion, and only is that camera distance becomes far away and causes the brightness degree step-down, shows with green without magenta.On the other hand, under the situation that brightness degree is high and the brightness degree AF image is low of the G of white light image image, being judged as is pathological changes portion, shows with magenta.
Then, effect of the present invention is described.At first, through observing pattern switching push button 28, be set at the AF observing pattern.Under the AF observing pattern, white light between the light period to body cavity internal radiation white light and exciting light, during the white light shading only to body cavity internal radiation exciting light.Since white light between the light period with the white light shading during this two side all shine exciting light, therefore, always send AF from endoceliac bio-tissue.Then, fujinon electronic video endoscope 11 uses CCD100, when white light is between the light period, takes the white light image, in the time of during the white light shading, takes the AF image.To deliver in the processor device 15 through the image pickup signal that these shootings obtain.
In processor device 15, image pickup signal is transformed to the view data of numeral through A/D transformation component 115.Then; According to the view data that obtains; Carry out the tone compensation with tone compensation section 116; Used the balance adjustment of correction data afterwards with the balance adjustment part 120 of image processing part 117, carried out the high sensitivity processing, carried out display gray scale with display gray scale handling part 122 and handle with high sensitivity handling part 121.Handle through these, obtain to have synthesized the composograph of white light image and AF image.Then, this composograph is shown in monitor 18.
In the high sensitivity handling part 121 in image processing part 117,, carry out the high sensitivityization of AF image through the AF image being implemented frame addition and the mixing of software pixel.When conducting frame addition and software pixel are mixed, at first from the AF image, detect fluorescence intensity.Then, decide frame addition number and pixel mixed number according to fluorescence intensity.
After having determined initial set value, for not as shake and do not make resolution not carry out the high sensitivityization of AF, and frame addition number and pixel mixed number are changed with reducing.At this, frame addition number and pixel mixed number are changed according to the quantity of motion as the size and the object of observation of the object of observation.From white light image or AF image, obtaining of the object of observation as size, or from 125 acquisitions of size input part.On the other hand, the quantity of motion of the object of observation obtains from the white light image.
For example, under the larger-size situation of the picture of the object of observation, from initial set value the pixel mixed number is increased, thereby guarantee and the corresponding appropriate sensitivity of the size of the object of observation.On the other hand, be under the situation of " 0 " in the quantity of motion of the object of observation, promptly during resting state, be accompanied by the process of time and increase the frame addition number from initial set value, make AF image high sensitivityization thus.And, when in the object of observation, producing motion, reduce through making the frame addition number, suppress the generation of the picture shake of the object of observation.
In addition; In the above-described embodiment; The AF image of delivering to processor device from fujinon electronic video endoscope has been carried out the software pixel of pixel mixed processing and mixed, but also can replace, when taking, carried out the hardware pixel of pixel mixed processing and mix with the CCD in the fujinon electronic video endoscope.The hardware pixel is mixed and to be meant that be the processing (M, N are the natural number more than 2) that unit exports 1 pixel value (image pickup signal) from CCD with the pixel group of a plurality of pixels formations of N pixel of M pixel of vertical direction and horizontal direction.Therefore, in the size of the object of observation hour, reduce the pixel count that constitutes each pixel group, and on the other hand, when the size of the object of observation is big, increase the pixel count that constitutes each pixel group.
In addition; In the above-described embodiment; Both variations that make frame addition number and pixel mixed number according to the size and the quantity of motion of the object of observation; But in the electronic endoscope system of the pixel mixed processing that does not possess mixing of software pixel or the mixing of hardware pixel etc., also can come only to make the frame addition number to change according to the quantity of motion of the object of observation.In this case, preferably the frame addition number is changed according to characteristic line shown in Figure 17 142.In addition, initial set value Pa is identical with above-mentioned embodiment, is that the fluorescence intensity according to the AF image decides.
Under static state, as stated, from initial set value Pb the frame addition number is increased, realize the high sensitivityization of AF image thus along with the process of time.Then, when being transformed to the object of observation from resting state quantity of motion is near the accurate resting state of " 0 " after just having made motion etc., stop the increase of frame addition number.If the frame addition number of this moment is Px.Then, shown in characteristic line 142, the frame addition number under the accurate resting state is maintained the frame addition number Px when resting state changes to accurate resting state.
Under accurate resting state, because quantity of motion almost near " 0 ", even therefore carry out the frame addition with frame addition number Px, is not worried producing the picture shake yet.Therefore, can realize the high sensitivityization identical with the situation of resting state.Then, under the situation about breaking away from, reduce the frame addition number greatly in the motion quantitative change according to quantity of motion from accurate resting state.At this, the minimizing of frame addition number, shown in characteristic line 142, quantity of motion is bigger and reduce manyly more.
And, in the above-described embodiment, directly to the body cavity internal radiation white light, but also can replace the frame sequence light that constitutes by the light of the light of the light of R color, G color, B color to the body cavity internal radiation.For exposed frames sequence light, use rotary filter 220 shown in Figure 180, replace the rotary shutter 48 shown in Fig. 6 A and Fig. 6 B.In rotary filter 220, be provided with: the light shielding part 221 identical with the light shielding part 48b of rotary shutter 48 along Zhou Fangxiang; Make R color color filter 223r from the light transmission of the R color in the white light of white light light source 45; Make G color color filter 223g from the light transmission of the G color in the white light of white light light source 45; And make B color color filter 223b from the light transmission of the B color in the white light of white light light source 45.Is that the center is rotated through making this rotary filter 220 with rotating shaft 220a, can white light between the light period according to the order of the light of the light of the light of R color, G color, B color to the body cavity internal radiation.
In addition; In the above-described embodiment; White light light source in the light supply apparatus of white light has produced and has shone endoceliac white light; Also can replace, such shown in the electronic endoscope system 300 of Figure 19, produce white light through blue laser light source in the light supply apparatus of white light 304 and light projector unit 306,307 in the leading section 24a that is located at fujinon electronic video endoscope.Blue laser light source 304 is sent the blue laser with centre wavelength 445nm.The blue laser that is sent is via photoconduction 55,56, and 306,307 to the body cavity internal radiation from the light projector unit.In addition, blue laser light source 304 is controlled through blue laser control part 305 via driver 305a.
Light projector unit 306 has in the 1st and the 2nd light projector unit 41,42 and has possessed other all identical structure the fluorophor 310 except replacing light diffusing member.Fluorophor 310 constitutes and comprises absorption and encourage from the part of the blue laser of photoconduction 55 and send green～xanchromatic multiple fluorescent material (for example YAG is fluorophor or BAM (BaMgAl
10O
17) fluorophor that waits).Thus, with the blue laser be exciting light green～xanchromatic excitation luminescence, with do not absorbed the blue laser that sees through and generate white light altogether by fluorophor 310.About light projector unit 307, since identical with light projector unit 306, explanation therefore omitted.
In addition, fluorophor 310 preferably has roughly rectangular shape.In this case, fluorophor 310 also can be solidified into the fluorophor material roughly rectangular-shaped with binding agent, in addition, also can be to form the material behind the mixing phosphor material in the resin of unorganic glass etc. roughly rectangular-shaped.
In addition; In the above-described embodiment; Shone exciting light from the 1st and the 2nd light projector unit 41,42 that is fixedly installed in outer housing 14, but also can replace, shown in figure 20; The exciting light that also can make the pliers pipeline 20a that inserts logical insertion section 20 is with probe maintaining part 403 protrusions of probe 400 from outer housing 402, from the irradiating part 400a irradiation exciting light of this exciting light with probe 400.In addition, exciting light is connected in the light supply apparatus 401 of the exciting light with LASER Light Source 72,73 identical with above-mentioned embodiment with probe 400.
Outer housing 402 is in that to possess on this aspect of exciting light cut-off filter 32 outer housing 14 with above-mentioned embodiment identical, but different with outer housing 14 on this aspect of the opening 405,406 that is formed with probe maintaining part the 403, the 1st and the 2nd illuminating window 57,59 usefulness.Therefore; In body cavity, in addition, the 1st and the 2nd illuminating window 57,59 exposes from opening 405,406 exciting light that remains in probe maintaining part 403 with the irradiating part 400a of probe 400; Therefore, the installation of outer housing 402 can not hamper the irradiation of exciting light and white light.
In addition; In the above-described embodiment; Explained that the AFI that observes the AF that the endogenous fluorescent material in bio-tissue sends through the irradiation of exciting light is applied to the situation the present invention; But the present invention also can use in the PDD that has used the fluorescence medicament (Photo Dynamic Diagnosis, light power diagnosis analysis), near-infrared fluorescent are observed.
In PDD, the wavelength of fluorescence is different according to throwing in the fluorescence medicament difference of giving the patient.For example; When throwing in " light beam liquid ", " laser fluid injection ", " PVC ス ダ イ Application (visudyne; trade name) ",, and send the fluorescence of centre wavelength 660nm from bio-tissue through exciting light to endoceliac bio-tissue irradiation centre wavelength 405nm as medicament.In addition, when having thrown in " 5-ALA (5-aminolevulinic acid) ", through the exciting light to endoceliac bio-tissue irradiation centre wavelength 405nm, the feasible fluorescence that sends 2 peak values from bio-tissue with wavelength 635nm, 670nm as medicament.On the other hand, in near-infrared fluorescent is observed, use ICG (Indocyanine Green) as medicament.Through this ICG is thrown in to the patient, the exciting light before and after endoceliac bio-tissue irradiation 800nm, and send the fluorescence in near-infrared territory with peak wavelength 845nm from bio-tissue.
The medicament fluorescence that above PDD or near-infrared fluorescent are observed is bigger than the light quantity of the AF of observing with AFI, but since the fluorescence medicament can not put aside fully bio-tissue etc. other, and present deficiency in light quantity sometimes.In this case, the medicament fluoroscopic image of the gained such as shooting through medicament fluorescence is implemented the frame addition and the pixel mixed processing of above-mentioned embodiment.Then, the motion according to the object of observation changes these frame additions and pixel mixed processing.Realize the high sensitivityization of medicament fluoroscopic image thus.
Claims (13)
1. electronic endoscope system possesses:
Light supply apparatus, it sends and is used for from the exciting light of endoceliac bio-tissue activating fluorescent and the illumination light different with the wave-length coverage of this exciting light;
Fujinon electronic video endoscope; It is through taking with imaging apparatus because the said exciting light of irradiation sends in the said body cavity of said fluorescence; Obtaining fluoroscopic image, and through taking with said imaging apparatus in the said body cavity that is thrown light on by said illumination light, to obtain the subject image;
Motion detection unit, it detects the motion of the said endoceliac object of observation from said subject image;
The high sensitivity processing unit, it implements frame addition and pixel mixed processing to said fluoroscopic image; With
Handle the change unit, it changes the contents processing of said frame addition and said pixel mixed processing according to the motion of the said object of observation.
2. electronic endoscope system according to claim 1 is characterized in that,
Said frame addition is the processing of the fluoroscopic image of the said fluoroscopic image of the synthetic multiframe high image quality that generates 1 frame,
Said pixel mixed processing is in said fluoroscopic image, the software pixel of the pixel value addition of a plurality of pixels to be mixed.
3. electronic endoscope system according to claim 2 is characterized in that,
Said high sensitivity processing unit makes the frame addition number of the frame number of answering addition in the said frame addition of expression and representes that the pixel mixed number of answering the added pixels number in the said software pixel mixing changes according to the quantity of motion of the object of observation.
4. electronic endoscope system according to claim 3 is characterized in that,
When said high sensitivity processing unit does not move in the said object of observation, said frame addition number is increased along with the process of time.
5. electronic endoscope system according to claim 1 is characterized in that,
Said high sensitivity processing unit changes the content of said pixel mixed processing according to the size of the said object of observation.
6. electronic endoscope system according to claim 5 is characterized in that,
This electronic endoscope system also possesses the size input block of the size of the said object of observation of input.
7. electronic endoscope system according to claim 3 is characterized in that,
Under the original state of the shooting that has begun said fluoroscopic image, decide said frame addition number and said pixel mixed number according to the fluorescence intensity of said fluoroscopic image.
8. electronic endoscope system according to claim 1 is characterized in that,
Said frame addition is the processing of the fluoroscopic image of the said fluoroscopic image of the synthetic multiframe high image quality that generates 1 frame,
Said pixel mixed processing is imaging apparatus to be controlled to be the hardware pixel of in said imaging apparatus, the pixel value phase adduction of a plurality of pixels being exported mix.
9. electronic endoscope system according to claim 1 is characterized in that,
Said illumination light be wavelength from the white light of blue light belt until red light belt, said subject image is through to taking the white light image that obtains in the body cavity that has shone white light,
Said motion detection unit detects the motion of the said object of observation from the white light image that obtains taking in the body cavity that has shone white light.
10. electronic endoscope system according to claim 1 is characterized in that,
Said fluoroscopic image is the AF image that obtains with the AF imaging.
11. electronic endoscope system according to claim 1 is characterized in that,
Said fluoroscopic image is to utilize light power diagnosis analysis or near-infrared fluorescent to observe and acquisition medicament fluoroscopic image.
12. the processor device of an electronic endoscope system; Said electronic endoscope system has fujinon electronic video endoscope; This fujinon electronic video endoscope is used for from the exciting light of endoceliac bio-tissue activating fluorescent and the illumination light different with the wave-length coverage of this exciting light to the body cavity internal radiation; And take from said endoceliac back light with imaging apparatus
The processor device of said electronic endoscope system possesses:
Receiving element, its from said fujinon electronic video endoscope receive through receive with imaging apparatus said fluorescence take the fluoroscopic image that obtains and through with imaging apparatus to taking the subject image that obtains in the said body cavity that has shone said illumination light;
Motion detection unit, it detects the motion of the said endoceliac object of observation from said subject image;
The high sensitivity processing unit, it implements frame addition and pixel mixed processing to said fluoroscopic image; With
Handle the change unit, it changes the contents processing of said frame addition and said pixel mixed processing according to the motion of the said object of observation.
13. the high sensitivity method of a fluoroscopic image has:
Alternately be used for from the step of the exciting light of endoceliac bio-tissue activating fluorescent and the illumination light different with the wave-length coverage of this exciting light to the body cavity internal radiation;
Through obtaining the step of fluoroscopic image in the said body cavity that sends said fluorescence with the imaging apparatus shooting owing to the said exciting light of irradiation;
Through with imaging apparatus to taking the step that obtains the subject image in the said body cavity that has shone said illumination light;
From said subject image, detect the step of the motion of the said endoceliac object of observation;
Said fluoroscopic image is implemented the step of frame addition and pixel mixed processing; With
Change the step of the content of said frame addition and said pixel mixed processing according to the motion of the said object of observation.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2010-236730 | 2010-10-21 | ||
| JP2010236730A JP5539840B2 (en) | 2010-10-21 | 2010-10-21 | Electronic endoscope system, processor device for electronic endoscope system, and method for operating electronic endoscope system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102551646A true CN102551646A (en) | 2012-07-11 |
Family
ID=46258201
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011103199564A Pending CN102551646A (en) | 2010-10-21 | 2011-10-20 | Electronic endoscope system and processor thereof, high-sensitivity method for fluorescence image |
Country Status (2)
| Country | Link |
|---|---|
| JP (1) | JP5539840B2 (en) |
| CN (1) | CN102551646A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109640781A (en) * | 2016-09-06 | 2019-04-16 | 奥林巴斯株式会社 | Endoscopic system |
| CN112967276A (en) * | 2021-03-31 | 2021-06-15 | 杭州海康威视数字技术股份有限公司 | Object detection method, object detection device, endoscope system, electronic device, and storage medium |
Families Citing this family (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2017064091A (en) | 2015-09-30 | 2017-04-06 | ソニー株式会社 | Image processing device, image processing method, surgical system, and surgical thread |
| JP7313280B2 (en) | 2016-09-09 | 2023-07-24 | インテュイティブ サージカル オペレーションズ， インコーポレイテッド | Simultaneous White Light and Hyperspectral Light Imaging System |
| US20200163538A1 (en) * | 2017-05-17 | 2020-05-28 | Sony Corporation | Image acquisition system, control apparatus, and image acquisition method |
| JP7219002B2 (en) * | 2017-09-11 | 2023-02-07 | ｉ－ＰＲＯ株式会社 | Endoscope |
| JP7356266B2 (en) * | 2018-08-31 | 2023-10-04 | キヤノン株式会社 | Imaging device, imaging system, and method for driving the imaging device |
| US11463644B2 (en) | 2018-08-31 | 2022-10-04 | Canon Kabushiki Kaisha | Imaging device, imaging system, and drive method of imaging device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH07250804A (en) * | 1994-03-15 | 1995-10-03 | Olympus Optical Co Ltd | Fluorescence observer |
| US5667474A (en) * | 1994-03-09 | 1997-09-16 | Fuji Photo Optical Co., Ltd. | Visible and infrared imaging apparatus with movement detecting circuits for affecting freeze and noise reducing operations |
| US20020085753A1 (en) * | 2000-12-04 | 2002-07-04 | Fuji Photo Film Co., Ltd. | Fluorescent image obtaining apparatus |
| CN1572231A (en) * | 2003-06-23 | 2005-02-02 | 奥林巴斯株式会社 | Endoscope apparatus for obtaining properly dimmed observation images |
| US20080306337A1 (en) * | 2007-06-11 | 2008-12-11 | Board Of Regents, The University Of Texas System | Characterization of a Near-Infrared Laparoscopic Hyperspectral Imaging System for Minimally Invasive Surgery |
| CN101677751A (en) * | 2007-05-22 | 2010-03-24 | 奥林巴斯株式会社 | Encapsulated medical device and encapsulated medical system |
Family Cites Families (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP3946985B2 (en) * | 2000-12-04 | 2007-07-18 | 富士フイルム株式会社 | Fluorescence imaging device |
| JP2003070721A (en) * | 2001-09-06 | 2003-03-11 | Pentax Corp | Image processor and fluorescent observation endoscope system |
| JP4496883B2 (en) * | 2004-08-17 | 2010-07-07 | ソニー株式会社 | Image processing method, image processing apparatus, program, and recording medium |
| JP2006175052A (en) * | 2004-12-22 | 2006-07-06 | Fuji Photo Film Co Ltd | Fluorescent image capturing apparatus |
| US7231014B2 (en) * | 2005-02-14 | 2007-06-12 | Varian Medical Systems Technologies, Inc. | Multiple mode flat panel X-ray imaging system |
| US20080058602A1 (en) * | 2006-08-30 | 2008-03-06 | Karl Storz Endovision | Endoscopic device with temperature based light source control |
| JP2009034224A (en) * | 2007-07-31 | 2009-02-19 | Olympus Medical Systems Corp | Medical treatment apparatus |
| JP4488319B2 (en) * | 2008-12-08 | 2010-06-23 | オリンパス株式会社 | Endoscope device |
| JP5449816B2 (en) * | 2009-03-26 | 2014-03-19 | オリンパス株式会社 | Image processing apparatus, image processing program, and method of operating image processing apparatus |
-
2010
- 2010-10-21 JP JP2010236730A patent/JP5539840B2/en active Active
-
2011
- 2011-10-20 CN CN2011103199564A patent/CN102551646A/en active Pending
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5667474A (en) * | 1994-03-09 | 1997-09-16 | Fuji Photo Optical Co., Ltd. | Visible and infrared imaging apparatus with movement detecting circuits for affecting freeze and noise reducing operations |
| JPH07250804A (en) * | 1994-03-15 | 1995-10-03 | Olympus Optical Co Ltd | Fluorescence observer |
| US20020085753A1 (en) * | 2000-12-04 | 2002-07-04 | Fuji Photo Film Co., Ltd. | Fluorescent image obtaining apparatus |
| CN1572231A (en) * | 2003-06-23 | 2005-02-02 | 奥林巴斯株式会社 | Endoscope apparatus for obtaining properly dimmed observation images |
| CN101677751A (en) * | 2007-05-22 | 2010-03-24 | 奥林巴斯株式会社 | Encapsulated medical device and encapsulated medical system |
| US20080306337A1 (en) * | 2007-06-11 | 2008-12-11 | Board Of Regents, The University Of Texas System | Characterization of a Near-Infrared Laparoscopic Hyperspectral Imaging System for Minimally Invasive Surgery |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109640781A (en) * | 2016-09-06 | 2019-04-16 | 奥林巴斯株式会社 | Endoscopic system |
| CN112967276A (en) * | 2021-03-31 | 2021-06-15 | 杭州海康威视数字技术股份有限公司 | Object detection method, object detection device, endoscope system, electronic device, and storage medium |
| CN112967276B (en) * | 2021-03-31 | 2023-09-05 | 杭州海康威视数字技术股份有限公司 | Object detection method, object detection device, endoscope system, electronic device, and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2012085916A (en) | 2012-05-10 |
| JP5539840B2 (en) | 2014-07-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN102551646A (en) | Electronic endoscope system and processor thereof, high-sensitivity method for fluorescence image | |
| CN103262522B (en) | Camera head | |
| JP5496852B2 (en) | Electronic endoscope system, processor device for electronic endoscope system, and method for operating electronic endoscope system | |
| US7857751B2 (en) | Electronic endoscope system including image synthesizing processor | |
| JP4855728B2 (en) | Illumination device and observation device | |
| US8100826B2 (en) | Apparatus and methods relating to expanded dynamic range imaging endoscope systems | |
| US20090012361A1 (en) | Apparatus and methods relating to color imaging endoscope systems | |
| CN105792727B (en) | Endoscope apparatus | |
| US20120078046A1 (en) | Endoscopic image display apparatus | |
| CN105828692B (en) | Endoscope apparatus | |
| CN107072506B (en) | Photographic device and processing unit | |
| CN109475283A (en) | Endoscopic system | |
| CN110087528A (en) | Endoscopic system and image display device | |
| JPH0397441A (en) | Endoscope for fluorescent observation | |
| CN102551639A (en) | Electronic Endoscope, Electronic Endoscope System, And Excitation Light Irradiation Method | |
| CN104936503B (en) | Endoscope apparatus | |
| CN102551647A (en) | Electronic endoscope system, processor device of the same, and method of supersensitizing fluoroscopic image | |
| WO2012002320A1 (en) | Image processing apparatus and image processing method | |
| JP2020014718A (en) | Light source device for endoscope and endoscope system | |
| JPH03109515A (en) | Automatic light control device | |
| JPH01136629A (en) | Endoscopic apparatus for fluorescent observation | |
| CN110072427A (en) | The preparation method of calibration solid sample, endoscopic system and solid sample | |
| JP2810716B2 (en) | Endoscope for fluorescence observation | |
| JPH08254659A (en) | Image pickup device | |
| CN102379675A (en) | Electronic endoscope system, shooting control method thereof and processor device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C05 | Deemed withdrawal (patent law before 1993) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20120711 |