CN104380066B - For the system of high light spectrum image-forming, the method for recording and displaying high spectrum image - Google Patents
For the system of high light spectrum image-forming, the method for recording and displaying high spectrum image Download PDFInfo
- Publication number
- CN104380066B CN104380066B CN201480001605.0A CN201480001605A CN104380066B CN 104380066 B CN104380066 B CN 104380066B CN 201480001605 A CN201480001605 A CN 201480001605A CN 104380066 B CN104380066 B CN 104380066B
- Authority
- CN
- China
- Prior art keywords
- light
- camera
- light field
- image
- field
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000001228 spectrum Methods 0.000 title claims description 48
- 238000000034 method Methods 0.000 title claims description 21
- 238000003384 imaging method Methods 0.000 claims abstract description 31
- 230000003287 optical effect Effects 0.000 claims abstract description 27
- 230000003595 spectral effect Effects 0.000 claims description 18
- 230000006870 function Effects 0.000 claims description 6
- 238000012634 optical imaging Methods 0.000 claims description 2
- 210000003462 vein Anatomy 0.000 description 11
- 238000005516 engineering process Methods 0.000 description 6
- 238000012360 testing method Methods 0.000 description 6
- 230000008901 benefit Effects 0.000 description 5
- 238000001914 filtration Methods 0.000 description 5
- 239000011521 glass Substances 0.000 description 5
- 238000005286 illumination Methods 0.000 description 5
- 239000000463 material Substances 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000005855 radiation Effects 0.000 description 4
- 206010028980 Neoplasm Diseases 0.000 description 3
- 210000004204 blood vessel Anatomy 0.000 description 3
- 230000003321 amplification Effects 0.000 description 2
- 238000013459 approach Methods 0.000 description 2
- 238000003491 array Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 239000000571 coke Substances 0.000 description 2
- 238000004590 computer program Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000003199 nucleic acid amplification method Methods 0.000 description 2
- 238000009877 rendering Methods 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 238000001356 surgical procedure Methods 0.000 description 2
- 238000013519 translation Methods 0.000 description 2
- 230000000007 visual effect Effects 0.000 description 2
- YBJHBAHKTGYVGT-ZKWXMUAHSA-N (+)-Biotin Chemical compound N1C(=O)N[C@@H]2[C@H](CCCCC(=O)O)SC[C@@H]21 YBJHBAHKTGYVGT-ZKWXMUAHSA-N 0.000 description 1
- 210000001367 artery Anatomy 0.000 description 1
- 230000002238 attenuated effect Effects 0.000 description 1
- 238000005452 bending Methods 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000015572 biosynthetic process Effects 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- RVRCFVVLDHTFFA-UHFFFAOYSA-N heptasodium;tungsten;nonatriacontahydrate Chemical compound O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.[Na+].[Na+].[Na+].[Na+].[Na+].[Na+].[Na+].[W].[W].[W].[W].[W].[W].[W].[W].[W].[W].[W] RVRCFVVLDHTFFA-UHFFFAOYSA-N 0.000 description 1
- 238000003331 infrared imaging Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 239000007788 liquid Substances 0.000 description 1
- 230000003211 malignant effect Effects 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 238000000386 microscopy Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 210000005036 nerve Anatomy 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 238000001454 recorded image Methods 0.000 description 1
- 238000009738 saturating Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000003068 static effect Effects 0.000 description 1
- 239000000126 substance Substances 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
- 238000001429 visible spectrum Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/11—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths for generating image signals from visible and infrared light wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
- H04N9/3185—Geometric adjustment, e.g. keystone or convergence
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0033—Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room
- A61B5/0035—Features or image-related aspects of imaging apparatus classified in A61B5/00, e.g. for MRI, optical tomography or impedance tomography apparatus; arrangements of imaging apparatus in a room adapted for acquisition of images from more than one imaging mode, e.g. combining MRI and optical tomography
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0075—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by spectroscopy, i.e. measuring spectra, e.g. Raman spectroscopy, infrared absorption spectroscopy
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0077—Devices for viewing the surface of the body, e.g. camera, magnifying lens
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/48—Other medical applications
- A61B5/4887—Locating particular structures in or on the body
- A61B5/489—Blood vessels
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/52—Devices using data or image processing specially adapted for radiation diagnosis
- A61B6/5211—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data
- A61B6/5229—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image
- A61B6/5247—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data combining image data of a patient, e.g. combining a functional image with an anatomical image combining images from an ionising-radiation diagnostic technique and a non-ionising radiation diagnostic technique, e.g. X-ray and ultrasound
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/2823—Imaging spectrometer
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/02—Constructional details
- G01J5/025—Interfacing a pyrometer to an external device or network; User interface
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J5/02—Constructional details
- G01J5/08—Optical arrangements
- G01J5/0896—Optical arrangements using a light source, e.g. for illuminating a surface
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/10—Beam splitting or combining systems
- G02B27/14—Beam splitting or combining systems operating by reflection only
- G02B27/141—Beam splitting or combining systems operating by reflection only using dichroic mirrors
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B3/00—Simple or compound lenses
- G02B3/0006—Arrays
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/73—Deblurring; Sharpening
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3191—Testing thereof
- H04N9/3194—Testing thereof including sensor feedback
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/646—Circuits for processing colour signals for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
- A61B2090/374—NMR or MRI
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
- A61B2090/376—Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy
- A61B2090/3762—Surgical systems with images on a monitor during operation using X-rays, e.g. fluoroscopy using computed tomography systems [CT]
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/37—Surgical systems with images on a monitor during operation
- A61B2090/378—Surgical systems with images on a monitor during operation using ultrasound
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
- A61B6/44—Constructional features of apparatus for radiation diagnosis
- A61B6/4429—Constructional features of apparatus for radiation diagnosis related to the mounting of source units and detector units
- A61B6/4435—Constructional features of apparatus for radiation diagnosis related to the mounting of source units and detector units the source unit and the detector unit being coupled by a rigid structure
- A61B6/4441—Constructional features of apparatus for radiation diagnosis related to the mounting of source units and detector units the source unit and the detector unit being coupled by a rigid structure the rigid structure being a C-arm or U-arm
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J5/00—Radiation pyrometry, e.g. infrared or optical thermometry
- G01J2005/0077—Imaging
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10052—Images from lightfield camera
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Medical Informatics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Animal Behavior & Ethology (AREA)
- Public Health (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Biophysics (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Veterinary Medicine (AREA)
- General Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Optics & Photonics (AREA)
- Radiology & Medical Imaging (AREA)
- Human Computer Interaction (AREA)
- Vascular Medicine (AREA)
- Computer Vision & Pattern Recognition (AREA)
- High Energy & Nuclear Physics (AREA)
- Geometry (AREA)
- Theoretical Computer Science (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Image Processing (AREA)
- Studio Devices (AREA)
- Photoreceptors In Electrophotography (AREA)
- Spectrometry And Color Measurement (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
- Ultra Sonic Daignosis Equipment (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
Abstract
Imaging system includes for recording the light-field camera of EO-1 hyperion light field (CLF) (3).System further includes the light projector (4) for the light field (PLF) in projected visible-light.Camera and projector share common optical axis.EO-1 hyperion light field (CLF) that projector is captured based on light-field camera projects light field (PLF).
Description
Technical field
The present invention relates to a kind of systems for high light spectrum image-forming and one kind for recording high spectrum image and in visible light
The method of middle display high spectrum image, the system include camera for recording the high spectrum image of object and in visible light
The display equipment of middle display logger high spectrum image.
Background technique
It is well known that high light spectrum image-forming is used to disclose the details that human eye can not or be difficult to see that, such as human body inner tissue
Difference.In high light spectrum image-forming, at least one of them wave band is at least partly invisible for human eye or is at least hardly visible
One or more wave bands in reference object image.Then, which is converted into visual picture, to observation in visible light
Person provides the image.High light spectrum image-forming can be illuminated based on the spectral selection before image capture (i.e. using in some wave band
Optical illumination object) and spectral selection filtering both (i.e. using the filter for only transmitting the light in some wave band).This two
In the case of kind, it is desirable that image procossing discloses the result images of interested Structure Comparison degree to generate.
In such systems, by convention, shoot high spectrum image (such as the image for extending beyond visible spectrum) and
Result is shown on the display screen.To observation object invisible or it is difficult that the details seen is interested to be sitting in display screen backstage
The observer in face can will appear in the image studied in visible light on screen in such as UV light or IR light such as image.
Although the use of screen being highly useful technology, possibility is restricted.It has proposed to throw high spectrum image
Shadow on the object-under-study, such as R.K.Miyake, H.D.Zeman, F.H.Duarte, R.Kikuchi,
" the Vein imaging:A new method of near of E.Ramacciotti, G.Lovhoiden, C.Vrancken
infrared imaging where a processed image is projected onto the skin for the
Enhancement of vein treatment ",Dermatologic, Surgery, volume 32, the 1031-1038 pages,
2006.Projection is executed using laser-projector.
It is difficult to provide good clear projection (if almost impossible) using known technology, wherein projection symbol
Relatively high Aligning degree is closed, except non-object (being as is known in the art skin) is static, and meets high flat degree.
The object of the present invention is to provide a kind of system and method, allow to see directly and with correct alignment observed
Object EO-1 hyperion details.
Summary of the invention
For this purpose, system of the invention is characterized in that, the camera of system is light-field capture camera and shows that equipment is light
Projector, wherein camera and projector share coaxial optical path, and wherein camera be arranged to capture EO-1 hyperion light field and
Output including sending the data in captured EO-1 hyperion light field for from the input to light field projector, and light field projector
It is arranged to based on the light field from the received data of camera and on the object in projected visible-light.
For this purpose, method of the invention is characterized in that, the light field in the EO-1 hyperion radiation scope of object is caught by light-field camera
It obtains, the data in light field captured to camera are handled to provide projecting image data, light field projection to light field projector
Instrument is based on projecting image data and projects light field on object, and wherein camera and projector share coaxial optical path, and visible
Light field in light is by light field projector on object.
Light-field capture camera captures (spectral radiance range i.e. at least partly sightless for human eye in bloom spectral limit
In) light field, and the light field in light field projector visible light.Light field projector is formed for showing note in visible light
Record the display equipment of device high spectrum image.The light field projected leads to the display for covering the 3D rendering of object projected, described
3D rendering is clearly in entire big depth bounds.Shared coaxial optical path provides the opposite appearance for the light field for capturing and projecting
Easily alignment.This allows to realize that high spectrum image exists on the observation object that camera has captured its EO-1 hyperion light field by projector
Accurate and live fluoroscopic in visible light, this is equally applicable to observation object unevenness but has the case where 3D shape.
Compared with conventional 2D or even 3D camera, light-field capture camera, which this have the advantage that, obtains complete light field,
The middle possible clear image obtained in entire depth range.Common 2D camera does not provide the big depth of field, and although 3D camera can be with
Some depth informations are provided, but it cannot provide clear image in entire depth range.Light-field camera is also referred to as full light
Camera.Light-field camera is the camera that field information of the capture in relation to scene is imaged using full light.Full light imaging capture incident field,
To retain both intensity and direction of incident light.Full photoimaging systems can be realized based on various technologies: such as M.Levoy et al.
" Light field microscopy " (ACM Trans. on Graphics, volume 25, the 3rd phase, the 924-934 pages,
In July, 2006) described in microlens array；As A.Veeraraghavan et al. " Dappled photography:
Mask enhanced cameras for heterodyned light fields and coded aperture
Refocusing " (ACM Trans. on Graphics(Proc. SIGGRAPH 2007), volume 26, the 3rd phase, 2007 7
Month) described in the speckle photography art with series classification attenuating masks；If A.Levin et al. is in " Image and depth
Form a conventional camera with a coded aperture " (ACM Trans. on Graphics (Proc. SIGGRAPH 2007), volume 26, the 3rd phase, in July, 2007) described in aperture coding mask；Such as
E.R.Dowski et al. at " Extended depth of field through wave-front coding ",Applied Optics, volume 34, o. 11th, the 1859-1866 pages, April nineteen ninety-five) described in wavefront coded device；Such as H.Nagahara
Et al. " Flexible Depth of Field Photography " (Proc. ECCV 2008, in October, 2008) described in
Scanning focused imaging.The spatial information of full light imaging storage incident field.Since each light passes through the position 2D on sensor
It sets and horizontal and vertical incidence angle is characterized, thus 2 more dimensions of addition, so the light field captured is actually
4 dimensions.The light field projected creates in entire big optical depth range clearly image on object.
, it is preferable to use microlens array in technology described above.It is encoded in series classification attenuating masks and aperture
In mask, it is attenuated by some light of mask, so as to cause loss of strength.In microlens array, greater percentage is used
Available light.
Microlens array is located between the lens and imaging sensor of full light camera.Microlens array is captured lens
Light refocuses on imaging sensor, thus many small images that creation is shot from slightly different viewpoint.3D information is deposited
In small image, each small image is generated by single lenticule for storage.Each small image has relatively low spatial discrimination
Rate.
Another type light-field capture camera without using microlens array is saturating using so-called scanning focused or scanning
The system of mirror technology.In this camera, change condenser lens and/or sensor position during capturing image.The technology phase
When in the integral (intergrate) image when scanning focused (in specific depth of field range).Gained image includes for gathering
Coke scanning all image informations and also capture all available lights.Captured image can be deconvoluted to provide various depths
Clear image at degree and rebuild full light projection light field.It is preferable to use microlens arrays, because light field can be obtained instantaneously
?.By using lenticule, projection light field pair that the capture light field that is relatively easily captured camera and projector are projected
It is quasi-.
Preferably, camera and projector share the public chain of optical imaging element along shared coaxial optical axis.This makes
The light field captured can be preferably aligned with the light field projected.
Preferably, system includes the element for the offer plenoptic function being located in shared coaxial optical path.
Element by providing the offer plenoptic function in shared coaxial path increases what alignment was captured and projected
The convenience of light field.
This element can be microlens array, code aperture, wavefront coded device.
In these elements, preferred microlens array.
In embodiment, system include for split from common optical axis to light-field camera and correspondingly from light field projector to
The beam splitter of the optical path of common optical axis, beam splitter have dichroic spectral selection attribute.Dichroic beam splitters are by EO-1 hyperion
Light in range transmits or is reflected into camera, while reflecting or transmitting the light in the visible range from projector.
In another embodiment, it is illuminated using spectral selection.
In a preferred embodiment, system is mobile system, preferably portable system, such as hand held system.For example,
This allows doctor to check vein immediately and at the scene.When that must be inserted into needle in vein, this site inspection is very big
Advantage.
In another preferred embodiment, which is a part of surgical operation working flare.
In another embodiment, system is a part of larger system.Larger system further includes for providing observation object
Internal image on secondary (secondary) image data secondary imaging system, wherein system includes based on being captured
The data of EO-1 hyperion light field provide the processor of depth information and secondary data are formatted as throwing based on depth information
The device of image of the shadow on object.Secondary imaging system may, for example, be x-ray system, MRI, CT, PET-CT or ultrasound system
System.
Detailed description of the invention
By the exemplary embodiment that following accompanying drawings will be used to be described, will become in terms of these and other objects and advantage
It obtains obviously.
Fig. 1 shows the embodiment of the system according to the present invention；
Fig. 2 shows another embodiments of the system according to the present invention；
Fig. 3 shows another embodiment of the system according to the present invention；
Fig. 4 shows the handheld device including the system according to the present invention；
Fig. 5 is shown to be enhanced using the vein image of hand held system as shown in Figure 4；
Fig. 6 shows surgical operation or dentist's lamp including the system according to the present invention；
Fig. 7 and 8 shows the x-ray system including the system according to the present invention；
Fig. 9 shows using lenticule the principle for capturing light field and projecting light field；
Figure 10 shows the method for finely tuning the corresponding relationship between the light field for capturing and projecting.
Attached drawing is not drawn to scale.In general, same component makes to be indicated by the same numeral in the accompanying drawings.
Specific embodiment
The object of the present invention is to provide a kind of result images as observed structural projection, however with this side
Formula make projection it is always correct focus organizationally, without the surface curvature of tubing or its relative to capture/projection device
How is orientation.
High light spectrum image-forming provides contrast, such as the sightless contrast in tissue of naked eyes.For example, improved contrast can be with
For being introduced into period announcement blood vessel and nerve in vein in surgical operation or by needle.It can also be used to mark malignant tissue.
High spectrum image capture can based on monochromatic non-spectral selective image sensor and using imaging sensor it
Preceding spectral selection filtering is similar to conventional RGB camera but has more Color Channels and have different filterings special
Point.Otherwise, high spectrum image capture can also be based on spectral selection (control) illumination and unfiltered imaging sensor
Combination.The combination of " illumination of filtering " and " acquisition of filtering " is also possible.
By way of the linear weighted combination for the different spectrum input values of same spatial location, usually by different materials
Spectral response difference between material is converted to visible contrast (b/w or pseudo-colours).A variety of different predefined weight combinations cause
Different contrast in tissue.Therefore, the result from high spectrum image capture is usually to have interested material (liquid or group
Knit) enhancing contrast image.In this way, for example, it may be possible to subtle compared to such as skin based on them but be different
Spectral response discloses the position of vein and artery.Corresponding result images are described under the skin area observed by being directly in
Blood vessel structure.It is an object of the invention in real time and with observed tissue it is constant be correctly aligned by result images
Live fluoroscopic is in observed tissue.
The shortcomings that current Hyperspectral imager, is generally placed at, and result data individually occurs on the display screen, makes
It obtains and is easily lost with the geometrical relationship of live tissue.Nowadays, it is held in form display screen using the true glasses of amplification
The popular approach of tissue constant alignment observed by the result data generated in glasses and surgeon.Major defect is, this
It is required that for the headset equipment that the position of working region tracks its position and orientation, to increase this solution
Complexity.In addition, it forces expert to wear special glasses.In addition, there are many people in operating room；If only expert takes
With special glasses, then what assistant cannot see that expert watching is what, unless their also wearing spectacles and eyes
The position of mirror and orientation are also tracked, to greatly increase the complexity of system.
It is an object of the present invention to provide a kind of system and method, allow to see institute directly and with correct alignment
The EO-1 hyperion details of the object of observation to image tracing or wears special glasses without 3D.
Fig. 1 shows the embodiment of system and a method according to the invention.
In this example it is tissue in object 1() on, EO-1 hyperion light is irradiated from EO-1 hyperion source 2.The light source can be
A part of system, and in a preferred embodiment, it is, or can be provided separately.EO-1 hyperion source for example in IR or
This is set to organize the formation of high spectrum image in UV.Alternatively, object itself can independently of EO-1 hyperion light source presence and mention
For high spectrum image, that is, the image in human eye wavelength that can't see or be difficult to see that.For example, the object can be provided with object
Matter, the substance issue phosphorescence after the past is illuminated in specific wavelength.
Alternately or additionally, tissue 1 can even provide IR figure in the case where no light source irradiated thereon
Picture, the IR image show sightless details in visible wavelength in IR wavelength.Alternately or additionally, it can use supply
Irradiation object is carried out in the source of visible light and, for example, UV and/or IR light, in the optical path to camera or provides wavelength in the camera and selects
Selecting property element makes cameras record high spectrum image.
Alternately or additionally, camera can be provided with the sensor picture that image is electronically recorded in visible light
Element and in EO-1 hyperion radiation scope record image sensor pixel, and the data from EO-1 hyperion sensitive pixels by with
In EO-1 hyperion light field.
It is still possible that using including all quick to visible light and EO-1 hyperion (such as part IR and/or UV of spectrum) radiation
The light-field camera of the pixel of sense, and wavelength selective filter device is placed in chronological order, visible light and EO-1 hyperion are provided
Before the source of radiation, wherein filter transmits the EO-1 hyperion part of visible light or spectrum and makes to obtain from the data of light-field camera
Take the light field data neutralized in the visible part for being also likely to be spectrum in order to provide bloom spectral limit synchronous with time-sequential illumination.
In embodiment, high spectrum image is shot in UV the or IR range of electromagnetic spectrum.These embodiments are preferred.
However, it is possible to for example shoot height by means of x-ray imaging or terahertz imaging in other electro-magnetic spectrum ranges
Spectrum picture.
For this embodiment, light-field camera is to provide light field data in the X-ray of electromagnetic spectrum or Terahertz part
X-ray or terahertz imaging equipment.
4D light field provided by tissue is captured by lens system 5 as light-field camera 3.Lens system 5 includes 6 He of beam splitter
Microlens array 7.Show captured light field by CLF table in Fig. 1.Light-field camera includes the sensor for capturing light field on it.
Via data of the image processor 8 in the captured light field of the offer of light field projector 4.Therefore, the output offer of camera is used for
The data of the input of projector.However, " providing data " is not construed as meaning that camera data is supplied effectively directly into throwing
Shadow instrument, but camera data forms the basis of the data for projector.Output and light field projector 4 in light-field camera 3
The processing of data can be provided between input.Light field PLF is projected in by light field projector via beam splitter 6 and microlens array 7
On tissue 1.Preferably, light source forms a part of system.This enables control over the intensity for the light being radiated on object 1.Fig. 1
Implementation be illustrated a kind of system, wherein shooting high spectrum image in UV or IR.As set forth above, it is possible to clap in various ways
Take the photograph such image.For simplicity, wavelength selective element is being not shown in the figure.This wavelength selective element can be such as
It is placed on before source or before camera, or if camera includes to be used for visible light rather than the different pixels of UV or IR,
Data can be filtered electronically, i.e., be filtered by means of data filter to data acquired in light-field camera.
Due to the reason of the short focus of the lenticule in generally microlens array, so microlens array tends to creation
Closely focus on the subsequent micro- pattern matrix of lens array.Between microlens array 7 and beam splitter 6 and also point
The subsequent optical lens system relay (relay) of beam device is somebody's turn to do (micro-) plane of delineation, so that the sensor of micro- plane of delineation and camera
It plane and is overlapped with the plane of the pattern-creating element in projector.Pattern-creating element can be, for example, light-emitting component battle array
Column and switched mirror (usually DLP element) array or LCD optical shutter array.
Projector 4 and camera 3 share public coaxial optical axis.It is that common light is shown in FIG. 1 in the parallel fact by light
Axis.It is using the advantages of common optical path for image capture and projection, the covering projected and associated tissue are good
Alignment.In addition to for sensing with the scaling of the difference in projection element size, complicated 3D processing is not required.
Each lenticule may be considered super-pixel, and the super-pixel not only stored angles information, additionally storage should " super picture
The intensity of incident light at the position of element ".Similarly, generating will with the projector of the associated identical micro- image of microlens array
The projection for causing its focal plane to be overlapped with initial surface plane, but regardless of its curved shape how.Use common optical path and biography
Sensor is directed at the projection that will lead on the surface for always focusing on using camera and capturing with projector pixel.Because of lenticule
Array will not decay light field, and it is advantageous to use microlens array.
The system, which can be referred to as, provides the reality system of the full light EO-1 hyperion amplification of range constant capture and projection.
Depending on application, beam splitter 6 can also provide spectral selection.Particularly when image capture is mainly invisible
When in area of light (such as IR), beam splitter can have dichroic attribute.In this case, incident IR light is followed towards camera
Straight line path, and the visible light from projector is reflected by beam splitter.
The embodiment of the system according to the present invention is also shown in Fig. 2.Reflecting mirror is used to fold projected light field.At certain
This allows the more compact design of system in a little situations.
Fig. 3 shows another embodiment.In this embodiment, camera and projector include different microlens arrays.Fig. 1
System with 2 is preferred, but for example, if the spectral wavelength of high light spectrum image-forming requires to be poorly suited for visible wavelength
Individual microlens array then can be used in the certain material of lenticule.In fig. 1-3, camera and projector are along common light
Axis shares public image-forming component.
Figure 4 and 5 show the preferred embodiment of system.In this embodiment, system is mobile system, preferably portable
Formula system.In this embodiment, system is hand held system.System includes EO-1 hyperion source, camera and throwing in handheld device
Shadow instrument, wherein portable device is used to capture tissue area and for example provide sightless number in other ways in venous locations
According to projection, as shown in Figure 5.Be wherein quickly found out that vein is important or even essential situation in, set using portable
The standby appropriate image capture for realizing such as vein and the clear image suitably projected provide very big advantage.When for example in urgent feelings
When inserting a needle into vein in shape (such as accident), quickly and accurately works and be only required to easily operate and by band
Relatively simple equipment to emergency situations may be most important or even concerning life and death.Existing system do not provide it is accurate and
There is provided the image of the position of vein in real time and in the scene of the accident or a possibility that other EO-1 hyperion details.Figure 4 and 5 it is portable
Formula system does not provide this possibility.Under such case example, system is hand-held.The system can be worn on the helmet
Or makes both hands freely contact pin on sleeve or execute other medical procedures.
Fig. 6 shows use of the system according to the present invention in surgery operating lamp or dentist's lamp.Optionally, lamp can
To provide part of the spectral selection illumination to capture as high spectrum image.
In another embodiment, the present invention may be incorporated in including secondary imaging system (such as x-ray imaging system)
In system, or more generally merges and generating the system of the internal image of observation object (such as in patent application
System described in WO2010067281) in.
The schematic diagram of the system for this embodiment is shown in Fig. 7.
System includes being attached to UV, visible or sensitive infrared wavelength two cameras X-ray C-arm.Shown C-arm
X-ray system includes bedframe 72, which moves on wheel 71 and C-arm 73 is located at bedframe 72
Place is so that C-arm 73 can rotate (revolution) around axis 74, so that it can also be on the direction of double-head arrow 76 around axis 75
It turns to (track rotation).Although x-ray system can also be solid as in conduit room there has been described mobile system
Determine on the wall.With 180 degree x-ray source 77 relative to each other and detector 81(preferably rectangular planar detector) in C-arm 73
End region in be fastened to C-arm 73.
X-ray C-arm can obtain the three-dimensional internal image of patient.Camera system 82 be attached to the side of detector 81 and
The image that patient operates field can be captured.In a particular embodiment, camera system can carry out three-dimensional imaging to patient.In addition,
Hyperspectral imager 83 according to the present invention is also affixed to detector 81 and can be focused on the bending table of patient with image
This mode on face projects back to information on patient in visible light.For example, structure (such as tumor boundaries) is in EO-1 hyperion
Preferably describe in image and can be projected back on patient in visible light according to the present invention.This make tumor boundaries for
Surgeon is more visible.In addition to the high light spectrum image-forming returns to projection, by system 83 to captured by x-ray system and being turned
It is possible for changing the return projection of the image of visual picture into.For example, visible in the case where x-ray imaging be deep into human body
Internal knub position, which is projected, to be returned on patient body.In this way, surgeon has the more preferable instruction of tumour position.Together
Sample can indicate important feature, such as be located exactly at lower face and the sightless big blood vessel of human eye.In this way, when in the position
When setting place's notch, surgeon carefully understands in advance.Replace x-ray system, similar approach also can be applied to MRI, CT, PET-
CT or ultrasonic system.Also terahertz imaging system can be used.All these systems provide the internal image of observation object, and
In all cases, data source generates 2D image stream, which forms secondary in addition to the data obtained based on camera
Data acquisition system.
In the system in fig. 7, the opposite position of Hyperspectral imager and secondary imaging system (x-ray system in Fig. 7)
It is known and fixed for setting.This enables EO-1 hyperion and internal imaging relatively simply to match.
In the relative position of wherein Hyperspectral imager and secondary internal imaging system more or less to a greater extent
In variable system, it is preferable to provide device is to determine the relative position of high light spectrum image-forming and secondary imaging system.This can be certainly
It is dynamic to complete, such as by providing electronic device to measure X, Y and Z coordinate of two imaging systems, and preferably also measurement at
As the orientation or axis of system (if the information is related).Certainly, this can also be by being manually entered this data come complete
At.Alternately or additionally, Lock-in or it is special be placed within the scope of respective image be present in high spectrum image and
Characteristics of image in secondary image can be used to be directed at high spectrum image and secondary image.For example, will be in EO-1 hyperion and visible
And the small metal object with patient shown in radioscopic image at various points can be used for the purpose.
Fig. 8 further illustrates the system of Fig. 7.The use of this secondary image data from such as X-ray data is wanted
The explicit algorithm of depth map d (x, y) is sought, full light phase of depth map d (x, the y) description for each pixel (x, y) of projector
Machine/the distance between projector and tissue surface d.This with require nothing more than space interpolation with by the input pixel grid of full light camera
The full light camera data itself for being fitted on the output pixel grid of projector is contrasted.
The light field captured includes depth information.In order to restore distance profile from the light field data that is captured, such as pass through
T. Bishop, P. Favaro " the Plenoptic depth estimation from multiple of Bishop et al.
Aliased views " (IEEE 12th International Conference on Computer Vision in 2009
Workshops(ICCV Workhshops), IEEE, the 1622-1629 pages, Los Alamitos, 2009) and Wanner et al.
S. Wanner, J. Fehr, B. Jaehne " Generation EPI representations of 4D light
Fields with a single lens focused plenoptics camera " (Proc. ISVC 2011, G.
Bebis et al., the 90-101 pages, 2011) propose various solutions.Then, this becomes to be held by the processing block 8 in Fig. 8
Capable special duty.Then, the depth map d (x, y) restored is used in part 9 will be from the image weight in secondary data source
Format turns to micro- pattern matrix.Then, in the case where being properly aligned with microlens array, secondary data will also be with suitably poly-
Coke is projected on tissue surface, but regardless of its shape and orientation how.Although it is not shown, part 9 also can have
The input of the data on relative position and/or orientation for inputting EO-1 hyperion and x-ray imaging system.
Fig. 9 shows using lenticule the principle for capturing light field and projecting light field.The top section of Fig. 9 shows light field
Capture.The spatial information of full light imaging storage incident field.Using microlens array, 3D information is stored in
In small micro- image, each small micro- image is generated by the single lenticule in microlens array.Since each light passes through sensing
The position 2D and horizontal and vertical incidence angle on device are characterized, thus 2 more dimensions of addition, so the light captured
Field is actually 4 dimensions.
Each lenticule may be considered super-pixel, the super-pixel not only stored angles information but also storage " super-pixel "
Position at incident light intensity.
The bottom part of Fig. 9 shows the pixel projection light field from projector 4.Light is reversed.Generation and lenticule
The projector of the associated identical micro- image of array will lead to the projection that its focal plane is overlapped with initial surface plane, but regardless of it
How is curved shape.It will lead to always to focus on using the alignment of common optical path and sensor and projector pixel and utilize camera
Projection on the surface of capture.If all elements are all accurately identical, size is identical, and position is mutually same, then in camera
There is simple one-one relationship between pixel and the pixel of projector.In reality, the two are in size or accurate location side
It face can be different.However, relationship keeps translation (T) and scales the simple task of (S).This is executed in a processor 8.
It can also be by providing the dress for translating sensor or projection surface in the x and y direction for projector or camera
It sets mechanically to complete translation task.
In Fig. 9, by with common optical element, and especially it is to provide the common element of plenoptic function, lenticule
Array 7 increases the corresponding relationship between image recording and the optical path of projection, to simplify processing.
Figure 10 shows the method for finding the required Pan and Zoom factor.
In Figure 10, test image T is provided, test image T is from sending the number on recorded image to processor 8
According to camera 3 record；Processor 8 by for example by previous computer generate ray trace camera and projector hypothesis
The initial T and S-transformation for knowing feature and finding are applied to data and transmit data to projector 4.The image projected and survey
Attempt as being compared, this can for example be come using the independent camera of both images for being able to record high spectrum image and being projected
It completes.If test image and the picture registration projected, using the preset value for being used for T and S, otherwise, the value of T and S change
Until test image and the picture registration projected.This is a kind of mode for finding T and S value.In fig. 10 it is shown that with
In by adjusting Pan and Zoom factor T and S so that test image T is aligned with the light field image projected makes according to the present invention
System light-field camera and light field projector alignment method.In a preferred method according to the invention, light field figure is being obtained
Before picture and projection light field image, the test and alignment procedures are carried out.
In short, the present invention can be described as follows briefly:
Imaging system includes the light-field camera 3 for recording EO-1 hyperion light field (CLF).The system further includes for visible
The light projector 4 of light field (PLF) is projected in light.Camera and projector share common optical axis.Projector is based on light-field camera and is caught
The EO-1 hyperion light field (CLF) that obtains projects light field (PLF).
The invention is not limited to shown in figure or example described above embodiment.For those skilled in the art
It will be clear that many modifications are all possible.
Word " comprising " be not excluded for it is except as listed in a claim go out those of except other element or steps presence.Member
The presence of multiple this elements is not precluded in the article " one " or the use of "one" before part.
Word " device " includes any device, but regardless of its form be for execute the software of specified function, hardware or its
Any combination.
Such as when from light-field camera to part 8 send light field data to be processed with to projector 4 provide projected light number of fields
According to when, the different elements of system can with and be preferably in individual equipment, but various elements can be located at various physical bits
Set place.The part 8 can be in identical equipment with camera and projector, and preferably also may be in CPU or mutual
It is shared on website in networking or by various systems.Data can be passed through wired and wireless by any device for being used for transmission data
Part 8 is transferred to from camera 3.This is equally applicable to the data from part 8 to projector 4.
For wherein completing those of present invention embodiment by means of software, the present invention is also generally or partly
It is related to a kind of including may be stored on the computer-readable medium for executing program code devices according to the method for the present invention
Computer program product, and it is related to a kind of computer program product by computer arrangement load comprising for according to this
The instruction of the method for invention.
Claims (13)
1. a kind of system including Hyperspectral imager, the Hyperspectral imager include:
For recording the camera of the high spectrum image of object, and
For showing the display equipment of the high spectrum image in visible light,
Wherein the camera is light-field capture camera and the display equipment is light field projector, wherein the camera and projection
Instrument shares coaxial optical path, and wherein the camera is arranged in spectral radiance range at least partly sightless for human eye
Middle capture EO-1 hyperion light field, thus to obtain the high spectrum image of the object, and wherein the light-field capture camera includes using
The output of the data in captured EO-1 hyperion light field is sent in the input to the light field projector, and the light field projects
Instrument be arranged to based on from the received data of light-field capture camera come the light field on the object in projected visible-light；
The system also includes:
The secondary imaging system of the secondary image data on three-dimensional internal image for providing observation object；And
There is provided depth information and based on the depth information based on the data of the EO-1 hyperion light field captured come by described two
Secondary image data format turns to the processor for using image of the light field projector on the object.
2. the system as claimed in claim 1, wherein the light-field camera and light field projector are total along shared coaxial optical axis
Enjoy the public chain of optical imaging element.
3. system as claimed in claim 1 or 2, wherein the Hyperspectral imager includes being positioned in shared axis light
The element of offer plenoptic function in road.
4. system as claimed in claim 1 or 2, wherein the Hyperspectral imager includes providing the lenticule of plenoptic function
Array.
5. system as claimed in claim 4, wherein the microlens array is total by the light-field camera and light field projector
Element.
6. system as claimed in claim 1 or 2, wherein the Hyperspectral imager include for split from common optical axis to
The light-field camera and the correspondingly beam splitter of the optical path from the light field projector to common optical axis, the beam splitter have two
To the spectral selection attribute of color.
7. system as claimed in claim 1 or 2, wherein the Hyperspectral imager is mobile system.
8. system as claimed in claim 1 or 2, wherein camera is for recording bloom in the part IR or UV of electromagnetic spectrum
Compose the camera of light field.
9. system as claimed in claim 1 or 2, wherein the secondary imaging system be x-ray imaging system, MRI, CT,
PET-CT or ultrasonic image-forming system.
10. a kind of method for recording high spectrum image and showing in visible light the high spectrum image, wherein object
Light field in spectral radiance range at least partly sightless for human eye is captured by light-field camera, thus to obtain the object
High spectrum image, the data in light field captured to the camera are handled to provide projected image number to light field projector
According to the light field projector projects light field based on the projecting image data on object, wherein the camera and projection
Instrument shares coaxial optical path, and the light field in visible light by the light field projector on the object, to the light field
The data in light field that camera is captured are handled to provide depth information, and wherein in the three-dimensional internal figure of the object
The secondary image data is reformatted using the depth information as upper offer secondary image data, and wherein, and
The data of the reformatting are provided to the light field projector.
11. method as claimed in claim 10, wherein capturing the light field in the part IR or UV of electromagnetic spectrum.
12. method as claimed in claim 10, wherein the secondary image data is by x-ray imaging system, MRI, CT, PET-
CT or ultrasonic system provide.
13. a kind of device, including memory and processor, the memory is for storing machine-executable instruction, the machine
Executable instruction is for method described in any one of requirement of perform claim when executed by the processor 10 to 12.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201361803169P | 2013-03-19 | 2013-03-19 | |
| US61/803169 | 2013-03-19 | ||
| PCT/IB2014/059652 WO2014147515A1 (en) | 2013-03-19 | 2014-03-12 | System for hyperspectral imaging in visible light, method for recording a hyperspectral image and displaying the hyperspectral image in visible light |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104380066A CN104380066A (en) | 2015-02-25 |
| CN104380066B true CN104380066B (en) | 2018-12-21 |
Family
ID=50397213
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201480001605.0A Active CN104380066B (en) | 2013-03-19 | 2014-03-12 | For the system of high light spectrum image-forming, the method for recording and displaying high spectrum image |
Country Status (7)
| Country | Link |
|---|---|
| US (1) | US9736402B2 (en) |
| EP (1) | EP2976609B1 (en) |
| JP (1) | JP5974174B2 (en) |
| CN (1) | CN104380066B (en) |
| BR (1) | BR112014028811B1 (en) |
| RU (1) | RU2655018C2 (en) |
| WO (1) | WO2014147515A1 (en) |
Families Citing this family (31)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102012222375B3 (en) * | 2012-12-06 | 2014-01-30 | Siemens Aktiengesellschaft | Magnetic coil device for investigation on head of patient, has light field camera element which is provided in camera unit of magnetic coil assembly, such that camera element is arranged within receiving region surrounding shell unit |
| US10107747B2 (en) * | 2013-05-31 | 2018-10-23 | Ecole Polytechnique Federale De Lausanne (Epfl) | Method, system and computer program for determining a reflectance distribution function of an object |
| DE102014210938A1 (en) * | 2014-06-06 | 2015-12-17 | Siemens Aktiengesellschaft | Method for controlling a medical device and control system for a medical device |
| WO2016048911A1 (en) * | 2014-09-22 | 2016-03-31 | Invuity, Inc. | Hyperspectral imager |
| US20160205360A1 (en) * | 2014-12-04 | 2016-07-14 | Stephen Allen | Systems and methods for facilitating placement of labware components |
| US9906759B2 (en) | 2015-04-09 | 2018-02-27 | Qualcomm Incorporated | Combined processing and display device package for light field displays |
| CN104887181A (en) * | 2015-04-29 | 2015-09-09 | 浙江大学 | Portable vein projector |
| WO2016195684A1 (en) * | 2015-06-04 | 2016-12-08 | Siemens Healthcare Gmbh | Apparatus and methods for a projection display device on x-ray imaging devices |
| CN106331442B (en) | 2015-07-02 | 2021-01-15 | 松下知识产权经营株式会社 | Image pickup apparatus |
| US10317667B2 (en) * | 2015-07-04 | 2019-06-11 | The Regents Of The University Of California | Compressive plenoptic microscopy for functional brain imaging |
| CN105158888B (en) * | 2015-09-29 | 2020-09-11 | 南京理工大学 | Programmable microscope condenser device based on LCD (liquid crystal display) panel and imaging method thereof |
| JP2017080159A (en) * | 2015-10-29 | 2017-05-18 | パイオニア株式会社 | Image processing apparatus, image processing method, and computer program |
| US10448910B2 (en) * | 2016-02-03 | 2019-10-22 | Globus Medical, Inc. | Portable medical imaging system |
| WO2017147528A1 (en) | 2016-02-26 | 2017-08-31 | University Of Southern California | Optimized volumetric imaging with selective volume illumination and light field detection |
| DE102016207501A1 (en) * | 2016-05-02 | 2017-11-02 | Siemens Healthcare Gmbh | Method for operating a magnetic resonance device and magnetic resonance device |
| EP3284396B1 (en) * | 2016-08-16 | 2020-02-12 | Leica Instruments (Singapore) Pte. Ltd. | Observation apparatus and method for visual enhancement of an observed object |
| JP7313280B2 (en) * | 2016-09-09 | 2023-07-24 | インテュイティブ サージカル オペレーションズ， インコーポレイテッド | Simultaneous White Light and Hyperspectral Light Imaging System |
| CN110461270B (en) * | 2017-02-14 | 2023-01-10 | 阿特雷塞斯有限责任公司 | High speed optical tracking with compression and/or CMOS windowing |
| EP3379487B1 (en) * | 2017-03-21 | 2023-10-04 | Siemens Healthcare GmbH | Contrast enhanced reproduction of spectral ct image data |
| GB201713512D0 (en) * | 2017-08-23 | 2017-10-04 | Colordyne Ltd | Apparatus and method for projecting and detecting light on a 2D or 3D surface, e.g. for semantic lighting based therapy |
| CN109087341B (en) * | 2018-06-07 | 2022-07-05 | 华南农业大学 | Fusion method of close-range hyperspectral camera and ranging sensor |
| CN108836506A (en) * | 2018-07-20 | 2018-11-20 | 东北大学 | A kind of black light for operation shows that equipment and optics instruct system |
| CN108937992B (en) * | 2018-08-06 | 2020-10-23 | 清华大学 | In-situ visualization system for X-ray perspective imaging and calibration method thereof |
| GB201817092D0 (en) * | 2018-10-19 | 2018-12-05 | Cancer Research Tech Ltd | Apparatus and method for wide-field hyperspectral imaging |
| US11550145B2 (en) | 2019-01-16 | 2023-01-10 | Korea Photonics Technology Institute | Optical system for implementing augmented reality and device including the same |
| KR102222076B1 (en) * | 2019-03-19 | 2021-03-03 | 한국광기술원 | Optical System for Realizing Augmented Reality and Medical Augmented Reality Apparatus Including the Same |
| GB201902668D0 (en) * | 2019-02-27 | 2019-04-10 | Colordyne Ltd | Appoaratus for selectively illuminating a target field, for example, in a self dimming headlight system |
| JP7281632B2 (en) * | 2019-06-25 | 2023-05-26 | パナソニックＩｐマネジメント株式会社 | projection system |
| CN112001998B (en) * | 2020-09-02 | 2021-02-19 | 西南石油大学 | Real-time simulation ultrasonic imaging method based on OptiX and Unity3D virtual reality platforms |
| US20220319031A1 (en) * | 2021-03-31 | 2022-10-06 | Auris Health, Inc. | Vision-based 6dof camera pose estimation in bronchoscopy |
| WO2024086564A1 (en) * | 2022-10-17 | 2024-04-25 | Monogram Orthopaedics Inc. | Markerless tracking with spectral imaging camera(s) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1999022640A2 (en) * | 1997-10-30 | 1999-05-14 | Hypermed Imaging, Inc. | Multispectral/hyperspectral medical instrument |
| US20060247514A1 (en) * | 2004-11-29 | 2006-11-02 | Panasyuk Svetlana V | Medical hyperspectral imaging for evaluation of tissue and tumor |
| US20080027317A1 (en) * | 2006-06-29 | 2008-01-31 | Fred Wood | Scanned laser vein contrast enhancer |
| CN101980663A (en) * | 2008-03-28 | 2011-02-23 | 皇家飞利浦电子股份有限公司 | Object localization in x-ray images |
| CN102245106A (en) * | 2008-12-11 | 2011-11-16 | 皇家飞利浦电子股份有限公司 | System and method for generating images of a patient's interior and exterior |
| CN102421365A (en) * | 2009-05-13 | 2012-04-18 | 皇家飞利浦电子股份有限公司 | System for detecting global patient movement during imaging procedures |
| US20120200829A1 (en) * | 2011-02-09 | 2012-08-09 | Alexander Bronstein | Imaging and projecting devices and methods |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP4625956B2 (en) * | 2004-08-27 | 2011-02-02 | 国立大学法人東京工業大学 | Image processing apparatus and image processing method |
| US9078619B2 (en) * | 2004-12-28 | 2015-07-14 | Hypermed Imaging, Inc. | Hyperspectral/multispectral imaging in determination, assessment and monitoring of systemic physiology and shock |
| GB0602137D0 (en) * | 2006-02-02 | 2006-03-15 | Ntnu Technology Transfer As | Chemical and property imaging |
| US20080298642A1 (en) * | 2006-11-03 | 2008-12-04 | Snowflake Technologies Corporation | Method and apparatus for extraction and matching of biometric detail |
| JP2010517733A (en) | 2007-02-14 | 2010-05-27 | ルミネトクス コーポレイション | Apparatus and method for projecting subcutaneous structure onto object surface |
| EP2075616A1 (en) * | 2007-12-28 | 2009-07-01 | Möller-Wedel GmbH | Device with a camera and a device for mapping and projecting the picture taken |
| US8897522B2 (en) * | 2012-05-30 | 2014-11-25 | Xerox Corporation | Processing a video for vascular pattern detection and cardiac function analysis |
-
2014
- 2014-03-12 RU RU2014153621A patent/RU2655018C2/en active
- 2014-03-12 BR BR112014028811-9A patent/BR112014028811B1/en active IP Right Grant
- 2014-03-12 EP EP14714393.7A patent/EP2976609B1/en active Active
- 2014-03-12 JP JP2015521141A patent/JP5974174B2/en active Active
- 2014-03-12 WO PCT/IB2014/059652 patent/WO2014147515A1/en active Application Filing
- 2014-03-12 US US14/400,200 patent/US9736402B2/en active Active
- 2014-03-12 CN CN201480001605.0A patent/CN104380066B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO1999022640A2 (en) * | 1997-10-30 | 1999-05-14 | Hypermed Imaging, Inc. | Multispectral/hyperspectral medical instrument |
| US20060247514A1 (en) * | 2004-11-29 | 2006-11-02 | Panasyuk Svetlana V | Medical hyperspectral imaging for evaluation of tissue and tumor |
| US20080027317A1 (en) * | 2006-06-29 | 2008-01-31 | Fred Wood | Scanned laser vein contrast enhancer |
| CN101980663A (en) * | 2008-03-28 | 2011-02-23 | 皇家飞利浦电子股份有限公司 | Object localization in x-ray images |
| CN102245106A (en) * | 2008-12-11 | 2011-11-16 | 皇家飞利浦电子股份有限公司 | System and method for generating images of a patient's interior and exterior |
| CN102421365A (en) * | 2009-05-13 | 2012-04-18 | 皇家飞利浦电子股份有限公司 | System for detecting global patient movement during imaging procedures |
| US20120200829A1 (en) * | 2011-02-09 | 2012-08-09 | Alexander Bronstein | Imaging and projecting devices and methods |
Non-Patent Citations (2)
| Title |
|---|
| Vein Imaging: A New Method of Near Infrared Imaging, Where a Processed Image Is Projected onto the Skin for the Enhancement of Vein Treatment;ROBERTO KASUO MIYAKE等;《Dermatologic Surgery》;20060831;第32卷(第8期);1031-1038 * |
| 长波红外高光谱成像系统的设计与实现;袁立银等;《红外与激光工程》;20110228;第40卷(第2期);181-185 * |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2014147515A1 (en) | 2014-09-25 |
| BR112014028811A2 (en) | 2017-06-27 |
| CN104380066A (en) | 2015-02-25 |
| RU2655018C2 (en) | 2018-05-23 |
| RU2014153621A (en) | 2016-07-20 |
| EP2976609B1 (en) | 2022-01-05 |
| US20150381908A1 (en) | 2015-12-31 |
| JP5974174B2 (en) | 2016-08-23 |
| JP2015529482A (en) | 2015-10-08 |
| EP2976609A1 (en) | 2016-01-27 |
| US9736402B2 (en) | 2017-08-15 |
| BR112014028811B1 (en) | 2020-11-17 |
| RU2014153621A3 (en) | 2018-03-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104380066B (en) | For the system of high light spectrum image-forming, the method for recording and displaying high spectrum image | |
| US20240000295A1 (en) | Light field capture and rendering for head-mounted displays | |
| ES2972214T3 (en) | Generation of one or more luminosity edges to form three-dimensional models of objects | |
| CN109429060B (en) | Pupil distance measuring method, wearable eye equipment and storage medium | |
| JP2017517794A (en) | Image processing method and image processing apparatus | |
| KR20110016896A (en) | System and method for generating a multi-dimensional image | |
| US20220346643A1 (en) | Ophthalmic imaging apparatus and system | |
| JP7053469B2 (en) | Systems and equipment for eye tracking | |
| AU2015411714A1 (en) | Ophthalmic surgery using light-field microscopy | |
| KR20140041012A (en) | Multi 3-dimension camera using multi pattern beam and method of the same | |
| JP7300895B2 (en) | Image processing device, image processing method, program, and storage medium | |
| JP2018060011A (en) | Display device | |
| KR102055254B1 (en) | Head mount system for supplying surgery assist image | |
| KR101133503B1 (en) | Integrated optical and x-ray ct system and method of reconstructing the data thereof | |
| Schmalz | Robust single-shot structured light 3D scanning | |
| Kagawa et al. | Variable field-of-view visible and near-infrared polarization compound-eye endoscope | |
| Fu et al. | Robust near-infrared structured light scanning for 3D human model reconstruction | |
| Kwan et al. | Development of a Light Field Laparoscope for Depth Reconstruction | |
| US12016642B2 (en) | Constellations for tracking instruments, such as surgical instruments, and associated systems and methods | |
| JP4682326B2 (en) | Marker recognition method and apparatus in optical motion capture | |
| US20240175677A1 (en) | Measuring system providing shape from shading | |
| US20230355319A1 (en) | Methods and systems for calibrating instruments within an imaging system, such as a surgical imaging system | |
| JP2010249907A (en) | Photographing device and imaging method | |
| KR20240100446A (en) | Systems and methods for medical imaging | |
| JP2016146606A (en) | Image processing system and image processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |