EP4437736A1 - Medizinische bildgebungsvorrichtung sowie verfahren zum kalibrieren einer medizinischen bildgebungsvorrichtung - Google Patents
Medizinische bildgebungsvorrichtung sowie verfahren zum kalibrieren einer medizinischen bildgebungsvorrichtungInfo
- Publication number
- EP4437736A1 EP4437736A1 EP22821894.7A EP22821894A EP4437736A1 EP 4437736 A1 EP4437736 A1 EP 4437736A1 EP 22821894 A EP22821894 A EP 22821894A EP 4437736 A1 EP4437736 A1 EP 4437736A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- image
- image information
- sensor
- calibration
- recording device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/555—Constructional details for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00011—Operational features of endoscopes characterised by signal transmission
- A61B1/00013—Operational features of endoscopes characterised by signal transmission using optical means
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00057—Operational features of endoscopes provided with means for testing or calibration
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00163—Optical arrangements
- A61B1/00172—Optical arrangements with means for scanning
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B23/00—Telescopes, e.g. binoculars; Periscopes; Instruments for viewing the inside of hollow bodies; Viewfinders; Optical aiming or sighting devices
- G02B23/24—Instruments or systems for viewing the inside of hollow bodies, e.g. fibrescopes
- G02B23/2476—Non-optical details, e.g. housings, mountings, supports
- G02B23/2484—Arrangements in relation to a camera or imaging device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/61—Noise processing, e.g. detecting, correcting, reducing or removing noise the noise originating only from the lens unit, e.g. flare, shading, vignetting or "cos4"
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
- A61B1/00002—Operational features of endoscopes
- A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
- A61B1/00006—Operational features of endoscopes characterised by electronic signal processing of control signals
Definitions
- the invention relates to a medical
- Imaging device in particular a laparoscope
- Endoscope and / or an exoscope with a light source for
- Image recording device with a sensitivity distribution, so that the first image information from the
- Image recording device is recorded, and for imaging a second piece of image information of the viewing area on the image recording device, so that the second
- Image information is recorded by the image recording device, and a setting device for setting
- Image parameters of the image recording device Furthermore, the invention relates to a method for calibrating a medical imaging device according to the type described above.
- Image recording device acts as part of a
- medical imaging devices with so-called hyperspectral imaging are also known, for example, with hyperspectral imaging being used, for example, to produce a line-by-line
- Viewing area can be read.
- medical imaging devices for example
- Endoscopes with hyperspectral imaging must be calibrated at the factory, which, depending on the
- the object of the invention is to improve the prior art.
- Imaging device in particular a laparoscope
- Endoscope and / or an exoscope with a light source for
- Illuminating a viewing area an optic with an optical path for recording the viewing area and for imaging a first piece of image information
- Image information is recorded by the image recording device and for imaging second image information of the
- Image recording device is included, and one
- Control unit is assigned, the first
- Image information can be recorded by the control unit and the control unit uses the setting device as a function of the first image information for adapting the sensitivity distribution with a calibration correlation between the first image information and the second
- Image information controls so that by means of
- Image recording device is present.
- Image information can be recorded in such a way that a Intensity range of the image recording device, in which a particularly low-noise recording of image information is made possible, is used in the best possible way or a corresponding exceeding of a corresponding
- a “medical imaging device” can be any technical and/or electronic device that is suitable for recording, further processing and/or forwarding an image of a viewing area in a medical environment and, for example, on a
- Such a medical imaging device is an endoscope, a dual
- endoscope a stereo endoscope, an exoscope or a stereo
- exoscope is a mostly narrow and elongated imaging device, which is suitable for inserting it into a cavity or through a mostly small opening and inside the
- An "exoscope” is a comparable device that is used, for example, in medical interventions from the outside for imaging, i.e. in what is known as an open surgical procedure
- the "stereo" property of the respective endoscope or exoscope describes the ability by means of two optical paths and / or two optics a stereoscopic
- a corresponding dual endoscope or dual exoscope is in the
- a respective “endoscope” in the actual sense, as described above, is also integrated within an endoscope system with additional devices, such as cable routing, additional sensors and/or a display device for displaying image information on an external monitor can be.
- additional devices such as cable routing, additional sensors and/or a display device for displaying image information on an external monitor can be.
- endoscope and endoscope are also integrated within an endoscope system with additional devices, such as cable routing, additional sensors and/or a display device for displaying image information on an external monitor.
- a “laparoscope” is in particular a medical imaging device, which is the so-called
- Laparoscopy i.e. an examination of the abdomen, in particular the abdominal cavity.
- This is a type of endoscope, with a shaft of the laparoscope, which is particularly stiff, being inserted through a “trocar”.
- Guidance aid can be introduced into an abdominal cavity.
- Such a laparoscope includes, for example, a small camera at one end inserted into the abdominal cavity, which can also be referred to as an endoscope. Furthermore, a laparoscope also includes optical lens systems, i.e. a
- Optics which is used, for example, for enlargement.
- the laparoscope is comparable to the optical one
- a "light source” is, for example, an LED, a
- Incandescent lamp or other light-emitting device Incandescent lamp or other light-emitting device.
- Such a light source can also be realized in that a light generated by means of an LED or another light-generating device is directed or directed to a corresponding location in the viewing area by means of a light guide, for example a glass fiber or a glass fiber bundle.
- a light guide for example a glass fiber or a glass fiber bundle.
- a "Scope of View” describes the area that
- Such a viewing area is, for example, an organ, a bone, a partial area of a human or animal body or another area of interest for a corresponding one
- Imaging the observation area describes the introduction of light into the observation area, for example the irradiation of light of different wavelength ranges in the
- An "optics” describes the entirety of all components that direct light and / or image information or an image along the optical path.
- an optic includes such an optic with lenses, cover plates,
- An "optical path” is in particular the path which
- Optics passes through to, for example, the image recording device or to a respective image sensor.
- Such an optical path is defined, for example, by means of an optical axis or as a geometric course.
- Capturing the viewing area describes the guiding, directing and/or directing of image information or light information of the viewing area, for example an image of the viewing area via the optical path of the optics, so that imaging of corresponding image information is made possible.
- a "mapping" of a corresponding piece of image information describes the generation of a pixel from a
- pixels is performed. Such an imaging is done by an optical system.
- Image information of the viewing area is corresponding optically and/or electronically processed information that results from the imaging of the
- this is a Data format that represents an image of the viewing area.
- this image information also includes the optical properties, e.g.
- Image information i.e. the properties of light, towards digital image information, for example, is fluid.
- An "image recording device” is, for example, an electronic chip or another similar one
- Image recording device components of a CCD chip or a comparable electronic component wherein the
- Image recording device for example, different
- Components may have which different properties
- a "sensitivity distribution” describes the varying sensitivity of the
- Image recording device against incident light so that, for example, edge areas of
- Image recording device are less sensitive than a
- An "adjustment device” can be an optical, an electronic and/or a mechanical device which is suitable for adjusting image parameters
- Setting device can, for example, a
- an “image parameter” represents a property of corresponding image information, in particular one recorded by the image recording device
- Image information that can be influenced.
- Such an image parameter can in particular also be pixel-by-pixel, ie for a few pixels each or for everyone
- Pixel of the image recording device be fixed or changeable.
- Image parameters an exposure setting, an
- Image recording device compared to, for example, that
- a "control unit” which is, for example, a computer, a microprocessor or another type of device, for example a mechanical device, by means of which it is possible to act on the setting device in this way, is used to achieve a desired effect on the setting device
- a control unit can be a
- Be a computer which picks up corresponding signals, processes them according to a stored algorithm and then influences them in a targeted manner
- Adjusting device heard so that by means of
- the control unit controls the
- Image information such that the first image information is recorded and evaluated, for example, so that an adjustment of the sensitivity distribution with a
- Calibration correlation between the first image information and the second image information is enabled.
- Image recording device is adapted such that a
- Signal-to-noise ratio is advantageously achieved and / or a corresponding exposure is optimized.
- a "calibration” describes the process in which the sensitivity distribution with the Calibration correlation is superimposed, for example, and thus a calibrated sensitivity distribution is present.
- the calibration is the process that detects a deviation from an ideal and in a second
- Step towards a so-called "normal” corrected with corresponding deviations ideally being completely or at least largely eliminated by the calibration.
- Imaging device as simple as possible and with few
- the adjustment device can be introduced into the optical path by means of a switching device, so that the first image information from the
- Switching device in which the adjustment device is not introduced into the optical path, can be accommodated and the
- the setting device depending on the first image information for adapting the sensitivity distribution with a calibration correlation between the first image information and the second
- Controls image information the image recording device having in particular a first image sensor for recording the first image information and the second image information.
- a first image sensor which is used alone, can thus be switched by means of the switching device in such a way that the function according to the invention is fulfilled with only a first image sensor.
- a "switching device" is, for example, one
- the optical path is deflected around the adjustment device, so that in a first switching state the optical path runs around the adjustment device and in a second switching state the optical path runs in such a way that the adjustment device is in engagement with the optical path.
- the adjustment device can also be pivoted into the optical path or introduced in some other way, so that the first switching state
- Adjusting device is not introduced mechanically in the course of the optical path and is introduced in the second switching state in the direct optical path.
- the optical path has a first partial optical path for imaging the first
- Image information on the image recording device wherein the first image information can be recorded by the control unit in the first partial optical path and the control unit
- Image information controls, wherein the image recording device in particular one of the first partial optical path associated first image sensor with a first sensitivity distribution for recording the first
- a respective piece of image information can be recorded simultaneously by means of the first image sensor and the second image sensor, so that in particular the calibration correlation is formed and/or applied in real time, so that at best a simultaneous recording of the first image information and the second image information with a calibration
- Image information can be done.
- Partial paths is divided and corresponding image information is routed along a respective optical partial path and can therefore be imaged separately from one another, in particular on different image sensors.
- the processes are displayed within a specified time.
- the term "real time” is also used in such a way that, for example, for an operator the impression of the simultaneity of events, for example the perception of a "real-time” representation, arises according to the real time impression of the operator.
- a representation takes place in parallel with a
- Frame rate of more than 24 frames per second or a higher frame rate so that an operator can no longer distinguish between individual frames.
- the calibration correlation is formed using reference image information, in particular using different reference image information with in particular the respective exposure settings.
- Such "reference image information” is, for example, an image panel of a specific, uniform coloring, such as a white panel or a gray panel, based on which with a known
- Color distribution for example an exposure or other information regarding the calibration correlation can be reliably detected and the calibration correlation can be formed therefrom.
- an “image sensor” can be, for example, an electronic chip or another similar device by means of which light and/or a corresponding image traveling along the optical path and the respective optics can be recorded and converted into electronic signals.
- such an image sensor is a CCD chip or a comparable electronic component.
- the calibration correlation is based on a white balance and/or based on a
- Image sensor formed.
- Image information such as a photographic image
- Light source at a recording location for example at
- an adjustment of the color temperature is also mentioned.
- a "black balance" a setting is made in such a way that it is ensured that black parts of the image or black
- Components of the image information in particular from an electronic camera, such as an electronic image sensor, can also be reproduced in black and have no color distortion.
- an aperture is completely closed so that no more light falls on a corresponding image sensor.
- Corresponding individual signals from, for example, color channels of an image sensor are then adjusted in such a way that a corresponding image signal is output.
- Types of lighting such as appropriate
- Imaging device are stored, so for example when adjusting the light source or
- the respective calibration correlation is at least in principle already available.
- a further evaluating the first piece of image information by appropriately evaluating the first piece of image information, a further
- Image recording device in particular the second
- Image sensor and / or a frame number of
- Image recording device in particular the second
- Image sensor is adjustable and / or
- Exposure manipulator an exposure intensity and/or an exposure duration of the image recording device, in particular of the second image sensor, can be adjusted.
- Image recording device in particular the second
- Corresponding image information is recorded, for example by increasing the frame rate when it can be read from the first image information that the
- Exposure intensity of the second image sensor is sufficient and so that the frame rate can be increased accordingly without
- a corresponding frame number of the image recording device in particular of the second image sensor, can be assigned to a corresponding
- Calibration correlation or corresponding information of the first image sensor or the first image information can be adjusted, so that an exposure intensity and/or an exposure duration of the image recording device, in particular the second image sensor, can be set using this data, for example by a
- the image recording device has a spectral sensor, in particular a hyperspectral sensor with line-by-line scanning of image information
- the hyperspectral sensor has, in particular, a slit diaphragm and/or a grating diaphragm for, in particular, variable interruption and/or steering of the respective image information.
- physiological parameters are, for example, by means of corresponding light spectra can be determined by analyzing a degree of absorption for a wavelength or a corresponding wavelength range or also a number of degrees of absorption for a number of wavelength ranges of a light spectrum and inferring a corresponding physiological parameter from this.
- a specific physiological parameter for example, a specific
- Absorption wavelength ranges a water content or a third absorption wavelength or more
- Corresponding wavelength ranges for determining different physiological parameters can be the same, overlapping or different or can be used in different combinations.
- a “spectral sensor” is a sensor, for example an image sensor or another light-sensitive sensor, which is able to record spectral information, for example image information, and thus information about, for example, a
- Output spectral distribution in the viewing area so that physiological parameters can be determined, for example, based on the spectral distribution.
- a “hyperspectral sensor” includes, for example, a spectrometer unit that is a so-called observation slit and splits light incident through a prism or an optical grating depending on the wavelength. Correspondingly split light is then sent to an image sensor of the
- Hyperspectral sensor supplied and detected by this.
- Individual recordings of a hyperspectral sensor thus provide spectral information for a so-called image line of an object, ie for example an image line from the observation area.
- an object for example an object in the viewing area
- a so-called hyperspectral data cube is created over an entire area from the viewing area, i.e. multidimensional information which, for example, for each pixel, i.e. each image point, in the picture an optical one
- wavelengths of light supplies.
- a wavelength of light supplies.
- Data cube can then, for example, physiological
- Tissue parameters are derived and / or calculated.
- a "slit diaphragm" is, for example, the mechanical means by which such a
- Observation gap is generated.
- it is a metal sheet with a corresponding
- a "grid screen” is, for example, one corresponding sequence of slots in the form of each similar or identically designed slots in a
- a piece of image information can then be variably interrupted, for example, or else directed or diffracted.
- the adjustment device has a
- Motor in particular an adjusting motor, with the means of the motor and / or by means of the adjusting motor
- Slit diaphragm and / or the grating diaphragm is movable, so that the variable interrupting and / or directing the respective image information by moving the
- Slit diaphragm and/or grating diaphragm takes place.
- a “motor” is a mechanical device, for example an electromechanical device, which converts the energy provided into, for example, a rotation or translation, i.e. into a physical movement.
- a rotation or translation i.e. into a physical movement.
- Hydraulic motor a magnetic motor or some other kind
- Control unit a calculation unit for calculating a predicted recording time of the respective
- Image information based on the calibration correlation and / or based on operating parameters
- Control unit the image recording device, the first
- Recording time are calculated so that, for example, a
- a corresponding exposure time can be displayed, up to a corresponding medical
- Imaging device for example, must not be moved.
- a “calculation unit” is, for example, a
- Algorithm on a computer for operating the medical imaging device which a corresponding calculation based on a stored
- controlling parameters of the control unit are, for example, physical properties of the control unit, corresponding properties set by an operator or, for example, an exposure setting of the
- Control unit the image recording device, the first
- Image sensor and / or the second image sensor are identical to Image sensor and / or the second image sensor.
- Image recording device has a sensor for recording an image visible to an operator, in particular one
- RGB image and/or the first image sensor is on
- Image sensor for recording one for an operator visible image in particular an RGB sensor and / or
- a visible image of the observation area can also be displayed for the operator in parallel with the generation of the spectral image information or, for example, in parallel or at intervals alternating with the recording of physiological parameters.
- color information namely red, green and blue
- Color information which is then assembled into a visible image of different color representations.
- RGB sensor is in particular an electronic one
- Sensor which, for example, corresponding filters are upstream, so that certain sensor areas only
- RGB sensor can receive light information of certain colors and thus a separation according to different colors is possible.
- RGB sensor also becomes general
- RGB sensor is usually designed as a sensor with a so-called Bayer filter.
- the object is achieved by a method for calibrating a medical
- Embodiments with the following steps: - Recording the first image information with the
- Image information is present in the image recording device, - Controlling the setting device by means of the
- Control unit by fitting the second sensitivity distribution with the
- Image information is present, so that a calibration of the second image sensor is achieved.
- Calibration describes the activity that brings about a calibration. Calibration can therefore include recording information and comparing the information with a desired norm or a desired normal, it can also be part of the
- controlling is based on a
- Partial information of the first image information in particular based on an average pixel intensity of the first Image information based on a maximum pixel intensity of the first image information and / or based on a pixel
- partial information can be any information of the image information which has a specific feature, a specific quality or a specific property of the image information in its
- a "pixel intensity” describes, for example, a luminosity of a
- Pixels or analog signal strength with respect to a corresponding pixel ie with respect to a pixel or a portion of the image or the
- Image information in which case, for example, the mean pixel intensity, ie an average
- the calibration is performed.
- the calibration can also be carried out using a maximum pixel intensity, so that, for example, an image sensor is effectively prevented from being overdriven.
- a pixel Intensity distribution so the distribution corresponding
- Signal strengths are used to take into account a smoothing of corresponding image information components in the calibration.
- Controlling the second image sensor is performed line by line, so that the calibration is performed line by line for a respective line.
- a respective line is set, for example, based on its exposure, so that a signal-to-noise ratio is set as low as possible, so that a corresponding line is optimally exposed.
- an exposure time as a setting value for controlling the
- a total recording time can be optimized in such a way that each based on the
- control unit assigned to the setting device is used
- a closed control loop can be set up, by means of which a corresponding calibration can be carried out during operation or in
- Intervals between corresponding operating states can be controlled.
- a "control unit” is, for example, a
- Computer or a computer chip in particular a computer or a computer chip with a corresponding algorithm, which has, for example, reference values or corresponding control values, which then as part of a
- a "control measurement” describes the process in which a corresponding check of the accuracy is carried out, for example at the time of a
- Calibration correlation based on a ratio of a first image size of the first image information and a second image size of the second image information, in particular based on a respective length and/or based on a respective width of the respective image information, so that a size-adapted, format-adapted, length-adapted and/or width-adapted superimposition of the
- a "ratio" of a first image size to a second image size describes, for example, a
- Width ratios with a respective "length” and a respective “width” depicting any dimension of such an image size.
- the calibration is carried out during the recording of the first image information by means of an ongoing calibration and/or after the recording of the first image information by means of a subsequent
- Recording or in a particular time not by a calibration can be performed in an operator-perceptible sequence.
- Adjusting the illumination intensity of the light source in particular depending on calibration correlation.
- Image in particular a hyperspectral recording, is not sufficient, the illumination intensity of the light source can be readjusted or readjusted accordingly.
- Illumination intensity of the light source can be done frame by frame or line by line, so for example by adjusting the
- Illumination intensity of the light source a temporal
- Figure 1 is a schematic representation of a laparoscopic system with a hyperspectral system in a
- Figure 2 is a schematic representation of an alternative laparoscopic system with an alternative hyperspectral
- FIG. 3 shows a diagram for representing a respective signal-to-noise ratio in a spectral range under consideration for different measurement distances
- Figure 4 is a diagram showing a
- Figure 5 is a diagram showing a required exposure time of a
- Figure 6 is a diagram showing a
- Figure 7 is a schematic flow chart of a
- Figure 8 is a schematic flow chart of a
- Figure 9 is a schematic flow chart of a
- a laparoscopic system 101 consists of a
- Laparoscope 103 for viewing an abdominal cavity and a hyperspectral system 121 for evaluating corresponding
- the laparoscope 103 has a shaft 111, shown as an example, which can be inserted into a trocar, for example, and guided into the abdominal cavity by means of the trocar.
- the shaft serves to direct light along an optical path 181 from the viewing area 193 to a lens adapter 117 on a side of the laparoscope 103 facing an operator
- a lens (not shown), for example, can be attached to the lens adapter 117 so that the laparoscope 103 can be used as an optical aid without electronic aids and the lens is used to present an image of the object 191 in the viewing area 193 to a viewer.
- Light channel 115 is provided, the light channel 115 being attached to the connection 113 laterally opposite the shaft 11 .
- Light from a light source for example LED lighting, can be introduced into the shaft 111 by means of the light channel 115, so that the viewing area 193 and thus the object 191 can be illuminated by means of the light guided through the light channel 115 and the shaft 111.
- a hyperspectral system 121 is placed so that the light incident along the optical path 181 is guided into the hyperspectral system 121 through the lens adapter 117.
- the hyperspectral system 121 has a housing 123 shown as an example, with all means for recording corresponding images, in particular a color image of the viewing area 193 and a hyperspectral image of the viewing area 193, being accommodated in the housing 123 .
- the light incident along the optical path 181 is split at a beam splitter 143 so that a part of the incident light can be guided onto an image sensor 141 along an optical path 183 .
- Image sensor 141 is an RGB sensor, so it is used for Capture a color image of the viewing area 193.
- the RGB sensor for example as a CMOS sensor, is equipped with a Bayer filter.
- Beam splitter 143 partially exiting light is through a
- High-pass filter glass 145 passed, allowing unwanted
- Light is guided along the optical path 185 through a lens 147 and then impinges on a transmission grating 149.
- the light is spectrally split and deflected by means of the transmission grating 149 and then by means of a
- Lens 151 directed to an image sensor 142, which receives and processes corresponding spectrally divided light information.
- HSI system ie a subsystem for hyperspectral observation, is thus housed within the housing 124 .
- a servomotor 161 is used for the mechanical
- Image sensor 142 so that one line of an image of the
- Viewing area 193 can be imaged on the image sensor 142 and thus for this respective line
- Spectral distribution of the incident light is mapped.
- a multiplicity of lines scanned in this way becomes then a so-called hyperspectral data cube is generated, i.e. multidimensional information about the
- a computer 125 is shown as an example, which receives image information from the image sensor via a data line 127
- Image sensor 142 picks up and processes. Furthermore, he can
- Computer 125 influence and control the servomotor 161 via a data line 129, so that the computer 125 can adjust and control the hyperspectral arrangement, ie the HSI system.
- the computer 125 takes, for example, exposure information from the image sensor
- Computer 125 based on the image data determined by the image sensor 141 influence the servomotor 161 such that, for example, a sampling rate, ie a respective repetition rate of the image lines, is set such that a respective image line with an optimal
- Exposure time and thus can be recorded with an optimal exposure.
- the computer 125 can control the image sensor 142 via the data line 131 and also read out corresponding image information, so that, for example, a feedback of the recorded
- Image information from the image sensor 142 is used to change the change carried out by the computer 125 on To check servomotor 161 and thus determine the correctness of the influence made.
- the computer 125 also performs a calculation of how long each image capture of the object
- the object 191 arranged in the viewing area 193 is viewed analogously to the example described above, light falls along an optical path 281 into the hyperspectral system 221 (schematic representation).
- the light can be directed via a swiveling mirror 231 onto a mirror 241, a mirror 243 and onto a further swiveling mirror 232, so that the light is first transmitted via an optical path 285 to the im
- Housing 223 housed HSI system over on one
- Image sensor 241 is directed. In this operating state, the image sensor 241 is able to produce a color image of the
- Mirror 231 and mirror 232 are disengaged from optical path 281.
- the optical path 285 is unused. The incident light then passes through the HSI
- Servomotor 261 shown, which controls the function of
- Servomotor 161 analogously depicts. Analogous to the previous one
- Example can then have a computer corresponding
- the image falling through the HSI system is calibrated so that the image sensor 241 in this switching state generates an HSI image, in particular a respective line of an HSI
- the representation with the mirrors 231 and 232 is selected as an example in order to illustrate the principle of action for the use of a single image sensor 241, the HSI system in the housing 223 can also be used in the optical Path 281 can be pivoted in and out or in another
- Form are each guided along the optical path 283 or optionally along the optical path 285.
- a diagram 301 represents a signal-to-noise ratio for different measurement distances, ie different
- a function 311 with slight local deviations represents the signal-to-noise ratio for five different measurement distances and exposure times
- Exposure time can be compensated.
- function 313, 315, 317 and 319 show a respective signal-to-noise ratio for different
- Measuring distances namely at 40 mm (function 313), 50 mm
- the exposure time is 2.6 ms in each case. This shows that the signal-to-noise ratio at a
- Exposure strength can therefore serve, due to the im
- Exposure time at increased measuring distance is used, for example, to keep the image quality constant.
- a diagram 401 shows a required one
- tissue phantom This diagram 401 also shows automatically controlled exposure times of an RGB sensor when darkening and brightening.
- tissue phantom is an exemplary arrangement which is approximately optical
- a measurement distance is shown on an abscissa 403 of diagram 401, and a first ordinate 405 represents the exposure time.
- a second ordinate 407 provides a necessary exposure time for the exposure of 720
- Corresponding graphs 409 represent the respective functional relationships.
- a function 411 shows the connection for an HSI recording when recording a white reference.
- a chart 501 provides a corresponding correlation of white light exposure time to HSI
- Exposure time is, namely corresponding correlation to an automatic regulation of corresponding exposure times of the color image sensor with different illumination of the
- An abscissa 503 represents the exposure time of the
- a function 511 shows the corresponding one
- a function 515 shows the
- a diagram 601 shows a correlation of a necessary engine speed, for example the
- the abscissa 603 represents the frame rate (FPS), an ordinate 605 a corresponding engine speed, which, for example, as steps of a stepping motor or as
- Speed can be plotted (plotted in Figure 6 as an example steps of a stepper motor).
- Function 611 shows the corresponding connection, so that by means of a corresponding example of the
- Computer 125 controlled speed of the motor 161 an accurate refresh rate of the HSI system is controllable.
- a method 701 is used to calibrate an HSI exposure time:
- a method 801 shows controlling an appropriate motor speed for affecting an HSI system: [106] First, an HSI is recorded 803
- Image of a square object for example, at different frame rates of the HSI sensor.
- the motor speed is then adapted 805 for the respective frame rates in such a way and for so long until a respective ratio of the length of the considered
- Tolerance is around the value 1, for example between
- a method 901 represents creating an HSI
- Exposure time of the color sensor e.g.
- a maximum possible frame rate is then calculated 907 for a corresponding exposure quality while maintaining a corresponding exposure quality and Image quality, whereby corresponding exposure times can be limited to a practicable or technically feasible range.
- a calculation 911 then takes place of a
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Surgery (AREA)
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Biophysics (AREA)
- Animal Behavior & Ethology (AREA)
- Pathology (AREA)
- Radiology & Medical Imaging (AREA)
- Veterinary Medicine (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Astronomy & Astrophysics (AREA)
- General Physics & Mathematics (AREA)
- Endoscopes (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102021130790.2A DE102021130790B4 (de) | 2021-11-24 | 2021-11-24 | Medizinische Bildgebungsvorrichtung sowie Verfahren zum Kalibrieren einer medizinischen Bildgebungsvorrichtung |
| PCT/EP2022/082723 WO2023094351A1 (de) | 2021-11-24 | 2022-11-22 | Medizinische bildgebungsvorrichtung sowie verfahren zum kalibrieren einer medizinischen bildgebungsvorrichtung |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4437736A1 true EP4437736A1 (de) | 2024-10-02 |
Family
ID=84487561
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP22821894.7A Pending EP4437736A1 (de) | 2021-11-24 | 2022-11-22 | Medizinische bildgebungsvorrichtung sowie verfahren zum kalibrieren einer medizinischen bildgebungsvorrichtung |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US20250040795A1 (de) |
| EP (1) | EP4437736A1 (de) |
| CN (1) | CN118202660A (de) |
| DE (1) | DE102021130790B4 (de) |
| WO (1) | WO2023094351A1 (de) |
Families Citing this family (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102023134893B3 (de) | 2023-12-13 | 2025-03-27 | Karl Storz Se & Co. Kg | Endoskopvorrichtung, Endoskop und medizinisches System zur medizinischen Bildgebung |
| DE102023135636A1 (de) * | 2023-12-18 | 2025-06-18 | Karl Storz Se & Co. Kg | Bildgebungsvorrichtung, insbesondere endoskopische, exoskopische und/oder mikroskopische Bildgebungsvorrichtung |
| US12402786B2 (en) * | 2023-12-29 | 2025-09-02 | Karl Storz Imaging, Inc. | Hyperspectral/multispectral imaging system with simultaneous white light imaging |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP5570373B2 (ja) * | 2010-09-29 | 2014-08-13 | 富士フイルム株式会社 | 内視鏡システム |
| DE102013217379A1 (de) * | 2013-08-30 | 2015-03-05 | Spekled GmbH | Vorrichtung und Verfahren zur Aufnahme eines Hyperspektralbildes |
| US11240426B2 (en) | 2019-06-20 | 2022-02-01 | Cilag Gmbh International | Pulsed illumination in a hyperspectral, fluorescence, and laser mapping imaging system |
| DE102020105458B4 (de) | 2019-12-13 | 2023-09-28 | Karl Storz Se & Co. Kg | Medizinische Bildgebungsvorrichtung |
| DE102019134473A1 (de) * | 2019-12-16 | 2021-06-17 | Hoya Corporation | Live-Kalibrierung |
-
2021
- 2021-11-24 DE DE102021130790.2A patent/DE102021130790B4/de active Active
-
2022
- 2022-11-22 CN CN202280073594.1A patent/CN118202660A/zh active Pending
- 2022-11-22 WO PCT/EP2022/082723 patent/WO2023094351A1/de not_active Ceased
- 2022-11-22 EP EP22821894.7A patent/EP4437736A1/de active Pending
- 2022-11-22 US US18/710,774 patent/US20250040795A1/en active Pending
Also Published As
| Publication number | Publication date |
|---|---|
| DE102021130790A1 (de) | 2023-05-25 |
| WO2023094351A1 (de) | 2023-06-01 |
| DE102021130790B4 (de) | 2023-10-12 |
| US20250040795A1 (en) | 2025-02-06 |
| CN118202660A (zh) | 2024-06-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP4437736A1 (de) | Medizinische bildgebungsvorrichtung sowie verfahren zum kalibrieren einer medizinischen bildgebungsvorrichtung | |
| DE10304267B9 (de) | Augenchirurgie-Mikroskopiesystem | |
| EP2108306B1 (de) | Vorrichtung und Verfahren zur endoskopischen 3D-Datenerfassung | |
| DE102018110641B3 (de) | Mikroskopieverfahren zur Abbildung eines Objekts sowie Mikroskop | |
| DE3818125C2 (de) | ||
| DE102020105459A1 (de) | Medizinische bildgebungsvorrichtung mit mehreren bildgebungsmodi | |
| EP2786696B1 (de) | Dentalkamerasystem | |
| DE102010045364A1 (de) | Verfahren und Vorrichtung zur Erzeugung hochwertiger Fundusaufnahmen | |
| DE102005034332A1 (de) | Einrichtung und Verfahren zur Beobachtung, Dokumentation und/oder Diagnose des Augenhintergrundes | |
| DE4026821A1 (de) | Verfahren zur erfassung von anomalien der haut, insbesondere von melanomen, sowie vorrichtung zur durchfuehrung des verfahrens | |
| DE102018110643B3 (de) | Stereo-Mikroskop und Verfahren zur Stereomikroskopie | |
| WO2008067922A1 (de) | Verfahren zur erzeugung hochqualitativer aufnahmen der vorderen und/oder hinteren augenabschnitte | |
| EP1441249A1 (de) | Operationsmikroskop | |
| DE102013208306A1 (de) | Stereoskopisches Mikroskop | |
| DE102011053250B4 (de) | Verfahren zum Aufnehmen von Bildern eines Beobachtungsobjektes mit einem elektronischen Bildsensor und optisches Beobachtungsgerät | |
| EP0700217B1 (de) | Verfahren und Vorrichtung zur Korrektur des Weissabgleichs eines Videofarbbildsignals | |
| DE102018123781B4 (de) | Verfahren zum Durchführen einer Shading-Korrektur und optisches Beobachtungsgerätesystem | |
| DE102018110642B4 (de) | Mikroskopieverfahren zur Abbildung eines Objekts sowie Mikroskop | |
| DE102018110640B4 (de) | Verfahren und Mikroskop zum Abbilden eines Objekts | |
| EP4093018B1 (de) | Verfahren zur medizinischen bildgebung und medizinische bildgebungsvorrichtung | |
| EP4654878A1 (de) | Medizinische bildgebungsvorrichtung, endoskopvorrichtung, endoskop und verfahren zur bildgebung | |
| DE102020101879A1 (de) | Stereo-Mikroskop und Mikroskopieverfahren zum Erzeugen eines Stereo-Bilds eines Objekts | |
| WO2023139251A1 (de) | Messvorrichtung und messverfahren zum überprüfen eines messbildzustandes | |
| WO2009059737A1 (de) | Anordnung und verfahren zur automatischen ermittlung einer kataraktstärke eines auges sowie ophthalmologisches gerät und steuerverfahren für ein solches | |
| EP4115842B1 (de) | Beleuchtungsanordnung |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20240611 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC ME MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| 17Q | First examination report despatched |
Effective date: 20250904 |