DE102021120588A1 - Image recording device, image recording method, corresponding method for setting up and endoscope - Google Patents

Abstract

The invention thus relates to an image recording device (1) with a beam splitter (5) which defines at least two optical channels (6, 7), each optical channel (6, 7) leading to an image sensor (3, 8, 18) and wherein the optical channels (6, 7) have different optical characteristics due to optical filters (13).

Description

The invention relates to an image recording device with at least one first image sensor, which can be a color image sensor, for example, for recording an image data stream, with a beam splitter that defines at least two optical channels, the at least one first image sensor in a first optical channel of the at least two optical channels is arranged and a second image sensor is arranged in a second optical channel of the at least two optical channels.

The invention further relates to an image recording method, in which an image data stream is recorded with at least one first image sensor, which can be a color image sensor, for example, with at least two optical channels being defined with a beam splitter, with the at least one first image sensor in a first optical channel of the at least two optical channels is arranged and a second image sensor is arranged in a second optical channel of the at least two optical channels.

The invention also relates to a method for setting up an image recording device and/or an image recording method and a series

Finally, the invention relates to an endoscope.

Such image recording methods and image recording devices are used, for example, in endoscopy in order to obtain color images.

In addition to the color information, it has now become common practice to also provide information with which, for example, tissue can be identified or other measurements can be carried out. The images recorded by the image sensors must first be viewed as spectral and intensity-dependent signals. A visual image of the scene under consideration is generated from this by subsequent image processing or by a calculation rule, and additional information about the tissue itself or the substances contained therein is obtained.

The object of the invention is to increase the flexibility of the possible uses of an image recording method and an image recording device.

In order to achieve the stated object, the features of claim 1 are provided according to the invention in an image recording device. In particular, in order to achieve the stated object in an image recording device of the type described above, it is proposed according to the invention that at least one of the two optical channels is filtered, so that the at least two optical channels have different spectral characteristics. In this case, the spectral characteristics can be non-constant as a function of the wavelength, for example. Different spectral characteristics can be characterized, for example, in that their respective wavelength-dependent absorption, reflection and/or transmission coefficients are different from one another. Optical filtering using suitable thin-layer filters can also be achieved in that the reflection coefficients are wavelength-dependent, while the transmission coefficients are not different.

It can also be provided that both optical channels are filtered accordingly.

A color image can be calculated from the signal of the first image sensor or from a calculation of both image sensors.

The invention thus enables a color image to be enriched or processed with additional spectral information that can be calculated by evaluating the additional image sensor or by comparing measured values from the additional image sensor with measured values from the first image sensor.

The different filtering can be achieved, for example, by a color filter array (CFA, color filter field) of at least one of the image sensors, ie for example the first image sensor and/or the further image sensor. This allows different wavelengths to be imaged on the photocells of the image sensors.

For example, an entire system can be referred to as an optical channel that extends from the lens to the active image array of the image sensor, i.e., for example, to the photocells or the light-sensitive sensor cells, i.e. including the sensor-side wavelength filters (color filters, resonators, quantum dots, ... ), extends.

The filter can thus be formed integrally with the associated image sensor. The filter can also be optically connected in front of the respective image sensor. The filter can thus, for example, also be optically connected upstream and/or downstream of the beam splitter or be formed by the beam splitter itself.

As a beam splitter, for example, a mirror, more precisely a dichroic or polychroic mirror, depending on the wavelength entwe that transmits or reflects the light. It is also possible for only a part to be reflected or let through (e.g. 50/50 beam splitter). Provision can be made here for the respectively reflected and/or the respectively transmitted part (differing from one another) to be filtered.

In a further embodiment, the different spectral characteristics are achieved by a structure combining splitter layers (spectrally dependent or neutral) and wavelength-dependent absorption filters.

The further image sensor can, for example, be constructed in the same way as the first image sensor.

To achieve the object, the features of the independent claim directed to an image recording device are alternatively provided in an image recording device. In particular, in order to achieve the stated object in an image recording device of the type described above, it is alternatively proposed according to the invention that the spectral sensitivities of the first image sensor, which can be a color image sensor, for example, and the second image sensor differ, with the second image sensor having at least two spectral ranges can separate. The advantage here is that the additional image sensor can be used in order to be able to selectively isolate spectral components of the first image sensor that cannot necessarily be described by a color channel. The invention thus makes use of the knowledge that different spectral sensitivities of two image sensors can be used in order to measure light from a sub-area of the color channel in a color channel of one image sensor, in particular from a sub-area in which the spectral sensitivities of two color channels of the image sensors overlap , to compensate or to neutralize.

The signals detected by the second sensor can also come from a spectral range that is detected by the first sensor with only low sensitivity.

In an advantageous embodiment, it can be provided that the features of the solution described first are combined with those of the solution described second. It is thus possible to provide constellations that allow the largest possible number of different additive or subtractive calculations of the color channels of the image sensors with one another. A flexible evaluation system can thus be provided with which a large number of different functionalities can be implemented.

A class of examples for different functionalities is through a respective spectral decomposition of the light, which is captured from the recorded scene with the optical system, and the derivation of an image for the visual representation (e.g. colored or with gray values or black and white), in particular with a generation of additional information, for example, about an examined tissue or the substances contained therein based on the spectral composition.

In an advantageous embodiment, it can be provided that a filter is arranged in at least one of the two optical channels. Different filtering can thus be set up with simple means. The filter can be fixed or replaceable.

In an advantageous embodiment it can be provided that the filter is provided by the beam splitter.

In an advantageous embodiment, it can be provided that the filter is optically connected upstream and/or downstream of the beam splitter. Thus available filters can be used. Provision can also be made for the filter or filters to be arranged to be exchangeable or to be alterable in some other way. As a result, a different spectral processing can be supported or set up.

In an advantageous embodiment it can be provided that the filter is formed on the first image sensor and/or the second image sensor. Thus, existing filters can be used in a compact design.

In an advantageous embodiment it can be provided that the second image sensor can separate at least two spectral ranges. Thus, measured values of the first image sensor in different color channels can be processed differently or deviating from one another.

In an advantageous embodiment it can be provided that the second image sensor and the first image sensor have different spectral sensitivities. An image of the first image sensor can thus be enriched with additional spectral information. This can be used, for example, to separate the spectral ranges from one another and to obtain the individual spectral information from them or to detect spectral ranges that cannot be detected by one of the image sensors used, or can only be detected with reduced sensitivity.

In an advantageous embodiment can be provided alternatively or additionally that the second image sensor and the first image sensor have overlapping spectral sensitivities. In this way, spectral subtractions can be carried out for the overlapping areas.

In an advantageous embodiment, it can be provided that a calculation device is formed, with which a spectral image component of the first image sensor and/or the second image sensor can be identified and/or separated.

Thus, for example, the color channels of the first image sensor for specific wavelength ranges can be modified in a targeted manner by image content of the further image sensor.

In an advantageous embodiment, it can be provided that the or a processing device is set up to subtract a spectral image component of the first image sensor or the second image sensor from an image of the second image sensor or the first image sensor. Thus, the image of the first image sensor can be enriched or processed pixel by pixel or at least spatially resolved with spectral information.

This can be done, for example, pixel-by-pixel, sub-pixel-by-pixel and/or in relation to image areas that correspond spatially and/or in terms of content. This enables false color representations to be calculated in a simple manner to display or output additional spectral information.

It can be provided that partial areas of pixels, e.g. every second or nth pixel in every second or mth, in particular nth, row, are calculated with one another by mathematical operations, in particular subtracted from one another, multiplied with one another and/or be folded, or several sub-areas of an image sensor can be offset against one another with different or the same sub-areas or the entire image of the other image sensor, and different, non-corresponding pixels or mean values of these can also be offset. In this way, location-correct, wavelength-dependent calculations of the image content can be implemented in a simple manner.

In an advantageous embodiment, it can be provided that a calculation device, for example the already mentioned one, is set up to extract spectral information from an image of the second image sensor. Image information of the color image from the first image sensor can thus be enriched with spectral, in particular local and/or global, information, for example an intensity at or near a wavelength. The extraction preferably takes place at the correct location. This enables a false-color image to be created based on this spectral information or spectral information to be obtained, for example to be placed directly over a white-light image or to be processed in a further processing unit and the information obtained from this displayed spatially resolved or overlaid on the white-light image.

It can be provided here that the extracted spectral information is linked to an image of the first image sensor in the correct location. Thus, an enriched reality ("augmented reality") can be created for the color image. Additional information, even in the non-visible wavelength range, can thus be displayed in an easily ascertainable manner.

In an advantageous embodiment it can be provided that a calculation device, in particular the already mentioned one, is set up to change a color assignment of an image of the first image sensor on the basis of spectral information derived from an image of the second image sensor. This means that additional information can be easily displayed in a color image without losing the actual image content. The image content can also be obscured by a complete overlay, or a partially transparent overlay can be generated while preserving the image content.

The change is preferably in the right place. In this way, location-dependent additional information can be displayed without the need for additional display areas.

In an advantageous embodiment, it can be provided that an interface is formed with which at least one spectral processing step of the clearing device can be changed. A functionality of the spectral calculation can thus be easily modified and aligned to a new task without, for example, filters or image sensors having to be exchanged.

In an advantageous embodiment, it can be provided that a further beam splitter is optically connected upstream or downstream of the beam splitter. This enables further optical evaluations and/or processing. The additional beam splitters can contain, for example, other light-sensitive sensors, such as image sensors.

It can be provided here that at least one light-sensitive sensor, in particular a further image sensor, is optically connected downstream of the further beam splitter. In this way, additional color channels can be provided which, for example, result directly from the CFA of the image sensor or the upstream filter of the light-sensitive sensor can arise. A combination of possible applications and billing schemes can be enlarged.

For example, the additional beam splitter can be connected downstream of the beam splitter. An existing application can thus be easily expanded without having to disrupt a function of the first image sensor and/or the second image sensor. For example, a beam splitter can be used instead of one of the (image) sensors that are already being set up.

For example, the additional beam splitter can be connected upstream of the beam splitter. A variant can thus be implemented in a simple manner.

If a second beam splitter is connected upstream or downstream, at least one further image sensor or light-sensitive sensor designed in some other way can be seated on it. This means that additional color channels can be provided for a refined spectral resolution or increased sensitivity.

• - Filterung durch unterschiedliche Sensitivität der eingesetzten Photozellen bzw. Sensortechnologie; und/oder
• - Zusammensetzung des Farbbildes aus unterschiedlichen Farbkomponenten der einzelnen Bildsensoren, insbesondere wobei sich einzelnen Farbkomponenten aus der Verrechnung von min. zwei Farbkomponenten der einzelnen Bildsensoren ergeben; und/oder
• - Anbringen in mindestens einem der weiteren optischen Pfade von lichtempfindlichen Sensoren, insbesondere wobei eine räumliche Auflösung verschieden von derjenigen vom ersten Farbbildsensor sein kann.

For example, one or more of the following can be done:

• - Filtering through different sensitivities of the photocells or sensor technology used; and or
• - Composition of the color image from different color components of the individual image sensors, in particular with individual color components resulting from the offsetting of at least two color components of the individual image sensors; and or
• - Attachment in at least one of the further optical paths of light-sensitive sensors, in particular where a spatial resolution can be different from that of the first color image sensor.

If, for example, a system with two beam splitters is set up one behind the other, an image sensor, for example the first image sensor or the second image sensor, and the second beam splitter can sit on the two outputs of the first beam splitter. For example, image sensors or light-sensitive sensors can then be located on the second beam splitter itself. Thus, the total number of sensors can be increased by at least one. This can be continued as desired until an attenuation in the beam splitters becomes too great or a change in the optical path length difference between the optical channels becomes too great.

Each beam splitter can also contain several (in particular two or more than two) image sensors.

In principle, one could use a 3-CMOS beam splitter and thus have three image sensors on one beam splitter.

The whole thing is then a scalable n-CMOS system with n-1 beam splitters when using 2-CMOS beam splitters. With a 3-CMOS beam splitter, for example, up to five image sensors or light-sensitive sensors can be connected to two beam splitters.

In order to achieve the stated object, the features of the first independent claim directed to an image recording method are provided according to the invention in an image recording method. In particular, in order to achieve the stated object in an image recording method of the type described above, it is proposed according to the invention that a filter is arranged in at least one of the two optical channels, through which the at least two optical channels are spectrally influenced differently. It is thus possible to implement different applications in which, for example, spectral image information can be obtained from the image data stream or in which the image data stream can be enriched with spectral image information.

In order to achieve the stated object, the features of the second independent claim directed to an image recording method are alternatively provided according to the invention in an image recording method. In particular, in order to achieve the stated object in an image recording method of the type described above, it is proposed according to the invention that the spectral sensitivities of the first image sensor, which can be embodied as a color image sensor, and the second image sensor differ, with the second image sensor having at least two spectral ranges can separate. The advantage here is that applications in which spectral components of the image data stream are identified, extracted or eliminated can be implemented by processing one or more of the at least two spectral ranges.

In an advantageous embodiment, it can be provided that the features of the solution described first are combined in an image recording method with those of the solution described second in an image recording method.

In an advantageous embodiment it can be provided that a spectral image component, for example a color channel or a partial area of such, of the first image sensor and/or the second image sensor is identified and/or separated. Thus this spectral part of the image is closed Additional spectral information can be obtained.

In an advantageous embodiment, it can be provided that a spectral image component, for example a color channel, of the first image sensor or of the second image sensor is subtracted from an image of the second image sensor or of the first image sensor. Thus, an image portion can be eliminated from a predefined wavelength range in a simple manner.

The subtraction can be carried out, for example, pixel-by-pixel, sub-pixel-by-pixel and/or in relation to image areas that correspond spatially and/or in terms of content. The corresponding image areas can be calculated, for example, by feature comparisons and/or correlations.

In an advantageous embodiment it can be provided that a preferably spatially resolved, spectral information is extracted from an image of the second image sensor. Additional information for the color image can thus be obtained, or spectral areas can be separated from one another by calculating the signals from individual pixels in a color area.

Provision can be made here for the extracted spectral information to be linked in the correct location to an image, in particular a color image, of the first image sensor. This means that additional information can be displayed in relation to the location.

In an advantageous embodiment, it can be provided that a color assignment of an image, in particular a color image, of the first image sensor is changed, preferably in a location-dependent manner, on the basis of spectral information derived from an image of the second image sensor. Additional information, in particular from outside the visible wavelength range or for wavelength ranges that a first image sensor cannot separate, can thus be displayed.

In an advantageous embodiment, it can be provided that an image recording device according to the invention, in particular as described above or according to one of the claims directed to an image recording device, is used.

A preferred application of the invention of possibly independent inventive quality is in a method for setting up an image recording device according to the invention, in particular as described above or according to one of the claims directed to an image recording device, and/or for setting up an image recording method according to the invention, in particular as described above or according to one of the claims directed to an image recording method, in that at least one spectral processing step, in particular of the processing device, is changed, preferably via an interface. A flexible adaptation of an image recording device and/or an image recording method to a new evaluation requirement can thus be set up.

A preferred application of possibly independent importance can thus provide a series of image recording devices, with variants of image recording devices, in particular image recording devices according to the invention, for example as described above and/or according to one of the claims directed to an image recording device, corresponding arrangements of image sensors and/or a corresponding Optics and/or have a matching beam splitter, wherein at least one optical channel, which leads to at least one image sensor, distinguishes between two variants through different spectral characteristics, in particular through different filters. Thus, a variety of parts in the variants can be reduced by, for example, image sensors, also with exchanged or matching filter fields, beam splitters and/or upstream optics being used unchanged for several variants, while the different spectral characteristics are achieved by different filters.

A preferred use of the image recording device according to the invention is in an endoscope. Here, the first image sensor can be used, for example, to create a realistic image of an examination object, while the second image sensor and/or at least one further image sensor can be used to generate additional image information from a non-visible wavelength range or from a visible wavelength range that is outshone by other wavelength ranges and is therefore difficult or impossible to see in the color image of the first image sensor. Alternatively or additionally, spectral information can be obtained from the calculation of the two image data or additional spectral information can be recorded in order to generate further information about the composition of a tissue or the substances contained therein

The invention will now be described in more detail using an exemplary embodiment, but is not limited to the exemplary embodiment. Further exemplary embodiments result from combining the features of individual or multiple claims with one another and/or with one or more features of the exemplary embodiment.

• 1 eine erfindungsgemäße Bildaufnahmevorrichtung in einer Prinzipskizze zur Erläuterung des erfindungsgemäßen Bildaufnahmeverfahrens,
• 2 eine Variante einer erfindungsgemäßen Bildaufnahmevorrichtung,
• 3 eine weitere Variante einer erfindungsgemäßen Bildaufnahmevorrichtung und
• 4 ein Ablaufplan eines erfindungsgemäßen Bildaufnahmeverfahrens.

It shows:

• 1 an image recording device according to the invention in a schematic diagram to explain the image recording method according to the invention,
• 2 a variant of an image recording device according to the invention,
• 3 a further variant of an image recording device according to the invention and
• 4 a flow chart of an image recording method according to the invention.

1 shows an image recording device 1 according to the invention in a schematic representation, in which structural details have been omitted for the sake of simplicity.

In a preferred use of the invention, this image recording device 1 can be part of an endoscope, for example. For this purpose, the image recording device 1 can be arranged, for example, at the distal end of the endoscope or at the proximal end of the endoscope.

The image recording device 1 here has an optical system 2, behind which a first image sensor 3, here by way of example a color image sensor, defined for example by a corresponding CFA, is arranged. The optics 2 can act as a lens, for example.

The first image sensor 3 is in a manner known per se to generate an image data stream 4 (cf. 4 ) furnished.

The image recording device 1 also has a beam splitter 5, through which a first optical channel 6 and a second optical channel 7 are formed, both of which are fed from the optics 2.

A second image sensor 8 is arranged in the second optical channel 7 .

In the embodiment according to 1 the first optical channel 6 is filtered, so that the at least two optical channels 6, 7 have spectral characteristics that differ from one another. This can be characterized, for example, by the fact that the wave-dependent transfer functions are different for the two optical channels.

In the exemplary embodiment, the filtering has the effect that only a narrow sub-range is allowed to pass in a green wavelength range.

In the representation according to 1 spectral sensitivities 9, 10 are shown, which represent a sensitivity of the sensor for different wavelengths. In this case, the first spectral sensitivity 9 is assigned to the first image sensor 3 , while the second spectral sensitivity 10 is assigned to the second image sensor 8 .

The second spectral sensitivity 10 of the second image sensor 8 has three color channels “yellow”, “magenta” and “cyan”. The second image sensor 8 can accordingly separate two spectral ranges 11, 12, namely a first (yellow) spectral range 11 and a second (blue-green) spectral range 12.

The first image sensor 3 also has three color channels “blue”, “green” and “red” in a manner known per se.

The first image sensor 3 is used to record a colored image data stream from an examination object.

A first optical channel 6 and a second optical channel 7 are formed by a beam splitter 5 .

The first optical channel 6 leads to the first image sensor 3 already mentioned, while the second optical channel 7 leads to a second image sensor 8 .

In this case, the first optical channel 6 is provided with an (additional) filter 13 .

In 1 it can be seen that the first image sensor 3 on the one hand and the second image sensor 8 on the other hand have different spectral sensitivities 9, 10.

This is achieved by means of a color filter array (CFA, Color Filter Array) that is not obvious and that implements the first image sensor 3 in the present example as an RGB sensor and the second image sensor 8 as a CMY sensor. Other spectral characteristics are implemented in further exemplary embodiments.

Because of these upstream filter fields, the two optical channels 6, 7 therefore have different spectral characteristics, which can be described by the spectral sensitivities 9, 10 of the image sensors 3, 8. In this case, the filter fields are connected downstream of the beam splitter 5 .

In addition to the CFAs (filter fields) located on the image sensors 6, 7, further spectral filters can also be placed directly in front of the individual image sensors 6, 7 may be appropriate. See for example dashed line in in front of the image sensor 3.

In this case, the optional filter 13 can be used to further limit the sensitivity of the green color channel (or in other exemplary embodiments of another color channel).

Based on the second spectral sensitivity 10 of the second image sensor 8, it can be seen that the second image sensor 8 can distinguish a first spectral range 11 from a second spectral range 12, since the spectral sensitivities of the Y color channel and those of the C color channel overlap only slightly.

The superimposed representation of the spectral sensitivities 9, 10 in the right part of 1 shows that by means of spectral calculation, in particular spectral subtraction and/or addition, light signals in different wavelengths can be separated from one another, which could otherwise only be detected together.

In this way, for example, fluorescence signals that lie in a common color channel of the first image sensor 3 and are therefore not separable from one another can be differentiated by evaluating the second image sensor 8 . For this purpose, for example, the C color channel of the second image sensor 8 can be used in order to separate one half of the green color channel of the first image sensor 3 from another half of this channel.

The filter fields and/or the filter 13 (not shown in any more detail) are thus arranged in the optical channels 6, 7 in order to achieve different spectral characteristics.

2 shows another embodiment of the invention.

Components and functional units that are exemplary or identical to the previous exemplary embodiment are denoted by the same reference symbols and are not described separately again.

The statements to 1 therefore apply 2 accordingly.

The embodiment according to 2 differs from the after 1 in that the beam splitter 5 is a dichroic beam splitter thus providing a filter 13 .

It can also be a polychroic beam splitter. As already explained, additional filters can be attached directly in front of the individual image sensors in addition to the CFA located on them.

Thus, the optical channels 6, 7 have different spectral characteristics, even if the spectral sensitivities 9, 10 of the first image sensor 3 on the one hand and of the second image sensor 8 on the other hand should be identical.

3 shows another embodiment of the invention. Again are to the 1 and 2 Similar or identical components and functional units are denoted by the same reference symbols and are not described again.

The remarks on the 1 and 2 therefore apply to the 3 accordingly.

The embodiment according to 3 differs from the previous exemplary embodiments in that a filter 13 is connected downstream of the beam splitter 5 in the optical channel 7, through which the optical channel 7 to the second image sensor 8 is filtered.

The embodiment according to 3 differs further from the previous exemplary embodiments in that the beam splitter 5 is preceded by a further beam splitter 17, through which a portion of the light incident through the optics 2 is directed to a further image sensor 18.

The beam splitter 5 and the further beam splitter 17 can also be integrated, for example as a triple beam splitter (e.g. 3-CMOS). The individual beam splitters can be designed both for dividing the intensity and for spectral separation (dichroic or polychroic beam splitters). In addition, as already noted above, filters can be used directly in front of the image sensors or between the individual glass prisms of the beam splitter or beam splitters.

The spectral sensitivity of the additional image sensor 18 can be designed to match one of the other image sensors 3, 8 or deviate from both.

4 shows the general function of the invention in a schematic diagram.

With the image sensors 3, 8, image information is recorded in color channels 19, which are subjected to a respective spectral processing step 16.

This results in spectrally processed images, which are combined in an image combiner 21 to form a spectrally processed color image 22 .

Alternatively or additionally, the image combiner 21 can calculate the two images or individual color planes with one another.

The processing takes place pixel by pixel in the images 20, with corresponding pixels being offset against one another.

In an embodiment variant, image sensors with different resolutions could be combined. This allows the resolutions to be adjusted using a suitable interpolation method.

The combiner 21 and the spectral processing steps 16 are accessible via an interface 15 in order to adapt the functionality of the clearing device 14 in such a way that a different spectral identification and/or processing is made possible.

In the combiner 21 it can thus be achieved that image information from the two image sensors 3, 8, which is isolated or identified, for example, in a spectral calculation step 16, is calculated, in particular spectrally added and/or spectrally subtracted and/or spectrally multiplied and/or spectrally divided and/or subjected to a linear transformation. As mentioned, this can be done pixel by pixel and/or for pixels with corresponding content or with the help of average values over several pixels and/or by combining several pixels of an image area, whereby not all pixels of this image area have to be used.

In the combiner 21, a view can be created from multiple paths. However, the type of false color display (e.g. white light image + HSV overlay of the spectral information) and/or the mixing ratios (transparency, intensity, ...) can be set here.

It can thus be seen from the schematic representation that this method can be carried out pixel by pixel for corresponding image pixels of the image sensors 3, 8, so that the spectral processing and the enrichment with spectral information can be carried out at the correct location.

The combiner 21 can also be set up, in particular by being controlled via the interface 15, for a different processing that is not spectral addition or subtraction. For example, based on the spectral information from the additional image sensor 8, a color assignment in the spectrally processed image 20 of the first image sensor 3 can be changed in such a way that a false color representation of information from the additional image sensor 8 and/or an overlay from the calculation of additional information (see above), which, for example, either replaces the corresponding image areas or is partially overlaid in a transparent manner.

It is thus possible via the interface 15 to implement other spectral analyzes without replacing filters 13 and/or image sensors 3, 8, 18.

In a further exemplary embodiment, a series of image recording devices 1 is created in which the optics 2 and/or image sensors 3, 8, 18 and/or optical channels 6, 7 are designed to match, with the spectral characteristics of the optical channels 6, 7 through different filters 13 result.

A preferred use of the imaging device is in endoscopy. The image recording device 1 can then be part of an endoscope. This can be particularly the case with integrated endoscope systems, e.g. with CiT systems (Chip in Tip), where the image sensors are located in the distal area. Alternatively, the arrangement described here can be located in the camera connected to the endoscope.

The invention thus relates to an image recording device 1 with a beam splitter 5 which defines at least two optical channels 6, 7, each optical channel 6, 7 leading to an image sensor 3, 8, 18 and the optical channels 6, 7 being filtered by optical filters 13 have different optical characteristics.

Reference List

1

image pickup device

2

optics

3

first image sensor, in particular color image sensor

4

image stream

5

beam splitter

6

(first) optical channel

7

(second) optical channel

8th

second image sensor

9

(first) spectral sensitivity

10

(second) spectral sensitivity

11

(first) spectral range

12

(second) spectral range

13

filter

14

clearing facility

15

interface

16

spectral processing step

17

another beam splitter

18

another image sensor

19

color channel

20

spectrally processed image

21

combiner

22

color image

Claims (23)

Image recording device (1) with at least one first image sensor (3), in particular a color image sensor, for recording an image data stream (4), with a beam splitter (5) which defines at least two optical channels (6, 7), the at least one first image sensor (3) is arranged in a first optical channel (6) of the at least two optical channels (6, 7) and in a second optical channel (7) of the at least two optical channels (6, 7) a second image sensor (8) is arranged, characterized in that at least one of the two optical channels (6, 7), in particular both optical channels (6, 7), is filtered so that the at least two optical channels (6, 7) have different, preferably non-constant, spectral characteristics exhibit. Image recording device (1) according to the preamble of claim 1 , especially after claim 1 , characterized in that the spectral sensitivities (9, 10) of the at least one first image sensor (3) and the second image sensor (8) differ, wherein the second image sensor (8) can separate at least two spectral ranges. Image recording device (1) according to one of the preceding claims, characterized in that a filter (13) is arranged in at least one of the two optical channels (6, 7), in particular with a filter (13 ) is arranged. Image recording device (1) according to one of the preceding claims, characterized in that the filter (13) is provided by the beam splitter (5) and/or that the filter (13) is optically connected before and/or after the beam splitter (5) and /or that the filter (13) is formed on the at least one first image sensor (3) and/or the second image sensor (8). Image recording device (1) according to one of the preceding claims, characterized in that the second image sensor (8) can separate at least two spectral ranges (11, 12). Image recording device (1) according to one of the preceding claims, characterized in that the second image sensor (8) and the at least one first image sensor (3) have different and/or overlapping spectral sensitivities (9, 10). Image recording device (1) according to one of the preceding claims, characterized in that a calculation device (14) is formed, with which a spectral image component (20) of the at least one first image sensor (3) and/or the second image sensor (8) can be identified and/or or is separable. Image recording device (1) according to one of the preceding claims, characterized in that the or a processing device (14) for a subtraction of a spectral image portion (20) of the at least one first image sensor (3) or the second image sensor (8) from an image of the second Image sensor (8) or the at least one first image sensor (3) is set up, in particular pixel-by-pixel, sub-pixel-by-pixel and/or in relation to spatially and/or in terms of content corresponding image areas. Image recording device (1) according to one of the preceding claims, characterized in that the or a calculation device (14) is set up to extract preferably spatially resolved spectral information from an image of the second image sensor (8), in particular so that the extracted spectral information is also correctly positioned is linked to an image of the at least one first image sensor (3). Image recording device (1) according to one of the preceding claims, characterized in that the or a computing device (14) for a preferably location-dependent change in a color assignment of an image of the at least one first image sensor (3) based on an image of the second image sensor (8) derived spectral information is set up. Image recording device (1) according to one of the preceding claims, characterized in that an interface (15) is formed with which at least one spectral processing step (16) of the calculation device (14) can be changed. Image recording device (1) according to one of the preceding claims, characterized in that the beam splitter (5) is optically preceded or followed by a further beam splitter (17), in particular with at least one further image sensor (18) being optically or downstream of the further beam splitter (17). is. Image recording method, in which an image data stream (4) is recorded with at least one first image sensor (3), in particular at least one color image sensor, with at least two optical channels being defined with a beam splitter (5), with the at least one first image sensor (3) is arranged in a first optical channel of the at least two optical channels and a second image sensor (8) is arranged in a second optical channel of the at least two optical channels, characterized in that a filter (13) is arranged in at least one of the two optical channels , through which the at least two optical channels are spectrally influenced differently. Image recording method according to the generic term of Claim 13 , especially after Claim 13 , characterized in that the spectral sensitivities (9, 10) of the at least one first image sensor (3) and the second image sensor (8) differ, wherein the second image sensor (8) can separate at least two spectral ranges (11, 12). Image recording method according to one of Claims 13 until 14 , characterized in that a spectral image component (20) of the at least one first image sensor (3) and/or the second image sensor (8) is identified and/or separated. Image recording method according to one of Claims 13 until 15 , characterized in that a spectral image portion (20) of the at least one first image sensor (3) or the second image sensor (8) with an image of the second image sensor (8) or the at least one first image sensor (3) by a calculation rule, in particular a subtraction, is combined. Image recording method according to one of Claims 13 until 16 , characterized in that a preferably spatially resolved, spectral information is extracted from an image of the second image sensor (8), in particular wherein the extracted spectral information is correctly positioned with an image of the at least one first image sensor (3) is linked. Image recording method according to one of Claims 13 until 17 , characterized in that a color assignment of an image of the at least one first image sensor (3) based on an image of the second image sensor (8) derived spectral information is preferably changed depending on the location. Image recording method according to one of Claims 13 until 18 , characterized by one or more of the following steps: - Filtering by different sensitivities of the photocells or sensor technology used; and/or composition of the color image from different color components of the individual image sensors, in particular individual color components resulting from the offsetting of at least two color components of the individual image sensors; and/or - mounting in at least one of the further optical paths of light-sensitive sensors, in particular where a spatial resolution can be different from that of the first color image sensor. Image recording method according to one of Claims 13 until 19 , characterized in that an image recording device (1) according to one of Claims 1 until 12 is used. Method for setting up an image recording device (1) according to one of Claims 1 until 12 and/or for setting up an image recording method according to one of Claims 13 until 20 , characterized in that , preferably via an interface (15), at least one spectral processing step (16), in particular the clearing device (14), is changed. Series of image recording devices (1), variants of image recording devices (1), in particular according to one of Claims 1 until 12 , each having matching arrays of image sensors (3, 8) and/or matching optics (2) and/or matching beam splitter (5), characterized in that at least one optical channel (6, 7) leading to at least one image sensor (3, 8), in particular to the first image sensor (3) and/or to the second image sensor (8), distinguishes between two variants through different spectral characteristics, in particular through different filters (13). Endoscope with an image recording device (1) according to one of Claims 1 until 12 .

Images