EP4154052A1 - Bildsensorvorrichtung einer kamera zur detektion von licht - Google Patents
Bildsensorvorrichtung einer kamera zur detektion von lichtInfo
- Publication number
- EP4154052A1 EP4154052A1 EP21720740.6A EP21720740A EP4154052A1 EP 4154052 A1 EP4154052 A1 EP 4154052A1 EP 21720740 A EP21720740 A EP 21720740A EP 4154052 A1 EP4154052 A1 EP 4154052A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- light
- coupling
- area
- carrier medium
- designed
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/12—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with one sensor only
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/10—Beam splitting or combining systems
- G02B27/12—Beam splitting or combining systems operating by refraction only
- G02B27/126—The splitting element being a prism or prismatic array, including systems based on total internal reflection
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0025—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration
- G02B27/0037—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for optical correction, e.g. distorsion, aberration with diffracting elements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/10—Beam splitting or combining systems
- G02B27/1006—Beam splitting or combining systems for splitting or combining different wavelengths
- G02B27/1013—Beam splitting or combining systems for splitting or combining different wavelengths for colour or multispectral image sensors, e.g. splitting an image into monochromatic image components on respective sensors
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B33/00—Colour photography, other than mere exposure or projection of a colour film
- G03B33/10—Simultaneous recording or projection
- G03B33/12—Simultaneous recording or projection using beam-splitting or beam-combining systems, e.g. dichroic mirrors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/13—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths with multiple sensors
- H04N23/16—Optical arrangements associated therewith, e.g. for beam-splitting or for colour correction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/134—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on three different wavelength filter elements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/42—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect
- G02B27/4272—Diffraction optics, i.e. systems including a diffractive element being designed for providing a diffractive effect having plural diffractive elements positioned sequentially along the optical path
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/32—Holograms used as optical elements
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B33/00—Colour photography, other than mere exposure or projection of a colour film
- G03B33/04—Colour photography, other than mere exposure or projection of a colour film by four or more separation records
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B33/00—Colour photography, other than mere exposure or projection of a colour film
- G03B33/10—Simultaneous recording or projection
- G03B33/16—Simultaneous recording or projection using colour-pattern screens
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
- H04N23/11—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths for generating image signals from visible and infrared light wavelengths
Definitions
- the invention relates to an image sensor device of a camera for detecting light, in particular light in the visible and infrared spectrum.
- An image sensor device in particular for camera sensors, is generally a flat arrangement of individual sensor elements, that is to say pixels, which generate image information by means of the image points and corresponding intensity or brightness values.
- the individual sensor elements can only record intensity signals, not colors. For this reason, color filters are placed over pixels for color recordings, which only allow a certain color to pass through, for example red, green and blue, so that a certain brightness value can then be assigned to this color. Since only one color filter can be assigned to each sensor element, i.e. each pixel, this means that theoretically only a third of the pixels and thus a reduced resolution are available for each color, and only a part of each pixel, depending on the color filter of light.
- the most common method for distributing the red, green and blue color filters is the so-called Bayer pattern. Here green occurs twice as often as red or blue.
- each pixel can only measure one specific brightness value, as described, the two missing color values are interpolated for this pixel position, so that a complete red, green and blue signal is available for each pixel and thus image point.
- the number of pixels or the number of sensor elements of the image sensor device must increase. For this purpose, either the image sensor device must be larger in terms of area, or the individual pixels must be smaller while the area remains the same.
- image information plays an increasingly important role today, for example for image processing. More and more image information is required for ever more precise and demanding applications. This applies to still images, i.e. photos, as well as moving images, i.e. videos.
- WO 2008/091534 A1 provides a method, an apparatus and a system which provide a holographic layer as a microlens and color filter arrangement in an image sensor.
- the invention is based on the object of providing an improved image sensor device in which more light can be provided for sensor elements.
- the invention provides an image sensor device for detecting light.
- the image sensor device can in particular be an image sensor device for a camera for color-dependent detection of light.
- the image sensor device comprises at least a first and a second sensor element, which are designed to generate a respective intensity signal from detected light, a carrier medium which is arranged in front of the first and second sensor element, the carrier medium being designed as a light guide and at least has a first and a second coupling-in area and at least a first and a second coupling-out area.
- the first coupling-in area has a first deflection structure which is designed to couple light with a first predetermined wavelength, which falls from an environment onto the first coupling-in area, into the carrier medium in the direction of the first coupling-out area, the second coupling-in area having a second deflection structure, which is designed to couple light with a second predetermined wavelength, which falls from the environment onto the second coupling area, into the carrier medium in the direction of the second coupling area.
- the carrier medium is also designed to transmit the light coupled in via the coupling-in regions to the coupling-out regions by means of internal reflection, the first coupling-out region being arranged in front of the first sensor element and the second coupling-out region being arranged in front of the second sensor element, and wherein the first coupling-out region is a first coupling-out region Deflection structure which is designed to decouple the transmitted light with the first predetermined wavelength that falls on the first decoupling area from the carrier medium onto the first sensor element, and wherein the second decoupling area has a second outcoupling deflection structure which is designed that Transmitted light with the second predetermined wavelength, which falls on the second coupling-out area, is coupled out of the carrier medium onto the second sensor element.
- first and second sensor elements can be arranged next to one another and preferably be part of a sensor element arrangement. This means that the first and second sensor elements are sensors of an image sensor of the camera. In particular, the sensor elements can be photodiodes.
- the first and second coupling areas can preferably have a larger area than a sensor element, so that more light can be collected for detection.
- the respective coupling area can be arranged, for example, above the respective other sensor element and collect the predetermined wavelength in order to direct it to the appropriate sensor element.
- the predetermined first wavelength that would hit the second sensor element is coupled into the carrier medium from the first coupling area via the first deflection structure and is guided to the first Auskoppelbe rich by internal reflection, where it is directed to the predetermined first wavelength provided first sensor element hits.
- only the second coupling area or the first and second coupling area can be arranged above the first sensor element.
- neither of the two coupling areas is arranged above the first sensor element, so that the light is guided from another area of the carrier medium to the first sensor element. The same applies to the second sensor element and an arrangement of the first and / or the second coupling area in front of this sensor element.
- the carrier medium or light-conducting medium can, for example, comprise a glass plate or glass pane which is designed as a light guide. That is, the carrier medium can transmit light by means of internal reflection, in particular by means of total reflection, in particular similar to a fiber optic cable.
- the coupling-in area and a coupling-out area are arranged on the carrier medium.
- the carrier medium carries, so to speak, the coupling-in area and the coupling-out area.
- the coupling area has the aforementioned deflection structure.
- This can be designed, for example, in the form of an optical grating, also called a diffraction grating.
- the deflection structure is designed to couple light that falls from the environment onto the coupling area into the carrier medium. Coupling in this context means that the deflecting structure deflects or deflects the light from the environment in such a way that it penetrates a volume of the carrier medium and is internally reflected there at at least one interface of the carrier medium.
- the carrier medium is designed to transmit the light coupled in via the coupling-in area to the coupling-out area by means of the internal reflection.
- the outcoupling deflection structure of the coupling-out area can finally couple the transmitted light out of the carrier medium.
- the outcoupling deflection structure can deflect or redirect the transmitted or forwarded light in particular in such a way that the light no longer reflects at the interface of the carrier medium when it hits the deflection structure, but instead is decoupled from the carrier medium and thus from the carrier medium can emerge.
- the light of the respective predetermined wavelength runs parallel to the sensor elements after coupling.
- the respective deflection structures can be designed as a diffraction structure or refraction structure, as an interference structure, grating structure, as a lens system or mirror.
- the deflection structures can each be used as a holographic-optical element (HOE) (or, for short, holographic phical element) be formed, which can deflect light with a predetermined wave length in a predetermined angle.
- HOE holographic-optical element
- the image sensor device can preferably also comprise a computing device which is designed to generate an image, in particular a color image, from the respective intensity signal of the detected light.
- the invention has the advantage that more light can be made available to each sensor element, since light can be collected from an enlarged area and directed to the respective sensor element. In this way, for example, a resolution of the image sensor device can be increased without increasing image noise.
- the invention also includes embodiments which result in additional advantages.
- the respective deflection structures are designed as a holographic element with at least one optical grating, in particular a holographic volume grating or a holographic surface grating.
- an optical grating also called a diffraction grating, and its method of operation and manufacturing process is well known.
- an optical grating can be designed as at least partially periodic structures, so-called grating structures, in a substrate.
- an optical grating can bring about a direction of light through the physical effect of diffraction, as is known, for example, from mirrors, lenses or prisms. If light falls, that is, light rays fall on the optical grating, the incident light rays in particular fulfilling the Bragg equation, the light rays are bent or deflected by the optical grating. The light can thus be directed in particular by interference phenomena of the light beams diffracted by the optical grating.
- the deflection structure of the coupling area or outcoupling area can accordingly also be referred to as a diffraction structure.
- An optical grating can preferably be designed to be direction-selective or angle-selective with respect to the incident light.
- only light in particular a portion of the light that falls onto an optical grating from a predetermined direction of incidence, for example at a predetermined angle, can be deflected.
- Light in particular a portion of the light that falls onto the optical grating from a different direction, is preferably not deflected or the less, the greater the difference from the predetermined direction of incidence.
- the portion of light which deviates from the predetermined direction of incidence or optimal direction of incidence can consequently preferably propagate unhindered through the substrate with the optical grating.
- an optical grating can also be designed to be wavelength-selective or frequency-selective.
- only light in particular a first portion of the light with a predetermined wavelength, can be deflected or diffracted by the optical grating at a specific diffraction angle.
- Light in particular a second portion of the light with a wavelength other than the predetermined wavelength, is preferably not deflected, or the less the greater the difference from the predetermined wavelength.
- the second light component which differs from the predetermined wavelength or optimum wavelength, can consequently preferably propagate unhindered through the substrate with the optical grating. In this way, for example, at least one monochromatic light component can be split off from polychromatic light which strikes the optical grating.
- the deflection effect for the optimum wavelength is advantageously at a maximum and decreases towards longer and shorter wavelengths, for example according to a Gaussian bell, or becomes weaker.
- the deflection effect only acts on a fraction of the visible light spectrum and / or in an angular range smaller than 90 degrees.
- a production of an optical grating can in particular by means of exposure of a substrate, so for example photolithographically or holographically, take place.
- the optical grating can then also be referred to as a holographic or holographic-optical grating.
- Two types of holographic-optical gratings are known: holographic surface gratings (surface holografic gratings, short: SHG) and holographic volume gratings (volume holografic gratings, short: VHG).
- the grating structure can be generated by optically deforming a surface structure of the substrate. Due to the modified surface structure, incident light can be deflected, for example reflected.
- holographic surface gratings are so-called sawtooth or blaze gratings.
- the grating structure can be incorporated into the entire volume or part of the volume of the substrate.
- Holographic surface gratings and holographic volume gratings are usually frequency-selective.
- a particularly suitable material for said substrate for incorporating an optical grating is glass, for example quartz glass, in particular a photosensitive glass.
- a polymer, in particular a photopolymer, or a film, in particular a photosensitive film, for example made of plastic or organic materials can be used.
- the material, in particular in substrate form has optical waveguide properties.
- Substrates that have a deflection structure for diffracting light, for example in the form of an optical grating can also be referred to as holographic-optical elements. With such holographic-optical elements, in particular the properties of conventional lenses, mirrors and prisms can be simulated. Advantages of holographic-optical elements are that, in contrast to conventional optical elements made of glass or plastic, they can be made lighter, because of the unnecessary curvature, substantially flatter and at the same time transparent.
- the image sensor device can have at least three sensor elements, that is to say three pixels, each sensor element being responsible for a predetermined wavelength.
- these predetermined wavelengths can be collected from the ambient light over a large area and passed on to the appropriate sensor element.
- the three sensor elements can in particular be part of an image sensor which is constructed from a periodic stringing together of these three sensor elements. It can also be provided, for example, that a first sensor element, two second sensor elements and a third sensor element are arranged in a 2x2 matrix of sensor elements that form part of an image sensor of the image sensor device, this matrix being able to repeat itself periodically so that the entire Image sensor results.
- the first predetermined wavelength is in a red color spectrum
- the second predetermined wavelength is in a green color spectrum
- the third predetermined wavelength is in a blue color spectrum, i.e. the three primary colors red, green and blue can be reproduced so that the image sensor device can generate a color image.
- the first predetermined wavelength can be in a wavelength range from 650 nanometers to 800 nanometers, in particular 700 nanometers
- the green wavelength in a wavelength range between 500 nanometers and 570 nanometers, in particular 546 nanometers
- the third predetermined wavelength in one Wavelength range between 420 nanometers and 500 nanometers, especially at 436 nanometers.
- This embodiment has the advantage that the image sensor device uses the basic colors Color image can be generated, with the carrier medium and the coupling-in and coupling-out areas being able to collect enough light with the specified wavelength for the respective sensor element, so that image noise can be suppressed and an image can be improved. An improved color-dependent detection of light can thus be provided.
- At least two coupling areas are formed as a cohesive coupling area, the deflection structures belonging to the at least two coupling areas being provided in the associated coupling area as individual elements or being formed as a single multiplex deflection structure.
- at least two coupling areas can coincide in one area of the carrier medium, for example the first and second coupling areas, the first and third coupling areas or the second and third coupling areas.
- all three coupling areas can be arranged in the associated coupling area.
- the provision of the deflection structures in the associated coupling-in area as individual elements means that they can be incorporated into the carrier medium at different positions, for example, within the associated coupling-in area.
- the deflection structures can be frequency-selective, for example the first predetermined wavelength can be deflected by the first deflection structure, which can be located on a surface in the carrier medium, and the second predetermined wavelength can pass through the first deflection structure, since the deflection structures are frequency-selective are. Subsequently, the second predetermined wavelength can be deflected by the second deflection structure, which can be located in a direction of incidence of light behind the first deflection structure.
- multiplex deflection structure optical gratings, in particular holographic gratings, which can diffract polychromatic light, though optical gratings are usually frequency selective.
- holographic volume holographic gratings MVHG for short
- This embodiment has the advantage that even more areas of the carrier medium can be used to collect the predetermined wavelengths and thus more light can be provided to each sensor element for generating the intensity signal.
- the respective deflecting structures are frequency-selective and thus the first deflecting structure only deflects light of the first predetermined wavelength and the second deflecting structure only deflects light of the second predetermined wavelength.
- the third deflection structure can only deflect light of the third predetermined wavelength. This means that the respective deflection structure only deflects light of a predetermined wavelength so that it is coupled into the carrier medium.
- Such a frequency selectivity or wavelength selectivity is a typical property of holographic-optical elements which use optical gratings as deflection structures for directing light. If, for example, white light from the environment falls on one of the respective coupling areas, only the light portion of the light, i.e.
- a first portion of the light, with the predetermined wavelength can be deflected or bent by the respective deflection structure at a certain diffraction angle through the respective deflection structure .
- Remaining portions or a second portion of the light with a wavelength other than the predetermined wavelength are preferably not deflected, or the less the greater the difference from the predetermined wavelength.
- Other components of the light that deviate from the predetermined wavelength or optimum wavelength can consequently propagie in particular unhindered through the carrier medium be split off.
- the deflection effect for the optimum wavelength is advantageously at a maximum and falls towards longer and shorter wavelengths, for example according to a Gaussian curve, or becomes weaker.
- the predetermined wavelengths which the respective deflecting structures deflect differ from one another.
- each of the deflection structures deflects light of a different wavelength.
- a first of the different coupling areas can be designed as a red filter, for example, and only deflect red light.
- a second of the different coupling areas can be designed as a blue filter, for example, and thus only deflect blue light.
- a third of the different coupling areas can be designed as a green filter, for example, and thus only deflect green light.
- the deflection structures can act as color filters that can divide the light onto the appropriate sensor elements. Since the deflection structures are not only arranged in front of the matching sensor elements, but can also be arranged on an entire surface of an image sensor, more light with the predetermined wavelength can, however, be collected, whereby a resolution can be improved.
- a first color filter is arranged in front of the first sensor element and a second color filter is arranged in front of the second sensor element, the first color filter being designed to only allow light with the first predetermined wavelength to pass through, and the second color filter being designed to do so to let through only light with the second specified wavelength.
- a third color filter can be provided in front of the third sensor element, which is designed to only allow light with the third predetermined wavelength to pass through.
- the respective color filters can transmit red, green or blue light.
- the sensor elements can preferably be arranged in a matrix and the color filters can be arranged in front of the sensor elements according to a Bayer pattern.
- a respective color filter is frequency-selective, that is, only light of a predetermined wavelength can be transmitted to the respective sensor element via each color filter.
- the color filters can be divided into categories, with a first category only permeable to red light, a second category only permeable to blue light and a third category only permeable to green light.
- Farbfil ter can be made of colored glass, plastic or gelatine foils, for example. This embodiment has the advantage that wavelength components of white light that have not already been deflected by one of the deflection structures do not strike the respective sensor element that is intended for a predetermined wavelength. Thus, incorrect detection of undesired wavelengths can be avoided, whereby an image signal of the image sensor device can be improved.
- the first coupling area is not arranged in front of the first sensor element and the second coupling area is not arranged in front of the second sensor element.
- the third coupling area cannot be arranged in front of the third sensor element.
- the first coupling area can be arranged in front of the second sensor element and the second coupling area can be arranged in front of the first sensor element.
- This embodiment has the advantage that, for example, light with the specified first wavelength, which would strike the first sensor element anyway, is not deflected by the first deflection structure, but the light of the specified first wavelength that would strike the second sensor element , can be diverted to the first sensor element via the first coupling and decoupling structure.
- this embodiment is preferably used with the color filters mentioned above.
- This embodiment has the advantage that material can be saved in the production of deflection structures, as a result of which costs can be saved in the production of the image sensor device.
- the coupling-in regions and the coupling-out regions are formed in one piece with the carrier medium or the carrier medium is formed as a separate element from the coupling-in regions and the coupling-out regions.
- the coupling area and the decoupling area can thus for example be incorporated directly into a surface structure of the carrier medium.
- the carrier medium itself can be designed as a holographic-optical element, for example it can be etched or lasered.
- the carrier medium can be formed separately from the coupling-in area and the coupling-out area.
- the coupling-in area and the coupling-out area can each form an element, for example, and the carrier medium can form another element which rests against the respective elements.
- the coupling-in region and the coupling-out region can thus be formed in at least one holographic-optical element.
- the coupling-in area and the coupling-out area can be formed in different sections of a holographic film or plate.
- the film or plate can be glued to the carrier medium.
- the holographic film can also be designed as an adhesive film and adhere directly, that is to say without adhesive, to the surface of the carrier medium by means of molecular forces.
- the respective outcoupling area has a smaller dimension than the respective infeed area has a larger dimension than the respective outcoupling area
- a respective deflection structure has a bundling grating structure which is designed to differentiate light rays of the light depending on the point of incidence strongly deflect, so that the deflection structure bundles the light beams on the respective outcoupling deflection structure.
- the respective outcoupling deflection structure can have a diffusion grating structure or a bundling grating structure which is designed to deflect light rays to different degrees depending on the location of incidence and to parallelize or focus them on the respective sensor element for decoupling from the carrier medium.
- a large coupling-in area can be provided which has a large entry surface for light, this light being bundled onto a small coupling-out area and thus suitably for the respective sensor element.
- the diffraction grating structure can have an inhomogeneous diffraction structure which, for example, can diffract light rays from an edge of the diffraction structure more than light rays from a center of the diffraction structure, as a result of which the light rays can be fanned out.
- a focusing grating structure can have a grating structure in which light beams can be focused depending on the position impinging on them.
- the bundling grating structure and the diverging grating structure and the corresponding distances between the two structures are preferably selected so that the light beams diverge from the diverging grating structure to the bundling grating structure and are again parallelized by the bundling grating structure.
- This arrangement is comparable to a Galilean telescope in which a converging lens and a diverging lens are arranged one behind the other in such a way that the focal lengths of the two lenses coincide at one point behind the diverging lens.
- This embodiment has the advantage that more light of the predetermined wavelength can be collected from a larger area and thus an intensity signal of the image sensor device can be improved.
- the invention also includes the combinations of the features of the described embodiments enclosed.
- FIG. 1 shows a schematic illustration of an image sensor device according to an exemplary embodiment
- FIG. 2 shows a perspective illustration of an image sensor device according to an exemplary embodiment
- FIG. 3 is a perspective illustration of an image sensor device according to a further exemplary embodiment
- 4 shows a schematic representation of a light guide within a carrier medium according to an exemplary embodiment
- FIG. 5 shows a schematic illustration of a light guide within a carrier medium according to a further exemplary embodiment.
- an image sensor device 10 for detecting light can have a first sensor element 12 and a second sensor element 14, which are each designed to generate an intensity signal when light is detected.
- the first and second sensor elements can comprise a photodiode.
- the first and second sensor elements 12, 14 can be arranged on a surface as part of an image sensor of the image sensor device 10.
- the image sensor can, for example, be part of a camera that is designed to generate an image, in particular a color image.
- the first sensor element 12 and the second sensor element 14 are shown spaced apart from one another, but these can also be shaped be arranged coherently next to each other.
- a flat, three-dimensional arrangement, that is to say in a plane with a plurality of sensor elements, can also be provided. To explain the functioning of the Schmsensorvor device 10, however, only the two Senso relements 12, 14 are shown in this embodiment.
- the image sensor device 10 comprises a carrier medium 16 which is designed as a light guide and is arranged on a detector surface of the sensor elements 12, 14.
- the carrier medium 16 is arranged at a distance from the sensor elements 12, 14, but the sensor elements 12, 14 can also rest against the carrier medium 16 in a form-fitting manner.
- the carrier medium 16 can have a first coupling-in area 18 and a second coupling-in area 20. Furthermore, the carrier medium 16 can have a first coupling-out region 22 and a second coupling-out region 24.
- the first coupling-in area 18 can have a first deflection structure 26 which is designed to couple light with a first predetermined wavelength that falls onto the first coupling-in area 18 from an environment into the carrier medium 16 in the direction of the first coupling-out area 22.
- the second coupling-in region 20 can have a second deflection structure 28 which is designed to couple light with a predetermined second wavelength into the carrier medium 16 in the direction of the second coupling-out region 24.
- the coupled-in light can then be passed on to the respective coupling-out regions 22, 24 by means of internal reflection. This means that the carrier medium 16 can guide the light parallel to a detector surface of the sensor elements 12, 14 from the coupling areas to the respective decoupling areas.
- the first coupling-out region 22, which is preferably arranged in front of the first sensor element 12, can have a first coupling-out deflection structure 30 which is designed to couple the light of the first predetermined wavelength transmitted in the carrier medium 16 from the carrier medium onto the first sensor element 12.
- the second decoupling area 24 can have a second decoupling deflection structure 32, which is designed to take the transmitted light with the second predetermined wavelength that falls on the second decoupling area, in particular on the second decoupling deflection structure 32, from the carrier medium 16 to the second Disengage sensor element 14.
- the respective deflection structures 26, 28, 30, 32 can be designed as an optical grating, for example by means of a holographic element, in particular as a holographic volume grating or holographic surface grating.
- the carrier medium 16 can be formed, for example, by means of a layered construction, with light-conducting elements, such as glass or plastic plates, forming cover layers for a holographic-optical element, i.e. for the deflection structures 26, 28, 30, 32.
- the holographic-optical element can be produced by stacking several holographic-optical elements.
- the deflection structures as holographic-optical elements can, for example, be formed by means of a photopolymer film or a glass that is introduced between cover layers of the carrier medium 16, preferably glued on.
- the holographic-optical element can be formed by holographic exposure methods in such a way that the deflection structures 26, 28, 30, 32 are formed, such as, for example, the holographic volume grating or the holographic surface grating.
- the mode of operation of the image sensor device 10 will be described below.
- light 34 from an environment can impinge on the image sensor device 10, in particular on the first coupling area 18, which is shown by means of a dashed line.
- the light 34 can, for example, have the first predetermined wavelength, such as a red wavelength component which strikes the first deflection structure 26.
- the first deflection structure 26 can be designed as a holographic surface grating, this being frequency-selective and thus only able to deflect the first predetermined wavelength portion in order to couple it into the carrier medium 16 in the direction of the first decoupling region 22.
- the direction of the coupling-out area here means a macroscopic direction from the coupling-in area along the carrier medium 16 to the coupling-out area, or a direction vector in the direction of propagation of the light by means of internal reflections. Forwarding by means of internal reflection means that the coupled-in light beams meet a critical angle condition of total reflection. A light path can of course have a zigzag course due to the internal reflection.
- the first decoupling deflection structure 30 can also be designed as a holographic surface grating which deflects the first predetermined wavelength in a frequency-selective manner.
- a holographic grating, like the first outcoupling deflection structure 30, can preferably also be angle-selective, that is, only the light of the first predetermined wavelength that comes within the carrier medium 16 from the direction of the first infeed area is deflected.
- the light 36 which can be white light, for example, can have other wavelengths in addition to the first and second predetermined wavelengths. show shares.
- the first sensor element 12 can therefore preferably have a first color filter 38, which only lets through the light with the first predetermined wavelength and absorbs other wavelength components. The first sensor element 12 can thus generate an intensity signal which originates only from the first predetermined wavelength.
- the second sensor element 14 can have a second color filter 40 which only allows light with the second predetermined wavelength to pass.
- the respective coupling-in areas 18, 20 can have a larger dimension than the respective decoupling areas 22, 24. That means that an area on which the light can strike can be larger than the respective decoupling area and thus the respective sensor element, whereby more Light can be collected for detection.
- the respective deflection structure 26, 28 can have a bundling grating structure which is designed to deflect the light beams of the respective predetermined wavelength to different degrees depending on the location of incidence, so that after passing through the carrier medium 16, the light beams onto the outcoupling deflection structure 30, 32 can be focused. A higher proportion of light is thus available for detection, which can improve an intensity signal.
- Fig. 2 is a perspective view of an exemplary Situationsensorvor device 10 is shown according to an exemplary embodiment.
- the first sensor element 12 can be designed to detect red light as the first predetermined wavelength.
- the second sensor element 14 can be designed to detect the second predetermined wavelength, in this exemplary embodiment green light, it being possible for two second sensor elements 14 to be provided.
- a third sensor element 42 can be provided which is designed to detect a third predetermined wavelength, in this case blue light.
- the sensor elements can be arranged rectangularly as part of an image sensor in a 2x2 matrix, wherein the 2x2 matrix can only represent a section of the image sensor.
- the Sensor elements can be arranged according to a Bayer pattern, so that a color image can be reconstructed from the detected wavelengths.
- an associated coupling-in area 44 can extend over an entire surface of the carrier medium 16, wherein a plurality of coupling-in areas can be combined in the associated coupling-in area 44.
- the first coupling-in area 18, the second coupling-in area 20 and a third coupling-in area can coincide in the associated coupling-in area, with deflection structures of the respective coupling-in areas being arranged one behind the other in the carrier medium 16.
- the deflection structures belonging to the respective coupling area can preferably also be designed as a single multiplex deflection structure. This means that by changing the periodicity of the grating structure, several optical gratings can be interlaced and thus only those predetermined wavelength components are coupled into the carrier medium 16 which correspond to the wavelength specified by the grating planes.
- light 34 which comprises, for example, red light as the first predetermined wavelength and which falls on the associated coupling-in area 44
- the first decoupling deflection structure 30 can emit the portion of the red light onto the first sensor element 12. That is to say that the coupling-in area 44 that belongs together acts as a first deflection structure for red light.
- the previously described bundling grating structure can also be used to bundle the light onto the first decoupling area 22, which is smaller in comparison to the associated coupling-in area 44.
- green and blue wavelength components can also be deflected onto the corresponding sensor elements 14, 42.
- a further exemplary embodiment of the Schmsensorvor device 10 is shown in perspective.
- the sensor elements as part of an image sensor can be the same as in Fig. 2 angeord net in this embodiment.
- a surface of the carrier medium 16 can include the first coupling region 18.
- the first coupling-in area 18, according to the aforementioned embodiments can deflect the light 34 that falls on the first coupling-in area 18 onto the first coupling-out area 22 via the carrier medium 16 so that the red wavelength component can be coupled out onto the first sensor element 12.
- the carrier medium 16 in front of the first sensor element 12 does not have a first coupling area with the first deflection structure.
- light 36 that strikes this area can reach the first sensor element 12 directly through the carrier medium 16.
- the deflecting structures for the second and third coupling areas are provided (not shown).
- the deflection structures are preferably designed as a holographic grating, the deflection structures are frequency-selective, which means that the predetermined first wavelength, i.e. the red light, is not deflected and can pass directly to the sensor element 12.
- the holographic gratings can be angle-selective, as a result of which the first outcoupling deflection structure of the first outcoupling region 22 does not deflect the red wavelength portion of the light 36 from the direct path into the first sensor element 12. It can thus be achieved that the respective wavelength components reach the sensor element intended for them.
- FIGS. 4 and 5 show, for example, how light conduction can be achieved by means of internal reflection within the carrier medium 16 for a previously shown image matrix made up of sensor elements for red, green and blue wavelengths.
- the light guide according to FIG. 4 can be provided. This means that light that falls into a respective coupling area on the surface of the carrier medium 16 can be directed diagonally into the corresponding field of the decoupling area, from where it is coupled out from the carrier medium 16 to the corresponding sensor element for red or blue light can.
- a coupling area with the deflection structure for green light can be provided twice on one surface of the carrier medium 16, with the carrier medium 16 the green light can then be directed parallel and opposite to one another in the respective coupling-in areas to the coupling-out areas for green light by means of internal reflection, which is illustrated, for example, in FIG. 5.
- one aspect is that a light guide (carrier medium 16) with a holographic-optical element (the deflection structures) is placed over a color filter pattern of sensor elements, which, depending on the desired wavelengths, otherwise unused red, green or collects blue light and directs it onto the individual pixels (the sensor elements).
- the light guide can contain, for example, several individual holographic optical elements, for example three pieces for red, yellow and blue, or a holographic optical element with multiple exposure (multiplexing).
- the holographic-optical element can have at least one coupling-in and one coupling-out deflection structure.
- each pixel can receive light from an entire pixel area.
- an “active” area increases by a factor of 2 for green, and by a factor of 4 for red and blue.
- an image sensor device 10 for example a camera sensor
- mxn pixels with mxn color filters lying on the pixels, preferably red, green and blue color filters according to a Bayer pattern.
- a transparent light guide (carrier medium 16) with at least one holographic-optical element and at least two exposures can be provided, one for coupling in and one for coupling out.
- At least three holographic-optical elements or three exposures can be provided in at least one holographic-optical element for coupling red, green and blue light. It can also be provided that cutouts are provided in the coupling-in holographic optical element for the pixel to be coupled out.
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Human Computer Interaction (AREA)
- Color Television Image Signal Generators (AREA)
- Solid State Image Pick-Up Elements (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102020113591.2A DE102020113591B4 (de) | 2020-05-19 | 2020-05-19 | Bildsensorvorrichtung einer Kamera zur Detektion von Licht |
| PCT/EP2021/060371 WO2021233633A1 (de) | 2020-05-19 | 2021-04-21 | Bildsensorvorrichtung einer kamera zur detektion von licht |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4154052A1 true EP4154052A1 (de) | 2023-03-29 |
Family
ID=75639903
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP21720740.6A Withdrawn EP4154052A1 (de) | 2020-05-19 | 2021-04-21 | Bildsensorvorrichtung einer kamera zur detektion von licht |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US12101537B2 (de) |
| EP (1) | EP4154052A1 (de) |
| CN (1) | CN115605799A (de) |
| DE (1) | DE102020113591B4 (de) |
| WO (1) | WO2021233633A1 (de) |
Family Cites Families (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0287581A (ja) * | 1988-09-26 | 1990-03-28 | Canon Inc | 波長分波光検出器 |
| US5764389A (en) | 1996-11-26 | 1998-06-09 | Hughes Electronics Corporation | Holographic color filters for display applications, and operating method |
| US6330113B1 (en) * | 2000-09-28 | 2001-12-11 | Foveon, Inc. | Color separation prism with adjustable path lengths |
| JP4652634B2 (ja) | 2001-08-31 | 2011-03-16 | キヤノン株式会社 | 撮像装置 |
| US6738171B1 (en) | 2001-11-21 | 2004-05-18 | Micron Technology, Inc. | Color filter array and microlens array having holographic optical elements |
| US7250973B2 (en) | 2002-02-21 | 2007-07-31 | Canon Kabushiki Kaisha | Image pickup apparatus for reflecting light at an area between successive refractive areas |
| EP1341235A3 (de) | 2002-02-28 | 2006-05-10 | Canon Kabushiki Kaisha | Bildaufnahmegerät |
| US7106526B2 (en) * | 2004-04-21 | 2006-09-12 | Matsushita Electric Industrial Co., Ltd. | Thin imaging apparatus, a thin camera, and an imaging method |
| US8101903B2 (en) | 2007-01-23 | 2012-01-24 | Micron Technology, Inc. | Method, apparatus and system providing holographic layer as micro-lens and color filter array in an imager |
| WO2013140016A1 (en) * | 2012-03-20 | 2013-09-26 | Nokia Corporation | An apparatus and a method for imaging |
| US10048647B2 (en) * | 2014-03-27 | 2018-08-14 | Microsoft Technology Licensing, Llc | Optical waveguide including spatially-varying volume hologram |
| US9632226B2 (en) * | 2015-02-12 | 2017-04-25 | Digilens Inc. | Waveguide grating device |
| KR102556008B1 (ko) | 2015-10-06 | 2023-07-17 | 삼성전자주식회사 | 이미지 센서의 컬러 스플리터 |
| KR102392711B1 (ko) * | 2017-12-21 | 2022-04-29 | 한국전자통신연구원 | 컬러 카메라 및 그의 컬러 영상 획득 방법 |
| DE102019206377A1 (de) * | 2019-05-03 | 2020-11-05 | Audi Ag | Objekterkennungssystem zum Anordnen auf einem Gerät |
-
2020
- 2020-05-19 DE DE102020113591.2A patent/DE102020113591B4/de active Active
-
2021
- 2021-04-21 US US17/999,182 patent/US12101537B2/en active Active
- 2021-04-21 WO PCT/EP2021/060371 patent/WO2021233633A1/de not_active Ceased
- 2021-04-21 CN CN202180034455.3A patent/CN115605799A/zh active Pending
- 2021-04-21 EP EP21720740.6A patent/EP4154052A1/de not_active Withdrawn
Also Published As
| Publication number | Publication date |
|---|---|
| US12101537B2 (en) | 2024-09-24 |
| WO2021233633A1 (de) | 2021-11-25 |
| CN115605799A (zh) | 2023-01-13 |
| DE102020113591A1 (de) | 2021-11-25 |
| DE102020113591B4 (de) | 2022-02-03 |
| US20230209154A1 (en) | 2023-06-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| DE69434719T2 (de) | Optische holographische Vorrichtungen | |
| DE112015000351T5 (de) | Anzeigevorrichtung für eine holografische Rekonstruktion | |
| EP3217205B1 (de) | Vorrichtung und verfahren zur multispot-scanning-mikroskopie | |
| DE2713890C2 (de) | ||
| DE102009043745A1 (de) | Spektraldetektor mit variabler Filterung durch räumliche Farbtrennung und Laser-Scanning- Mikroskop | |
| EP1141763B1 (de) | Anordnung zur separierung von anregungs- und emissionslicht in einem mikroskop | |
| EP0992141B1 (de) | Einrichtung zur übertragung von optischen signalen unterschiedlicher frequenzen | |
| DE102019206363B3 (de) | Kraftfahrzeug mit einer Vorrichtung zum farbabhängigen Detektieren von Bildinhalten sowie Rechenvorrichtung | |
| EP3918393B1 (de) | Bildschirm mit einem transparenten basiskörper | |
| DE2952071A1 (de) | Anordnung zur spektralen zerlegung von licht | |
| WO2020225122A1 (de) | 3d-druckvorrichtung zur photopolymerisation eines photosensitiven kunstharzes durch ein belichtungsmuster | |
| DE19831536A1 (de) | Vorrichtung und Verfahren zur Vereinigung von Licht mit Hilfe einer flachen Platte und ein Verfahren zur Herstellung der Vorrichtung | |
| DE69406229T2 (de) | Optische Abbildungsvorrichtung für die Spektralanalyse einer Szene | |
| WO2021233633A1 (de) | Bildsensorvorrichtung einer kamera zur detektion von licht | |
| EP3963357B1 (de) | Abstandsmesssystem | |
| WO2020200850A1 (de) | Optisches system | |
| EP3987327B1 (de) | Optisches system mit einem filterelement | |
| DE102018206341A1 (de) | LIDAR-System sowie gekrümmtes Schutzglas | |
| EP3963876A1 (de) | Erfassungsvorrichtung mit einer bilderfassungseinrichtung und einem trägermedium sowie erfassungssystem mit einer derartigen erfassungsvorrichtung und einem gerät mit einem bildschirm | |
| CN113412415A (zh) | 交错衍射光栅 | |
| DE102022114150B4 (de) | Optisches System zur digitalen Holografie | |
| DE102019204875B3 (de) | Flachbettscanner | |
| DE102021111066B4 (de) | Optische Spektroskopieeinrichtung | |
| DE102019206352A1 (de) | Detektionsvorrichtung zum Bestimmen einer Lichtintensität sowie Kraftfahrzeug | |
| DE102018206459A1 (de) | Filtereinheit für ein optisches Sensorsystem, Verfahren zum Betreiben einer Filtereinheit und Verfahren zum Herstellen einer Filtereinheit |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20221115 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230529 |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
| RIC1 | Information provided on ipc code assigned before grant |
Ipc: G03B 33/12 20060101ALI20241209BHEP Ipc: G02B 27/00 20060101ALI20241209BHEP Ipc: G02B 27/12 20060101ALI20241209BHEP Ipc: G02B 27/10 20060101AFI20241209BHEP |
|
| INTG | Intention to grant announced |
Effective date: 20241219 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
| 18D | Application deemed to be withdrawn |
Effective date: 20250423 |