EP4309357A1 - Kamerasystem zum erzeugen einer lückenlosen optischen abbildung - Google Patents
Kamerasystem zum erzeugen einer lückenlosen optischen abbildungInfo
- Publication number
- EP4309357A1 EP4309357A1 EP22713680.1A EP22713680A EP4309357A1 EP 4309357 A1 EP4309357 A1 EP 4309357A1 EP 22713680 A EP22713680 A EP 22713680A EP 4309357 A1 EP4309357 A1 EP 4309357A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- image sensor
- beam deflection
- camera system
- deflection element
- lens
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B13/00—Optical objectives specially designed for the purposes specified below
- G02B13/06—Panoramic objectives; So-called "sky lenses" including panoramic objectives having reflecting surfaces
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B1/00—Optical elements characterised by the material of which they are made; Optical coatings for optical elements
- G02B1/10—Optical coatings produced by application to, or surface treatment of, optical elements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B17/00—Systems with reflecting surfaces, with or without refracting elements
- G02B17/006—Systems in which light light is reflected on a plurality of parallel surfaces, e.g. louvre mirrors, total internal reflection [TIR] lenses
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B26/00—Optical devices or arrangements for the control of light using movable or deformable optical elements
- G02B26/08—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
- G02B26/0808—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light by means of one or more diffracting elements
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B26/00—Optical devices or arrangements for the control of light using movable or deformable optical elements
- G02B26/08—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light
- G02B26/0816—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the direction of light by means of one or more reflecting elements
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B17/00—Details of cameras or camera bodies; Accessories therefor
- G03B17/02—Bodies
- G03B17/17—Bodies with reflectors arranged in beam forming the photographic image, e.g. for reducing dimensions of camera
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B37/00—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe
- G03B37/04—Panoramic or wide-screen photography; Photographing extended surfaces, e.g. for surveying; Photographing internal surfaces, e.g. of pipe with cameras or projectors providing touching or overlapping fields of view
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/50—Constructional details
- H04N23/55—Optical parts specially adapted for electronic image sensors; Mounting thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/58—Means for changing the camera field of view without moving the camera body, e.g. nutating or panning of optics or image sensors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/698—Control of cameras or camera modules for achieving an enlarged field of view, e.g. panoramic image capture
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B5/00—Optical elements other than lenses
- G02B5/04—Prisms
Definitions
- the present invention relates to a camera system for generating a gapless optical image.
- a sharp, bright and low-distortion image of large fields of view can be generated by segmenting the field of view.
- Beam deflection is required for very large fields of view (> approx. 150°).
- a beam deflection takes place in three-dimensional space in at least one plane. In general, this means that the partial fields of view cannot be joined together without a major overlap when they are combined to form a single field of view. Rather, the individual partial fields of view are rotated relative to one another, which leads to overlaps and/or gaps when they are put together.
- Gaps For example, correspond to unused zones on the image sensor. This is undesirable for economic reasons.
- One object of the present invention is to provide a camera system for generating an optical image, the camera system being of compact and simple construction.
- the core idea of the present invention is to avoid gaps in the field of view or unused areas on an image sensor used. Because it was recognized that there is an optimal arrangement of the imaging elements in relation to the image sensor or in relation to several image sensors and in relation to each other, in which the partial fields of view ideally connect to one another and complement each other to form a large overall field of view without significant overlap . In order to avoid gaps in the field of view or unused areas on an image sensor used, it was recognized that all mirror axes, which are also referred to herein as tilt axes, should be selected in such a way that they run parallel to an edge of an image sensor surface. It is also advantageous if the tilting axes are spaced parallel to an image sensor surface of the at least one image sensor.
- the proposed camera system comprises at least one rectangular image sensor, a multi-aperture lens for generating an optical image and a beam deflection element arrangement.
- the beam deflection element arrangement has a number of beam deflection elements for deflecting incident light beams.
- the beam deflection elements can be provided by mirrors and/or prisms. In other words: a beam deflection element can be a mirror or a prism or a combination of mirror and prism.
- the multi-aperture lens and the beam steering assembly are coupled to the at least one rectangular image sensor to form an array of optical channels incident on the at least one image sensor for capturing the optical image.
- two optical channels have different viewing directions and therefore two fields of view that are rotated and/or shifted in relation to one another, with one partial field of view of the partial fields of view being viewed through a lens without a deflection element and another partial field of view of the partial fields of view looking in a lateral viewing direction , resulting from a lens and a deflection element with an image sensor.
- a single image sensor or a plurality of image sensors can be provided in the proposed camera system.
- the image sensors are of rectangular design, in which case rectangular can also mean square.
- the side lengths of two image sensors can be of different lengths.
- the number of beam deflection elements is arranged relative to one another and in relation to the at least one image sensor in such a way that each beam deflection element is tilted about a tilting axis.
- a tilt axis can be understood as a mirror axis, which is characterized in that light beams incident on a beam deflection element are deflected into a specific optical channel, so that the light beams impinge on a predetermined, in particular rectangular, area of an image sensor surface of the at least one image sensor.
- the tilting axis runs through a beam deflection element surface, ie through a plane of the beam deflection element.
- the tilting axis preferably runs on an outer surface of the beam deflection element.
- a beam deflection element has outer surfaces, with at least one of these, in particular flat, surfaces forming the beam deflection element surface. It is also conceivable to place another surface of the beam deflection element in such a way that this other surface then defines the surface of the beam deflection element. It is also conceivable that such a placement is made possible by a user. It is also conceivable that the tilt axis is actually an axis around which the mirror can be rotated in order to choose the deflection. At this point it should be pointed out that the tilting axes, as used here in the present application, are only a conceptual aid for understanding or for the construction, and are not necessarily actually rotatable axes in the finished structure, but are such could.
- the tilting axis runs parallel to one side of the at least one rectangular image sensor (option A) or the tilting axis closes with at least one side of two sides of the at least one rectangular image sensor, in particular which span an image sensor surface of the at least one rectangular image sensor, a 45 ° angle (option B). If the condition of option A is met, the field of view does not rotate in object space. The field of view is only shifted and/or mirrored in one direction by tilting on the tilting axis, namely above, or below, or to one side of the image sensor surface in the object space. The corners of the desired overall field of view in the object space cannot be reached by fulfilling option A. If the condition of option B is met, i.e.
- the field of view rotates by 90 ° (degrees) in the object space.
- the sides of the rotated, in particular rectangular, field of view therefore run parallel to the shifted fields of view or the shifted field of view according to option A.
- the tilt axis runs at a different angle to the sides of the rectangular image sensor, gaps or Overlaps in the fields of vision arise.
- a complete field of view can thus be recorded with the proposed camera system, ie the entire area of the image sensor can be used to record the image.
- the tilting axis preferably runs parallel to, in particular at a distance from, the image sensor surface. Because the tilting axis runs parallel to one side of the at least one rectangular image sensor (option A fulfilled) or at a 45° angle to this side of the at least one rectangular image sensor (option B fulfilled) and on the other hand runs parallel to the image sensor surface a two-dimensional tilt angle is defined in three-dimensional space, which leads to a gapless field of view with a total field of view > 90°.
- a camera system which comprises: at least one rectangular image sensor, a multi-aperture lens for generating an optical image, and a beam deflection element arrangement which comprises a number of beam deflection elements for deflecting incident light beams, the multi-aperture lens and the beam-steering arrangement is coupled to the at least one rectangular image sensor to form an array of optical channels which are incident on the at least one image sensor for recording the optical image, the number of beam-steering elements being such with respect to one another and in relation to the at least an image sensor are arranged such that each beam deflection element is tilted about a tilting axis, the tilting axis running through a beam deflecting element surface and the tilting axis running parallel to one side of the at least one rectangular image sensor or the tilting axis running parallel at least one side of two sides of the at least one rectangular image sensor encloses a 45 angle, having two beam deflection arrangements, the two beam deflection arrangements surrounding the multi-aper
- the at least one image sensor described herein can also be a detector which can detect different electromagnetic wavelengths.
- a field of view can be imaged on an image sensor or on a number of image sensors, with the resulting total field of view being greater than or equal to a space in a hemisphere and without gaps.
- gaps or overlaps can be eliminated when assembling a large field of view made up of several partial fields of view can be avoided. This is because the proposed beam deflection arrangement makes it possible to image or record an uninterrupted field of view greater than 90° in three-dimensional space on the image sensor by means of the light beams or electromagnetic beams incident on the deflection elements.
- the proposed camera system can cover a field of view of a half-space without gaps and without overlapping, without the camera system as such increasing in size. Furthermore, the costs for producing such a camera system do not increase significantly either. This is because the camera system described herein addresses a problem that occurs in very specific arrangements. This involves a camera system that segments an overall field of view into partial fields of view and images each segmented field of view in an optical channel with at least one lens associated with the optical channel on an image sensor. In other words, each segmented partial field of view has its own optical channel with at least one objective. It is conceivable here for the lenses to be arranged on a common substrate. The lenses can be made, for example, by glass stamping or as a polymer molded onto glass.
- the lenses can therefore be designed as a monolithic array. Electromagnetic rays transmitted through a lens define an optical channel. This means that the number of lenses preferably determines the number of optical channels. A rectangular area of the at least one image sensor is assigned to each optical channel on the at least one image sensor of the proposed camera system. The electromagnetic beams of the associated optical channel are detected in each rectangular area.
- the advantages of the proposed camera system can be seen specifically in the fact that there is no loss of sensor area since the beam deflection element arrangement is configured in such a way that the entire sensor area can be used in order to cover as large a spatial area as possible. Furthermore, the proposed camera system can have the same or even smaller dimensions than those already known Camera systems are formed, which also contributes to a lower weight and / or lower costs for the production of the camera system.
- the proposed camera system can be used in vehicle cameras.
- Other example areas in which the proposed camera system can be used are robotics, machine vision (in other words: machine vision using industrial cameras), remote sensing, mobile phones, in video conference systems or even in medical applications.
- Advantageous refinements of the present invention are the subject matter of the dependent patent claims. Preferred exemplary embodiments of the present invention are explained in detail below with reference to the accompanying drawings. Shown are: Fig. 1a, b schematic views of various examples of lenses and
- Image sensors for forming optical channels on image sensors with different viewing directions
- 2a, b shows a schematic view of a camera system and representation of the associated resulting visual field in the object space
- FIGS. 3a-h schematic views of camera systems (FIGS. 3a, c, e, g) and depiction of the associated resulting visual field in the object space (FIGS. 3b, d, f, h);
- FIG. 4a-d schematic views of camera systems (FIGS. 4a, c) and depiction of the associated resulting visual field in the object space (FIGS. 4b, d);
- 5a,b show schematic views of resulting fields of view in the object space, each with nine optical channels, the optical channels in FIG. 5a showing no gaps and no overlap and the optical channels in FIG. 5b showing gaps and overlaps;
- 6a shows a schematic camera system in which the multi-aperture objective is arranged between the beam deflection element arrangement and at least one image sensor;
- 6b shows a schematic camera system in which the beam deflection element arrangement is arranged between the multi-aperture objective and the at least one image sensor;
- 6c shows a schematic camera system in which the multi-aperture objective is surrounded on both sides by a beam deflection element arrangement.
- FIGS. 1a to 6c Individual aspects of the invention described herein are illustrated below in Figs. 1a to 6c described. The principle of the present invention is illustrated by looking at FIGS. 1a to 6c together.
- the same reference symbols relate to elements that are the same or have the same effect, with not all reference symbols being repeated in all drawings, insofar as they are repeated.
- a coordinate system in image space (x, y, z) or in object space (k 1 , k 2 ) is drawn in, to which reference is made here in order to describe the proposed camera system in relation to the axes or to further specify the resulting visual field.
- the coordinates x, y, z, k 1 and k 2 are each real numbers, with the (x, y, z) coordinate system preferably being Cartesian coordinates and the (k 1 , k 2 ) coordinate system being polar coordinates.
- Figs. 1a and 1b are schematic views of different examples of lenses 2 and image sensors 40 for the formation of optical channels 22 on the image sensors 40 with different viewing directions 3 are shown.
- FIG. 1a shows, for example, a rectangular image sensor 40 with a lens 2, which is arranged on or parallel to the image sensor 40 at a distance.
- Reference number 3 indicates a viewing direction 3 of image sensor 40 in FIG. 1a. Without a beam deflection element 4, the line of sight 3 of the image sensor 40 extends, as shown in FIG is defined.
- the image sensor 40 has an image sensor surface 45 which is also rectangular.
- the image sensor 40 in Figs. 1a and 1b is each rectangular with two different side lengths 44a, 44b. It is also conceivable for the image sensor 40 to be square to train. Which angular range in the image space a specific optical channel occupies can be determined by back-projecting its rectangular range on the image sensor 40 through the lens 2 and the deflection element 4 into the object space.
- the visual field 50, 52 in turn has the shape of a rectangle in the object space. See figs. 2 to 4. If this is carried out for different tilt angles of the beam deflection element 4, then it is found that this rectangle rotates under certain circumstances. However, this depends on the tilt angle in three-dimensional space in at least one plane. In other words, the rotation or displacement of the rectangle depends on the tilting axis 5 about which the beam deflection element 4 is tilted in relation to the image sensor 40 . Two optical channels with different viewing directions 3 therefore have two fields of view 50, 52 which are rotated and/or shifted in relation to one another.
- a beam deflection element 4 is arranged in front of the lens 2 in FIG. 1b.
- the beam deflection element 4 can be a mirror 34 or a prism 32, for example. It is also conceivable that the beam deflection element 4 is a combination of a mirror 34 and a prism 32 or a combination of a plurality of mirrors 34 and prisms 32 .
- the beam deflection element 4 has such a geometry that the beam deflection element 4 has a beam deflection element surface 46 on a side facing away from the image sensor surface 45 or the objective 2, which extends away from the objective 2 at an angle ⁇ .
- the beam deflection element surface 46 can extend away from the lens 2 at an angle ⁇ >0° or ⁇ 90°.
- the beam deflection element surface 46 thus extends in three-dimensional space and has variable (x, y, z) coordinates starting from a surface of the objective 2, where x, y and z are real numbers.
- the beam deflection element surface 46 has a tilting axis 5 which—as shown in FIG.
- the image sensor 40 according to FIG. 1b has a viewing direction 3 that deviates from the straight-ahead direction, namely laterally in the y-direction.
- the image sensor 40 according to FIG. 1b looks sideways around the corner, so to speak.
- the camera system 100 comprises at least one rectangular image sensor 40, a multi-aperture lens 20 for generating a optical imaging, and a beam-deflecting element arrangement 30, such as that shown in Figs. 2a, 3a, 3c, 3e, 3g and 4a, and 4c can be seen.
- the beam deflection element arrangement 30 comprises a number of beam deflection elements 4 for deflecting incident light beams.
- the multi-aperture lens 20 comprises a number of lenses 2.
- the multi-aperture lens 20 and the beam deflection arrangement 30 are coupled to the at least one rectangular image sensor 40 in order to form an arrangement of optical channels 22 which incident on the at least one image sensor 40 for recording the optical image.
- An optical channel is defined as an arrangement of lens 2 and optionally beam deflection element 4 .
- Electromagnetic rays are then incident on the image sensor 40 through the optical channel 22. Electromagnetic rays are incident in each optical channel 22 and are then incident on the at least one image sensor 40 for recording the optical image.
- the number of beam deflection elements 4 is arranged in relation to one another and in relation to the image sensor 40 in such a way that each beam deflection element 4 is tilted about a tilting axis 5, with the tilting axis 5 running through a beam deflecting element surface 46 and the tilting axis 5 with one side of the at least one rectangular Image sensor 40 runs parallel or the tilting axis 5 encloses a 45° angle with at least one side, in particular with two sides, of the at least one rectangular image sensor 40, which span an image sensor surface 45 of the at least one rectangular image sensor 40.
- the camera system 100 includes a number of image sensors 40.
- each lens 2 could be designed with a single image sensor 40. It is also conceivable that a single image sensor is provided or that a lens 2 is arranged on a number of image sensors 40 .
- the at least one image sensor 40 can thus be a single image sensor 40 or consist of a plurality of image sensors 40.
- the tilting axis 5 preferably runs parallel to, in particular at a distance from, the image sensor surface 45.
- the tilting axis assumes a constant value on the z-axis and extends either along the x-axis or along the y-axis pa parallel to a side 44 of the at least one image sensor 40 (see FIGS. 3a and 3c) or extends in the xy plane, so that the tilting axis 5 has an angle of 45° a side length 44 of the at least one image sensor 40 (see FIG. 3e).
- the partial fields of view 50, 52 are drawn in in FIG. 3b, which result from the lenses 2 shown in FIG. 3a with and without deflection element 4. In the corresponding figures, partial field of view 50 is lens 2 looking straight ahead with image sensor 40 and without deflection element 4 .
- the partial fields of view 52 result from a lens 2 with an image sensor 40 and a deflection element 4 which looks in a lateral direction, as already described above.
- the partial field of view 52 from FIG. 3b is mirrored upwards, that is to say mirrored along a k 2 axis and shifted along the k 1 axis.
- the partial field of view 52 from FIG. 3d is mirrored to the right side, ie mirrored along a k 1 axis and shifted along the k 2 axis.
- the tilting axes 5 in FIGS. 3a and 3c are each arranged running parallel to one side of the image sensor 40.
- the partial field of view from FIG. 3f is, for example, rotated, mirrored and shifted parallel to the axes in the object space, so that the partial field of view in FIG. 3f only adjoins at one corner of the partial field of view 50 looking straight ahead.
- the tilting axis 5 in Fig. 3e runs at a 45° angle to one side of the image sensor 40.
- the partial field of view from Fig. 3h is, for example, rotated, mirrored and not shifted parallel to the axes in the object space, so that the partial field of view in Fig. 3h leads to gaps 72 and/or an overlap 70 with other partial fields of view 52 (cf. Fig. 5b).
- the tilting axis 5 in Fig. 3g does not run at a 45° angle to one side of the
- the image sensor 40 preferably comprises a rectangular image sensor surface 45, which is connected to the multi-aperture lens 20 and the beam deflection arrangement 30 in such a way that electromagnetic beams which are incident through a deflection element 4 in the associated optical channel 22 fall on a rectangular area of the image sensor surface 45 are incident.
- light beams are preferably incident on the multi-aperture objective 20 .
- electromagnetic rays from the non-visible range can also impinge on the image sensor 40, which can also be detectable.
- light rays therefore mean electromagnetic rays of any wavelength range.
- Each beam deflection element 4 is assigned an optical channel 22 through which the light beams impinge on the image sensor 40, in particular on a rectangular area of the image sensor 40.
- the beam deflection elements 4 are preferably mirrors 34 and/or prisms 32.
- a beam deflection element 4 can therefore be a mirror 34, or can be a prism 32, or can be a combination of mirror 34 and prism 32.
- Such mirrors 34 and/or prisms 32 are shown in Figs. 2 to 4 shown schematically.
- An image sensor 40 or a region of an image sensor 40 on which only one lens can be arranged can have a straight-ahead viewing direction 3, which can run along the z-axis.
- Each camera system 100 can have at least one image sensor 40 or a region of an image sensor 40 on which only one lens is arranged.
- the camera system 100 it is also conceivable for the camera system 100 to have a beam deflection element 4 with a straight-ahead direction, as has already been described further above.
- the at least one image sensor 40 preferably has a number of rectangular areas, with each rectangular area being assigned to an optical channel 22 .
- each optical channel 22 is assigned its own rectangular image sensor area, on which the electromagnetic rays assigned to the optical channel can be collected or detected in order to record the optical image.
- a rectangular area of the number of rectangular areas or the at least one image sensor 40 can be square (not shown).
- Image sensor 40 is preferably rectangular with two different side lengths 44a, 44b, as is shown, for example, in FIGS. 1a to 1b.
- the at least one image sensor 40 is composed of a plurality of rectangular image sensors to form an overall rectangular image sensor.
- a border of the image sensor surface 45 i.e. whether the image sensor surface 45 is square or rectangular, determines a resulting border of the visual field in the object space.
- Two different rectangular areas of the number of rectangular areas preferably have different side lengths 44a and 44b.
- the side lengths 44a, 44b of the image sensor 40 of different lengths define rectangular areas of the image sensor surface of different sizes, which are also associated with fields of view of different sizes in the object space. In this way, for example, the resolution can be improved or a larger space can be imaged by an image sensor 40 with lens 2 . It is conceivable to assemble the overall field of view from partial fields of view of different sizes and shapes, with the different partial fields of view being able to go back to image sensor surfaces 45 with different side lengths 44a, 44b. Such a procedure can be accompanied by space savings. Because, for example, the mirrors can become quite large for certain deflection angles.
- Electromagnetic rays that are not transmitted through a trimmed deflection element 4 can be transmitted, for example, through an adjacent deflection element 4, so that all in all, the entire image information, ie all electromagnetic rays, can be captured by the camera system . It is also conceivable for square image sensors 40 to be combined with rectangular image sensors 40 in a camera system 100 .
- Each beam deflection element 4 preferably has a beam deflection element surface which has the shape of a parallelogram or a trapezoid or a triangle or an oval or a circle or a polygon. It is also conceivable that the beam deflection element surface has an asymmetrical circumference. It is conceivable to cut a mirror or a prism in a desired shape, in particular for reasons of space. In particular, a deflection element 4 in a projection onto the image sensor surface 45 does not have to fill the same completely.
- the beam deflection element 4 can also be part of the optical system of the lens, ie it can be optically effective.
- the optical channel 22 can then be a hybrid imaging system that contains both refractive and reflective elements.
- the mirror can have any shape of reflective optical elements, for example parabolic, hyperbolic or spherical. In addition, it can also have another rotationally symmetrical, aspherical shape or have a free-form surface. Furthermore, a deflection element 4 can be segmented, i.e. composed of several surfaces and possibly have kinks.
- FIG. 3 shows some positions of the beam deflection elements 4 and the resulting fields of view 50, 52 in the object space.
- the tilting axis 5 of the beam deflection element 4 is parallel to one of the sides of the image sensor 40.
- the associated partial visual field 52 is mirrored upwards (FIG. 3b) or mirrored to the right (FIG. 3d). A shift up or to the right can be set by an associated tilt angle.
- the tilting axis 5 of the beam deflection element 4 encloses an angle of 45° to the sides of the image sensor 40.
- the resulting field of view 52 is mirrored about a 45° axis. In other words, the field of view 52 is shifted to the top left, which can be adjusted by the tilt angle (FIG. 3f).
- the tilting axis 5 of the beam deflection element 4 encloses an angle other than 45° to the sides of the image sensor 40.
- the resulting field of view 52 is mirrored about an axis other than 45°, causing the field of view to rotate. This leads to overlaps 70 and gaps 70 with other fields of view 52 (see also FIG. 5b).
- figs 4a and 4c each show a camera system with four optical channels 22 and Figs. 4b and 4d show the associated fields of view 50, 52 in object space.
- the tilting axes 5 either run parallel or enclose an angle of 45° to the sides of the image sensor 40 .
- the result is an uninterrupted field of view (FIG. 4b).
- the tilting axes 5 either run parallel or do not enclose an angle of 45° to the sides of the image sensor 40.
- FIG. The result is a field of view with gaps 72 and overlaps 70 (FIG. 4b)
- FIG. 5a shows a complete field of view 54 without gaps, which is composed of a field of view 50 straight ahead and eight partial fields of view 52 surrounding it.
- a camera system 100 as shown in FIG. tere optical channels 22 has been expanded.
- the optical channels from FIG. 5a are arranged, for example, in a 3 ⁇ 3 matrix structure.
- the optical channels may generally be arranged in an mxn matrix structure, where m and n are natural numbers.
- 5b shows an overall field of view with gaps 72 and overlaps 72.
- a camera system 100 as shown in FIG is neither parallel nor at a 45° angle to the sides 44 of the image sensor 40 .
- At least one beam deflection element 4 preferably has a metallic and/or a dielectric coating 60, 62.
- the metallic and/or the dielectric coating 60, 62 is applied to a surface 64, such as on the beam deflection element surface, of the beam deflection element 4 in order to separate two adjacent optical channels 22 from one another and/or to enable reflections in the beam deflection element 4.
- Incoming electromagnetic beams or light beams are reflected or deflected within the beam deflection element 4 on the metallic coating 60 or on the dielectric coating 62 according to the doctrine of the angle of incidence equaling the angle of emergence.
- camera systems 100 without a coating are also conceivable. These can then use total internal reflection, for example, to deflect the electromagnetic radiation.
- the beam deflection elements 4 can then be provided entirely or partially by prisms or by combinations of mirrors and prisms.
- At least one beam deflection element 4 is therefore preferably designed to implement the beam deflection by means of total internal reflection.
- the multi-aperture lens 20 is preferably a lens arrangement which is formed from two or more lenses 2 .
- the lenses 2 of the lens arrangement are arranged side by side, in particular each lens 2 is assigned an optical channel 22 .
- the number of optical channels is equal to the number of lenses 2.
- a number of lenses 2 can image their optical channels on a single image sensor 40. It is also conceivable for each lens 2 to image its optical channel 22 onto an image sensor 40 assigned to the lens, or for a lens to image its optical channel 22 onto image sensors 40 arranged next to one another.
- a lens 2 is preferably assigned to each beam deflection element 4 , with a beam deflection element 4 not being assigned to each lens 2 , so that the number of beam deflection elements 4 is less than or equal to the number of lenses 2 .
- the number of beam deflection elements 4 arranged next to one another can be less than or equal to the number of lenses 2 .
- Figs. 2 to 4 each show a schematic perspective of an excerpt of a camera system 100.
- FIGS. At the same time, this arrangement in the matrix structure reflects a possible channel assignment on the at least one image sensor 40 or on a detector.
- a partial visual field 50 is also shown in each of FIGS. 2 and 3, which results through the optical channel 22 of the associated lens 2 after detection by the at least one image sensor 40 in the object space.
- the figs. 2 to 4 each have a coordinate system in the object space, this coordinate system having the axes k 1 and k 2 .
- the lens 2 without a beam deflection element 4 looks in a straight-ahead direction, that is to say along an optical axis (in the z-direction) perpendicular to an image sensor plane 45 which runs parallel to an xy plane.
- a straight optical channel 22 of a lens 2 does not require any deflection or deflection of a light beam.
- the lens 2 with the beam deflection element 4 has a lateral viewing direction. In other words: the lens 2 can look in a specific lateral direction with the aid of the beam deflection element 4 .
- the partial field of view 50 of the objective 2 looking straight ahead is shown in FIGS. 3 and 4, for example, at the origin of the k 1 -k 2 coordinate system.
- the lateral partial field of view 52 that is shifted and/or rotated and/or mirrored by the respective associated beam deflection element 4 adjoins the straight field of view 50 in such a way that a complete overall field of view 54 can result, as is shown, for example, in Fig 5a is shown.
- the objective arrangement is preferably of monolithic design.
- Monolithic in this context means consisting of one piece or one piece.
- Preferred ' are the
- Lenses 26 of the lenses 2 arranged side by side on a common glass wafer (not shown).
- the lenses 24 are preferably arranged in one plane.
- the glass wafer thus acts as a carrier or as a substrate, which is related to Wafer-level optics can be referred to.
- the objectives can also each consist of several lenses; then, for example, the lens arrangement consists of several glass wafers stacked on top of one another.
- FIG. 6a shows a camera system in which the multi-aperture objective 20 is arranged between the beam deflection element arrangement 30 and at least one image sensor 40.
- FIG. The multi-aperture objective 20 and the beam deflection arrangement are preferred
- the multi-aperture lens 20 is located between the beam deflection arrangement 30 and the at least one image sensor 40 .
- FIG. 6b shows a camera system 100 in which the beam deflection element arrangement 30 is arranged between the multi-aperture objective 20 and the at least one image sensor 40.
- FIG. 6c shows a camera system 100 in which the multi-aperture lens 20 is surrounded on both sides by a beam deflection element arrangement 30 in each case.
- the camera system thus has two beam deflection arrangements 30, with the two beam deflection arrangements 30 surrounding the multi-aperture lens 20 on both sides and with one of the two beam deflection arrangements 30 being attached to the at least one image sensor 40.
- Multiple pixels of at least one image sensor 40 are preferably assigned to each lens 2 of the multi-aperture lens 20 .
- the lenses 2 shown in FIGS. 1 to 4 are each connected to an image sensor 40 so that an optical channel 22 of a lens 24 leads to a number of pixels of the image sensor 40 .
- the lenses 2 of the multi-lens arrangement 20 are preferably arranged next to one another.
- the beam deflection elements 4 are preferably arranged next to one another, as shown in Figs. 2 to 4 is shown.
- both the beam deflection element arrangement 30 and the lens arrangement each extend one above the other or one behind the other along the z-direction.
- the beam deflection element arrangement 30 and the lens arrangement each extend parallel to an x-y plane.
- the camera system 100 preferably has a plurality of, in particular two, four, six, nine or fifteen, optical channels 22 .
- the number of lenses 2 gives the Number of optical channels 22 before.
- four optical channels 22 can be seen in FIG.
- the optical channels are preferably arranged in matrix form. In Fig. 4, four channels are arranged in a 1 ⁇ 4 matrix structure. Accordingly, the lenses 2 and the sensors 40 are arranged in a matrix structure.
- the implementation can be done using a digital storage medium, for example a floppy disk, a DVD, a BluRay disk, a CD, a ROM, a PROM, an EPROM, an EEPROM or a FLASH memory, a hard disk or other magnetic or optical memory, on which electronically readable control signals are stored, which can interact with a programmable computer system in such a way that the respective method is carried out. Therefore, the digital storage medium executable for the proposed teaching can be computer-readable.
- a digital storage medium for example a floppy disk, a DVD, a BluRay disk, a CD, a ROM, a PROM, an EPROM, an EEPROM or a FLASH memory, a hard disk or other magnetic or optical memory, on which electronically readable control signals are stored, which can interact with a programmable computer system in such a way that the respective method is carried out. Therefore, the digital storage medium executable for the proposed teaching can be computer-readable.
- Some exemplary embodiments according to the teaching described herein thus comprise a data carrier which has electronically readable control signals which are capable of interacting with a programmable computer system in such a way that one of the features described herein is carried out as a method.
- exemplary embodiments of the teaching described herein can be implemented as a computer program product with a program code, with the program code being effective to carry out one of the methods when the computer program product runs on a computer.
- the program code can also be stored on a machine-readable carrier, for example.
- an exemplary embodiment of the method according to the invention is therefore a computer program that has a program code for performing one of the methods described herein when the computer program runs on a computer.
- Another embodiment of a proposed method is thus a data carrier (or a digital storage medium or a computer-readable medium) on which the computer program for performing one of the features described herein as procedure is recorded.
- the data carrier or digital storage medium or computer-readable medium is typically tangible and/or non-transitory.
- a further exemplary embodiment of the proposed method is therefore a data stream or a sequence of signals which represents the computer program for carrying out one of the methods described herein.
- the data stream or the sequence of signals can be configured, for example, to be transferred via a data communication connection, for example via the Internet.
- Another embodiment includes a processing device, such as a computer or programmable logic device, configured or adapted to perform a method of the system described herein.
- a processing device such as a computer or programmable logic device, configured or adapted to perform a method of the system described herein.
- a further exemplary embodiment includes a computer on which the computer program for carrying out the method for the system described herein is installed.
- a further embodiment according to the invention comprises an apparatus or a system which is designed to transmit to a recipient a computer program for carrying out at least one of the features described herein in the form of a method.
- the transmission can take place electronically or optically, for example.
- the recipient may be a computer, mobile device, storage device, or similar device.
- the device or the system can, for example, comprise a file server for the transmission of the computer program to the recipient.
- a programmable logic device eg, a field programmable gate array, an FPGA
- a field programmable gate array may cooperate with a microprocessor to perform the method described herein.
- the method is performed by any hardware device. This can be a universal be deployable hardware such as a computer processor (CPU) or hardware specific to the method such as an ASIC.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Human Computer Interaction (AREA)
- Studio Devices (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE102021202719.9A DE102021202719A1 (de) | 2021-03-19 | 2021-03-19 | Kamerasystem zum erzeugen einer lückenlosen optischen abbildung |
| PCT/EP2022/057223 WO2022195099A1 (de) | 2021-03-19 | 2022-03-18 | Kamerasystem zum erzeugen einer lückenlosen optischen abbildung |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP4309357A1 true EP4309357A1 (de) | 2024-01-24 |
Family
ID=80979127
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP22713680.1A Pending EP4309357A1 (de) | 2021-03-19 | 2022-03-18 | Kamerasystem zum erzeugen einer lückenlosen optischen abbildung |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US12578560B2 (de) |
| EP (1) | EP4309357A1 (de) |
| CN (1) | CN117356099A (de) |
| DE (1) | DE102021202719A1 (de) |
| WO (1) | WO2022195099A1 (de) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN121713096A (zh) * | 2023-04-19 | 2026-03-20 | 尼尔技术有限责任公司 | 用于视野分割的成像设备 |
| GB2632852A (en) | 2023-08-24 | 2025-02-26 | Ibm | Camera module |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170129402A1 (en) * | 2015-11-05 | 2017-05-11 | Delphi Technologies, Inc. | Camera With Light-Guide Array For Automated Vehicles |
| TWI573457B (zh) * | 2015-11-30 | 2017-03-01 | 財團法人工業技術研究院 | 相機陣列裝置 |
| DE102016200287A1 (de) | 2016-01-13 | 2017-07-13 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Multiaperturabbildungsvorrichtungen, Verfahren zum Herstellen derselben und Abbildungssystem |
| DE102016208210A1 (de) | 2016-05-12 | 2017-11-16 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | 3d-multiaperturabbildungsvorrichtungen, multiaperturabbildungsvorrichtung, verfahren zum bereitstellen eines ausgangssignals einer 3d-multiaperturabbildungsvorrichtung und verfahren zum erfassen eines gesamtgesichtsfeldes |
| DE102017208709B3 (de) | 2017-05-23 | 2018-10-25 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Multiaperturabbildungsvorrrichtung und Verfahren zum Bereitstellen einer Multiaperturabbildungsvorrichtung |
-
2021
- 2021-03-19 DE DE102021202719.9A patent/DE102021202719A1/de active Pending
-
2022
- 2022-03-18 CN CN202280036168.0A patent/CN117356099A/zh active Pending
- 2022-03-18 WO PCT/EP2022/057223 patent/WO2022195099A1/de not_active Ceased
- 2022-03-18 EP EP22713680.1A patent/EP4309357A1/de active Pending
-
2023
- 2023-09-18 US US18/469,308 patent/US12578560B2/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022195099A1 (de) | 2022-09-22 |
| DE102021202719A1 (de) | 2022-09-22 |
| CN117356099A (zh) | 2024-01-05 |
| US20240004170A1 (en) | 2024-01-04 |
| US12578560B2 (en) | 2026-03-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| DE102012109569B4 (de) | Head-Up-Display-Vorrichtung | |
| EP3338441B1 (de) | Multiaperturabbildungsvorrichtung mit einer reflektierende facetten aufweisenden strahlumlenkvorrichtung | |
| EP3338133B1 (de) | Vorrichtung mit einer multikanalabbildungsvorrichtung und verfahren zum herstellen derselben | |
| DE102012005152B4 (de) | Bildaufnahmevorrichtung und bildaufnahmeoptik | |
| EP3225021B1 (de) | Multiaperturabbildungsvorrichtung, abbildungssystem und verfahren zum bereitstellen einer multiaperturabbildungsvorrichtung | |
| EP3632094B1 (de) | Multiaperturabbildungsvorrichtung, abbildungssystem und verfahren zum bereitstellen einer multiaperturabbildungsvorrichtung | |
| DE102017010683B4 (de) | Verfahren zur automatischen Wiederherstellung eines eingemessenen Zustands eines Projektionssystems | |
| DE102015215833A1 (de) | Multiaperturabbildungsvorrichtung mit Optiksubstrat | |
| DE102015215845A1 (de) | Multiaperturabbildungsvorrichtung mit kanalindividueller Einstellbarkeit | |
| EP2011331B1 (de) | Bilderfassungssystem zur rundumsicht | |
| DE112004002767T5 (de) | Reflexionssperre für Panoramadisplay | |
| WO2022195099A1 (de) | Kamerasystem zum erzeugen einer lückenlosen optischen abbildung | |
| DE102015014143A1 (de) | Laserstrahlung ablenkende und fokussierende optische Einrichtung zur Lasermaterialbearbeitung | |
| EP3682626B1 (de) | Multiaperturabbildungsvorrichtung mit geringer bauhöhe und umschaltbarer blickrichtung, abbildungssystem und verfahren zum bereitstellen einer multiaperturabbildungsvorrichtung | |
| EP4379445A2 (de) | Bestimmung von tiefenwerten eines oberflächenbereichs eines werkstücks | |
| WO2018072993A1 (de) | Optisches element für ein lidar-system | |
| DE102006055758A1 (de) | Verfahren zur Kalibrierung von Kameras und Projektoren | |
| EP3948389B1 (de) | Vorrichtung mit einer multiaperturabbildungsvorrichtung zur erzeugung einer tiefenkarte | |
| EP2887010A1 (de) | Verfahren und Vorrichtung zum dreidimensionalen optischen Vermessen von Objekten mit einem topometrischen Messverfahren sowie Computerprogramm hierzu | |
| WO2020127262A1 (de) | Vorrichtung mit einer multiaperturabbildungsvorrichtung zur erzeugung einer tiefenkarte | |
| DE112017002459T5 (de) | Bildlesevorrichtung | |
| DE102020116468B4 (de) | Stereokamera | |
| DE102009008747A1 (de) | Optisches Abbildungssystem | |
| WO2020127748A1 (de) | Vorrichtung mit einer multiaperturabbildungsvorrichtung zum akkumulieren von bildinformation | |
| DE102021202716B4 (de) | Multiapertur-Projektor |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20230914 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
| 17Q | First examination report despatched |
Effective date: 20250723 |