US20230073944A1 - Imaging apparatus and distance measuring apparatus using the same - Google Patents

Imaging apparatus and distance measuring apparatus using the same Download PDF

Info

Publication number
US20230073944A1
US20230073944A1 US17/989,368 US202217989368A US2023073944A1 US 20230073944 A1 US20230073944 A1 US 20230073944A1 US 202217989368 A US202217989368 A US 202217989368A US 2023073944 A1 US2023073944 A1 US 2023073944A1
Authority
US
United States
Prior art keywords
lens
lens optical
optical systems
imaging apparatus
target object
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
US17/989,368
Inventor
Norihiro Imamura
Tsuguhiro Korenaga
Kunio Nobori
Takeo Azuma
Kazufumi Mizusawa
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Intellectual Property Management Co Ltd
Original Assignee
Panasonic Intellectual Property Management Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Intellectual Property Management Co Ltd filed Critical Panasonic Intellectual Property Management Co Ltd
Priority to US17/989,368 priority Critical patent/US20230073944A1/en
Publication of US20230073944A1 publication Critical patent/US20230073944A1/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B13/00Optical objectives specially designed for the purposes specified below
    • G02B13/001Miniaturised objectives for electronic devices, e.g. portable telephones, webcams, PDAs, small digital cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • H04N7/181Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0006Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means to keep optical surfaces clean, e.g. by preventing or removing dirt, stains, contamination, condensation
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B35/00Stereoscopic photography
    • G03B35/08Stereoscopic photography by simultaneous recording
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/50Depth or shape recovery
    • G06T7/55Depth or shape recovery from multiple images
    • G06T7/593Depth or shape recovery from multiple images from stereo images
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/50Constructional details
    • H04N23/55Optical parts specially adapted for electronic image sensors; Mounting thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • H04N5/2254
    • H04N5/247
    • GPHYSICS
    • G03PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03BAPPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
    • G03B17/00Details of cameras or camera bodies; Accessories therefor
    • G03B17/02Bodies
    • G03B17/08Waterproof bodies or housings
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30248Vehicle exterior or interior
    • G06T2207/30252Vehicle exterior; Vicinity of vehicle

Definitions

  • the present disclosure relates to an imaging apparatus having multiple imaging optical systems and a distance measuring apparatus that measures the distance to a target object based on parallax in images captured by multiple imaging optical systems.
  • Polynocular distance measuring apparatuses are known that capture images of a target object for measurement with an imaging apparatus having multiple imaging optical systems and measure the distance to the target object by making use of the parallax between the captured images. Such polynocular distance measuring apparatuses are utilized in driving assist systems for automobiles, three-dimensional shape measuring systems, and the like.
  • an ultrawide-angle monocular imaging apparatus In applications for monitoring the rear view and the surroundings of an automobile, in contrast, an ultrawide-angle monocular imaging apparatus is used for the purpose of aiding in visibility.
  • Japanese Unexamined Patent Application Publication No. 2013-109268 discloses an example of such an ultrawide-angle monocular imaging apparatus.
  • a sufficient distance measuring performance may not be obtained due to adhesion of water droplets between lenses.
  • One non-limiting and exemplary embodiment provides an imaging apparatus that makes it difficult for any adhering water droplet, such as a raindrop, to stand between lenses.
  • the techniques disclosed here feature an imaging apparatus for capturing an image of a target object, including: lens optical systems each including a lens whose surface closest to the target object is shaped to be convex toward the target object; imaging regions which respectively face the lens optical systems and output a photoelectrically converted signal corresponding to an amount of light transmitting the lens optical systems and received by the imaging regions; and a light-transmissive cover which covers an exposed portion of the lens of each of the lens optical systems and a portion between the lens of one of the lens optical systems and the lens of another one of the lens optical systems adjacent to the one of the lens optical systems, the cover having a curved portion which is convex toward the target object, in which optical axes of the lens optical systems are parallel to each other.
  • the imaging apparatus makes it difficult for an adhering water droplet such as a raindrop to stand on its surface and reduces the possibility of temporary reduction in image capturing performance.
  • FIG. 1 A is a schematic illustration of an imaging apparatus according to Embodiment 1 of the present disclosure
  • FIG. 1 B is a front view of the imaging apparatus of FIG. 1 A seen from the object side;
  • FIG. 1 C is a schematic illustration of a distance measuring apparatus in Embodiment 1;
  • FIG. 2 A is a front view of the imaging optical systems in the imaging apparatus seen from the object side in a modification of Embodiment 1;
  • FIG. 2 B is a front view of the imaging optical systems in the imaging apparatus seen from the object side in another modification of Embodiment 1;
  • FIG. 3 illustrates an example of a vehicle on which the imaging apparatus in Embodiment 1 is installed
  • FIG. 4 is a schematic illustration of the imaging apparatus in Embodiment 2 of the present disclosure.
  • FIG. 5 A is a schematic illustration showing an example of the imaging apparatus in Embodiment 3 of the present disclosure.
  • FIG. 5 B is a schematic illustration showing another example of the imaging apparatus in Embodiment 3 of the present disclosure.
  • FIG. 6 is a schematic illustration of an imaging apparatus as a comparative example
  • FIG. 7 A is a schematic illustration showing an example of the imaging apparatus in another embodiment of the present disclosure.
  • FIG. 7 B is a schematic illustration showing an example of the imaging apparatus in still another embodiment of the present disclosure.
  • FIG. 8 is a schematic illustration showing an example of the imaging apparatus in yet another embodiment of the present disclosure.
  • a polynocular distance measuring apparatus for monitoring the rear view or surroundings of a vehicle with combination of the aforementioned techniques
  • an arrangement in which multiple ultrawide-angle monocular imaging apparatuses are arrayed close to each other may be conceivable because the distance to the target object is assumed to be several meters or less.
  • the surface of the topmost lens of an ultrawide-angle taking lens is shaped to be convex on the object side.
  • a water droplet tends to stand between the topmost lens of one monocular imaging apparatus and the topmost lens of the adjacent monocular imaging apparatus.
  • a water droplet standing between adjacent lenses in a polynocular distance measuring apparatus can lead to an insufficient distance measurement performance.
  • an imaging apparatus for capturing an image of a target object includes: lens optical systems each including a lens whose surface closest to the target object is shaped to be convex toward the target object; imaging regions which respectively face the lens optical systems and output a photoelectrically converted signal corresponding to an amount of light transmitting the lens optical systems and received by the imaging regions; and a light- transmissive cover which covers an exposed portion of the lens of each of the lens optical systems and a portion between the lens of one of the lens optical systems and the lens of another one of the lens optical systems adjacent to the one of the lens optical systems, the cover having a curved portion which is convex toward the target object, in which optical axes of the lens optical systems are parallel to each other.
  • the dome shape of the cover makes it difficult for any water droplet adhering to the cover to stand there.
  • the lens of each of the lens optical systems may be a concave meniscus lens.
  • the cover may cover an entire exposed portion of the lens optical systems on the target object side.
  • the cover may be made of glass.
  • the lens of each of the lens optical systems may be made of resin.
  • each of the lens optical systems may have an angle of view of 120° or more in at least one direction.
  • the cover may be water repellent.
  • f 0 represents a focal length of the cover and fx represents the focal length of each of the lens optical systems.
  • each of the lens optical systems may include n (n being an integer greater than 0) single lenses including the lens, and a k-th (k is an integer greater than 0 and equal to or less than n) single lens from a target-object-side end of each of the lens optical systems may be integrally formed with a k-th single lens from a target-object-side end of another lens optical system.
  • the single lenses included in each of the lens optical systems may have the same shapes.
  • the single lenses included in each of the lens optical systems may have different shapes.
  • the k-th single lens from the target-object-side end of each of the lens optical systems may be fused with the k-th single lens from the target-object-side end of another lens optical system.
  • the k-th single lens from the target-object-side end of each of the lens optical systems may be fixedly attached to the k-th single lens from the target-object-side end of another lens optical system.
  • all single lenses included in each of the lens optical systems may be integrally formed with the single lenses of another lens optical system that are located at corresponding positions.
  • the imaging regions may be provided in a single image sensor.
  • the imaging regions may be respectively provided in a plurality of image sensors.
  • the imaging apparatus may further include body tubes each housing the lens of each of the lens optical systems, in which a minimum distance between adjacent body tubes may be 15 mm or less.
  • an angle between the optical axis of each of the lens optical systems and a normal to a tangent line at an end of an effective diameter of the cover across which light from the target object passes through may be 75 degrees or less.
  • the lens optical systems may be arranged in one direction, and a cross section of the cover that is perpendicular to the one direction may have an arch shape.
  • the cover may have a dome shape.
  • a distance measuring apparatus includes the imaging apparatus described in any of the above embodiments and a computation circuit, in which in operation, the computation circuit measures a distance to a target object based on a parallax of the target object in images obtained in imaging regions of the imaging apparatus.
  • the computation circuit may measure the distance to the target object by using a baseline length between two lens optical systems, a focal length of each of the lens optical systems and the parallax of the target object in two images obtained in the two imaging regions of the imaging apparatus.
  • the distance measuring apparatus may further include an output device that outputs information corresponding to the distance measured by the computation circuit.
  • FIG. 1 A is a schematic illustration of an imaging apparatus A according to Embodiment 1
  • FIG. 1 B is a front view of the imaging apparatus A seen from the object (target object) side.
  • the imaging apparatus A includes a first lens optical system La, a second lens optical system Lb, a first image sensor Na, and a second image sensor Nb.
  • the first lens optical system La and the second lens optical system Lb are both ultrawide-angle lens optical systems with a horizontal angle of view of 120° or more.
  • a lens optical system that has an angle of view of 120° or more in at least one selected from the group of the horizontal, vertical, and diagonal directions is referred to as an “ultrawide-angle” lens optical system.
  • the imaging apparatus A also includes a casing B that houses and maintains the aforementioned components, and a circuit board P.
  • a light-transmissive, dome-shaped cover L 0 is disposed that covers the entire exposed portion of a first lens L 1 positioned on the top of each of the first lens optical system La and the second lens optical system Lb.
  • the cover L 0 has a curved portion which is convex on the target object side (the upper side in FIG. 1 A ).
  • the term “dome-shaped” widely means a shape that has a curved portion, such as a part of a sphere or an ellipsoid, for example.
  • the shape of the cover L 0 is illustrated as a part of a sphere, though this is not a limitation.
  • the first lens optical system La and the second lens optical system Lb have the identical structure and light gathering characteristics.
  • the lens optical systems La, Lb each include the first lens L 1 , a stop S, and a second lens L 2 , which are held by a lens holder H.
  • the topmost first lens L 1 is a concave meniscus lens that is convex on the object side as shown in FIG. 1 A .
  • each lens optical system is illustrated as being formed of two lenses herein, lens optical systems formed of three or more lenses may be used.
  • the first image sensor Na has an imaging region la and the second image sensor Nb has an imaging region lb.
  • the imaging region la is disposed so as to face the bottom surface of the first lens optical system La (the exposed surface of the lowermost lens in FIG. 1 A ), while the imaging region lb is disposed so as to face the bottom surface of the second lens optical system Lb.
  • the imaging regions la and lb have a structure in which multiple light detection cells (pixels) composed of photodiode or the like are two-dimensionally and periodically arrayed. Each pixel outputs a photoelectrically converted signal corresponding to the amount of received light through photoelectric conversion.
  • the photoelectrically converted signals are sent to a signal processing circuit (not shown) connected to the circuit board P in which they undergo various kinds of signal processing and multiple images are generated.
  • FIGS. 1 A and 1 B also illustrate a water droplet W adhering to the cover L 0 .
  • this embodiment can prevent the water droplet W from standing between the topmost lenses of the two lens optical systems La, Lb.
  • FIG. 6 schematically illustrates an imaging apparatus A′ without a dome-shaped cover attached to it.
  • the reference characters given to the components in FIG. 6 are the same as in FIG. 1 A .
  • the imaging apparatus A′ When the imaging apparatus A′ is used for monitoring the rear view or the surroundings of an automobile, it is typically installed outside the vehicle interior, so water droplets can adhere to it when it rains and during a car wash. Since the first lens optical system La and the second lens optical system Lb form a recessed portion between them due to the structure of the imaging apparatus A′ as illustrated in FIG. 6 , an adhering water droplet W is likely to stand there. Adhesion of water droplet W in this portion can cause an unwanted object such as the water droplet or dust to show up in an image.
  • FIG. 1 C generally illustrates the structure of the distance measuring apparatus.
  • the distance measuring apparatus includes the imaging apparatus A described above and a computation circuit C that measures the distance to the target object based on the parallax of the target object in multiple images output from the imaging apparatus A.
  • the computation circuit C may be implemented as an electronic circuit such as a digital signal processor (DSP) or a combination of a computation unit such as a central processing unit (CPU) and a memory storing a program.
  • DSP digital signal processor
  • CPU central processing unit
  • Light from the target object for distance measurement passes through the cover L 0 and then forms an image in the imaging region la of the first image sensor Na and the imaging region lb of the second image sensor Nb via the first lens optical system La and the second lens optical system Lb.
  • the first image sensor Na and the second image sensor Nb generate and output a first image signal and a second image signal respectively.
  • the computation circuit C applies calibrating correction such as coordinate and distortion corrections to the first and second image signals, thereby converting the first and second image signals into images adapted for parallax calculation based on pattern matching. Then, pattern matching is conducted between the two images.
  • an evaluation function is calculated while moving a minute region of the same size in the second image by one pixel at a time in the baseline direction (the horizontal direction in FIG. 1 C ) and the position with the highest correlation is found, thereby extracting the parallax between the first image and the second image in the minute regions.
  • SAD sum of absolute difference
  • SSD sum of squared difference
  • the computation circuit C uses a baseline length between the first lens optical system La and the second lens optical system Lb, a focal length of each of the first lens optical system La and the second lens optical system Lb and the extracted parallax to calculate the real-world distance to the object captured in the minute region based on the principle of triangulation. By conducting the parallax extraction in the minute region over the entire image, a distance map for the entire image can be generated.
  • the presence of the cover L 0 which has a dome shape reduces the possibility of an unwanted object such as a water droplet or dust showing up in a captured image, situations in which accurate distance measurement cannot be performed can be reduced.
  • a structure with four lens optical systems La, Lb, Lc, Ld arrayed as shown in FIG. 2 A or a structure with nine lens optical systems arrayed as shown in FIG. 2 B may be adopted.
  • pattern matching can be performed in two orthogonal baseline directions (the horizontal and vertical directions in FIGS. 2 A and 2 B ). Therefore, if the image has no light-dark contrast in one of the baseline directions, distance measurement is still possible if there is light-dark contrast in the other baseline direction.
  • lens optical systems Lb, Lc, Ld With a structure having lens optical systems arranged two-dimensionally, distance measurement can be performed with the field of view shared among the multiple lens optical systems, so measurement over the entire view field of the angle of view provided by each lens optical system is possible. For instance, focusing on the pair of lens optical systems La and Lb in FIG. 2 A , lens optical systems Lb, Lc, Ld would show up in an image captured in the imaging region which faces the lens optical system La, while lens optical systems La, Lc, Ld would show up in an image captured in the imaging region which faces the lens optical system Lb. However, measurement for the image portions in which lenses show up can be compensated with other lens pairs.
  • pairs of lens optical system Lb and Ld, Lc and Ld, and La and Lc can cover the portion for which measurement cannot be carried out with the lens optical systems La and Lb. That is, lens optical system pairs can mutually complement for a portion in which measurement cannot be performed.
  • Such an arrangement enables accurate distance measurement over a wide range. For example, when each lens optical system has an angle of view of 180°, distance measurement over the field of view area of a hemisphere is possible.
  • the cover L 0 can be designed to have extremely small lens effect.
  • “extremely small lens effect” means that
  • the focal length f 0 of the cover L 0 may be designed to be 50 fx or less.
  • the cover L 0 may be made of glass.
  • the imaging apparatus or the distance measuring apparatus according to this embodiment is installed on a vehicle, such as an automobile, for monitoring the rear view or the surroundings, it is usually installed outside the vehicle interior.
  • FIG. 3 illustrates a case in which the imaging apparatus A according to this embodiment is installed on vehicle V such as an automobile.
  • a cover L 0 made of resin would be sensitive to scratch during a car wash and the like.
  • a cover L 0 made of glass is more resistant to scratch during a car wash and the like.
  • the vehicle V may further include a computation circuit that, in operation, measures the distance to the target object based on the parallax of the target object in multiple images obtained in multiple imaging regions of the imaging apparatus A, and an output device that outputs information corresponding to the distance to the target object measured by the computation circuit.
  • a computation circuit that, in operation, measures the distance to the target object based on the parallax of the target object in multiple images obtained in multiple imaging regions of the imaging apparatus A
  • an output device that outputs information corresponding to the distance to the target object measured by the computation circuit.
  • Such an arrangement allows the driver of the vehicle V to know the distance to the target object.
  • the target object may include a pedestrian or an obstacle, for example.
  • Information output by the output device may include sound and image, for example. More specifically, the output device may issue a warning tone when a pedestrian or an obstacle is present within a certain distance from the vehicle V, for example.
  • the topmost lenses of the first lens optical system La and the second lens optical system Lb may be made of resin.
  • the topmost lens is typically composed of glass for protection against scratches.
  • fabricating the cover L 0 with glass permits the topmost lenses of the first lens optical system La and the second lens optical system Lb to be formed of resin.
  • glass lenses are generally more expensive than resin lenses, adopting resin lenses for the topmost lenses of the first lens optical system La and the second lens optical system Lb can keep the costs of the imaging apparatus A low.
  • Embodiment 2 differs from Embodiment 1 in that two imaging regions la and lb are provided in a single image sensor. Detailed description of matters similar to Embodiment 1 is omitted and the difference will be mainly discussed.
  • FIG. 4 is a schematic illustration of the imaging apparatus A in Embodiment 2. While Embodiment 1 provides image sensors Na and Nb respectively corresponding to the two lens optical systems La and Lb, Embodiment 2 provides a single image sensor N having two imaging regions la and lb.
  • FIG. 4 depicts the two imaging regions la and lb in the image sensor N as separate regions, an additional imaging region with multiple pixels may be provided between them. Since that portion is not used for image capturing, however, pixels may be provided only in the imaging region la and lb portions shown in FIG. 4 .
  • Embodiment 3 differs from Embodiments 1 and 2 in that at least one lens included in each of lens optical systems is formed integrally with a corresponding lens of another lens optical system.
  • each of multiple lens optical systems is composed of a combination of n (n being an integer greater than 0) single lenses including the topmost first lens L 1
  • the k-th (k is an integer greater than 0 and equal to or less than n) single lens from the target object side of each lens optical system is integrally formed with the k-th single lens from the target object side of another lens optical system.
  • FIG. 5 A schematically illustrates an example of the imaging apparatus A having such a structure.
  • the second lens from the target object side of the first lens optical system La and the second lens from the target object side of the second lens optical system Lb are integrally formed into a compound-eye lens L 2 c .
  • the compound-eye lens L 2 c is fabricated as a single article with a mold.
  • the compound-eye lens L 2 c is also configured to be placed on a lens holding portion Bc provided in the casing B.
  • the interval between the object surface side (the upper side in FIG. 5 A ) of the lens holding portion Bc and each imaging region represents the flange focal length of each lens optical system.
  • a cylindrical guide J is formed about the optical axis of each lens optical system, so that components can be positioned by inserting the stop S and the first lens L 1 of each lens optical system along the guide J.
  • Embodiment 1 While in Embodiment 1 the individual single lenses constituting each lens optical system are separate lenses, integral formation of the second lenses of the lens optical systems as in Embodiment 3 can keep the costs of the imaging apparatus A low.
  • the first lenses of the lens optical systems may also be integrally formed into a compound-eye lens L 1 c as illustrated in FIG. 5 B .
  • Such a structure could further reduce the costs of the imaging apparatus A.
  • each lens optical system is formed from a combination of three or more single lenses
  • at least one pair of single lenses may be integrally formed.
  • multiple single lenses located at the same position counted from the target object side may be integrally formed.
  • FIG. 7 A is a schematic illustration of an example of an imaging apparatus according to another embodiment of the present disclosure.
  • the minimum distance G between the body tube Ha of the first lens optical system La and the body tube Hb of the second lens optical system Lb is set to 15 mm or less.
  • the minimum distance G is 15 mm or less, raindrops are likely to stand between the body tube Ha and the body tube Hb, so attachment of the cover L 0 is particularly effective.
  • FIG. 7 B is a schematic illustration of an example of an imaging apparatus according to still another embodiment of the present disclosure.
  • the imaging apparatus is installed on a vehicle Z such that the optical axis V of the lens optical system is parallel to the ground G.
  • the angle M between the optical axis V of the lens optical system and the normal J to the tangent line at an end of the effective diameter ⁇ E across which a light beam passes through the cover L 0 is set to 75 degrees or less.
  • FIG. 8 is a schematic illustration of an example of an imaging apparatus according to yet another embodiment of the present disclosure.
  • two lens optical systems La, Lb are arranged in one direction as illustrated in FIG. 8 , the cross section of the cover L 0 ′ having an arch shape which is uniform in the direction in which the two lens optical system are arranged.
  • each lens optical system including the cover becomes an eccentric optical system. Consequently, various aberrations would vary between the lens optical systems, possibly causing a reduction in distance measurement accuracy.
  • each lens optical system is not an eccentric optical system, so that difference in various aberrations between the lens optical systems can be lessened compared to when a spherical or ellipsoid cover is used. As a result, a reduction in distance measurement accuracy can be suppressed.
  • each lens optical system the topmost lens (the surface closest to the target object) of each lens optical system as being a concave meniscus lens
  • a lens other than a concave meniscus lens may be used if each lens optical system is not ultrawide-angle.
  • the cover L 0 does not necessarily have to cover the entire exposed portion of the lens optical systems because it can prevent a water droplet from standing in rainy conditions to a certain degree as long as it covers the exposed portion of the topmost lenses of the lens optical systems and the portion between the lenses.
  • the imaging apparatus and distance measuring apparatus according to the present disclosure are applicable to on-vehicle camera systems, for example. In addition to on-vehicle applications, they may be applied also to image capture systems such as endoscope cameras, for example.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Optics & Photonics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Theoretical Computer Science (AREA)
  • Measurement Of Optical Distance (AREA)
  • Studio Devices (AREA)
  • Lenses (AREA)
  • Accessories Of Cameras (AREA)
  • Camera Bodies And Camera Details Or Accessories (AREA)
  • Structure And Mechanism Of Cameras (AREA)

Abstract

An imaging apparatus in an embodiment includes lens optical systems each including a lens whose surface closest to the target object is shaped to be convex toward the target object, imaging regions which respectively face the lens optical systems and output a photoelectrically converted signal corresponding to an amount of light transmitting the lens optical systems and received by the imaging regions, and a light-transmissive cover which covers an exposed portion of the lens of each of the lens optical systems and a portion between the lens of one of the lens optical systems and the lens of another one of the lens optical systems adjacent to the one of the lens optical systems, the cover having a curved portion which is convex toward the target object. The optical axes of the lens optical systems are parallel to each other.

Description

    RELATED APPLICATIONS
  • This application a Continuation Application of U.S. patent application Ser. No. 17/228,525, filed on Apr. 12, 2021, which is a Continuation Application of U.S. patent application Ser. No. 16/932,270, filed on Jul. 17, 2020, now U.S. Pat. No, 11,006,081, which is a Continuation Application of U.S. patent application Ser. No. 15/843,845, filed Dec. 15, 2017, now U.S. Pat. No. 10,757,370, which is a Continuation Application of U.S. application Ser. No. 14/693,913, filed on Apr. 23, 2015, now U.S. Pat. No. 9,876,992, which claims the benefit of Japanese Application No. 2014-093616, filed on Apr. 30, 2014, the entire disclosures of which Applications are incorporated by reference herein.
  • BACKGROUND 2. Technical Field
  • The present disclosure relates to an imaging apparatus having multiple imaging optical systems and a distance measuring apparatus that measures the distance to a target object based on parallax in images captured by multiple imaging optical systems.
  • 3. Description of the Related Art
  • Polynocular distance measuring apparatuses are known that capture images of a target object for measurement with an imaging apparatus having multiple imaging optical systems and measure the distance to the target object by making use of the parallax between the captured images. Such polynocular distance measuring apparatuses are utilized in driving assist systems for automobiles, three-dimensional shape measuring systems, and the like.
  • In a polynocular distance measuring apparatus for monitoring the front view of an automobile, multiple monocular imaging apparatuses are usually installed on the inner side of the windshield such that their optical axes are parallel to each other. Japanese Unexamined Patent Application Publication No. 2013-112314 discloses an example of a polynocular distance measuring apparatus of this type.
  • In applications for monitoring the rear view and the surroundings of an automobile, in contrast, an ultrawide-angle monocular imaging apparatus is used for the purpose of aiding in visibility. Japanese Unexamined Patent Application Publication No. 2013-109268 discloses an example of such an ultrawide-angle monocular imaging apparatus.
  • SUMMARY
  • In a situation where a polynocular distance measuring apparatus is used when it rains, for example, a sufficient distance measuring performance may not be obtained due to adhesion of water droplets between lenses.
  • One non-limiting and exemplary embodiment provides an imaging apparatus that makes it difficult for any adhering water droplet, such as a raindrop, to stand between lenses.
  • In one general aspect, the techniques disclosed here feature an imaging apparatus for capturing an image of a target object, including: lens optical systems each including a lens whose surface closest to the target object is shaped to be convex toward the target object; imaging regions which respectively face the lens optical systems and output a photoelectrically converted signal corresponding to an amount of light transmitting the lens optical systems and received by the imaging regions; and a light-transmissive cover which covers an exposed portion of the lens of each of the lens optical systems and a portion between the lens of one of the lens optical systems and the lens of another one of the lens optical systems adjacent to the one of the lens optical systems, the cover having a curved portion which is convex toward the target object, in which optical axes of the lens optical systems are parallel to each other.
  • The imaging apparatus according to an aspect of the present disclosure makes it difficult for an adhering water droplet such as a raindrop to stand on its surface and reduces the possibility of temporary reduction in image capturing performance.
  • Additional benefits and advantages of the disclosed embodiments will become apparent from the specification and drawings. The benefits and/or advantages may be individually obtained by the various embodiments and features of the specification and drawings, which need not all be provided in order to obtain one or more of such benefits and/or advantages.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1A is a schematic illustration of an imaging apparatus according to Embodiment 1 of the present disclosure;
  • FIG. 1B is a front view of the imaging apparatus of FIG. 1A seen from the object side;
  • FIG. 1C is a schematic illustration of a distance measuring apparatus in Embodiment 1;
  • FIG. 2A is a front view of the imaging optical systems in the imaging apparatus seen from the object side in a modification of Embodiment 1;
  • FIG. 2B is a front view of the imaging optical systems in the imaging apparatus seen from the object side in another modification of Embodiment 1;
  • FIG. 3 illustrates an example of a vehicle on which the imaging apparatus in Embodiment 1 is installed;
  • FIG. 4 is a schematic illustration of the imaging apparatus in Embodiment 2 of the present disclosure;
  • FIG. 5A is a schematic illustration showing an example of the imaging apparatus in Embodiment 3 of the present disclosure;
  • FIG. 5B is a schematic illustration showing another example of the imaging apparatus in Embodiment 3 of the present disclosure;
  • FIG. 6 is a schematic illustration of an imaging apparatus as a comparative example;
  • FIG. 7A is a schematic illustration showing an example of the imaging apparatus in another embodiment of the present disclosure;
  • FIG. 7B is a schematic illustration showing an example of the imaging apparatus in still another embodiment of the present disclosure; and
  • FIG. 8 is a schematic illustration showing an example of the imaging apparatus in yet another embodiment of the present disclosure.
  • DETAILED DESCRIPTION
  • In implementation of a polynocular distance measuring apparatus for monitoring the rear view or surroundings of a vehicle with combination of the aforementioned techniques, an arrangement in which multiple ultrawide-angle monocular imaging apparatuses are arrayed close to each other may be conceivable because the distance to the target object is assumed to be several meters or less. In general, the surface of the topmost lens of an ultrawide-angle taking lens is shaped to be convex on the object side. Thus, a water droplet tends to stand between the topmost lens of one monocular imaging apparatus and the topmost lens of the adjacent monocular imaging apparatus. A water droplet standing between adjacent lenses in a polynocular distance measuring apparatus can lead to an insufficient distance measurement performance.
  • Embodiments of the present disclosure will be generally described as follows.
  • According to an aspect of the present disclosure, an imaging apparatus for capturing an image of a target object includes: lens optical systems each including a lens whose surface closest to the target object is shaped to be convex toward the target object; imaging regions which respectively face the lens optical systems and output a photoelectrically converted signal corresponding to an amount of light transmitting the lens optical systems and received by the imaging regions; and a light- transmissive cover which covers an exposed portion of the lens of each of the lens optical systems and a portion between the lens of one of the lens optical systems and the lens of another one of the lens optical systems adjacent to the one of the lens optical systems, the cover having a curved portion which is convex toward the target object, in which optical axes of the lens optical systems are parallel to each other. With the imaging apparatus according to this aspect of the present disclosure, the dome shape of the cover makes it difficult for any water droplet adhering to the cover to stand there.
  • In an embodiment, the lens of each of the lens optical systems may be a concave meniscus lens.
  • In an embodiment, the cover may cover an entire exposed portion of the lens optical systems on the target object side.
  • In an embodiment, the cover may be made of glass.
  • In an embodiment, the lens of each of the lens optical systems may be made of resin.
  • In an embodiment, each of the lens optical systems may have an angle of view of 120° or more in at least one direction.
  • In an embodiment, the cover may be water repellent.
  • In an embodiment, |f0|>50 fx may be satisfied, where f0 represents a focal length of the cover and fx represents the focal length of each of the lens optical systems.
  • In an embodiment, each of the lens optical systems may include n (n being an integer greater than 0) single lenses including the lens, and a k-th (k is an integer greater than 0 and equal to or less than n) single lens from a target-object-side end of each of the lens optical systems may be integrally formed with a k-th single lens from a target-object-side end of another lens optical system. The single lenses included in each of the lens optical systems may have the same shapes. The single lenses included in each of the lens optical systems may have different shapes. The k-th single lens from the target-object-side end of each of the lens optical systems may be fused with the k-th single lens from the target-object-side end of another lens optical system. The k-th single lens from the target-object-side end of each of the lens optical systems may be fixedly attached to the k-th single lens from the target-object-side end of another lens optical system.
  • In an embodiment, all single lenses included in each of the lens optical systems may be integrally formed with the single lenses of another lens optical system that are located at corresponding positions.
  • In an embodiment, the imaging regions may be provided in a single image sensor.
  • In an embodiment, the imaging regions may be respectively provided in a plurality of image sensors.
  • In an embodiment, the imaging apparatus may further include body tubes each housing the lens of each of the lens optical systems, in which a minimum distance between adjacent body tubes may be 15 mm or less.
  • In an embodiment, an angle between the optical axis of each of the lens optical systems and a normal to a tangent line at an end of an effective diameter of the cover across which light from the target object passes through may be 75 degrees or less.
  • In an embodiment, the lens optical systems may be arranged in one direction, and a cross section of the cover that is perpendicular to the one direction may have an arch shape. The cover may have a dome shape.
  • According to another aspect of the present disclosure, a distance measuring apparatus includes the imaging apparatus described in any of the above embodiments and a computation circuit, in which in operation, the computation circuit measures a distance to a target object based on a parallax of the target object in images obtained in imaging regions of the imaging apparatus. The computation circuit may measure the distance to the target object by using a baseline length between two lens optical systems, a focal length of each of the lens optical systems and the parallax of the target object in two images obtained in the two imaging regions of the imaging apparatus.
  • In an embodiment, the distance measuring apparatus may further include an output device that outputs information corresponding to the distance measured by the computation circuit.
  • The embodiments will now be described more specifically. In the description that follows, the same or like components are denoted with the same reference characters. In the description that follows, a signal or information representing an image may be referred to just as an “image”.
  • Embodiment 1
  • FIG. 1A is a schematic illustration of an imaging apparatus A according to Embodiment 1, and FIG. 1B is a front view of the imaging apparatus A seen from the object (target object) side. The imaging apparatus A includes a first lens optical system La, a second lens optical system Lb, a first image sensor Na, and a second image sensor Nb. The first lens optical system La and the second lens optical system Lb are both ultrawide-angle lens optical systems with a horizontal angle of view of 120° or more. Herein, a lens optical system that has an angle of view of 120° or more in at least one selected from the group of the horizontal, vertical, and diagonal directions is referred to as an “ultrawide-angle” lens optical system.
  • The imaging apparatus A also includes a casing B that houses and maintains the aforementioned components, and a circuit board P. On the casing B, a light-transmissive, dome-shaped cover L0 is disposed that covers the entire exposed portion of a first lens L1 positioned on the top of each of the first lens optical system La and the second lens optical system Lb. The cover L0 has a curved portion which is convex on the target object side (the upper side in FIG. 1A). As used herein, the term “dome-shaped” widely means a shape that has a curved portion, such as a part of a sphere or an ellipsoid, for example. In this embodiment, the shape of the cover L0 is illustrated as a part of a sphere, though this is not a limitation.
  • The first lens optical system La and the second lens optical system Lb have the identical structure and light gathering characteristics. The lens optical systems La, Lb each include the first lens L1, a stop S, and a second lens L2, which are held by a lens holder H. When the lens optical systems are ultrawide, the topmost first lens L1 is a concave meniscus lens that is convex on the object side as shown in FIG. 1A. Although each lens optical system is illustrated as being formed of two lenses herein, lens optical systems formed of three or more lenses may be used.
  • The first image sensor Na has an imaging region la and the second image sensor Nb has an imaging region lb. The imaging region la is disposed so as to face the bottom surface of the first lens optical system La (the exposed surface of the lowermost lens in FIG. 1A), while the imaging region lb is disposed so as to face the bottom surface of the second lens optical system Lb. The imaging regions la and lb have a structure in which multiple light detection cells (pixels) composed of photodiode or the like are two-dimensionally and periodically arrayed. Each pixel outputs a photoelectrically converted signal corresponding to the amount of received light through photoelectric conversion. The photoelectrically converted signals are sent to a signal processing circuit (not shown) connected to the circuit board P in which they undergo various kinds of signal processing and multiple images are generated.
  • FIGS. 1A and 1B also illustrate a water droplet W adhering to the cover L0. By providing the cover L0, this embodiment can prevent the water droplet W from standing between the topmost lenses of the two lens optical systems La, Lb.
  • Consider now a case where the cover L0 shown in FIG. 1A is not provided. FIG. 6 schematically illustrates an imaging apparatus A′ without a dome-shaped cover attached to it. The reference characters given to the components in FIG. 6 are the same as in FIG. 1A. When the imaging apparatus A′ is used for monitoring the rear view or the surroundings of an automobile, it is typically installed outside the vehicle interior, so water droplets can adhere to it when it rains and during a car wash. Since the first lens optical system La and the second lens optical system Lb form a recessed portion between them due to the structure of the imaging apparatus A′ as illustrated in FIG. 6 , an adhering water droplet W is likely to stand there. Adhesion of water droplet W in this portion can cause an unwanted object such as the water droplet or dust to show up in an image.
  • In contrast, by disposing the light-transmissive dome-shaped cover L0 so as to cover the exposed portion of the first lens L1 positioned on top of each of the first lens optical system La and the second lens optical system Lb as well as the entire portion between the two first lenses L1 as illustrated in FIG. 1A, an adhering water droplet, if any, is less likely to stand on the surface than when the cover L0 is not present. Making the cover L0 water repellent could further reduce the possibility of a water droplet standing. These make it difficult for a water droplet adhering to the imaging apparatus A, if any, to stand there, thus reducing the possibility of an unwanted object such as a water droplet or dust showing up in an image.
  • Next, an arrangement for applying the imaging apparatus described above to a distance measuring apparatus will be described.
  • FIG. 1C generally illustrates the structure of the distance measuring apparatus. The distance measuring apparatus includes the imaging apparatus A described above and a computation circuit C that measures the distance to the target object based on the parallax of the target object in multiple images output from the imaging apparatus A. The computation circuit C may be implemented as an electronic circuit such as a digital signal processor (DSP) or a combination of a computation unit such as a central processing unit (CPU) and a memory storing a program.
  • Light from the target object for distance measurement (not shown) passes through the cover L0 and then forms an image in the imaging region la of the first image sensor Na and the imaging region lb of the second image sensor Nb via the first lens optical system La and the second lens optical system Lb. The first image sensor Na and the second image sensor Nb generate and output a first image signal and a second image signal respectively. The computation circuit C applies calibrating correction such as coordinate and distortion corrections to the first and second image signals, thereby converting the first and second image signals into images adapted for parallax calculation based on pattern matching. Then, pattern matching is conducted between the two images. Specifically, focusing on a minute region of a predetermined number of pixels in the first image, an evaluation function is calculated while moving a minute region of the same size in the second image by one pixel at a time in the baseline direction (the horizontal direction in FIG. 1C) and the position with the highest correlation is found, thereby extracting the parallax between the first image and the second image in the minute regions. For the evaluation function, sum of absolute difference (SAD) or sum of squared difference (SSD) may be used, for example. The computation circuit C uses a baseline length between the first lens optical system La and the second lens optical system Lb, a focal length of each of the first lens optical system La and the second lens optical system Lb and the extracted parallax to calculate the real-world distance to the object captured in the minute region based on the principle of triangulation. By conducting the parallax extraction in the minute region over the entire image, a distance map for the entire image can be generated.
  • Since in this embodiment the presence of the cover L0 which has a dome shape reduces the possibility of an unwanted object such as a water droplet or dust showing up in a captured image, situations in which accurate distance measurement cannot be performed can be reduced.
  • While this embodiment was described in the context of a structure with two lens optical systems, a structure with three or more lens optical systems arranged two-dimensionally is also possible. With two lens optical systems, an accurate distance measurement cannot be obtained when there is no light-dark contrast in a direction parallel to the baseline in an image because only one baseline direction exists. Also, as mentioned above, since the topmost lens of an ultrawide-angle lens is usually a concave meniscus lens that is convex on the object side as shown in FIG. 1A, adjacent lenses will show up in each other's image when the angle of view is wide. Thus, measurement over a wide field of view, for example, an angle of view of 180°, cannot be performed.
  • A structure with four lens optical systems La, Lb, Lc, Ld arrayed as shown in FIG. 2A or a structure with nine lens optical systems arrayed as shown in FIG. 2B may be adopted. In the case of two-dimensional arrangement of lens optical systems as illustrated in FIGS. 2A and 2B, pattern matching can be performed in two orthogonal baseline directions (the horizontal and vertical directions in FIGS. 2A and 2B). Therefore, if the image has no light-dark contrast in one of the baseline directions, distance measurement is still possible if there is light-dark contrast in the other baseline direction.
  • With a structure having lens optical systems arranged two-dimensionally, distance measurement can be performed with the field of view shared among the multiple lens optical systems, so measurement over the entire view field of the angle of view provided by each lens optical system is possible. For instance, focusing on the pair of lens optical systems La and Lb in FIG. 2A, lens optical systems Lb, Lc, Ld would show up in an image captured in the imaging region which faces the lens optical system La, while lens optical systems La, Lc, Ld would show up in an image captured in the imaging region which faces the lens optical system Lb. However, measurement for the image portions in which lenses show up can be compensated with other lens pairs. Specifically, pairs of lens optical system Lb and Ld, Lc and Ld, and La and Lc can cover the portion for which measurement cannot be carried out with the lens optical systems La and Lb. That is, lens optical system pairs can mutually complement for a portion in which measurement cannot be performed.
  • Such an arrangement enables accurate distance measurement over a wide range. For example, when each lens optical system has an angle of view of 180°, distance measurement over the field of view area of a hemisphere is possible.
  • Specific methods for calculating a distance from multiple ultrawide-angle images as described above are disclosed by Japanese Patent Application No. 2013-258380 and a specification of U.S. patent application Ser. No. 14/555643, for instance, the entire contents of which are incorporated herein.
  • The cover L0 in this embodiment will be described in more detail.
  • The cover L0 can be designed to have extremely small lens effect. As used herein, “extremely small lens effect” means that |f0|>50 fx is satisfied, where f0 represents the focal length of the light-transmissive cover L0, and fx represents the focal length of each of lens optical systems La and Lb, for example. Since the optical axis of each lens optical system is eccentric to the center axis of the cover L0, if the cover L0 has lens effect, asymmetry of optical characteristics, such as distortion, between the positive side and the negative side of the angle of view in each lens optical system would be large. Such asymmetry of optical characteristics can lead to reduced accuracy of distance measurement. In contrast, when the cover L0 has extremely small lens effect, optical characteristics such as distortion is more symmetric between the positive side and the negative side of the angle of view, preventing a reduction in distance measurement accuracy. It is noted that depending on the characteristics of lens optical systems, it can be desirable to intentionally impart lens function to the cover L0. In such a case, the focal length f0 of the cover L0 may be designed to be 50 fx or less.
  • The cover L0 may be made of glass. In a case where the imaging apparatus or the distance measuring apparatus according to this embodiment is installed on a vehicle, such as an automobile, for monitoring the rear view or the surroundings, it is usually installed outside the vehicle interior. FIG. 3 illustrates a case in which the imaging apparatus A according to this embodiment is installed on vehicle V such as an automobile. When the imaging apparatus A is installed outside the vehicle interior, a cover L0 made of resin would be sensitive to scratch during a car wash and the like. In contrast, a cover L0 made of glass is more resistant to scratch during a car wash and the like. The vehicle V may further include a computation circuit that, in operation, measures the distance to the target object based on the parallax of the target object in multiple images obtained in multiple imaging regions of the imaging apparatus A, and an output device that outputs information corresponding to the distance to the target object measured by the computation circuit. Such an arrangement allows the driver of the vehicle V to know the distance to the target object. The target object may include a pedestrian or an obstacle, for example. Information output by the output device may include sound and image, for example. More specifically, the output device may issue a warning tone when a pedestrian or an obstacle is present within a certain distance from the vehicle V, for example.
  • When the cover L0 is made of glass, the topmost lenses of the first lens optical system La and the second lens optical system Lb may be made of resin. For a lens optical system for monitoring the rear side or the surroundings of a vehicle, the topmost lens is typically composed of glass for protection against scratches. However, fabricating the cover L0 with glass permits the topmost lenses of the first lens optical system La and the second lens optical system Lb to be formed of resin. As glass lenses are generally more expensive than resin lenses, adopting resin lenses for the topmost lenses of the first lens optical system La and the second lens optical system Lb can keep the costs of the imaging apparatus A low.
  • Embodiment 2
  • Embodiment 2 differs from Embodiment 1 in that two imaging regions la and lb are provided in a single image sensor. Detailed description of matters similar to Embodiment 1 is omitted and the difference will be mainly discussed.
  • FIG. 4 is a schematic illustration of the imaging apparatus A in Embodiment 2. While Embodiment 1 provides image sensors Na and Nb respectively corresponding to the two lens optical systems La and Lb, Embodiment 2 provides a single image sensor N having two imaging regions la and lb.
  • By thus combining the image sensors corresponding to the first lens optical system La and the second lens optical system Lb into a single image sensor, relative inclination of the two imaging surfaces can be decreased compared to when separate image sensors are used. This can suppress reduction in the accuracy of distance measurement compared to the structure of Embodiment 1.
  • Although FIG. 4 depicts the two imaging regions la and lb in the image sensor N as separate regions, an additional imaging region with multiple pixels may be provided between them. Since that portion is not used for image capturing, however, pixels may be provided only in the imaging region la and lb portions shown in FIG. 4 .
  • Embodiment 3
  • Embodiment 3 differs from Embodiments 1 and 2 in that at least one lens included in each of lens optical systems is formed integrally with a corresponding lens of another lens optical system. In other words, assuming that each of multiple lens optical systems is composed of a combination of n (n being an integer greater than 0) single lenses including the topmost first lens L1, in this embodiment, the k-th (k is an integer greater than 0 and equal to or less than n) single lens from the target object side of each lens optical system is integrally formed with the k-th single lens from the target object side of another lens optical system.
  • FIG. 5A schematically illustrates an example of the imaging apparatus A having such a structure. In FIG. 5A, the second lens from the target object side of the first lens optical system La and the second lens from the target object side of the second lens optical system Lb are integrally formed into a compound-eye lens L2 c. The compound-eye lens L2 c is fabricated as a single article with a mold. The compound-eye lens L2 c is also configured to be placed on a lens holding portion Bc provided in the casing B. Thus, the interval between the object surface side (the upper side in FIG. 5A) of the lens holding portion Bc and each imaging region represents the flange focal length of each lens optical system. On the object surface side of the compound-eye lens L2 c, a cylindrical guide J is formed about the optical axis of each lens optical system, so that components can be positioned by inserting the stop S and the first lens L1 of each lens optical system along the guide J.
  • While in Embodiment 1 the individual single lenses constituting each lens optical system are separate lenses, integral formation of the second lenses of the lens optical systems as in Embodiment 3 can keep the costs of the imaging apparatus A low.
  • In addition to the structure with integral formation of the second lenses of the lens optical systems, the first lenses of the lens optical systems may also be integrally formed into a compound-eye lens L1 c as illustrated in FIG. 5B. Such a structure could further reduce the costs of the imaging apparatus A.
  • In a case where each lens optical system is formed from a combination of three or more single lenses, at least one pair of single lenses may be integrally formed. Also, when three or more lens optical systems are used, multiple single lenses located at the same position counted from the target object side may be integrally formed.
  • Other Embodiments
  • FIG. 7A is a schematic illustration of an example of an imaging apparatus according to another embodiment of the present disclosure. In FIG. 7A, the minimum distance G between the body tube Ha of the first lens optical system La and the body tube Hb of the second lens optical system Lb is set to 15 mm or less. When the minimum distance G is 15 mm or less, raindrops are likely to stand between the body tube Ha and the body tube Hb, so attachment of the cover L0 is particularly effective.
  • FIG. 7B is a schematic illustration of an example of an imaging apparatus according to still another embodiment of the present disclosure. In this example, the imaging apparatus is installed on a vehicle Z such that the optical axis V of the lens optical system is parallel to the ground G. In FIG. 7B, the angle M between the optical axis V of the lens optical system and the normal J to the tangent line at an end of the effective diameter ϕE across which a light beam passes through the cover L0 is set to 75 degrees or less. When the imaging apparatus is thus installed on a vehicle and the like with the optical axis V of the lens optical system being parallel to the ground G, setting the angle M to 75 degrees or less makes raindrops adhering to the surface of the cover L0 easy to flow. Consequently, raindrops are less likely to stand on the surface of the cover L0.
  • FIG. 8 is a schematic illustration of an example of an imaging apparatus according to yet another embodiment of the present disclosure. In this example, two lens optical systems La, Lb are arranged in one direction as illustrated in FIG. 8 , the cross section of the cover L0′ having an arch shape which is uniform in the direction in which the two lens optical system are arranged. If a cover shaped in a sphere or an ellipsoid is used in the case of arrangement of two lens optical systems in one direction, each lens optical system including the cover becomes an eccentric optical system. Consequently, various aberrations would vary between the lens optical systems, possibly causing a reduction in distance measurement accuracy. With a structure such as shown in FIG. 8 , in contrast, each lens optical system is not an eccentric optical system, so that difference in various aberrations between the lens optical systems can be lessened compared to when a spherical or ellipsoid cover is used. As a result, a reduction in distance measurement accuracy can be suppressed.
  • While the foregoing embodiments described the topmost lens (the surface closest to the target object) of each lens optical system as being a concave meniscus lens, a lens other than a concave meniscus lens may be used if each lens optical system is not ultrawide-angle. Additionally, the cover L0 does not necessarily have to cover the entire exposed portion of the lens optical systems because it can prevent a water droplet from standing in rainy conditions to a certain degree as long as it covers the exposed portion of the topmost lenses of the lens optical systems and the portion between the lenses.
  • The imaging apparatus and distance measuring apparatus according to the present disclosure are applicable to on-vehicle camera systems, for example. In addition to on-vehicle applications, they may be applied also to image capture systems such as endoscope cameras, for example.

Claims (11)

What is claimed is:
1. An imaging apparatus for capturing an image of a target object, comprising:
lens optical systems each including a lens whose surface closest to the target object is shaped to be convex toward the target object;
light detection cells which respectively face the lens optical systems;
retainers each retaining the lens which is closest to the target object in each of the lens optical systems;
a cover which covers an exposed portion of the lens of each of the lens optical systems, the cover having a curved portion which is convex toward the target object; and
a casing which houses the light detection cells, wherein each of the retainers protrudes from the casing.
2. The imaging apparatus according to claim 1, wherein |f0|>50 fx is satisfied, where f0 represents a focal length of the cover and fx represents the focal length of each of the lens optical systems.
3. The imaging apparatus according to claim 1, wherein optical axes of the lens optical systems are fixed to each other.
4. The imaging apparatus according to claim 1, wherein the lens which is closest to the target object in each of the lens optical systems is a concave meniscus lens.
5. The imaging apparatus according to claim 1, wherein
the lens optical systems are arranged in a direction, and
a cross section of the cover that is perpendicular to the direction has an arch shape.
6. The imaging apparatus according to claim 1, further comprising:
a computation circuit, wherein
in operation, the computation circuit measures a distance to the target object based on a parallax of the target object in images obtained in the light detection cells of the imaging apparatus.
7. The imaging apparatus according to claim 1, wherein the lens optical systems include more than four lens optical systems each of which has a different optical axis.
8. The imaging apparatus according to claim 1, wherein in plan view, a center of the cover does not overlap the surface of the lens which is closest to the target object in each of the lens optical systems.
9. The imaging apparatus according to claim 1, wherein each of the lens optical systems has an angle of view of 120 degrees or more in at least one direction.
10. The imaging apparatus according to claim 1, wherein an angle between an optical axis of each of the lens optical systems and a normal to a tangent line at an end of an effective diameter of the cover across which light from the target object passes through is 75 degrees or less.
11. A monitoring system for a vehicle comprising the imaging apparatus according to claim 1.
US17/989,368 2014-04-30 2022-11-17 Imaging apparatus and distance measuring apparatus using the same Pending US20230073944A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US17/989,368 US20230073944A1 (en) 2014-04-30 2022-11-17 Imaging apparatus and distance measuring apparatus using the same

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
JP2014-093616 2014-04-30
JP2014093616 2014-04-30
US14/693,913 US9876992B2 (en) 2014-04-30 2015-04-23 Imaging apparatus and distance measuring apparatus using the same
US15/843,845 US10757370B2 (en) 2014-04-30 2017-12-15 Imaging apparatus and distance measuring apparatus using the same
US16/932,270 US11006081B2 (en) 2014-04-30 2020-07-17 Imaging apparatus and distance measuring apparatus using the same
US17/228,525 US11533455B2 (en) 2014-04-30 2021-04-12 Imaging apparatus and distance measuring apparatus using the same
US17/989,368 US20230073944A1 (en) 2014-04-30 2022-11-17 Imaging apparatus and distance measuring apparatus using the same

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US17/228,525 Continuation US11533455B2 (en) 2014-04-30 2021-04-12 Imaging apparatus and distance measuring apparatus using the same

Publications (1)

Publication Number Publication Date
US20230073944A1 true US20230073944A1 (en) 2023-03-09

Family

ID=53039748

Family Applications (5)

Application Number Title Priority Date Filing Date
US14/693,913 Active 2035-08-23 US9876992B2 (en) 2014-04-30 2015-04-23 Imaging apparatus and distance measuring apparatus using the same
US15/843,845 Active US10757370B2 (en) 2014-04-30 2017-12-15 Imaging apparatus and distance measuring apparatus using the same
US16/932,270 Active US11006081B2 (en) 2014-04-30 2020-07-17 Imaging apparatus and distance measuring apparatus using the same
US17/228,525 Active US11533455B2 (en) 2014-04-30 2021-04-12 Imaging apparatus and distance measuring apparatus using the same
US17/989,368 Pending US20230073944A1 (en) 2014-04-30 2022-11-17 Imaging apparatus and distance measuring apparatus using the same

Family Applications Before (4)

Application Number Title Priority Date Filing Date
US14/693,913 Active 2035-08-23 US9876992B2 (en) 2014-04-30 2015-04-23 Imaging apparatus and distance measuring apparatus using the same
US15/843,845 Active US10757370B2 (en) 2014-04-30 2017-12-15 Imaging apparatus and distance measuring apparatus using the same
US16/932,270 Active US11006081B2 (en) 2014-04-30 2020-07-17 Imaging apparatus and distance measuring apparatus using the same
US17/228,525 Active US11533455B2 (en) 2014-04-30 2021-04-12 Imaging apparatus and distance measuring apparatus using the same

Country Status (3)

Country Link
US (5) US9876992B2 (en)
EP (2) EP3862812B1 (en)
JP (1) JP2015222423A (en)

Families Citing this family (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9876992B2 (en) 2014-04-30 2018-01-23 Panasonic Intellectual Property Management Co., Ltd. Imaging apparatus and distance measuring apparatus using the same
US20160295194A1 (en) * 2015-03-30 2016-10-06 Ming Shi CO., LTD. Stereoscopic vision system generatng stereoscopic images with a monoscopic endoscope and an external adapter lens and method using the same to generate stereoscopic images
US10146049B2 (en) * 2016-04-01 2018-12-04 Flir Systems, Inc. Cold weather camera kit
EP3557858B1 (en) * 2016-12-15 2021-01-20 Panasonic Intellectual Property Management Co., Ltd. Imaging device and imaging method
KR20190013224A (en) * 2017-08-01 2019-02-11 엘지전자 주식회사 Mobile terminal
JP6986683B2 (en) 2018-01-05 2021-12-22 パナソニックIpマネジメント株式会社 Parallax value calculation device, parallax value calculation method and program
JP7156801B2 (en) * 2018-02-08 2022-10-19 株式会社フジクラ endoscope and catheter
CN112805992B (en) * 2018-10-03 2024-04-23 富士胶片株式会社 Image pickup apparatus
JP2023094128A (en) * 2021-12-23 2023-07-05 株式会社日立製作所 Imaging device

Family Cites Families (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4997265A (en) * 1988-10-14 1991-03-05 Ricoh Company, Ltd. Zoom lens for variable power copying apparatus
JP2611173B2 (en) * 1992-06-11 1997-05-21 運輸省船舶技術研究所長 Positioning method and device using fisheye lens
JP2000092357A (en) 1998-09-08 2000-03-31 Mitsubishi Electric Corp Image pickup device
JP2001318423A (en) 2000-05-12 2001-11-16 Nippon Sheet Glass Co Ltd Protective cover for camera
JP2002090603A (en) * 2000-07-10 2002-03-27 Matsushita Electric Ind Co Ltd Waterproof camera
JP4464009B2 (en) 2001-05-14 2010-05-19 ティーオーエー株式会社 Imaging device
EP2557469A1 (en) * 2002-10-01 2013-02-13 Fujitsu Limited Robot
JP2005128273A (en) 2003-10-24 2005-05-19 Nissin Kohki Co Ltd Meniscus lens and optical system using the same
JP4009581B2 (en) 2003-11-18 2007-11-14 オリンパス株式会社 Capsule medical system
US7054076B2 (en) * 2004-03-11 2006-05-30 Pinotage, L.L.C. Lens assembly and optical imaging system using same
WO2006068129A1 (en) * 2004-12-22 2006-06-29 Matsushita Electric Industrial Co., Ltd. Imaging device and manufacturing method thereof
JP4695432B2 (en) 2005-04-12 2011-06-08 オリンパスメディカルシステムズ株式会社 In-subject introduction apparatus, in-subject information display apparatus, and in-subject information acquisition system
JP2007043225A (en) 2005-07-29 2007-02-15 Univ Of Electro-Communications Picked-up processing apparatus and picked-up processing method
KR100733253B1 (en) * 2005-11-18 2007-06-27 삼성전기주식회사 High density printed circuit board and manufacturing method thereof
JP2009164654A (en) 2006-04-24 2009-07-23 Panasonic Corp Compound eye camera module
JP4436427B2 (en) * 2006-05-16 2010-03-24 パナソニック株式会社 Imaging device and semiconductor circuit element
US8199975B2 (en) * 2006-12-12 2012-06-12 Cognex Corporation System and method for side vision detection of obstacles for vehicles
WO2009013866A1 (en) * 2007-07-23 2009-01-29 Panasonic Corporation Image pickup apparatus with distance measurement function using multiple eye system
JP4914790B2 (en) 2007-09-04 2012-04-11 オリンパスメディカルシステムズ株式会社 Intra-subject introduction device and method for producing intra-subject introduction device
JP2009211012A (en) 2008-03-06 2009-09-17 Funai Electric Co Ltd Wide-angle compound-eye imaging apparatus
US8866920B2 (en) 2008-05-20 2014-10-21 Pelican Imaging Corporation Capturing and processing of images using monolithic camera array with heterogeneous imagers
JP4796660B2 (en) 2008-06-16 2011-10-19 パナソニック株式会社 Two-disc imaging optical system and imaging apparatus including the same
KR101011269B1 (en) * 2009-02-20 2011-01-27 (주)씨엔에스 정보통신 Dome Camera
JP2010194099A (en) 2009-02-25 2010-09-09 Fujifilm Corp Capsule type endoscope
JP5441465B2 (en) * 2009-03-24 2014-03-12 富士フイルム株式会社 Capsule endoscope
WO2011074531A1 (en) * 2009-12-14 2011-06-23 Do Satoshi Wide angle lens and system equipped with wide angle lens
JP2011172174A (en) 2010-02-22 2011-09-01 Ricoh Co Ltd Imaging apparatus, distance image capturing device, and manufacturing method thereof
JP5466569B2 (en) * 2010-04-26 2014-04-09 富士フイルム株式会社 Imaging lens and imaging apparatus
TWM408051U (en) 2011-01-04 2011-07-21 Topview Optronics Corp Defogging and defrosting device for camera protection lens
WO2012129521A1 (en) * 2011-03-23 2012-09-27 Gentex Corporation Lens cleaning apparatus
JP2012215807A (en) 2011-03-29 2012-11-08 Sony Corp Reflex lens device and stereoscopic imaging apparatus with reflex lens device
JP2013057738A (en) * 2011-09-07 2013-03-28 Olympus Corp Imaging apparatus
JP2013109268A (en) 2011-11-24 2013-06-06 Kyocera Corp Wide-angle optical system and imaging apparatus
JP5628778B2 (en) 2011-11-30 2014-11-19 日立オートモティブシステムズ株式会社 In-vehicle camera mounting device
JP2013148634A (en) 2012-01-17 2013-08-01 Tamron Co Ltd Camera
JP6006009B2 (en) 2012-06-14 2016-10-12 ユー・ディー・シー アイルランド リミテッド COMPOUND, ORGANIC ELECTROLUMINESCENT ELEMENT, MATERIAL FOR ORGANIC ELECTROLUMINESCENT ELEMENT, AND LIGHT EMITTING DEVICE, DISPLAY DEVICE AND LIGHTING DEVICE USING SAME
EP2878999B1 (en) 2012-07-27 2016-09-14 Nissan Motor Co., Ltd. Vehicle-mounted camera device
US20140240469A1 (en) * 2013-02-28 2014-08-28 Motorola Mobility Llc Electronic Device with Multiview Image Capture and Depth Sensing
WO2014171513A1 (en) 2013-04-18 2014-10-23 岡本硝子株式会社 Housing for underwater video camera
US9736365B2 (en) * 2013-10-26 2017-08-15 Light Labs Inc. Zoom related methods and apparatus
US20150248772A1 (en) * 2014-02-28 2015-09-03 Semiconductor Components Industries, Llc Imaging systems and methods for monitoring user surroundings
US9876992B2 (en) * 2014-04-30 2018-01-23 Panasonic Intellectual Property Management Co., Ltd. Imaging apparatus and distance measuring apparatus using the same

Also Published As

Publication number Publication date
US20180109763A1 (en) 2018-04-19
EP3862812B1 (en) 2023-11-22
US10757370B2 (en) 2020-08-25
EP3862812A1 (en) 2021-08-11
US20210235043A1 (en) 2021-07-29
US11006081B2 (en) 2021-05-11
US11533455B2 (en) 2022-12-20
JP2015222423A (en) 2015-12-10
EP2950142A1 (en) 2015-12-02
US9876992B2 (en) 2018-01-23
US20200351473A1 (en) 2020-11-05
EP2950142B1 (en) 2021-06-09
US20150319409A1 (en) 2015-11-05

Similar Documents

Publication Publication Date Title
US11533455B2 (en) Imaging apparatus and distance measuring apparatus using the same
US11270134B2 (en) Method for estimating distance to an object via a vehicular vision system
JP6807543B2 (en) Imaging device
US20110211068A1 (en) Image pickup apparatus and rangefinder
JP6589926B2 (en) Object detection device
JP6510551B2 (en) Image pickup optical system, image pickup apparatus and distance measurement system
US20160379066A1 (en) Method and Camera System for Distance Determination of Objects from a Vehicle
JP4414661B2 (en) Stereo adapter and range image input device using the same
JP5273356B2 (en) Compound eye image input device and distance measuring device using the same
JP5440903B2 (en) Imaging device, stereo camera device, and vehicle exterior monitoring device
CN107122770B (en) Multi-camera system, intelligent driving system, automobile, method and storage medium
US20120033079A1 (en) Camera for a vehicle
US10992920B2 (en) Stereo image processing device
JP7098790B2 (en) Imaging control device and moving object
JP5455033B2 (en) Distance image input device and outside monitoring device
US20180276844A1 (en) Position or orientation estimation apparatus, position or orientation estimation method, and driving assist device
CN110966982A (en) Monocular camera ranging system and method for cleaning robot
CN109855594A (en) Photographic device, distance measuring equipment, onboard system and mobile device
WO2009104381A1 (en) Range finder and range finding method
EP3404911A1 (en) Imaging system and moving body control system
JP6983740B2 (en) Stereo camera system and distance measurement method
CN116668665A (en) Measuring device, moving device, measuring method, and storage medium
US10247939B2 (en) Lens unit, imaging apparatus, and on-vehicle camera
JP7207889B2 (en) Range finder and in-vehicle camera system
JP2009168447A (en) Imaging apparatus

Legal Events

Date Code Title Description
STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION