CN117768634A - vehicle-mounted stereoscopic vision camera based on binocular camera and laser radar and imaging method - Google Patents
vehicle-mounted stereoscopic vision camera based on binocular camera and laser radar and imaging method Download PDFInfo
- Publication number
- CN117768634A CN117768634A CN202410195339.5A CN202410195339A CN117768634A CN 117768634 A CN117768634 A CN 117768634A CN 202410195339 A CN202410195339 A CN 202410195339A CN 117768634 A CN117768634 A CN 117768634A
- Authority
- CN
- China
- Prior art keywords
- lens
- laser
- visible light
- camera
- path
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 15
- 238000000034 method Methods 0.000 claims description 9
- 238000010586 diagram Methods 0.000 description 2
- 238000011160 research Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Abstract
the invention discloses a vehicle-mounted stereoscopic vision camera based on a binocular camera and a laser radar and an imaging method, and belongs to the technical field of binocular cameras, wherein the vehicle-mounted stereoscopic vision camera comprises a camera body, a visible light laser receiving common-path lens, a visible light receiving device and a laser emitting device are arranged in the camera body, a laser receiver is arranged between the visible light laser receiving common-path lens and the laser emitting device, the visible light laser receiving common-path lens comprises a first lens, a spectroscope and a visible light receiver, the laser emitting device comprises a laser emitter, a collimator, a diffraction mirror and a second lens, and the visible light receiving device comprises a third lens and a third lens. The vehicle-mounted stereoscopic vision camera and the imaging method based on the binocular camera and the laser radar can be used for imaging scene depth images, and the problem that weak texture or repeated texture areas and shielding areas in the scene are poor in imaging is solved.
Description
Technical Field
The invention relates to the technical field of binocular cameras, in particular to a vehicle-mounted stereoscopic vision camera based on a binocular camera and a laser radar and an imaging method.
Background
Unlike a binocular of human being, a depth camera based on the principle of TOF, structured light, which does not project a light source actively to the outside, calculates depth by entirely relying on two pictures taken (color RGB or gray-scale images), and is therefore sometimes referred to as a passive binocular depth camera.
Binocular stereoscopic vision simulates the three-dimensional perception of the human visual system to the environment, acquires the parallax of two images by performing stereoscopic matching on corrected left and right images, calculates the depth of a scene according to the triangulation principle, is a research hotspot in the field of computer vision in the last decades, and has made a series of progress. The traditional stereo matching method adopts the characteristics of manual design to carry out stereo matching, and researches show that the method has poor performance on the weak texture or repeated texture area and the shielding area. The information is collected by using visible light or laser radar in the camera of the same kind, so that a depth image of a scene cannot be obtained, and poor imaging is caused.
Disclosure of Invention
The invention aims to provide a vehicle-mounted stereoscopic vision camera based on a binocular camera and a laser radar and an imaging method, which solve the problem of poor imaging of a weak texture or repeated texture region and a shielding region in a scene.
in order to achieve the above purpose, the invention provides a vehicle-mounted stereoscopic vision camera based on a binocular camera and a laser radar, which comprises a camera body, wherein a visible light laser receiving common-path lens, a visible light receiving device and a laser transmitting device are arranged in the camera body, the visible light laser receiving common-path lens and the visible light receiving device are respectively arranged on two sides of the laser transmitting device, a laser receiver is arranged between the visible light laser receiving common-path lens and the laser transmitting device, the visible light laser receiving common-path lens comprises a first lens, a spectroscope and a visible light receiver, the laser transmitting device comprises a laser emitter, a collimator, a diffraction mirror and a second lens, the visible light receiving device comprises a third lens and a third lens, the visible light receiver comprises a lens group, a lens base and a lens cone, the lens group comprises a plurality of lenses, the lenses are respectively arranged on different lens bases, and the lens base is arranged in the lens cone.
Preferably, the visible light receiver in the visible light laser receiving common-path lens is arranged below the spectroscope, and the spectroscope is arranged below the first lens.
Preferably, the visible light receiver in the visible light receiving device is disposed below the third lens.
preferably, the diffraction mirror is arranged below the second lens, and the collimator and the laser transmitter are arranged below the diffraction mirror.
preferably, the laser receiver is disposed on the right side of the beam splitter.
Preferably, the first lens, the second lens and the third lens are all connected with the camera body through the lens base.
the invention also provides an imaging method of the vehicle-mounted stereoscopic vision camera based on the binocular camera and the laser radar, which comprises the following steps:
step one, visible light on the right side of a camera body enters a visible light receiver in a visible light laser receiving common-path lens, the visible light is processed, and external information is collected;
Step two, the laser emitter at the middle part of the camera body emits laser, the laser passes through the collimator, reaches the diffraction mirror to diffract and expand the laser range, and then the laser is emitted to the outside through the lens II;
Step three, the laser emitted by the middle part of the camera body is refracted back to the left side of the camera body through an external object, the common light path of the visible light and the laser is split through a spectroscope, the light is split to a visible light receiver in a lens of the common light path of the laser receiver and the visible light laser receiving, and external information is collected;
And step four, finally, summarizing the overall information to obtain a depth image of the scene.
the invention has the following beneficial effects:
when the camera acquires information to acquire an image, the left side of the camera is subjected to visible light and laser common light path processing, a light path enters the camera from the outside of the camera, passes through a lens to reach a spectroscope, the spectroscope splits light, the visible light enters a visible light receiving device through the spectroscope, the laser enters the laser receiving device through the spectroscope refraction, finally, information is converged to obtain a depth image of a scene, and the problem that a weak texture or repeated texture area and a shielding area are not well represented is solved.
The technical scheme of the invention is further described in detail through the drawings and the embodiments.
Drawings
FIG. 1 is a cross-sectional view of an embodiment of a vehicle-mounted stereoscopic camera based on a binocular camera and a lidar of the present invention;
FIG. 2 is a schematic view of a visible light laser receiving common-path lens structure of an embodiment of a vehicle-mounted stereoscopic camera based on a binocular camera and a laser radar;
FIG. 3 is a schematic diagram of a left-side visible light receiver of an embodiment of a vehicle-mounted stereoscopic camera based on a binocular camera and a lidar of the present invention;
FIG. 4 is a schematic view of a laser receiver of an embodiment of a vehicle-mounted stereoscopic camera based on a binocular camera and a lidar according to the present invention;
fig. 5 is a schematic diagram of a right visible light receiver of an embodiment of a vehicle-mounted stereoscopic camera based on a binocular camera and a lidar according to the present invention.
1. A camera body; 2. a first lens; 3. a beam splitter; 4. a visible light receiver; 5. a laser receiver; 6. a second lens; 7. a diffraction mirror; 8. a collimator; 9. a laser emitter; 10. a third lens; 11. a diffraction mirror base; 12. a diffraction lens barrel; 13. a collimator housing; 14. a lens group; 15. lens barrel.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present application more apparent, the embodiments of the present application will be further described in detail below with reference to the accompanying drawings and examples. It should be understood that the detailed description and specific examples, while indicating the embodiment of the application, are intended for purposes of illustration only and are not intended to limit the scope of the application. All other embodiments, which can be made by those skilled in the art based on the embodiments of the application without making any inventive effort, are intended to be within the scope of the application. Examples of the embodiments are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to like or similar elements throughout or elements having like or similar functionality.
It should be noted that the terms "comprises" and "comprising," along with any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or server that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed or inherent to such process, method, article, or apparatus, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
Like reference numerals and letters denote like items in the following figures, and thus once an item is defined in one figure, no further definition or explanation thereof is necessary in the following figures.
In the description of the present invention, it should be noted that, directions or positional relationships indicated by terms such as "upper", "lower", "inner", "outer", etc., are directions or positional relationships based on those shown in the drawings, or those that are conventionally put in use, are merely for convenience of describing the present invention and simplifying the description, and do not indicate or imply that the apparatus or elements to be referred to must have a specific direction, be constructed and operated in a specific direction, and thus should not be construed as limiting the present invention.
In the description of the present invention, it should also be noted that, unless explicitly specified and limited otherwise, the terms "disposed," "mounted," and "connected" are to be construed broadly, and may be, for example, fixedly connected, detachably connected, or integrally connected; can be mechanically or electrically connected; can be directly connected or indirectly connected through an intermediate medium, and can be communication between two elements. The specific meaning of the above terms in the present invention will be understood in specific cases by those of ordinary skill in the art.
As shown in fig. 1, the vehicle-mounted stereoscopic vision camera based on the binocular camera and the laser radar provided by the invention comprises a camera body 1, wherein a visible light laser receiving common-path lens, a visible light receiving device and a laser emitting device are arranged in the camera body 1.
As shown in fig. 2, the left-side visible laser light receiving common-path lens includes a lens 2, a beam splitter 3, a visible light receiver 4, and a laser receiver 5. The visible light receiver 4 in the visible light laser receiving common-path lens is arranged below the spectroscope 3, the spectroscope 3 is arranged below the first lens 2, and the laser receiver 5 is arranged on the right side of the spectroscope 3. The first lens 2 is connected with the camera body 1 through a lens base.
The middle laser emitting device comprises a laser emitter 9, a collimator 8, a diffraction mirror 7 and a second lens 6. The diffraction mirror 7 is arranged below the second lens 6, and the collimator 8 and the laser emitter 9 are arranged below the diffraction mirror 7. The second lens 6 is connected to the camera body 1 through a lens mount, and the diffraction mirror 7 is connected to the camera body 1 through a diffraction mount 11. The lens mount and the diffraction mount 11 are fixed in the diffraction lens barrel 12, the collimator 8 is fixed in the collimator housing 13, the laser transmitter 9 is connected with the collimator housing 13, and the diffraction lens barrel 12 and the collimator housing 13 are fixed in the camera body 1.
The right visible light receiving device includes a visible light receiver 4 and a lens three 10. The visible light receiver 4 in the visible light receiving device is disposed below the lens three 10. The visible light laser receiving common-path lens and the visible light receiving device are respectively arranged at two sides of the laser transmitting device. The visible light receiver 4 comprises a lens group 14, lens seats and a lens cone 15, the lens group 14 comprises a plurality of lenses, the lenses are respectively arranged on different lens seats, and the lens seats are arranged in the lens cone 15.
the invention discloses an imaging method of a vehicle-mounted stereoscopic vision camera based on a binocular camera and a laser radar, which comprises the following steps of:
step one, the visible light on the right side of the camera body 1 enters a visible light receiver 4 in a visible light laser receiving common-path lens, and the visible light is processed to acquire external information.
step two, the laser emitter 9 at the middle part of the camera body 1 emits laser, the laser reaches the diffraction mirror 7 through the collimator 8 to diffract and expand the laser range, and the laser is emitted to the outside through the lens two 6.
And thirdly, the laser emitted by the middle part of the camera body 1 is refracted back to the left side of the camera body 1 through an external object, the common light path of the visible light and the laser is split through the spectroscope 3, the light is split to the visible light receiver 4 in the lens of the common light path of the laser receiver and the visible light laser receiving, and external information is collected.
And step four, finally, summarizing the overall information to obtain a depth image of the scene.
Therefore, the vehicle-mounted stereoscopic vision camera and the imaging method based on the binocular camera and the laser radar can obtain the scene depth image, and solve the problem of poor imaging of weak texture or repeated texture areas and shielding areas in the scene.
Finally, it should be noted that: the above embodiments are only for illustrating the technical solution of the present invention and not for limiting it, and although the present invention has been described in detail with reference to the preferred embodiments, it will be understood by those skilled in the art that: the technical scheme of the invention can be modified or replaced by the same, and the modified technical scheme cannot deviate from the spirit and scope of the technical scheme of the invention.
Claims (7)
1. A vehicle-mounted stereoscopic vision camera based on a binocular camera and a laser radar is characterized in that: the camera comprises a camera body, wherein a visible light laser receiving common-path lens, a visible light receiving device and a laser transmitting device are arranged in the camera body, the visible light laser receiving common-path lens and the visible light receiving device are respectively arranged on two sides of the laser transmitting device, a laser receiver is arranged between the visible light laser receiving common-path lens and the laser transmitting device, the visible light laser receiving common-path lens comprises a first lens, a spectroscope and a second lens, the laser transmitting device comprises a laser emitter, a collimator, a diffraction mirror and a second lens, the visible light receiving device comprises a third lens and a third lens, the visible light receiver comprises a lens group, a lens seat and a lens cone, the lens group comprises a plurality of lenses, the lenses are respectively arranged on the different lens seats, and the lens seat is arranged in the lens cone.
2. the binocular camera and lidar based vehicle stereo vision camera of claim 1, wherein: the visible light receiver in the visible light laser receiving common-path lens is arranged below the spectroscope, and the spectroscope is arranged below the first lens.
3. The binocular camera and lidar based vehicle stereo vision camera of claim 2, wherein: the visible light receiver in the visible light receiving device is disposed below the third lens.
4. A binocular camera and lidar based vehicle mounted stereoscopic camera according to claim 3, wherein: the diffraction mirror is arranged below the second lens, and the collimator and the laser transmitter are arranged below the diffraction mirror.
5. The binocular camera and lidar based vehicle stereo vision camera of claim 4, wherein: the laser receiver is arranged on the right side of the spectroscope.
6. The binocular camera and lidar based vehicle stereo vision camera of claim 5, wherein: the first lens, the second lens and the third lens are all connected with the camera body through the lens base.
7. the imaging method of a vehicle-mounted stereoscopic camera based on a binocular camera and a laser radar according to any one of claims 1 to 6, wherein: the method comprises the following steps:
step one, visible light on the right side of a camera body enters a visible light receiver in a visible light laser receiving common-path lens, the visible light is processed, and external information is collected;
Step two, the laser emitter at the middle part of the camera body emits laser, the laser passes through the collimator, reaches the diffraction mirror to diffract and expand the laser range, and then the laser is emitted to the outside through the lens II;
Step three, the laser emitted by the middle part of the camera body is refracted back to the left side of the camera body through an external object, the common light path of the visible light and the laser is split through a spectroscope, the light is split to a visible light receiver in a lens of the common light path of the laser receiver and the visible light laser receiving, and external information is collected;
And step four, finally, summarizing the overall information to obtain a depth image of the scene.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410195339.5A CN117768634A (en) | 2024-02-22 | 2024-02-22 | vehicle-mounted stereoscopic vision camera based on binocular camera and laser radar and imaging method |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202410195339.5A CN117768634A (en) | 2024-02-22 | 2024-02-22 | vehicle-mounted stereoscopic vision camera based on binocular camera and laser radar and imaging method |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN117768634A true CN117768634A (en) | 2024-03-26 |
Family
ID=90314798
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202410195339.5A Pending CN117768634A (en) | 2024-02-22 | 2024-02-22 | vehicle-mounted stereoscopic vision camera based on binocular camera and laser radar and imaging method |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117768634A (en) |
Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106254796A (en) * | 2016-10-11 | 2016-12-21 | 公安部第研究所 | A kind of iraser laser spot detection imaging device based on iconoscope and method |
| CN108650447A (en) * | 2018-07-06 | 2018-10-12 | 上海图漾信息科技有限公司 | Imaging sensor, depth data measurement head and measuring system |
| CN108917645A (en) * | 2018-07-20 | 2018-11-30 | 清华大学苏州汽车研究院（吴江） | Binocular vision system based on laser modulation |
| CN209787294U (en) * | 2019-01-11 | 2019-12-13 | 南京理工大学 | Multispectral three-dimensional imaging system |
| CN111757086A (en) * | 2019-03-28 | 2020-10-09 | 杭州海康威视数字技术股份有限公司 | Active binocular camera, RGB-D image determination method and device |
| CN115462735A (en) * | 2021-06-10 | 2022-12-13 | 珠海市迪谱医疗科技有限公司 | High-precision monocular endoscopic stereo imaging system and imaging method |
| CN116413681A (en) * | 2021-12-30 | 2023-07-11 | 武汉万集光电技术有限公司 | Laser radar and vision fusion system and detection method |
| CN220381291U (en) * | 2023-07-21 | 2024-01-23 | 中国科学院理化技术研究所 | Laser radar system of common light path |
| WO2024027709A1 (en) * | 2022-08-01 | 2024-02-08 | 合肥英睿系统技术有限公司 | Multi-mode handheld optical device |
| WO2024026631A1 (en) * | 2022-08-01 | 2024-02-08 | 合肥英睿系统技术有限公司 | Multi-mode handheld optical device |
-
2024
- 2024-02-22 CN CN202410195339.5A patent/CN117768634A/en active Pending
Patent Citations (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106254796A (en) * | 2016-10-11 | 2016-12-21 | 公安部第研究所 | A kind of iraser laser spot detection imaging device based on iconoscope and method |
| CN108650447A (en) * | 2018-07-06 | 2018-10-12 | 上海图漾信息科技有限公司 | Imaging sensor, depth data measurement head and measuring system |
| CN108917645A (en) * | 2018-07-20 | 2018-11-30 | 清华大学苏州汽车研究院（吴江） | Binocular vision system based on laser modulation |
| CN209787294U (en) * | 2019-01-11 | 2019-12-13 | 南京理工大学 | Multispectral three-dimensional imaging system |
| CN111757086A (en) * | 2019-03-28 | 2020-10-09 | 杭州海康威视数字技术股份有限公司 | Active binocular camera, RGB-D image determination method and device |
| CN115462735A (en) * | 2021-06-10 | 2022-12-13 | 珠海市迪谱医疗科技有限公司 | High-precision monocular endoscopic stereo imaging system and imaging method |
| CN116413681A (en) * | 2021-12-30 | 2023-07-11 | 武汉万集光电技术有限公司 | Laser radar and vision fusion system and detection method |
| WO2024027709A1 (en) * | 2022-08-01 | 2024-02-08 | 合肥英睿系统技术有限公司 | Multi-mode handheld optical device |
| WO2024026631A1 (en) * | 2022-08-01 | 2024-02-08 | 合肥英睿系统技术有限公司 | Multi-mode handheld optical device |
| CN220381291U (en) * | 2023-07-21 | 2024-01-23 | 中国科学院理化技术研究所 | Laser radar system of common light path |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP3214682B2 (en) | Display device | |
| CN106772431A (en) | A kind of Depth Information Acquistion devices and methods therefor of combination TOF technologies and binocular vision | |
| US10382699B2 (en) | Imaging system and method of producing images for display apparatus | |
| US20050207486A1 (en) | Three dimensional acquisition and visualization system for personal electronic devices | |
| CN108718406B (en) | Variable-focus 3D depth camera and imaging method thereof | |
| CN104903677A (en) | Methods and apparatus for merging depth images generated using distinct depth imaging techniques | |
| CN108616742B (en) | 3D panoramic shooting system and method | |
| CN110187506B (en) | Optical display system and augmented reality device | |
| CN109756725A (en) | Structured light projection device, three-dimensional camera mould group and terminal device | |
| US20190020866A1 (en) | Intelligent device and method for outputting a depth image | |
| US20170104978A1 (en) | Systems and methods for real-time conversion of video into three-dimensions | |
| CN107209949A (en) | Method and system for producing amplification 3D rendering | |
| CN113109947A (en) | Display device and wearable display equipment | |
| CN117768634A (en) | vehicle-mounted stereoscopic vision camera based on binocular camera and laser radar and imaging method | |
| CN110012280B (en) | TOF module for VSLAM system and VSLAM calculation method | |
| CN109725429B (en) | Solid-aggregation hybrid imaging stereoscopic display device | |
| CN114659635B (en) | Spectral depth imaging device and method based on image surface segmentation light field | |
| CN215416101U (en) | Display device and wearable display equipment | |
| CN213091888U (en) | Depth measurement system and electronic device | |
| CN210321610U (en) | Three-dimensional scanning system in single camera mouth | |
| US20120287239A1 (en) | Robot Vision With Three Dimensional Thermal Imaging | |
| CN108227226B (en) | 3D display device and 3D display method | |
| CN111652967A (en) | Three-dimensional reconstruction system and method based on front-back fusion imaging | |
| US11758119B2 (en) | Low cost HUD using stereo and head tracking | |
| Padullaparthi | VCSELs for 3D Sensing and Computer Vision |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |