CN106382918A - Three-dimensional visual sensor - Google Patents
Three-dimensional visual sensor Download PDFInfo
- Publication number
- CN106382918A CN106382918A CN201610783334.XA CN201610783334A CN106382918A CN 106382918 A CN106382918 A CN 106382918A CN 201610783334 A CN201610783334 A CN 201610783334A CN 106382918 A CN106382918 A CN 106382918A
- Authority
- CN
- China
- Prior art keywords
- image
- radar detedtor
- control system
- visual sensor
- dimensional visual
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01C—MEASURING DISTANCES, LEVELS OR BEARINGS; SURVEYING; NAVIGATION; GYROSCOPIC INSTRUMENTS; PHOTOGRAMMETRY OR VIDEOGRAMMETRY
- G01C11/00—Photogrammetry or videogrammetry, e.g. stereogrammetry; Photographic surveying
- G01C11/02—Picture taking arrangements specially adapted for photogrammetry or photographic surveying, e.g. controlling overlapping of pictures
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
- G01S13/00—Systems using the reflection or reradiation of radio waves, e.g. radar systems; Analogous systems using reflection or reradiation of waves whose nature or wavelength is irrelevant or unspecified
- G01S13/02—Systems using reflection of radio waves, e.g. primary radar systems; Analogous systems
- G01S13/06—Systems determining position data of a target
- G01S13/08—Systems for measuring distance only
Landscapes
- Engineering & Computer Science (AREA)
- Radar, Positioning & Navigation (AREA)
- Remote Sensing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Computer Networks & Wireless Communication (AREA)
- Radar Systems Or Details Thereof (AREA)
- Traffic Control Systems (AREA)
Abstract
The invention provides a three-dimensional visual sensor. Images from two cameras are spliced to obtain an image of the front within the range of 180 degrees. A control system receives the image from the camera and acquires directional angles of various objects in the image. A radar detector comprises a steering engine. The steering engine acquires the directional angles and adjusts radar transmitting direction of the radar detector to the directional angle of the object. The radar detector controls the angle of the radar detector according to the directional angles of the various objects. The radar detector acquires distance data of the various objects and sends the distance data to the control system. The control system completes corresponding control according to directions and distances of the various objects in the image. The three-dimensional visual sensor provided by the invention completes confirmation of distance and position of the object through the dual cameras and the radar detector. The three-dimensional visual sensor has high judgment accuracy and has a wide application prospect.
Description
Technical field
The present invention relates to 3D vision technical field, particularly a kind of three-dimensional visual sensor.
Background technology
With the development of computer vision and artificial intelligence, the form of vision sensor and function are also lifted rapid.Existing
Some vision sensors are generally divided into two big class, and a class is to pay attention to the stereoscopic vision of 3D, is taken the photograph by two or more
As head catches the picture of object in reality, and taken the photograph by the athletic posture and distance that the image collecting is analyzed with acquisition object
The distance of camera.An other class is panoramic picture acquisition scheme emerging in recent years, by the shooting of fixed alignment different directions
Head, the image of collection all angles around object, through calibrating and splicing the panoramic picture obtaining around object.
A but only direction of stereo vision sensor concern, although and panoramic vision sensor solution energy
Enough images simultaneously gathering multiple directions, but the visual identity of multi-vision visual can not be carried out, considerably increase and carry out artificial intelligence
The difficulty of energy.Additionally, panoramic vision sensor at this stage has multi-cam splicing, refraction-reflection type, bugeye lens splicing etc. three
Plant solution, multi-cam splicing solution is relatively costly, refraction-reflection type photographic head uses scene limited, and can be only generated post
Face panorama sketch.
Content of the invention
For solving above-mentioned technical problem, the invention provides a kind of three-dimensional visual sensor, it includes two photographic head, thunders
Reach detector, control system, two of which photographic head has to the left, to the right certain drift angle, the figure of described two photographic head respectively
As splicing gets the image of front 180 degree scope；
Described control system accepts the image that described photographic head obtains, and obtains the deflection of each object in described image
Degree, and send to the radar detedtor positioned at front end；
Described radar detedtor includes a steering machine, and described steering machine obtains described orientation angle and adjusts radar detedtor
Radar emission direction to described object place orientation angle；
Described radar detedtor controls the angle of described radar detedtor according to the orientation angle of the described each object obtaining,
Described radar detedtor obtains the range data of each object and sends to control system, and described control system is according to described image
In the direction of each object complete corresponding control with range data.
It is preferred that it is used for automatic machinery people or autonomous driving vehicle.
The invention has the advantages that：
The three-dimensional visual sensor that the present invention provides pass through dual camera and radar detedtor complete the distance to object and
The confirmation of position, the degree of accuracy of judgement is high, and application prospect is extensive.
Certainly, the arbitrary product implementing the present invention it is not absolutely required to reach all the above advantage simultaneously.
Brief description
In order to be illustrated more clearly that the technical scheme of the embodiment of the present invention, below by use required for embodiment description
Accompanying drawing be briefly described it should be apparent that, drawings in the following description are only some embodiments of the present invention, for ability
For the those of ordinary skill of domain, on the premise of not paying creative work, can also be obtained other attached according to these accompanying drawings
Figure.
Fig. 1 is three-dimensional visual sensor composition schematic diagram provided in an embodiment of the present invention.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation description is it is clear that described embodiment is only a part of embodiment of the present invention, rather than whole embodiments.It is based on
Embodiment in the present invention, it is all other that those of ordinary skill in the art are obtained under the premise of not making creative work
Embodiment, broadly falls into the scope of protection of the invention.
As shown in figure 1, embodiments providing a kind of three-dimensional visual sensor, it includes two photographic head, radars
Detector, control system, two of which photographic head has to the left, to the right certain drift angle, the image of described two photographic head respectively
Splicing gets the image of front 180 degree scope；
Described control system accepts the image that described photographic head obtains, and obtains the deflection of each object in described image
Degree, and send to the radar detedtor positioned at front end；
Described radar detedtor includes a steering machine, and described steering machine obtains described orientation angle and adjusts radar detedtor
Radar emission direction to described object place orientation angle；
Described radar detedtor controls the angle of described radar detedtor according to the orientation angle of the described each object obtaining,
Described radar detedtor obtains the range data of each object and sends to control system, and described control system is according to described image
In the direction of each object complete corresponding control with range data.
The three-dimensional visual sensor that the present embodiment provides can be used for automatic machinery people or autonomous driving vehicle.
The three-dimensional visual sensor that the present invention provides pass through dual camera and radar detedtor complete the distance to object and
The confirmation of position, the degree of accuracy of judgement is high, and application prospect is extensive.
Present invention disclosed above preferred embodiment is only intended to help illustrate the present invention.Preferred embodiment is not detailed
Describe all of details, also do not limit the specific embodiment that this invention is only described.Obviously, the content according to this specification,
Can make many modifications and variations.This specification is chosen and is specifically described these embodiments, is to preferably explain the present invention
Principle and practical application so that skilled artisan can be best understood by and utilize the present invention.The present invention is only
Limited by claims and its four corner and equivalent.
Claims (2)
1. a kind of three-dimensional visual sensor it is characterised in that include two photographic head, radar detedtor, control systems, wherein two
Individual photographic head has to the left, to the right certain drift angle respectively, and the image mosaic of described two photographic head gets front 180 degree scope
Image；
Described control system accepts the image that described photographic head obtains, and obtains the orientation angle of each object in described image, and
Send to the radar detedtor positioned at front end；
Described radar detedtor includes a steering machine, and described steering machine obtains described orientation angle and adjusts the thunder of radar detedtor
Reach the direction of the launch to described object place orientation angle；
Described radar detedtor controls the angle of described radar detedtor according to the orientation angle of the described each object obtaining, described
Radar detedtor obtains the range data of each object and sends to control system, and described control system is according in described image
The direction of each object completes corresponding control with range data.
2. three-dimensional visual sensor as claimed in claim 1 is it is characterised in that it is used for automatic machinery people or automatically drives
Sail automobile.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610783334.XA CN106382918A (en) | 2016-08-31 | 2016-08-31 | Three-dimensional visual sensor |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610783334.XA CN106382918A (en) | 2016-08-31 | 2016-08-31 | Three-dimensional visual sensor |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN106382918A true CN106382918A (en) | 2017-02-08 |
Family
ID=57938737
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201610783334.XA Pending CN106382918A (en) | 2016-08-31 | 2016-08-31 | Three-dimensional visual sensor |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106382918A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107071347A (en) * | 2017-02-27 | 2017-08-18 | 浙江宇视科技有限公司 | The method of adjustment and headend equipment of a kind of wireless localization apparatus |
| CN108229345A (en) * | 2017-12-15 | 2018-06-29 | 吉利汽车研究院（宁波）有限公司 | A kind of driver's detecting system |
| CN112104859A (en) * | 2019-06-17 | 2020-12-18 | 苏州思善齐自动化科技有限公司 | Three-dimensional vision sensor and use method thereof |
| CN113070898A (en) * | 2021-03-31 | 2021-07-06 | 郑州工业应用技术学院 | Three-dimensional visual sense sensing control device based on multi-sense fusion |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1616920A (en) * | 2003-11-14 | 2005-05-18 | 北京理工大学 | An active real-time 3D positioning system based on binocular vision and laser ranging |
| US20130222174A1 (en) * | 2010-10-11 | 2013-08-29 | Tok Son Choe | Apparatus and method for providing obstacle information in autonomous mobile vehicle |
| CN104079916A (en) * | 2014-06-16 | 2014-10-01 | 深圳市德赛微电子技术有限公司 | Panoramic three-dimensional visual sensor and using method |
| CN105159317A (en) * | 2015-09-14 | 2015-12-16 | 深圳一电科技有限公司 | Unmanned plane and control method |
| CN205220511U (en) * | 2015-12-23 | 2016-05-11 | 安徽安凯汽车股份有限公司 | Car safe driving assists detecting system |
| CN105678787A (en) * | 2016-02-03 | 2016-06-15 | 西南交通大学 | Heavy-duty lorry driving barrier detection and tracking method based on binocular fisheye camera |
| CN105818763A (en) * | 2016-03-09 | 2016-08-03 | 乐卡汽车智能科技（北京）有限公司 | Method, device and system for confirming distance of object around vehicle |
-
2016
- 2016-08-31 CN CN201610783334.XA patent/CN106382918A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1616920A (en) * | 2003-11-14 | 2005-05-18 | 北京理工大学 | An active real-time 3D positioning system based on binocular vision and laser ranging |
| US20130222174A1 (en) * | 2010-10-11 | 2013-08-29 | Tok Son Choe | Apparatus and method for providing obstacle information in autonomous mobile vehicle |
| CN104079916A (en) * | 2014-06-16 | 2014-10-01 | 深圳市德赛微电子技术有限公司 | Panoramic three-dimensional visual sensor and using method |
| CN105159317A (en) * | 2015-09-14 | 2015-12-16 | 深圳一电科技有限公司 | Unmanned plane and control method |
| CN205220511U (en) * | 2015-12-23 | 2016-05-11 | 安徽安凯汽车股份有限公司 | Car safe driving assists detecting system |
| CN105678787A (en) * | 2016-02-03 | 2016-06-15 | 西南交通大学 | Heavy-duty lorry driving barrier detection and tracking method based on binocular fisheye camera |
| CN105818763A (en) * | 2016-03-09 | 2016-08-03 | 乐卡汽车智能科技（北京）有限公司 | Method, device and system for confirming distance of object around vehicle |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107071347A (en) * | 2017-02-27 | 2017-08-18 | 浙江宇视科技有限公司 | The method of adjustment and headend equipment of a kind of wireless localization apparatus |
| CN107071347B (en) * | 2017-02-27 | 2020-02-18 | 浙江宇视科技有限公司 | Adjusting method of wireless positioning equipment and front-end equipment |
| CN108229345A (en) * | 2017-12-15 | 2018-06-29 | 吉利汽车研究院（宁波）有限公司 | A kind of driver's detecting system |
| CN112104859A (en) * | 2019-06-17 | 2020-12-18 | 苏州思善齐自动化科技有限公司 | Three-dimensional vision sensor and use method thereof |
| CN113070898A (en) * | 2021-03-31 | 2021-07-06 | 郑州工业应用技术学院 | Three-dimensional visual sense sensing control device based on multi-sense fusion |
| CN113070898B (en) * | 2021-03-31 | 2022-07-15 | 郑州工业应用技术学院 | A three-dimensional vision sensor control device based on multi-sensory fusion |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11106203B2 (en) | Systems and methods for augmented stereoscopic display | |
| CN104835117B (en) | Generating method of spherical panorama based on overlapping method | |
| CN105744163B (en) | A kind of video camera and image capture method based on depth information tracking focusing | |
| US20200191556A1 (en) | Distance mesurement method by an unmanned aerial vehicle (uav) and uav | |
| CN104079916A (en) | Panoramic three-dimensional visual sensor and using method | |
| CN106444837A (en) | Obstacle avoiding method and obstacle avoiding system for unmanned aerial vehicle | |
| CN104506761B (en) | A kind of 360 degree of full-view stereo photography machines | |
| CN108628337A (en) | Coordinates measurement device, contouring system and path generating method | |
| CN108323190A (en) | An obstacle avoidance method, device and unmanned aerial vehicle | |
| CN102081296B (en) | Device and method for quickly positioning compound-eye vision imitated moving target and synchronously acquiring panoramagram | |
| KR101600862B1 (en) | stereo vision system using a plurality of uav | |
| CN101814181A (en) | Unfolding method for restoration of fisheye image | |
| JP2017509986A (en) | Optical flow imaging system and method using ultrasonic depth detection | |
| JP2015037937A (en) | Flight vehicle flight control system | |
| CN112995516B (en) | Focusing method and device, aerial camera and unmanned aerial vehicle | |
| WO2019061064A1 (en) | Image processing method and device | |
| CN106382918A (en) | Three-dimensional visual sensor | |
| CN103295231A (en) | Method for geometrically correcting vertically mapped images of fisheye lenses in fisheye image mosaic | |
| CN106289184A (en) | One works in coordination with vision deformation monitoring method without GNSS signal with without unmanned plane under control point | |
| CN110132226A (en) | The distance and azimuth angle measurement system and method for a kind of unmanned plane line walking | |
| CN112837207B (en) | Panoramic depth measurement method, four-eye fisheye camera and binocular fisheye camera | |
| WO2019144269A1 (en) | Multi-camera photographing system, terminal device, and robot | |
| CN106254738A (en) | Dual image acquisition system and image-pickup method | |
| WO2020207411A1 (en) | Image data processing method and apparatus, image processing chip and aircraft | |
| CN206100245U (en) | 360 camera is taken photograph to degree panorama degree of depth |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20170427 Address after: 243000 Ma'anshan Anhui city to undertake industrial transfer demonstration park, international science and Technology Park, No. 21 Applicant after: MA'ANSHAN TIANZHENG INTELLIGENT EQUIPMENT CO., LTD. Address before: 300131 Hongqiao District, Tianjin District, No. 1, No. 1, No. 1 road, Hongqiao Applicant before: Hu Zhaozheng |
|
| TA01 | Transfer of patent application right | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20170208 |
|
| RJ01 | Rejection of invention patent application after publication |