CN105282537A - Image acquisition device - Google Patents
Image acquisition device Download PDFInfo
- Publication number
- CN105282537A CN105282537A CN201410316792.3A CN201410316792A CN105282537A CN 105282537 A CN105282537 A CN 105282537A CN 201410316792 A CN201410316792 A CN 201410316792A CN 105282537 A CN105282537 A CN 105282537A
- Authority
- CN
- China
- Prior art keywords
- camera lens
- image
- lens module
- depth information
- acquiring device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The present invention provides an image acquisition device comprising at least three lens modules, a storage unit and a processing unit, wherein the storage unit is coupled to the lens modules, and the processing unit is coupled to the storage unit and the lens modules. Each of the lens modules is used for obtaining the image of a shot object respectively. The storage unit is used for storing the images obtained by the lens modules. The processing unit is used for obtaining the complete depth information of the shot object according to multiple image combinations formed by every two images. According to the image acquisition device provided by the invention, the problem of inaccurate estimation of depth information caused by the factors of cross stripes, repetitive lines, shading, reflective and depth noise of the depth information can be solved.
Description
Technical field
The invention relates to a kind of image acquiring device, and relate to a kind of image acquiring device with multiple camera lens module especially.
Background technology
Along with the development of science and technology, intelligent electronic device miscellaneous, such as plate computer, personal digital assistant and smart mobile phone etc., become the instrument that modern is indispensable.Wherein, the camera lens that the intelligent electronic device of senior money carries is equally matched with traditional consumption type camera, even can replace, and the senior money of minority also has the function close to digital single anti-picture element and image quality or shooting 3-D view.
To carry the above-mentioned electronic installation of twin-lens, the distance between its twin-lens arranges the average distance approximated between the mankind two, and the right and left eyes of simulating human is to take 3-D view by this.When mankind's eyes watch same object with small different angle, eyes can see small two different images, and the narrow difference that eyes are seen, be generally referred to as binocular disparity (binoculardisparity) or retinaldisparity (retinaldisparity).Brain can become have the single image of level and the depth of field the image co-registration of these two narrow difference, and then makes us class and produce three-dimensional third dimension.
But, in general twin-lens stereovision technique, for striped, repeated lines anyhow, cover, reflective and degree of depth noise etc. is all without effective solution, its overwhelming majority only can obtain the depth information of image from the difference the coloured image of left and right, so its effect is very limited and easily cause the puzzlement in backend application and flaw.
Summary of the invention
The invention provides a kind of image acquiring device, it utilizes the image accessed by least three camera lens modules, obtains the complete depth information of subject.
The invention provides a kind of image acquiring device, comprise at least three camera lens modules, memory cell and processing unit, wherein memory cell couples described camera lens module, and processing unit couples memory cell and described camera lens module.Described camera lens module is respectively in order to obtain the image of subject.The image that memory cell obtains in order to store described camera lens module.Processing unit, in order to the multiple image combinings formed according to described image between two, obtains the complete depth information of subject.
In one embodiment of this invention, above-mentioned processing unit, according to each image combining, obtains the partial depth information that subject corresponds to each image combining respectively, and again according to described partial depth information, obtains the complete depth information of subject.
In one embodiment of this invention, the quantity of above-mentioned camera lens module is three and is all arranged in first axle.
In one embodiment of this invention, the quantity of above-mentioned camera lens module is three and is arranged in intersect and coplanar second axis and the 3rd axis, and one of them of wherein said camera lens module is positioned at the joining of the second axis and the 3rd axis.
In one embodiment of this invention, above-mentioned second axis is mutually vertical with above-mentioned 3rd axis.
In one embodiment of this invention, the quantity of above-mentioned camera lens module is even number and is arranged in rectangular array.
Based on above-mentioned, the present invention proposes the image acquiring device with at least three camera lens modules, its image got respectively in conjunction with different arrangement mode or the camera lens module between two of different baseline (baseline), thus obtain the complete depth information of subject, with solve depth information because of have anyhow striped, repeated lines, cover, the factor such as reflective and degree of depth noise and cause depth information to estimate inaccurate problem.
For above-mentioned feature and advantage of the present invention can be become apparent, special embodiment below, and coordinate accompanying drawing to be described in detail below.
Accompanying drawing explanation
Fig. 1 is the function block schematic diagram of the image acquiring device of one embodiment of the invention;
Fig. 2 is the arrangement mode schematic diagram of the camera lens module of one embodiment of the invention;
Fig. 3 is the arrangement mode schematic diagram of the camera lens module of another embodiment of the present invention;
Fig. 4 a and Fig. 4 b is the arrangement mode schematic diagram of the camera lens module of further embodiment of this invention.
Description of reference numerals:
100,200,300,400a, 400b: image acquiring device;
110: at least three camera lens modules;
120: memory cell;
130: processing unit;
210,220,230,310,320,330: camera lens module;
410a ~ 440a, 410b ~ 480b: camera lens module;
X: first axle;
X1: the second axis;
Y1: the three axis.
Embodiment
In general, tradition is made up of the twin-lens that specification is identical in order to the camera producing stereo-picture, wherein the spacing distance of twin-lens is about 7.7 centimetres, use the actual range of simulation human eye, the parameter such as focal length, aperture, shutter of twin-lens is then controlled by the processor of camera, via the triggering of cable release, can shoot the same area but the different image in visual angle, namely this image is the image in order to simulating human right and left eyes.But, the camera of this type for having striped anyhow, repeated lines, cover, the subject such as reflective and degree of depth noise only can obtain image depth information from the difference the coloured image of left and right, so its effect is very limited and easily cause the puzzlement in backend application and flaw.The present invention proposes the image acquiring device with at least three camera lens modules, it is in conjunction with the image accessed by different arrangement mode or the combination of camera lens between two of different baseline, thus obtain the complete depth information of subject, estimate inaccurate problem to solve the degree of depth.
Next section Example of the present invention will coordinate accompanying drawing to describe in detail, the component symbol that following description is quoted, when different accompanying drawing occurs that identical component symbol will be considered as same or analogous element.These embodiments are a part of the present invention, and unexposed all embodiments of the present invention.More precisely, these embodiments are the example of the device in patent claim of the present invention.
Fig. 1 is the function block schematic diagram of the image acquiring device of one embodiment of the invention, but this is only for convenience of description, not in order to limit the present invention.
Please refer to Fig. 1, image acquiring device 100 comprises at least three camera lens modules 110, memory cell 120 and processing unit 130.In the present embodiment, image acquiring device 100 is such as digital camera, slr camera, digital code camera, network camera or other have the electronic installation such as smart mobile phone, panel computer, personal digital assistant, head mounted display of image-acquisition functions, and the present invention is not as limit.
Described at least three camera lens modules 110 comprise photo-sensitive cell, in order to difference sense light line strength, and then produce image respectively.Described photo-sensitive cell is such as charge coupled cell (ChargeCoupledDevice, be called for short CCD), Complimentary Metal-Oxide semiconductor (ComplementaryMetal-OxideSemiconductor, be called for short CMOS) element or other be such as Video Graphics Array (VideoGraphicsArray, be called for short VGA) etc. low cost element, the present invention does not limit at this.At least three camera lens modules 110 are in order to obtain the image of subject, and wherein subject can be a certain objects or a scene.
Memory cell 120 is such as the fixed of arbitrary form or packaged type random asccess memory (RandomAccessMemory, be called for short RAM), read-only memory (Read-OnlyMemory, be called for short ROM), flash disk (Flashmemory), hard disk or other similar devices or these devices combination.Memory cell 120 is coupled at least three camera lens modules 110, in order to store the image that at least three camera lens modules 110 obtain.
Processing unit 130 can be such as CPU (CentralProcessingUnit, be called for short CPU), or the microprocessor (Microprocessor) of other programmable general services or special purpose, digital signal processor (DigitalSignalProcessor, be called for short DSP), Programmable Logic Controller (ProgrammableController), Application Specific Integrated Circuit (ApplicationSpecificIntegratedCircuits, be called for short ASIC), programmable logic device (ProgrammableLogicDevice, be called for short PLD) or the combination of other similar devices or these devices.
Processing unit 130 couples at least three camera lens modules 110 and memory cell 120, its each image combining that the image that camera lens module obtains between two can be utilized to form, and obtains the complete depth information of subject.Furthermore, processing unit 130, according to the image combining between two accessed by camera lens module of different arrangement mode and different baseline, obtains the depth information (being defined herein as " partial depth information ") corresponding to each image combining.Processing unit 130 again in conjunction with various piece depth information, thus can obtain the complete depth information of subject.Enumerate the multiple image acquiring device with many camera lens modules by according to different costs and technical sophistication degree below, and be illustrated for its characteristic.
In one embodiment, the quantity of each camera lens module is three, and arranges along same axis.For example, Fig. 2 is the arrangement mode schematic diagram of the camera lens module of one embodiment of the invention.
Please refer to Fig. 2, in the present embodiment, image acquiring device 200 comprises three camera lens modules 210,220,230, and it is arranged on first axle X with the arrangement mode of in-line.Parallax range between this hypothesis camera lens module 210 and camera lens module 220 is b1, parallax range between camera lens module 220 and camera lens module 230 is b2, parallax range between camera lens module 210 and camera lens module 230 is b3, and the image that camera lens module 210, camera lens module 220 and camera lens module 230 obtain is respectively Img1, Img2 and Img3.In the present embodiment, three camera lens modules 210,220,230 can be equidistant configurations; In other words, parallax range b1 equals parallax range b2.But in other embodiments, three camera lens modules 210,220,230 also can be Unequal distance configurations, and the present invention does not limit at this.
The image acquiring device generally with twin-lens module is after the subject image obtaining repeated lines, and the image accessed by two camera lenses will be extremely similar and cause the difficulty in characteristic point comparison (featurepointmatching).In the present embodiment, the processing unit (not shown) of image acquiring device 200 image between two can be utilized to combine image combining Img1-Img2, Img2-Img3 and Img1-Img3 to obtain the depth information of subject.
In detail, to have the subject of repeated lines, the content of image combining Img1-Img2 and/or image combining Img2-Img3 is likely very similar.The processing unit recycling visual angle difference of image acquiring device 200 and the larger camera lens module 210 of parallax range b3 with acquired by camera lens module 230 to image combining Img1-Img3 to image combining Img1-Img2 and/or image combining Img2-Img3 the depth information estimated carry out reparation and compensate, to obtain the more accurate complete depth information of subject.
In another embodiment, the quantity of each camera lens module is also three, but what be different from previous embodiment is, the camera lens module of the present embodiment will intersect and the arrangement of the axis of copline (coplanar) along two, and one of them person of wherein said camera lens module is positioned in the joining of two axis.For example, Fig. 3 is the arrangement mode schematic diagram of the camera lens module of another embodiment of the present invention.
Please refer to Fig. 3, in the present embodiment, image acquiring device 300 comprises three camera lens modules 310,320,330, and it is arranged on the second axis X 1 and the 3rd axis Y1 with the arrangement mode of L-shaped, and wherein camera lens module 320 is positioned in the joining of the second axis X 1 and the 3rd axis Y1.The image obtained at this hypothesis camera lens module 310, camera lens module 320 and camera lens module 330 is respectively Img4, Img5 and Img6.
The image acquiring device 200 of in-line is arranged as with each camera lens module, image accessed by camera lens module 210,220,230 is only the horizontal-shift between picture element, it is after acquisition has the image of the subject of horizontal stripe, the image produced will be extremely similar, and the image combining utilizing all images between two to form still can cause the difficulty in characteristic point comparison.In the present embodiment, the processing unit (not shown) of image acquiring device 300 image between two can be utilized to combine image combining Img4-Img5 and Img5-Img6 to obtain the depth information of subject.
In detail, to have the subject of horizontal stripe, the processing unit of image acquiring device 300 can utilize camera lens module 310 and the image combining Img4-Img5 accessed by camera lens module 320 to obtain the complete depth information of subject.On the other hand, to have the subject of vertical bar line, the processing unit of image acquiring device 300 can utilize camera lens module 320 and the image combining Img5-Img6 accessed by camera lens module 330 to obtain the complete depth information of subject.
In another embodiment, the processing unit of image acquiring device 300 can also according to different calculation modes, the camera lens module 310 that utilization is positioned on different axis and the image combining Img5-Img7 accessed by camera lens module 330 obtain the complete depth information of the subject with horizontal stripe or vertical bar line, and the present invention does not limit at this.
General when carrying out image acquisition, subject is sometimes because light produces the phenomenon of the reflective or veil in front and generating portion crested.Under some shooting situation, the partial depth information that aforesaid image acquiring device 200 or image acquiring device 300 can be tied each image combining and estimate, repair the reflective or part of crested of subject in compensation image picture, and then obtain the complete depth information of subject.But, under part shooting situation, aforesaid image acquiring device 200 or image acquiring device 300 still cannot solve by means of only the image accessed by three camera lens modules subject because of reflective, crested even the degree of depth estimate the problems such as the noise occurred.Accordingly, in one embodiment, the quantity of described camera lens module is even number, and described camera lens module is arranged in a rectangular array.For example, Fig. 4 a and Fig. 4 b is the arrangement mode schematic diagram of the camera lens module of further embodiment of this invention.
Please also refer to Fig. 4 a, in the present embodiment, image acquiring device 400a comprises four camera lens modules 410a, 420a, 430a, 440a.Be similar to three camera lens modules 310,320,330 of image acquiring device 300, image acquiring device 400a carries out degree of depth estimation except utilizing camera lens module 410a, 420a, 430a for the subject with repeated lines or striped anyhow, camera lens module 440a also can be utilized to obtain image from another visual angle, to make up the problems such as the noise occurred of deficiency image acquiring device 300 to estimate to(for) reflective, crested or the degree of depth.Referring again to Fig. 4 b, in another embodiment, can again by additionally arranging multiple camera lens module 410b ~ 480b and arranging the image acquiring device 400b had compared with large rectangle array, to obtain the depth information of more accurate subject.
It is table one that previous embodiment can be converged whole according to the cost of manufacture of image acquiring device, technical sophistication degree and characteristic thereof and advantage.
Wherein, the explanation of table one content please refer to aforementioned relevant paragraph, does not repeat them here.
In sum, the present invention proposes the image acquiring device with at least three camera lens modules, its image got respectively in conjunction with different arrangement mode or the camera lens module between two of different baseline, thus obtain the complete depth information of subject, with solve depth information because of have anyhow striped, repeated lines, cover, the factor such as reflective and degree of depth noise and cause depth information to estimate inaccurate problem.
Table one
Last it is noted that above each embodiment is only in order to illustrate technical scheme of the present invention, be not intended to limit; Although with reference to foregoing embodiments to invention has been detailed description, those of ordinary skill in the art is to be understood that: it still can be modified to the technical scheme described in foregoing embodiments, or carries out equivalent replacement to wherein some or all of technical characteristic; And these amendments or replacement, do not make the essence of appropriate technical solution depart from the scope of various embodiments of the present invention technical scheme.
Claims (6)
1. an image acquiring device, is characterized in that, comprising:
At least three camera lens modules, obtain the image of subject respectively;
Memory cell, couples described camera lens module, stores the described image that described camera lens module obtains; And
Processing unit, couples this memory cell and described camera lens module, according to multiple image combinings that described image between two forms, obtains the complete depth information of this subject.
2. image acquiring device according to claim 1, it is characterized in that, this processing unit is according to each described image combining, obtain the partial depth information that this subject corresponds to each described image combining respectively, and again according to described partial depth information, obtain this complete depth information of this subject.
3. image acquiring device according to claim 1, is characterized in that, the quantity of described camera lens module is three and is all arranged in first axle.
4. image acquiring device according to claim 1, it is characterized in that, the quantity of described camera lens module is three and is arranged in intersect and coplanar second axis and the 3rd axis, and one of them of wherein said camera lens module is positioned at the joining of this second axis and the 3rd axis.
5. image acquiring device according to claim 4, is characterized in that, this second axis is mutually vertical with the 3rd axis.
6. image acquiring device according to claim 1, is characterized in that, the quantity of described camera lens module is even number and is arranged in rectangular array.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410316792.3A CN105282537A (en) | 2014-07-04 | 2014-07-04 | Image acquisition device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410316792.3A CN105282537A (en) | 2014-07-04 | 2014-07-04 | Image acquisition device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105282537A true CN105282537A (en) | 2016-01-27 |
Family
ID=55150751
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410316792.3A Pending CN105282537A (en) | 2014-07-04 | 2014-07-04 | Image acquisition device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105282537A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108961194A (en) * | 2017-03-31 | 2018-12-07 | 钰立微电子股份有限公司 | To merge the depth map generation device of more depth maps |
| CN108986154A (en) * | 2017-05-31 | 2018-12-11 | 钰立微电子股份有限公司 | Method and system for verifying quality of depth map corresponding to image acquisition device |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101487970A (en) * | 2009-03-03 | 2009-07-22 | 北京微视新纪元科技有限公司 | Mirror-image stereo camera apparatus and method |
| CN103546720A (en) * | 2012-07-13 | 2014-01-29 | 晶睿通讯股份有限公司 | Processing system and processing method for synthesizing virtual visual angle image |
| WO2014081115A1 (en) * | 2012-11-26 | 2014-05-30 | Lg Electronics Inc. | Array camera, electrical device, and method for operating the same |
-
2014
- 2014-07-04 CN CN201410316792.3A patent/CN105282537A/en active Pending
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101487970A (en) * | 2009-03-03 | 2009-07-22 | 北京微视新纪元科技有限公司 | Mirror-image stereo camera apparatus and method |
| CN103546720A (en) * | 2012-07-13 | 2014-01-29 | 晶睿通讯股份有限公司 | Processing system and processing method for synthesizing virtual visual angle image |
| WO2014081115A1 (en) * | 2012-11-26 | 2014-05-30 | Lg Electronics Inc. | Array camera, electrical device, and method for operating the same |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108961194A (en) * | 2017-03-31 | 2018-12-07 | 钰立微电子股份有限公司 | To merge the depth map generation device of more depth maps |
| CN108986154A (en) * | 2017-05-31 | 2018-12-11 | 钰立微电子股份有限公司 | Method and system for verifying quality of depth map corresponding to image acquisition device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9973672B2 (en) | Photographing for dual-lens device using photographing environment determined using depth estimation | |
| US10755381B2 (en) | Method and device for image stitching | |
| CN107396080B (en) | Method and system for generating depth information | |
| CN106254854B (en) | Preparation method, the apparatus and system of 3-D image | |
| CN110111262A (en) | A kind of projector distortion correction method, device and projector | |
| US9154765B2 (en) | Image processing device and method, and stereoscopic image display device | |
| US20150156475A1 (en) | Method and Device for Implementing Stereo Imaging | |
| US20120093394A1 (en) | Method for combining dual-lens images into mono-lens image | |
| CN103605210A (en) | Virtual type integrated imaging 3D display device | |
| US20170155889A1 (en) | Image capturing device, depth information generation method and auto-calibration method thereof | |
| WO2018032841A1 (en) | Method, device and system for drawing three-dimensional image | |
| CN103269430A (en) | Three-dimensional scene generation method based on building information model (BIM) | |
| CN107864372B (en) | Stereo photographing method and device and terminal | |
| CN103049933A (en) | Image processing device and method thereof | |
| Kagawa et al. | A three‐dimensional multifunctional compound‐eye endoscopic system with extended depth of field | |
| CN103488039A (en) | 3D camera module and electronic equipment with 3D camera module | |
| TW201719579A (en) | Image capturing device, depth information generation method and auto-calibration method thereof | |
| CN203289497U (en) | Portable electronic device | |
| CN105282537A (en) | Image acquisition device | |
| CN211531217U (en) | 3D terminal | |
| US10277881B2 (en) | Methods and devices for determining visual fatigue of three-dimensional image or video and computer readable storage medium | |
| TW201611571A (en) | Method for generating 3D image and electronic apparatus using the same | |
| WO2021145913A1 (en) | Estimating depth based on iris size | |
| CN105488845B (en) | Generate the method and its electronic device of 3-D view | |
| CN102780900B (en) | Image display method of multi-person multi-view stereoscopic display |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160127 |
|
| WD01 | Invention patent application deemed withdrawn after publication |