CN105635718A - Image capture device - Google Patents
Image capture device Download PDFInfo
- Publication number
- CN105635718A CN105635718A CN201410580159.5A CN201410580159A CN105635718A CN 105635718 A CN105635718 A CN 105635718A CN 201410580159 A CN201410580159 A CN 201410580159A CN 105635718 A CN105635718 A CN 105635718A
- Authority
- CN
- China
- Prior art keywords
- image
- unit
- infrared
- rgb
- picture element
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Abstract
The invention discloses an image capture device applied to electronic products. The image capture device comprises a red-green-blue and infrared image capture unit, a red-green-blue image capture unit, an infrared light emitting unit and a processing unit. The red-green-blue and infrared image capture unit captures a first image of an external environment, and the first image is a composite image containing red-green-blue image information (RGB) and infrared (IR) image information. The red-green-blue image capture unit captures a second image of the external environment. The infrared light emitting unit emits an infrared light source. The processing unit is electrically connected with the red-green-blue and infrared image capture unit, the red-green-blue image capture unit and the infrared light emitting unit, and selectively gets the depth information of the first image based on the first image or gets the depth information of the second image based on the first image and the second image. Different image processing modes can be adopted in different external environments in order to solve the problem that depth images are of low accuracy or are vulnerable to interference in the known technologies.
Description
Technical field
The invention relates to a kind of image capture unit, particularly a kind of result through detecting pick-up image scene judges the mode of generation degree of depth image, to set up the image capture unit of a kind of hybrid generation degree of depth image.
Background technology
The twin-lens arranged in pairs or groups on current running gear can reach many different effects, take two photos combine as being utilized respectively a wide-angle lens or a zoom lens, to reach the result of lossless zoom, or two photos that twin-lens takes are utilized to analyze the depth of field being subtracted image. But no matter be which kind of application, it is necessary to arrive best image instantly namely capturing of pick-up image, just follow-up application can be produced maximum benefit.
For intelligent mobile phone, current degree of depth image producing method can be estimated and is slightly divided into two kinds, first kind of way is to utilize on intelligent mobile phone one main image acquisition lens and an assisted image acquisition lens, and uses the chromatic image that the two camera lens captures to process through a Stereo Matching (Stereomatching) to produce a degree of depth image. Another way utilizes the infrared image acquisition lens on intelligent mobile phone and an infrared LEDs module, the infrared image captured and this infrared LEDs module is processed through structured light (Structure-light) to produce another degree of depth image.
Utilize structured light to process produced degree of depth image and there is preferably accuracy, utilize the reason of infrared light sources yet with it, if being easily subject to the light source interference of sunlight out of doors or being disturbed by other light source. On the other hand, although utilizing degree of depth image produced by Stereo Matching process to have be not subject to the advantage that outdoors sunlight disturbs, the scope of application is wider, but the accuracy of its degree of depth image is not so good as the accuracy of degree of depth image produced by use structured light process.
Described in before taking a broad view of, being event, the present inventor concentrates on studies, thinks and designs the image capture unit of a kind of hybrid generation degree of depth through pains for many years, is improved with the disappearance for prior art, and then the enforcement in enhancement industry utilizes.
Summary of the invention
Because the problem of above-mentioned prior art, the purpose of the present invention is exactly produce a kind of image capture unit processed in conjunction with Stereo Matching process and structured light, to guarantee that image capture unit can for different external environment conditions to carry out different image processing modes.
Based on above-mentioned purpose, the present invention provides a kind of image capture unit, it is applicable on an electronic product, and image capture unit comprises a RGB and infrared ray (RGB/IR) image acquisition unit, a RGB image acquisition unit, an infrared light emission unit and a processing unit. First image of RGB and infrared image acquisition unit fechtable external environment condition, and the first image is the synthetic image comprising RGB image information and infrared image information. Second image of RGB image acquisition unit fechtable external environment condition. Infrared light emission unit sends infrared light sources. Processing unit can be electrically connected RGB and infrared image acquisition unit, RGB image acquisition unit and infrared light emission unit. Processing unit is optionally obtained one first image depth information by the first image, or is obtained one second image depth information by the first image and the second image.
Preferably, processing unit is taken out infrared image information by the first image, and infrared image information carries out one first image processing to obtain the first image depth information; When processing unit judges that the first image depth information meets a switching condition, processing unit utilizes RGB and infrared image acquisition unit and RGB image acquisition unit to capture the first image and the second image, and taken out RGB image information by the first image, and RGB image information and the second image are carried out one second image processing, to obtain the second image depth information.
Preferably, the first image depth information comprises multiple picture element, and each picture element can have confidence index.
Preferably, when the confidence index of picture element of multiple picture elements is be more than or equal to a confidence index threshold value, picture element is an effective picture element, and when the confidence index of picture element is less than confidence index threshold value, picture element is an invalid picture element.
Preferably, when having effective picture element in multiple picture elements and accounting for the ratio of the plurality of picture element effective picture element ratio threshold value less than, processing unit judges that the first image depth meets switching condition.
Preferably, when processing unit judges that the first image depth information does not meet switching condition, lasting the first image captured is taken out infrared image information by processing unit, and infrared image information carries out the first image processing to obtain the first image depth information.
Preferably, RGB and the distance between infrared image acquisition unit and RGB image acquisition unit are less than 3 centimeters, and the distance between infrared light emission unit and RGB and infrared image acquisition unit is more than 7 centimeters.
Accompanying drawing explanation
Fig. 1 is the block chart of the image capture unit of the present invention.
Fig. 2 is the schematic diagram of the image capture unit of the first embodiment of the present invention.
Fig. 3 A is the first schematic diagram of the image capture unit of the second embodiment of the present invention.
Fig. 3 B is the second schematic diagram of the image capture unit of the second embodiment of the present invention.
Symbol description
100,150 image capture unit
10,151,221 RGBs and infrared image acquisition unit
11 first images
20,152,222 RGB image acquisition unit
21 second images
30,153,223 infrared light emission unit
31 infrared light sources
40,240 processing unit
41 switching conditions
42 first image processing
43 second image processing
44 first image depth information
45 second image depth information
46 infrared image information
47 RGB image informations
48 picture elements
D1 the first distance
D2 second distance
200 intelligent mobile phones
211 Touch Screens
Detailed description of the invention
In this use, vocabulary " and/or " comprise one or more relevant bar list of items any or all combination. When the narration prefix of " at least one " is before a component list, modify whole list element and individual elements in non-modified list.
Refer to Fig. 1, for the schematic diagram of the image capture unit of the present invention. As shown in Figure 1, a kind of image capture unit 100, suitable on an electronic product, this image capture unit 100 comprises a RGB and infrared ray (RGB/IR) image acquisition unit 10, RGB image acquisition unit 20, infrared light emission unit 30 and a processing unit 40. Wherein processing unit 40 is electrically connected RGB and infrared image acquisition unit 10, RGB image acquisition unit 20 and infrared light emission unit 30. This electronic installation can comprise an intelligent mobile phone, a tablet PC or a notebook computer, this RGB and infrared image acquisition unit 10 can be a camera lens module, the image sensor of a sensing HONGGUANG, green glow, blue light and infrared ray (RGB/IR) can be comprised in it, and RGB image acquisition unit 20 can be another camera lens module, the image sensor of a sensing HONGGUANG, green glow, blue light (RGB) in it, can be comprised.
Illustrate further, one first image 11 of RGB and infrared image acquisition unit 10 fechtable external environment condition, and one second image 21 of RGB image acquisition unit 20 fechtable external environment condition. Wherein, this first image 11 is a synthetic image, and it comprises infrared ray (IR) image information 46 and RGB (RGB) image information 47. When capturing the first image 11, processing unit 40 can first make infrared light emission unit 30 send an infrared light sources 31, and recycling RGB and infrared image acquisition unit 10 are to capture the first image 11. Then, processing unit 40 takes out infrared image information 46 from the first image 11, and infrared image information 46 carries out the first image processing 42 to produce one first image depth information 44. When processing unit 40 judges that the first image depth information 44 meets a switching condition 41, namely processing unit 40 utilizes RGB and infrared image acquisition unit 10 and RGB image acquisition unit 20 to capture the first image 11 and the second image 21 respectively, and by the first image 11 takes out RGB image information 47. Finally, the RGB image information 47 of this first image 11 and the second image 21 is utilized to carry out the second image processing 43, to produce one second image depth information 45.
Wherein this first image processing 42 can comprise a structured light image processing, and then produces a structured light degree of depth image, and the characteristic of this structured light degree of depth image is have a depth map image of a preferably accuracy; This second image processing 43 can comprise a Stereo Matching image processing, to produce to have a high-resolution depth map image.
Illustrating further, processing unit 40 utilizes a confidence index threshold value and an effective picture element ratio threshold value to judge whether the first image depth information 44 meets switching condition 41. First image depth information 44 can comprise multiple picture element 48, and each picture element 48 of multiple picture element 48 has the confidence index (confidencelevel) corresponding to its depth value. First, the judgement whether multiple picture element 48 is effective picture element is carried out. Such as, if the confidence index of picture element 48 is be more than or equal to confidence index threshold value, then processing unit 40 sets this picture element 48 is an effective picture element, that is it possesses an effective depth value; Otherwise, then setting this picture element 48 is an invalid picture element. Complete to judge this multiple picture elements 48 be whether effectively after, now carries out the judgement of the first image depth information 44 quality good or not. Such as, processing unit 40 is added up effective picture element and is accounted for the ratio of all picture elements, and calculates an effective picture element ratio, and defines image depth information quality with this effective picture element ratio. When effective picture element ratio effective picture element ratio threshold value less than of these multiple picture elements 48, representing described image depth information quality not good, processing unit 40 judges that the quality of the first image depth information 44 meets switching condition 41.
Can learn more than comprehensive, be may insure that by the image capture unit 100 of the present invention under different external environment conditions, carry out different image processing modes, to solve the problem that the accuracy of degree of depth image in known techniques is not good or is subject to interference.
Refer to Fig. 2, for the schematic diagram of the image capture unit of the first embodiment of the present invention. In the image capture unit 150 of this embodiment, the first distance d1 between RGB and infrared image acquisition unit 151 and RGB image acquisition unit 152 is smaller than 3 centimeters, and the second distance d2 between infrared light emission unit 153 and RGB and infrared image acquisition unit 151 then can more than 7 centimeters.
Refer to Fig. 3 A and Fig. 3 B, respectively the first schematic diagram of the image capture unit of the second embodiment of the present invention and the second schematic diagram. In this embodiment, electronic installation is illustrated enforcement with intelligent mobile phone 200, but is not limited. Show a front and a back side of intelligent mobile phone 200 in figure 3 a respectively. Front comprises a Touch Screen 211 and inputs for user, and the back side is provided with a RGB and infrared image acquisition unit 221, RGB image acquisition unit 222 and an infrared light emission unit 223. Quality according to the first image depth information 44 of intelligent mobile phone 200 is used as a switching condition in this embodiment. That is user can first use the RGB on intelligent mobile phone 200 and infrared image acquisition unit 221 and infrared light emission unit 223 to carry out image capture, and via, after the first image processing, obtaining the first image depth information. At this point it is possible to confidence index threshold value and effective picture element ratio threshold value by system default judge whether produced first image depth information meets switching condition. Its detailed judgment mode is similar to aforementioned, does not repeat them here.
The available application program of mobile phone of intelligent mobile phone 200, shows that the show message of this switching condition is on Touch Screen 211 in manual or automated manner. When meeting switching condition, user can pass through intelligent mobile phone 200 Touch Screen 211 with select " be " and one input instruction, now the processing unit 240 in intelligent mobile phone 200 will input instruction according to this and control RGB and infrared image acquisition unit 221 and RGB image acquisition unit 222, makes this RGB and infrared image acquisition unit 221 and RGB image acquisition unit 222 capture the image of external environment condition respectively and produce the first image and the second image. Processing unit 240 thus the first image then takes out RGB image information, itself and the second image are carried out a Stereo Matching image processing (the second image processing 43), to produce there is a high-resolution depth map image.
On the contrary, when being unsatisfactory for switching condition, as shown in Figure 3 B, now the processing unit 240 in intelligent mobile phone 200 will input instruction according to this, first control infrared light emission unit 223 and be irradiated infrared ray, then control RGB and infrared image acquisition unit 221 carries out image capture. The first image captured due to RGB and infrared image acquisition unit 221 contains infrared ray information, first image just can be taken out infrared image information by processing unit 240, and it is carried out a structured light image processing (the first image processing 42), and then produce a structured light degree of depth image. And the characteristic of this structured light degree of depth image is have a degree of depth image of a preferably accuracy.
It is noted that also the second image can be produced by RGB image acquisition unit 222 in this embodiment, but will not be processed at this second image and produce described structured light degree of depth image referenced by unit 240.
With processing unit 240, the present embodiment shows that a user interface selects for user, it can also allow the processing unit 240 backdrop procedure in intelligent mobile phone 200 automatically perform procedure above, and the driving relationship between above-mentioned user interface shown on Touch Screen 211 and processing unit 240 can be reached by general application program of mobile phone, therefore it is not described in detail at this.
As known from the above, the image capture unit of the present invention can in conjunction with Stereo Matching image processing and structured light image processing, make image capture unit can carry out image capture and its preferably image processing mode for different external environment conditions, in other words, can effectively reduce the interference factor of external environment condition, make this image capture unit shoot the coherent video meeting external environment condition most.
Specific embodiment proposed in the detailed description of preferred embodiment is only in order to the convenient technology contents that the present invention is described; but not the present invention is narrowly limited to above-described embodiment; in the situation without departing from the spirit of the present invention and appending claims; the many variations done is implemented, and comes under protection scope of the present invention.
Claims (7)
1. an image capture unit, it is adaptable on electronic product, it is characterised in that described image capture unit comprises:
RGB and infrared image acquisition unit, capture the first image of external environment condition, and wherein said first image is the synthetic image comprising RGB image information and infrared image information;
RGB image acquisition unit, captures the second image of external environment condition;
Infrared light emission unit, sends infrared light sources; And
Processing unit, it is electrically connected described RGB and infrared image acquisition unit, described RGB image acquisition unit and described infrared light emission unit, and in order to optionally to be obtained the first image depth information by described first image, or obtained the second image depth information by described first image and described second image.
2. image capture unit as claimed in claim 1, it is characterized in that, described processing unit is taken out described infrared image information by described first image, and described infrared image information is carried out the first image processing to obtain described first image depth information, when described processing unit judges that described first image depth information meets switching condition, described processing unit utilizes described RGB and infrared image acquisition unit and described RGB image acquisition unit to capture described first image and described second image, described processing unit is taken out described RGB image information by described first image, and described RGB image information and described second image are carried out the second image processing, to obtain described second image depth information.
3. image capture unit as claimed in claim 2, it is characterised in that described first image depth information comprises multiple picture element, and each the plurality of picture element has confidence index.
4. image capture unit as claimed in claim 3, it is characterized in that, when the described confidence index of a picture element of the plurality of picture element is be more than or equal to confidence index threshold value, described picture element is effective picture element, when the described confidence index of described picture element is less than described confidence index threshold value, described picture element is invalid picture element.
5. image capture unit as claimed in claim 4, it is characterized in that, when having described effective picture element in the plurality of picture element and accounting for the ratio of the plurality of picture element less than effective picture element ratio threshold value, described processing unit judges that described first image depth meets described switching condition.
6. image capture unit as claimed in claim 2, it is characterized in that, when described processing unit judges that described first image depth information does not meet described switching condition, lasting described first image captured is taken out described infrared image information by described processing unit, and described infrared image information carries out described first image processing to obtain described first image depth information.
7. image capture unit as claimed in claim 1, it is characterized in that, distance between described RGB and infrared image acquisition unit and described RGB image acquisition unit is less than 3 centimeters, and the distance between described infrared light emission unit and described RGB and infrared image acquisition unit is more than 7 centimeters.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410580159.5A CN105635718A (en) | 2014-10-27 | 2014-10-27 | Image capture device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410580159.5A CN105635718A (en) | 2014-10-27 | 2014-10-27 | Image capture device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN105635718A true CN105635718A (en) | 2016-06-01 |
Family
ID=56050152
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410580159.5A Pending CN105635718A (en) | 2014-10-27 | 2014-10-27 | Image capture device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN105635718A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107277318A (en) * | 2017-06-26 | 2017-10-20 | 苏州佳世达电通有限公司 | Image capture unit and image acquisition method |
| CN107666607A (en) * | 2016-07-28 | 2018-02-06 | 魏伟 | It is a kind of that data are obtained by mobile phone dual camera and handle the method for making 3D film sources |
| WO2019218265A1 (en) * | 2018-05-16 | 2019-11-21 | Lu Kuanyu | Multi-spectrum high-precision method for identifying objects |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102438111A (en) * | 2011-09-20 | 2012-05-02 | 天津大学 | Three-dimensional measurement chip and system based on double-array image sensor |
| CN102609927A (en) * | 2012-01-12 | 2012-07-25 | 北京理工大学 | Foggy visible light/infrared image color fusion method based on scene depth |
| CN102982530A (en) * | 2011-10-21 | 2013-03-20 | 微软公司 | Generating depth map |
| CN103081484A (en) * | 2010-09-07 | 2013-05-01 | 英特尔公司 | A 3-D camera |
| US20130163853A1 (en) * | 2011-12-23 | 2013-06-27 | Samsung Electronics Co., Ltd. | Apparatus for estimating robot position and method thereof |
| WO2013131232A1 (en) * | 2012-03-05 | 2013-09-12 | Microsoft Corporation | Generation of depth images based upon light falloff |
| WO2014035128A1 (en) * | 2012-09-03 | 2014-03-06 | Lg Innotek Co., Ltd. | Image processing system |
-
2014
- 2014-10-27 CN CN201410580159.5A patent/CN105635718A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103081484A (en) * | 2010-09-07 | 2013-05-01 | 英特尔公司 | A 3-D camera |
| CN102438111A (en) * | 2011-09-20 | 2012-05-02 | 天津大学 | Three-dimensional measurement chip and system based on double-array image sensor |
| CN102982530A (en) * | 2011-10-21 | 2013-03-20 | 微软公司 | Generating depth map |
| US20130163853A1 (en) * | 2011-12-23 | 2013-06-27 | Samsung Electronics Co., Ltd. | Apparatus for estimating robot position and method thereof |
| CN102609927A (en) * | 2012-01-12 | 2012-07-25 | 北京理工大学 | Foggy visible light/infrared image color fusion method based on scene depth |
| WO2013131232A1 (en) * | 2012-03-05 | 2013-09-12 | Microsoft Corporation | Generation of depth images based upon light falloff |
| WO2014035128A1 (en) * | 2012-09-03 | 2014-03-06 | Lg Innotek Co., Ltd. | Image processing system |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN107666607A (en) * | 2016-07-28 | 2018-02-06 | 魏伟 | It is a kind of that data are obtained by mobile phone dual camera and handle the method for making 3D film sources |
| CN107277318A (en) * | 2017-06-26 | 2017-10-20 | 苏州佳世达电通有限公司 | Image capture unit and image acquisition method |
| WO2019218265A1 (en) * | 2018-05-16 | 2019-11-21 | Lu Kuanyu | Multi-spectrum high-precision method for identifying objects |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8913156B2 (en) | Capturing apparatus and method of capturing image | |
| US20170054960A1 (en) | Camera color trmperature compensation system and smart terminal employing same | |
| US9813635B2 (en) | Method and apparatus for auto exposure value detection for high dynamic range imaging | |
| CN106060419B (en) | A kind of photographic method and mobile terminal | |
| CN105657272A (en) | Terminal equipment and photographing method thereof | |
| CN107635101A (en) | Image pickup method, device, storage medium and electronic equipment | |
| US10447940B2 (en) | Photographing apparatus using multiple exposure sensor and photographing method thereof | |
| CN102957934B (en) | Display processing method, device and display device | |
| CN102467235A (en) | Method for user gesture recognition in multimedia device and multimedia device thereof | |
| CN102369723A (en) | Auto exposure method and device, and imaging device | |
| CN102959970A (en) | Device, method, and program for determining obstacle within imaging range when capturing images displayed in three-dimensional view | |
| CN105631797A (en) | Watermarking method and device | |
| CN106131441A (en) | Photographic method and device, electronic equipment | |
| CN113014803A (en) | Filter adding method and device and electronic equipment | |
| CN104823437A (en) | Picture processing method and device | |
| CN103297675A (en) | Image capture method and relative image capture system | |
| CN105635718A (en) | Image capture device | |
| CN102088539A (en) | Method and system for evaluating pre-shot picture quality | |
| CN105791790A (en) | Image processing method and apparatus | |
| CN105426068A (en) | Photographing control system and photographing method | |
| KR101516487B1 (en) | Image processing device using difference camera | |
| CN112887601B (en) | Shooting method and device and electronic equipment | |
| CN114500837B (en) | Shooting method and device and electronic equipment | |
| CN107816841A (en) | The detecting system and its detection method of food species inside refrigerator compartment | |
| CN112637588B (en) | Method and device for detecting contamination of camera and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20160601 |
|
| WD01 | Invention patent application deemed withdrawn after publication |