CN104917938A - Depth camera device for mobile communication device - Google Patents
Depth camera device for mobile communication device Download PDFInfo
- Publication number
- CN104917938A CN104917938A CN201410095433.XA CN201410095433A CN104917938A CN 104917938 A CN104917938 A CN 104917938A CN 201410095433 A CN201410095433 A CN 201410095433A CN 104917938 A CN104917938 A CN 104917938A
- Authority
- CN
- China
- Prior art keywords
- light
- infrared
- image
- reflection film
- camera device
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The invention provides a depth camera device used for a mobile communication device. The depth camera device comprises an infrared emitter module which is configured to emit infrared light in a first wavelength range; and an infrared camera module which is configured to obtain image light and generate a depth image. The infrared camera module comprises an imaging lens which is configured to capture the image light, a first antireflection film being formed on the surface of the imaging lens, wherein the first antireflection film is used for enhancing transmitting intensity of the light in the first wavelength range; and a black-and-white image sensor which is configured to be aligned with the imaging lens and receive the image light from the imaging lens directly without passing through any light filter, and the black-and-white image sensor responds to the full-waveband image light directly received from the imaging lens and generates electrical signals. The depth camera device can improve photosensitive performance of the image sensor on the infrared light, saves power consumption, accelerates data acquisition speed and simplifies processing flow.
Description
Technical field
The present invention relates to a kind of depth camera device, more particularly, relate to a kind of depth camera device for mobile communication equipment.
Background technology
At present, machine vision quietly proceeds to consumer electronics market from Industry Control, and demand that is miniaturized and low-power consumption result in hardware device type selecting, and the generating laser usually cannot selecting large power consumption is to meet user to the clear projection of structure light intensity at a distance; Also the camera of large scale sensitive chip cannot be integrated with to meet comparatively high photosensitivity energy, comparatively great dynamic range, and finer and smoother gray-level characteristic, thus the parsing precision under industrial control field hardware condition cannot be reached.But the Consumer's Experience in order to reach, the application scenarios in consumer electronics field is also very harsh to the requirement of precision.
Usually, depth camera device is by infrared photography head unit and the laser emitter modules formation with diffraction optical element (diffractive optical element, DOE).In a mobile communication device, infrared eye usually adopts general cell-phone camera head module to realize, and by changing the plated film specification of camera lens, realizes the shielding to visible ray and the perception to infrared light.But the photographing module of mobile communication equipment was taken as the leading factor with the application demand of video recording of taking pictures originally, was for target carries out imaging with the characteristic of human eye vision always always.But, now, under the prerequisite of mobile communication equipment as hardware foundation, how can the perception infrared transmitter pattern be incident upon on different depth object be the topmost target realizing depth camera device in current mobile communications equipment better.
As can be seen here, as how minimum cost changes the photographing module of existing mobile communication equipment, carry out perception infrared laser better and be incident upon the pattern on different depth object, the photosensitive property of each pixel to infrared light improving the imageing sensor of mobile communication equipment is problem demanding prompt solution in prior art.
Summary of the invention
In order to solve above-mentioned technical problem of the prior art, according to an aspect of the present invention, a kind of depth camera device is provided, for a mobile communication equipment, described depth camera device comprises: infrared transmitter module, be configured the infrared light launching first wave length scope, and infrared photography module, be configured to obtain image light and generating depth map picture, described infrared photography module comprises further: imaging len, be configured to catch image light, and described imaging lens surface is formed with the first anti-reflection film, described first anti-reflection film is for strengthening the intensity in transmission of the light of first wave length scope, and black and white image transducer, be configured with described imaging len optical alignment and directly receive image light and not via any optical filtering, described black and white image transducer produces the signal of telecommunication in response to the full wave light of the image directly received from described imaging len from described imaging len.
In addition, according to one embodiment of present invention, described infrared transmitter module also comprises diffraction optical element, and the infrared light be configured infrared transmitter module is launched is shaped to diffraction pattern pattern.
In addition, according to one embodiment of present invention, described black and white image sensor surface is also formed with the second anti-reflection film, and described second anti-reflection film improves described imageing sensor to the only full wave light of second wave length scope described in the photosensitive property of the light of second wave length scope or infrared light by the intensity in transmission of the light strengthening second wave length scope.
In addition, according to one embodiment of present invention, described first anti-reflection film is also for stoping the light of visible wavelength to pass through.
In addition, according to one embodiment of present invention, described imageing sensor is complementary metal oxide semiconductors (CMOS) (Complementary Metal Oxide Semiconductor, COMS) imageing sensor.
According to a further aspect in the invention, a kind of mobile communication equipment is provided, comprise depth camera device, described depth camera device comprises: infrared transmitter module, be configured the infrared light launching first wave length scope, and infrared photography module, be configured to obtain image light and generating depth map picture, described infrared photography module comprises further: imaging len, be configured to catch image light, and described imaging lens surface is formed with the first anti-reflection film, described first anti-reflection film is for strengthening the intensity in transmission of the light of first wave length scope; And black and white image transducer, be configured with described imaging len optical alignment and directly receive image light and not via any optical filtering, described black and white image transducer produces the signal of telecommunication in response to the full wave light of the image directly received from described imaging len from described imaging len.
In addition, according to one embodiment of present invention, described infrared transmitter module also comprises diffraction optical element, and the infrared light be configured infrared transmitter module is launched is shaped to diffraction pattern pattern.
In addition, according to one embodiment of present invention, described black and white image sensor surface is also formed with the second anti-reflection film, and described second anti-reflection film improves described imageing sensor to the only full wave light of second wave length scope described in the photosensitive property of the light of second wave length scope or infrared light by the intensity in transmission of the light strengthening second wave length scope.
In addition, according to one embodiment of present invention, described first anti-reflection film is also for stoping the light of visible wavelength to pass through.
In addition, according to one embodiment of present invention, described imageing sensor is complementary metal oxide semiconductors (CMOS) (Complementary Metal Oxide Semiconductor, COMS) imageing sensor.
As can be seen here, because depth camera device provided by the invention and the mobile communication equipment comprising this depth camera device have the black and white image transducer eliminating redgreenblue filter, therefore improve the photosensitive property of imageing sensor to infrared light, thus improve the image quality according to depth camera device of the present invention.Simultaneously, also just because of have employed this black and white image transducer, eliminate the ISP process of initial RGB data to yuv data, the chip design of Hardware I SP can be saved thus or reduce the CPU process of software I SP, and save power consumption, accelerate data acquisition speed, reduced data handling process, accelerate the speed that picture depth is recovered, the Operational Figure Of Merit of user is also significantly promoted simultaneously.
It being understood that general description above and detailed description below both exemplary, and intention is to provide further illustrating of claimed technology.
Accompanying drawing explanation
In order to be illustrated more clearly in the technical scheme of the embodiment of the present invention, be briefly described to the accompanying drawing used required in embodiment or description of the prior art below, apparently, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skill in the art, under the prerequisite not paying creative work, other accompanying drawing can also be obtained according to these accompanying drawings:
Fig. 1 shows the structural representation of the depth camera device 100 for a mobile communication equipment according to an embodiment of the invention;
Fig. 2 shows the pixel of each monochrome of the imageing sensor with red-green-blue color filter to the response curve of the incident light of different wave length;
Fig. 3 shows the exemplary block diagram of the mobile communication equipment 300 comprising depth camera device 100 according to the embodiment of the present invention.
Embodiment
Hereinafter, the preferred embodiments of the present invention are described in detail with reference to accompanying drawing.Note, in the present description and drawings, there is substantially the same step and represent with the identical Reference numeral of element, and will be omitted the repetition of explanation of these steps and element.
Mentioned in the whole text " embodiment " or " embodiment " of this specification means and to be contained at least one described embodiment in conjunction with special characteristic, structure or the characteristic described by described embodiment.Therefore, the appearance of phrase " in one embodiment " or " in one embodiment " may not all refer to same embodiment in the description.In addition, described special characteristic, structure or characteristic can any applicable mode be combined in one or more embodiments.
Below, with reference to Fig. 1, depth camera device according to an embodiment of the invention is described.Fig. 1 shows the structural representation of the depth camera device 100 for a mobile communication equipment according to an embodiment of the invention, and as shown in the figure, depth camera device 100 can comprise: infrared transmitter module 110 and infrared photography module 120.
Particularly, infrared transmitter module 110, can be configured the infrared light launching first wave length scope.Usually, infrared light belongs to invisible light, and wave-length coverage is 780nm-10
6nm, its medium wavelength 780nm-1500nm is called near infrared light, and wavelength 150nm-30000nm is mid-infrared light, and mid-infrared light is thermal radiation mainly.30000-10
6nm is far red light, and the infrared light of the present invention's application is near infrared light, that is, the infrared transmitter module 110 of depth camera device 100 is configured the infrared light of the first wave length scope of launching is near infrared light.In addition, in one embodiment, infrared transmitter module 110 can comprise Infrared laser emission device, and described Infrared laser emission device can be configured to launch near-infrared laser.In another embodiment of the present invention, infrared transmitter module 110 can comprise infrarede emitting diode (LED) equipment, and described infrarede emitting diode (LED) equipment can be configured to launch near infrared light.
In addition, in one embodiment of the invention, described infrared transmitter module 110 can also comprise diffraction optical element 111, and described diffraction optical element 111 can be configured and the infrared light that infrared transmitter module 110 is launched is shaped to specific diffraction pattern pattern.When diffraction pattern patterned illumination is to rough object or can form random diffraction speckle after penetrating frosted glass, these speckles have the randomness of height, and can along with the different changing patterns of distance.That is, in space, the speckle pattern at any two places is all different.As long as stamp such structured light in space, whole space is just all marked, and spot pattern can change pattern along with the distance difference of imaging object, marks space when diffraction speckle is irradiated to whole space.Such as, as shown in Figure 1, for the imaging object 130 in imaging space, by the speckle pattern above recognition object 130, the position of imaging object 130 can just be obtained.In addition, the speckle pattern recording whole space in advance is also needed, to do the demarcation of light source.The method of demarcating is: every a segment distance, get reference planes, the speckle pattern in reference planes is recorded.Such as, suppose that the locational space of imaging object is the scope of distance 1 meter to 4 meters, reference planes can be got every 10cm, so can obtain 30 width speckle images through demarcation.
Then, infrared photography module 120 can be configured to obtain the image light in whole imaging object space and generating depth map picture.Particularly, infrared photography module 120 can be configured the infrared speckle image taking scene to be measured, the 30 width reference pictures that this width image and we preserve are done degree of correlation computing successively, we can obtain 30 width degree of correlation images like this, and in space, have the position that object exists, degree of correlation image will demonstrate peak value.These peak values are stacked from level to level, then passes through some interpolation, the depth image of the object in imaging space can be obtained.Infrared photography module 120 can further include: imaging len 121 and black and white image transducer 122.Imaging len 121 is configured the image light of catching whole scene, and described imaging len 121 surface can be formed with the first anti-reflection film, and described first anti-reflection film is for strengthening the intensity in transmission of the light of first wave length scope.Black and white image transducer 122 can be configured with described imaging len optical alignment and directly receive image light and not via any optical filtering, black and white image transducer 122 can produce the signal of telecommunication in response to the full wave light of the image directly received from described imaging len from described imaging len.
Received the free token of the structured light of the infrared light formation that above-mentioned infrared transmitter module 110 is launched by infrared photography module 120, and obtain space length by analyzing spot pattern, thus generating depth map picture.Particularly, infrared photography module 120 can comprise imaging len 121 and black and white image transducer 122.Wherein, imaging len 121, be configured to catch image light, and described image light is focused on black and white image transducer 122, imaging len 121 surface can be formed with the first anti-reflection film, described first anti-reflection film is for strengthening the intensity in transmission of the near infrared light of first wave length scope, namely described first anti-reflection film may be used for the transmission strengthening the infrared light conformed to the laser beam centre wavelength that generating laser sends, simultaneously, described first anti-reflection film can also be used for stoping the light of visible wavelength to pass through, visible ray from object is reflected at the first anti-reflection film place on imaging len 121 surface, that is, first anti-reflection film on described imaging len 121 surface can stop visible ray to pass through while the transmission strengthening infrared light, thus amplitude peak ground improves the transmission proportion of infrared light, reduce visible ray to the interference of the infrared photosensitive property of photoreceptor.
Usually, imageing sensor in mobile communication equipment can be complementary metal oxide semiconductors (CMOS) (Complementary Metal Oxide Semiconductor, COMS) imageing sensor or charge coupled device (Charge-coupled Device, CCD) imageing sensor.Imageing sensor comprises to primaries (such as usually, red light, green light and blue light) responsive redgreenblue optical wavelength filter, the pixel detection of transducer is by the light of redgreenblue filter and luminous intensity is transformed into the signal of telecommunication, thus by imageing sensor, optical color image conversion is become electronic color image.Usually, the camera module in mobile communication equipment is taken as the leading factor with the application demand of video recording of taking pictures always, is for target carries out imaging with the characteristic of human eye vision always.But, in the present invention, be under the prerequisite of target with depth camera, need the imageing sensor in the camera module in mobile communication equipment better perception infrared transmitter module be incident upon the infrared speckle pattern on different depth object.Therefore, in order to realize above-mentioned target, the black and white image transducer 122 that depth camera device 100 according to the present invention uses is redesigned by the image sensing device in the camera module to existing mobile communication equipment, original filter covering the redgreenblue optical wavelength on sensitive component surface is removed, thus the photobehavior of total transmissivity wave band can be realized.Namely adopt the image sensor design of black and white version to replace the honorable color image sensor design of original redgreenblue, carry out module group assembling.
In one embodiment of the invention, black and white image transducer 122 surface is also formed with the second anti-reflection film, described second anti-reflection film improves the photosensitive property of the light of described black and white image transducer 122 pairs of second wave length scopes by the intensity in transmission of the light strengthening second wave length scope, the only full wave light of described second wave length scope or near infrared light.Namely, in camera lens coating designs, the plated film scheme that enhancing and laser center wavelength band lead to the infrared transmission conformed to is adopted to carry out plated film, the anti-reflection film strengthening transmission of near infra red light rate is further formed on the surface of black and white image transducer 122, thus the photosensitive property of black and white image transducer 122 pairs of infrared lights can be further improved, realize the high precision movement communication equipment infrared camera module of black and white version.
In traditional red-green-blue color imageing sensor, due to the filter effect of redgreenblue wavelength, the pixel of each monochrome can decline to some extent to needing the photosensitive degree of incident infrared band light (wavelength is approximately the near infrared light in about 850nm scope), and Fig. 2 shows the pixel of each monochrome of the imageing sensor with red-green-blue color filter to the response curve of the incident light of different wave length.As shown in Figure 2, after red-green-blue color filter filters to incident light, the response of the infrared light of the near infrared wavelength region that depth camera device uses is greatly reduced, and has therefore had a strong impact on imageing sensor to the reception of the photobehavior of infrared light and infrared photography module 120 pairs of infrared light speckle pattern and imaging.Therefore, if removed by the filter of the redgreenblue wavelength on the original CMOS of covering sensitive component surface, in the image sensor, the photosensitive property of each pixel near infrared light can be improved, thus improve the image quality of depth camera device.
And each pixel of traditional image three-colo(u)r transducer obtains R, G, B component respectively, the initial RGB data combined thus, cannot imaging be directly used in and the algorithm now in depth camera cannot be realized.Initial RGB data all will through complicated ISP(Image Signal Process, picture signal process) computing, generate color image and carry out preview, take pictures and record a video.But for the algorithm principle of structured light depth recovery, do not need chromatic component, only need to resolve the luminance component Y of yuv space.In this case, in the conversion of original RGB to YUV to Y, two middle step conversions all can produce information dropout.Existing handset image transducer can use the analog to digital converter (ADC) of 10 bits substantially, and a lot of imageing sensor even can reach the precision of 12 bits or 16 bits.If but also finally only analyze Y-signal component, the highest precision that can only reach 8 bits through ISP conversion.Like this in effective depth bounds, maximum degree of depth is expressed only has 2
8individual, for long distance high accuracy depth gesture identification, this is far from being enough.And if the filter of the redgreenblue wavelength on the original CMOS of covering sensitive component surface is removed, the initial data that new black and white version imageing sensor is photosensitive obtained, just directly can use as the luminance component of each pixel.The precision of such imageing sensor can rise to 2
10even 2
16, this precision for depth recovery can have greatly improved.Simultaneously, also just because of have employed this black and white image transducer, eliminate the ISP process of initial RGB data to yuv data, the chip design of Hardware I SP can be saved like this or reduce the CPU process of software I SP, and save power consumption, accelerate image data acquisition speed, simplified image flow chart of data processing, accelerate the speed of depth recovery, the Operational Figure Of Merit of user also can significantly promote simultaneously.
In addition, the present invention additionally provides a kind of mobile communication equipment 300 on the other hand, Fig. 3 shows the exemplary block diagram of the mobile communication equipment 300 comprising depth camera device 100 according to the embodiment of the present invention, mobile communication equipment 300 comprises depth camera device 100 provided by the invention, and described depth camera device 100 comprises: infrared transmitter module 110 and infrared photography module 120.
Particularly, the infrared transmitter module 110 of mobile communication equipment 300, can be configured the infrared light launching first wave length scope.Usually, infrared light belongs to invisible light, and wave-length coverage is 780nm-10
- 6nm, its medium wavelength 780nm-1500nm is called near infrared light, and wavelength 150nm-30000nm is mid-infrared light, and mid-infrared light is thermal radiation mainly.30000-10
6nm is far red light, and the infrared light of the present invention's application is near infrared light, that is, the infrared transmitter module 110 of mobile communication equipment 300 is configured the infrared light of the first wave length scope of launching is near infrared light.In addition, in one embodiment, infrared transmitter module 110 can comprise Infrared laser emission device, and described Infrared laser emission device can be configured to launch near-infrared laser.In another embodiment of the present invention, infrared transmitter module 110 can comprise infrarede emitting diode (LED) equipment, and described infrarede emitting diode (LED) equipment can be configured to launch near infrared light.
In addition, in one embodiment of the invention, the infrared transmitter module 110 of described mobile communication equipment 300 can also comprise diffraction optical element 111, and described diffraction optical element 111 can be configured and the infrared light that infrared transmitter module 110 is launched is shaped to specific diffraction pattern pattern.When diffraction pattern patterned illumination is to rough object or can form random diffraction speckle after penetrating frosted glass, these speckles have the randomness of height, and can along with the different changing patterns of distance.That is, in space, the speckle pattern at any two places is all different.As long as stamp such structured light in space, whole space is just all marked, and spot pattern can change pattern along with the distance difference of imaging object, marks space when diffraction speckle is irradiated to whole space.Such as, as shown in Figure 1, for the imaging object 130 in this imaging space, by the speckle pattern above recognition object 130, the position of imaging object 130 can just be obtained.In addition, also need in advance the speckle pattern in whole space all to be recorded, to do the demarcation of light source.The method of demarcating is: every a segment distance, get reference planes, the speckle pattern in reference planes is recorded.Such as, suppose that the locational space of imaging object is the scope of distance 1 meter to 4 meters, reference planes can be got every 10cm, so can obtain 30 width speckle images through demarcation.
Then, the infrared photography module 120 of mobile communication equipment 300 can be configured to obtain the image light in whole imaging object space and generating depth map picture.Particularly, the infrared photography module 120 of mobile communication equipment 300 can be configured the infrared speckle image taking scene to be measured, this width image and the 30 width reference pictures preserved are done degree of correlation computing successively, 30 width degree of correlation images can be obtained like this, and in space, have the position that object exists, degree of correlation image will demonstrate peak value.These peak values are stacked from level to level, then passes through some interpolation, the depth image of the object in imaging space can be obtained.The infrared photography module 120 of mobile communication equipment 300 can further include: imaging len 121 and black and white image transducer 122.Imaging len 121 is configured the image light of catching whole scene, and described imaging len 121 surface can be formed with the first anti-reflection film, and described first anti-reflection film is for strengthening the intensity in transmission of the light of first wave length scope.Black and white image transducer 122 can be configured with described imaging len optical alignment and directly receive image light and not via any optical filtering, black and white image transducer 122 can produce the signal of telecommunication in response to the full wave light of the image directly received from described imaging len from described imaging len.
Particularly, the free token of the structured light of the infrared light formation that above-mentioned infrared transmitter module 110 is launched can be received by the infrared photography module 120 of mobile communication equipment 300, and obtain space length by analyzing spot pattern, thus generating depth map picture.More specifically, the infrared photography module 120 of mobile communication equipment 300 can comprise imaging len 121 and black and white image transducer 122.Wherein, imaging len 121, be configured to catch image light, and described image light is focused on black and white image transducer 122, imaging len 121 surface can be formed with the first anti-reflection film, described first anti-reflection film is for strengthening the intensity in transmission of the near infrared light of first wave length scope, namely described first anti-reflection film may be used for the transmission strengthening the infrared light conformed to the laser beam centre wavelength that generating laser sends, simultaneously, described first anti-reflection film can also be used for stoping the light of visible wavelength to pass through, visible ray from object is reflected at the first anti-reflection film place on imaging len 121 surface, that is, first anti-reflection film on described imaging len 121 surface can stop visible ray to pass through while the transmission strengthening infrared light, thus amplitude peak ground improves the transmission proportion of infrared light, reduce visible ray to the interference of the infrared photosensitive property of photoreceptor.
Usually, imageing sensor in mobile communication equipment can be complementary metal oxide semiconductors (CMOS) (Complementary Metal Oxide Semiconductor, COMS) imageing sensor or charge coupled device (Charge-coupled Device, CCD) imageing sensor.Imageing sensor comprises to primaries (such as usually, red light, green light and blue light) responsive redgreenblue optical wavelength filter, the pixel detection of transducer is by the light of redgreenblue filter and luminous intensity is transformed into the signal of telecommunication, thus by imageing sensor, optical color image conversion is become electronic color image.Usually, the camera module in mobile communication equipment is taken as the leading factor with the application demand of video recording of taking pictures always, is for target carries out imaging with the characteristic of human eye vision always.But, in the present invention, be under the prerequisite of target with depth camera, need the imageing sensor in the camera module in mobile communication equipment better perception infrared transmitter module be incident upon the infrared speckle pattern on different depth object.Therefore, in order to realize above-mentioned target, the black and white image transducer 122 that mobile communication equipment 300 according to the present invention uses is redesigned by the image sensing device in the camera module to existing mobile communication equipment, original filter covering the redgreenblue optical wavelength on sensitive component surface is removed, thus the photobehavior of total transmissivity wave band can be realized.Namely adopt the image sensor design of black and white version to replace the honorable color image sensor design of original redgreenblue, carry out module group assembling.
In one embodiment of the invention, black and white image transducer 122 surface of mobile communication equipment 300 can also be formed with the second anti-reflection film, described second anti-reflection film improves the photosensitive property of the light of described black and white image transducer 122 pairs of second wave length scopes by the intensity in transmission of the light strengthening second wave length scope, the only full wave light of described second wave length scope or near infrared light.Namely, in camera lens coating designs, employing is led to laser center wavelength band the infrared plated film scheme conformed to and is carried out plated film, the anti-reflection film strengthening transmission of near infra red light rate is further formed on the surface of black and white image transducer 122, thus the photosensitive property of black and white image transducer 122 pairs of infrared lights can be further improved, realize the high precision movement communication equipment infrared camera module of black and white version.
In the red-green-blue color imageing sensor of traditional mobile communication equipment, due to the filter effect of redgreenblue wavelength, the pixel of each monochrome can decline to some extent to needing the photosensitive degree of incident infrared band light (wavelength is approximately the near infrared light in about 850nm scope), and Fig. 2 shows the pixel of each monochrome of the imageing sensor with red-green-blue color filter to the response curve of the incident light of different wave length.As shown in Figure 2, in traditional mobile communication equipment, after red-green-blue color filter filters to incident light, the response curve value of imageing sensor to the infrared light of near infrared wavelength region is greatly reduced, and has therefore had a strong impact on imageing sensor to the photobehavior of infrared light and to the reception of infrared light speckle pattern and imaging.Therefore, if removed by the filter of the redgreenblue wavelength on the original CMOS of covering sensitive component surface, in the image sensor, the photosensitive property of each pixel near infrared light can be improved, thus improve the image quality of depth camera device.
And each pixel of the image three-colo(u)r transducer in traditional mobile communication equipment obtains R, G, B component respectively, the initial RGB data combined thus, cannot imaging be directly used in and the algorithm now in depth camera cannot be realized.Initial RGB data all will through complicated ISP(Image Signal Process, picture signal process) computing, generate color image and carry out preview, take pictures and record a video.But for the algorithm principle of structured light depth recovery, do not need chromatic component, only need to resolve the luminance component Y of yuv space.In this case, in the conversion of original RGB to YUV to Y, two middle step conversions all can produce information dropout.Existing handset image transducer can use the analog to digital converter (ADC) of 10 bits substantially, and a lot of imageing sensor even can reach the precision of 12 bits or 16 bits.If but also finally only analyze Y-signal component, the highest precision that can only reach 8 bits through ISP conversion.Like this in effective depth bounds, maximum degree of depth is expressed only has 2
8individual, for long distance high accuracy depth gesture identification, this is far from being enough.And if the filter of the redgreenblue wavelength on the original CMOS of covering sensitive component surface is removed, the initial data that new black and white version imageing sensor is photosensitive obtained, just directly can use as the luminance component of each pixel.The precision of such imageing sensor can rise to 2
10even 2
16, this precision for depth recovery can have greatly improved.Simultaneously, also just because of have employed this black and white image transducer, eliminate the ISP process of initial RGB data to yuv data, the chip design of Hardware I SP can be saved thus or reduce the CPU process of software I SP, and save power consumption, accelerate image data acquisition speed, simplified image flow chart of data processing, accelerate the speed of depth recovery, the Operational Figure Of Merit of user is also significantly promoted simultaneously.
The theme of the such as concrete structure and element that define in the description is provided with helping Integrated Understanding embodiments of the invention, and they are only exemplary.Further, for knowing and for simplicity, the description for known function and structure being omitted.It should be appreciated by those skilled in the art that and can be dependent on design requirement and other factors carries out various amendment, combination, incorporating aspects and replacement to the present invention, as long as they are in the scope of appended claims and equivalent thereof.
Claims (10)
1. a depth camera device, for a mobile communication equipment, described depth camera device comprises:
Infrared transmitter module, is configured the infrared light launching first wave length scope, and
Infrared photography module, is configured to obtain image light and generating depth map picture, and described infrared photography module comprises further:
Imaging len, is configured to catch image light, and described imaging lens surface is formed with the first anti-reflection film, and described first anti-reflection film is for strengthening the intensity in transmission of the light of first wave length scope; And
Black and white image transducer, be configured with described imaging len optical alignment and directly receive image light and not via any optical filtering, described black and white image transducer produces the signal of telecommunication in response to the full wave light of the image directly received from described imaging len from described imaging len.
2. depth camera device as claimed in claim 1, wherein, described infrared transmitter module also comprises diffraction optical element, and the infrared light be configured infrared transmitter module is launched is shaped to diffraction pattern pattern.
3. depth camera device as claimed in claim 2, wherein, described black and white image sensor surface is also formed with the second anti-reflection film, described second anti-reflection film improves the photosensitive property of described imageing sensor to the light of second wave length scope, the only full wave light of described second wave length scope or infrared light by the intensity in transmission of the light strengthening second wave length scope.
4. depth camera device as claimed in claim 3, wherein, described first anti-reflection film is also for stoping the light of visible wavelength to pass through.
5. the depth camera device according to any one of claim 1-4, wherein, described imageing sensor is complementary metal oxide semiconductors (CMOS) (Complementary Metal Oxide Semiconductor, COMS) imageing sensor.
6. a mobile communication equipment, comprises depth camera device, and described depth camera device comprises:
Infrared transmitter module, is configured the infrared light launching first wave length scope, and
Infrared photography module, is configured to obtain image light and generating depth map picture, and described infrared photography module comprises further:
Imaging len, is configured to catch image light, and described imaging lens surface is formed with the first anti-reflection film, and described first anti-reflection film is for strengthening the intensity in transmission of the light of first wave length scope; And
Black and white image transducer, be configured with described imaging len optical alignment and directly receive image light and not via any optical filtering, described black and white image transducer produces the signal of telecommunication in response to the full wave light of the image directly received from described imaging len from described imaging len.
7. mobile communication equipment as claimed in claim 6, wherein, described infrared transmitter module also comprises diffraction optical element, and the infrared light be configured infrared transmitter module is launched is shaped to diffraction pattern pattern.
8. mobile communication equipment as claimed in claim 7, wherein, described black and white image sensor surface is also formed with the second anti-reflection film, described second anti-reflection film improves the photosensitive property of described imageing sensor to the light of second wave length scope, the only full wave light of described second wave length scope or infrared light by the intensity in transmission of the light strengthening second wave length scope.
9. mobile communication equipment as claimed in claim 8, wherein, described first anti-reflection film is also for stoping the light of visible wavelength to pass through.
10. the mobile communication equipment according to any one of claim 6-9, wherein, described imageing sensor is complementary metal oxide semiconductors (CMOS) (Complementary Metal Oxide Semiconductor, COMS) imageing sensor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410095433.XA CN104917938B (en) | 2014-03-14 | 2014-03-14 | Depth camera device for mobile communication equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410095433.XA CN104917938B (en) | 2014-03-14 | 2014-03-14 | Depth camera device for mobile communication equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104917938A true CN104917938A (en) | 2015-09-16 |
| CN104917938B CN104917938B (en) | 2018-08-31 |
Family
ID=54086611
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410095433.XA Active CN104917938B (en) | 2014-03-14 | 2014-03-14 | Depth camera device for mobile communication equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104917938B (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105631438A (en) * | 2016-02-16 | 2016-06-01 | 格科微电子（上海）有限公司 | Optical fingerprint recognition device |
| CN106934394A (en) * | 2017-03-09 | 2017-07-07 | 深圳奥比中光科技有限公司 | Double-wavelength images acquisition system and method |
| CN107707831A (en) * | 2017-09-11 | 2018-02-16 | 广东欧珀移动通信有限公司 | Image processing method and device, electronic installation and computer-readable recording medium |
| CN108542497A (en) * | 2018-03-06 | 2018-09-18 | 南京生命源医药实业有限公司 | Operation navigation device |
| US11503228B2 (en) | 2017-09-11 | 2022-11-15 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing method, image processing apparatus and computer readable storage medium |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100265316A1 (en) * | 2009-04-16 | 2010-10-21 | Primesense Ltd. | Three-dimensional mapping and imaging |
| CN103561257A (en) * | 2013-11-01 | 2014-02-05 | 北京航空航天大学 | Interference-free light-encoded depth extraction method based on depth reference planes |
| CN103581653A (en) * | 2013-11-01 | 2014-02-12 | 北京航空航天大学 | Method for non-interference depth extraction of optical coding depth camera system according to luminous intensity modulation |
| US20140371941A1 (en) * | 2013-06-18 | 2014-12-18 | The Regents Of The University Of Colorado, A Body Corporate | Software-defined energy communication networks |
-
2014
- 2014-03-14 CN CN201410095433.XA patent/CN104917938B/en active Active
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100265316A1 (en) * | 2009-04-16 | 2010-10-21 | Primesense Ltd. | Three-dimensional mapping and imaging |
| US20140371941A1 (en) * | 2013-06-18 | 2014-12-18 | The Regents Of The University Of Colorado, A Body Corporate | Software-defined energy communication networks |
| CN103561257A (en) * | 2013-11-01 | 2014-02-05 | 北京航空航天大学 | Interference-free light-encoded depth extraction method based on depth reference planes |
| CN103581653A (en) * | 2013-11-01 | 2014-02-12 | 北京航空航天大学 | Method for non-interference depth extraction of optical coding depth camera system according to luminous intensity modulation |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105631438A (en) * | 2016-02-16 | 2016-06-01 | 格科微电子（上海）有限公司 | Optical fingerprint recognition device |
| CN106934394A (en) * | 2017-03-09 | 2017-07-07 | 深圳奥比中光科技有限公司 | Double-wavelength images acquisition system and method |
| CN106934394B (en) * | 2017-03-09 | 2024-01-19 | 奥比中光科技集团股份有限公司 | Dual wavelength image acquisition system and method |
| CN107707831A (en) * | 2017-09-11 | 2018-02-16 | 广东欧珀移动通信有限公司 | Image processing method and device, electronic installation and computer-readable recording medium |
| US11503228B2 (en) | 2017-09-11 | 2022-11-15 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing method, image processing apparatus and computer readable storage medium |
| US11516412B2 (en) | 2017-09-11 | 2022-11-29 | Guangdong Oppo Mobile Telecommunications Corp., Ltd. | Image processing method, image processing apparatus and electronic device |
| CN108542497A (en) * | 2018-03-06 | 2018-09-18 | 南京生命源医药实业有限公司 | Operation navigation device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104917938B (en) | 2018-08-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210014429A1 (en) | Image sensor modules including primary high-resolution imagers and secondary imagers | |
| US8497897B2 (en) | Image capture using luminance and chrominance sensors | |
| JP5315574B2 (en) | Imaging device | |
| CN110298874B (en) | Method and apparatus for capturing images and related three-dimensional models based on a single image sensor and structured light patterns in the visible spectrum | |
| CN104917938A (en) | Depth camera device for mobile communication device | |
| US20110299857A1 (en) | Transmission device, transmission method, reception device, reception method, communication system, and communication method | |
| US11818462B2 (en) | Phase detection autofocus sensor apparatus and method for depth sensing | |
| JP6653128B2 (en) | Visible light communication system | |
| CN108965721A (en) | The control method and device of camera module, electronic equipment | |
| US9392187B2 (en) | Image generating apparatus including digital iris and method and non-transitory recordable medium | |
| US20150138325A1 (en) | Camera integrated with light source | |
| CN109784120B (en) | Optical code generation device, light sensation data interaction method and image acquisition device | |
| KR102590900B1 (en) | Image processing apparatus and image processing method | |
| CN111953417A (en) | Indoor visible light communication automatic alignment system and method | |
| WO2023279289A1 (en) | Processing image data using multi-point depth sensing system information | |
| KR20200091197A (en) | Camera device and autofocusing method of the same | |
| WO2021059735A1 (en) | Image processing device, electronic apparatus, image processing method, and program | |
| CN112672021B (en) | Language identification method and device and electronic equipment | |
| CN106713725A (en) | Shooting system capable of splitting double light waves | |
| CN106534704A (en) | Infrared technology-based photographing method and apparatus of terminal device | |
| KR20200023927A (en) | Image processing apparatus and image processing method | |
| US11438486B2 (en) | 3D active depth sensing with laser pulse train bursts and a gated sensor | |
| CN214335963U (en) | Learning machine | |
| US20240070886A1 (en) | Mixed-mode depth imaging | |
| US11582436B2 (en) | Passive three-dimensional image sensing based on chromatic focal differentiation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |