CN104917938B - Depth camera device for mobile communication equipment - Google Patents
Depth camera device for mobile communication equipment Download PDFInfo
- Publication number
- CN104917938B CN104917938B CN201410095433.XA CN201410095433A CN104917938B CN 104917938 B CN104917938 B CN 104917938B CN 201410095433 A CN201410095433 A CN 201410095433A CN 104917938 B CN104917938 B CN 104917938B
- Authority
- CN
- China
- Prior art keywords
- light
- infrared
- imaging
- camera device
- image sensor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Studio Devices (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
Abstract
A kind of depth camera device is provided, a mobile communication equipment is used for, the depth camera device includes：Infrared transmitter module is arranged to the infrared light and infrared photography module of transmitting first wavelength range, is arranged to obtain image light and generates depth image, the infrared photography module further comprises：Imaging len is arranged to capture images light, and the imaging lens surface is formed with the first anti-reflection film, and first anti-reflection film is used to enhance the intensity in transmission of the light of first wavelength range；And black white image sensor, it is arranged to the imaging len optical alignment and directly receives image light not via any optical filtering from the imaging len, the black white image sensor generates electric signal in response to the full wave light of image directly received from the imaging len.Depth camera device provided by the invention can improve photosensitive property of the imaging sensor to infrared light, and save power consumption, accelerate data acquisition speed, simplify process flow.
Description
Technical field
The present invention relates to a kind of depth camera devices, more specifically to a kind of depth for mobile communication equipment
Photographic device.
Background technology
At present, machine vision is quietly transferred to consumer electronics market from Industry Control, and the demand of miniaturization and low-power consumption causes
In hardware device type selecting, the laser emitter of big power consumption can not be usually selected to meet user to structure light intensity remote
On clear projection；Also the camera of large scale sensitive chip can not be integrated with to meet compared with high photosensitivity energy, compared with Larger Dynamic model
It encloses, and finer and smoother gray-level characteristic, to be unable to reach the parsing precision under industrial control field hardware condition.However in order to reach
Good user experience, requirement of the application scenarios to precision in consumer electronics field are also very harsh.
Usually, depth camera device by infrared camera device and has diffraction optical element（diffractive
Optical element, DOE）Laser emitter modules constitute.In a mobile communication device, infrared eye is usually adopted
It is realized with general cell-phone camera head module, by replacing the plated film specification of camera lens, is realized to the shielding of visible light and to infrared light
Perception.However the photographing module of mobile communication equipment with the application demand for video recording of taking pictures is always originally leading, be always with
The characteristic of human eye vision is that target is imaged.But now, under the premise of mobile communication equipment is as hardware foundation, such as
What, which can preferably perceive the pattern that infrared transmitter is incident upon on different depth object, is realized in current mobile communications equipment
The most important target of depth camera device.
It can be seen that as how minimum cost changes the photographing module of existing mobile communication equipment, preferably to feel
Know the pattern that infrared laser is incident upon on different depth object, improves each pixel of the imaging sensor of mobile communication equipment
Photosensitive property to infrared light is urgent problem to be solved in the prior art.
Invention content
In order to solve above-mentioned technical problem in the prior art, according to an aspect of the present invention, a kind of depth camera is provided
Device, is used for a mobile communication equipment, and the depth camera device includes：Infrared transmitter module is arranged to transmitting first
The infrared light and infrared photography module of wave-length coverage are arranged to obtain image light and generate depth image, described infrared to take the photograph
As module further comprises：Imaging len is arranged to capture images light, and the imaging lens surface is formed with the first increasing
Permeable membrane, first anti-reflection film are used to enhance the intensity in transmission of the light of first wavelength range；And black white image sensor, through matching
It sets with the imaging len optical alignment and directly from imaging len reception image light and not via any optical filtering, institute
It states black white image sensor and generates electric signal in response to the full wave light of image directly received from the imaging len.
In addition, according to one embodiment of present invention, the infrared transmitter module further includes diffraction optical element, through matching
It sets and the infrared light that infrared transmitter module emits is shaped to diffraction pattern pattern.
In addition, according to one embodiment of present invention, the black white image sensor surface is also formed with the second anti-reflection film,
Second anti-reflection film improves the second wave of described image sensor pair by the intensity in transmission of the light of enhancing second wave length range
The light of second wave length range described in the photosensitive property of the light of long range is full wave light either infrared light.
In addition, according to one embodiment of present invention, first anti-reflection film is additionally operable to prevent the light of visible wavelength logical
It crosses.
In addition, according to one embodiment of present invention, described image sensor is complementary metal oxide semiconductor
（Complementary Metal Oxide Semiconductor, COMS）Imaging sensor.
According to another aspect of the present invention, a kind of mobile communication equipment, including depth camera device are provided, the depth is taken the photograph
As device includes：Infrared transmitter module is arranged to the infrared light and infrared photography module of transmitting first wavelength range,
It is arranged to obtain image light and generates depth image, the infrared photography module further comprises：Imaging len is arranged to
Capture images light, and the imaging lens surface is formed with the first anti-reflection film, and first anti-reflection film is for enhancing first wave
The intensity in transmission of the light of long range；And black white image sensor, it is arranged to and the imaging len optical alignment and direct
Image light is received not via any optical filtering from the imaging len, and the black white image sensor is in response to from the imaging
The full wave light of image that lens directly receive and generate electric signal.
In addition, according to one embodiment of present invention, the infrared transmitter module further includes diffraction optical element, through matching
It sets and the infrared light that infrared transmitter module emits is shaped to diffraction pattern pattern.
In addition, according to one embodiment of present invention, the black white image sensor surface is also formed with the second anti-reflection film,
Second anti-reflection film improves the second wave of described image sensor pair by the intensity in transmission of the light of enhancing second wave length range
The light of second wave length range described in the photosensitive property of the light of long range is full wave light either infrared light.
In addition, according to one embodiment of present invention, first anti-reflection film is additionally operable to prevent the light of visible wavelength logical
It crosses.
In addition, according to one embodiment of present invention, described image sensor is complementary metal oxide semiconductor
（Complementary Metal Oxide Semiconductor, COMS）Imaging sensor.
It can be seen that being set with the mobile communication including the depth camera device due to depth camera device provided by the invention
It is standby that there is the black white image sensor for eliminating redgreenblue filter, therefore imaging sensor is improved to the photosensitive of infrared light
Performance, to improve the image quality of depth camera device according to the present invention.Meanwhile it is also this black just because of using
ISP processing of the initial RGB data to yuv data is omitted, it is possible thereby to which the chip for saving Hardware I SP is set in white imaging sensor
Meter or the CPU processing for reducing software I SP, and power consumption is saved, accelerate data acquisition speed, simplifies flow chart of data processing, together
When accelerate the rate of picture depth recovery, the Operational Figure Of Merit of user is also substantially improved.
It is to be understood that foregoing general description and following detailed description are both illustrative, and it is intended to
In the further explanation for providing claimed technology.
Description of the drawings
In order to illustrate the technical solution of the embodiments of the present invention more clearly, below will be in embodiment or description of the prior art
Required attached drawing is briefly described, it should be apparent that, the accompanying drawings in the following description is only some realities of the present invention
Example is applied, it for those of ordinary skill in the art, without creative efforts, can also be according to these attached drawings
Obtain other attached drawings：
Fig. 1 shows the depth camera device 100 according to an embodiment of the invention for being used for a mobile communication equipment
Structural schematic diagram；
Fig. 2 shows the monochromatic pixels of each of the imaging sensor with red-green-blue color filter to enter to different wave length
Penetrate the response curve of light；
Fig. 3 shows the demonstration of the mobile communication equipment 300 according to the ... of the embodiment of the present invention including depth camera device 100
Property structure diagram.
Specific implementation mode
Hereinafter, by preferred embodiments of the present invention will be described in detail with reference to the annexed drawings.Note that in the specification and drawings
In, there is substantially the same step and element to be denoted by the same reference numerals, and to the repetition solution of these steps and element
Releasing will be omitted.
Mentioned " one embodiment " or " embodiment " means to be retouched in conjunction with the embodiment this specification in the whole text
The a particular feature, structure, or characteristic stated is contained at least one described embodiment.Therefore, in the description phrase " one
In a embodiment " or the appearance of " in one embodiment " be not necessarily all referring to the same embodiment.In addition, the special characteristic, knot
Structure or characteristic can be in any suitable manner combined in one or more embodiments.
Depth camera device according to an embodiment of the invention is described next, with reference to Fig. 1.Fig. 1 shows root
According to the structural schematic diagram of the depth camera device 100 for a mobile communication equipment of one embodiment of the present of invention, as schemed institute
Show, depth camera device 100 may include：Infrared transmitter module 110 and infrared photography module 120.
Specifically, infrared transmitter module 110 can be arranged to the infrared light of transmitting first wavelength range.Usually,
Infrared light belongs to black light, wave-length coverage 780nm-106Nm, medium wavelength 780nm-1500nm are known as near infrared light, wave
Long 150nm-30000nm is mid-infrared light, and mid-infrared light is mainly heat radiation.30000-106Nm is far red light, and the present invention answers
Infrared light is near infrared light, that is, the infrared transmitter module 110 of depth camera device 100 is arranged to the first of transmitting
The infrared light of wave-length coverage is near infrared light.In addition, in one embodiment, infrared transmitter module 110 may include infrared
Laser emitter, the Infrared laser emission device can be arranged to transmitting near-infrared laser.In another implementation of the present invention
In example, infrared transmitter module 110 may include infrared light-emitting diode（LED）Equipment, the infrared light-emitting diode（LED）
Equipment can be arranged to transmitting near infrared light.
In addition, in one embodiment of the invention, the infrared transmitter module 110 can also include diffraction optics member
Part 111, the diffraction optical element 111 can be arranged to the infrared light that infrared transmitter module 110 emits being shaped to spy
Fixed diffraction pattern pattern.When diffraction pattern pattern is irradiated to rough object or penetrates random diffraction can be formed after frosted glass dissipate
Spot, these speckles have the randomness of height, and can be with the different changing patterns of distance.That is, at arbitrary two in space
Speckle pattern is all different.As long as stamping such structure light in space, entire space is all marked, hot spot figure
Case can change pattern as the distance of imaging object is different, be carried out to space when diffraction speckle is irradiated to entire space
Label.For example, as shown in Figure 1, for the imaging object 130 in imaging space, by identifying the speckle pattern above object 130
Case, so that it may to obtain the position of imaging object 130.In addition it is also necessary to the speckle pattern in entire space be recorded in advance, to do light source
Calibration.The method of calibration is：Every a distance, a reference planes are taken, the speckle pattern in reference planes is recorded
Come.For example, it is assumed that the locational space of imaging object is the range of 1 meter to 4 meters of distance, a reference can be taken flat every 10cm
Face, then 30 width speckle images can be obtained by calibration.
Then, infrared photography module 120 can be arranged to obtain the image light in entire imaging object space and generate depth
Spend image.Specifically, infrared photography module 120 can be arranged to shoot the infrared speckle image of scene to be measured, by the diagram
Picture and the 30 width reference pictures that we preserve make degree of correlation operation successively, we can obtain 30 width correlation chart pictures in this way,
And have position existing for object in space, peak value will be shown on correlation chart picture.These peak values are stacked in one from level to level
It rises, using some interpolation, you can obtain the depth image of the object in imaging space.Infrared photography module 120 can also be into
One step includes：Imaging len 121 and black white image sensor 122.Imaging len 121 is arranged to capture the figure of entire scene
As light, and 121 surface of the imaging len could be formed with the first anti-reflection film, and first anti-reflection film is for enhancing first wave
The intensity in transmission of the light of long range.Black white image sensor 122 can be then arranged to the imaging len optical alignment simultaneously
Directly from the imaging len receive image light and not via any optical filtering, black white image sensor 122 can in response to from
The full wave light for the image that the imaging len directly receives and generate electric signal.
The knot that the infrared light that above-mentioned infrared transmitter module 110 emits is formed is received by infrared photography module 120
The free token of structure light, and space length is obtained by analyzing spot pattern, to generate depth image.Specifically, infrared
Photographing module 120 may include imaging len 121 and black white image sensor 122.Wherein, imaging len 121 are arranged to catch
Image light is obtained, and described image light is focused on into black white image sensor 122,121 surface of imaging len could be formed with
One anti-reflection film, first anti-reflection film are used to enhance the intensity in transmission of the near infrared light of first wavelength range, i.e., described first increases
Permeable membrane can be used for enhancing the transmission for the infrared light being consistent with the laser beam centre wavelength that laser emitter is sent out, meanwhile, it is described
First anti-reflection film can be also used for that the light of visible wavelength is prevented to pass through, and make the visible light from object in 121 table of imaging len
It is reflected at first anti-reflection film in face, that is to say, that first anti-reflection film on 121 surface of the imaging len can be infrared in enhancing
It prevents visible light from passing through while the transmission of light, the transmission proportion of infrared light is improved to amplitude peak, reduce visible light pair
The interference of the infrared photosensitive property of photoreceptor.
Usually, the imaging sensor in mobile communication equipment can be complementary metal oxide semiconductor
（Complementary Metal Oxide Semiconductor, COMS）Imaging sensor or charge coupled device
（Charge-coupled Device, CCD）Imaging sensor.Imaging sensor is generally comprised to primaries（For example, red
Light, green light and blue light）Sensitive redgreenblue optical wavelength filter, the pixel detection of sensor are filtered by redgreenblue
Luminous intensity is simultaneously transformed into electric signal by the light of mirror, to which optical color image is transformed into electronic color figure by imaging sensor
Picture.In general, the camera module in mobile communication equipment is always leading with the application demand for video recording of taking pictures, it is always with human eye
The characteristic of vision is that target is imaged.However, in the present invention, using depth camera as target under the premise of, need mobile logical
The imaging sensor in camera module in letter equipment preferably perceives infrared transmitter module and is incident upon on different depth object
Infrared speckle pattern.Therefore, in order to realize above-mentioned target, black and white used in depth camera device 100 according to the present invention
Imaging sensor 122 is redesigned by the image sensing device in the camera module to existing mobile communication equipment, will
The filter of original redgreenblue optical wavelength for being covered in sensitive component surface removes, so as to realize total transmissivity wave band
Photobehavior.It uses the image sensor design of black and white version to replace original redgreenblue light color image sensor to set
Meter carries out module group assembling.
In one embodiment of the invention, 122 surface of black white image sensor is also formed with the second anti-reflection film, and described
Two anti-reflection films improve the black white image sensor 122 to the second wave by the intensity in transmission of the light of enhancing second wave length range
The light of the photosensitive property of the light of long range, the second wave length range is full wave light either near infrared light.That is, in camera lens
In coating designs, the plated film scheme for the infrared transmission being consistent with laser center wavelength band logical using enhancing carries out plated film,
The surface of black white image sensor 122 is formed with the anti-reflection film for further enhancing transmission of near infra red light rate, to which black white image passes
Sensor 122 can be further improved to the photosensitive property of infrared light, realize that the high precision movement communication equipment of black and white version is infrared
Camera module.
It is each monochromatic since the filter of redgreenblue wavelength acts in traditional red-green-blue color imaging sensor
Pixel to needing incident infrared band light（Wavelength is about the near infrared light in 850nm or so ranges）Photosensitive degree
It will be declined, Fig. 2 shows the monochromatic pixels of each of the imaging sensor with red-green-blue color filter to different waves
The response curve of long incident light.As shown in Fig. 2, after red-green-blue color filter filters to incident light, depth camera device
The response of the infrared light of used near infrared wavelength region is greatly reduced, therefore has seriously affected imaging sensor to red
Reception and imaging of the photobehavior and infrared photography module 120 of outer light to infrared light speckle pattern.Therefore, if by original
The filter for being covered in the redgreenblue wavelength on CMOS sensitive components surface removes, you can in the image sensor, improves every
A pixel is to the photosensitive property of near infrared light, to improve the image quality of depth camera device.
Moreover, each pixel of traditional image three-colo(u)r sensor obtains R, G, B component respectively, that thus combines is original
RGB data cannot be used directly for being imaged and cannot achieve the algorithm in depth camera now.Initial RGB data will be through
Cross complicated ISP（Image Signal Process, picture signal processing）Operation generates color image and carries out preview, takes pictures
And video recording.But the algorithm principle for the structure light depth recovery being directed to, do not need chromatic component, it is only necessary to the bright of yuv space
Degree component Y is parsed.In this case, in the conversion of original RGB to YUV to Y, two intermediate steps conversion can all produce
Raw information is lost.Existing handset image sensor can use the analog-digital converter of 10 bits substantially（ADC）, many images
Sensor can even reach the precision of 12 bits or 16 bits.However if by ISP conversions and final only analysis Y-signal
Component only up to reach the precision of 8 bits.In this way in effective depth bounds, most depth expression only 28It is a, it is right
For long distance high accuracy depth gesture identification, this is far from being enough.And if being covered in the photosensitive first devices of CMOS by original
The filter of the redgreenblue wavelength on part surface removes, the photosensitive obtained initial data of new black and white version imaging sensor, just
It can directly be used as the luminance component of each pixel.The precision of imaging sensor can be promoted to 2 in this way10Even 216,
This can have greatly improved for the precision of depth recovery.Meanwhile it also being saved just because of this black white image sensor is used
ISP processing of the initial RGB data to yuv data has been omited, the chip design of Hardware I SP can be saved in this way or has reduced software
The CPU processing of ISP, and power consumption is saved, accelerate image data acquisition speed, simplifies image flow chart of data processing, accelerate simultaneously
The rate of depth recovery, the Operational Figure Of Merit of user can also be substantially improved.
In addition, another aspect of the present invention additionally provides a kind of mobile communication equipment 300, Fig. 3 is shown according to of the invention real
The exemplary block diagram of the mobile communication equipment 300 including depth camera device 100 of example is applied, mobile communication equipment 300 wraps
Depth camera device 100 provided by the invention is included, the depth camera device 100 includes：Infrared transmitter module 110 and infrared
Photographing module 120.
Specifically, the infrared transmitter module 110 of mobile communication equipment 300 can be arranged to transmitting first wave length model
The infrared light enclosed.Usually, infrared light belongs to black light, wave-length coverage 780nm-10-6Nm, medium wavelength 780nm-
1500nm is known as near infrared light, and wavelength 150nm-30000nm is mid-infrared light, and mid-infrared light is mainly heat radiation.30000-
106Nm is far red light, and the infrared light that the present invention applies is near infrared light, that is, the infrared transmitter mould of mobile communication equipment 300
The infrared light that block 110 is arranged to the first wavelength range of transmitting is near infrared light.In addition, in one embodiment, infrared hair
Emitter module 110 may include Infrared laser emission device, and the Infrared laser emission device can be arranged to transmitting near-infrared and swash
Light.In another embodiment of the present invention, infrared transmitter module 110 may include infrared light-emitting diode（LED）Equipment,
The infrared light-emitting diode（LED）Equipment can be arranged to transmitting near infrared light.
In addition, in one embodiment of the invention, the infrared transmitter module 110 of the mobile communication equipment 300 is also
May include diffraction optical element 111, the diffraction optical element 111 can be arranged to send out infrared transmitter module 110
The infrared light penetrated is shaped to specific diffraction pattern pattern.After diffraction pattern pattern is irradiated to rough object or penetrates frosted glass
Random diffraction speckle can be formed, these speckles have the randomness of height, and can be with the different changing patterns of distance.That is,
Speckle pattern at arbitrary two in space is all different.As long as stamping such structure light in space, entire space is all
It is marked, spot pattern can change pattern as the distance of imaging object is different, when diffraction speckle is irradiated to entire sky
Between when space is marked.For example, as shown in Figure 1, for the imaging object 130 in this imaging space, pass through identification
Speckle pattern above object 130, so that it may to obtain the position of imaging object 130.In addition it is also necessary in advance entire space
Speckle pattern is all recorded, to do the calibration of light source.The method of calibration is：Every a distance, a reference planes are taken,
Speckle pattern in reference planes is recorded.For example, it is assumed that the locational space of imaging object is the range of 1 meter to 4 meters of distance,
A reference planes can be taken every 10cm, then 30 width speckle images can be obtained by calibration.
Then, the infrared photography module 120 of mobile communication equipment 300 can be arranged to obtain entire imaging object space
Image light and generate depth image.Specifically, the infrared photography module 120 of mobile communication equipment 300 can be arranged to clap
Diagram picture and the 30 width reference pictures preserved are made degree of correlation operation by the infrared speckle image for taking the photograph scene to be measured successively,
30 width correlation chart pictures can be obtained in this way, and have position existing for object in space, and appearance will be shown on correlation chart picture
Value.These peak values are stacked from level to level, using some interpolation, you can obtain the depth map of the object in imaging space
Picture.The infrared photography module 120 of mobile communication equipment 300 can further include：Imaging len 121 and black white image pass
Sensor 122.Imaging len 121 is arranged to capture the image light of entire scene, and 121 surface of the imaging len can be with shape
It is used to enhance the intensity in transmission of the light of first wavelength range at having the first anti-reflection film, first anti-reflection film.Black white image senses
Device 122 can then be arranged to the imaging len optical alignment and directly from the imaging len receive image light and without
By any optical filtering, black white image sensor 122 can be in response to all band of the image directly received from the imaging len
Light and generate electric signal.
Specifically, above-mentioned infrared transmitter can be received by the infrared photography module 120 of mobile communication equipment 300
The free token for the structure light that the infrared light that module 110 emits is formed, and space length is obtained by analyzing spot pattern, from
And generate depth image.More specifically, the infrared photography module 120 of mobile communication equipment 300 may include 121 He of imaging len
Black white image sensor 122.Wherein, imaging len 121 are arranged to capture images light, and described image light are focused on
Black white image sensor 122,121 surface of imaging len could be formed with the first anti-reflection film, and first anti-reflection film is for enhancing
The intensity in transmission of the near infrared light of first wavelength range, i.e., described first anti-reflection film can be used for enhancing to be sent out with laser emitter
The transmission of infrared light that is consistent of laser beam centre wavelength, meanwhile, first anti-reflection film can be also used for preventing visible light wave
Long light passes through, and the visible light from object is made to be reflected at first anti-reflection film on 121 surface of imaging len, that is to say, that
First anti-reflection film on 121 surface of the imaging len can prevent visible light from passing through while enhancing the transmission of infrared light, from
And amplitude peak improve the transmission proportion of infrared light, reduce interference of the visible light to the infrared photosensitive property of photoreceptor.
Usually, the imaging sensor in mobile communication equipment can be complementary metal oxide semiconductor
（Complementary Metal Oxide Semiconductor, COMS）Imaging sensor or charge coupled device
（Charge-coupled Device, CCD）Imaging sensor.Imaging sensor is generally comprised to primaries（For example, red
Light, green light and blue light）Sensitive redgreenblue optical wavelength filter, the pixel detection of sensor are filtered by redgreenblue
Luminous intensity is simultaneously transformed into electric signal by the light of mirror, to which optical color image is transformed into electronic color figure by imaging sensor
Picture.In general, the camera module in mobile communication equipment is always leading with the application demand for video recording of taking pictures, it is always with human eye
The characteristic of vision is that target is imaged.However, in the present invention, using depth camera as target under the premise of, need mobile logical
The imaging sensor in camera module in letter equipment preferably perceives infrared transmitter module and is incident upon on different depth object
Infrared speckle pattern.Therefore, in order to realize above-mentioned target, black and white used in mobile communication equipment 300 according to the present invention
Imaging sensor 122 is redesigned by the image sensing device in the camera module to existing mobile communication equipment, will
The filter of original redgreenblue optical wavelength for being covered in sensitive component surface removes, so as to realize total transmissivity wave band
Photobehavior.It uses the image sensor design of black and white version to replace original redgreenblue light color image sensor to set
Meter carries out module group assembling.
In one embodiment of the invention, 122 surface of black white image sensor of mobile communication equipment 300 can be with shape
The black and white is improved by the intensity in transmission of the light of enhancing second wave length range at having the second anti-reflection film, second anti-reflection film
Imaging sensor 122 to the photosensitive property of the light of second wave length range, the light of the second wave length range be full wave light or
Person is near infrared light.That is, in camera lens coating designs, using the infrared plated film scheme being consistent with laser center wavelength band logical into
Row plated film is formed with the anti-reflection film for further enhancing transmission of near infra red light rate on the surface of black white image sensor 122, to black
White imaging sensor 122 can be further improved to the photosensitive property of infrared light, realize the high precision movement communication of black and white version
Equipment infrared camera module.
In the red-green-blue color imaging sensor of traditional mobile communication equipment, due to the filter of redgreenblue wavelength
Effect, each monochromatic pixel is to needing incident infrared band light（Wavelength is about the near-infrared in 850nm or so ranges
Light）Photosensitive degree can all be declined, it is monochromatic Fig. 2 shows each of imaging sensor with red-green-blue color filter
Response curve of the pixel to the incident light of different wave length.As shown in Fig. 2, in traditional mobile communication equipment, red-green-blue color
After filter filters to incident light, the response curve value of the infrared light of near infrared wavelength region substantially drops in imaging sensor
It is low, thus seriously affected reception of the imaging sensor to the photobehavior of infrared light and to infrared light speckle pattern at
Picture.Therefore, if the filter of original redgreenblue wavelength for being covered in CMOS sensitive components surface removed, you can scheming
As in sensor, photosensitive property of each pixel near infrared light being improved, to improve the image quality of depth camera device.
Moreover, each pixel of the image three-colo(u)r sensor in traditional mobile communication equipment obtains R, G, B component respectively,
Thus the initial RGB data combined cannot be used directly for being imaged and cannot achieve the algorithm in depth camera now.It is original
RGB data will pass through complicated ISP（Image Signal Process, picture signal processing）Operation generates color image
Preview is carried out, takes pictures and records a video.But for the algorithm principle of structure light depth recovery, chromatic component is not needed, it is only necessary to be right
The luminance component Y of yuv space is parsed.In this case, in the conversion of original RGB to YUV to Y, intermediate two
Step conversion can all generate information loss.Existing handset image sensor can use the analog-digital converter of 10 bits substantially
（ADC）, many imaging sensors can even reach the precision of 12 bits or 16 bits.However if simultaneously by ISP conversions
Final only analysis Y-signal component, only up to reach the precision of 8 bits.In this way in effective depth bounds, most depth
Expression only 28A, for long distance high accuracy depth gesture identification, this is far from being enough.And if by original covering
Remove in the filter of the redgreenblue wavelength on CMOS sensitive components surface, obtained by new black and white version imaging sensor is photosensitive
Initial data, just can directly be used as the luminance component of each pixel.The precision of imaging sensor can carry in this way
It is raised to 210Even 216, this can have greatly improved for the precision of depth recovery.Meanwhile it is also this black just because of using
ISP processing of the initial RGB data to yuv data is omitted, it is possible thereby to which the chip for saving Hardware I SP is set in white imaging sensor
Meter or the CPU processing for reducing software I SP, and power consumption is saved, accelerate image data acquisition speed, simplifies image real time transfer
Flow, while the rate of depth recovery is accelerated, the Operational Figure Of Merit of user is also substantially improved.
The theme of the such as concrete structure and element that are defined in is to be provided for helping this hair of Integrated Understanding
Bright embodiment, and they are only exemplary.Also, for the sake of clear and simplicity, it will omit for known function
With the description of structure.The present invention is carried out respectively it should be appreciated by those skilled in the art that can be dependent on design requirement and other factors
Kind modification, combination, part is combined and replacement, as long as they are in the range of the appended claims and its equivalent.
Claims (8)
1. a kind of depth camera device, is used for a mobile communication equipment, the depth camera device includes：
Infrared transmitter module is arranged to the infrared light of transmitting first wavelength range, and
Infrared photography module is arranged to obtain image light and generates depth image, and the infrared photography module further comprises：
Imaging len, is arranged to capture images light, and the imaging lens surface is formed with the first anti-reflection film, and described first
Anti-reflection film is used to enhance the intensity in transmission of the light of first wavelength range；And
Black white image sensor is arranged to the imaging len optical alignment and directly receives image from the imaging len
Light and not via any optical filtering, the black white image sensor is in response to the image all-wave that is directly received from the imaging len
Section light and generate electric signal；
Wherein, the infrared transmitter module further includes diffraction optical element, is arranged to emit infrared transmitter module
Infrared light is shaped to diffraction pattern pattern.
2. depth camera device as described in claim 1, wherein the black white image sensor surface is also formed with the second increasing
Permeable membrane, second anti-reflection film improve described image sensor pair the by enhancing the intensity in transmission of the light of second wave length range
The light of the photosensitive property of the light of two wave-length coverages, the second wave length range is full wave light either infrared light.
3. depth camera device as claimed in claim 2, wherein first anti-reflection film is additionally operable to prevent visible wavelength
Light passes through.
4. depth camera device as claimed in any one of claims 1-3, wherein described image sensor is complementary metal oxygen
Compound semiconductor (Complementary Metal Oxide Semiconductor, COMS) imaging sensor.
5. a kind of mobile communication equipment, including depth camera device, the depth camera device include：
Infrared transmitter module is arranged to the infrared light of transmitting first wavelength range, and
Infrared photography module is arranged to obtain image light and generates depth image, and the infrared photography module further comprises：
Imaging len, is arranged to capture images light, and the imaging lens surface is formed with the first anti-reflection film, and described first
Anti-reflection film is used to enhance the intensity in transmission of the light of first wavelength range；And
Black white image sensor is arranged to the imaging len optical alignment and directly receives image from the imaging len
Light and not via any optical filtering, the black white image sensor is in response to the image all-wave that is directly received from the imaging len
Section light and generate electric signal；
Wherein, the infrared transmitter module further includes diffraction optical element, is arranged to emit infrared transmitter module
Infrared light is shaped to diffraction pattern pattern.
6. mobile communication equipment as claimed in claim 5, wherein the black white image sensor surface is also formed with the second increasing
Permeable membrane, second anti-reflection film improve described image sensor pair the by enhancing the intensity in transmission of the light of second wave length range
The light of the photosensitive property of the light of two wave-length coverages, the second wave length range is full wave light either infrared light.
7. mobile communication equipment as claimed in claim 6, wherein first anti-reflection film is additionally operable to prevent visible wavelength
Light passes through.
8. the mobile communication equipment as described in any one of claim 5-7, wherein described image sensor is complementary metal oxygen
Compound semiconductor (Complementary Metal Oxide Semiconductor, COMS) imaging sensor.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410095433.XA CN104917938B (en) | 2014-03-14 | 2014-03-14 | Depth camera device for mobile communication equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410095433.XA CN104917938B (en) | 2014-03-14 | 2014-03-14 | Depth camera device for mobile communication equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104917938A CN104917938A (en) | 2015-09-16 |
| CN104917938B true CN104917938B (en) | 2018-08-31 |
Family
ID=54086611
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410095433.XA Active CN104917938B (en) | 2014-03-14 | 2014-03-14 | Depth camera device for mobile communication equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104917938B (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105631438A (en) * | 2016-02-16 | 2016-06-01 | 格科微电子（上海）有限公司 | Optical fingerprint recognition device |
| CN106934394B (en) * | 2017-03-09 | 2024-01-19 | 奥比中光科技集团股份有限公司 | Dual wavelength image acquisition system and method |
| WO2019047985A1 (en) | 2017-09-11 | 2019-03-14 | Oppo广东移动通信有限公司 | Image processing method and device, electronic device, and computer-readable storage medium |
| CN107707831A (en) * | 2017-09-11 | 2018-02-16 | 广东欧珀移动通信有限公司 | Image processing method and device, electronic installation and computer-readable recording medium |
| CN108542497A (en) * | 2018-03-06 | 2018-09-18 | 南京生命源医药实业有限公司 | Operation navigation device |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103561257A (en) * | 2013-11-01 | 2014-02-05 | 北京航空航天大学 | Interference-free light-encoded depth extraction method based on depth reference planes |
| CN103581653A (en) * | 2013-11-01 | 2014-02-12 | 北京航空航天大学 | Method for non-interference depth extraction of optical coding depth camera system according to luminous intensity modulation |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8717417B2 (en) * | 2009-04-16 | 2014-05-06 | Primesense Ltd. | Three-dimensional mapping and imaging |
| WO2014205119A1 (en) * | 2013-06-18 | 2014-12-24 | The Regents Of The University Of Colorado, A Body Corporate | Software-defined energy communication networks |
-
2014
- 2014-03-14 CN CN201410095433.XA patent/CN104917938B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103561257A (en) * | 2013-11-01 | 2014-02-05 | 北京航空航天大学 | Interference-free light-encoded depth extraction method based on depth reference planes |
| CN103581653A (en) * | 2013-11-01 | 2014-02-12 | 北京航空航天大学 | Method for non-interference depth extraction of optical coding depth camera system according to luminous intensity modulation |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104917938A (en) | 2015-09-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104917938B (en) | Depth camera device for mobile communication equipment | |
| Tocci et al. | A versatile HDR video production system | |
| US20020050518A1 (en) | Sensor array | |
| JP6394338B2 (en) | Image processing apparatus, image processing method, and imaging system | |
| US9398272B2 (en) | Low-profile lens array camera | |
| CN108600712B (en) | Image sensor, mobile terminal and image shooting method | |
| CN104156649B (en) | Vein recognition imaging device and method for safety authentication of mobile terminal | |
| CN108712608A (en) | Terminal device image pickup method and device | |
| CN110830730B (en) | Apparatus and method for generating moving image data in electronic device | |
| US20210067705A1 (en) | Phase detection autofocus (pdaf) sensor | |
| CN103096094A (en) | Vision recognition apparatus and method | |
| EP3522528A1 (en) | Image white balance correction method and electronic device | |
| JP2001526430A (en) | Single chip symbol reader with smart sensor | |
| KR20200091197A (en) | Camera device and autofocusing method of the same | |
| US9843387B2 (en) | Decoding apparatus, decoding method, and non-transitory recording medium | |
| CN207218885U (en) | A kind of intelligent terminal auto-exposure control structure for wireless light communication | |
| CN110266967A (en) | Image processing method, device, storage medium and electronic equipment | |
| CN206790586U (en) | A kind of filming apparatus for dividing double light | |
| CN112672021B (en) | Language identification method and device and electronic equipment | |
| WO2021149503A1 (en) | Electronic device | |
| CN106713725A (en) | Shooting system capable of splitting double light waves | |
| WO2020255715A1 (en) | Image processing device, imaging device, image processing method, and image processing program | |
| JP6210081B2 (en) | Decoding device, decoding method, and program | |
| CN109447925B (en) | Image processing method and device, storage medium and electronic equipment | |
| CN110995965A (en) | Shooting module and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |