CN106534721A - Imaging device capable of distinguishing foreground, operation method thereof and imaging sensor - Google Patents
Imaging device capable of distinguishing foreground, operation method thereof and imaging sensor Download PDFInfo
- Publication number
- CN106534721A CN106534721A CN201510581322.4A CN201510581322A CN106534721A CN 106534721 A CN106534721 A CN 106534721A CN 201510581322 A CN201510581322 A CN 201510581322A CN 106534721 A CN106534721 A CN 106534721A
- Authority
- CN
- China
- Prior art keywords
- subframe
- pixel
- image
- region
- picture frame
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The invention discloses an imaging device. The imaging device comprises a condensing lens and an image sensor, wherein the image sensor is used for sensing light rays penetrating through the condensing lens, and comprises a pixel matrix, a light shield layer, a plurality of micro-lenses and an infrared light filtering layer; the pixel matrix comprises a plurality of infrared pixels, a plurality of first pixels and a plurality of second pixels; the light shield layer shields a part above a first area of the plurality of first pixels and a part above a second area of the plurality of second pixels; the first area and the second area are symmetrical to each other along a first direction in a mirroring way; the plurality of micro-lenses are arranged above the pixel matrix; and the infrared light filtering layer covers a part above the plurality of infrared pixels.
Description
Technical field
A kind of relevant optical pickocff of the present invention, particularly about the imaging of a kind of distinguishable prospect and background
Device and its How It Works.
Background technology
Various electronic installation is widely used to the default application of activation system by differentiating gesture,
Such as portable electronic devices or Wearable electronic installation.A kind of known resolution prospect with the mode of background is
Using the object in the range of system source lighting operation.When the system source polishing, imageing sensor
Obtain a bright image；And when the system source not polishing, described image sensor obtains one secretly
Image.The interference of background can be then eliminated by calculating the difference image of the bright image and the dark image.
However, portable electronic devices or Wearable electronic installation are operated under high light often, for example
Under sunshine.Compared with sunshine due to the brightness of system source and seem very faint, therefore by known
Calculate the mode of the difference image of bright dark image and cannot effectively eliminate ambient interferences.
In view of this, a kind of strong and weak imaging device of ambient light that is not only restricted to is that current industry is badly in need of.
The content of the invention
The present invention proposes a kind of imaging device of distinguishable prospect and its How It Works, its collocation phase-detection
To overcome the restriction caused by strong ambient light.
The present invention proposes a kind of distinguishable prospect that can use different operating modes under varying environment light
Imaging device and its How It Works.
The present invention provides a kind of imaging device, and which includes collector lens and imageing sensor.Described image
Sensor is to sense the light that penetrates the collector lens and comprising picture element matrix, light shield layer, Duo Gewei
Lens and infrared light filter layer.The picture element matrix comprising in the first direction and second direction arrangement it is multiple
Infrared ray pixel, multiple first pixels and multiple second pixels.Light shield layer masking is the plurality of the
Above the first area of one pixel and above the second area of the plurality of second pixel, wherein, described
One region forms specular with the second area along the first direction.The plurality of lenticule is arranged
Above the picture element matrix.The infrared light filter layer is covered in above the plurality of infrared ray pixel.
The present invention also provides a kind of imaging device, and which includes infrared light supply, collector lens, imageing sensor
And processor.Described image sensor penetrates the light of the collector lens to sense, described red
Bright picture frame is exported when outer light source is lighted and exports dark picture frame when the infrared light supply extinguishes.The figure
As sensor includes picture element matrix, light shield layer, multiple lenticules and infrared light filter layer.The pixel square
Battle array comprising in the first direction and second direction arrangement multiple infrared ray pixels, multiple first pixels and multiple
Second pixel.The light shield layer masking is above the first area of the plurality of first pixel and the plurality of
Above the second area of the second pixel, wherein, the first area and the second area are along described first
Direction forms specular.The plurality of lenticule is arranged on above the picture element matrix.The infrared light
Filter layer is covered in above the plurality of infrared ray pixel.The processor to by the bright picture frame and
In the dark picture frame, the infrared view region of the plurality of infrared ray pixel of correspondence forms infrared ray
Frame, the first image-region of the plurality of first pixel of correspondence form the first subframe, correspondence the plurality of the
Second image-region of two pixels forms the second subframe, and calculates the institute of the bright picture frame in first mode
The difference image that infrared ray subframe is stated with the infrared ray subframe of the dark picture frame is to isolate at least
One foreground image, or isolated at least according to first subframe and second subframe in second mode
One foreground image.
The present invention also provide a kind of imaging device How It Works, the imaging device comprising infrared light supply,
Multiple infrared ray pixels, multiple first pixels, multiple second pixels and multiple lenticules, the plurality of
One pixel and the plurality of second pixel pass through the plurality of lenticular Part I and second respectively
Tap receives the incident light of out of phase.The How It Works are comprised the steps of：Existed with the imaging device
The infrared light supply exports bright picture frame and exports dark picture frame when the infrared light supply extinguishes when lighting；
The infrared view region of correspondence the plurality of infrared ray pixel is formed into infrared ray subframe, will be correspondence described
First image-region of multiple first pixels forms the first subframe, by the of correspondence the plurality of second pixel
Two image-regions form the second subframe；In the first mode, calculate the infrared ray of the bright picture frame
The difference image of subframe and the infrared ray subframe of the dark picture frame is isolating at least one prospect
Image；And in a second mode, at least one is isolated according to first subframe and second subframe
Individual foreground image.
The present invention a kind of imageing sensor is also provided, comprising picture element matrix, light shield layer, multiple lenticules and
Infrared light filter layer.The picture element matrix comprising in the first direction and second direction arrangement multiple infrared rays
Pixel, multiple first pixels and multiple second pixels.The light shield layer is covered in the plurality of first pixel
First area above and the second area of the plurality of second pixel above, wherein, the first area
Specular is formed with the second area along the first direction.The plurality of lenticule is arranged on described
Above picture element matrix.The infrared light filter layer is covered in above the plurality of infrared ray pixel.
In order to the above and other objects, features and advantages of the present invention can be become apparent from, will hereafter coordinate institute
Accompanying drawing shows, describes in detail as follows.Additionally, in the explanation of the present invention, identical component is accorded with identical
Number represent, here first states clearly.
Description of the drawings
Fig. 1 is the block schematic diagram of the imaging device of the present invention one embodiment of explanation；
Fig. 2A -2B are the sectional view of the imageing sensor of the imaging device that the present invention illustrates some embodiments；
Fig. 3 A-3D are the schematic diagram of the configuration of the light shield layer that the present invention illustrates some embodiments；
Fig. 4 is the schematic diagram of the How It Works of the imaging device of the present invention one embodiment of explanation；
Fig. 5 is the signal of the How It Works of the first mode of the imaging device of the present invention one embodiment of explanation
Figure；
Fig. 6 is the flow chart of the How It Works of the imaging device of the present invention one embodiment of explanation.
Description of reference numerals
1 imaging device
10 collector lenses
11 imageing sensors
13 processors
130 storage elements
131 light source control modules
133 selecting modules
135 difference blocks
137 calculations of offset modules
139 application modules
15 infrared light supplies
9 objects
P1-P4、PinfPixel
F picture frames
Ls infrared lights
Lrs reflection lights
La ambient lights
Specific embodiment
Refer to shown in Fig. 1 and 2A-2B, Fig. 1 is the side of the imaging device of the present invention one embodiment of explanation
Block schematic diagram, Fig. 2A -2B are cuing open for the imageing sensor of the imaging device that the present invention illustrates some embodiments
View.Imaging device 1 includes collector lens 10, imageing sensor 11, processor 13 and infrared light
Source 15.In some embodiments, the processor 13 for example can be with described image sensor 11 and described red
Outer light source 15 is arranged in same chip.In some embodiments, the processor 13 can be described image
Processing unit outside sensor 11, to receive and process the figure acquired in described image sensor 11
As frame F, with Selection utilization first mode (such as general mode) or second mode (such as high light pattern)
An at least foreground image (foreground image) is isolated from background image；For example, when the imaging
When device 1 is applied to gesture identification, at least one foreground image can be that the hand of user or user grip
Object.The processor 13 for example can for microcontroller (MCU), central processing unit (CPU),
Digital signal processor (DSP) etc. is to process the picture frame F exported by described image sensor 11
Person.
The infrared light supply 15 can for example be light emitting diode or laser diode, to send infrared light
Ls illuminates the operable scope of the imaging device 1；Wherein, the operable scope is for example joined by component
It is several to be determined.When object 9 is entered in the operable scope, then towards described image sensor 11
The infrared light Ls is reflected to form reflection light Lrs.In some embodiments, the imaging device 1 can
Comprising at least one optical module (not illustrating) homogenizing the light sent by the infrared light supply 15.
The collector lens 10 is for example can be located in the camera lens of image-taking device (such as camera), and which can
The lens group arranged for single lens or along optical axis (optical axis), has no specific restriction, and in order to
Simplify schema and only show single lens herein.The collector lens 10 is used as camera lens window (lens
Window), to obtain reflection light Lrs or ambient light La from the object 9, and guide institute
Reflection light Lrs and ambient light La are stated to described image sensor 11.The collector lens 10 with it is described
The distance of imageing sensor 11 is desirably equal to the first focal length of the collector lens 10 (such as near described
The focal length of 11 side of imageing sensor).It will be appreciated that when there is ambient light La, the reflection
Light Lrs also can the reflected light comprising component environment light.
Described image sensor 11 (for example being represented with pel array herein) is penetrated based on default focal length sensing
The light (such as reflection light Lrs and ambient light La) of the collector lens 10 output image frame F；
For example, described image sensor 11 exports bright picture frame and described when the infrared light supply 15 is lighted
Infrared light supply 15 exports dark picture frame when extinguishing.Described image sensor 11 includes 111 (example of picture element matrix
Illustrate such as by taking 9 × 9 picture element matrixs as an example), light shield layer 113, multiple lenticules 115 and infrared light filter
Layer 117 (with reference to Fig. 2A and 2B)；Wherein, to shelter after the light shield layer 113 is patterned
State at least a portion for multiple pixels that picture element matrix 111 is included, so that the plurality of pixel does not hide
Cover the incident light that area receives out of phase by the different piece of the plurality of lenticule 115.It is described default
Focal length refers to that the collector lens 10 is be collectively forming with the plurality of lenticule 115 saturating positioned at the optically focused
Second focal length of the incident side of mirror 10, is sometimes referred to simply as the collector lens 10 or the figure in the present invention
As the acquiescence focal length of sensor 11.
It has been found that when object 9 is (such as remote positioned at second focal length of the collector lens 10
From the focal length of 11 side of described image sensor, i.e., described default focal length) place's reflection infrared light Ls or environment
Object when light La is to the imaging device 1, in the picture frame F exported by described image sensor 11
Position of the image in the subframe of the pixel relative to different masking kenels will not produce skew, and work as described right
As 9 positioned at the collector lens 10 second focal length when, described image sensor 11 is exported
Picture frame F in position of the object images in the subframe of the pixels of relatively different masking kenels can court
(shift) is offset to different directions, after citing is specified in.Therefore, the imaging device 1 can determine whether described
Whether position offset is located in preset range, to judge whether the object 9 is positioned at operable scope
Interior foreground image.In other words, the imaging device 1 of present invention explanation has operable scope, is located at
Imaging of the object in the operable scope on described image frame F is then defined as foreground image.
In one embodiment, the picture element matrix 111 includes multiple infrared ray pixels Pinf, multiple first pictures
Plain P1And multiple second pixels P2(such as X-direction) and second direction (such as Y side in the first direction
To) arrangement.It should be noted that, in present invention explanation, the plurality of first pixel P1And it is the plurality of
Second pixel P2The region that finger is covered by the light shield layer 113 is different.For example, in monochrome image sensor
In, the plurality of first pixel P1And the plurality of second pixel P2Pixel itself it is identical, and at which
On light shield layer 113 masking kenel (cover pattern) difference (as shown in Figure 1).For example, exist
In color image sensor, the plurality of first pixel P1And the plurality of second pixel P2Can be respectively
(such as formed in pixel comprising red pixel (such as forming red filter layer in pixel), green pixel
Green color filter), blue pixel (such as forming blue color filter layer in pixel) or other colored pixels,
And the plurality of first pixel P1And the plurality of second pixel P2On light shield layer 113 masking kenel
It is different.The plurality of infrared ray pixel PinfTop is coated with infrared light filter layer 117 but not by the screening
Photosphere 113 covers.
The light shield layer 113 is for example using formed (such as CMOS of the metal level as conductivity pathway
One layer of M1-M10 wherein at least in processing procedure), the black light blocking being alternatively additionally formed beyond metal level
Layer, or be a combination of both, specific restriction is had no, as long as incident light can be stopped.This enforcement
In example, the light shield layer 113 is covered in the plurality of first pixel P1First area (hatched example areas)
Top and the plurality of second pixel P2Second area (hatched example areas) above.In Fig. 1, described
One region is positioned at along the side of the first direction (such as X-direction), and the second area is located at
Along the opposite direction side of the first direction, and the plurality of first pixel P1The first area and institute
State multiple second pixels P2The second area along the first direction formed specular.Additionally, institute
State multiple first pixels P1Non- shielded area (white space) beyond with the first area and it is described many
Individual second pixel P2Non- shielded area (white space) beyond with the second area；Wherein, it is described
Multiple first pixels P1Non- shielded area and the plurality of second pixel P2Non- shielded area respectively pass through institute
The different piece for stating multiple lenticules 115 receives the incident light (as shown in Figure 2 A) of out of phase.
For example in Fig. 1, the plurality of first pixel P1First area be the plurality of first pixel P1
Upside and the plurality of second pixel P2Second area be the plurality of second pixel P2Downside.
It should be noted that, although Fig. 1 shows the substantially single picture of the first area and the second area
The 50% of vegetarian noodles product, but which is only not limited to explanation of the present invention to illustrate.In other embodiment,
The first area and the second area can be the 5%-95% of single elemental area, have no specific restriction.
The plurality of lenticule 115 is arranged on above the picture element matrix 111, and is pointed to one respectively
Pixel.The light shield layer 113 and the infrared light filter layer 117 then between the picture element matrix 111 with
Between the plurality of lenticule 115；Wherein, the light shield layer 113 and the infrared light filter layer 117 with
The vertical range of the picture element matrix 111 can be equal or different, has no specific restriction.Thereby, it is described many
Individual first pixel P1And the plurality of second pixel P2Respectively by the first of the plurality of lenticule 115
Partly (it is, for example, the latter half of lenticule 115 with respect to Fig. 1, is, for example, lenticule 115 with respect to Fig. 2A
Right half part) and Part II (be, for example, the top half of lenticule 115 with respect to Fig. 1, it is relative to scheme
2A be, for example, lenticule 115 left-half) receive out of phase incident light.It should be noted that,
Although Fig. 2A shows the plurality of first pixel P1And the plurality of second pixel P2Non- shielded area substantially
Relative to the half of the plurality of lenticule 115, but which is only not limited to the present invention to illustrate
Explanation.It will be appreciated that the plurality of lenticule of light penetration 115 and non-shielded area can be reached
Part is determined according to the shaded portions of the light shield layer 113.It is in present invention explanation, the plurality of micro-
The Part I and Part II of mirror 115 can be configured to the 5%-95% of the plurality of lenticule 115, and
Without specific restriction.
In Fig. 1, the picture element matrix 111 is also comprising along the second direction (such as Y-direction) arrangement
Multiple 3rd pixels P3And multiple 4th pixels P4.The light shield layer 113 is also covered the plurality of
3rd pixel P3The 3rd region (hatched example areas) above and the plurality of 4th pixel P4The 4th area
Above domain (hatched example areas)；Wherein, the 3rd region is positioned at along the second direction (such as Y
Direction) side, and the 4th region is positioned at along the opposite direction side of the second direction.For example scheme
In 1, the 3rd region is located at the plurality of 3rd pixel P3Left side, and the 4th region is located at
The plurality of 4th pixel P4Right side, and the 3rd region with the 4th region along the second party
To formation specular.
In more detail, the light shield layer 113 is covered in the top of the picture element matrix 111, and comprising the
One masking kenel is covered in the plurality of first pixel P1First area above；Second masking kenel masking
In the plurality of second pixel P2Second area above；3rd masking kenel is covered the plurality of 3rd
Pixel P3The 3rd overlying regions；4th masking kenel is covered in the plurality of 4th pixel P4The 4th
Overlying regions；Wherein, the first area forms specular in the first direction with the second area；
3rd region forms specular in a second direction with the 4th region.It is in one embodiment, described
First direction is perpendicular to the second direction.It should be noted that, the plurality of first pixel P1It is extremely described
Multiple 4th pixels P4Configuration be not limited to shown in Fig. 1, can preferably be uniformly distributed in the pixel battle array
Row 111 are everywhere.Additionally, in some embodiments, the picture element matrix 111 is only comprising the plurality of the
One pixel P1And the plurality of second pixel P2Or only include the plurality of 3rd pixel P3And it is the plurality of
4th pixel P4, hold depending on different application.
In one embodiment, all described first area of the picture element matrix 111, the second area,
3rd region and the 4th region are respectively provided with equal area (as shown in Figure 1), for example, single
The 5%-95% of elemental area.
It should be noted that, although show the first area with the second area along first party in Fig. 1
To the rectangle for forming specular, and the 3rd region forms mirror in a second direction with the 4th region
As symmetrical rectangle, but which is only not limited to explanation of the present invention to illustrate.In other embodiment,
The first area to the 4th region can be not rectangle.It is referring for example to shown in Fig. 3 A-3D, described
First area to the four-range non-shielded area (white space) is for example configured to along default direction (figure
In be shown as the adjacent direction of two pixels) increase or monotone increasing, and its shape is in the preset direction
It is mirrored into symmetrical.Due in the plurality of first pixel P1(or the plurality of 3rd pixel P3) and institute
State multiple second pixels P2(or the plurality of 4th pixel P4) when receiving incident beam, near described many
Individual first pixel P1(or the plurality of 3rd pixel P3) and the plurality of second pixel P2(or it is described
Multiple 4th pixels P4) the incident light that receives respectively of center between phase difference it is unobvious, and lean on
Nearly the plurality of first pixel P1(or the plurality of 3rd pixel P3) and the plurality of second pixel P2
(or the plurality of 4th pixel P4) the incident light that receives respectively of edge between phase difference then compared with
Greatly, therefore, the non-shielded area at generic pixel edge is configured to into the non-shielded area more than generic pixel center,
The accuracy of phase-detection can be lifted.It should be noted that, Fig. 3 A-3D are only to illustrate, and are not used to
Limit explanation of the invention.
The processor 13 is by bright picture frame and dark picture frame, to correspond to the plurality of infrared ray picture
Plain PinfInfrared view region IinfForm infrared ray subframe Finf, the plurality of first pixel P of correspondence1
The first image-region IP1Form the first subframe FP1, the plurality of second pixel P of correspondence2The second image
Region IP2Form the second subframe FP2, as shown in Figure 4.The processor 13 is simultaneously calculated in first mode
Infrared ray subframe F of bright picture frameinf_BWith infrared ray subframe F of dark picture frameinf_DDifference image with point
At least one foreground image is separated out, or in second mode according to first subframe FP1And it is described second sub
Frame FP2Isolate at least one foreground image；Wherein, the first mode is, for example, general mode, institute
It is, for example, high light pattern to state second mode.In details of the words, first subframe FP1By the plurality of first
Pixel P1The luma data of output and formed, second subframe FP2By the plurality of second pixel P2
The luma data of output and formed, infrared ray subframe FinfBy the plurality of infrared ray pixel PinfIt is defeated
The luma data that goes out and formed.
When the picture element matrix 111 is configured comprising four kinds of pixels, the processor 13 is also to will be bright
In picture frame and dark picture frame, the plurality of 3rd pixel P of correspondence3The 3rd image-region IP3Form the
Three subframes FP3, the plurality of 4th pixel P of correspondence3The 4th image-region IP4Form the 4th subframe IP4,
As shown in Figure 4.In details of the words, the 3rd subframe FP3By the plurality of 3rd pixel P3The ash of output
Exponent number according to and formed, the 4th subframe FP4By the plurality of 4th pixel P4The luma data of output and
Formed.
Referring again to Fig. 1, the processor 13 comprising light source control module 131, selecting module 133,
Difference block 135, calculations of offset module 137 and application module 139；Wherein, the light source control mould
Block 131, selecting module 133, difference block 135, calculations of offset module 137 and application module 139
For example can be realized in the way of software and/or hardware, have no specific restriction.For convenience of description, the light source
Control module 131, selecting module 133, difference block 135, calculations of offset module 137 and application module
139 are shown as separated from one another, and actually its running is completed by the processor 13.The process
The parameter required when preferably also operating to store in advance comprising storage element 130 of device 13, for example relatively
The default bias amount scope of operable scope.
The light source control module 131 is to control 15 relative described image sensor of the infrared light supply
11 image obtains and lights and extinguish, so that the infrared light supply 15 relatively of described image sensor 11
Bright picture frame is obtained and is exported when lighting and relatively described infrared light supply 15 is obtained when extinguishing and exports dark figure
As frame.
The selecting module 133 of the processor 13 is to the figure that exported according to described image sensor 11
As frame F selection operation patterns.In one embodiment, the selecting module 133 of the processor 13 is to root
The first mode or the second mode are selected according to the mean flow rate of dark picture frame.For example, the process
The selecting module 133 of device 13 only calculates the infrared light image region I of the dark picture frameinfMean flow rate
Or the ensemble average brightness of the calculating dark picture frame, and the comparison mean flow rate and luminance threshold (its
For example it is stored in the storage element 130).When the mean flow rate is less than the luminance threshold, table
Show that ambient light La is not very strong, then into the first mode, therefore the first mode can be described as it is general
Logical pattern or low light level pattern；When the mean flow rate is more than the luminance threshold, ambient light La is represented very
By force, then into the second mode, therefore the second mode can be described as high light pattern.
As it was previously stated, when ambient light La is too strong, the luminance difference of bright picture frame and dark picture frame is simultaneously failed to understand
It is aobvious.Therefore, in another embodiment, the selecting module 133 of the processor 13 is to according to bright image
Frame selects the first mode or the second mode with the mean luminance differences of dark picture frame.When described average
Luminance difference is more than luminance difference threshold value (which is for example stored in the storage element 130), represents ambient light
La is not very strong, hence into the first mode；When the mean luminance differences are less than the luminance difference
Threshold value, represents that ambient light La is very strong, hence into the second mode.
Fig. 5 is refer to, which is the How It Works of the first mode of present invention explanation.In first mode, institute
State the infrared ray of the bright picture frame that described image sensor 11 is exported by the difference block 135 of processor 13
Subframe Finf_BAnd infrared ray subframe F of dark picture frameinf_DCarry out calculus of differences.For example, it is assumed that described red
Outside line subframe Finf_BComprising object images I9And background image Ia, and infrared ray subframe Finf_DOnly wrap
Ia containing background image.When infrared ray subframe Finf_BDeduct infrared ray subframe Finf_DAfterwards, difference
Image (Finf_B-Finf_D) only it is left object images I9, use the interference for eliminating background image.
Fig. 1 and Fig. 4 is refer to, the function mode of second mode is then illustrated.In the present embodiment, for example
Illustrate so that an object 9 is located at the incident side of the collector lens 10 as an example.Described image sensor
11 based on default focal length acquisition and output image frame F (which can be bright picture frame or dark picture frame) is to institute
State processor 13.Assume that the selecting module 133 is selected into the second mode, the processor
Described image frame F is divided into the first subframe F by 13 calculations of offset module 137P1And second subframe FP2；
Wherein, first subframe FP1It is relevant to the plurality of first pixel P1And second subframe FP2Phase
With regard to the plurality of second pixel P2.As it was previously stated, when the object 9 is located at the collector lens 10
The second focal length (i.e. described pre- focal length) when, the image-region of the related object 9 is sub described first
Frame FP1And second subframe FP2In be located substantially at opposite position without shifting.When described right
As 9 positioned at the collector lens 10 the second focal length when, the image-region of the related object 9 exists
First subframe FP1And second subframe FP2In can shift and be located at opposite position.Institute
The calculations of offset module 137 of processor 13 is stated then to described according to bright picture frame or dark picture frame
One subframe FP1And second subframe FP2Isolate at least one foreground image.As it was previously stated, working as environment
When light La is enough strong, the luminance difference of bright picture frame or dark picture frame is not obvious, therefore may be used to separate
Foreground image.
For example, Fig. 4 shows first subframe FP1In the first image-region I91From center line (such as dotted line)
The amount of offsetting up be S1, and second subframe FP2In the second image-region I92It is (such as empty from center line
Line) the amount of offseting downward be S2.The calculations of offset module 137 of the processor 13 is then to calculate S1
And S2The first side-play amount between the two, such as (S1-S2).It should be noted that, the calculating of side-play amount is simultaneously
It is not limited to center line as baseline, herein only for convenient explanation by taking center line as an example, the calculating of side-play amount
Can also according to such as block compare (block matching) or motion detection (motion detection) come
Realize, have no specific restriction, as long as first subframe F can be calculatedP1With second subframe FP2
In corresponding image-region (such as I91、I92) between first side-play amount；Wherein, two image
Whether region is corresponding for example can be judged with the brightness of two image-region or shape.The processor
13 calculations of offset module 137 is by first side-play amount corresponding at least in preset range
Individual image-region is identified as at least one foreground image, and the image-region outside the default scoping is recognized
For background image.
When the picture element matrix 111 is configured comprising four kinds of pixels, the calculations of offset of the processor 13
Described image frame F is also divided into the 3rd subframe F by module 137P3And the 4th subframe FP4；Wherein, it is described
3rd subframe FP3It is relevant to the plurality of 3rd pixel P3, and the 4th subframe FP4It is relevant to described
Multiple 4th pixels P4.Under the second mode, the calculations of offset module 137 of the processor 13 is then
To the 3rd subframe F according to bright picture frame or dark picture frameP3And the 4th subframe FP4Separate
Go out at least one foreground image.
For example, Fig. 4 shows the 3rd subframe FP3In the 3rd image-region I93From center line (such as dotted line)
Side-play amount to the right be S3, and the 4th subframe FP4In the 4th image-region I94It is (such as empty from center line
Line) side-play amount to the left be S4.The calculations of offset module 137 of the processor 13 is then to calculate S3
And S4The second side-play amount between the two, such as (S3-S4), as it was previously stated, the calculation of side-play amount is simultaneously
It is not limited to subtraction.The calculations of offset module 137 of the processor 13 is by preset range
Corresponding at least one image-region of second side-play amount is identified as at least one foreground image, and by institute
The image-region stated outside default scoping is identified as background image.
As it was previously stated, the preset range is pre-stored in the storage element 130, which is relative to operable
The side-play amount of scope.In other words, when first side-play amount and/or second side-play amount are beyond described
Preset range, then it represents that described image region belongs to background image.
It should be noted that, although Fig. 4 shows described first image region I91Offset up S1, it is described
Two image-region I92Offset downward S2, the 3rd image-region I93Offset to the right S3, four image
Region I94S is offset to the left4, which is only with illustrating and not to limit the present invention.With respect to the object 9
Image-region offset direction according to the object 9 from second focal length away from or near the optically focused
Lens 10 and the plurality of first pixel P1To the plurality of 4th pixel P4Light shield layer 113 screening
Depending on covering region, person shown by Fig. 4 is not limited to.
The application module 139 is then according at least one identified foreground object output control signal
Sc, such as the change output institute according to the direction of displacement, speed and quantity of at least one foreground object
State control signal Sc to control the running of application program.
It should be noted that, in the present embodiment, image-region is carried out by taking circular (corresponding point object 9) as an example
Illustrate, but the present invention is not limited thereto, image-region can for example be the edge in described image frame F
Etc. (edge) side-play amount person can be clearly shown, has no specific restriction.
Additionally, judging accuracy for increasing, the processor 13 also utilizes shadowing method (shading) school
Just described first subframe FP1And second subframe FP2Brightness be consistent, so, it is possible correct judgement
First subframe FP1And second subframe FP2In corresponding image-region (such as brightness identical
Image-region), such as I91、I92.It is when the picture element matrix 111 is configured comprising four kinds of pixels, described
Processor 13 also corrects the 3rd subframe F using shadowing methodP3And the 4th subframe FP4Brightness be
Unanimously, so, it is possible correctly to judge the 3rd subframe FP3And the 4th subframe FP4In it is corresponding
Image-region (such as brightness identical image-region), such as I93、I94。
Referring to shown in Fig. 1,2A-2B and 4-6, Fig. 6 is the imaging of present invention explanation embodiment
The How It Works of device, its imaging device 1 for example suitable for Fig. 1.As it was previously stated, imaging device 1
Comprising infrared light supply 15, multiple infrared ray pixels Pinf, multiple first pixels P1, multiple second pixels P2
And multiple lenticules 115.The plurality of first pixel P1And the plurality of second pixel P2Pass through institute respectively
The Part I and Part II for stating multiple lenticules 115 receives the incident light of out of phase, such as Fig. 1
Show that the Part I is located at the upside of pixel, but its position positioned at the downside of the pixel Part II
Put and be not limited to shown in Fig. 1 with the ratio of pixel.
The How It Works of the present embodiment are comprised the steps of：Exported when infrared light supply is lighted with imaging device
Bright picture frame simultaneously exports dark picture frame (step S61) when the infrared light supply extinguishes；Will be correspondence described
The infrared view region of multiple infrared ray pixels, the first image-region of the plurality of first pixel of correspondence
And the second image-region of the plurality of second pixel of correspondence formed respectively infrared ray subframe, the first subframe and
Second subframe (step S62)；Select first mode or second mode (step S63)；Described first
In pattern, the infrared ray subframe of the bright picture frame and the infrared ray of the dark picture frame is calculated
The difference image of subframe is isolating at least one foreground image (step S64)；And described second
In pattern, at least one foreground image (step S65) is isolated according to first subframe and described second.
Step S61：The light source control module 131 of the processor 13 controls 15 phase of the infrared light supply
The image of described image sensor 11 is obtained and is lighted and is extinguished, to light in the infrared light supply 15
When export bright picture frame and export dark picture frame when the infrared light supply 15 extinguishes.In more detail, institute
State frame per second (frame rate) at least ignition frequency of the infrared light supply 15 of imageing sensor 11
Twice, such as twice, four times ....
Step S62：Described image sensor 11 is by acquired every picture frame F (such as bright images
Frame and dark picture frame) export to the processor 11 and post-processed.For example, the processor 11 will
In every picture frame F, the plurality of infrared ray pixel P of correspondenceinfInfrared view region IinfFormed red
Outside line subframe Finf, by correspondence the plurality of first pixel P1The first image-region IP1Form the first subframe
FP1And will corresponding the plurality of second pixel P2The second image-region IP2Form the second subframe FP2, such as
Shown in Fig. 4.Formed subframe mode for example according to script positioned at described image frame F position relationship again
Constitute infrared ray subframe Finf, first subframe FP1And second subframe FP2。
In some embodiments, the imaging device 1 also includes multiple 3rd pixels P3And multiple 4th pixels
P4, the plurality of 3rd pixel P3And the plurality of 4th pixel P4Pass through the plurality of lenticule respectively
115 Part III and Part IV receive the incident light of out of phase, and such as Fig. 1 shows the described 3rd
Part be located at pixel right side and the Part IV be located at pixel left side, but its position and with pixel
Ratio is not limited to shown in Fig. 1.In embodiment shown in Fig. 1, the Part I and described second
It is divided into the plurality of lenticule 115 described 3rd along the two opposite sides of the first axial direction (such as X-axis)
It is divided to and the Part IV is the plurality of lenticule 115 along the two relative of second axially (such as Y-axis)
Side.
When the picture element matrix 111 is configured comprising four kinds of pixels, in step S62, the processor 11
By in every picture frame F, the plurality of 3rd pixel P is corresponded to3The 3rd image-region IP3Form the 3rd
Subframe FP3, by correspondence the plurality of 4th pixel P4The 4th image-region IP4Form the 4th subframe FP4。
In some embodiments, during first mode, 13 difference block 135 of the processor only produces infrared ray
Frame FinfAnd do not produce the first subframe FP1To the 4th subframe FP4；During second mode, the processor 13
Calculations of offset module 137 only produces the first subframe FP1To the second subframe FP4And do not produce infrared ray subframe
Finf。
Step S63：The selecting module 133 of the processor 13 is average bright according to described image frame F's
Degree judges whether ambient light is too strong.In one embodiment, 133 basis of selecting module of the processor 13
The mean flow rate of dark picture frame selects first mode or second mode.In another embodiment, the processor
13 selecting module 133 according to the mean luminance differences of bright picture frame and dark picture frame select first mode or
Second mode.In present invention explanation, the first mode for example, general mode or low light level pattern are described
Second mode is, for example, high light pattern.Thereby, the processor 13 can be selected according to the power of ambient light
Suitable algorithm is isolating an at least foreground image.
Step S64：When ambient light is not very strong, then into first mode.Now, the processor
13 difference block 135 can directly calculate infrared ray subframe F of bright picture frameinf_BIt is red with dark picture frame
Outside line subframe Finf_DDifference image isolating at least one foreground object image I9, as shown in Figure 5.
In more detail, infrared ray pixel PinfThe grey decision-making of output be used in the ordinary mode calculate and not strong
Calculated in optical mode.
Step S65：When ambient light is very strong, then into second mode.Now, the processor 13
Side-play amount computing module 137 according to first subframe FP1And second subframe FP2Calculate at least one
Individual first side-play amount (such as S shown in Fig. 41With S2Side-play amount), and by described in preset range
An at least image-region corresponding to first side-play amount is identified as at least one foreground image.As it was previously stated,
The preset range is the default bias amount scope of the operable scope of correspondence.
When the picture element matrix 111 is configured comprising four kinds of pixels, in step S65, the processor 13
Side-play amount computing module 137 further accordance with the 3rd subframe FP3And the 4th subframe FP4Calculate at least
Second side-play amount (such as S shown in the 4th3With S4Side-play amount), and by described in preset range
At least one image-region corresponding to two side-play amounts is identified as at least one foreground image.Mandatory declaration
It is, might not be complete according to the foreground image identified with second side-play amount by first side-play amount
It is exactly the same, may only part it is identical or entirely different, hold depending on the characteristics of image in described image frame F.
Finally, the application module 139 of the processor 13 can be according to the foreground image output for being identified
Control signal Sc carries out gesture identification etc. to carry out different application, such as.
Additionally, in order to increase identification accuracy, the processor 13 can be using shadowing method correction described the
One subframe FP1And second subframe FP2Brightness be consistent and correct the 3rd subframe FP3And it is described
4th subframe FP4Brightness be it is consistent, with calculate side-play amount when, in first subframe FP1With it is described
Second subframe FP2In be easier to find corresponding image-region, it is and described in the 3rd subframe FP3With it is described
4th subframe FP4In be easier to find corresponding image-region.
In sum, it is known that gesture recognition system is when ambient light is stronger, it may appear that correctly cannot operate
Situation.Therefore, present invention explanation proposes a kind of imaging device (Fig. 1) and its How It Works (Fig. 6),
Which isolates foreground image using under varying environment luminous intensity using algorithms of different, to overcome known gesture
The problem of identifying system.
Although the present invention is disclosed by previous examples, which is not limited to the present invention, and any is sent out
Technical staff with usual knowledge in bright art, without departing from the spirit and scope of the present invention
It is interior, when various changes and modification can be made.Therefore protection scope of the present invention is when regarding appended claims
The scope for being defined is defined.
Claims (21)
1. a kind of imaging device, the imaging device are included：
Collector lens；
Imageing sensor, to sense the light for penetrating the collector lens, described image sensor is included：
Picture element matrix, comprising in the first direction and second direction arrangement multiple infrared ray pixels, multiple
First pixel and multiple second pixels；
Light shield layer, covers above the first area of the plurality of first pixel and the plurality of second picture
Above the second area of element, wherein, the first area is with the second area along the first direction shape
It is mirrored into symmetrical；
Multiple lenticules, are arranged on above the picture element matrix；And
Infrared light filter layer, is covered in above the plurality of infrared ray pixel.
2. imaging device according to claim 1, wherein described picture element matrix is also comprising multiple the
Three pixels and multiple 4th pixels, the light shield layer are also covered in the 3rd region of the plurality of 3rd pixel
Top and the 4th overlying regions of the plurality of 4th pixel, wherein, the 3rd region and the described 4th
Region forms specular along the second direction.
3. imaging device according to claim 2, wherein described first area, secondth area
Domain, the 3rd region and the 5%-95% that the 4th region is single elemental area.
4. a kind of imaging device, the imaging device are included：
Infrared light supply；
Collector lens；
Imageing sensor, to sense the light for penetrating the collector lens, lights in the infrared light supply
When export bright picture frame and export dark picture frame, described image sensor bag when the infrared light supply extinguishes
Contain：
Picture element matrix, comprising in the first direction and second direction arrangement multiple infrared ray pixels, multiple
First pixel and multiple second pixels；
Light shield layer, covers above the first area of the plurality of first pixel and the plurality of second picture
Above the second area of element, wherein, the first area is with the second area along the first direction shape
It is mirrored into symmetrical；
Multiple lenticules, are arranged on above the picture element matrix；And
Infrared light filter layer, is covered in above the plurality of infrared ray pixel；And
Processor, by the bright picture frame and the dark picture frame, to correspond to the plurality of infrared ray
The infrared view region of pixel forms infrared ray subframe, the first image of the plurality of first pixel of correspondence
Region forms the first subframe, and the second image-region of the plurality of second pixel of correspondence forms the second subframe,
And first mode calculate the infrared ray subframe of the bright picture frame with described in the dark picture frame
The difference image of infrared ray subframe isolating at least one foreground image, or in second mode according to described
First subframe and second subframe isolate at least one foreground image.
5. imaging device according to claim 4, wherein described processor is to according to described dark
The mean flow rate of picture frame selects the first mode or the second mode.
6. imaging device according to claim 4, wherein described processor is to according to described bright
Picture frame selects the first mode or the second mode with the mean luminance differences of the dark picture frame.
7. imaging device according to claim 4, wherein described processor is to according to described bright
First subframe and second subframe of picture frame or the dark picture frame isolates described at least one
Individual foreground image.
8. imaging device according to claim 7, wherein described processor are sub according to described first
Frame and second subframe calculate at least one first side-play amounts, and by described the in preset range
Image-region corresponding to one side-play amount is identified as at least one foreground image.
9. imaging device according to claim 4, wherein described picture element matrix is also comprising multiple the
Three pixels and multiple 4th pixels, the light shield layer are also covered in the 3rd region of the plurality of 3rd pixel
Top and the 4th overlying regions of the plurality of 4th pixel, wherein, the 3rd region and the described 4th
Region forms specular along the second direction.
10. imaging device according to claim 9, wherein described first area, secondth area
Domain, the 3rd region and the 5%-95% that the 4th region is single elemental area.
11. imaging devices according to claim 9, wherein described processor is also to will be described bright
In picture frame and the dark picture frame, the 3rd image-region of the plurality of 3rd pixel of correspondence forms the 3rd
Subframe, the 4th image-region of the plurality of 4th pixel of correspondence form the 4th subframe, and described second
Pattern is according to the 3rd subframe and the 4th subframe of the bright picture frame or the dark picture frame point
Separate out at least one foreground image.
12. imaging devices according to claim 11, wherein described processor is according to the described 3rd
Subframe and the 4th subframe calculate at least one second side-play amounts, and by described in preset range
Image-region corresponding to second side-play amount is identified as at least one foreground image.
13. imaging devices according to claim 11, wherein described processor also utilize shadowing method
The brightness for correcting first subframe and second subframe is consistent, corrects the 3rd subframe and described
The brightness of the 4th subframe is consistent.
The How It Works of 14. a kind of imaging device, the imaging device include infrared light supply, multiple infrared
Line pixel, multiple first pixels, multiple second pixels and multiple lenticules, the plurality of first pixel and
The plurality of second pixel passes through the plurality of lenticular Part I respectively and Part II is received not
Synchronous incident light, the How It Works are included：
Bright picture frame is exported and in the infrared light with the imaging device when the infrared light supply is lighted
Source exports dark picture frame when extinguishing；
The infrared view region of correspondence the plurality of infrared ray pixel is formed into infrared ray subframe, will correspondence
First image-region of the plurality of first pixel forms the first subframe, by correspondence the plurality of second pixel
The second image-region formed the second subframe；
In the first mode, the infrared ray subframe of the bright picture frame and the dark picture frame are calculated
The difference image of the infrared ray subframe is isolating at least one foreground image；And
In a second mode, at least one prospect is isolated according to first subframe and second subframe
Image.
15. How It Works according to claim 14, the How It Works are also included：
The first mode or the second mode are selected according to the mean flow rate of the dark picture frame.
16. How It Works according to claim 14, the How It Works are also included：
According to the bright picture frame and the mean luminance differences of the dark picture frame select the first mode or
The second mode.
17. How It Works according to claim 14, the How It Works are also included：
At least one first side-play amounts are calculated according to first subframe and second subframe, and will be between
The image-region corresponding to first side-play amount in preset range is identified as at least one prospect
Image.
18. How It Works according to claim 14, wherein described imaging device is also comprising multiple
3rd pixel and multiple 4th pixels, the plurality of 3rd pixel and the plurality of 4th pixel pass through respectively
The incident light of the plurality of lenticular Part III and Part IV reception out of phase, described first
Divide and the Part II is that the plurality of lenticule is described 3rd along the two opposite sides of the first axial direction
Divide and the Part IV is two opposite sides of the plurality of lenticule along the second axial direction.
19. How It Works according to claim 18, the How It Works are also included：
3rd image-region of correspondence the plurality of 3rd pixel is formed into the 3rd subframe；
4th image-region of correspondence the plurality of 4th pixel is formed into the 4th subframe；And
At least one second side-play amounts are calculated according to the 3rd subframe and the 4th subframe, and will be between
The image-region corresponding to second side-play amount in preset range is identified as at least one prospect
Image.
20. How It Works according to claim 19, the How It Works are also included：
The brightness for correcting first subframe and second subframe using shadowing method is consistent, and correction is described
The brightness of the 3rd subframe and the 4th subframe is consistent.
A kind of 21. imageing sensors, the imageing sensor are included：
Picture element matrix, comprising in the first direction and second direction arrangement multiple infrared ray pixels, Duo Ge
One pixel and multiple second pixels；
Light shield layer, covers above the first area of the plurality of first pixel and the plurality of second pixel
Second area above, wherein, the first area is formed along the first direction with the second area
Specular；
Multiple lenticules, are arranged on above the picture element matrix；And
Infrared light filter layer, is covered in above the plurality of infrared ray pixel.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910706667.6A CN110598685B (en) | 2015-09-14 | 2015-09-14 | Imaging device for resolving foreground |
| CN201510581322.4A CN106534721B (en) | 2015-09-14 | 2015-09-14 | The imaging device and its operation method of resolution prospect |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510581322.4A CN106534721B (en) | 2015-09-14 | 2015-09-14 | The imaging device and its operation method of resolution prospect |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910706667.6A Division CN110598685B (en) | 2015-09-14 | 2015-09-14 | Imaging device for resolving foreground |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106534721A true CN106534721A (en) | 2017-03-22 |
| CN106534721B CN106534721B (en) | 2019-08-27 |
Family
ID=58348992
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510581322.4A Active CN106534721B (en) | 2015-09-14 | 2015-09-14 | The imaging device and its operation method of resolution prospect |
| CN201910706667.6A Active CN110598685B (en) | 2015-09-14 | 2015-09-14 | Imaging device for resolving foreground |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910706667.6A Active CN110598685B (en) | 2015-09-14 | 2015-09-14 | Imaging device for resolving foreground |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN106534721B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008058976A (en) * | 2007-09-10 | 2008-03-13 | Semiconductor Energy Lab Co Ltd | Semiconductor device |
| CN101689557A (en) * | 2008-07-11 | 2010-03-31 | 松下电器产业株式会社 | Solid-state imaging device |
| US20110116078A1 (en) * | 2009-11-16 | 2011-05-19 | Samsung Electronics Co., Ltd. | Infrared image sensor |
| CN102289131A (en) * | 2010-06-17 | 2011-12-21 | 奥林巴斯株式会社 | Image pickup apparatus |
| CN104221149A (en) * | 2012-03-28 | 2014-12-17 | 富士胶片株式会社 | Imaging element and imaging device |
| CN104318199A (en) * | 2014-06-23 | 2015-01-28 | 上海箩箕技术有限公司 | Compound optical sensor and manufacture method and use method thereof |
Family Cites Families (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101779154B (en) * | 2007-08-13 | 2012-03-07 | 松下电器产业株式会社 | Imaging device and camera |
| JP5366619B2 (en) * | 2008-08-12 | 2013-12-11 | キヤノン株式会社 | Image processing apparatus, imaging apparatus, image processing method, and image processing program |
| JP5585208B2 (en) * | 2010-05-20 | 2014-09-10 | ソニー株式会社 | Solid-state imaging device and electronic apparatus |
| US8408821B2 (en) * | 2010-10-12 | 2013-04-02 | Omnivision Technologies, Inc. | Visible and infrared dual mode imaging system |
| JP6119193B2 (en) * | 2012-02-24 | 2017-04-26 | 株式会社リコー | Distance measuring device and distance measuring method |
| TWI595219B (en) * | 2012-05-08 | 2017-08-11 | Sony Corp | Infrared conversion element, imaging device and imaging method |
| KR102111181B1 (en) * | 2012-08-21 | 2020-05-15 | 포토내이션 리미티드 | Systems and methods for parallax detection and correction in images captured using array cameras |
-
2015
- 2015-09-14 CN CN201510581322.4A patent/CN106534721B/en active Active
- 2015-09-14 CN CN201910706667.6A patent/CN110598685B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2008058976A (en) * | 2007-09-10 | 2008-03-13 | Semiconductor Energy Lab Co Ltd | Semiconductor device |
| CN101689557A (en) * | 2008-07-11 | 2010-03-31 | 松下电器产业株式会社 | Solid-state imaging device |
| US20110116078A1 (en) * | 2009-11-16 | 2011-05-19 | Samsung Electronics Co., Ltd. | Infrared image sensor |
| CN102289131A (en) * | 2010-06-17 | 2011-12-21 | 奥林巴斯株式会社 | Image pickup apparatus |
| CN104221149A (en) * | 2012-03-28 | 2014-12-17 | 富士胶片株式会社 | Imaging element and imaging device |
| CN104318199A (en) * | 2014-06-23 | 2015-01-28 | 上海箩箕技术有限公司 | Compound optical sensor and manufacture method and use method thereof |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110598685A (en) | 2019-12-20 |
| CN106534721B (en) | 2019-08-27 |
| CN110598685B (en) | 2023-06-30 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11418729B2 (en) | Image sensor having symmetrical opaque layer | |
| JP6110862B2 (en) | Object distance determination from images | |
| CN101836180B (en) | Detecting ambient light levels in a vision system | |
| US7359564B2 (en) | Method and system for cancellation of ambient light using light frequency | |
| US9438813B2 (en) | Lighting system and method for image and object enhancement | |
| US11818462B2 (en) | Phase detection autofocus sensor apparatus and method for depth sensing | |
| WO2014170154A1 (en) | A method of characterizing a light source and a mobile device | |
| KR101956928B1 (en) | Image acquisition method of camera base touch screen apparatus | |
| CN101937505B (en) | Target detection method and equipment and used image acquisition device thereof | |
| KR101516487B1 (en) | Image processing device using difference camera | |
| CN201440274U (en) | Target detection equipment and image acquisition device used by same | |
| KR20120070320A (en) | Display system including stereo camera and position detecting method using the same | |
| CN109300186B (en) | Image processing method and device, storage medium and electronic equipment | |
| CN106534721A (en) | Imaging device capable of distinguishing foreground, operation method thereof and imaging sensor | |
| KR101929003B1 (en) | Oled display apparatus having optical sensing funtion | |
| CN106352847A (en) | Phase difference based distance measurement device and distance measurement method | |
| US9906705B2 (en) | Image pickup apparatus | |
| JP5924577B2 (en) | Position detection device | |
| CN109973942B (en) | Controller, control system and control method thereof | |
| US20240137456A1 (en) | Optical sensor having opaque layer | |
| JP2019202580A (en) | Light distribution controller, light projection system, and light distribution control method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |