CN106250839B - A kind of iris image perspective correction method, apparatus and mobile terminal - Google Patents
A kind of iris image perspective correction method, apparatus and mobile terminal Download PDFInfo
- Publication number
- CN106250839B CN106250839B CN201610602917.8A CN201610602917A CN106250839B CN 106250839 B CN106250839 B CN 106250839B CN 201610602917 A CN201610602917 A CN 201610602917A CN 106250839 B CN106250839 B CN 106250839B
- Authority
- CN
- China
- Prior art keywords
- iris image
- image
- iris
- angle
- unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/18—Eye characteristics, e.g. of the iris
- G06V40/193—Preprocessing; Feature extraction
Abstract
The invention discloses a kind of iris image perspective correction methods, suitable for executing in the terminal, this method comprises: obtaining the original iris image of user to be identified;Calculate the three dimensional space coordinate p of every bit in the original iris images';The direction of visual lines of human eye and the angle theta of horizontal direction when obtaining original iris image according to the positional information calculation of the human eye iris and its original iris image;The transformation matrix of the iris image perspective correction is constructed according to the angle, θ;According to the transformation matrix to the three dimensional space coordinate p of the original iris images' is coordinately transformed, the three dimensional space coordinate p of the iris image after being correcteds.The invention also discloses a kind of iris image perspective correction device and mobile terminals.
Description
Technical field
The present invention relates to image procossings and area of pattern recognition, more particularly, to a kind of iris image perspective correction side
Method, device and mobile terminal.
Background technique
With the fast development of intelligent mobile terminal and network technology, safety of the people to information especially personal information
It is continuously improved with stability requirement, the application of authentication is carried out using people's unique physiological characteristic inherently or behavioural characteristic
It is more and more extensive.Wherein, other than the technologies such as fingerprint recognition, recognition of face, in addition one more safety iris recognition skill
Art is also increasingly subject to the favor of people.Moreover, with the continuous progress of science and technology, iris authentication system is gradually applied to mobile phone, puts down
In small and exquisite, frivolous, the portable electronic equipment such as plate and notebook.
In general, when user carries out iris recognition using mobile phone, in order to see the eye image presented on the display screen,
It needs to make to generate an angle between eyes and mobile phone.This angle makes the profile of iris image become ellipse from circle.
Due to blocking for eyelid, the profile of iris image is usually incomplete circle or ellipse.Existing Algorithm of Iris Recognition can be reliable
Incomplete circle is efficiently detected, but cannot reliably and effectively detect incomplete ellipse.
The current method for carrying out perspective correction to iris image has the automatic distortions correction based on characteristic point detection, the party
Method is it needs to be determined that the location information of characteristic point or have reference picture.That is, one group of feature that comparison detects in a reference image
Point and another group of characteristic point detected in present image, estimate the rotation and translation between camera and target, then right
Present image is converted, and is obtained and characteristic point position consistent in reference picture.Obviously, this method requires to hold in the picture
It easily detects enough and sufficiently stable characteristic point, and to extraneous illumination condition and interferes also more sensitive.For different
The face area of people, it is difficult to reliably obtain the characteristic point of fixed position, and calculation amount is larger, not be suitable for mobile terminal rainbow
The requirement of real-time of film application.
It is, therefore, desirable to provide a kind of quick approximation method for correcting this metamorphopsic distortion automatically, obtains one and round lose
Very lesser iris image, reduces the difficulty of subsequent processing.
Summary of the invention
For this purpose, the present invention provides a kind of iris image perspective correction method, apparatus and mobile terminal, to try hard to solve or
At least alleviate at least one existing problem above.
According to an aspect of the present invention, a kind of iris image perspective correction method should suitable for executing in the terminal
Method includes: the original iris image for obtaining user to be identified;Calculate the three dimensional space coordinate of every bit in original iris image
ps';The sight side of human eye when obtaining original iris image according to the positional information calculation of human eye iris and its original iris image
To the angle theta with horizontal direction;The transformation matrix of iris image perspective correction is constructed according to angle, θ;According to transformation matrix to original
The three dimensional space coordinate p of beginning iris images' is coordinately transformed, the three dimensional space coordinate p of the iris image after being correcteds。
Optionally, in iris image perspective correction method according to the present invention, further includes: described in being constructed according to angle, θ
Spin matrix R and the R ' of camera lens and former world coordinate system, wherein setting the origin of former world coordinate system as incident light axis and people
The intersection point of plane where eye iris, and gravity and horizontal direction are located at there are two reference axis.
Optionally, in iris image perspective correction method according to the present invention, ps=CR [(R ')-1C-1ps'+c '-c],
Wherein, C is the camera matrix by coefficient adjustment, suitable for the pixel unit in image is converted to length unit;C and c ' difference
Be camera optical center relative to former world coordinate system and former world coordinate system around non-gravity and the axis of the horizontal direction rotation angle θ
The coordinate of new coordinate system afterwards.
Optionally, in iris image perspective correction method according to the present invention,Wherein,It is the depth information of every bit in original iris image, suitable for being calculated according to rotation angle, θ and object distance u.
Optionally, in iris image perspective correction method according to the present invention, R is unit matrix,
Optionally, in iris image perspective correction method according to the present invention, the calculation formula of angle, θ are as follows:
Wherein, u is object distance, and v is image distance, and h is that the central point in infrared imaging region in imaging sensor is passed to described image
The distance of sensor central point, H are the central points of the human eye iris to the distance of the incident light axis, and a is the mobile terminal
Screen in image display area to described image sensor central point distance.
Optionally, in iris image perspective correction method according to the present invention, c=[cx,cy,cz]T, c '=[cx',
cy', cz']T, wherein T is matrix transposition, c and c ' is suitable for central point and incident light by angle theta, object distance u and human eye iris
The distance H of axis is calculated.
Optionally, in iris image perspective correction method according to the present invention, cx=cy=0, cz=-u, cx'=0,
Optionally, in iris image perspective correction method according to the present invention, camera matrix
Focal length (f including two change in coordinate axis directionx, fy) and optical center coordinate (cx, cy)。
Optionally, in iris image perspective correction method according to the present invention, further includes: according to eyes location algorithm from
Position of human eye is determined in imaging region, and its position coordinates is scaled length unit from pixel unit;And it will be after correction
Length unit in iris image coordinate is scaled pixel unit, and the iris image that remaps.
According to another aspect of the present invention, a kind of iris image perspective correction device is provided, suitable for residing in movement
In terminal, which includes: image acquisition unit, suitable for obtaining the original iris image of user to be identified;Coordinate calculating unit,
Suitable for calculating the three dimensional space coordinate p of every bit in original iris images';Angle calculation unit, be suitable for according to human eye iris and
The angle of the direction of visual lines of human eye and horizontal direction when the positional information calculation of its original iris image obtains original iris image
θ;Matrix construction unit, suitable for constructing the transformation matrix of iris image perspective correction according to angle, θ;Coordinate transformation unit is suitable for
According to transformation matrix to the three dimensional space coordinate p of original iris images' is coordinately transformed, the iris image after being corrected
Three dimensional space coordinate ps。
Optionally, in iris image perspective correction device according to the present invention, matrix construction unit is further adapted for according to angle
Spin matrix R and the R ' for spending θ building camera lens and former world coordinate system, wherein setting the origin of former world coordinate system as incident light
The intersection point of plane where axis and human eye iris, and gravity and horizontal direction are located at there are two reference axis.
Optionally, in iris image perspective correction device according to the present invention, ps=CR [(R ')-1C-1ps'+c '-c],
Wherein, C is the camera matrix by coefficient adjustment, suitable for the pixel unit in image is converted to length unit;C and c ' difference
Be camera optical center relative to former world coordinate system and former world coordinate system around non-gravity and the axis of the horizontal direction rotation angle θ
The coordinate of new coordinate system afterwards.
Optionally, in iris image perspective correction device according to the present invention,Wherein,It is the depth information of every bit in original iris image, suitable for being calculated according to rotation angle, θ and object distance u.
Optionally, in iris image perspective correction device according to the present invention, R is unit matrix,
Optionally, in iris image perspective correction device according to the present invention, the calculation formula of angle, θ are as follows:
Wherein, u is object distance, and v is image distance, and h is that the central point in infrared imaging region in imaging sensor is passed to described image
The distance of sensor central point, H are the central points of the human eye iris to the distance of the incident light axis, and a is the mobile terminal
Screen in image display area to described image sensor central point distance.
Optionally, in iris image perspective correction device according to the present invention, c=[cx,cy,cz]T, c '=[cx',
cy', cz']T, wherein T is matrix transposition, c and c ' is suitable for central point and incident light by angle theta, object distance u and human eye iris
The distance H of axis is calculated.
Optionally, in iris image perspective correction device according to the present invention, cx=cy=0, cz=-u, cx'=0,
Optionally, in iris image perspective correction device according to the present invention, camera matrix
Focal length (f including two change in coordinate axis directionx, fy) and optical center coordinate (cx, cy)。
Optionally, further include unit conversion unit in iris image perspective correction device according to the present invention, be suitable for root
Position of human eye is determined from imaging region according to eyes location algorithm, and its position coordinates is scaled length list from pixel unit
Position;And suitable for the length unit in the iris image coordinate after correction is scaled pixel unit, and the iris figure that remaps
Picture.
According to a further aspect of the invention, a kind of mobile terminal, including iris image as described above perspective are provided
Means for correcting.
Optionally, in mobile terminal according to the present invention, further include and the iris image perspective correction device phase coupling
The complex imaging system connect, the complex imaging system include: lens assembly, the optical lens including fixed focal length;Filter set
Part, including the visible band pass filter for allowing the light of visible light wave range to pass through and the near-infrared for allowing near infrared light wave band to pass through
Light bandpass region;And imaging sensor, including visual light imaging region, near infrared light imaging region and the two regions it
Between transitional region, wherein visual light imaging region under visual light imaging mode to by visible band pass filter can
It is light-exposed be imaged and near infrared light imaging region under near infrared light imaging mode to by near infrared light bandpass filter
Near infrared light be imaged.
According to the technique and scheme of the present invention, human eye sight when iris recognition is whole relative to the rotation of mobile terminal or movement
The rotation relative to human eye sight is held, human eye sight is uniformly equivalent to and rotates the angle θ, gravity side in world coordinate system from horizontal direction
To axis also rotate the angle θ.This programme is calculated according to the relationship of the display position of human eye iris, imaging position and sight angle
Tilt angle of the mobile terminal when carrying out iris recognition, and the change by calculating tilt angle building iris image perspective correction
Change matrix.Human eye iris is carried out to inverse perspective projection according to transformation matrix under the coordinate system of rotation, then in the coordinate not rotated
System is lower to carry out perspective projection, and the screen out of plumb of the direction of visual lines of human eye and mobile terminal is led when can be solved because of iris recognition
The problem of iris image deformation of cause.I.e. by the angle of estimation human eye and imaging device, the quick correction of distorted image is realized
The iris image of ellipse is modified to closer to circle, is convenient for subsequent identifying processing, improves the accurate of iris recognition by transformation
Degree.
Detailed description of the invention
To the accomplishment of the foregoing and related purposes, certain illustrative sides are described herein in conjunction with following description and drawings
Face, these aspects indicate the various modes that can practice principles disclosed herein, and all aspects and its equivalent aspect
It is intended to fall in the range of theme claimed.Read following detailed description in conjunction with the accompanying drawings, the disclosure it is above-mentioned
And other purposes, feature and advantage will be apparent.Throughout the disclosure, identical appended drawing reference generally refers to identical
Component or element.
Fig. 1 shows the structural block diagram of mobile terminal 100 according to an embodiment of the invention;
Fig. 2 shows the structural frames of the complex imaging system 200 of mobile terminal 100 according to an embodiment of the invention
Figure;
Fig. 3 shows the schematic diagram using mobile terminal acquisition self-timer image and iris recognition image;
Fig. 4 shows imaging position of the human eye iris according to an embodiment of the invention under different sight angle and shows
Show the schematic diagram of position;
Fig. 5 shows the flow chart of iris image perspective correction method 500 according to an embodiment of the invention;
Fig. 6 A and 6B respectively illustrate the image schematic diagram before and after progress perspective correction according to an embodiment of the invention;
Fig. 7 shows the structural block diagram of iris image perspective correction device 700 according to an embodiment of the invention.
Specific embodiment
Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing
Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here
It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure
It is fully disclosed to those skilled in the art.
Fig. 1 is 100 organigram of mobile terminal according to an embodiment of the invention.As described in Figure 1, mobile whole
End 100 includes: memory interface 102, one or more data processor, image processor and/or central processing unit 104,
And peripheral interface 106.Memory interface 102, one or more processors 104 and/or peripheral interface 106 are either discrete
Element also can integrate in one or more integrated circuits.In the mobile terminal 100, various elements can by one or
A plurality of communication bus or signal wire couple.Sensor, equipment and subsystem may be coupled to peripheral interface 106, to help
Realize multiple functions.For example, motion sensor 110, optical sensor 112 and range sensor 114 may be coupled to peripheral interface
106, to facilitate the functions such as orientation, illumination and ranging.Other sensors 116 can equally be connected with peripheral interface 106, such as fixed
Position system (such as GPS receiver), temperature sensor, biometric sensor or other sensor devices, it is possible thereby to help reality
Apply relevant function.
Camera sub-system 120 and optical sensor 122 can be used for the camera of convenient such as record photos and video clips
The realization of function, wherein the camera sub-system and optical sensor for example can be charge-coupled device (CCD) or complementary gold
Belong to oxide semiconductor (CMOS) optical sensor.It can help to realize by one or more radio communication subsystems 124
Communication function, wherein radio communication subsystem may include radio-frequency transmitter and transmitter and/or light (such as infrared) receiver
And transmitter.The particular design and embodiment of radio communication subsystem 124 can depend on mobile terminal 100 is supported one
A or multiple communication networks.For example, mobile terminal 100 may include being designed to support GSM network, GPRS network, EDGE net
The communication subsystem 124 of network, Wi-Fi or WiMax network and BlueboothTM network.Audio subsystem 126 can be with loudspeaking
Device 128 and microphone 130 are coupled, to help the function of implementing to enable voice, such as speech recognition, speech reproduction, number
Word record and telephony feature.
I/O subsystem 140 may include touch screen controller 142 and/or other one or more input controllers 144.
Touch screen controller 142 may be coupled to touch screen 146.For example, the touch screen 146 and touch screen controller 142 can be with
The contact carried out therewith and movement or pause are detected using any one of a variety of touch-sensing technologies, wherein sensing skill
Art includes but is not limited to capacitive character, resistive, infrared and surface acoustic wave technique.Other one or more input controllers 144
May be coupled to other input/control devicess 148, for example, one or more buttons, rocker switch, thumb wheel, infrared port,
The pointer device of USB port, and/or stylus etc.One or more of button (not shown)s may include for controlling
The up/down button of 130 volume of loudspeaker 128 and/or microphone.
Memory interface 102 can be coupled with memory 150.The memory 150 may include that high random access is deposited
Reservoir and/or nonvolatile memory, such as one or more disk storage equipments, one or more optical storage apparatus, and/
Or flash memories (such as NAND, NOR).Memory 150 can store an operating system 152, for example, Android, IOS or
The operating system of Windows Phone etc.The operating system 152 may include for handling basic system services and execution
The instruction of task dependent on hardware.Memory 150 can also be stored using 154.These applications in operation, can be from memory
150 are loaded on processor 104, and run on the operating system run via processor 104, and utilize operating system
And the interface that bottom hardware provides realizes the various desired functions of user, such as instant messaging, web page browsing, pictures management.
Using can be independently of operating system offer, it is also possible to what operating system carried.In addition, being mounted to shifting using 154
When in dynamic terminal 100, drive module can also be added to operating system.
In above-mentioned various applications 154, one such application is iris image perspective correction related to the present invention dress
Set 700.In some embodiments, mobile terminal 100 is configured as executing iris image perspective correction method according to the present invention
400。
When carrying out iris recognition using mobile terminal, it usually needs individual near-infrared camera carries out iris imaging,
Can not be multiplexed with the camera of existing visual light imaging (spectral frequency is in 380-760nm) (for example smart phone is existing
The preposition colour imagery shot having), undoubtedly increase the structure complexity of mobile terminal.And it is carried out using mobile terminal single camera
Near infrared light and the Compound scan technology of visible light two waveband can effectively solve the above problems.Fig. 2 shows according to the present invention one
The structural block diagram of the complex imaging system 200 of the mobile terminal 100 of a embodiment.As shown in Fig. 2, the complex imaging system packet
Include: the complex imaging system 200 includes lens assembly 230, optical filter box 220 and the image successively arranged along input path
Sensor 210.Wherein, optical filter box 220 includes visible band pass filter 221 and the (figure of near infrared light bandpass filter 222
In be shown as being filled with backslash), imaging sensor 210 includes (being illustrated as with anti-for the region A of near infrared light imaging
Oblique line filling), for the region B of visual light imaging and the transitional region C between A, B area (be shown as being filled out with horizontal line
It fills).
Full spectrum light line incidence passes through lens assembly 230 and reaches optical filter box 220, wherein visible band pass filter
221 permission visible lights (for example, wavelength is 380-760nm) pass through, and near infrared light bandpass filter 222 allows near infrared light
(for example, wavelength is 780-880nm) passes through.Visible band pass filter 221 and near infrared light bandpass filter 222 can pass through
Plated film is realized.It is imaged, and passed through in the region B of imaging sensor substantially by the visible light of visible band pass filter 221
The near infrared light of near infrared light bandpass filter 222 is imaged in the region A of imaging sensor substantially.It can using image processing software
Respectively to distinguish the imaging of the region B and A of imaging sensor, wherein the imaging of region B corresponds to normal visible light
The mobile terminals such as imaging, such as user's use mobile phone carry out imaging when daily self-timer, and the imaging of region A corresponds to closely
Imaging under infrared mode, such as imaging of the user when carrying out iris recognition using mobile phone.In this way, can easily realize can
The light-exposed switching between near infrared light imaging switches optical filter without being equipped with moving component, is greatly improved steady
It is qualitative.
Fig. 3 shows the schematic diagram using mobile terminal acquisition self-timer image and iris recognition image.As shown in figure 3, with
In self-timer, the screen of mobile terminal is parallel with face at family, it can be observed that self-timer preview screen (such as lower left corner figure of full screen
Show).And when carrying out iris recognition, mobile terminal is tilted an angle, θ by user, to observe the iris for being located at screen top
It identifies in preview screen (as shown in the lower right corner).
Horizontal direction rotation alternatively, it is also possible to keep the screen of mobile terminal constant, when the direction of visual lines of face is from self-timer
Turn the angle θ.Because both iris recognition situations, mobile terminal and the relativeness of human eye sight are really the same, so
Both of which is unified for latter in invention, human eye iris shown in as Fig. 4 under different sight angle at
Image position and display position, to be calculated.When human eye sight is not orthogonal to display screen, iris recognition picture can be generated
Deformation influences the algorithm of iris recognition, carries out rainbow by estimating the tilt angle of mobile terminal this paper presents a kind of thus
The method of film image perspective correction.
As shown in figure 4, regarding iris as a disc, the plane where defining it is object plane.Ignore eyeball radius pair
The influence of the iris depth of field indicates the position of iris with the position of the eyeball centre of sphere.In order to make one eye iris in the red of imaging sensor
Outer smooth regional imaging need to guarantee that eyeball is located in the visual field scope of infrared light region.In order to keep iris image clear, need to guarantee
Eyeball is located in field depth.
Right-handed coordinate system is used, if world coordinate system, using the intersection point of object plane and optical axis as origin, x-axis forward direction is carried on the back from paper
Front is directed toward in face, and y-axis is positive downwards, and z-axis forward direction is to the right.Camera coordinate system is original with the camera lens center of mobile terminal
Point, x-axis forward direction are directed toward front from the paper back side, and y-axis is positive downwards, and z-axis forward direction is to the right.Sensor coordinate system image taking sensor
Center be origin, x-axis forward direction is directed toward front from the paper back side, and y-axis is positive downwards, and z-axis forward direction is to the right.Coordinate system rotation is used
Xyz Eulerian angles indicate, i.e., first rotate around x axis, and rotate further around new y-axis, rotate further around new z-axis.Rotate the positive direction of angle
It is defined by right hand rule, i.e., is positive-angle against the counter clockwise direction that reference axis is looked.
From the above description, it can be seen that object plane, as plane and image manifesting planes be world coordinate system, camera coordinates respectively
The X/Y plane of system and sensor coordinate system.When object plane is parallel with as plane, the profile of iris image is circle.But because
In the operation of actual iris recognition, for object plane with as plane and not parallel, it is ellipse for leading to the profile of the iris image finally obtained
It is round.
The initial direction of visual lines of human eye is horizontal direction in Fig. 4, shown in vector LOS0;When iris recognition, user in order to
Direction of visual lines is adjusted to LOS1 by the iris image shown by observing above the screen of mobile terminal, i.e., object plane is to cross eye
The direction x of ball center is that rotary shaft rotates clockwise the angle θ.The present invention guarantees the depth of field of eyeball and at image position in rotary course
It sets constant.Correspondingly, the Y-axis of former world coordinate system has also rotated clockwise the angle θ along X-axis.Wherein set sight when iris recognition
Angle between direction LOS1 and the Y-axis of former world coordinate system is α, the angle between the Y-axis of the world coordinate system rotated through
For β, it is known that, β=π-θ-α.
It keeps human eye sight direction constant if should be appreciated that, mobile terminal is rotated into the angle θ along away from human eye direction, then is existed
In this case world coordinate system is unchanged, but the X/Y plane of camera coordinates system and sensor coordinate system has rotated the angle θ around X-axis.But
Because camera coordinate system has rotated the angle θ relative to world coordinate system under right hand rule, be equivalent to world coordinate system relative to
Camera coordinate system has rotated-θ.So can be equivalent to keep camera coordinates system and sensor coordinate system constant, world coordinates
The X/Y plane of system rotates the angle-θ around X-axis.Such case still can be using iris position, imaging position, display shown in Fig. 4
Position and the position of world coordinate system indicate.
As shown in figure 4, set object distance as u, image distance v, the central point in infrared imaging region is passed to image in imaging sensor
The distance of sensor central point is h.According to pinhole imaging system principle, H=hu/v.The central point of human eye iris is separately set to incident light axis
Distance be H, the distance of image display area to image sensor center point is a in the screen of mobile terminal, in human eye iris
The heart is d at a distance from camera lens center.It, can be true from imaging region according to eyes location algorithm when carrying out distance calculating
Determine position of human eye, and its position coordinates is scaled length unit from pixel unit.
According to the above parameter, the angle changing between human eye sight LOS0 and sight LOS1 can be calculated are as follows:
Furthermore it is also possible to which the angle for obtaining Y-axis in iris imaging light LOS1 and former world coordinate system is α=arctan
(u/H) angle β=π-θ-α=π-θ-arctan of Y-axis and in iris imaging light LOS1 and postrotational world coordinate system
(u/H)。
As described above, camera rotation angle is θx=0, θy=0, θz=0, rotating angle according to camera can structure
Make spin matrix R.Due to not rotating, R is unit matrix.
And camera rotation angle is θ when iris recognitionx'=θ, θy'=0, θz'=0, rotating angle according to camera can
Construct spin matrix
In addition, camera center OcIt is c in the coordinate of former world coordinate systemx=0, cy=0, cz=-u is expressed as vector c
=[cx,cy,cz]T, wherein T is matrix transposition.Camera center O when iris recognitioncThe coordinate of world coordinate system after rotation
For c'x=0, c'y=H+dcos β, c'z=-dsin β is expressed as vector c'=[cx',cy',cz']T。
For camera lens, it is known that its focal length is f, and calibrated camera matrix is C.Succinct, the camera square to describe
Battle array is so that transformed pixel unit is become length unit by coefficient adjustment.
According to one embodiment, Ke YiquWhich includes the focal length (f of both directionx, fy) and
Optical center coordinate (cx, cy).It needs carrying out Conversion of measurement unit multiplied by unit conversion factor, when practical operation also needs to consider several non-thread
Property distortion.
It should be appreciated that iris coordinate and its image coordinate are the relationships of perspective projection.One point p of known spatialw=[xw,yw,
zw]TCoordinate p under camera coordinate systemc=[xc,yc,zc]TFor pc=R (pw- c), the coordinate under sensor coordinate system
For ps=Cpc, the form after depth is normalized isThe point will be lost i.e. on iris image
Depth information
It is thus known that existing deformed iris image, it can be according to space a little in world coordinate system, camera coordinates
Corresponding relationship under system and sensor coordinate system infers undeformed iris image coordinate.It specifically, can be according to original rainbow
Film image first in the coordinate system subinverse perspective projection of rotation, then the perspective projection under the coordinate system not rotated, can correct image
Deformation.
Wherein, in the coordinate system according to rotation against perspective projection process, the three-dimensional space for first obtaining current deformation pattern is sat
Mark ps'.Regard iris region as plane, using according to rotation angle, θ and object distance u, can estimate the depth of iris region every bit
Spend informationGenerate the coordinate under the sensor coordinate system with depth informationIt later, can basis
Sensor coordinate system and the variation relation of camera coordinates system restore coordinate p of the human eye iris under camera coordinate systemc'=C- 1ps'.Then seat of the human eye iris under former world coordinate system is acquired according to the transformation relation of camera coordinates system and world coordinate system
Mark pw=(R')-1pc'+c'。
Later, perspective projection process is carried out under the coordinate system not rotated, i.e., according to the coordinate p under former world coordinate systemw
Release the coordinate p under camera coordinates systemc=R (pw- c), then release the coordinate under sensor, the iris after being corrected
The three dimensional space coordinate p of images=CR [(R ')-1C-1ps'+c '-c].
Fig. 5 shows the flow chart of iris image perspective correction method 500 according to an embodiment of the invention.Such as Fig. 5
Shown, this method starts from step S510.
Then, in step S510, face iris image to be identified is acquired.It would generally for collected iris image
Some pretreatments are carried out, to improve its precision and clarity, such as are normalized or noise reduction process.
Then, in step S520, the three dimensional space coordinate p of every bit in original iris image is calculateds'.Specifically,Wherein,It is the depth information of every bit in original iris image, is suitable for according to rotation angle
Degree θ and object distance u is calculated.Wherein it is possible to determine position of human eye from imaging region according to eyes location algorithm, and by its position
It sets coordinate and is scaled length unit from pixel unit, so as to coordinate calculating.
Then, it in step S530, is obtained according to the positional information calculation of human eye iris and its original iris image original
The angle theta of the direction of visual lines of human eye and horizontal direction when iris image.Specifically,
Then, in step S540, the transformation matrix of iris image perspective correction is constructed according to angle, θ.Wherein, further include
Spin matrix R and the R ' of camera lens and former world coordinate system is constructed according to the angle, θ, if the origin of former world coordinate system is
The intersection point of plane where incident light axis and human eye iris, and gravity and horizontal direction are located at there are two reference axis.
Specifically, R is unit matrix,
Then, in step S550, according to the transformation matrix to the three dimensional space coordinate p of original iris images' is carried out
Coordinate transform, the three dimensional space coordinate p of the iris image after being correcteds.Specifically, ps=CR [(R ')-1C-1ps'+c '-c],
Wherein, C is the camera matrix by coefficient adjustment, suitable for the pixel unit in image is converted to length unit;C and c ' difference
It is the optical center of camera relative to former world coordinate system and the world coordinate system coordinate rotated through.
Wherein, c=[cx,cy,cz]T, c '=[cx', cy', cz']T, wherein T is matrix transposition, c and c ' is suitable for passing through folder
The central point of angle θ, object distance u and human eye iris are calculated with incident light axis distance H.
According to the calculating in Fig. 4, cx=cy=0, cz=-u, cx'=0,
Finally, the length unit in coordinate is scaled pixel unit, and the iris image that remaps, it can be by iris wheel
Exterior feature is corrected to circle from ellipse.Fig. 6 A and 6B are respectively illustrated before and after progress perspective correction according to an embodiment of the invention
Image schematic diagram.As can be seen that image is ellipse before perspective correction, and after carrying out perspective correction, image becomes round
Shape, hence it is evident that be conducive to subsequent identification process.
Fig. 7 shows the structural block diagram of iris image perspective correction device 700 according to an embodiment of the invention.Such as figure
Shown in 7, which includes: image acquisition unit 710, coordinate calculating unit 720, angle calculation unit 730, matrix construction unit
740 and coordinate transformation unit 750.
Image acquisition unit 710 is suitable for obtaining the original iris image of user to be identified.
Coordinate calculating unit 720 is suitable for calculating the three dimensional space coordinate p of every bit in original iris images'.
Angle calculation unit 730 is suitable for being obtained according to the positional information calculation of the human eye iris and its original iris image
The angle theta of the direction of visual lines of human eye and horizontal direction when original iris image.
Matrix construction unit 740 is suitable for constructing the transformation square of the iris image perspective correction according to the rotation angle, θ
Battle array.It wherein, further include spin matrix R and the R ' that camera lens and former world coordinate system are constructed according to rotation angle, θ.
Coordinate transformation unit, suitable for the three dimensional space coordinate p according to the transformation matrix and original iris images' pairs
The original iris image is coordinately transformed, the three dimensional space coordinate p of the iris image after being correcteds。
It can also include unit conversion unit according to one embodiment, be suitable for according to eyes location algorithm from imaging region
Middle determining position of human eye, and its position coordinates is scaled length unit from pixel unit;And by the iris after the correction
Length unit in image coordinate is scaled pixel unit, and the iris image that remaps.
Iris image perspective correction device 700 according to the present invention, detail, the calculating of especially each parameter
Journey is disclosed in detail in the description based on Fig. 1-Fig. 6, and details are not described herein.
It can be seen that the present invention determines human eye iris in imaging sensor by the iris region in positioning infrared image
The imaging position of device, the display position on mobile terminal screen, and the human eye iris position of itself is combined, estimate acquisition rainbow
The angle of mobile terminal and human eye sight direction when film image, this angle may be caused by human eye sight direction change, can also
Caused by can be because of rotation of mobile terminal.Further, it can confirm the angle between imaging sensor and human eye iris, and according to the angle
Degree establishes the transformation matrix of iris image perspective transform.Origin distortion iris image is converted according to the transformation matrix, i.e.,
First in the coordinate system subinverse perspective projection of rotation, then the perspective projection under the coordinate system not rotated, anamorphose can be corrected, is obtained
To approximate undistorted iris image.According to the solution of the present invention, it can effectively eliminate human eye sight and be not orthogonal to screen when institute
Caused by imaging distortion the problem of, the iris image of ellipse is corrected to approximate circle, facilitates subsequent iris recognition process,
To improve the accuracy of iris recognition.
A8, the method as described in A7, wherein cx=cy=0, cz=-u, cx'=0,
A9, the method as described in A3, wherein the camera matrixIncluding two change in coordinate axis direction
Focal length (fx, fy) and optical center coordinate (cx, cy)。
A10, method as described in a1, further includes: position of human eye is determined from imaging region according to eyes location algorithm, and
Its position coordinates is scaled length unit from pixel unit;And by the length list in the iris image coordinate after the correction
Position is scaled pixel unit, and the iris image that remaps.
B12, device as described in b11, the matrix construction unit are further adapted for constructing the camera mirror according to the angle, θ
Spin matrix R and the R ' of head and former world coordinate system, wherein setting the origin of former world coordinate system as incident light axis and human eye iris
The intersection point of place plane, and gravity and horizontal direction are located at there are two reference axis.
B13, as described in B12 device, ps=CR [(R ')-1C-1ps'+c '-c], wherein C is the phase by coefficient adjustment
Machine matrix, suitable for the pixel unit in image is converted to length unit;C and c ' is the optical center of camera respectively relative to original
The coordinate of the new coordinate system of world coordinate system and former world coordinate system after non-gravity and the axis of the horizontal direction rotation angle θ.
B14, device as described in b11,Wherein,It is each in original iris image
The depth information of point, suitable for being calculated according to rotation angle, θ and object distance u.
B15, as described in B12 device, wherein
R is unit matrix,
B16, device as described in b11, the calculation formula of the angle, θ are as follows:
Wherein, u is object distance, and v is image distance, and h is that the central point in infrared imaging region in imaging sensor is passed to described image
The distance of sensor central point, H are the central points of the human eye iris to the distance of the incident light axis, and a is the mobile terminal
Screen in image display area to described image sensor central point distance.
B17, the device as described in B13, c=[cx,cy,cz]T, c '=[cx', cy', cz']T, wherein T is matrix transposition, c
It is suitable for being calculated by the central point of angle theta, object distance u and human eye iris and incident light axis distance H with c '.
B18, the method as described in B17, wherein cx=cy=0, cz=-u, cx'=0,
B19, the device as described in B13, wherein the camera matrixIncluding two reference axis sides
To focal length (fx, fy) and optical center coordinate (cx, cy)。
B20, device as described in b11, further includes: unit conversion unit is suitable for according to eyes location algorithm from imaging area
Position of human eye is determined in domain, and its position coordinates is scaled length unit from pixel unit;And by the rainbow after the correction
Length unit in film image coordinate is scaled pixel unit, and the iris image that remaps.
It should be appreciated that in order to simplify the disclosure and help to understand one or more of the various inventive aspects, it is right above
In the description of exemplary embodiment of the present invention, each feature of the invention be grouped together into sometimes single embodiment, figure or
In person's descriptions thereof.However, the disclosed method should not be interpreted as reflecting the following intention: i.e. claimed hair
Bright requirement is than feature more features expressly recited in each claim.More precisely, as the following claims
As book reflects, inventive aspect is all features less than single embodiment disclosed above.Therefore, it then follows specific real
Thus the claims for applying mode are expressly incorporated in the specific embodiment, wherein each claim itself is used as this hair
Bright separate embodiments.
Those skilled in the art should understand that the module of the equipment in example disclosed herein or unit or groups
Part can be arranged in equipment as depicted in this embodiment, or alternatively can be positioned at and the equipment in the example
In different one or more equipment.Module in aforementioned exemplary can be combined into a module or furthermore be segmented into multiple
Submodule.
Those skilled in the art will understand that can be carried out adaptively to the module in the equipment in embodiment
Change and they are arranged in one or more devices different from this embodiment.It can be the module or list in embodiment
Member or component are combined into a module or unit or component, and furthermore they can be divided into multiple submodule or subelement or
Sub-component.Other than such feature and/or at least some of process or unit exclude each other, it can use any
Combination is to all features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so disclosed
All process or units of what method or apparatus are combined.Unless expressly stated otherwise, this specification is (including adjoint power
Benefit require, abstract and attached drawing) disclosed in each feature can carry out generation with an alternative feature that provides the same, equivalent, or similar purpose
It replaces.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments
In included certain features rather than other feature, but the combination of the feature of different embodiments mean it is of the invention
Within the scope of and form different embodiments.For example, in the following claims, embodiment claimed is appointed
Meaning one of can in any combination mode come using.
In addition, be described as herein can be by the processor of computer system or by executing by some in the embodiment
The combination of method or method element that other devices of the function are implemented.Therefore, have for implementing the method or method
The processor of the necessary instruction of element forms the device for implementing this method or method element.In addition, Installation practice
Element described in this is the example of following device: the device be used for implement as in order to implement the purpose of the invention element performed by
Function.
As used in this, unless specifically stated, come using ordinal number " first ", " second ", " third " etc.
Description plain objects, which are merely representative of, is related to the different instances of similar object, and is not intended to imply that the object being described in this way must
Must have the time it is upper, spatially, sequence aspect or given sequence in any other manner.
Although the embodiment according to limited quantity describes the present invention, above description, the art are benefited from
It is interior it is clear for the skilled person that in the scope of the present invention thus described, it can be envisaged that other embodiments.Additionally, it should be noted that
Language used in this specification primarily to readable and introduction purpose and select, rather than in order to explain or limit
Determine subject of the present invention and selects.Therefore, without departing from the scope and spirit of the appended claims, for this
Many modifications and changes are obvious for the those of ordinary skill of technical field.For the scope of the present invention, to this
Invent done disclosure be it is illustrative and not restrictive, it is intended that the scope of the present invention be defined by the claims appended hereto.
Claims (20)
1. a kind of iris image perspective correction method, suitable for executing in the terminal, this method comprises:
Obtain the original iris image of user to be identified;
Calculate the three dimensional space coordinate p of every bit in the original iris images';
The sight side of human eye when obtaining original iris image according to the positional information calculation of human eye iris and its original iris image
To the angle, θ with horizontal direction;
The transformation matrix of the iris image perspective correction is constructed according to the angle, θ;
According to the transformation matrix and original iris image to the three dimensional space coordinate p of the original iris images' is sat
Mark transformation, the three dimensional space coordinate p of the iris image after being correcteds;
Wherein, the calculation formula of angle, θ are as follows:
Wherein, u is object distance, and v is image distance, and h is the central point in infrared imaging region in imaging sensor to described image sensor
The distance of central point, H are the central points of the human eye iris to the distance of incident light axis, and a is in the screen of the mobile terminal
Distance of the image display area to described image sensor central point.
2. the step of the method as described in claim 1, the transformation matrix of the building iris image perspective correction further include:
Spin matrix R and the R ' that camera lens and former world coordinate system are constructed according to the angle, θ, wherein setting former world coordinate system
Origin be the intersection point of plane where incident light axis and human eye iris, and be located at gravity and level side there are two reference axis
To.
3. method according to claim 2, ps=CR [(R ')-1C-1ps'+c '-c],
Wherein, C is the camera matrix by coefficient adjustment, suitable for the pixel unit in image is converted to length unit;C and c '
It is that the optical center of camera is revolved relative to former world coordinate system and former world coordinate system around non-gravity and the axis of horizontal direction respectively
The coordinate of new coordinate system after turning the angle θ.
4. the method as described in claim 1,
Wherein,It is the depth information of every bit in original iris image, suitable for being calculated according to angle, θ and object distance u.
5. method according to claim 2, wherein
R is unit matrix,
6. method as claimed in claim 3, c=[cx,cy,cz]T, c '=[cx', cy', cz']T, wherein T is matrix transposition, c
It is suitable for being calculated by the central point of angle, θ, object distance u and human eye iris and incident light axis distance H with c '.
7. method as claimed in claim 6, wherein cx=cy=0, cz=-u, cx'=0,
8. method as claimed in claim 3, wherein the camera matrixIncluding two reference axis sides
To focal length (fx, fy) and optical center coordinate (cx, cy)。
9. the method as described in claim 1, further includes:
Position of human eye is determined from imaging region according to eyes location algorithm, and its position coordinates is scaled length from pixel unit
Spend unit;And
Length unit in iris image coordinate after the correction is scaled pixel unit, and the iris image that remaps.
10. a kind of iris image perspective correction device is suitable for being resident in the terminal, which includes:
Image acquisition unit, suitable for obtaining the original iris image of user to be identified;
Coordinate calculating unit, suitable for calculating the three dimensional space coordinate p of every bit in the original iris images';
Angle calculation unit, suitable for obtaining original iris figure according to the positional information calculation of human eye iris and its original iris image
As when the direction of visual lines of the human eye and angle, θ of horizontal direction;
Matrix construction unit, suitable for constructing the transformation matrix of the iris image perspective correction according to the angle, θ;
Coordinate transformation unit, suitable for the three dimensional space coordinate p according to the transformation matrix to original iris images' carries out coordinate change
It changes, the three dimensional space coordinate p of the iris image after being correcteds;
Wherein, the calculation formula of angle, θ are as follows:
Wherein, u is object distance, and v is image distance, and h is the central point in infrared imaging region in imaging sensor to described image sensor
The distance of central point, H are the central points of the human eye iris to the distance of incident light axis, and a is in the screen of the mobile terminal
Distance of the image display area to described image sensor central point.
11. device as claimed in claim 10, the matrix construction unit is further adapted for constructing camera lens according to the angle, θ
With spin matrix R and the R ' of former world coordinate system, wherein setting the origin of former world coordinate system as incident light axis and human eye iris institute
Gravity and horizontal direction are located in the intersection point of plane, and there are two reference axis.
12. device as claimed in claim 11, ps=CR [(R ')-1C-1ps'+c '-c],
Wherein, C is the camera matrix by coefficient adjustment, suitable for the pixel unit in image is converted to length unit;C and c '
It is that the optical center of camera is revolved relative to former world coordinate system and former world coordinate system around non-gravity and the axis of horizontal direction respectively
The coordinate of new coordinate system after turning the angle θ.
13. device as claimed in claim 10,
Wherein,It is the depth information of every bit in original iris image, suitable for being calculated according to angle, θ and object distance u.
14. device as claimed in claim 11, wherein
R is unit matrix,
15. device as claimed in claim 12, c=[cx,cy,cz]T, c '=[cx', cy', cz']T, wherein T is that matrix turns
It sets, c and c ' is suitable for being calculated by the central point of angle, θ, object distance u and human eye iris and incident light axis distance H.
16. device as claimed in claim 15, wherein cx=cy=0, cz=-u, cx'=0,
17. device as claimed in claim 12, wherein the camera matrixIncluding two reference axis
Focal length (the f in directionx, fy) and optical center coordinate (cx, cy)。
18. device as claimed in claim 10, further includes:
Unit conversion unit is suitable for determining position of human eye from imaging region according to eyes location algorithm, and by its position coordinates
Length unit is scaled from pixel unit;And the length unit in the iris image coordinate after the correction is scaled pixel
Unit, and the iris image that remaps.
19. a kind of mobile terminal, including the iris image perspective correction device as described in any one of claim 10-18.
20. mobile terminal as claimed in claim 19 further includes answering with what the iris image perspective correction device mutually coupled
Synthesized image system, the complex imaging system include:
Lens assembly, the optical lens including fixed focal length;
Optical filter box including the visible band pass filter for allowing the light of visible light wave range to pass through and allows near infrared light wave band
By near infrared light bandpass region;And
Imaging sensor, including the transition region between visual light imaging region, near infrared light imaging region and the two regions
Domain,
Wherein, the visual light imaging region is under the visual light imaging mode to by the visible band pass filter
Visible light is imaged and the near infrared light imaging region is described close red to passing through under the near infrared light imaging mode
The near infrared light of outer light belt pass filter is imaged.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610602917.8A CN106250839B (en) | 2016-07-27 | 2016-07-27 | A kind of iris image perspective correction method, apparatus and mobile terminal |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610602917.8A CN106250839B (en) | 2016-07-27 | 2016-07-27 | A kind of iris image perspective correction method, apparatus and mobile terminal |
Publications (2)
Publication Number | Publication Date |
---|---|
CN106250839A CN106250839A (en) | 2016-12-21 |
CN106250839B true CN106250839B (en) | 2019-06-04 |
Family
ID=57604365
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610602917.8A Active CN106250839B (en) | 2016-07-27 | 2016-07-27 | A kind of iris image perspective correction method, apparatus and mobile terminal |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN106250839B (en) |
Families Citing this family (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107194968B (en) * | 2017-05-18 | 2024-01-16 | 腾讯科技(上海)有限公司 | Image identification tracking method and device, intelligent terminal and readable storage medium |
CN107564089B (en) * | 2017-08-10 | 2022-03-01 | 腾讯科技(深圳)有限公司 | Three-dimensional image processing method, device, storage medium and computer equipment |
CN108875526B (en) * | 2018-01-05 | 2020-12-25 | 北京旷视科技有限公司 | Method, device and system for line-of-sight detection and computer storage medium |
CN108765301B (en) * | 2018-03-27 | 2020-08-07 | 长春理工大学 | Optical system and distortion correction method and system thereof |
CN109726694B (en) * | 2019-01-02 | 2023-08-25 | 上海百豪新材料有限公司 | Iris image acquisition method and device |
CN110544285B (en) * | 2019-10-30 | 2020-02-04 | 南京安科医疗科技有限公司 | Method for correcting head position in head CT image |
CN111144219B (en) * | 2019-11-29 | 2023-08-18 | 武汉虹识技术有限公司 | Iris recognition device and method based on 3D structured light |
CN111145087B (en) * | 2019-12-30 | 2023-06-30 | 维沃移动通信有限公司 | Image processing method and electronic equipment |
CN111428654B (en) * | 2020-03-27 | 2023-11-28 | 北京万里红科技有限公司 | Iris recognition method, iris recognition device and storage medium |
CN112417951B (en) * | 2020-09-30 | 2022-06-24 | 北京极豪科技有限公司 | Fingerprint image calibration method and device, electronic equipment and storage medium |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7756301B2 (en) * | 2005-01-26 | 2010-07-13 | Honeywell International Inc. | Iris recognition system and method |
CN201307266Y (en) * | 2008-06-25 | 2009-09-09 | 韩旭 | Binocular sightline tracking device |
CN101656840B (en) * | 2008-08-22 | 2011-09-28 | 原相科技股份有限公司 | Wide-angle sensor array module and image correcting method, operating method and application thereof |
CN103870796B (en) * | 2012-12-13 | 2017-05-24 | 汉王科技股份有限公司 | Eye sight evaluation method and device |
CN104484649B (en) * | 2014-11-27 | 2018-09-11 | 北京天诚盛业科技有限公司 | The method and apparatus of iris recognition |
CN204270321U (en) * | 2014-12-24 | 2015-04-15 | 武汉虹识技术有限公司 | A kind of iris collection device |
CN104615978B (en) * | 2015-01-23 | 2017-09-22 | 清华大学 | Direction of visual lines tracking and device |
CN105187726B (en) * | 2015-06-17 | 2021-05-18 | 巽腾(广东)科技有限公司 | Multifunctional mobile image processing device and processing method |
CN105094337B (en) * | 2015-08-19 | 2018-06-22 | 华南理工大学 | A kind of three-dimensional gaze estimation method based on iris and pupil |
CN105740846A (en) * | 2016-03-02 | 2016-07-06 | 河海大学常州校区 | Horizontal visual angle estimation and calibration method based on depth camera |
-
2016
- 2016-07-27 CN CN201610602917.8A patent/CN106250839B/en active Active
Also Published As
Publication number | Publication date |
---|---|
CN106250839A (en) | 2016-12-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN106250839B (en) | A kind of iris image perspective correction method, apparatus and mobile terminal | |
CN106295533B (en) | A kind of optimization method, device and the camera terminal of self-timer image | |
CN109151340B (en) | Video processing method and device and electronic equipment | |
CN104506762B (en) | Optical field acquisition control method and device, optical field acquisition equipment | |
WO2015180659A1 (en) | Image processing method and image processing device | |
CN108777767A (en) | Photographic method, device, terminal and computer readable storage medium | |
KR20190038594A (en) | Face recognition-based authentication | |
CN107920211A (en) | A kind of photographic method, terminal and computer-readable recording medium | |
WO2016010724A1 (en) | Multispectral eye analysis for identity authentication | |
WO2016010721A1 (en) | Multispectral eye analysis for identity authentication | |
WO2016010720A1 (en) | Multispectral eye analysis for identity authentication | |
US11244158B2 (en) | Image acquisition method, apparatus, system, and electronic device | |
CN108200335A (en) | Photographic method, terminal and computer readable storage medium based on dual camera | |
CN110290324A (en) | Equipment imaging method, device, storage medium and electronic equipment | |
CN206595991U (en) | A kind of double-camera mobile terminal | |
CN110213493A (en) | Equipment imaging method, device, storage medium and electronic equipment | |
WO2021164678A1 (en) | Automatic iris capturing method and apparatus, computer-readable storage medium, and computer device | |
CN106529436A (en) | Identity consistency authentication method and device, and mobile terminal | |
US20170046813A1 (en) | An apparatus and associated methods for image capture | |
CN110213492A (en) | Equipment imaging method, device, storage medium and electronic equipment | |
CN110232707A (en) | A kind of distance measuring method and device | |
CN110427108A (en) | Photographic method and Related product based on eyeball tracking | |
EP2981074B1 (en) | Display device, display method, and display program | |
CN110225256A (en) | Equipment imaging method, device, storage medium and electronic equipment | |
CN107392088A (en) | Three-dimensional vein identification device and method, switch, mobile terminal |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB03 | Change of inventor or designer information |
Inventor after: Wang Xiaopeng Inventor before: Wang Xiaopeng Inventor before: Guo Yansong |
|
CB03 | Change of inventor or designer information | ||
GR01 | Patent grant | ||
GR01 | Patent grant |