CN106250839B - A kind of iris image perspective correction method, apparatus and mobile terminal - Google Patents

A kind of iris image perspective correction method, apparatus and mobile terminal Download PDF

Info

Publication number
CN106250839B
CN106250839B CN201610602917.8A CN201610602917A CN106250839B CN 106250839 B CN106250839 B CN 106250839B CN 201610602917 A CN201610602917 A CN 201610602917A CN 106250839 B CN106250839 B CN 106250839B
Authority
CN
China
Prior art keywords
iris image
image
iris
angle
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201610602917.8A
Other languages
Chinese (zh)
Other versions
CN106250839A (en
Inventor
王晓鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to CN201610602917.8A priority Critical patent/CN106250839B/en
Publication of CN106250839A publication Critical patent/CN106250839A/en
Application granted granted Critical
Publication of CN106250839B publication Critical patent/CN106250839B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18Eye characteristics, e.g. of the iris
    • G06V40/193Preprocessing; Feature extraction

Abstract

The invention discloses a kind of iris image perspective correction methods, suitable for executing in the terminal, this method comprises: obtaining the original iris image of user to be identified;Calculate the three dimensional space coordinate p of every bit in the original iris images';The direction of visual lines of human eye and the angle theta of horizontal direction when obtaining original iris image according to the positional information calculation of the human eye iris and its original iris image;The transformation matrix of the iris image perspective correction is constructed according to the angle, θ;According to the transformation matrix to the three dimensional space coordinate p of the original iris images' is coordinately transformed, the three dimensional space coordinate p of the iris image after being correcteds.The invention also discloses a kind of iris image perspective correction device and mobile terminals.

Description

A kind of iris image perspective correction method, apparatus and mobile terminal
Technical field
The present invention relates to image procossings and area of pattern recognition, more particularly, to a kind of iris image perspective correction side Method, device and mobile terminal.
Background technique
With the fast development of intelligent mobile terminal and network technology, safety of the people to information especially personal information It is continuously improved with stability requirement, the application of authentication is carried out using people's unique physiological characteristic inherently or behavioural characteristic It is more and more extensive.Wherein, other than the technologies such as fingerprint recognition, recognition of face, in addition one more safety iris recognition skill Art is also increasingly subject to the favor of people.Moreover, with the continuous progress of science and technology, iris authentication system is gradually applied to mobile phone, puts down In small and exquisite, frivolous, the portable electronic equipment such as plate and notebook.
In general, when user carries out iris recognition using mobile phone, in order to see the eye image presented on the display screen, It needs to make to generate an angle between eyes and mobile phone.This angle makes the profile of iris image become ellipse from circle. Due to blocking for eyelid, the profile of iris image is usually incomplete circle or ellipse.Existing Algorithm of Iris Recognition can be reliable Incomplete circle is efficiently detected, but cannot reliably and effectively detect incomplete ellipse.
The current method for carrying out perspective correction to iris image has the automatic distortions correction based on characteristic point detection, the party Method is it needs to be determined that the location information of characteristic point or have reference picture.That is, one group of feature that comparison detects in a reference image Point and another group of characteristic point detected in present image, estimate the rotation and translation between camera and target, then right Present image is converted, and is obtained and characteristic point position consistent in reference picture.Obviously, this method requires to hold in the picture It easily detects enough and sufficiently stable characteristic point, and to extraneous illumination condition and interferes also more sensitive.For different The face area of people, it is difficult to reliably obtain the characteristic point of fixed position, and calculation amount is larger, not be suitable for mobile terminal rainbow The requirement of real-time of film application.
It is, therefore, desirable to provide a kind of quick approximation method for correcting this metamorphopsic distortion automatically, obtains one and round lose Very lesser iris image, reduces the difficulty of subsequent processing.
Summary of the invention
For this purpose, the present invention provides a kind of iris image perspective correction method, apparatus and mobile terminal, to try hard to solve or At least alleviate at least one existing problem above.
According to an aspect of the present invention, a kind of iris image perspective correction method should suitable for executing in the terminal Method includes: the original iris image for obtaining user to be identified;Calculate the three dimensional space coordinate of every bit in original iris image ps';The sight side of human eye when obtaining original iris image according to the positional information calculation of human eye iris and its original iris image To the angle theta with horizontal direction;The transformation matrix of iris image perspective correction is constructed according to angle, θ;According to transformation matrix to original The three dimensional space coordinate p of beginning iris images' is coordinately transformed, the three dimensional space coordinate p of the iris image after being correcteds
Optionally, in iris image perspective correction method according to the present invention, further includes: described in being constructed according to angle, θ Spin matrix R and the R ' of camera lens and former world coordinate system, wherein setting the origin of former world coordinate system as incident light axis and people The intersection point of plane where eye iris, and gravity and horizontal direction are located at there are two reference axis.
Optionally, in iris image perspective correction method according to the present invention, ps=CR [(R ')-1C-1ps'+c '-c], Wherein, C is the camera matrix by coefficient adjustment, suitable for the pixel unit in image is converted to length unit;C and c ' difference Be camera optical center relative to former world coordinate system and former world coordinate system around non-gravity and the axis of the horizontal direction rotation angle θ The coordinate of new coordinate system afterwards.
Optionally, in iris image perspective correction method according to the present invention,Wherein,It is the depth information of every bit in original iris image, suitable for being calculated according to rotation angle, θ and object distance u.
Optionally, in iris image perspective correction method according to the present invention, R is unit matrix,
Optionally, in iris image perspective correction method according to the present invention, the calculation formula of angle, θ are as follows:
Wherein, u is object distance, and v is image distance, and h is that the central point in infrared imaging region in imaging sensor is passed to described image The distance of sensor central point, H are the central points of the human eye iris to the distance of the incident light axis, and a is the mobile terminal Screen in image display area to described image sensor central point distance.
Optionally, in iris image perspective correction method according to the present invention, c=[cx,cy,cz]T, c '=[cx', cy', cz']T, wherein T is matrix transposition, c and c ' is suitable for central point and incident light by angle theta, object distance u and human eye iris The distance H of axis is calculated.
Optionally, in iris image perspective correction method according to the present invention, cx=cy=0, cz=-u, cx'=0,
Optionally, in iris image perspective correction method according to the present invention, camera matrix Focal length (f including two change in coordinate axis directionx, fy) and optical center coordinate (cx, cy)。
Optionally, in iris image perspective correction method according to the present invention, further includes: according to eyes location algorithm from Position of human eye is determined in imaging region, and its position coordinates is scaled length unit from pixel unit;And it will be after correction Length unit in iris image coordinate is scaled pixel unit, and the iris image that remaps.
According to another aspect of the present invention, a kind of iris image perspective correction device is provided, suitable for residing in movement In terminal, which includes: image acquisition unit, suitable for obtaining the original iris image of user to be identified;Coordinate calculating unit, Suitable for calculating the three dimensional space coordinate p of every bit in original iris images';Angle calculation unit, be suitable for according to human eye iris and The angle of the direction of visual lines of human eye and horizontal direction when the positional information calculation of its original iris image obtains original iris image θ;Matrix construction unit, suitable for constructing the transformation matrix of iris image perspective correction according to angle, θ;Coordinate transformation unit is suitable for According to transformation matrix to the three dimensional space coordinate p of original iris images' is coordinately transformed, the iris image after being corrected Three dimensional space coordinate ps
Optionally, in iris image perspective correction device according to the present invention, matrix construction unit is further adapted for according to angle Spin matrix R and the R ' for spending θ building camera lens and former world coordinate system, wherein setting the origin of former world coordinate system as incident light The intersection point of plane where axis and human eye iris, and gravity and horizontal direction are located at there are two reference axis.
Optionally, in iris image perspective correction device according to the present invention, ps=CR [(R ')-1C-1ps'+c '-c], Wherein, C is the camera matrix by coefficient adjustment, suitable for the pixel unit in image is converted to length unit;C and c ' difference Be camera optical center relative to former world coordinate system and former world coordinate system around non-gravity and the axis of the horizontal direction rotation angle θ The coordinate of new coordinate system afterwards.
Optionally, in iris image perspective correction device according to the present invention,Wherein,It is the depth information of every bit in original iris image, suitable for being calculated according to rotation angle, θ and object distance u.
Optionally, in iris image perspective correction device according to the present invention, R is unit matrix,
Optionally, in iris image perspective correction device according to the present invention, the calculation formula of angle, θ are as follows:
Wherein, u is object distance, and v is image distance, and h is that the central point in infrared imaging region in imaging sensor is passed to described image The distance of sensor central point, H are the central points of the human eye iris to the distance of the incident light axis, and a is the mobile terminal Screen in image display area to described image sensor central point distance.
Optionally, in iris image perspective correction device according to the present invention, c=[cx,cy,cz]T, c '=[cx', cy', cz']T, wherein T is matrix transposition, c and c ' is suitable for central point and incident light by angle theta, object distance u and human eye iris The distance H of axis is calculated.
Optionally, in iris image perspective correction device according to the present invention, cx=cy=0, cz=-u, cx'=0,
Optionally, in iris image perspective correction device according to the present invention, camera matrix Focal length (f including two change in coordinate axis directionx, fy) and optical center coordinate (cx, cy)。
Optionally, further include unit conversion unit in iris image perspective correction device according to the present invention, be suitable for root Position of human eye is determined from imaging region according to eyes location algorithm, and its position coordinates is scaled length list from pixel unit Position;And suitable for the length unit in the iris image coordinate after correction is scaled pixel unit, and the iris figure that remaps Picture.
According to a further aspect of the invention, a kind of mobile terminal, including iris image as described above perspective are provided Means for correcting.
Optionally, in mobile terminal according to the present invention, further include and the iris image perspective correction device phase coupling The complex imaging system connect, the complex imaging system include: lens assembly, the optical lens including fixed focal length;Filter set Part, including the visible band pass filter for allowing the light of visible light wave range to pass through and the near-infrared for allowing near infrared light wave band to pass through Light bandpass region;And imaging sensor, including visual light imaging region, near infrared light imaging region and the two regions it Between transitional region, wherein visual light imaging region under visual light imaging mode to by visible band pass filter can It is light-exposed be imaged and near infrared light imaging region under near infrared light imaging mode to by near infrared light bandpass filter Near infrared light be imaged.
According to the technique and scheme of the present invention, human eye sight when iris recognition is whole relative to the rotation of mobile terminal or movement The rotation relative to human eye sight is held, human eye sight is uniformly equivalent to and rotates the angle θ, gravity side in world coordinate system from horizontal direction To axis also rotate the angle θ.This programme is calculated according to the relationship of the display position of human eye iris, imaging position and sight angle Tilt angle of the mobile terminal when carrying out iris recognition, and the change by calculating tilt angle building iris image perspective correction Change matrix.Human eye iris is carried out to inverse perspective projection according to transformation matrix under the coordinate system of rotation, then in the coordinate not rotated System is lower to carry out perspective projection, and the screen out of plumb of the direction of visual lines of human eye and mobile terminal is led when can be solved because of iris recognition The problem of iris image deformation of cause.I.e. by the angle of estimation human eye and imaging device, the quick correction of distorted image is realized The iris image of ellipse is modified to closer to circle, is convenient for subsequent identifying processing, improves the accurate of iris recognition by transformation Degree.
Detailed description of the invention
To the accomplishment of the foregoing and related purposes, certain illustrative sides are described herein in conjunction with following description and drawings Face, these aspects indicate the various modes that can practice principles disclosed herein, and all aspects and its equivalent aspect It is intended to fall in the range of theme claimed.Read following detailed description in conjunction with the accompanying drawings, the disclosure it is above-mentioned And other purposes, feature and advantage will be apparent.Throughout the disclosure, identical appended drawing reference generally refers to identical Component or element.
Fig. 1 shows the structural block diagram of mobile terminal 100 according to an embodiment of the invention;
Fig. 2 shows the structural frames of the complex imaging system 200 of mobile terminal 100 according to an embodiment of the invention Figure;
Fig. 3 shows the schematic diagram using mobile terminal acquisition self-timer image and iris recognition image;
Fig. 4 shows imaging position of the human eye iris according to an embodiment of the invention under different sight angle and shows Show the schematic diagram of position;
Fig. 5 shows the flow chart of iris image perspective correction method 500 according to an embodiment of the invention;
Fig. 6 A and 6B respectively illustrate the image schematic diagram before and after progress perspective correction according to an embodiment of the invention;
Fig. 7 shows the structural block diagram of iris image perspective correction device 700 according to an embodiment of the invention.
Specific embodiment
Exemplary embodiments of the present disclosure are described in more detail below with reference to accompanying drawings.Although showing the disclosure in attached drawing Exemplary embodiment, it being understood, however, that may be realized in various forms the disclosure without should be by embodiments set forth here It is limited.On the contrary, these embodiments are provided to facilitate a more thoroughly understanding of the present invention, and can be by the scope of the present disclosure It is fully disclosed to those skilled in the art.
Fig. 1 is 100 organigram of mobile terminal according to an embodiment of the invention.As described in Figure 1, mobile whole End 100 includes: memory interface 102, one or more data processor, image processor and/or central processing unit 104, And peripheral interface 106.Memory interface 102, one or more processors 104 and/or peripheral interface 106 are either discrete Element also can integrate in one or more integrated circuits.In the mobile terminal 100, various elements can by one or A plurality of communication bus or signal wire couple.Sensor, equipment and subsystem may be coupled to peripheral interface 106, to help Realize multiple functions.For example, motion sensor 110, optical sensor 112 and range sensor 114 may be coupled to peripheral interface 106, to facilitate the functions such as orientation, illumination and ranging.Other sensors 116 can equally be connected with peripheral interface 106, such as fixed Position system (such as GPS receiver), temperature sensor, biometric sensor or other sensor devices, it is possible thereby to help reality Apply relevant function.
Camera sub-system 120 and optical sensor 122 can be used for the camera of convenient such as record photos and video clips The realization of function, wherein the camera sub-system and optical sensor for example can be charge-coupled device (CCD) or complementary gold Belong to oxide semiconductor (CMOS) optical sensor.It can help to realize by one or more radio communication subsystems 124 Communication function, wherein radio communication subsystem may include radio-frequency transmitter and transmitter and/or light (such as infrared) receiver And transmitter.The particular design and embodiment of radio communication subsystem 124 can depend on mobile terminal 100 is supported one A or multiple communication networks.For example, mobile terminal 100 may include being designed to support GSM network, GPRS network, EDGE net The communication subsystem 124 of network, Wi-Fi or WiMax network and BlueboothTM network.Audio subsystem 126 can be with loudspeaking Device 128 and microphone 130 are coupled, to help the function of implementing to enable voice, such as speech recognition, speech reproduction, number Word record and telephony feature.
I/O subsystem 140 may include touch screen controller 142 and/or other one or more input controllers 144. Touch screen controller 142 may be coupled to touch screen 146.For example, the touch screen 146 and touch screen controller 142 can be with The contact carried out therewith and movement or pause are detected using any one of a variety of touch-sensing technologies, wherein sensing skill Art includes but is not limited to capacitive character, resistive, infrared and surface acoustic wave technique.Other one or more input controllers 144 May be coupled to other input/control devicess 148, for example, one or more buttons, rocker switch, thumb wheel, infrared port, The pointer device of USB port, and/or stylus etc.One or more of button (not shown)s may include for controlling The up/down button of 130 volume of loudspeaker 128 and/or microphone.
Memory interface 102 can be coupled with memory 150.The memory 150 may include that high random access is deposited Reservoir and/or nonvolatile memory, such as one or more disk storage equipments, one or more optical storage apparatus, and/ Or flash memories (such as NAND, NOR).Memory 150 can store an operating system 152, for example, Android, IOS or The operating system of Windows Phone etc.The operating system 152 may include for handling basic system services and execution The instruction of task dependent on hardware.Memory 150 can also be stored using 154.These applications in operation, can be from memory 150 are loaded on processor 104, and run on the operating system run via processor 104, and utilize operating system And the interface that bottom hardware provides realizes the various desired functions of user, such as instant messaging, web page browsing, pictures management. Using can be independently of operating system offer, it is also possible to what operating system carried.In addition, being mounted to shifting using 154 When in dynamic terminal 100, drive module can also be added to operating system.
In above-mentioned various applications 154, one such application is iris image perspective correction related to the present invention dress Set 700.In some embodiments, mobile terminal 100 is configured as executing iris image perspective correction method according to the present invention 400。
When carrying out iris recognition using mobile terminal, it usually needs individual near-infrared camera carries out iris imaging, Can not be multiplexed with the camera of existing visual light imaging (spectral frequency is in 380-760nm) (for example smart phone is existing The preposition colour imagery shot having), undoubtedly increase the structure complexity of mobile terminal.And it is carried out using mobile terminal single camera Near infrared light and the Compound scan technology of visible light two waveband can effectively solve the above problems.Fig. 2 shows according to the present invention one The structural block diagram of the complex imaging system 200 of the mobile terminal 100 of a embodiment.As shown in Fig. 2, the complex imaging system packet Include: the complex imaging system 200 includes lens assembly 230, optical filter box 220 and the image successively arranged along input path Sensor 210.Wherein, optical filter box 220 includes visible band pass filter 221 and the (figure of near infrared light bandpass filter 222 In be shown as being filled with backslash), imaging sensor 210 includes (being illustrated as with anti-for the region A of near infrared light imaging Oblique line filling), for the region B of visual light imaging and the transitional region C between A, B area (be shown as being filled out with horizontal line It fills).
Full spectrum light line incidence passes through lens assembly 230 and reaches optical filter box 220, wherein visible band pass filter 221 permission visible lights (for example, wavelength is 380-760nm) pass through, and near infrared light bandpass filter 222 allows near infrared light (for example, wavelength is 780-880nm) passes through.Visible band pass filter 221 and near infrared light bandpass filter 222 can pass through Plated film is realized.It is imaged, and passed through in the region B of imaging sensor substantially by the visible light of visible band pass filter 221 The near infrared light of near infrared light bandpass filter 222 is imaged in the region A of imaging sensor substantially.It can using image processing software Respectively to distinguish the imaging of the region B and A of imaging sensor, wherein the imaging of region B corresponds to normal visible light The mobile terminals such as imaging, such as user's use mobile phone carry out imaging when daily self-timer, and the imaging of region A corresponds to closely Imaging under infrared mode, such as imaging of the user when carrying out iris recognition using mobile phone.In this way, can easily realize can The light-exposed switching between near infrared light imaging switches optical filter without being equipped with moving component, is greatly improved steady It is qualitative.
Fig. 3 shows the schematic diagram using mobile terminal acquisition self-timer image and iris recognition image.As shown in figure 3, with In self-timer, the screen of mobile terminal is parallel with face at family, it can be observed that self-timer preview screen (such as lower left corner figure of full screen Show).And when carrying out iris recognition, mobile terminal is tilted an angle, θ by user, to observe the iris for being located at screen top It identifies in preview screen (as shown in the lower right corner).
Horizontal direction rotation alternatively, it is also possible to keep the screen of mobile terminal constant, when the direction of visual lines of face is from self-timer Turn the angle θ.Because both iris recognition situations, mobile terminal and the relativeness of human eye sight are really the same, so Both of which is unified for latter in invention, human eye iris shown in as Fig. 4 under different sight angle at Image position and display position, to be calculated.When human eye sight is not orthogonal to display screen, iris recognition picture can be generated Deformation influences the algorithm of iris recognition, carries out rainbow by estimating the tilt angle of mobile terminal this paper presents a kind of thus The method of film image perspective correction.
As shown in figure 4, regarding iris as a disc, the plane where defining it is object plane.Ignore eyeball radius pair The influence of the iris depth of field indicates the position of iris with the position of the eyeball centre of sphere.In order to make one eye iris in the red of imaging sensor Outer smooth regional imaging need to guarantee that eyeball is located in the visual field scope of infrared light region.In order to keep iris image clear, need to guarantee Eyeball is located in field depth.
Right-handed coordinate system is used, if world coordinate system, using the intersection point of object plane and optical axis as origin, x-axis forward direction is carried on the back from paper Front is directed toward in face, and y-axis is positive downwards, and z-axis forward direction is to the right.Camera coordinate system is original with the camera lens center of mobile terminal Point, x-axis forward direction are directed toward front from the paper back side, and y-axis is positive downwards, and z-axis forward direction is to the right.Sensor coordinate system image taking sensor Center be origin, x-axis forward direction is directed toward front from the paper back side, and y-axis is positive downwards, and z-axis forward direction is to the right.Coordinate system rotation is used Xyz Eulerian angles indicate, i.e., first rotate around x axis, and rotate further around new y-axis, rotate further around new z-axis.Rotate the positive direction of angle It is defined by right hand rule, i.e., is positive-angle against the counter clockwise direction that reference axis is looked.
From the above description, it can be seen that object plane, as plane and image manifesting planes be world coordinate system, camera coordinates respectively The X/Y plane of system and sensor coordinate system.When object plane is parallel with as plane, the profile of iris image is circle.But because In the operation of actual iris recognition, for object plane with as plane and not parallel, it is ellipse for leading to the profile of the iris image finally obtained It is round.
The initial direction of visual lines of human eye is horizontal direction in Fig. 4, shown in vector LOS0;When iris recognition, user in order to Direction of visual lines is adjusted to LOS1 by the iris image shown by observing above the screen of mobile terminal, i.e., object plane is to cross eye The direction x of ball center is that rotary shaft rotates clockwise the angle θ.The present invention guarantees the depth of field of eyeball and at image position in rotary course It sets constant.Correspondingly, the Y-axis of former world coordinate system has also rotated clockwise the angle θ along X-axis.Wherein set sight when iris recognition Angle between direction LOS1 and the Y-axis of former world coordinate system is α, the angle between the Y-axis of the world coordinate system rotated through For β, it is known that, β=π-θ-α.
It keeps human eye sight direction constant if should be appreciated that, mobile terminal is rotated into the angle θ along away from human eye direction, then is existed In this case world coordinate system is unchanged, but the X/Y plane of camera coordinates system and sensor coordinate system has rotated the angle θ around X-axis.But Because camera coordinate system has rotated the angle θ relative to world coordinate system under right hand rule, be equivalent to world coordinate system relative to Camera coordinate system has rotated-θ.So can be equivalent to keep camera coordinates system and sensor coordinate system constant, world coordinates The X/Y plane of system rotates the angle-θ around X-axis.Such case still can be using iris position, imaging position, display shown in Fig. 4 Position and the position of world coordinate system indicate.
As shown in figure 4, set object distance as u, image distance v, the central point in infrared imaging region is passed to image in imaging sensor The distance of sensor central point is h.According to pinhole imaging system principle, H=hu/v.The central point of human eye iris is separately set to incident light axis Distance be H, the distance of image display area to image sensor center point is a in the screen of mobile terminal, in human eye iris The heart is d at a distance from camera lens center.It, can be true from imaging region according to eyes location algorithm when carrying out distance calculating Determine position of human eye, and its position coordinates is scaled length unit from pixel unit.
According to the above parameter, the angle changing between human eye sight LOS0 and sight LOS1 can be calculated are as follows:
Furthermore it is also possible to which the angle for obtaining Y-axis in iris imaging light LOS1 and former world coordinate system is α=arctan (u/H) angle β=π-θ-α=π-θ-arctan of Y-axis and in iris imaging light LOS1 and postrotational world coordinate system (u/H)。
As described above, camera rotation angle is θx=0, θy=0, θz=0, rotating angle according to camera can structure Make spin matrix R.Due to not rotating, R is unit matrix.
And camera rotation angle is θ when iris recognitionx'=θ, θy'=0, θz'=0, rotating angle according to camera can Construct spin matrix
In addition, camera center OcIt is c in the coordinate of former world coordinate systemx=0, cy=0, cz=-u is expressed as vector c =[cx,cy,cz]T, wherein T is matrix transposition.Camera center O when iris recognitioncThe coordinate of world coordinate system after rotation For c'x=0, c'y=H+dcos β, c'z=-dsin β is expressed as vector c'=[cx',cy',cz']T
For camera lens, it is known that its focal length is f, and calibrated camera matrix is C.Succinct, the camera square to describe Battle array is so that transformed pixel unit is become length unit by coefficient adjustment.
According to one embodiment, Ke YiquWhich includes the focal length (f of both directionx, fy) and Optical center coordinate (cx, cy).It needs carrying out Conversion of measurement unit multiplied by unit conversion factor, when practical operation also needs to consider several non-thread Property distortion.
It should be appreciated that iris coordinate and its image coordinate are the relationships of perspective projection.One point p of known spatialw=[xw,yw, zw]TCoordinate p under camera coordinate systemc=[xc,yc,zc]TFor pc=R (pw- c), the coordinate under sensor coordinate system For ps=Cpc, the form after depth is normalized isThe point will be lost i.e. on iris image Depth information
It is thus known that existing deformed iris image, it can be according to space a little in world coordinate system, camera coordinates Corresponding relationship under system and sensor coordinate system infers undeformed iris image coordinate.It specifically, can be according to original rainbow Film image first in the coordinate system subinverse perspective projection of rotation, then the perspective projection under the coordinate system not rotated, can correct image Deformation.
Wherein, in the coordinate system according to rotation against perspective projection process, the three-dimensional space for first obtaining current deformation pattern is sat Mark ps'.Regard iris region as plane, using according to rotation angle, θ and object distance u, can estimate the depth of iris region every bit Spend informationGenerate the coordinate under the sensor coordinate system with depth informationIt later, can basis Sensor coordinate system and the variation relation of camera coordinates system restore coordinate p of the human eye iris under camera coordinate systemc'=C- 1ps'.Then seat of the human eye iris under former world coordinate system is acquired according to the transformation relation of camera coordinates system and world coordinate system Mark pw=(R')-1pc'+c'。
Later, perspective projection process is carried out under the coordinate system not rotated, i.e., according to the coordinate p under former world coordinate systemw Release the coordinate p under camera coordinates systemc=R (pw- c), then release the coordinate under sensor, the iris after being corrected The three dimensional space coordinate p of images=CR [(R ')-1C-1ps'+c '-c].
Fig. 5 shows the flow chart of iris image perspective correction method 500 according to an embodiment of the invention.Such as Fig. 5 Shown, this method starts from step S510.
Then, in step S510, face iris image to be identified is acquired.It would generally for collected iris image Some pretreatments are carried out, to improve its precision and clarity, such as are normalized or noise reduction process.
Then, in step S520, the three dimensional space coordinate p of every bit in original iris image is calculateds'.Specifically,Wherein,It is the depth information of every bit in original iris image, is suitable for according to rotation angle Degree θ and object distance u is calculated.Wherein it is possible to determine position of human eye from imaging region according to eyes location algorithm, and by its position It sets coordinate and is scaled length unit from pixel unit, so as to coordinate calculating.
Then, it in step S530, is obtained according to the positional information calculation of human eye iris and its original iris image original The angle theta of the direction of visual lines of human eye and horizontal direction when iris image.Specifically,
Then, in step S540, the transformation matrix of iris image perspective correction is constructed according to angle, θ.Wherein, further include Spin matrix R and the R ' of camera lens and former world coordinate system is constructed according to the angle, θ, if the origin of former world coordinate system is The intersection point of plane where incident light axis and human eye iris, and gravity and horizontal direction are located at there are two reference axis.
Specifically, R is unit matrix,
Then, in step S550, according to the transformation matrix to the three dimensional space coordinate p of original iris images' is carried out Coordinate transform, the three dimensional space coordinate p of the iris image after being correcteds.Specifically, ps=CR [(R ')-1C-1ps'+c '-c], Wherein, C is the camera matrix by coefficient adjustment, suitable for the pixel unit in image is converted to length unit;C and c ' difference It is the optical center of camera relative to former world coordinate system and the world coordinate system coordinate rotated through.
Wherein, c=[cx,cy,cz]T, c '=[cx', cy', cz']T, wherein T is matrix transposition, c and c ' is suitable for passing through folder The central point of angle θ, object distance u and human eye iris are calculated with incident light axis distance H.
According to the calculating in Fig. 4, cx=cy=0, cz=-u, cx'=0,
Finally, the length unit in coordinate is scaled pixel unit, and the iris image that remaps, it can be by iris wheel Exterior feature is corrected to circle from ellipse.Fig. 6 A and 6B are respectively illustrated before and after progress perspective correction according to an embodiment of the invention Image schematic diagram.As can be seen that image is ellipse before perspective correction, and after carrying out perspective correction, image becomes round Shape, hence it is evident that be conducive to subsequent identification process.
Fig. 7 shows the structural block diagram of iris image perspective correction device 700 according to an embodiment of the invention.Such as figure Shown in 7, which includes: image acquisition unit 710, coordinate calculating unit 720, angle calculation unit 730, matrix construction unit 740 and coordinate transformation unit 750.
Image acquisition unit 710 is suitable for obtaining the original iris image of user to be identified.
Coordinate calculating unit 720 is suitable for calculating the three dimensional space coordinate p of every bit in original iris images'.
Angle calculation unit 730 is suitable for being obtained according to the positional information calculation of the human eye iris and its original iris image The angle theta of the direction of visual lines of human eye and horizontal direction when original iris image.
Matrix construction unit 740 is suitable for constructing the transformation square of the iris image perspective correction according to the rotation angle, θ Battle array.It wherein, further include spin matrix R and the R ' that camera lens and former world coordinate system are constructed according to rotation angle, θ.
Coordinate transformation unit, suitable for the three dimensional space coordinate p according to the transformation matrix and original iris images' pairs The original iris image is coordinately transformed, the three dimensional space coordinate p of the iris image after being correcteds
It can also include unit conversion unit according to one embodiment, be suitable for according to eyes location algorithm from imaging region Middle determining position of human eye, and its position coordinates is scaled length unit from pixel unit;And by the iris after the correction Length unit in image coordinate is scaled pixel unit, and the iris image that remaps.
Iris image perspective correction device 700 according to the present invention, detail, the calculating of especially each parameter Journey is disclosed in detail in the description based on Fig. 1-Fig. 6, and details are not described herein.
It can be seen that the present invention determines human eye iris in imaging sensor by the iris region in positioning infrared image The imaging position of device, the display position on mobile terminal screen, and the human eye iris position of itself is combined, estimate acquisition rainbow The angle of mobile terminal and human eye sight direction when film image, this angle may be caused by human eye sight direction change, can also Caused by can be because of rotation of mobile terminal.Further, it can confirm the angle between imaging sensor and human eye iris, and according to the angle Degree establishes the transformation matrix of iris image perspective transform.Origin distortion iris image is converted according to the transformation matrix, i.e., First in the coordinate system subinverse perspective projection of rotation, then the perspective projection under the coordinate system not rotated, anamorphose can be corrected, is obtained To approximate undistorted iris image.According to the solution of the present invention, it can effectively eliminate human eye sight and be not orthogonal to screen when institute Caused by imaging distortion the problem of, the iris image of ellipse is corrected to approximate circle, facilitates subsequent iris recognition process, To improve the accuracy of iris recognition.
A8, the method as described in A7, wherein cx=cy=0, cz=-u, cx'=0,
A9, the method as described in A3, wherein the camera matrixIncluding two change in coordinate axis direction Focal length (fx, fy) and optical center coordinate (cx, cy)。
A10, method as described in a1, further includes: position of human eye is determined from imaging region according to eyes location algorithm, and Its position coordinates is scaled length unit from pixel unit;And by the length list in the iris image coordinate after the correction Position is scaled pixel unit, and the iris image that remaps.
B12, device as described in b11, the matrix construction unit are further adapted for constructing the camera mirror according to the angle, θ Spin matrix R and the R ' of head and former world coordinate system, wherein setting the origin of former world coordinate system as incident light axis and human eye iris The intersection point of place plane, and gravity and horizontal direction are located at there are two reference axis.
B13, as described in B12 device, ps=CR [(R ')-1C-1ps'+c '-c], wherein C is the phase by coefficient adjustment Machine matrix, suitable for the pixel unit in image is converted to length unit;C and c ' is the optical center of camera respectively relative to original The coordinate of the new coordinate system of world coordinate system and former world coordinate system after non-gravity and the axis of the horizontal direction rotation angle θ.
B14, device as described in b11,Wherein,It is each in original iris image The depth information of point, suitable for being calculated according to rotation angle, θ and object distance u.
B15, as described in B12 device, wherein
R is unit matrix,
B16, device as described in b11, the calculation formula of the angle, θ are as follows:
Wherein, u is object distance, and v is image distance, and h is that the central point in infrared imaging region in imaging sensor is passed to described image The distance of sensor central point, H are the central points of the human eye iris to the distance of the incident light axis, and a is the mobile terminal Screen in image display area to described image sensor central point distance.
B17, the device as described in B13, c=[cx,cy,cz]T, c '=[cx', cy', cz']T, wherein T is matrix transposition, c It is suitable for being calculated by the central point of angle theta, object distance u and human eye iris and incident light axis distance H with c '.
B18, the method as described in B17, wherein cx=cy=0, cz=-u, cx'=0,
B19, the device as described in B13, wherein the camera matrixIncluding two reference axis sides To focal length (fx, fy) and optical center coordinate (cx, cy)。
B20, device as described in b11, further includes: unit conversion unit is suitable for according to eyes location algorithm from imaging area Position of human eye is determined in domain, and its position coordinates is scaled length unit from pixel unit;And by the rainbow after the correction Length unit in film image coordinate is scaled pixel unit, and the iris image that remaps.
It should be appreciated that in order to simplify the disclosure and help to understand one or more of the various inventive aspects, it is right above In the description of exemplary embodiment of the present invention, each feature of the invention be grouped together into sometimes single embodiment, figure or In person's descriptions thereof.However, the disclosed method should not be interpreted as reflecting the following intention: i.e. claimed hair Bright requirement is than feature more features expressly recited in each claim.More precisely, as the following claims As book reflects, inventive aspect is all features less than single embodiment disclosed above.Therefore, it then follows specific real Thus the claims for applying mode are expressly incorporated in the specific embodiment, wherein each claim itself is used as this hair Bright separate embodiments.
Those skilled in the art should understand that the module of the equipment in example disclosed herein or unit or groups Part can be arranged in equipment as depicted in this embodiment, or alternatively can be positioned at and the equipment in the example In different one or more equipment.Module in aforementioned exemplary can be combined into a module or furthermore be segmented into multiple Submodule.
Those skilled in the art will understand that can be carried out adaptively to the module in the equipment in embodiment Change and they are arranged in one or more devices different from this embodiment.It can be the module or list in embodiment Member or component are combined into a module or unit or component, and furthermore they can be divided into multiple submodule or subelement or Sub-component.Other than such feature and/or at least some of process or unit exclude each other, it can use any Combination is to all features disclosed in this specification (including adjoint claim, abstract and attached drawing) and so disclosed All process or units of what method or apparatus are combined.Unless expressly stated otherwise, this specification is (including adjoint power Benefit require, abstract and attached drawing) disclosed in each feature can carry out generation with an alternative feature that provides the same, equivalent, or similar purpose It replaces.
In addition, it will be appreciated by those of skill in the art that although some embodiments described herein include other embodiments In included certain features rather than other feature, but the combination of the feature of different embodiments mean it is of the invention Within the scope of and form different embodiments.For example, in the following claims, embodiment claimed is appointed Meaning one of can in any combination mode come using.
In addition, be described as herein can be by the processor of computer system or by executing by some in the embodiment The combination of method or method element that other devices of the function are implemented.Therefore, have for implementing the method or method The processor of the necessary instruction of element forms the device for implementing this method or method element.In addition, Installation practice Element described in this is the example of following device: the device be used for implement as in order to implement the purpose of the invention element performed by Function.
As used in this, unless specifically stated, come using ordinal number " first ", " second ", " third " etc. Description plain objects, which are merely representative of, is related to the different instances of similar object, and is not intended to imply that the object being described in this way must Must have the time it is upper, spatially, sequence aspect or given sequence in any other manner.
Although the embodiment according to limited quantity describes the present invention, above description, the art are benefited from It is interior it is clear for the skilled person that in the scope of the present invention thus described, it can be envisaged that other embodiments.Additionally, it should be noted that Language used in this specification primarily to readable and introduction purpose and select, rather than in order to explain or limit Determine subject of the present invention and selects.Therefore, without departing from the scope and spirit of the appended claims, for this Many modifications and changes are obvious for the those of ordinary skill of technical field.For the scope of the present invention, to this Invent done disclosure be it is illustrative and not restrictive, it is intended that the scope of the present invention be defined by the claims appended hereto.

Claims (20)

1. a kind of iris image perspective correction method, suitable for executing in the terminal, this method comprises:
Obtain the original iris image of user to be identified;
Calculate the three dimensional space coordinate p of every bit in the original iris images';
The sight side of human eye when obtaining original iris image according to the positional information calculation of human eye iris and its original iris image To the angle, θ with horizontal direction;
The transformation matrix of the iris image perspective correction is constructed according to the angle, θ;
According to the transformation matrix and original iris image to the three dimensional space coordinate p of the original iris images' is sat Mark transformation, the three dimensional space coordinate p of the iris image after being correcteds
Wherein, the calculation formula of angle, θ are as follows:
Wherein, u is object distance, and v is image distance, and h is the central point in infrared imaging region in imaging sensor to described image sensor The distance of central point, H are the central points of the human eye iris to the distance of incident light axis, and a is in the screen of the mobile terminal Distance of the image display area to described image sensor central point.
2. the step of the method as described in claim 1, the transformation matrix of the building iris image perspective correction further include:
Spin matrix R and the R ' that camera lens and former world coordinate system are constructed according to the angle, θ, wherein setting former world coordinate system Origin be the intersection point of plane where incident light axis and human eye iris, and be located at gravity and level side there are two reference axis To.
3. method according to claim 2, ps=CR [(R ')-1C-1ps'+c '-c],
Wherein, C is the camera matrix by coefficient adjustment, suitable for the pixel unit in image is converted to length unit;C and c ' It is that the optical center of camera is revolved relative to former world coordinate system and former world coordinate system around non-gravity and the axis of horizontal direction respectively The coordinate of new coordinate system after turning the angle θ.
4. the method as described in claim 1,
Wherein,It is the depth information of every bit in original iris image, suitable for being calculated according to angle, θ and object distance u.
5. method according to claim 2, wherein
R is unit matrix,
6. method as claimed in claim 3, c=[cx,cy,cz]T, c '=[cx', cy', cz']T, wherein T is matrix transposition, c It is suitable for being calculated by the central point of angle, θ, object distance u and human eye iris and incident light axis distance H with c '.
7. method as claimed in claim 6, wherein cx=cy=0, cz=-u, cx'=0,
8. method as claimed in claim 3, wherein the camera matrixIncluding two reference axis sides To focal length (fx, fy) and optical center coordinate (cx, cy)。
9. the method as described in claim 1, further includes:
Position of human eye is determined from imaging region according to eyes location algorithm, and its position coordinates is scaled length from pixel unit Spend unit;And
Length unit in iris image coordinate after the correction is scaled pixel unit, and the iris image that remaps.
10. a kind of iris image perspective correction device is suitable for being resident in the terminal, which includes:
Image acquisition unit, suitable for obtaining the original iris image of user to be identified;
Coordinate calculating unit, suitable for calculating the three dimensional space coordinate p of every bit in the original iris images';
Angle calculation unit, suitable for obtaining original iris figure according to the positional information calculation of human eye iris and its original iris image As when the direction of visual lines of the human eye and angle, θ of horizontal direction;
Matrix construction unit, suitable for constructing the transformation matrix of the iris image perspective correction according to the angle, θ;
Coordinate transformation unit, suitable for the three dimensional space coordinate p according to the transformation matrix to original iris images' carries out coordinate change It changes, the three dimensional space coordinate p of the iris image after being correcteds
Wherein, the calculation formula of angle, θ are as follows:
Wherein, u is object distance, and v is image distance, and h is the central point in infrared imaging region in imaging sensor to described image sensor The distance of central point, H are the central points of the human eye iris to the distance of incident light axis, and a is in the screen of the mobile terminal Distance of the image display area to described image sensor central point.
11. device as claimed in claim 10, the matrix construction unit is further adapted for constructing camera lens according to the angle, θ With spin matrix R and the R ' of former world coordinate system, wherein setting the origin of former world coordinate system as incident light axis and human eye iris institute Gravity and horizontal direction are located in the intersection point of plane, and there are two reference axis.
12. device as claimed in claim 11, ps=CR [(R ')-1C-1ps'+c '-c],
Wherein, C is the camera matrix by coefficient adjustment, suitable for the pixel unit in image is converted to length unit;C and c ' It is that the optical center of camera is revolved relative to former world coordinate system and former world coordinate system around non-gravity and the axis of horizontal direction respectively The coordinate of new coordinate system after turning the angle θ.
13. device as claimed in claim 10,
Wherein,It is the depth information of every bit in original iris image, suitable for being calculated according to angle, θ and object distance u.
14. device as claimed in claim 11, wherein
R is unit matrix,
15. device as claimed in claim 12, c=[cx,cy,cz]T, c '=[cx', cy', cz']T, wherein T is that matrix turns It sets, c and c ' is suitable for being calculated by the central point of angle, θ, object distance u and human eye iris and incident light axis distance H.
16. device as claimed in claim 15, wherein cx=cy=0, cz=-u, cx'=0,
17. device as claimed in claim 12, wherein the camera matrixIncluding two reference axis Focal length (the f in directionx, fy) and optical center coordinate (cx, cy)。
18. device as claimed in claim 10, further includes:
Unit conversion unit is suitable for determining position of human eye from imaging region according to eyes location algorithm, and by its position coordinates Length unit is scaled from pixel unit;And the length unit in the iris image coordinate after the correction is scaled pixel Unit, and the iris image that remaps.
19. a kind of mobile terminal, including the iris image perspective correction device as described in any one of claim 10-18.
20. mobile terminal as claimed in claim 19 further includes answering with what the iris image perspective correction device mutually coupled Synthesized image system, the complex imaging system include:
Lens assembly, the optical lens including fixed focal length;
Optical filter box including the visible band pass filter for allowing the light of visible light wave range to pass through and allows near infrared light wave band By near infrared light bandpass region;And
Imaging sensor, including the transition region between visual light imaging region, near infrared light imaging region and the two regions Domain,
Wherein, the visual light imaging region is under the visual light imaging mode to by the visible band pass filter Visible light is imaged and the near infrared light imaging region is described close red to passing through under the near infrared light imaging mode The near infrared light of outer light belt pass filter is imaged.
CN201610602917.8A 2016-07-27 2016-07-27 A kind of iris image perspective correction method, apparatus and mobile terminal Active CN106250839B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610602917.8A CN106250839B (en) 2016-07-27 2016-07-27 A kind of iris image perspective correction method, apparatus and mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610602917.8A CN106250839B (en) 2016-07-27 2016-07-27 A kind of iris image perspective correction method, apparatus and mobile terminal

Publications (2)

Publication Number Publication Date
CN106250839A CN106250839A (en) 2016-12-21
CN106250839B true CN106250839B (en) 2019-06-04

Family

ID=57604365

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610602917.8A Active CN106250839B (en) 2016-07-27 2016-07-27 A kind of iris image perspective correction method, apparatus and mobile terminal

Country Status (1)

Country Link
CN (1) CN106250839B (en)

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107194968B (en) * 2017-05-18 2024-01-16 腾讯科技(上海)有限公司 Image identification tracking method and device, intelligent terminal and readable storage medium
CN107564089B (en) * 2017-08-10 2022-03-01 腾讯科技(深圳)有限公司 Three-dimensional image processing method, device, storage medium and computer equipment
CN108875526B (en) * 2018-01-05 2020-12-25 北京旷视科技有限公司 Method, device and system for line-of-sight detection and computer storage medium
CN108765301B (en) * 2018-03-27 2020-08-07 长春理工大学 Optical system and distortion correction method and system thereof
CN109726694B (en) * 2019-01-02 2023-08-25 上海百豪新材料有限公司 Iris image acquisition method and device
CN110544285B (en) * 2019-10-30 2020-02-04 南京安科医疗科技有限公司 Method for correcting head position in head CT image
CN111144219B (en) * 2019-11-29 2023-08-18 武汉虹识技术有限公司 Iris recognition device and method based on 3D structured light
CN111145087B (en) * 2019-12-30 2023-06-30 维沃移动通信有限公司 Image processing method and electronic equipment
CN111428654B (en) * 2020-03-27 2023-11-28 北京万里红科技有限公司 Iris recognition method, iris recognition device and storage medium
CN112417951B (en) * 2020-09-30 2022-06-24 北京极豪科技有限公司 Fingerprint image calibration method and device, electronic equipment and storage medium

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7756301B2 (en) * 2005-01-26 2010-07-13 Honeywell International Inc. Iris recognition system and method
CN201307266Y (en) * 2008-06-25 2009-09-09 韩旭 Binocular sightline tracking device
CN101656840B (en) * 2008-08-22 2011-09-28 原相科技股份有限公司 Wide-angle sensor array module and image correcting method, operating method and application thereof
CN103870796B (en) * 2012-12-13 2017-05-24 汉王科技股份有限公司 Eye sight evaluation method and device
CN104484649B (en) * 2014-11-27 2018-09-11 北京天诚盛业科技有限公司 The method and apparatus of iris recognition
CN204270321U (en) * 2014-12-24 2015-04-15 武汉虹识技术有限公司 A kind of iris collection device
CN104615978B (en) * 2015-01-23 2017-09-22 清华大学 Direction of visual lines tracking and device
CN105187726B (en) * 2015-06-17 2021-05-18 巽腾(广东)科技有限公司 Multifunctional mobile image processing device and processing method
CN105094337B (en) * 2015-08-19 2018-06-22 华南理工大学 A kind of three-dimensional gaze estimation method based on iris and pupil
CN105740846A (en) * 2016-03-02 2016-07-06 河海大学常州校区 Horizontal visual angle estimation and calibration method based on depth camera

Also Published As

Publication number Publication date
CN106250839A (en) 2016-12-21

Similar Documents

Publication Publication Date Title
CN106250839B (en) A kind of iris image perspective correction method, apparatus and mobile terminal
CN106295533B (en) A kind of optimization method, device and the camera terminal of self-timer image
CN109151340B (en) Video processing method and device and electronic equipment
CN104506762B (en) Optical field acquisition control method and device, optical field acquisition equipment
WO2015180659A1 (en) Image processing method and image processing device
CN108777767A (en) Photographic method, device, terminal and computer readable storage medium
KR20190038594A (en) Face recognition-based authentication
CN107920211A (en) A kind of photographic method, terminal and computer-readable recording medium
WO2016010724A1 (en) Multispectral eye analysis for identity authentication
WO2016010721A1 (en) Multispectral eye analysis for identity authentication
WO2016010720A1 (en) Multispectral eye analysis for identity authentication
US11244158B2 (en) Image acquisition method, apparatus, system, and electronic device
CN108200335A (en) Photographic method, terminal and computer readable storage medium based on dual camera
CN110290324A (en) Equipment imaging method, device, storage medium and electronic equipment
CN206595991U (en) A kind of double-camera mobile terminal
CN110213493A (en) Equipment imaging method, device, storage medium and electronic equipment
WO2021164678A1 (en) Automatic iris capturing method and apparatus, computer-readable storage medium, and computer device
CN106529436A (en) Identity consistency authentication method and device, and mobile terminal
US20170046813A1 (en) An apparatus and associated methods for image capture
CN110213492A (en) Equipment imaging method, device, storage medium and electronic equipment
CN110232707A (en) A kind of distance measuring method and device
CN110427108A (en) Photographic method and Related product based on eyeball tracking
EP2981074B1 (en) Display device, display method, and display program
CN110225256A (en) Equipment imaging method, device, storage medium and electronic equipment
CN107392088A (en) Three-dimensional vein identification device and method, switch, mobile terminal

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
CB03 Change of inventor or designer information

Inventor after: Wang Xiaopeng

Inventor before: Wang Xiaopeng

Inventor before: Guo Yansong

CB03 Change of inventor or designer information
GR01 Patent grant
GR01 Patent grant