CN110287668A - Unlocking method and Related product - Google Patents
Unlocking method and Related product Download PDFInfo
- Publication number
- CN110287668A CN110287668A CN201910528810.7A CN201910528810A CN110287668A CN 110287668 A CN110287668 A CN 110287668A CN 201910528810 A CN201910528810 A CN 201910528810A CN 110287668 A CN110287668 A CN 110287668A
- Authority
- CN
- China
- Prior art keywords
- facial image
- image
- mould group
- infrared
- face
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
- G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
- G06F21/31—User authentication
- G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
Landscapes
- Engineering & Computer Science (AREA)
- Computer Security & Cryptography (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Software Systems (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Image Analysis (AREA)
Abstract
The embodiment of the present application discloses a kind of unlocking method and Related product, and the method is applied to electronic equipment, and the electronic equipment includes: infrared mould group, which comprises obtains the facial image of the infrared mould group acquisition；The facial image is matched with default face template；Such as the facial image and default face template successful match, unlock operation is executed.Technical solution provided by the present application may be implemented to realize recognition of face unlock by infrared mould group, promote unlock operation convenience, improves face unlock efficiency, has the advantages that user experience is high.
Description
Technical field
This application involves technical field of electronic equipment, and in particular to a kind of unlocking method and Related product.
Background technique
With a large amount of popularization and applications of electronic equipment (such as mobile phone, tablet computer), what electronic equipment can be supported is answered
With more and more, function is stronger and stronger, and electronic equipment develops towards diversification, personalized direction, becomes in user's life
Indispensable appliance and electronic.
It is main at present that facial image progress recognition of face unlock is acquired by camera, there is ejection type camera shooting for part
It needs frequently to go up and down and open camera for the electronic equipment of head, causes electronic equipment to realize that face unlock is cumbersome, drop
Low face unlocks efficiency.
Summary of the invention
This application provides a kind of unlocking method and Related products, realize that face is known by infrared mould group to can achieve
It does not unlock, avoids frequently going up and down and unlatching camera causes face unlock cumbersome, promote unlock operation convenience, improve
Face unlocks efficiency.
In a first aspect, the embodiment of the present application provides a kind of unlocking method, the method is applied to electronic equipment, the electronics
Equipment includes: infrared mould group, which comprises
Obtain the facial image of the infrared mould group acquisition；
The facial image is matched with default face template；
Such as the facial image and default face template successful match, unlock operation is executed.
Second aspect, the embodiment of the present application provide a kind of device, and described device is applied to electronic equipment, the electronic equipment
It include: infrared mould group, described device includes:
Acquiring unit, for obtaining the facial image of the infrared mould group acquisition；
Judging unit, for matching the facial image with default face template；
Execution unit, for such as the facial image and default face template successful match, execution unlock operation.
The third aspect, the embodiment of the present application provide a kind of electronic equipment, including processor, memory, communication interface and
One or more programs, wherein said one or multiple programs are stored in above-mentioned memory, and are configured by above-mentioned
It manages device to execute, above procedure is included the steps that for executing the instruction in the embodiment of the present application first aspect.
Fourth aspect, the embodiment of the present application provide a kind of computer readable storage medium, wherein above-mentioned computer-readable
Storage medium storage is used for the computer program of electronic data interchange, wherein above-mentioned computer program executes computer such as
Step some or all of described in the embodiment of the present application first aspect.
5th aspect, the embodiment of the present application provide a kind of computer program product, wherein above-mentioned computer program product
Non-transient computer readable storage medium including storing computer program, above-mentioned computer program are operable to make to calculate
Machine executes the step some or all of as described in the embodiment of the present application first aspect.The computer program product can be one
A software installation packet.
As can be seen that the facial image that technical solution provided by the present application is acquired by obtaining the infrared mould group；By institute
Facial image is stated to be matched with default face template；Such as the facial image and default face template successful match, solution is executed
Lock operation avoids causing face unlock cumbersome due to frequently going up and down and opening camera, promotes unlock operation convenience, mention
Face unlock efficiency is risen.
Detailed description of the invention
In order to illustrate the technical solutions in the embodiments of the present application or in the prior art more clearly, to embodiment or will show below
There is attached drawing needed in technical description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this
Some embodiments of application for those of ordinary skill in the art without creative efforts, can be with
It obtains other drawings based on these drawings.
Figure 1A is the structural schematic diagram of a kind of electronic equipment provided by the embodiments of the present application；
Figure 1B is a kind of flow diagram of unlocking method provided by the embodiments of the present application；
Fig. 2A is the flow diagram of another unlocking method provided by the embodiments of the present application；
Fig. 2 B is the flow diagram of another unlocking method provided by the embodiments of the present application；
Fig. 3 is the structural schematic diagram of a kind of electronic equipment provided by the embodiments of the present application；
Fig. 4 is a kind of functional unit composition block diagram of tripper provided by the embodiments of the present application.
Specific embodiment
Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete
Site preparation description, it is clear that described embodiments are some of the embodiments of the present invention, instead of all the embodiments.Based on this hair
Embodiment in bright, every other implementation obtained by those of ordinary skill in the art without making creative efforts
Example, shall fall within the protection scope of the present invention.
Description and claims of this specification and term " first ", " second ", " third " and " in the attached drawing
Four " etc. are not use to describe a particular order for distinguishing different objects.In addition, term " includes " and " having " and it
Any deformation, it is intended that cover and non-exclusive include.Such as it contains the process, method of a series of steps or units, be
System, product or equipment are not limited to listed step or unit, but optionally further comprising the step of not listing or list
Member, or optionally further comprising other step or units intrinsic for these process, methods, product or equipment.
Referenced herein " embodiment " is it is meant that the special characteristic, result or the characteristic that describe can wrap in conjunction with the embodiments
Containing at least one embodiment of the present invention.Each position in the description occur the phrase might not each mean it is identical
Embodiment, nor the independent or alternative embodiment with other embodiments mutual exclusion.Those skilled in the art explicitly and
Implicitly understand, embodiment described herein can be combined with other embodiments.
Electronic equipment involved by the embodiment of the present application may include the various handheld devices with wireless communication function
(such as smart phone or tablet computer) calculates equipment or is connected to other processing equipments of radio modem, and each
The user equipment (user equipment, UE) of kind form, mobile station (mobile station, MS), terminal device
(terminal device) etc..
It describes in detail below to the embodiment of the present application.
Figure 1A is please referred to, Figure 1A is the structural schematic diagram of a kind of electronic equipment disclosed in the embodiment of the present application, electronic equipment
100 include storage and processing circuit 110, and the sensor 170 connecting with the storage and processing circuit 110, in which:
Electronic equipment 100 may include control circuit, which may include storage and processing circuit 110.This is deposited
Storage and processing circuit 110 can store device, such as hard drive memory, nonvolatile memory (such as flash memory or it is used for shape
At other electrically programmable read only memories etc. of solid state drive), volatile memory (such as either statically or dynamically arbitrary access
Memory etc.) etc., the embodiment of the present application is with no restriction.Processing circuit in storage and processing circuit 110 can be used for controlling electricity
The operating of sub- equipment 100.The processing circuit can microprocessor based on one or more, microcontroller, digital signal processor,
Baseband processor, power management unit, audio codec chip, specific integrated circuit, display-driver Ics etc. come
It realizes.
Storage and processing circuit 110 can be used for running the software in electronic equipment 100, such as the Internet browser application journey
Sequence, voice over internet protocol (Voice over Internet Protocol, VOIP) call application program, Email
Application program, media play-back application, operation system function etc..These softwares can be used for executing some control operations, example
Such as, based on the Image Acquisition of camera, the ambient light measurement based on ambient light sensor, based on proximity sensor close to sensing
Device measurement, the information display function that the positioning indicators such as status indicator lamp based on light emitting diode are realized, based on touch
The touch event of sensor detects, and in the associated function of multiple (such as layering) display information displayed on screen, with execution
The associated operation of wireless communication function, operation associated with collecting and generating audio signal, is pressed with collection and treatment button
Other functions etc. in the associated control operation of event data and electronic equipment 100 are pressed, the embodiment of the present application does not limit
System.
Electronic equipment 100 may include input-output circuit 150.Input-output circuit 150 can be used for making electronic equipment
100 realization data are output and input, i.e. permission electronic equipment 100 allows electronic equipment from outer equipment receiving data and also
100 export data to external equipment from electronic equipment 100.Input-output circuit 150 may further include sensor 170.
Sensor 170 may include infrared mould group, wherein infrared mould group may include infrared camera and ultrasonic sensor, infrared
Camera can be used for acquiring infrared face image or for infrared distance measurement, and ultrasonic sensor can be used for acquiring face figure
Picture or ultrasonic distance measurement can also include ambient light sensor, the proximity sensor based on light and capacitor, fingerprint recognition mould
Group, (for example, being based on light touch sensor and/or capacitive touch sensors, touch sensor can be touch-control to touch sensor
A part of display screen can also be used as a touch sensor arrangement and independently use), acceleration transducer, camera and its
Its sensor etc., camera can be front camera or rear camera, and fingerprint recognition mould group can be integrated under display screen
Side, for acquiring fingerprint image, fingerprint recognition mould group can be following at least one: optical finger print identifies mould group or ultrasound
Wave fingerprint recognition mould group etc., is not limited thereto.The lower section of front display screen can be set in above-mentioned front camera, after above-mentioned
Setting camera can be set in the lower section of display screen below.Certain above-mentioned front camera or rear camera can also get along well aobvious
Display screen is integrally disposed, and certainly in practical applications, above-mentioned front camera or rear camera can also be lifting structure, this Shen
Please specific embodiment be not intended to limit the specific structure of above-mentioned front camera or rear camera.
Input-output circuit 150 can also include one or more display screens, when for multiple display screens, such as 2 aobvious
When display screen, a display screen be can be set before electronic equipment, another display screen can be set after electronic equipment
Face, such as display screen 130.Display screen 130 may include liquid crystal display, organic light-emitting diode (OLED) display screen, and electric ink is aobvious
Display screen, plasma panel, one or several kinds of combination in the display screen using other display technologies.Display screen 130 can be with
Including touch sensor array (that is, display screen 130 can be touching display screen).Touch sensor can be by transparent touch
The capacitive touch sensors that sensor electrode (such as tin indium oxide (ITO) electrode) array is formed, or can be and use it
The touch sensor that its touching technique is formed, such as sound wave touch-control, pressure sensible touch, resistive touch, optical touch etc., the application are real
Apply example with no restriction.
Electronic equipment 100 can also include audio component 140.Audio component 140 can be used for providing for electronic equipment 100
Audio input and output function.Audio component 140 in electronic equipment 100 may include loudspeaker, microphone, buzzer, sound
Adjust generator and other for generating and detecting the component of sound.
Telecommunication circuit 120 can be used for providing the ability with external device communication for electronic equipment 100.Telecommunication circuit 120
It may include analog- and digital- input-output interface circuit, and the radio communication circuit based on radiofrequency signal and/or optical signal.
Radio communication circuit in telecommunication circuit 120 may include radio-frequency transceiver circuitry, power amplifier circuit, low noise amplification
Device, switch, filter and antenna.For example, the radio communication circuit in telecommunication circuit 120 may include for passing through transmitting
The circuit of near-field communication (Near Field Communication, NFC) is supported with near-field coupling electromagnetic signal is received.Example
Such as, telecommunication circuit 120 may include near-field communication aerial and near-field communication transceiver.Telecommunication circuit 120 can also include honeycomb
Telephone transceiver and antenna, wireless lan transceiver circuit and antenna etc..
Electronic equipment 100 can further include battery, power management circuitry and other input-output units 160.It is defeated
Enter-output unit 160 may include button, control stick, click wheel, scroll wheel, touch tablet, keypad, keyboard, camera, hair
Optical diode and other positioning indicators etc..
User can input a command for the operation of controlling electronic devices 100 by input-output circuit 150, and can be with
Status information and other outputs from electronic equipment 100 are received using the output data of input-output circuit 150 to realize.
Display screen in the embodiment of the present application can be Thin Film Transistor-LCD (Thin Film
Transistor-Liquid Crystal Display, TFT-LCD), light emitting diode (LED) display screen (Light Emitting
Diode, LED), organic light-emitting diode (OLED) display screen (Organic Light-Emitting Diode, OLED) etc..
Based on electronic equipment described in above-mentioned Figure 1A, following function can be used to implement:
The infrared mould group of the electronic equipment, for emitting infrared light collection facial image；
The storage and processing circuit 110 of the electronic equipment, for obtaining the facial image of the infrared mould group acquisition；It will
The facial image is matched with default face template；Such as the facial image and default face template successful match, execute
Unlock operation.
In a kind of optional technical solution,
Circuit 110 is stored and processed, for the facial image for obtaining the infrared mould group acquisition, comprising: obtain institute
State the first time of infrared camera transmitting infrared light；Obtain the second time that the infrared camera receives the infrared light；
The first distance between the electronic equipment and face is determined according to the first time, second time；Described first
When distance is less than default first distance threshold value, face acquisition is carried out by the infrared camera and ultrasonic sensor, is obtained
Facial image.
In a kind of optional technical solution,
Circuit 110 is stored and processed, includes: described in acquisition for the facial image for obtaining the infrared mould group acquisition
The third time of ultrasonic sensor transmitting ultrasonic wave；Obtain the 4th time that the ultrasonic sensor receives the ultrasonic wave；According to
The second distance between the electronic equipment and face is determined according to the third time, the 4th time；Described second away from
When from being less than default second distance threshold value, face acquisition being carried out by the infrared camera and ultrasonic sensor, obtains people
Face image.
In a kind of optional technical solution,
Circuit 110 is stored and processed, for obtaining facial image, the facial image includes following three facial image:
Infrared face image, ultrasonic wave facial image and image is carried out by the infrared face image and the ultrasonic wave facial image melts
The synthesis facial image obtained after conjunction；It is described that match with default face template by the facial image include: to described three
A facial image carries out image quality evaluation, obtains three image quality evaluation values；From three image quality evaluation values
Maximum value is chosen, using the corresponding facial image of the maximum value as facial image to be matched；It obtains and the face figure to be matched
As the corresponding default face template；The facial image to be matched is matched with the default face template.
In a kind of optional technical solution,
Circuit 110 is stored and processed, the acceleration of gravity of gravity sensor acquisition is received, judges that the acceleration of gravity is
No to be greater than preset acceleration of gravity threshold value, such as acceleration of gravity is greater than the acceleration of gravity threshold value, starts described red
External mold group；The energy change value that the infrared mould group returns is received, is greater than preset energy variation threshold in the energy change value
Value executes described the step of obtaining the facial image that the infrared mould group acquires.
In a kind of optional technical solution,
Circuit 110 is stored and processed, it fails to match with default face template for such as the facial image, and starting fingerprint is known
Other mould group；Obtain fingerprint image；The fingerprint image is matched with preset fingerprint template, the fingerprint image with it is described
When the success of preset fingerprint template matching, the step of execution unlock operates is executed.
Figure 1B is please referred to, Figure 1B is a kind of flow diagram of unlocking method provided by the embodiments of the present application, as shown,
Applied to electronic equipment as shown in Figure 1A, the electronic equipment includes that this panorama shooting method includes:
Step 101, the facial image for obtaining the infrared mould group acquisition.
Wherein, above-mentioned facial image may include following at least one: infrared face image, ultrasonic wave facial image and should
Infrared face image and the ultrasonic wave facial image carry out the synthesis facial image obtained after image co-registration.
In a possible example, the acceleration of gravity of gravity sensor acquisition is received, preset acceleration of gravity is obtained
Threshold value, judges whether the acceleration of gravity is greater than the acceleration of gravity threshold value, as the acceleration of gravity is greater than the acceleration of gravity
Threshold value executes face judgement operation, wherein face judgement includes: the infrared mould group of starting, receives the energy that the infrared mould group returns
Changing value is measured, preset energy variation threshold value is obtained, judges whether the energy change value is greater than the energy variation threshold value, if the energy
It measures changing value and is greater than the energy variation threshold value, hold the facial image operation for obtaining the infrared mould group acquisition, obtain the facial image.
Wherein, which can be any one predeterminable area of the electronic equipment, which can be set
In display screen, any positions such as upper left side, upside, downside, left side, the right side of display screen can be located at, it can also be simultaneously
The left and right side of the display screen is set, it is, of course, also possible to be set to the back side of electronic equipment.The area of the predeterminable area is big
It is small that the shape of the predeterminable area can be round, ellipse, trapezoidal etc. premised on meeting and can emit reception infrared light,
This is without limitation；For example, the infrared mould group can be set at the outline border of the electronic equipment left and right side, which can
To include: infrared camera and receiving antenna.
In a possible example, the infrared mould group includes: infrared camera, and the electronic equipment includes: ultrasonic mould
Group, the ultrasound mould group includes: ultrasonic sensor；Above-mentioned steps 101, the facial image packet for obtaining the infrared mould group acquisition
It includes:
A11, the first time for obtaining the infrared camera transmitting infrared light；
A12, the second time that the infrared camera receives the infrared light is obtained；
A13, according to the first time, second time determine between the electronic equipment and face first away from
From；
A14, when the first distance is less than default first distance threshold value, pass through the infrared camera and the ultrasound
Wave sensor carries out face acquisition, obtains the facial image.
Wherein, which can be any one predeterminable area of the electronic equipment, which can be set
In display screen, any positions such as upper left side, upside, downside, left side, the right side of display screen can be located at, it can also be simultaneously
The left and right side of the display screen is set, it is, of course, also possible to be set to the back side of electronic equipment.The area of the predeterminable area is big
It is small that the shape of the predeterminable area can be round, ellipse, trapezoidal etc. premised on meeting and can emit reception ultrasonic wave,
This is without limitation；For example, the ultrasound mould group can be set at the outline border of the electronic equipment left and right side, which can
To include: ultrasonic sensor and receiving antenna.
In a possible example, start the infrared camera in infrared mould group, controls the infrared camera in default side
Transmitting infrared light upwards, which may include: the vertical direction etc. of the electronic equipment display screen, determine the infrared photography
Hair penetrates the first time of infrared light；The infrared light for receiving infrared camera transmitting, it is red to determine that the infrared camera receives this
Second time of outer light；Preset first distance calculation formula is obtained, which may include:
d1=v1*(t2-t1)/2
Wherein, d1For the first distance, v1For the aerial spread speed of infrared light, t1At the first time for this, t2For this
Second time；It is calculated between the electronic equipment and face according to the first distance calculation formula, first time, the second time
First distance；Default first distance threshold value is obtained, judges whether the first distance is less than the default first distance threshold value, if should
First distance is less than the default first distance threshold value, starts ultrasonic sensor, carries out face by the ultrasonic sensor and adopts
Collection, obtains ultrasonic wave facial image, carries out face acquisition by the infrared camera, obtains infrared face image, obtains default
Image Fusion, to the ultrasonic wave facial image, the infrared face image execute image co-registration synthesis face is calculated
Image returns to the facial image, which includes: the ultrasonic wave facial image, the infrared face image, the synthesis face
Image.
In a possible example, the infrared mould group includes: infrared camera, and the electronic equipment includes: ultrasound
Mould group, the ultrasound mould group includes: ultrasonic sensor；Above-mentioned steps 101, the facial image for obtaining the infrared mould group acquisition
Include:
B11, the third time for obtaining the ultrasonic sensor transmitting ultrasonic wave；
B12, the 4th time that the ultrasonic sensor receives the ultrasonic wave is obtained；
B13, according to the third time, the 4th time determine between the electronic equipment and face second away from
From；
B14, when the second distance is less than default second distance threshold value, pass through the infrared camera and the ultrasound
Wave sensor carries out face acquisition, obtains the facial image.
In a possible example, start the ultrasonic sensor in infrared mould group, controls the ultrasonic sensor pre-
Emit ultrasonic wave on set direction, which may include: the vertical direction etc. of the electronic equipment display screen, determine the ultrasound
The third time of wave sensor transmitting ultrasonic wave；The ultrasonic wave for receiving ultrasonic sensor transmitting, determines the supersonic sensing
Device receives the second time of the ultrasonic wave；Preset second distance calculation formula is obtained, which can wrap
It includes:
d2=v2*(t4-t3)/2
Wherein, d2For the second distance, v2For the aerial spread speed of ultrasonic wave, t3For the third time, t4For this
4th time；It is calculated between the electronic equipment and face according to the second distance calculation formula, third time, the 4th time
Second distance；Default second distance threshold value is obtained, judges whether the second distance is less than the default second distance threshold value, if should
Second distance is less than the default second distance threshold value, starts infrared camera, carries out face acquisition by the infrared camera, obtains
To infrared face image, face acquisition is carried out by the ultrasonic sensor, ultrasonic wave facial image is obtained, obtains preset figure
As blending algorithm, image co-registration is executed to the ultrasonic wave facial image, the infrared face image, synthesis facial image is calculated,
The facial image is returned to, which includes: the ultrasonic wave facial image, the infrared face image, the synthesis facial image.
Above-mentioned terminal start infrared mould group mode can there are many, such as in an alternative embodiment, Ke Yitong
A specific button is crossed to determine whether to start infrared mould group.It certainly, can be by full in an alternative embodiment
When foot setting trigger condition, start or obtain the face picture of infrared mould group acquisition, which can be one specifically
To determine whether to start infrared mould group, which includes but is not limited to that specific gesture or bio-identification are tested for operation
Card etc..The application specific embodiment is not intended to limit the scheme of the infrared mould group of above-mentioned starting.
Step 102 matches the facial image with default face template.
Wherein, default face template can pre-save in the electronic device, default face template may be one or
The multiple facial images of person, default face template may include following at least one: infrared face image, ultrasonic wave facial image,
Facial image is synthesized by what is obtained after the infrared face image and ultrasonic wave facial image progress image co-registration.
In a possible example, the facial image includes following three facial image: infrared face image, ultrasound
Wave facial image and people is synthesized by what the infrared face image and the ultrasonic wave facial image obtain after image co-registration
Face image；The facial image is matched with default face template, be may include steps of by above-mentioned steps 102:
A21, image quality evaluation is carried out to three facial images, obtains three image quality evaluation values；
A22, choose maximum value from three image quality evaluation values, using the corresponding facial image of the maximum value as
Facial image to be matched；
A23, the default face template corresponding with the facial image to be matched is obtained；
A24, the facial image to be matched is matched with the default face template.
Wherein, which may include following three facial image: infrared face image, ultrasonic wave facial image and
The infrared face image and the ultrasonic wave facial image carry out the synthesis facial image obtained after image co-registration.
In a possible example, above-mentioned steps A21 carries out image quality evaluation to three facial images, obtains
Three image quality evaluation values may include: to obtain preset image quality evaluation algorithm, execute figure to three facial images
As quality evaluation algorithm, three image quality evaluation values are obtained, wherein executing the image quality evaluation algorithm includes: to obtain to be somebody's turn to do
The image data of facial image, the image data may include it is following one or more: exposure, clarity, color value,
Noise figure, color difference, color difference reduction degree, resolution ratio, color space, to coke number, pseudomorphism, obtain the mapping of the image data and weight
Relationship determines the corresponding image weights of the image data, is calculated according to the image data, the weight, and the face figure is obtained
As corresponding image quality evaluation values.
In a possible example, above-mentioned steps A23 obtains the default people corresponding with the facial image to be matched
Face template, it may include: the determining people to be matched that the facial image to be matched, which match with the default face template,
The corresponding default face template of face image obtains default template for example, determining that the facial image to be matched is infrared face image
In infrared face template preset face template as this；Feature extraction operation is executed to the facial image to be matched, is somebody's turn to do
The corresponding face characteristic to be matched of facial image to be matched obtains the default corresponding default face characteristic of face template, foundation
The face characteristic to be matched, the default face characteristic execute feature matching operation, obtain the face characteristic to be matched and this is default
The characteristic similarity of face characteristic obtains preset similarity threshold, judges whether this feature similarity is greater than the similarity threshold
Value determines that the facial image to be matched is matched into the default face template if this feature similarity is greater than the similarity threshold
Function determines that the facial image to be matched is matched with the default face template if this feature similarity is not more than the similarity threshold
It is unsuccessful.
In a possible example, above-mentioned steps 102 match the facial image with default face template, can
To include the following steps:
B21, ambient brightness is obtained；
B22, facial image to be matched is determined according to the ambient brightness；
B23, the determination default face template corresponding with the facial image to be matched；
B24, the facial image to be matched is matched with the default face template.
In a possible example, above-mentioned steps B22 determines that facial image to be matched can wrap according to the ambient brightness
It includes: obtaining the mapping relations of preset brightness range Yu stencil-chosen strategy, determine the ambient brightness pair according to the ambient brightness
The subject brightness range answered, the mapping relations according to the subject brightness range, the brightness range and stencil-chosen strategy determine should
The corresponding target selection strategy of subject brightness range determines people to be matched according to the target selection strategy from the facial image
Face image；For example, determining the corresponding object brightness model of the ambient brightness according to the ambient brightness if obtaining the ambient brightness is 20
It encloses for the first range, determines that the corresponding target of first range is selected according to the brightness range and the mapping relations of stencil-chosen strategy
Selecting strategy is first choice strategy, determines that the facial image to be matched is infrared face image according to the first choice strategy；If
Obtaining the ambient brightness is 50, determines that the corresponding subject brightness range of the ambient brightness is the second range according to the ambient brightness,
Determine that the corresponding target selection strategy of second range is second according to the brightness range and the mapping relations of stencil-chosen strategy
Selection strategy determines that the facial image to be matched is ultrasonic wave facial image according to second selection strategy；If obtaining the environment
Brightness is 70, determines that the corresponding subject brightness range of the ambient brightness is third range according to the ambient brightness, according to the brightness
Range and the mapping relations of stencil-chosen strategy determine that the corresponding target selection strategy of the third range is third selection strategy, according to
Determine that the facial image to be matched is that the infrared face image and the ultrasonic wave facial image carry out figure according to the third selection strategy
As the synthesis facial image obtained after fusion.
Step 103, such as described facial image and default face template successful match, execute unlock operation.
In a possible example, obtained after executing matching operation with the default face template to the facial image to be matched
Human face similarity degree obtains preset similarity threshold, judges whether the human face similarity degree is greater than the similarity threshold, if the face
Similarity is greater than the similarity threshold, determines the facial image and preset face template successful match, executes unlock operation；If
The human face similarity degree is not more than the similarity threshold, and determining the facial image, it fails to match with preset face template, and starting refers to
Line identifies mould group, receives the fingerprint image of fingerprint recognition mould group acquisition, executes feature extraction and calculation to the fingerprint image and obtains
The corresponding fingerprint characteristic of the fingerprint image obtains the corresponding preset fingerprint feature of preset fingerprint template, calculate the fingerprint characteristic with
The fingerprint similarity of the preset fingerprint feature, judges whether the fingerprint similarity is greater than preset fingerprint similarity threshold, if should
Fingerprint similarity is greater than the fingerprint similarity threshold, determines the fingerprint image and preset fingerprint template matching success, executes solution
Lock operation determines the fingerprint image and the preset fingerprint template if the fingerprint similarity is not more than the fingerprint similarity threshold
With unsuccessful, the total degree of face matching and fingerprint matching is obtained, if the total degree is greater than preset frequency threshold value, stops holding
Row unlock operation simultaneously sends abnormality alarm to preset electronic equipment.
Wherein, which can be set any one predeterminable area in the electronic equipment, the predeterminable area
It can be set in display screen, the upper left side of display screen, upside, downside, left side, right side etc. any position can be located at,
The size of the predeterminable area is premised on the fingerprint region for meeting finger can cover.The shape of the predeterminable area can be circle
Shape, ellipse, trapezoidal etc., are not limited thereto.
In a possible example, however, it is determined that it fails to match with preset face template for the facial image, and starting vein is known
Other mould group receives the vein image of hand vein recognition mould group acquisition, obtains default vein template, which is preset with this
Vein template is matched, comprising:
31, image segmentation is carried out to the vein image, obtains targeted vein area image；
32, the characteristic point distribution of the targeted vein area image is analyzed；
33, circular image interception is carried out to the targeted vein area image according to a not concentric of M, obtains M circle
Venosomes image, the M are the integer greater than 3；
34, target circle venosomes image is selected from the M circular vein area image, the target circle is quiet
The quantity for the characteristic point that arteries and veins area image is included is greater than other circular vein regions in the M circular vein area image
Image；
35, the target circle venosomes image is divided to obtain N number of annulus, the ring width of N number of annulus is identical；
36, since N number of annulus the smallest annulus of radius, by N number of annulus successively with default vein template
Carry out Feature Points Matching, and the accumulative matching value for having matched annulus；
37, stop carrying out Feature Points Matching immediately when accumulative matching value is greater than preset matching threshold value, and export identity
Identify successful prompting message.
Wherein, electronic equipment can carry out image segmentation to vein image, obtain targeted vein area image, in turn, point
The characteristic point distribution for analysing the targeted vein area image carries out the targeted vein area image according to a not concentric of M round
Image interception obtains M circular vein area image, and M is the integer greater than 3, selects mesh from M circular vein area image
Circular vein area image is marked, the quantity for the characteristic point that target circle venosomes image is included is greater than M circular vein area
Other circular vein area images in area image divide target circle venosomes image to obtain N number of annulus, N number of annulus
Ring width it is identical, since N number of annulus the smallest annulus of radius, by N number of annulus successively with default vein template carry out feature
Point matching, and the accumulative matching value for having matched annulus, in this way, during hand vein recognition, it can be by different location or difference
The characteristic point of vein is equivalent to and samples to entire vein image, and the sampling can cover entire vein area for matching
Domain, thus, corresponding property feature up to standard can be found from each region to be used to match, when accumulative matching value is greater than in advance
If stopping carrying out Feature Points Matching immediately when matching threshold, and the successful prompting message of identification is exported, so, it is possible quickly
And precisely identify hand vein recognition；If the vein image and the default vein object matching success, execute unlock operation.
Another unlocking method is provided refering to Fig. 2A, Fig. 2A, unlocking method as shown in Figure 2 A is using as shown in Figure 1A
Electronic equipment execute, this method is as shown in Figure 2 A, includes the following steps:
Step 201A, the acceleration of gravity of gravity sensor acquisition is received；
Step 202A, judge whether the acceleration of gravity is greater than preset acceleration of gravity threshold value, such as gravity adds
Speed is greater than the acceleration of gravity threshold value, starts the infrared mould group；
Step 203A, the energy change value that the infrared mould group returns is received, is greater than in the energy change value preset
Energy variation threshold value obtains the facial image of the infrared mould group acquisition；
Step 204A, the facial image is matched with default face template, such as the facial image and default people
The success of face template matching executes unlock operation.
Wherein, the specific descriptions of above-mentioned steps 201A- step 204A are referred to unlocking method described in above-mentioned Figure 1B
Corresponding steps, details are not described herein.
As can be seen that unlocking method described in the embodiment of the present application, is applied to electronic equipment, the electronic equipment packet
Include: gravity sensor, infrared mould group receive the acceleration of gravity of gravity sensor acquisition, whether judge the acceleration of gravity
Greater than preset acceleration of gravity threshold value, such as acceleration of gravity is greater than the acceleration of gravity threshold value, starts described infrared
Mould group receives the energy change value that the infrared mould group returns, and is greater than preset energy variation threshold value in the energy change value,
The facial image for obtaining the infrared mould group acquisition, the facial image is matched with default face template, such as the people
Face image and default face template successful match execute unlock operation, in this way, the acceleration of gravity acquired by gravity sensor
Start infrared mould group, facial image is acquired by energy variation amount, the intelligence of infrared mould group acquisition function is improved, improves
User experience.
Refering to Fig. 2 B, Fig. 2 B provides another unlocking method, and unlocking method as shown in Figure 2 B is using as shown in Figure 1A
Electronic equipment execute, this method is as shown in Figure 2 B, includes the following steps:
Step 201B, the facial image of the infrared mould group acquisition is obtained；
Step 202B, the facial image is matched with default face template；
Step 203B, such as described facial image and default face template successful match, execute unlock operation；
Step 204B, it fails to match with default face template for such as described facial image, starts fingerprint recognition mould group；
Step 205B, fingerprint image is obtained；
Step 206B, the fingerprint image is matched with preset fingerprint template, the fingerprint image with it is described pre-
If when fingerprint template successful match, executing the step of execution unlock operates.
Wherein, the specific descriptions of above-mentioned steps 201B- step 206B are referred to unlocking method described in above-mentioned Figure 1B
Corresponding steps, details are not described herein.
As can be seen that unlocking method described in the embodiment of the present application, is applied to electronic equipment, the electronic equipment packet
Include: infrared mould group, fingerprint recognition mould group obtain the facial image of the infrared mould group acquisition, by the facial image and preset
Face template is matched, such as the facial image and default face template successful match, executes unlock operation, such as face
It fails to match with default face template for image, starts fingerprint recognition mould group, obtains fingerprint image, by the fingerprint image and presets
Fingerprint template is matched, and in the fingerprint image and preset fingerprint template matching success, execution is described to execute unlock
The step of operation, so, it is possible to realize recognition of face unlock by infrared mould group, unlock operation convenience be promoted, in infrared mould
Fingerprint recognition unlock is realized by fingerprint recognition mould group when group recognition of face failure, meets the diversity of user demand, improves
Face unlocks efficiency.
As shown in figure 3, Fig. 3 provides a kind of electronic equipment, which includes infrared mould group 301, processor
302 and memory 303, wherein
The infrared mould group 301, for acquiring facial image；
The processor 302, for obtaining the facial image；By the facial image and the progress of default face template
Match；Such as the infrared face image and default face template successful match, unlock operation is executed.
In a kind of optional embodiment, processor 302 is specifically used for: described to obtain what the infrared mould group acquired
Facial image includes: the first time for obtaining the infrared camera transmitting infrared light；It obtains the infrared camera and receives institute
State the second time of infrared light；It is determined between the electronic equipment and face according to the first time, second time
First distance；When the first distance is less than default first distance threshold value, pass through the infrared camera and the ultrasonic wave
Sensor carries out face acquisition, obtains the facial image.
In a kind of optional embodiment, processor 302 is specifically used for: described to obtain what the infrared mould group acquired
Facial image includes: the third time for obtaining the ultrasonic sensor transmitting ultrasonic wave；It obtains the ultrasonic sensor and receives institute
State the 4th time of ultrasonic wave；It is determined between the electronic equipment and face according to the third time, the 4th time
Second distance；When the second distance is less than default second distance threshold value, pass through the infrared camera and the ultrasonic wave
Sensor carries out face acquisition, obtains the facial image.
In a kind of optional embodiment, processor 302 is specifically used for: the facial image includes following three people
Face image: infrared face image, ultrasonic wave facial image and by the infrared face image and the ultrasonic wave facial image into
The synthesis facial image obtained after row image co-registration；It is described the facial image match with default face template include:
Image quality evaluation is carried out to three facial images, obtains three image quality evaluation values；From three picture quality
Maximum value is chosen in evaluation of estimate, using the corresponding facial image of the maximum value as facial image to be matched；Obtain with it is described to
With the corresponding default face template of facial image；By the facial image to be matched and the default face template progress
Match.
In a kind of optional embodiment, processor 302 is specifically used for: the gravity for receiving gravity sensor acquisition adds
Speed, judges whether the acceleration of gravity is greater than preset acceleration of gravity threshold value, as described in being greater than the acceleration of gravity
Acceleration of gravity threshold value starts the infrared mould group；The energy change value that the infrared mould group returns is received, in the energy quantitative change
The step of change value is greater than preset energy variation threshold value, executes the facial image for obtaining the infrared mould group acquisition.
In a kind of optional embodiment, processor 302 is specifically used for: such as the facial image and default face mould
It fails to match for plate, starts fingerprint recognition mould group；Obtain fingerprint image；By the fingerprint image and the progress of preset fingerprint template
Match, in the fingerprint image and preset fingerprint template matching success, executes the step of execution unlock operates.
Fig. 4 is the functional unit composition block diagram of tripper 400 involved in the embodiment of the present application.The tripper
400, it is applied to electronic equipment, the electronic equipment includes: infrared mould group, and described device 400 includes: acquiring unit 401, judgement
Unit 402 and execution unit 403, wherein
Acquiring unit 401, for obtaining the facial image of the infrared mould group acquisition；
Judging unit 402, for matching the facial image with default face template；
Execution unit 403, for such as the facial image and default face template successful match, execution unlock operation.
In a kind of possible embodiment of the application, the tripper 400 further include: fingerprint identification unit, for such as institute
Stating facial image, it fails to match with default face template, starts fingerprint recognition mould group；Obtain fingerprint image；By the fingerprint image
It is matched with preset fingerprint template, in the fingerprint image and preset fingerprint template matching success, is held described in execution
The step of row unlock operation.
The embodiment of the present application also provides a kind of computer storage medium, wherein computer storage medium storage is for electricity
The computer program of subdata exchange, the computer program make computer execute any as recorded in above method embodiment
Some or all of method step, above-mentioned computer include electronic equipment.
The embodiment of the present application also provides a kind of computer program product, and above-mentioned computer program product includes storing calculating
The non-transient computer readable storage medium of machine program, above-mentioned computer program are operable to that computer is made to execute such as above-mentioned side
Some or all of either record method step in method embodiment.The computer program product can be a software installation
Packet, above-mentioned computer includes electronic equipment.
It should be noted that for the various method embodiments described above, for simple description, therefore, it is stated as a series of
Combination of actions, but those skilled in the art should understand that, the application is not limited by the described action sequence because
According to the application, some steps may be performed in other sequences or simultaneously.Secondly, those skilled in the art should also know
It knows, the embodiments described in the specification are all preferred embodiments, related actions and modules not necessarily the application
It is necessary.
In the above-described embodiments, it all emphasizes particularly on different fields to the description of each embodiment, there is no the portion being described in detail in some embodiment
Point, reference can be made to the related descriptions of other embodiments.
In several embodiments provided herein, it should be understood that disclosed device, it can be by another way
It realizes.For example, the apparatus embodiments described above are merely exemplary, such as the division of said units, it is only a kind of
Logical function partition, there may be another division manner in actual implementation, such as multiple units or components can combine or can
To be integrated into another system, or some features can be ignored or not executed.Another point, shown or discussed is mutual
Coupling, direct-coupling or communication connection can be through some interfaces, the indirect coupling or communication connection of device or unit,
It can be electrical or other forms.
Above-mentioned unit as illustrated by the separation member may or may not be physically separated, aobvious as unit
The component shown may or may not be physical unit, it can and it is in one place, or may be distributed over multiple
In network unit.It can select some or all of unit therein according to the actual needs to realize the mesh of this embodiment scheme
's.
It, can also be in addition, each functional unit in each embodiment of the application can integrate in one processing unit
It is that each unit physically exists alone, can also be integrated in one unit with two or more units.Above-mentioned integrated list
Member both can take the form of hardware realization, can also realize in the form of software functional units.
If above-mentioned integrated unit is realized in the form of SFU software functional unit and sells or use as independent product
When, it can store in a computer-readable access to memory.Based on this understanding, the technical solution of the application substantially or
Person says that all or part of the part that contributes to existing technology or the technical solution can body in the form of software products
Reveal and, which is stored in a memory, including some instructions are used so that a computer equipment
(can be personal computer, server or network equipment etc.) executes all or part of each embodiment above method of the application
Step.And memory above-mentioned includes: USB flash disk, read-only memory (ROM, Read-Only Memory), random access memory
The various media that can store program code such as (RAM, Random Access Memory), mobile hard disk, magnetic or disk.
Those of ordinary skill in the art will appreciate that all or part of the steps in the various methods of above-described embodiment is can
It is completed with instructing relevant hardware by program, which can store in a computer-readable memory, memory
May include: flash disk, read-only memory (English: Read-Only Memory, referred to as: ROM), random access device (English:
Random Access Memory, referred to as: RAM), disk or CD etc..
The embodiment of the present application is described in detail above, specific case used herein to the principle of the application and
Embodiment is expounded, the description of the example is only used to help understand the method for the present application and its core ideas；
At the same time, for those skilled in the art can in specific embodiments and applications according to the thought of the application
There is change place, in conclusion the contents of this specification should not be construed as limiting the present application.
Claims (10)
1. a kind of unlocking method, which is characterized in that the method is applied to electronic equipment, and the electronic equipment includes: infrared mould
Group, which comprises
Obtain the facial image of the infrared mould group acquisition；
The facial image is matched with default face template；
Such as the facial image and default face template successful match, unlock operation is executed.
2. the method according to claim 1, wherein the infrared mould group includes infrared camera, the electronics
Equipment further include: ultrasonic mould group, the ultrasound mould group includes: ultrasonic sensor；
The facial image for obtaining the infrared mould group acquisition includes:
Obtain the first time of the infrared camera transmitting infrared light；
Obtain the second time that the infrared camera receives the infrared light；
The first distance between the electronic equipment and face is determined according to the first time, second time；
When the first distance is less than default first distance threshold value, pass through the infrared camera and the ultrasonic sensor
Face acquisition is carried out, the facial image is obtained.
3. the method according to claim 1, wherein the infrared mould group includes infrared camera, the electronics
Equipment further include: ultrasonic mould group, the ultrasound mould group includes: ultrasonic sensor；
The facial image for obtaining the infrared mould group acquisition includes:
Obtain the third time of the ultrasonic sensor transmitting ultrasonic wave；
Obtain the 4th time that the ultrasonic sensor receives the ultrasonic wave；
The second distance between the electronic equipment and face is determined according to the third time, the 4th time；
When the second distance is less than default second distance threshold value, pass through the infrared camera and the ultrasonic sensor
Face acquisition is carried out, the facial image is obtained.
4. method according to claim 1-3, which is characterized in that the facial image includes following three face
Image: it infrared face image, ultrasonic wave facial image and is carried out by the infrared face image and the ultrasonic wave facial image
The synthesis facial image obtained after image co-registration；
It is described the facial image match with default face template include:
Image quality evaluation is carried out to three facial images, obtains three image quality evaluation values；
Maximum value is chosen from three image quality evaluation values, using the corresponding facial image of the maximum value as people to be matched
Face image；
Obtain the default face template corresponding with the facial image to be matched；
The facial image to be matched is matched with the default face template.
5. method according to claim 1-4, which is characterized in that described to obtain the red of the infrared mould group acquisition
Before outer facial image further include:
The acceleration of gravity for receiving gravity sensor acquisition, judges whether the acceleration of gravity is greater than preset acceleration of gravity
Threshold value, such as acceleration of gravity are greater than the acceleration of gravity threshold value, start the infrared mould group；
The energy change value that the infrared mould group returns is received, is greater than preset energy variation threshold value in the energy change value,
The step of executing the facial image for obtaining the infrared mould group acquisition.
6. method according to claim 1-5, which is characterized in that the method also includes:
If it fails to match with default face template for the facial image, start fingerprint recognition mould group；
Obtain fingerprint image；
The fingerprint image is matched with preset fingerprint template, in the fingerprint image and the preset fingerprint template matching
When success, the step of execution unlock operates is executed.
7. a kind of tripper, which is characterized in that described device is applied to electronic equipment, and the electronic equipment includes: infrared mould
Group, described device include:
Acquiring unit, for obtaining the facial image of the infrared mould group acquisition；
Judging unit, for matching the facial image with default face template；
Execution unit, for such as the facial image and default face template successful match, execution unlock operation.
8. device according to claim 7, which is characterized in that described device further include:
Fingerprint identification unit, for such as the facial image, it fails to match with default face template, starts fingerprint recognition mould group；It obtains
Fetching print image；The fingerprint image is matched with preset fingerprint template, in the fingerprint image and the preset fingerprint
When template matching success, the step of execution unlock operates is executed.
9. a kind of electronic equipment, which is characterized in that including processor, memory, the memory is for storing one or more
Program, and be configured to be executed by the processor, described program includes as claimed in any one of claims 1 to 6 for executing
The instruction of step in method.
10. a kind of computer readable storage medium, which is characterized in that storage is used for the computer program of electronic data interchange,
In, the computer program makes computer execute as the method according to claim 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910528810.7A CN110287668A (en) | 2019-06-18 | 2019-06-18 | Unlocking method and Related product |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910528810.7A CN110287668A (en) | 2019-06-18 | 2019-06-18 | Unlocking method and Related product |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110287668A true CN110287668A (en) | 2019-09-27 |
Family
ID=68004790
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910528810.7A Pending CN110287668A (en) | 2019-06-18 | 2019-06-18 | Unlocking method and Related product |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110287668A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101901336A (en) * | 2010-06-11 | 2010-12-01 | 哈尔滨工程大学 | Fingerprint and finger vein bimodal recognition decision level fusion method |
| CN108347516A (en) * | 2018-01-16 | 2018-07-31 | 宁波金晟芯影像技术有限公司 | A kind of face identification system and method for 3D identifications |
| CN108875331A (en) * | 2017-08-01 | 2018-11-23 | 北京旷视科技有限公司 | Face unlocking method, device and system and storage medium |
| CN109857238A (en) * | 2019-02-25 | 2019-06-07 | 深圳传音通讯有限公司 | Terminal unlock method and terminal |
| US20190182408A1 (en) * | 2017-12-13 | 2019-06-13 | Canon Kabushiki Kaisha | Image processing apparatus, method therefor, and storage medium |
-
2019
- 2019-06-18 CN CN201910528810.7A patent/CN110287668A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101901336A (en) * | 2010-06-11 | 2010-12-01 | 哈尔滨工程大学 | Fingerprint and finger vein bimodal recognition decision level fusion method |
| CN108875331A (en) * | 2017-08-01 | 2018-11-23 | 北京旷视科技有限公司 | Face unlocking method, device and system and storage medium |
| US20190182408A1 (en) * | 2017-12-13 | 2019-06-13 | Canon Kabushiki Kaisha | Image processing apparatus, method therefor, and storage medium |
| CN108347516A (en) * | 2018-01-16 | 2018-07-31 | 宁波金晟芯影像技术有限公司 | A kind of face identification system and method for 3D identifications |
| CN109857238A (en) * | 2019-02-25 | 2019-06-07 | 深圳传音通讯有限公司 | Terminal unlock method and terminal |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN109583320A (en) | Fingerprint identification method and relevant apparatus | |
| CN109583356A (en) | Fingerprint identification method and Related product | |
| CN110298316A (en) | Fingerprint identification method and Related product | |
| CN109376700A (en) | Fingerprint identification method and Related product | |
| CN110287680A (en) | Unlocked by fingerprint method and Related product | |
| CN109543570A (en) | Fingerprint identification method and Related product | |
| CN109657561A (en) | Fingerprint collecting method and Related product | |
| CN109376702A (en) | Fingerprint identification method and Related product | |
| CN110099219A (en) | Panorama shooting method and Related product | |
| CN108848317A (en) | Camera control method and Related product | |
| CN110427741A (en) | Fingerprint identification method and Related product | |
| CN109144454A (en) | double-sided screen display control method and related product | |
| CN110210395A (en) | Vein image acquisition method and Related product | |
| CN110162953A (en) | Biometric discrimination method and Related product | |
| CN110475020A (en) | Apparatus control method and Related product | |
| CN110188666A (en) | Vein collection method and Related product | |
| CN110363535A (en) | Pay abnormity prompt method and Related product | |
| CN110245607A (en) | Eyeball tracking method and Related product | |
| CN110221696A (en) | Eyeball tracking method and Related product | |
| CN110309776A (en) | Fingerprint template input method and Related product | |
| CN110210394A (en) | Vein image acquisition method and Related product | |
| CN109376701A (en) | Fingerprint identification method and Related product | |
| CN110266942A (en) | The synthetic method and Related product of picture | |
| CN110264184A (en) | Pay control method and Related product | |
| CN109376703A (en) | Fingerprint identification method and Related product |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20190927 |
|
| RJ01 | Rejection of invention patent application after publication |