CN108182379A - The antitheft tracing method of home appliance, device and system - Google Patents

The antitheft tracing method of home appliance, device and system Download PDF

Info

Publication number
CN108182379A
CN108182379A CN201711220970.2A CN201711220970A CN108182379A CN 108182379 A CN108182379 A CN 108182379A CN 201711220970 A CN201711220970 A CN 201711220970A CN 108182379 A CN108182379 A CN 108182379A
Authority
CN
China
Prior art keywords
user
image
information
home appliance
face image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201711220970.2A
Other languages
Chinese (zh)
Other versions
CN108182379B (en
Inventor
谌进
宋德超
邓洪斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Gree Electric Appliances Inc of Zhuhai
Original Assignee
Gree Electric Appliances Inc of Zhuhai
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Gree Electric Appliances Inc of Zhuhai filed Critical Gree Electric Appliances Inc of Zhuhai
Priority to CN201711220970.2A priority Critical patent/CN108182379B/en
Publication of CN108182379A publication Critical patent/CN108182379A/en
Application granted granted Critical
Publication of CN108182379B publication Critical patent/CN108182379B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/30Scenes; Scene-specific elements in albums, collections or shared content, e.g. social network photos or video
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/50Network services
    • H04L67/52Network services specially adapted for the location of the user terminal
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W4/00Services specially adapted for wireless communication networks; Facilities therefor
    • H04W4/02Services making use of location information
    • H04W4/025Services making use of location information using location based information parameters

Abstract

The invention discloses a kind of antitheft tracing method of home appliance, device and system.Wherein, this method includes:In the case where receiving the first preset instructions that the first user is sent by client device, the face image of the second user of currently used home appliance is obtained, wherein, the first preset instructions are used to start the recognition of face pattern of home appliance;The matched image information of face image with second user is searched in pre-set image information library;In the case of being found in pre-set image information library with the matched image information of the face image of second user, the location information of the user information of second user and/or home appliance is back to client device, wherein, the user information of second user includes at least:The facial image information of second user.The present invention solves the technical issues of information of the position that air-conditioning can not be known after existing home appliance is stolen and illegal user.

Description

The antitheft tracing method of home appliance, device and system
Technical field
The present invention relates to field of household appliances, in particular to a kind of antitheft tracing method of home appliance, device and are System.
Background technology
With the development of various intelligent appliance technologies, more and more people buy various expensive intelligent appliances and set Standby, this is but also intelligent appliance slips into the target stolen behind interior as some illegal molecules.For air-conditioning, due to The important devices of air-conditioning are mainly installed on outdoor unit, and outdoor unit is installed on outdoor environment, the maximum probability of the loss of air-conditioning. Thus, how in the case where home appliance is lost, the position of home appliance is quickly navigated to, and obtain the letter of illegal user Breath, quickly to retrieve the home appliance of loss, the loss of user is preferably minimized, being that following intelligent appliance is urgently to be resolved hurrily asks Topic.
The position of air-conditioning and the information of illegal user can not be known after being stolen for above-mentioned existing home appliance Problem, currently no effective solution has been proposed.
Invention content
An embodiment of the present invention provides a kind of antitheft tracing method of home appliance, device and system, existing at least to solve Some home appliances can not know after being stolen air-conditioning position and illegal user information the technical issues of.
One side according to embodiments of the present invention provides a kind of antitheft tracing method of home appliance, including:It is connecing In the case of receiving the first preset instructions that the first user is sent by client device, the of currently used home appliance is obtained The face image of two users, wherein, the first preset instructions are used to start the recognition of face pattern of home appliance;Believe in pre-set image Cease the matched image information of face image searched in library with second user;It finds in pre-set image information library and is used with second In the case of the matched image information of face image at family, the position of the user information of second user and/or home appliance is believed Breath is back to client device, wherein, the user information of second user includes at least:The facial image information of second user.
Another aspect according to embodiments of the present invention additionally provides a kind of anti-theft tracking system of home appliance, including:Family Electric equipment, for acquiring the face image of the user of currently used home appliance;Client device, for sending the first default finger It enables, wherein, the first preset instructions are used to start the recognition of face pattern of home appliance;Server, respectively with client device and Home appliance communicates, and in the case where receiving the first preset instructions, obtaining the face image of user, believes in pre-set image Cease searched in library with the matched image information of face image, and find in pre-set image information library matched with face image In the case of image information, the location information of the user information of user and/or home appliance is back to client device, user User information include at least:The facial image information of user.
Another aspect according to embodiments of the present invention additionally provides a kind of anti-theft tracking device of home appliance, including:The One acquiring unit, in the case where receiving the first preset instructions that the first user is sent by client device, obtaining The face image of the second user of currently used home appliance, wherein, the first preset instructions are used to start the face of home appliance Recognition mode;Searching unit is believed for being searched in pre-set image information library with the matched image of the face image of second user Breath;First execution unit, for finding image letter matched with the face image of second user in pre-set image information library In the case of breath, the location information of the user information of second user and/or home appliance is back to client device, wherein, The user information of second user includes at least:The facial image information of second user.
Another aspect according to embodiments of the present invention, additionally provides a kind of storage medium, and storage medium includes the journey of storage Sequence, wherein, program performs the antitheft tracing method of above-mentioned home appliance.
Another aspect according to embodiments of the present invention additionally provides a kind of processor, and processor is used to run program, In, program performs the antitheft tracing method of above-mentioned home appliance when running.
In embodiments of the present invention, in the feelings of the first preset instructions for receiving the first user and being sent by client device Under condition, the face image of the second user of currently used home appliance is obtained, wherein, the first preset instructions set for starting household electrical appliances Standby recognition of face pattern;The matched image information of face image with second user is searched in pre-set image information library; In the case of being found in pre-set image information library with the matched image information of the face image of second user, by second user The location information of user information and/or home appliance is back to client device, wherein, the user information of second user is at least wrapped It includes:The facial image information of second user has reached the user's based on the currently used home appliance of face recognition technology identification The purpose of identity, it is achieved thereby that in the case where home appliance is stolen, the location information of fast track home appliance and acquisition Eavesdropper identity information and then the technique effect quickly solved a case, and then solve after existing home appliance is stolen and can not know sky The technical issues of information of the position of tune and illegal user.
Description of the drawings
Attached drawing described herein is used to provide further understanding of the present invention, and forms the part of the application, this hair Bright illustrative embodiments and their description do not constitute improper limitations of the present invention for explaining the present invention.In the accompanying drawings:
Fig. 1 is a kind of flow chart of the antitheft tracing method of home appliance according to prior art;
Fig. 2 is a kind of flow chart of the antitheft tracing method of optional home appliance according to prior art;
Fig. 3 is a kind of flow chart of the antitheft tracing method of optional home appliance according to prior art;
Fig. 4 is a kind of preferred air-conditioning anti-theft tracking system schematic according to embodiments of the present invention;
Fig. 5 is a kind of startup air-conditioning anti-theft tracking work(optionally based on face recognition technology according to embodiments of the present invention The flow chart of energy;
Fig. 6 is a kind of anti-theft tracking function air-conditioning control optionally based on face recognition technology according to embodiments of the present invention Flow chart processed;
Fig. 7 is a kind of anti-theft tracking system schematic of home appliance according to embodiments of the present invention;And
Fig. 8 is a kind of anti-theft tracking schematic device of home appliance according to embodiments of the present invention.
Specific embodiment
In order to which those skilled in the art is made to more fully understand the present invention program, below in conjunction in the embodiment of the present invention The technical solution in the embodiment of the present invention is clearly and completely described in attached drawing, it is clear that described embodiment is only The embodiment of a part of the invention, instead of all the embodiments.Based on the embodiments of the present invention, ordinary skill people Member's all other embodiments obtained without making creative work should all belong to the model that the present invention protects It encloses.
It should be noted that term " first " in description and claims of this specification and above-mentioned attached drawing, " Two " etc. be the object for distinguishing similar, and specific sequence or precedence are described without being used for.It should be appreciated that it uses in this way Data can be interchanged in the appropriate case, so as to the embodiment of the present invention described herein can in addition to illustrating herein or Sequence other than those of description is implemented.In addition, term " comprising " and " having " and their any deformation, it is intended that cover Cover it is non-exclusive include, be not necessarily limited to for example, containing the process of series of steps or unit, method, system, product or equipment Those steps or unit clearly listed, but may include not listing clearly or for these processes, method, product Or the intrinsic other steps of equipment or unit.
According to embodiments of the present invention, a kind of antitheft tracing method embodiment of home appliance is provided, it should be noted that Step shown in the flowchart of the accompanying drawings can perform in the computer system of such as a group of computer-executable instructions, and And although showing logical order in flow charts, in some cases, can institute be performed with the sequence being different from herein The step of showing or describing.
Fig. 1 is a kind of antitheft tracing method flow chart of home appliance according to embodiments of the present invention, as shown in Figure 1, should Method includes the following steps:
Step S102 in the case where receiving the first preset instructions that the first user is sent by client device, is obtained The face image of the second user of currently used home appliance is taken, wherein, the first preset instructions are used to start the people of home appliance Face recognition mode.
As a kind of optional embodiment, above-mentioned client device includes but not limited to mobile phone, tablet computer, notebook electricity The equipment such as brain, computer;First user can manipulate the home appliance of own home by the client device, and home appliance includes But it is not limited to air-conditioning, TV, refrigerator, washing machine, humidifier, air purifier, micro-wave oven, smoke exhaust ventilator etc.;Optionally, these Home appliance has recognition of face pattern, user can be supported to be logged in by recognition of face, and in the case of login, ability Enough perform normal function.
It should be noted that since modern household electrical appliances are more and more intelligent so that home appliance closes as burglary molecule The target of note particularly with the outdoor unit of air-conditioning, is very easy to be stolen.By setting recognition of face work(on home appliance Can, it can quickly determine to need the identity of the personnel using home appliance based on face recognition technology so that only by face Identify that the home appliance just can be used normally in the user logined successfully, so as to which illegal user is prevented to be set using household electrical appliances It is standby.
Optionally, for each embodiment of the application using above-mentioned client device as " mobile phone ", above-mentioned home appliance is " air-conditioning " For illustrate.
Step S104 searches the matched image information of face image with second user in pre-set image information library.
As a kind of optional embodiment, the face that can be uploaded in above-mentioned pre-set image information library by least one user It Image Database that image is established or is carried according to interactive information such as the image of at least one user of collection or videos The face image of the user got and the Image Database established.Above-mentioned second user can be the use of currently used home appliance Family, the user may be validated user (for example, the first user licenses the user of its home appliance), it is also possible to illegal to use Family.
Step S106 is found and the matched image information of the face image of second user in pre-set image information library In the case of, the location information of the user information of second user and/or home appliance is back to client device, wherein, second The user information of user includes at least:The facial image information of second user.
As a kind of optional embodiment, the user information of above-mentioned second user includes but not limited to the face of second user Image information, if finding the feelings with the matched image information of the face image of the second user in pre-set image information library Under condition, the identity information of the second user can be determined according to the image information found, thus, it is back to client device Information can also include the identity information of second user.
Optionally, the above method can also include:Step S108 does not find in pre-set image information library and is used with second In the case of the matched image information of face image at family, the face image of second user is recorded, and by the face of second user The location information of image and/or home appliance is back to client device.
From the foregoing, it will be observed that in the above embodiments of the present application, pass through in the owner (i.e. the first user) for receiving home appliance Client device send for start home appliance the first preset instructions of recognition of face pattern in the case of, pass through household electrical appliances Equipment acquires the face image of the second user of the currently used home appliance, and searches whether to deposit in pre-set image information library With the matched image information of face image of the second user of acquisition, when being found in pre-set image information library and second user The matched image information of face image in the case of, the user information of second user (is included but not limited into second user Facial image information) and/or the location information of home appliance be back to client device.
Easily it is noted that starting the people of home appliance by being used for of sending of client device receiving the first user In the case of first preset instructions of face pattern, no matter whether home appliance is currently in operating status, can acquire current Using the face image of the second user of the home appliance, optionally, which can acquire in the range of pre-determined distance The image information of at least one user, so as to according to the face image that second user is extracted in the image collected information.
By scheme disclosed in above-described embodiment, reach and currently used home appliance is identified based on face recognition technology The purpose of the identity of user, it is achieved thereby that in the case where home appliance is stolen, the location information of fast track home appliance And eavesdropper identity information and then the technique effect quickly solved a case are obtained, and then solve can not after existing home appliance is stolen Know air-conditioning position and illegal user information the technical issues of.
It should be noted that the owner (i.e. above-mentioned first user) of home appliance can also by way of recognition of face into The verification of row identity, and then realize and log in.In a kind of optional embodiment, sent out receiving the first user by client device In the case of the first preset instructions sent, before the face image for the second user for obtaining currently used home appliance, such as Fig. 2 institutes Show, the above method can also include the following steps:
Step S202 receives the face image for the first user that client device uploads;
Step S204 verifies the identity information of the face image of the first user;
Step S206 in the case where the face image of the first user is proved to be successful, receives the first user and passes through client The first preset instructions that equipment is sent.
Optionally, in the case of the face image authentication failed of the first user, the first prompt message is exported, wherein, the One prompt message verifies the face image of the first user for the first user of prompting again.
It by above-described embodiment, can realize based on face recognition technology, the identity of the owner of home appliance is tested Card.
Based on above-described embodiment, as an alternative embodiment, in the identity for the face image for verifying the first user After information, the above method can also include the following steps:Step S208, in the feelings that the face image of the first user is proved to be successful Under condition, the second preset instructions that the first user is sent by client device are received, wherein, the second preset instructions are used for household electrical appliances The function locking of equipment.
By above-described embodiment, realize after air-conditioning is stolen, long-range deadlock air-conditioning simultaneously disables its control function.In addition, only Have by recognition of face to household electrical appliances only in the case where being proved to be successful, background server just receives the first user and passes through client The first preset instructions for being used to open home appliance recognition of face pattern that equipment is sent.
In a kind of optional embodiment, above-mentioned steps S102 is sent receiving the first user by client device The first preset instructions in the case of, obtain the face image of the second user of currently used home appliance, can include as follows Step:
Step S1021 starts the recognition of face pattern of home appliance, wherein, home appliance is starting recognition of face pattern In the case of, acquire the face image of second user;
Step S1023 receives the face image for the second user that home appliance uploads.
In a kind of optional embodiment, above-mentioned steps S104 is searched and second user in pre-set image information library The matched image information of face image, may include steps of:
Step S1041 searches the matched image of face image with second user in the Image Database of the first user Information, wherein, the Image Database of the first user includes the facial image information at least one user of the first user-association;
Step S1043 is not found matched with the face image of second user in the Image Database of the first user In the case of image information, search in the Image Database of all users and believe with the matched image of the face image of second user Breath.
Optionally, image letter matched with the face image of second user is found in the Image Database of the first user In the case of breath, the location information of the user information of second user and/or home appliance is back to client device.
In a kind of optional embodiment, above-mentioned steps S1043, do not found in the Image Database of the first user with In the case of the matched image information of face image of second user, search in the Image Database of all users and used with second The matched image information of face image at family, including:
Step S1043a is not found matched with the face image of second user in the Image Database of the first user In the case of image information, the matched figure of face image with second user is searched in the Image Database of the first user again As information;
Step S1043b records the number searched again;
Step S1043c, judges whether the number searched again is more than predetermined threshold value;
Step S1043d in the case where the number searched again is more than predetermined threshold value, exports the second prompt message, In, the second prompt message sends third preset instructions for the first user of prompting, wherein, third preset instructions are used for useful in institute The matched image information of face image with second user is searched in the Image Database at family.
In a kind of optional embodiment, the face with second user is not found in the Image Database of the first user In the case of the image information of images match, the face image with second user is searched in the Image Database of all users After the image information matched, the above method can also include:If it is found in the Image Database of all users and second The matched image information of face image of user, then return the location information of the user information of second user and/or home appliance It is back to client device.
Based on any one above-mentioned optional embodiment, as a kind of optional embodiment, as shown in figure 3, the above method It can also include the following steps:
Step S302 detects whether that receive the first user sends the 4th preset instructions by client device, wherein, the Four preset instructions allow the third user using home appliance for the first user setting;
Step S304 in the case where detecting the 4th preset instructions, obtains the image information of third user;
Step S306 based on the image information of third user, controls home appliance.
By above-described embodiment, the control of home appliance can be shared with other users (i.e. by the owner of home appliance Above-mentioned third user), so as to home appliance owner not in case, the user for obtaining control can be by the face of oneself Portion's image logs in and uses the home appliance.
Preferably, above-mentioned first user can also will set third user to use the information such as time, the permission of home appliance, Further improve user experience.
It should be noted that the image of above-mentioned third user can be third user upload face image or According to the face image of third user extracted in the information such as chat video, the image between third user and the first user. Thus, as an alternative embodiment, above-mentioned steps S304, in the case where detecting the 4th preset instructions, obtain the The image information of three users, may include steps of:
Step S3041 obtains the interactive information of the first user and third user, wherein, interactive information is included as follows at least One of:Image information, video information, voice messaging;
Step S3043, extracts image information from interactive information.
By above-described embodiment, realize extracted in the interactive information between user and user user's face image and then Create the purpose of Image Database.
By taking air-conditioning as an example, Fig. 4 is a kind of preferred air-conditioning anti-theft tracking system schematic according to embodiments of the present invention, such as Shown in Fig. 4, which includes:Cloud Server, image recognition server, mobile phone and air-conditioning, wherein, air-conditioning can pass through no circuit It is communicated respectively with mobile phone, Cloud Server and image recognition server by device.The air-conditioning has the function of intelligent anti-theft tracking.When with After air-conditioning in the man of family is stolen, user only needs to open anti-theft tracking function in cell phone application, sweeps and sweeps the user's face of oneself, The specific location information of this air-conditioning currently in use can be inquired, it can be seen that be the use of this currently used air-conditioning The information at family, while there is a key deadlock and report a case to the security authorities.
Based on above-described embodiment, as an alternative embodiment, Fig. 5 is that one kind according to embodiments of the present invention is optional Based on face recognition technology startup air-conditioning anti-theft tracking function flow chart, as shown in figure 5, including the following steps:
(1) user has found that the air-conditioning equipment in family is stolen, and opens cell phone application, and opening anti-theft tracking function;
(2) " face identification functions " at selection anti-theft tracking interface, the user's face information scanned at this time, after air-conditioning The server of platform is matched, if matching is unsuccessful, reminds user that it fails to match, and user is asked to retry as requested;
(3) after successful match, user's successful match is prompted, user is prompted to select " key lock " button;Simultaneously after company Platform server opens user's air conditioner user face search pattern;
(4) after user's face information that server search to background server preserves, Auto-matching will be carried out;
(5) if successful match, air-conditioning position just is returned to user mobile phone, and return and the air-conditioning is being currently used User image information, notify whether user reports a case to the security authorities later;
(6) it if it fails to match, can again match again automatically twice.If continuous several times (for example, three times) search failure, And then user can be prompted, if need to open " global search " function;
(7) when user selects to click " global search " button, corporate server can scan for and analyze the matching clothes day after tomorrow All users' chat videos stored, image information, are matched later with the image of user in business device, after successful match, Operation according to step (5) continues;
Optionally, Fig. 6 is a kind of anti-theft tracking work(optionally based on face recognition technology according to embodiments of the present invention Energy airconditioning control flow chart, as shown in fig. 6, " people of the owner (i.e. above-mentioned first user) of home appliance on cell phone application is opened After face identification " pattern, " facial information " (the i.e. above-mentioned face image) of simultaneously upload user can be acquired, judges the face letter of user Whether breath collects success, if not collecting success, exports carrying for prompting user " typing failing, and please re-types as requested " Show information;If collect the prompt message for successfully, exporting prompting user " face information acquires successfully ".If user makes oneself With can then be logged in by way of recognition of face, and control air-conditioning;If user wants control being shared with other users (for example, good friend) uses, then can be to good friend's Video chat, and background server is by catching the personnel in Video chat It obtains, and carries out identities match, in the case of successful match, home appliance (for example, air-conditioning) control is shared with the good friend, So that good friend can control home appliance.
By scheme disclosed in the above embodiments of the present application, stolen air-conditioning can quickly be positioned based on face recognition technology Location information has the function of a key deadlock and reports a case to the security authorities, and returning for stolen air-conditioning user's image information can will be used It is back in user mobile phone app, while it is true that law enforcement agency is coordinated to carry out the identity information of offender.
Be easily noted that, due to traditional home appliance equipment access right this part of equipment is not done it is deep thin Change research, with the hair of the fast development of internet, Internet of Things and artificial intelligence technology, especially remote control home power technology Exhibition has had been increased to a higher level to the permission control of home appliance.The each embodiment of the application is known by face Other technology can quickly determine to need the identity of the personnel using home appliance, while user opens intelligent anti-theft tracking function Afterwards, air-conditioning equipment immediately can orient location information, have a key deadlock and warning function, user is allowed no longer to worry air-conditioning equipment It is stolen.
According to embodiments of the present invention, a kind of system for the antitheft tracing method for being used to implement above-mentioned home appliance is additionally provided Embodiment, Fig. 7 is a kind of anti-theft tracking system schematic of home appliance according to embodiments of the present invention, as shown in fig. 7, this is System includes:Home appliance 701, client device 703 and server 705.
Wherein, home appliance 701, for acquiring the face image of the user of currently used home appliance;
Client device 703, for sending the first preset instructions, wherein, the first preset instructions are used to start home appliance Recognition of face pattern;
Server 705, communicates respectively with client device and home appliance, in the feelings for receiving the first preset instructions Under condition, the face image of user is obtained, lookup and the matched image information of face image in pre-set image information library, and pre- If in the case of being found in Image Database with the matched image information of face image, by the user information of user and/or family The location information of electric equipment is back to client device, and the user information of user includes at least:The facial image information of user.
From the foregoing, it will be observed that in the above embodiments of the present application, server 705 is receiving the owner of home appliance 701 (i.e. One user) by client device 703 send for starting first preset instructions of the recognition of face pattern of home appliance In the case of, the face image of the second user of the currently used home appliance 701 is acquired by home appliance 701, and presetting It searches whether to deposit the matched image information of face image with the second user of acquisition in Image Database, believes when in pre-set image In the case of being found in breath library with the matched image information of the face image of second user, by the user information of second user (facial image information for including but not limited to second user) and/or the location information of home appliance are back to client device 703。
Easily it is noted that starting the people of home appliance by being used for of sending of client device receiving the first user In the case of first preset instructions of face pattern, no matter whether home appliance is currently in operating status, can acquire current Using the face image of the second user of the home appliance, optionally, which can acquire in the range of pre-determined distance The image information of at least one user, so as to according to the face image that second user is extracted in the image collected information.
By scheme disclosed in above-described embodiment, reach and currently used home appliance is identified based on face recognition technology The purpose of the identity of user, it is achieved thereby that in the case where home appliance is stolen, the location information of fast track home appliance And eavesdropper identity information and then the technique effect quickly solved a case are obtained, and then solve can not after existing home appliance is stolen Know air-conditioning position and illegal user information the technical issues of.
Optionally, server 705 can be used for starting the recognition of face pattern of home appliance, wherein, home appliance is opening In the case of moving face recognition mode, the face image of second user is acquired;Receive the face for the second user that home appliance uploads Portion's image.
Optionally, above-mentioned server 705 is additionally operable to not find the face with second user in pre-set image information library In the case of the image information of images match, record the face image of second user, and by the face image of second user and/or The location information of home appliance is back to client device.
In a kind of optional embodiment, above-mentioned server 705 is additionally operable to receive the first user that client device uploads Face image;Verify the identity information of the face image of the first user;In the feelings that the face image of the first user is proved to be successful Under condition, the first preset instructions that the first user is sent by client device are received.
Optionally, above-mentioned server 705 is additionally operable in the case of the face image authentication failed of the first user, output the One prompt message, wherein, the first prompt message verifies the face image of the first user for the first user of prompting again.
Optionally, above-mentioned server 705 is additionally operable in the case where the face image of the first user is proved to be successful, and receives the The second preset instructions that one user is sent by client device, wherein, the second preset instructions are used for the function of home appliance Locking.
In a kind of optional embodiment, above-mentioned server 705 is additionally operable to search in the Image Database of the first user With the matched image information of face image of second user, wherein, the Image Database of the first user includes and the first user is closed The facial image information of at least one user of connection;The face with second user is not found in the Image Database of the first user In the case of the image information of portion's images match, the face image with second user is searched in the Image Database of all users Matched image information.
Optionally, above-mentioned server 705 is additionally operable to find and second user in the Image Database of the first user In the case of the matched image information of face image, the location information of the user information of second user and/or home appliance is returned It is back to client device.
Optionally, above-mentioned server 705 is additionally operable to not find in the Image Database of the first user and second user The matched image information of face image in the case of, searched in the Image Database of the first user with second user again The matched image information of face image;Record the number searched again;Judge whether the number searched again is more than default threshold Value;In the case where the number searched again is more than predetermined threshold value, the second prompt message is exported, wherein, the second prompt message is used Third preset instructions are sent in the first user of prompting, wherein, third preset instructions are used in the Image Database of all users Search the matched image information of face image with second user.
Optionally, it is used if above-mentioned server 705 is additionally operable to find in the Image Database of all users with second The matched image information of face image at family then returns to the location information of the user information of second user and/or home appliance To client device.
Optionally, based on any one above-mentioned optional embodiment, as an alternative embodiment, above-mentioned server 705 are additionally operable to detect whether that receive the first user sends the 4th preset instructions by client device, wherein, the 4th default finger Enable the third user allowed for the first user setting using home appliance;In the case where detecting the 4th preset instructions, obtain Take the image information of third user;Based on the image information of third user, home appliance is controlled.
In a kind of optional embodiment, above-mentioned server 705 is additionally operable to obtain the interaction of the first user and third user Information, wherein, interactive information includes at least one following:Image information, video information, voice messaging;It is carried from interactive information Take image information.
According to embodiments of the present invention, a kind of device for the antitheft tracing method for being used to implement above-mentioned home appliance is additionally provided Embodiment, Fig. 8 is a kind of anti-theft tracking schematic device of home appliance according to embodiments of the present invention, as shown in figure 8, the dress Put including:First acquisition unit 801,803 and first execution unit 805 of searching unit.
Wherein, first acquisition unit 801, for receive the first user by client device and send it is first default In the case of instruction, the face image of the second user of currently used home appliance is obtained, wherein, the first preset instructions are used to open The recognition of face pattern of dynamic home appliance;
Searching unit 803, for searching the matched image of face image with second user in pre-set image information library Information;
First execution unit 805, matches for being found in pre-set image information library with the face image of second user Image information in the case of, the location information of the user information of second user and/or home appliance is back to client and is set It is standby, wherein, the user information of second user includes at least:The facial image information of second user.
Herein it should be noted that above-mentioned first acquisition unit 801,803 and first execution unit 805 of searching unit correspond to Step S102 to S106 in embodiment of the method, the example and application scenarios phase that above-mentioned module and corresponding step are realized Together, but it is not limited to above method embodiment disclosure of that.It should be noted that above-mentioned module can as a part for device To be performed in the computer system of such as a group of computer-executable instructions.
From the foregoing, it will be observed that in the above embodiments of the present application, by first acquisition unit 801 in the master for receiving home appliance People (i.e. the first user) presets finger by what client device was sent for starting the first of the recognition of face pattern of home appliance In the case of order, the face image of the second user of the currently used home appliance is acquired by home appliance, and by searching for Unit 803 searches whether to deposit the matched image information of face image with the second user of acquisition in pre-set image information library, It is found in pre-set image information library and the matched image information of the face image of second user by the first execution unit 805 In the case of, the user information (facial image information for including but not limited to second user) and/or household electrical appliances of second user are set Standby location information is back to client device.
Easily it is noted that starting the people of home appliance by being used for of sending of client device receiving the first user In the case of first preset instructions of face pattern, no matter whether home appliance is currently in operating status, can acquire current Using the face image of the second user of the home appliance, optionally, which can acquire in the range of pre-determined distance The image information of at least one user, so as to according to the face image that second user is extracted in the image collected information.
By scheme disclosed in above-described embodiment, reach and currently used home appliance is identified based on face recognition technology The purpose of the identity of user, it is achieved thereby that in the case where home appliance is stolen, the location information of fast track home appliance And eavesdropper identity information and then the technique effect quickly solved a case are obtained, and then solve can not after existing home appliance is stolen Know air-conditioning position and illegal user information the technical issues of.
In a kind of optional embodiment, above device further includes:Second execution unit, in pre-set image information library In do not find with the matched image information of the face image of second user in the case of, record the face image of second user, And the location information of the face image of second user and/or home appliance is back to client device.
In a kind of optional embodiment, above device further includes:First receiving unit, for receiving client device The face image of the first user passed;Authentication unit, for verifying the identity information of the face image of the first user;Second receives Unit in the case of being proved to be successful in the face image of the first user, receives the first user and is sent by client device The first preset instructions.
In a kind of optional embodiment, above device further includes:Output unit, in the face image of the first user In the case of authentication failed, the first prompt message is exported, wherein, the first prompt message is for prompting the first user to verify the again The face image of one user.
In a kind of optional embodiment, above device further includes:Third receiving unit, in the face of the first user In the case of image authentication is successful, the second preset instructions that the first user is sent by client device are received, wherein, second is pre- If instruction is for by the function locking of home appliance.
In a kind of optional embodiment, above-mentioned first acquisition unit includes:Starting module, for starting home appliance Recognition of face pattern, wherein, home appliance acquires the face image of second user in the case where starting recognition of face pattern; Receiving module, for receiving the face image of the second user of home appliance upload.
In a kind of optional embodiment, above-mentioned searching unit includes at least one following:First searching module, for The matched image information of face image with second user is searched in the Image Database of first user, wherein, the first user's Image Database includes the facial image information at least one user of the first user-association;Second searching module, for In the case of not found in the Image Database of first user with the matched image information of the face image of second user, in institute There is the matched image information of face image searched in the Image Database of user with second user.
In a kind of optional embodiment, above device further includes:Third execution unit, in the image of the first user In the case of being found in information bank with the matched image information of the face image of second user, by the user information of second user And/or the location information of home appliance is back to client device.
In a kind of optional embodiment, above-mentioned second searching module includes:Submodule is searched, for the first user's In the case of not found in Image Database with the matched image information of the face image of second user, again in the first user Image Database in search and the matched image information of face image of second user;Record sub module, for recording again The number of lookup;Judging submodule, for judging whether the number searched again is more than predetermined threshold value;Output sub-module is used In the case of predetermined threshold value is more than in the number searched again, the second prompt message is exported, wherein, the second prompt message is used for The first user is prompted to send third preset instructions, wherein, third preset instructions are used to look into the Image Database of all users It looks for and the matched image information of the face image of second user.
In a kind of optional embodiment, above device further includes:4th execution unit, if for all users' Found in Image Database with the matched image information of the face image of second user, then by the user information of second user And/or the location information of home appliance is back to client device.
In a kind of optional embodiment, above device further includes:Detection unit, for detecting whether receiving the first use Family sends the 4th preset instructions by client device, wherein, the 4th preset instructions allow to use house for the first user setting The third user of electric equipment;Second acquisition unit, in the case where detecting the 4th preset instructions, obtaining third user's Image information;Control unit for the image information based on third user, controls home appliance.
In a kind of optional embodiment, above-mentioned second acquisition unit includes:Acquisition module, for obtain the first user with The interactive information of third user, wherein, interactive information includes at least one following:Image information, video information, voice messaging; Extraction module, for extracting image information from interactive information.
According to embodiments of the present invention, a kind of storage medium is additionally provided, storage medium includes the program of storage, wherein, journey Sequence performs that any one in above method embodiment is optional or the antitheft tracing method of preferred home appliance.
According to embodiments of the present invention, a kind of processor is additionally provided, processor is used to run program, wherein, program operation Any one is optional in Shi Zhihang above method embodiments or the antitheft tracing method of preferred home appliance.
The embodiments of the present invention are for illustration only, do not represent the quality of embodiment.
In the above embodiment of the present invention, all emphasize particularly on different fields to the description of each embodiment, do not have in some embodiment The part of detailed description may refer to the associated description of other embodiment.
In several embodiments provided herein, it should be understood that disclosed technology contents can pass through others Mode is realized.Wherein, the apparatus embodiments described above are merely exemplary, such as the division of the unit, Ke Yiwei A kind of division of logic function, can there is an other dividing mode in actual implementation, for example, multiple units or component can combine or Person is desirably integrated into another system or some features can be ignored or does not perform.Another point, shown or discussed is mutual Between coupling, direct-coupling or communication connection can be INDIRECT COUPLING or communication link by some interfaces, unit or module It connects, can be electrical or other forms.
The unit illustrated as separating component may or may not be physically separate, be shown as unit The component shown may or may not be physical unit, you can be located at a place or can also be distributed to multiple On unit.Some or all of unit therein can be selected according to the actual needs to realize the purpose of this embodiment scheme.
In addition, each functional unit in each embodiment of the present invention can be integrated in a processing unit, it can also That each unit is individually physically present, can also two or more units integrate in a unit.Above-mentioned integrated list The form that hardware had both may be used in member is realized, can also be realized in the form of SFU software functional unit.
If the integrated unit is realized in the form of SFU software functional unit and is independent product sale or uses When, it can be stored in a computer read/write memory medium.Based on such understanding, technical scheme of the present invention is substantially The part to contribute in other words to the prior art or all or part of the technical solution can be in the form of software products It embodies, which is stored in a storage medium, is used including some instructions so that a computer Equipment (can be personal computer, server or network equipment etc.) perform each embodiment the method for the present invention whole or Part steps.And aforementioned storage medium includes:USB flash disk, read-only memory (ROM, Read-Only Memory), arbitrary access are deposited Reservoir (RAM, Random Access Memory), mobile hard disk, magnetic disc or CD etc. are various can to store program code Medium.
The above is only the preferred embodiment of the present invention, it is noted that for the ordinary skill people of the art For member, various improvements and modifications may be made without departing from the principle of the present invention, these improvements and modifications also should It is considered as protection scope of the present invention.

Claims (16)

1. a kind of antitheft tracing method of home appliance, which is characterized in that including:
In the case where receiving the first preset instructions that the first user is sent by client device, currently used household electrical appliances are obtained The face image of the second user of equipment, wherein, first preset instructions are used to start the recognition of face of the home appliance Pattern;
The matched image information of face image with the second user is searched in pre-set image information library;
The situation with the matched image information of the face image of the second user is found in the pre-set image information library Under, the location information of the user information of the second user and/or the home appliance is back to the client device, In, the user information of the second user includes at least:The facial image information of the second user.
2. according to the method described in claim 1, it is characterized in that, do not found in the pre-set image information library with it is described In the case of the matched image information of face image of second user, the face image of the second user is recorded, and by described in The location information of the face image of second user and/or the home appliance is back to the client device.
3. according to the method described in claim 1, it is characterized in that, receiving what the first user was sent by client device In the case of first preset instructions, before the face image for the second user for obtaining currently used home appliance, the method is also Including:
Receive the face image for first user that the client device uploads;
Verify the identity information of the face image of first user;
In the case where the face image of first user is proved to be successful, receives first user and set by the client The first preset instructions that preparation is sent.
4. the according to the method described in claim 3, it is characterized in that, feelings of the face image authentication failed in first user Under condition, the first prompt message is exported, wherein, first prompt message is for prompting first user to verify described the again The face image of one user.
5. according to the method described in claim 3, it is characterized in that, in the identity letter for verifying the face image of first user After breath, the method further includes:
In the case where the face image of first user is proved to be successful, receives first user and set by the client The second preset instructions that preparation is sent, wherein, second preset instructions are used for the function locking of the home appliance.
6. according to the method described in claim 1, it is characterized in that, receiving what the first user was sent by client device In the case of first preset instructions, the face image of the second user of currently used home appliance is obtained, including:
Start the recognition of face pattern of the home appliance, wherein, the home appliance is starting the recognition of face pattern In the case of, acquire the face image of the second user;
Receive the face image for the second user that the home appliance uploads.
7. it according to the method described in claim 1, it is characterized in that, is searched and the second user in pre-set image information library The matched image information of face image, including:
The matched image information of face image with the second user is searched in the Image Database of first user, In, the Image Database of first user is included to be believed with the face image of at least one user of first user-association Breath;
Image letter matched with the face image of the second user is not found in the Image Database of first user In the case of breath, search in the Image Database of all users and believe with the matched image of the face image of the second user Breath.
8. the method according to the description of claim 7 is characterized in that found in the Image Database of first user with In the case of the matched image information of face image of the second user, by the user information of the second user and/or institute The location information for stating home appliance is back to the client device.
9. it the method according to the description of claim 7 is characterized in that is not found in the Image Database of first user In the case of the matched image information of face image of the second user, searched in the Image Database of all users with The matched image information of face image of the second user, including:
Image letter matched with the face image of the second user is not found in the Image Database of first user In the case of breath, searched in the Image Database of first user again matched with the face image of the second user Image information;
Record the number searched again;
Judge whether the number searched again is more than predetermined threshold value;
In the case where the number searched again is more than the predetermined threshold value, the second prompt message is exported, wherein, described the Two prompt messages are used to that first user to be prompted to send third preset instructions, wherein, the third preset instructions are used in institute There is the matched image information of face image searched in the Image Database of user with the second user.
10. it the method according to the description of claim 7 is characterized in that is not searched in the Image Database of first user To with the matched image information of the face image of the second user in the case of, searched in the Image Database of all users After the matched image information of face image of the second user, the method further includes:
If found in the Image Database of all users with the matched image information of the face image of the second user, The location information of the user information of the second user and/or the home appliance is then back to the client device.
11. according to the method described in claim 1, it is characterized in that, the method further includes:
Detect whether that receive the first user sends the 4th preset instructions by client device, wherein, the described 4th default finger Enable the third user allowed for the first user setting using the home appliance;
In the case where detecting the 4th preset instructions, the image information of the third user is obtained;
Based on the image information of the third user, the home appliance is controlled.
12. according to the method for claim 11, which is characterized in that in the case where detecting the 4th preset instructions, The image information of the third user is obtained, including:
The interactive information of first user and third user are obtained, wherein, the interactive information includes at least one following:Figure As information, video information, voice messaging;
Described image information is extracted from the interactive information.
13. a kind of anti-theft tracking system of home appliance, which is characterized in that including:
Home appliance, for acquiring the face image of the user of the currently used home appliance;
Client device, for sending the first preset instructions, wherein, first preset instructions are used to start the home appliance Recognition of face pattern;
Server communicates respectively with the client device and the home appliance, for receiving the described first default finger In the case of order, the face image of the user is obtained, is searched in pre-set image information library matched with the face image Image information, and in the case of being found in the pre-set image information library with the matched image information of the face image, The location information of the user information of the user and/or the home appliance is back to the client device, the user User information include at least:The facial image information of the user.
14. a kind of anti-theft tracking device of home appliance, which is characterized in that including:
First acquisition unit, in the situation of the first preset instructions for receiving the first user and being sent by client device Under, the face image of the second user of currently used home appliance is obtained, wherein, first preset instructions are described for starting The recognition of face pattern of home appliance;
Searching unit is believed for being searched in pre-set image information library with the matched image of the face image of the second user Breath;
First execution unit matches for being found in the pre-set image information library with the face image of the second user Image information in the case of, the location information of the user information of the second user and/or the home appliance is back to The client device, wherein, the user information of the second user includes at least:The face image letter of the second user Breath.
15. a kind of storage medium, which is characterized in that the storage medium includes the program of storage, wherein, described program right of execution Profit requires the antitheft tracing method of the home appliance described in any one in 1 to 12.
16. a kind of processor, which is characterized in that the processor is used to run program, wherein, right of execution when described program is run Profit requires the antitheft tracing method of the home appliance described in any one in 1 to 12.
CN201711220970.2A 2017-11-28 2017-11-28 Anti-theft tracking method, device and system for household electrical appliance Active CN108182379B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711220970.2A CN108182379B (en) 2017-11-28 2017-11-28 Anti-theft tracking method, device and system for household electrical appliance

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711220970.2A CN108182379B (en) 2017-11-28 2017-11-28 Anti-theft tracking method, device and system for household electrical appliance

Publications (2)

Publication Number Publication Date
CN108182379A true CN108182379A (en) 2018-06-19
CN108182379B CN108182379B (en) 2020-06-16

Family

ID=62545459

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711220970.2A Active CN108182379B (en) 2017-11-28 2017-11-28 Anti-theft tracking method, device and system for household electrical appliance

Country Status (1)

Country Link
CN (1) CN108182379B (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112460752A (en) * 2020-10-27 2021-03-09 珠海格力电器股份有限公司 Anti-theft control method and system for split air conditioner, air conditioner and terminal

Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101833624A (en) * 2010-05-05 2010-09-15 中兴通讯股份有限公司 Information machine and access control method thereof
CN102202081A (en) * 2011-03-15 2011-09-28 复旦大学 Home remote monitoring and control system
CN102385362A (en) * 2011-09-14 2012-03-21 无锡市星亿涂装环保设备有限公司 Remote control method, device and system
CN102789682A (en) * 2012-07-13 2012-11-21 惠州Tcl移动通信有限公司 Method and system for remote control of household appliances
JP3182283U (en) * 2012-08-21 2013-03-21 カーティアン マークアレクサンドレ Audio playback method for electronic books
CN103957506A (en) * 2014-05-06 2014-07-30 重庆邮电大学 Mobile phone antitheft tracking system and method based on IMSI detection and face identification
CN103984315A (en) * 2014-05-15 2014-08-13 成都百威讯科技有限责任公司 Domestic multifunctional intelligent robot
CN104902242A (en) * 2015-06-04 2015-09-09 广东美的制冷设备有限公司 Anti-theft monitoring air conditioner and monitoring method for air conditioner
CN105116859A (en) * 2015-08-21 2015-12-02 杨珊珊 UAV-based smart home system and method
CN105471682A (en) * 2014-06-25 2016-04-06 小米科技有限责任公司 Household electrical appliance state information notification method and household electrical appliance state information notification device
CN105550674A (en) * 2016-02-01 2016-05-04 珠海格力电器股份有限公司 Method, device and system of verification of target object identity, and mobile terminal
CN106060033A (en) * 2016-05-27 2016-10-26 青岛海尔智能家电科技有限公司 Intelligent home appliance control method, intelligent home appliance control system, mobile terminal and server
CN106130852A (en) * 2016-08-30 2016-11-16 广东美的制冷设备有限公司 A kind of safety long-distance controls the method and device of household electrical appliances, air-conditioning
CN106765922A (en) * 2016-12-08 2017-05-31 广东志高空调有限公司 A kind of air-conditioning and air conditioning control method
CN106895553A (en) * 2017-02-14 2017-06-27 珠海格力电器股份有限公司 Air-conditioning and its control method and device, alarm method and device
CN106895554A (en) * 2017-02-14 2017-06-27 珠海格力电器股份有限公司 The methods, devices and systems and air-conditioner of user's registration in electric equipment
CN106980269A (en) * 2017-05-26 2017-07-25 周传浩 It is a kind of to ensure the intelligent home furnishing control method of communication security

Patent Citations (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101833624A (en) * 2010-05-05 2010-09-15 中兴通讯股份有限公司 Information machine and access control method thereof
CN102202081A (en) * 2011-03-15 2011-09-28 复旦大学 Home remote monitoring and control system
CN102385362A (en) * 2011-09-14 2012-03-21 无锡市星亿涂装环保设备有限公司 Remote control method, device and system
CN102789682A (en) * 2012-07-13 2012-11-21 惠州Tcl移动通信有限公司 Method and system for remote control of household appliances
JP3182283U (en) * 2012-08-21 2013-03-21 カーティアン マークアレクサンドレ Audio playback method for electronic books
CN103957506A (en) * 2014-05-06 2014-07-30 重庆邮电大学 Mobile phone antitheft tracking system and method based on IMSI detection and face identification
CN103984315A (en) * 2014-05-15 2014-08-13 成都百威讯科技有限责任公司 Domestic multifunctional intelligent robot
CN105471682A (en) * 2014-06-25 2016-04-06 小米科技有限责任公司 Household electrical appliance state information notification method and household electrical appliance state information notification device
CN104902242A (en) * 2015-06-04 2015-09-09 广东美的制冷设备有限公司 Anti-theft monitoring air conditioner and monitoring method for air conditioner
CN105116859A (en) * 2015-08-21 2015-12-02 杨珊珊 UAV-based smart home system and method
CN105550674A (en) * 2016-02-01 2016-05-04 珠海格力电器股份有限公司 Method, device and system of verification of target object identity, and mobile terminal
CN106060033A (en) * 2016-05-27 2016-10-26 青岛海尔智能家电科技有限公司 Intelligent home appliance control method, intelligent home appliance control system, mobile terminal and server
CN106130852A (en) * 2016-08-30 2016-11-16 广东美的制冷设备有限公司 A kind of safety long-distance controls the method and device of household electrical appliances, air-conditioning
CN106765922A (en) * 2016-12-08 2017-05-31 广东志高空调有限公司 A kind of air-conditioning and air conditioning control method
CN106895553A (en) * 2017-02-14 2017-06-27 珠海格力电器股份有限公司 Air-conditioning and its control method and device, alarm method and device
CN106895554A (en) * 2017-02-14 2017-06-27 珠海格力电器股份有限公司 The methods, devices and systems and air-conditioner of user's registration in electric equipment
CN106980269A (en) * 2017-05-26 2017-07-25 周传浩 It is a kind of to ensure the intelligent home furnishing control method of communication security

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112460752A (en) * 2020-10-27 2021-03-09 珠海格力电器股份有限公司 Anti-theft control method and system for split air conditioner, air conditioner and terminal
CN112460752B (en) * 2020-10-27 2022-03-18 珠海格力电器股份有限公司 Anti-theft control method and system for split air conditioner, air conditioner and terminal

Also Published As

Publication number Publication date
CN108182379B (en) 2020-06-16

Similar Documents

Publication Publication Date Title
Atlam et al. Internet of things forensics: A review
CN106506442B (en) A kind of smart home multi-user identification and its Rights Management System
CN103841108B (en) The authentication method and system of user biological feature
US10491630B2 (en) System and method for providing data-driven user authentication misuse detection
CN107332811A (en) The methods, devices and systems of intrusion detection
CN112398860A (en) Safety control method and device
CN204990444U (en) Intelligent security controlgear
CN106161406B (en) The method and apparatus for obtaining user account
CN109410386A (en) Unlocking processing method and processing device, storage medium, processor
CN107131607A (en) Monitoring method, device, system and air-conditioning based on air-conditioning
CN112333200A (en) Behavior characteristic continuous identity verification method and system for zero trust model
CN110572302B (en) Diskless local area network scene identification method and device and terminal
CN109118626A (en) Control method, device, storage medium and the electronic device of lockset
CN106469269B (en) A kind of method, apparatus and terminal of Password Management
Rodavia et al. Web and mobile based facial recognition security system using Eigenfaces algorithm
CN108182379A (en) The antitheft tracing method of home appliance, device and system
CN104240348A (en) Admittance identity authentication method based on image identification
CN214752023U (en) Fingerprint acquisition device and fingerprint management system
CN111179515A (en) Storage cabinet, management system and storage system of emergency equipment
CN106341541B (en) List treating method and apparatus
CN106355684A (en) Control method, device and system of controlled equipment
CN209435252U (en) A kind of backup verifying network system
CN116049797A (en) Intelligent storage system based on data classification system
CN111491258A (en) Object type detection method and device
CN113259136B (en) Multi-client cooperative authentication method, device, equipment and medium for feature recognition

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant