CN112233395B - Hand washing monitoring method and device - Google Patents
Hand washing monitoring method and device Download PDFInfo
- Publication number
- CN112233395B CN112233395B CN202011149167.6A CN202011149167A CN112233395B CN 112233395 B CN112233395 B CN 112233395B CN 202011149167 A CN202011149167 A CN 202011149167A CN 112233395 B CN112233395 B CN 112233395B
- Authority
- CN
- China
- Prior art keywords
- hand washing
- cleaning
- target
- hand
- determining
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B21/00—Alarms responsive to a single specified undesired or abnormal condition and not otherwise provided for
- G08B21/18—Status alarms
- G08B21/24—Reminder alarms, e.g. anti-loss alarms
- G08B21/245—Reminder of hygiene compliance policies, e.g. of washing hands
-
- G—PHYSICS
- G08—SIGNALLING
- G08B—SIGNALLING OR CALLING SYSTEMS; ORDER TELEGRAPHS; ALARM SYSTEMS
- G08B5/00—Visible signalling systems, e.g. personal calling systems, remote indication of seats occupied
- G08B5/22—Visible signalling systems, e.g. personal calling systems, remote indication of seats occupied using electric transmission; using electromagnetic transmission
- G08B5/36—Visible signalling systems, e.g. personal calling systems, remote indication of seats occupied using electric transmission; using electromagnetic transmission using visible light sources
Abstract
The application discloses a hand washing monitoring method and device, and belongs to the technical field of communication. The hand washing monitoring method comprises the following steps: under the condition that the user is determined to be in a hand washing state, determining hand washing cleaning intensity through a target sensor arranged on the wearable device; wherein the target sensor includes: an acceleration sensor, a gyroscope, and a microphone; determining the hand washing cleaning degree according to the hand washing cleaning intensity and the recorded hand washing cleaning duration; and scoring the hand washing according to the hand washing cleaning degree, and displaying a scoring result. The technical scheme provided by the embodiment of the application can solve the problems of large calculation amount, high cost and poor adaptability of the hand washing mode of the supervision user in the prior art to a certain extent.
Description
Technical Field
The application belongs to the technical field of communication, and particularly relates to a hand washing monitoring method and device.
Background
With the continuous improvement of the quality of life, the requirement of people on sanitation rises, and the frequent use of people for washing hands is a commonly adopted means for keeping sanitation. After the hands touch public articles (such as handrails, door handles and elevator buttons) or after the people go to the toilet, the probability of infecting diseases can be reduced by washing the hands.
When the hands are washed, the hand cleaning degree can be better ensured by washing the hands in place. In the prior art, in order to supervise hand washing of a user, a camera is usually arranged at a hand washing position, video monitoring is performed on a hand washing process through the camera, a hand washing action is identified through an image processing technology and compared with a standard hand washing process, so that a hand washing quality score is obtained, and the user is reminded.
However, in the method for monitoring hand washing of the user in the prior art, due to the fact that image processing is required, the calculation amount is large, the pressure of a processor is large, a camera device needs to be equipped, the cost is high, in addition, the hand washing habits of each person are different, comparative analysis is carried out based on a standard flow, the adaptability is poor, and hand washing of the user cannot be well monitored.
Disclosure of Invention
The embodiment of the application aims to provide a hand washing monitoring method and device, and the problems of large calculation amount, high cost and poor adaptability of a hand washing monitoring mode of a user in the prior art can be solved to a certain extent.
In order to solve the technical problem, the present application is implemented as follows:
in a first aspect, an embodiment of the present application provides a hand washing monitoring method, which is applied to a wearable device, and the hand washing monitoring method includes:
under the condition that the user is determined to be in a hand washing state, determining hand washing cleaning intensity through a target sensor arranged on the wearable device; wherein the target sensor includes: an acceleration sensor, a gyroscope, and a microphone;
determining the hand washing cleaning degree according to the hand washing cleaning intensity and the recorded hand washing cleaning duration;
and scoring the hand washing according to the hand washing cleaning degree, and displaying a scoring result.
In a second aspect, an embodiment of the present application provides a hand washing monitoring device for use in a wearable device, the hand washing monitoring device comprising:
the first determination module is used for determining the hand washing cleaning intensity through a target sensor arranged on the wearable device under the condition that the user is determined to be in the hand washing state; wherein the target sensor includes: an acceleration sensor, a gyroscope, and a microphone;
the second determining module is used for determining the hand washing cleaning degree according to the hand washing cleaning intensity and the recorded hand washing cleaning duration;
and the scoring module is used for scoring the hand washing according to the hand washing cleanliness degree and displaying a scoring result.
In a third aspect, an embodiment of the present application provides an electronic device, including: a processor, a memory, and a program or instructions stored on and executable on the processor, which when executed by the processor, implement the steps in the hand washing monitoring method of the first aspect.
In a fourth aspect, embodiments of the present application provide a readable storage medium having stored thereon a program or instructions which, when executed by a processor, implement the steps of the hand washing monitoring method of the first aspect.
In a fifth aspect, embodiments of the present application provide a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the hand washing monitoring method according to the first aspect.
In the embodiment of the application, hand washing of a user is monitored through wearable equipment worn by the user. The wearable device is provided with sensors such as an acceleration sensor, a gyroscope and a microphone, and the sensors can acquire hand washing data to a certain extent, so that the wearable device can score hand washing according to the obtained hand washing data for a user to check. When monitoring washing hands, the embodiment of the application does not need to arrange a camera at the washing hand position, and the wearable equipment worn by a user can be used, so that the monitoring cost is reduced. And image processing is not needed, the calculation amount is small, and the pressure of a processor is favorably reduced. In addition, in the embodiment of the application, the scoring is performed according to the hand washing cleaning strength and the hand washing cleaning duration, the comparison and analysis with a standard flow are not needed, the scoring can be effectively performed on various non-standard actions, and the applicability is high.
Drawings
Fig. 1 is a schematic flow chart of a hand washing monitoring method according to an embodiment of the present application;
FIG. 2 is a schematic illustration of hand washing status detection provided by embodiments of the present application;
FIG. 3 is a schematic diagram of a scoring process provided by an embodiment of the present application;
FIG. 4 is a schematic diagram of a scoring interface provided by embodiments of the present application;
FIG. 5 is a second schematic diagram of a scoring interface provided in accordance with an embodiment of the present application;
FIG. 6 is a schematic block diagram of a hand washing monitoring apparatus provided in an embodiment of the present application;
FIG. 7 is a block diagram of an electronic device provided by an embodiment of the application;
fig. 8 is a second schematic block diagram of an electronic device according to an embodiment of the present application.
Detailed Description
The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are some, but not all, embodiments of the present application. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present application.
The terms first, second and the like in the description and in the claims of the present application are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order. It will be appreciated that the data so used may be interchanged under appropriate circumstances such that embodiments of the application may be practiced in sequences other than those illustrated or described herein, and that the terms "first," "second," and the like are generally used herein in a generic sense and do not limit the number of terms, e.g., the first term can be one or more than one. In addition, "and/or" in the specification and claims means at least one of connected objects, a character "/" generally means that a preceding and succeeding related objects are in an "or" relationship.
The hand washing monitoring method provided by the embodiment of the present application is described in detail below with reference to the accompanying drawings through specific embodiments and application scenarios thereof.
Fig. 1 is a schematic flowchart of a hand washing monitoring method applied to a wearable device (e.g., a smart watch), according to an embodiment of the present disclosure.
As shown in fig. 1, the hand washing monitoring method may include:
step 101: in the case that the user is determined to be in the hand washing state, the hand washing cleaning intensity is determined through a target sensor arranged on the wearable device.
Wherein the target sensor includes: acceleration sensor, gyroscope, and microphone.
In the embodiment of the application, the wearable device worn by the user can acquire hand washing data through the target sensor arranged by the wearable device when the user is determined to be in a hand washing state, and then hand washing cleaning intensity is analyzed according to the acquired hand washing data. The hand washing intensity can be understood as hand washing efficiency per unit time, for example, the harder the hand is washed, the cleaner the hand is washed, i.e., the higher the cleaning efficiency is, the more forceful the hand washing is, the more powerful the hand washing is performed.
Step 102: and determining the hand washing cleaning degree according to the hand washing cleaning intensity and the recorded hand washing cleaning duration.
In the embodiment of the application, the wearable device determines the hand washing cleaning intensity through the target sensor, records the hand washing cleaning duration, and then determines the hand washing cleaning degree according to the hand washing cleaning intensity and the hand washing cleaning duration.
Optionally, when the hand washing cleanliness is determined according to the hand washing cleanliness intensity and the hand washing cleanliness duration, the hand washing cleanliness intensity within the hand washing cleanliness duration may be integrated to obtain the hand washing cleanliness. Of course, other implementations may be used for the calculations.
Step 103: and scoring the hand washing according to the hand washing cleanliness degree, and displaying a scoring result.
In the embodiment of the application, the user can be scored according to the obtained hand washing cleanness, and the scoring result is displayed for the user to check.
Wherein, the higher the hand washing cleanliness degree is, the cleaner the hand is washed, and the higher the score is; conversely, a lower degree of hand washing cleanliness indicates a less well-defined hand wash, and a lower score.
In the embodiment of the application, hand washing of a user is monitored through wearable equipment worn by the user. The wearable device is provided with sensors such as an acceleration sensor, a gyroscope and a microphone, and the sensors can acquire hand washing data to a certain extent, so that the wearable device can score hand washing according to the obtained hand washing data for a user to check. When monitoring washing hands, the embodiment of the application does not need to arrange a camera at the washing hand position, and the wearable equipment worn by a user can be used, so that the monitoring cost is reduced. And image processing is not needed, the calculation amount is small, and the pressure of a processor is favorably reduced. In addition, in the embodiment of the application, the scoring is performed according to the hand washing cleaning strength and the hand washing cleaning duration, the comparative analysis with a standard flow is not needed, the scoring can be effectively performed on various nonstandard actions, and the applicability is high.
Optionally, in this embodiment of the present application, how the wearable device determines whether the user is in a hand washing state may be generally implemented in two ways:
the first is that: the determination is made according to an input operation of the user. For example, the wearable device determines that the user is in a hand washing state when receiving the first input of the user, and monitors hand washing of the user after the wearable device enters a hand washing monitoring mode. The first input described herein is an input operation for indicating that the user is in the hand washing state, and may include, but is not limited to: at least one of touch input operation, voice input operation, and gesture input operation over air. The user determines whether the hand washing state is achieved, so that the accuracy of judgment can be improved.
Secondly, the following steps: automatically detected by the wearable device. For example, in the case that the hand washing action is detected by the acceleration sensor and the gyroscope in the target sensor, and/or the water flow sound is detected by the microphone in the target sensor, it is determined that the user is in the hand washing state, the wearable device performs the hand washing monitoring mode, and the monitoring of the hand washing of the user is started. Since a general hand washing operation has a specific operation characteristic, if the acceleration sensor and the gyroscope of the target sensor detect an operation characteristic corresponding to the hand washing operation, it can be considered that the user is in a hand washing state. In addition, since people generally wash their hands with water, it is possible to consider that the user is in a hand washing state even when the microphone of the target sensor detects a water flow sound. The wearable device automatically detects the data without user interference, and the operation is simple.
Preferably, the user may be determined to be in the hand washing state when the hand washing action is detected by the acceleration sensor and the gyroscope and the water flow sound is detected by the microphone, and the user may not be in the hand washing state when any one of the two conditions is not satisfied, so that the accuracy of the determination can be improved. As shown in fig. 2, it is determined whether a hand washing motion is detected based on the acceleration sensor data (i.e., data collected by the acceleration sensor) and the gyro data (i.e., data collected by the gyro). And judging whether the water flow sound is detected or not according to the microphone data (namely the data collected by the microphone). Determining that the user is in a hand washing state under the condition that hand washing actions and water flow sounds are detected; in the case where the hand washing action and/or the water flow sound is not detected, it is determined that the user is not in the hand washing state.
For the detection of the water flow sound, some water flow sound data can be stored in advance to judge whether the sound data collected by the microphone has sound data matched with the pre-stored water flow sound data. In the case of yes, the water flow sound is considered to be detected; in the absence, it is assumed that no water flow sound is detected.
Generally, the acceleration sensor and the gyroscope on the wearable device are in a normally open state, and the microphone is in a normally closed state, so that after the hand washing action is detected by the acceleration sensor and the gyroscope, the microphone can be started, and the microphone collects sound data.
Optionally, step 101: determining the hand washing cleaning intensity through a target sensor provided on the wearable device may include: and determining the hand washing cleaning intensity of each target cleaning part of the hand through the target sensor. Accordingly, step 102: determining the hand washing cleanliness according to the hand washing cleanliness intensity and the recorded hand washing cleanliness duration may include: and determining the hand washing cleaning degree of the corresponding target cleaning part according to the hand washing cleaning strength of each target cleaning part and the recorded hand washing cleaning duration of each target cleaning part.
Wherein the target cleaning site comprises: at least one of a palm, a back of a hand, a finger, and a wrist.
In this embodiment, the hand washing cleaning intensity in step 101 may be a cleaning intensity of each cleaning portion (i.e., target cleaning portion) of the hand, and accordingly, the hand washing cleaning duration in step 102 is a cleaning duration of each cleaning portion, and the hand washing cleaning degree in step 102 is a cleaning degree of each cleaning portion. The more the number of target cleaning parts is, the more comprehensive the evaluation of the hand washing is, and the higher the accuracy is.
It is understood that the hand washing cleaning intensity in step 101 may also be the cleaning intensity of the whole hand, and accordingly, the hand washing cleaning duration in step 102 is the cleaning duration of the whole hand, and the hand washing cleaning degree in step 102 is the cleaning degree of the whole hand. Therefore, the processing process is relatively simple, the calculation amount is low, and the pressure of the processor and the power consumption are favorably reduced.
Optionally, in the embodiment of the present application, the part currently being cleaned may be determined according to the hand washing action.
Generally, when the hand washing action is determined, the cleaning position is also determined. For example, the hand washing action is: the palms of the two hands are opposite and are rubbed back and forth, and then the cleaning part can be determined as follows: palms and fingers of the hands (more specifically, the side of the fingers on the same side as the palms); as another example, the hand washing action is: the left hand palm fits the back of the right hand, then the fingers of both hands rub around alternately, then can confirm that clean position is this moment: the palm of the left hand and the fingers of both hands (more specifically, the finger slits), so that the part currently being cleaned can be determined according to the hand washing action.
Since the tracks and the position postures of the hand washing actions of different types have certain differences, the data information acquired by the acceleration sensor and the gyroscope in the wearable device also has certain differences, and the hand washing actions of the same type are substantially similar although the hand washing modes of each person are slightly different, so that the type of the current hand washing action can be determined according to the data of the acceleration sensor and the data of the gyroscope, as shown in fig. 3. In addition, in the embodiment of the application, a corresponding relationship between the type of the hand washing action and the target cleaning part may be preset, so that the target cleaning part corresponding to the type of the current hand washing action may be determined according to the preset corresponding relationship between the type of the hand washing action and the target cleaning part.
Alternatively, the classification model may be constructed by collecting acceleration sensor data and gyroscope data generated during different types of hand washing actions in advance and using a classification method (such as neural network, feature classification, and the like), so as to accurately determine the type of the hand washing action.
In the embodiment of the application, the data collected by the acceleration sensor and the gyroscope arranged on the wearable device are analyzed to determine the hand washing action type, and compared with the prior art that the hand washing action type is identified by adopting an image processing mode, the data processing amount is small, so that the pressure of a processor is reduced, and the power consumption is reduced.
Optionally, as previously described: determining, by the target sensor, hand washing intensity for each target cleaning location of the hand, may include:
respectively acquiring parameter values of target parameters when each target cleaning part is cleaned through a target sensor; and determining the hand washing cleaning strength of the corresponding target cleaning part according to the parameter value of the target parameter.
The target parameters described herein include: at least one of water flow, hand sound, hand washing motion amplitude and hand washing motion speed. The water flow and the hand-made sound are obtained by a microphone in the target sensor, and the hand washing action amplitude and the hand washing action speed are obtained by a gyroscope and an acceleration sensor in the target sensor. Since the wearable device is generally worn on the wrist, the hand washing motion amplitude can be understood as the rotation amplitude of the wrist, and the hand washing motion speed can be understood as the movement speed of the wrist.
Wherein, the more the number of the target parameters is, the more comprehensive the evaluation of the hand washing cleaning intensity is, and the higher the accuracy is, therefore, the preferred target parameters include: water flow, hand sounds, hand washing motion amplitude, and hand washing motion speed, as shown in fig. 3.
For a better understanding of each target parameter, the water flow, the hand sounds and the amplitude and speed of the hand washing action are further explained below.
The magnitude of the water flow can affect the hand washing cleaning intensity. Generally, the greater the water flow, the greater the cleaning intensity; conversely, the smaller the water flow, the lower the cleaning intensity. And water flow sound and water flow size generally have a linear relation, consequently, can acquire water flow sound through the microphone on the wearable equipment, and then according to the preliminary corresponding relation between water flow sound and the water flow size, confirm the water flow size corresponding with the water flow sound of acquireing.
When washing hands, the sound emitted by the hands can reflect the hand washing cleaning intensity to a certain extent. Generally, the larger the scrubbing force is, the higher the cleaning intensity is, and the larger the sound made by the hand is; on the contrary, the smaller the scrubbing force, the lower the cleaning intensity, and the smaller the sound emitted by the hand, so that the sound emitted by the hand during hand washing can be used as a dimension for analyzing the hand washing cleaning intensity.
The hand washing action amplitude and speed can also reflect the hand washing cleaning strength to a certain extent. For example, a quick scrub of the palm will provide better cleaning than a slow scrub, with greater cleaning intensity. The amplitude of change of data collected by the acceleration sensor and the gyroscope on the wearable device directly quantifies the amplitude and the speed of the hand washing action, so that the amplitude and the speed of the hand washing action can be used as two dimensions for analyzing the hand washing cleaning intensity.
Alternatively, how to determine the cleaning intensity of the corresponding target cleaning part according to the parameter value of the target parameter can be implemented in the following manner:
determining the target cleaning intensity corresponding to the obtained parameter value of each target parameter according to the preset corresponding relation between the parameter value of each target parameter and the cleaning intensity; and multiplying each target cleaning intensity by the sum of the corresponding first preset weight value respectively to determine the hand washing cleaning intensity of the corresponding target cleaning part.
In the embodiment of the application, the corresponding relation between the parameter value of each target parameter and the cleaning intensity can be preset, so that after the parameter value of the target parameter is obtained, the target cleaning intensity corresponding to the parameter value of each target parameter can be obtained according to the preset corresponding relation.
In addition, in this embodiment of the application, a weight value may be preset for each target parameter (that is, a first preset weight value may be a numerical value greater than 0 and less than 1), and the first preset weight value may be set according to an influence degree of the target parameter on the cleaning intensity, for example, the larger the influence degree is, the larger the weight value is set; conversely, the smaller the degree of influence, the smaller the weight value setting. In this way, after the target cleaning intensity corresponding to the parameter value of each target parameter is obtained, the sum of each target cleaning intensity multiplied by the corresponding weight value can be determined as the hand washing cleaning intensity of the corresponding target cleaning part. Then, the hand washing cleaning degree of the corresponding target cleaning part can be determined according to the hand washing cleaning strength of each target cleaning part and the recorded hand washing cleaning duration of each target cleaning part.
Optionally, step 103: scoring the hand washing according to the hand washing cleanliness and displaying a scoring result, wherein the scoring method comprises the following steps:
respectively scoring the cleaning of each target cleaning part according to the hand washing cleaning degree of each target cleaning part; and respectively multiplying the score of each target cleaning part by the sum of the corresponding second preset weight values to determine the total score obtained by washing the hands at this time, and displaying the total score.
In the embodiment of the application, the cleaning of each target cleaning part can be respectively scored according to the hand washing cleaning degree of each target cleaning part, and then the total score of the hand washing is obtained according to the score of each target cleaning part. For example, as shown in fig. 3, a back of hand cleaning score, a palm cleaning score, and a finger cleaning score are obtained separately, and then an overall score is obtained from the three scores.
A weight value (i.e., a second preset weight value, which may be a numerical value greater than 0 and less than 1) may be preset for each target cleaning portion, and the second preset weight value may be set according to an influence degree of the target cleaning portion on the hand cleaning degree, for example, the larger the influence degree is, the larger the weight value is set; conversely, the smaller the degree of influence, the smaller the weight value setting.
Optionally, in this embodiment of the application, the total score of hand washing may be displayed in real time, as shown in fig. 4, in a display 401 of the wearable device, through text: "current handwash score 72" displays the overall score for viewing by the user and for alerting the user. Besides the overall score, the hand washing duration can be displayed, such as a text prompt message of '33 seconds washed hands' and the like.
Further, a cleaning result of each target cleaning portion may be displayed, where the cleaning result is used to indicate that the cleaning degree of the target cleaning portion has reached or failed to reach the standard, as shown in fig. 4, a rectangular frame 402 (only the rectangular frame at the "palm" is marked) is displayed on the left side of each target cleaning portion information, and when a tick mark is displayed in the rectangular frame 402, the cleaning degree of the target cleaning portion is indicated to reach the standard (that is, the cleaning degree of the hand is greater than or equal to a preset cleaning degree); when the tick mark is not displayed in the rectangular frame, it indicates that the cleaning degree of the target cleaning part does not reach the standard (i.e. the cleaning degree of hand washing is less than the preset cleaning degree).
The preset cleaning degree may be a fixed value, or may be flexibly adjusted according to a time interval between the current hand washing and the last hand washing. For example, the larger the time interval between the current hand washing and the last hand washing, the worse the cleanliness of the hands is, the higher the cleanliness requirement is, so that the preset cleanliness value can be increased; on the contrary, the smaller the time interval is, the better the cleanliness of the hand is, and the lower the cleanliness requirement is, the smaller the preset cleanliness value can be. The time interval and the preset cleaning degree may be associated in advance, so that the specific preset cleaning degree may be determined according to the time interval.
Optionally, the wearable device may output a prompt message for reminding the user to end the current hand washing action if it is determined that the target cleaning location is cleaned to reach the standard.
Optionally, if the wearable device detects that the user is no longer in the hand washing state within the preset time period, the final evaluation result of the hand washing may be displayed, as shown in fig. 5, through the text: "current handwash score 72", display the final overall score, and by text: "wash this day the third time, take 35 seconds, the duration is up to standard, but the finger has not been cleaned fully yet", show information such as the total number of times of washing the hand, the cleaning duration of this washing the hand, whether the cleaning duration of this washing the hand is up to standard and which local cleaning position is not up to standard. In addition, whether each local cleaning part reaches the standard or not can be displayed in a mode of combining graphics with characters, for example, in fig. 5, a rectangular frame 402 or a circular frame 403 is respectively displayed on the left side of characters of the "palm", "back of hand", "wrist" and "finger". Wherein, the tick mark is displayed in the rectangular frame to indicate that the mark reaches the standard, and the cross mark is displayed in the circular frame to indicate that the mark does not reach the standard.
Alternatively, in the embodiment of the present application, it may be determined that the user is no longer in the hand washing state in the case where the hand washing motion is not detected by the acceleration sensor and the gyroscope, and/or the water flow sound is not detected by the microphone. It is to be understood that in the case where the hand-rubbing action is detected by the acceleration sensor and the gyroscope, and/or the hand-rubbing sound is detected by the microphone, it is determined that the user is no longer in the hand-washing state. Or, in the case that the acceleration sensor and the gyroscope detect the hand drying action of the dryer, and/or the microphone detects the sound when the dryer is in the hand drying state, determining that the user is no longer in the hand washing state.
To sum up, in this application embodiment, the hand washing of the user is monitored through the wearable device worn by the user. The wearable device is provided with sensors such as an acceleration sensor, a gyroscope and a microphone, and the sensors can acquire hand washing data to a certain extent, so that the wearable device can score hand washing according to the obtained hand washing data for a user to check. The hand washing monitoring method provided by the embodiment of the application has the advantages of low cost, small calculation amount and strong applicability.
It should be noted that, in the hand washing monitoring method provided in the embodiment of the present application, the execution main body may be a hand washing monitoring device, or a control module in the hand washing monitoring device for executing the hand washing monitoring method. In the embodiment of the present application, a hand washing monitoring device is taken as an example to execute a hand washing monitoring method, and the hand washing monitoring device provided in the embodiment of the present application is described.
Fig. 6 is a schematic block diagram of a hand washing monitoring device applied to a wearable device (e.g., a smart watch) according to an embodiment of the present application.
As shown in fig. 6, the hand washing monitoring device includes:
the first determination module 601 is configured to determine hand washing cleaning intensity through a target sensor provided on the wearable device if it is determined that the user is in a hand washing state.
Wherein the target sensor includes: acceleration sensor, gyroscope, and microphone.
A second determining module 602, configured to determine a hand washing cleanliness degree according to the hand washing cleanliness intensity and the recorded hand washing cleanliness duration.
And the scoring module 603 is configured to score the hand washing according to the hand washing cleanliness, and display a scoring result.
Optionally, the first determining module 601 includes:
the first determining submodule is used for determining hand washing cleaning intensity of each target cleaning part of the hand through the target sensor.
Wherein the target cleaning site comprises: at least one of a palm, a back of a hand, a finger, and a wrist.
Optionally, the first determining sub-module includes:
and the acquisition unit is used for respectively acquiring the parameter value of the target parameter when each target cleaning part is cleaned through the target sensor.
Wherein the target parameters include: at least one of water flow, hand-made sound, hand washing action amplitude and hand washing action speed; the water flow and the sound emitted by the hand are obtained by a microphone in the target sensor, and the hand washing action amplitude and the hand washing action speed are obtained by a gyroscope and an acceleration sensor in the target sensor.
And the determining unit is used for determining the hand washing cleaning strength of the corresponding target cleaning part according to the parameter value of the target parameter.
Optionally, the determining unit includes:
and the first determining subunit is used for determining the target cleaning intensity corresponding to the obtained parameter value of each target parameter according to the preset corresponding relation between the parameter value of each target parameter and the cleaning intensity.
And the second determining subunit is used for determining the sum of each target cleaning intensity multiplied by the corresponding first preset weight value as the hand washing cleaning intensity of the corresponding target cleaning part.
Optionally, the second determining module 602 includes:
and the second determining submodule is used for determining the hand washing cleaning degree of the corresponding target cleaning part according to the hand washing cleaning intensity of each target cleaning part and the recorded hand washing cleaning duration of each target cleaning part.
Optionally, the scoring module 603 includes:
and the first grading submodule is used for grading the cleaning of each target cleaning part according to the hand washing cleaning degree of each target cleaning part.
And the second scoring submodule is used for multiplying the score of each target cleaning part by the sum of the corresponding second preset weight values respectively, determining the score as the total score obtained by the hand washing, and displaying the total score.
Optionally, the hand washing monitoring device further comprises:
and the display module is used for displaying the cleaning result of each target cleaning part.
The cleaning result is used for indicating that the hand washing cleaning degree of the target cleaning part reaches or does not reach the standard.
Optionally, the hand washing monitoring device further comprises:
and the prompting module is used for outputting prompting information for prompting a user to finish the current hand washing action under the condition that the cleaning of the target cleaning part is determined to reach the standard.
Optionally, the hand washing monitoring device further comprises:
and the third determination module is used for determining the type of the current hand washing action according to data information acquired by an acceleration sensor and a gyroscope in the target sensor.
And the fourth determining module is used for determining the target cleaning part corresponding to the type of the current hand washing action according to the preset corresponding relation between the type of the hand washing action and the target cleaning part.
Optionally, the hand washing monitoring device further comprises:
and the fifth determination module is used for determining that the user is in a hand washing state under the condition that hand washing actions are detected through an acceleration sensor and a gyroscope in the target sensor and water flow sounds are detected through a microphone in the target sensor.
In the embodiment of the application, hand washing of a user is monitored through wearable equipment worn by the user. The wearable device is provided with sensors such as an acceleration sensor, a gyroscope and a microphone, and the sensors can acquire hand washing data to a certain extent, so that the wearable device can score hand washing according to the obtained hand washing data for a user to check. The hand washing monitoring method provided by the embodiment of the application has the advantages of low cost, small calculation amount and strong applicability.
The hand washing monitoring device in the embodiment of the application can be a device, and can also be a component, an integrated circuit or a chip in the terminal. The apparatus may be a mobile electronic device, such as a wearable device, and the embodiments of the present application are not limited in particular.
The hand washing monitoring device in the embodiments of the present application may be a device having an operating system. The operating system may be an Android operating system (Android), an iOS operating system, or other possible operating systems, which is not specifically limited in the embodiments of the present application.
Optionally, as shown in fig. 7, an electronic device 700 is further provided in this embodiment of the present application, and includes a processor 701, a memory 702, and a program or an instruction stored in the memory 702 and executable on the processor 701, where the program or the instruction is executed by the processor 701 to implement each process of the hand washing monitoring method embodiment, and may achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
It should be noted that the electronic device in the embodiment of the present application includes the mobile electronic device described above.
Fig. 8 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
The electronic device 800 includes, but is not limited to: a radio frequency unit 801, a network module 802, an audio output unit 803, an input unit 804, a sensor 805, a display unit 806, a user input unit 807, an interface unit 808, a memory 809, and a processor 810.
Those skilled in the art will appreciate that the electronic device 800 may further comprise a power source (e.g., a battery) for supplying power to the various components, and the power source may be logically connected to the processor 810 through a power management system, so as to implement functions of managing charging, discharging, and power consumption through the power management system. The electronic device structure shown in fig. 8 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components, and thus, the description is omitted here.
Wherein the processor 810 is configured to: in the case where it is determined that the user is in the hand washing state, the hand washing cleaning intensity is determined by the sensor 805 (i.e., the target sensor in the embodiment of the present application); determining the hand washing cleaning degree according to the hand washing cleaning intensity and the recorded hand washing cleaning duration; according to the hand washing cleanliness, scoring is performed on the hand washing, and the display unit 806 is controlled to display scoring results. Wherein the target sensor includes: acceleration sensor, gyroscope, and microphone.
Optionally, the processor 810 is further configured to: the hand wash cleaning intensity for each target cleaning location on the hand is determined by the sensor 805. Wherein the target cleaning site comprises: at least one of a palm, a back of a hand, a finger, and a wrist.
Optionally, the sensor 805 is further configured to: and respectively acquiring the parameter value of the target parameter when each target cleaning part is cleaned. The processor 810 is further configured to: and determining the hand washing cleaning strength of the corresponding target cleaning part according to the parameter value of the target parameter. Wherein the target parameters include: at least one of water flow, hand-made sound, hand washing action amplitude and hand washing action speed; the water flow and the sound emitted by the hands are obtained by a microphone in the target sensor, and the hand washing action amplitude and the hand washing action speed are obtained by a gyroscope and an acceleration sensor in the target sensor;
optionally, the processor 810 is further configured to: determining the target cleaning intensity corresponding to the obtained parameter value of each target parameter according to the preset corresponding relation between the parameter value of each target parameter and the cleaning intensity; and respectively multiplying each target cleaning intensity by the sum of the corresponding first preset weight value to determine the hand washing cleaning intensity of the corresponding target cleaning part.
Optionally, the processor 810 is further configured to: and determining the hand washing cleaning degree of the corresponding target cleaning part according to the hand washing cleaning strength of each target cleaning part and the recorded hand washing cleaning duration of each target cleaning part.
Optionally, the processor 810 is further configured to: respectively scoring the cleaning of each target cleaning part according to the hand washing cleaning degree of each target cleaning part; and respectively multiplying the score of each target cleaning part by the sum of the corresponding second preset weight value, determining the total score obtained by washing the hands at this time, and displaying the total score.
Optionally, the processor 810 is further configured to: the control display unit 806 displays the washing result of each of the target cleaning portions. Wherein the cleaning result is used for indicating that the hand washing cleaning degree of the target cleaning part reaches or does not reach the standard.
Optionally, the processor 810 is further configured to: and under the condition that the target cleaning part is determined to reach the standard, outputting prompt information for prompting the user to end the current hand washing action.
Optionally, the processor 810 is further configured to: determining the type of the current hand washing action according to data information acquired by an acceleration sensor and a gyroscope in the sensor 805; and determining the target cleaning part corresponding to the type of the current hand washing action according to the preset corresponding relation between the type of the hand washing action and the target cleaning part.
Optionally, the processor 810 is further configured to: in the case where a hand washing action is detected by the acceleration sensor and the gyroscope in the sensor 805, and a water flow sound is detected by the microphone in the sensor 805, it is determined that the user is in a hand washing state.
In the embodiment of the application, hand washing of a user is monitored through wearable equipment worn by the user. The wearable device is provided with sensors such as an acceleration sensor, a gyroscope and a microphone, and the sensors can acquire hand washing data to a certain extent, so that the wearable device can score hand washing according to the obtained hand washing data for a user to check. The hand washing monitoring method provided by the embodiment of the application has the advantages of low cost, small calculation amount and strong applicability.
It should be understood that in the embodiment of the present application, the input Unit 804 may include a Graphics Processing Unit (GPU) 8041 and a microphone 8042, and the Graphics Processing Unit 8041 processes image data of a still picture or a video obtained by an image capturing device (such as a camera) in a video capturing mode or an image capturing mode. The display unit 806 may include a display panel 8061, and the display panel 8061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 807 includes a touch panel 8071 and other input devices 8072. A touch panel 8071, also referred to as a touch screen. The touch panel 8071 may include two portions of a touch detection device and a touch controller. Other input devices 8072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein. Memory 809 may be used to store software programs as well as various data including, but not limited to, application programs and operating systems. The processor 810 may integrate an application processor, which mainly handles operating systems, user interfaces, application programs, etc., and a modem processor, which mainly handles wireless communications. It will be appreciated that the modem processor described above may not be integrated into processor 810.
The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or the instruction is executed by a processor, the program or the instruction implements each process of the hand washing monitoring method embodiment applied to the first electronic device or the second electronic device, and can achieve the same technical effect, and in order to avoid repetition, details are not repeated here.
The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and so on.
The embodiment of the present application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled to the processor, the processor is configured to execute a program or an instruction, implement each process of the hand washing monitoring method embodiment, and achieve the same technical effect, and for avoiding repetition, the description is omitted here.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatuses in the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions recited, e.g., the described methods may be performed in an order different from that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
Claims (9)
1. A hand washing monitoring method is applied to wearable equipment and is characterized by comprising the following steps:
under the condition that the user is determined to be in a hand washing state, determining hand washing cleaning intensity through a target sensor arranged on the wearable device; wherein the target sensor includes: an acceleration sensor, a gyroscope, and a microphone;
determining the hand washing cleaning degree according to the hand washing cleaning intensity and the recorded hand washing cleaning duration;
scoring the hand washing according to the hand washing cleanliness degree, and displaying a scoring result;
the determining the hand washing cleaning intensity through a target sensor arranged on the wearable device comprises:
determining hand washing cleaning intensity of each target cleaning part of the hand through the target sensor; wherein the target cleaning site comprises: at least one of a palm, a back of a hand, a finger, and a wrist;
wherein, according to the clean degree of washing hand, score this washing hand to show the result of grading, include:
displaying the total score of hand washing and the washing result of each target cleaning part in real time; the cleaning result is used for indicating whether the hand washing cleaning degree of the target cleaning part reaches a preset cleaning degree, and the preset cleaning degree is adjusted according to the time interval between the current hand washing and the last hand washing.
2. The hand washing monitoring method of claim 1, wherein determining, by the target sensor, hand washing intensity for each target cleaning location on the hand comprises:
respectively acquiring parameter values of target parameters when each target cleaning part is cleaned through the target sensors; wherein the target parameters include: at least one of water flow, hand-made sound, hand washing action amplitude and hand washing action speed; the water flow and the sound emitted by the hands are obtained by a microphone in the target sensor, and the hand washing action amplitude and the hand washing action speed are obtained by a gyroscope and an acceleration sensor in the target sensor;
and determining the hand washing cleaning strength of the corresponding target cleaning part according to the parameter value of the target parameter.
3. The hand washing monitoring method of claim 2, wherein determining the hand washing cleaning intensity of the corresponding target cleaning portion according to the parameter value of the target parameter comprises:
determining the target cleaning intensity corresponding to the obtained parameter value of each target parameter according to the preset corresponding relation between the parameter value of each target parameter and the cleaning intensity;
and multiplying each target cleaning intensity by the corresponding weight value to determine the hand washing cleaning intensity of the corresponding target cleaning part.
4. The hand washing monitoring method of claim 1, wherein determining a hand washing cleanliness measure based on the hand washing cleanliness intensities and recorded hand washing cleanliness durations comprises:
determining the hand washing cleaning degree of the corresponding target cleaning part according to the hand washing cleaning strength of each target cleaning part and the recorded hand washing cleaning duration of each target cleaning part;
the scoring of the hand washing according to the hand washing cleaning degree and the display of the scoring result comprise:
respectively scoring the cleaning of each target cleaning part according to the hand washing cleaning degree of each target cleaning part;
and multiplying the score of each target cleaning part by the sum of the corresponding weight values respectively to determine the total score obtained by the hand washing, and displaying the total score.
5. A hand washing monitoring device applied to wearable equipment is characterized by comprising:
the first determination module is used for determining hand washing cleaning intensity through a target sensor arranged on the wearable device under the condition that the user is determined to be in a hand washing state; wherein the target sensor includes: an acceleration sensor, a gyroscope, and a microphone;
the second determining module is used for determining the hand washing cleaning degree according to the hand washing cleaning intensity and the recorded hand washing cleaning duration;
the grading module is used for grading the hand washing according to the hand washing cleanliness degree and displaying a grading result;
the first determining module includes:
the first determining submodule is used for determining hand washing cleaning intensity of each target cleaning part of the hand through the target sensor; wherein the target cleaning site comprises: at least one of a palm, a back of a hand, a finger, and a wrist;
the hand washing monitoring device further comprises:
the display module is used for displaying the total score of hand washing and the washing result of each target cleaning part in real time; the cleaning result is used for indicating whether the hand washing cleaning degree of the target cleaning part reaches a preset cleaning degree, and the preset cleaning degree is adjusted according to the time interval between the current hand washing and the last hand washing.
6. A hand washing monitoring apparatus according to claim 5 and wherein said first determination submodule comprises:
the acquisition unit is used for respectively acquiring the parameter value of a target parameter when each target cleaning part is cleaned through the target sensor; wherein the target parameters include: at least one of water flow, hand-made sound, hand washing action amplitude and hand washing action speed; the water flow and the sound emitted by the hands are obtained by a microphone in the target sensor, and the hand washing action amplitude and the hand washing action speed are obtained by a gyroscope and an acceleration sensor in the target sensor;
and the determining unit is used for determining the hand washing cleaning strength of the corresponding target cleaning part according to the parameter value of the target parameter.
7. A hand washing monitoring apparatus according to claim 6, wherein the determination unit comprises:
the first determining subunit is used for determining the target cleaning intensity corresponding to the obtained parameter value of each target parameter according to the preset corresponding relation between the parameter value of each target parameter and the cleaning intensity;
and the second determining subunit is used for determining the sum of each target cleaning intensity multiplied by the corresponding first preset weight value as the hand washing cleaning intensity of the corresponding target cleaning part.
8. A hand washing monitoring apparatus according to claim 5 and wherein said second determination module comprises:
the second determining submodule is used for determining the hand washing cleaning degree of the corresponding target cleaning part according to the hand washing cleaning intensity of each target cleaning part and the recorded hand washing cleaning duration of each target cleaning part;
the scoring module comprises:
the first scoring submodule is used for scoring the cleaning of each target cleaning part according to the hand washing cleaning degree of each target cleaning part;
and the second grading submodule is used for respectively multiplying the grade of each target cleaning part by the sum of the corresponding second preset weight value, determining the total grade obtained by the hand washing, and displaying the total grade.
9. An electronic device, comprising: a processor, a memory, and a program or instructions stored on and executable on the processor, the program or instructions, when executed by the processor, performing the steps in the hand washing monitoring method of any of claims 1-4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011149167.6A CN112233395B (en) | 2020-10-23 | 2020-10-23 | Hand washing monitoring method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202011149167.6A CN112233395B (en) | 2020-10-23 | 2020-10-23 | Hand washing monitoring method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN112233395A CN112233395A (en) | 2021-01-15 |
| CN112233395B true CN112233395B (en) | 2022-08-26 |
Family
ID=74110378
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202011149167.6A Active CN112233395B (en) | 2020-10-23 | 2020-10-23 | Hand washing monitoring method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN112233395B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114399698B (en) * | 2021-11-30 | 2024-04-02 | 西安交通大学 | Hand washing quality scoring method and system based on intelligent watch |
| CN114973353A (en) * | 2022-04-15 | 2022-08-30 | 合肥昊川信息科技有限公司 | Intelligent hand washing evaluation method and system, storage medium and electronic equipment |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001292918A (en) * | 2000-04-17 | 2001-10-23 | Hattori Kogyo Kk | Hand-washing equipment, hand-washing room, hand- washing control program medium, method of hand- washing verification service, hand-washing control display and hand-washing analysis result display |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8294584B2 (en) * | 2004-10-12 | 2012-10-23 | Plost Gerald N | System, method and implementation for increasing a likelihood of improved hand hygiene in a desirably sanitary environment |
| US20100073162A1 (en) * | 2008-09-05 | 2010-03-25 | Michael David Johnson | Hand washing reminder device and method |
| GB2521844A (en) * | 2014-01-03 | 2015-07-08 | Fluke Corp | A method and system for monitoring hand washing |
| US10410507B2 (en) * | 2015-04-13 | 2019-09-10 | Konrad David Pi | Method and system for hand washing compliance |
| US9721452B2 (en) * | 2015-04-24 | 2017-08-01 | WashSense, Inc. | Hand-wash management and compliance system |
| WO2018187557A1 (en) * | 2017-04-05 | 2018-10-11 | Microsensor Labs, LLC | System and method for proximity sensing of movable portions of a premises |
| US10679488B2 (en) * | 2017-04-05 | 2020-06-09 | Microsensor Labs, LLC | System and method for improving compliance with one or more protocols including hand hygiene and personal protective equipment protocols |
| CN108062164A (en) * | 2018-01-15 | 2018-05-22 | 杭州易同全科技有限公司 | For the intelligent terminal of hand hygiene compliance supervision |
| CN109102870A (en) * | 2018-08-22 | 2018-12-28 | 中国人民解放军第八五医院 | A kind of hand hygiene execution system |
| CN110289085B (en) * | 2019-05-31 | 2023-04-07 | 杭州小创科技有限公司 | Hand hygiene monitoring system and use method thereof |
| CN110263689A (en) * | 2019-06-11 | 2019-09-20 | 深圳市第三人民医院 | One kind is washed one's hands monitoring method and its system, hand washing device |
-
2020
- 2020-10-23 CN CN202011149167.6A patent/CN112233395B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2001292918A (en) * | 2000-04-17 | 2001-10-23 | Hattori Kogyo Kk | Hand-washing equipment, hand-washing room, hand- washing control program medium, method of hand- washing verification service, hand-washing control display and hand-washing analysis result display |
Also Published As
| Publication number | Publication date |
|---|---|
| CN112233395A (en) | 2021-01-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN112233395B (en) | Hand washing monitoring method and device | |
| CN105278681B (en) | Gestures detection is lifted in equipment | |
| CN105468247B (en) | Working mode switching method and mobile terminal | |
| CN103970277A (en) | Method and device for healthy reading monitoring based on handheld electronic device | |
| CN103425443A (en) | Control method, control system and electronic equipment | |
| CN109543574A (en) | Fingerprint collecting method and relevant device | |
| CN107864401A (en) | It is a kind of based on live monitoring method, device, system and terminal device | |
| CN111695542A (en) | Video monitoring fine-grained analysis method and system | |
| US20230160922A1 (en) | Methods and apparatus for detecting individual health related events | |
| CN112947838B (en) | Control method and device and electronic equipment | |
| WO2022156213A1 (en) | Gesture-based display interface control method and apparatus, device and storage medium | |
| CN108681498A (en) | A kind of monitoring method of CPU usage, device and mobile terminal | |
| CN107885635A (en) | Blank screen detection method, mobile terminal and computer-readable recording medium | |
| CN108345474A (en) | Startup method, starter and the mobile terminal of application program | |
| KR20190108139A (en) | Treadmill Step Counting Method and Apparatus | |
| CN108958593A (en) | A kind of method and mobile terminal of determining communication object | |
| CN108052985A (en) | Information collecting method, information acquisition terminal and computer readable storage medium | |
| CN113282261A (en) | Intelligent display method, device, computer program product and storage medium | |
| CN116687394B (en) | Tumble detection method, device, equipment and storage medium based on millimeter wave radar | |
| CN108540649A (en) | A kind of content displaying method and mobile terminal | |
| CN105975078B (en) | Gesture identification method and device for wearable device | |
| US8694445B1 (en) | Triggering attract mode for devices using viewability conditions and detected proximity of human to device | |
| JP2007114885A (en) | Classification method and device by similarity of image | |
| CN108200635A (en) | The progress control method and mobile terminal of a kind of application program | |
| CN112580543B (en) | Behavior recognition method, system and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |