CN113040757A - Head posture monitoring method and device, head intelligent wearable device and storage medium - Google Patents
Head posture monitoring method and device, head intelligent wearable device and storage medium Download PDFInfo
- Publication number
- CN113040757A CN113040757A CN202110229355.8A CN202110229355A CN113040757A CN 113040757 A CN113040757 A CN 113040757A CN 202110229355 A CN202110229355 A CN 202110229355A CN 113040757 A CN113040757 A CN 113040757A
- Authority
- CN
- China
- Prior art keywords
- head
- duration
- angle
- weight
- user
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1118—Determining activity level
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1116—Determining posture transitions
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
- A61B5/1121—Determining geometric values, e.g. centre of rotation or angular range of movement
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/68—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient
- A61B5/6801—Arrangements of detecting, measuring or recording means, e.g. sensors, in relation to patient specially adapted to be attached to or worn on the body surface
- A61B5/6802—Sensor mounted on worn items
- A61B5/6803—Head-worn items, e.g. helmets, masks, headphones or goggles
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/7405—Details of notification to user or communication with user or patient ; user input means using sound
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/74—Details of notification to user or communication with user or patient ; user input means
- A61B5/746—Alarms related to a physiological condition, e.g. details of setting alarm thresholds or avoiding false alarms
Abstract
The invention discloses a head posture monitoring method, a head posture monitoring device, head intelligent wearing equipment and a storage medium, wherein the method comprises the following steps: when detecting that the head intelligent wearing equipment worn on the head of a user moves, acquiring offset data of the head of the user once and recording duration, wherein the offset data comprises a roll angle, a pitch angle and a yaw angle; judging whether the accumulated collection times reach set times or not; if yes, calculating the sum of the weight value of each duration and the weight values of all the durations; judging whether the sum of the weighted values of all the duration is greater than a set threshold value; if so, determining that the head of the user is in a deviation state to be reminded; and respectively calculating the weighted values of the roll angle, the pitch angle and the yaw angle to determine the offset type of the head of the user and remind the user. According to the invention, the head deviation data of people is collected through the head intelligent wearing equipment worn on the head, so that people can be reminded to adjust the head posture when the head is in an incorrect posture, and a good brain using habit is developed for people.
Description
Technical Field
The invention relates to the technical field of head posture monitoring, in particular to a head posture monitoring method and device, head intelligent wearing equipment and a storage medium.
Background
With the development of electronic technology, the functions of electronic products (such as mobile phones and tablet computers) are becoming more powerful, and the attractions of these electronic products to people are very large, so that people who are low head and focus on the screen of the mobile phone are on the road, on the car and everywhere indoors, which is called "low head family".
The most direct harm of long-term head lowering is that the cervical vertebra bears huge pressure, so that the blood circulation of the cervical canal can be blocked, the muscle stiffness and spasm of the neck and the shoulder can be easily caused, and the problems of cervical spondylosis such as cervical curvature straightening, cervical disc protrusion and the like can be caused after a long time.
In view of the above problems, there are corresponding monitoring devices in the prior art, but these monitoring devices generally need to be placed on a desktop or built in an electronic product such as a mobile phone, and not only the monitoring results are not ideal, but also the use is inconvenient, and the technology is not mature enough, so that it is necessary to research a technology that can accurately and effectively monitor the head posture to protect the health of the cervical vertebra, and the use is convenient.
The above information is given as background information only to aid in understanding the present disclosure, and no determination or admission is made as to whether any of the above is available as prior art against the present disclosure.
Disclosure of Invention
The invention provides a head posture monitoring method and device, head intelligent wearing equipment and a storage medium, and aims to overcome the defects in the prior art.
In order to achieve the above purpose, the present invention provides the following technical solutions:
in a first aspect, an embodiment of the present invention provides a head posture monitoring method, where the method includes:
every time when detecting that head intelligent wearing equipment worn on the head of a user moves, acquiring offset data of the head of the user once and recording duration, wherein the offset data comprises a roll angle, a pitch angle and a yaw angle;
judging whether the accumulated collection times reach set times or not;
if yes, calculating the sum of the weight value of each duration and the weight values of all the durations;
judging whether the sum of the weighted values of all the duration is greater than a set threshold value;
if so, determining that the head of the user is in a deviation state to be reminded;
and respectively calculating the weighted values of the roll angle, the pitch angle and the yaw angle to determine the offset type of the head of the user and send a prompt to the user.
As an optional implementation, in the head posture monitoring method, the step of calculating the weight value of each duration and the sum of the weight values of all the durations includes:
the weight value for each duration is calculated according to the following formula:
Wtn＝Wr*Drn*Tn+Wp*Dpn*Tn+Wy*Dyn*Tn；
wherein Wtn is a weighted value of the nth duration, Wr is a weight of the influence of the set yaw on the head, Wp is a weight of the influence of the set nod on the head, Wy is a weight of the influence of the set turn on the head, Drn is a roll angle of the nth duration, Dpn is a pitch angle of the nth duration, Dyn is a yaw angle of the nth duration, tn is the nth duration, and n is a positive integer;
the sum of the weight values for all durations is calculated according to the following formula:
WT＝Wt1+Wt2+……Wtn；
where WT is the sum of the weight values for all durations.
As an optional implementation manner, in the head posture monitoring method, the step of calculating the weighted values of the roll angle, the pitch angle and the yaw angle respectively to determine the offset type of the head of the user, and sending a prompt to the user includes:
respectively calculating the weighted values of the roll angle, the pitch angle and the yaw angle;
and determining the corresponding offset type with the largest weight value among the roll angle, the pitch angle and the yaw angle as the offset type of the head of the user, and sending a prompt to the user.
As an optional implementation manner, in the head posture monitoring method, the step of calculating the weighted values of the roll angle, the pitch angle, and the yaw angle respectively includes:
calculating a weight value of the roll angle according to the following formula:
Wdr＝Wr*(Dr1*t1+Dr2*t2+……Drn*tn)；
wherein, Wdr is the weight value of the roll angle, Wr is the weight of the influence of the set head deviation on the head, Drn is the roll angle of the nth duration, tn is the nth duration, and n is a positive integer;
calculating a weight value of the pitch angle according to the following formula:
Wdp＝Wp*(Dp1*t1+Dp2*t2+……Dpn*tn)；
wherein, Wdp is the weight value of the pitch angle, Wp is the weight of the influence of the set nod on the head, Dpn is the pitch angle of the nth duration, tn is the nth duration, and n is a positive integer;
calculating the weight value of the yaw angle according to the following formula:
Wdy＝Wy*(Dy1*t1+Dy2*t2+……Dyn*tn)；
wdy is a weight value of the yaw angle, y is a weight of the influence of the set turning head on the head, Dyn is the yaw angle of the nth duration, tn is the nth duration, and n is a positive integer.
In a second aspect, an embodiment of the present invention provides a head posture monitoring device, including:
the data acquisition module is used for acquiring offset data of the head of the user and recording the duration when the head intelligent wearing equipment worn on the head of the user is detected to move, wherein the offset data comprises a roll angle, a pitch angle and a yaw angle;
the frequency judging module is used for judging whether the accumulated acquisition frequency reaches a set frequency or not;
the weight value calculation module is used for calculating the weight value of each duration and the sum of the weight values of all the durations if the acquisition times reach the set times;
the threshold judging module is used for judging whether the sum of the weighted values of all the duration is greater than a set threshold;
the state determining module is used for determining that the head of the user is in an offset state to be reminded if the sum of the weighted values of all the duration is greater than a set threshold;
and the offset reminding module is used for respectively calculating the weighted values of the roll angle, the pitch angle and the yaw angle so as to determine the offset type of the head of the user and send a reminder to the user.
As an optional implementation manner, in the head posture monitoring apparatus, the weight value calculating module is specifically configured to:
the weight value for each duration is calculated according to the following formula:
Wtn＝Wr*Drn*Tn+Wp*Dpn*Tn+Wy*Dyn*Tn；
wherein Wtn is a weighted value of the nth duration, Wr is a weight of the influence of the set yaw on the head, Wp is a weight of the influence of the set nod on the head, Wy is a weight of the influence of the set turn on the head, Drn is a roll angle of the nth duration, Dpn is a pitch angle of the nth duration, Dyn is a yaw angle of the nth duration, tn is the nth duration, and n is a positive integer;
the sum of the weight values for all durations is calculated according to the following formula:
WT＝Wt1+Wt2+……Wtn；
where WT is the sum of the weight values for all durations.
As an optional implementation manner, in the head posture monitoring apparatus, the offset reminding module includes:
the weighted value calculating unit is used for calculating weighted values of the roll angle, the pitch angle and the yaw angle respectively;
and the offset reminding unit is used for determining the offset type corresponding to the maximum weighted value in the roll angle, the pitch angle and the yaw angle as the offset type of the head of the user and sending a reminding to the user.
As an optional implementation manner, in the head posture monitoring apparatus, the weight value calculating unit is specifically configured to:
calculating a weight value of the roll angle according to the following formula:
Wdr＝Wr*(Dr1*t1+Dr2*t2+……Drn*tn)；
wherein, Wdr is the weight value of the roll angle, Wr is the weight of the influence of the set head deviation on the head, Drn is the roll angle of the nth duration, tn is the nth duration, and n is a positive integer;
calculating a weight value of the pitch angle according to the following formula:
Wdp＝Wp*(Dp1*t1+Dp2*t2+……Dpn*tn)；
wherein, Wdp is the weight value of the pitch angle, Wp is the weight of the influence of the set nod on the head, Dpn is the pitch angle of the nth duration, tn is the nth duration, and n is a positive integer;
calculating the weight value of the yaw angle according to the following formula:
Wdy＝Wy*(Dy1*t1+Dy2*t2+……Dyn*tn)；
wdy is a weight value of the yaw angle, y is a weight of the influence of the set turning head on the head, Dyn is the yaw angle of the nth duration, tn is the nth duration, and n is a positive integer.
In a third aspect, an embodiment of the present invention provides a head intelligent wearable device, including a memory and a processor, where the memory stores a computer program, and the processor implements the head posture monitoring method according to any one of the above aspects when executing the computer program.
In a fourth aspect, embodiments of the present invention provide a storage medium containing computer-executable instructions for execution by a computer processor to implement a head pose monitoring method as described in any one of the above aspects.
Compared with the prior art, the embodiment of the invention has the following beneficial effects:
according to the head posture monitoring method and device, the head intelligent wearing equipment and the storage medium, the head deviation data of people are collected through the head intelligent wearing equipment worn on the head, people can be accurately and conveniently reminded of adjusting the head posture when the head is in an incorrect posture, good brain using habits of people can be developed, cervical spondylosis can be prevented, and the head posture monitoring method and device have high popularization and application values.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without inventive exercise.
Fig. 1 is a schematic flow chart of a head posture monitoring method according to an embodiment of the present invention;
fig. 2 is a functional block diagram of a head posture monitoring device according to a second embodiment of the present invention;
fig. 3 is a schematic structural diagram of a head intelligent wearing device according to a third embodiment of the present invention.
Detailed Description
In order to make the objects, features and advantages of the present invention more obvious and understandable, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is apparent that the embodiments described below are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
In the description of the present invention, it is to be understood that when an element is referred to as being "connected" to another element, it can be directly connected to the other element or intervening elements may also be present. When a component is referred to as being "disposed on" another component, it can be directly on the other component or intervening components may also be present.
Furthermore, the terms "long", "short", "inner", "outer", and the like indicate orientations or positional relationships based on those shown in the drawings, and are only for convenience of describing the present invention, but do not indicate or imply that the referred devices or elements must have the specific orientations, be configured to operate in the specific orientations, and thus are not to be construed as limitations of the present invention.
The technical scheme of the invention is further explained by the specific implementation mode in combination with the attached drawings.
Example one
In view of the defects of the prior art, the inventor of the invention actively researches and innovates based on the practical experience and professional knowledge which are abundant for years when the product is designed and manufactured, and cooperates with the application of the theory, so as to create a feasible head posture monitoring technology, thereby leading the head posture monitoring technology to have higher practicability. After continuous research, design and repeated trial and improvement, the invention with practical value is finally created.
Referring to fig. 1, fig. 1 is a schematic flow chart of a head posture monitoring method, which is applicable to any scene of daily life of people and is implemented by a head posture monitoring device, which can be implemented by software and/or hardware and integrated inside a head intelligent wearable device according to an embodiment of the present invention. As shown in fig. 1, the head posture monitoring method may include the steps of:
s101, collecting offset data of the head of a user once and recording duration time when detecting that head intelligent wearable equipment worn on the head of the user moves, wherein the offset data comprises a roll angle, a pitch angle and a yaw angle.
S102, judging whether the accumulated collection times reach set times or not; if so, step S103 is executed, otherwise, the process returns to step S101.
And S103, calculating the weight value of each duration and the sum of the weight values of all the durations.
Preferably, the step S103 may further include:
(1) the weight value for each duration is calculated according to the following formula:
Wtn＝Wr*Drn*Tn+Wp*Dpn*Tn+Wy*Dyn*Tn；
wherein Wtn is a weighted value of the nth duration, Wr is a weight of the influence of the set yaw on the head, Wp is a weight of the influence of the set nod on the head, Wy is a weight of the influence of the set turn on the head, Drn is a roll angle of the nth duration, Dpn is a pitch angle of the nth duration, Dyn is a yaw angle of the nth duration, tn is the nth duration, and n is a positive integer;
(2) the sum of the weight values for all durations is calculated according to the following formula:
WT＝Wt1+Wt2+……Wtn；
where WT is the sum of the weight values for all durations.
S104, judging whether the sum of the weight values of all the duration is greater than a set threshold value or not; if so, step S105 is executed, otherwise, step S101 is returned to.
And S105, determining that the head of the user is in the offset state to be reminded.
And S106, respectively calculating the weighted values of the roll angle, the pitch angle and the yaw angle to determine the offset type of the head of the user and sending a prompt to the user.
Preferably, the step S106 may further include:
(1) respectively calculating the weighted values of the roll angle, the pitch angle and the yaw angle;
preferably, the above steps may further include:
(1.1) calculating a weight value of the roll angle according to the following formula:
Wdr＝Wr*(Dr1*t1+Dr2*t2+……Drn*tn)；
wherein, Wdr is the weight value of the roll angle, Wr is the weight of the influence of the set head deviation on the head, Drn is the roll angle of the nth duration, tn is the nth duration, and n is a positive integer;
(1.2) calculating a weight value of the pitch angle according to the following formula:
Wdp＝Wp*(Dp1*t1+Dp2*t2+……Dpn*tn)；
wherein, Wdp is the weight value of the pitch angle, Wp is the weight of the influence of the set nod on the head, Dpn is the pitch angle of the nth duration, tn is the nth duration, and n is a positive integer;
(1.3) calculating the weight value of the yaw angle according to the following formula:
Wdy＝Wy*(Dy1*t1+Dy2*t2+……Dyn*tn)；
wdy is a weight value of the yaw angle, y is a weight of the influence of the set turning head on the head, Dyn is the yaw angle of the nth duration, tn is the nth duration, and n is a positive integer.
(2) And determining the corresponding offset type with the largest weight value among the roll angle, the pitch angle and the yaw angle as the offset type of the head of the user, and sending a prompt to the user.
It should be noted that the offset types corresponding to the roll angle, the pitch angle, and the yaw angle are yaw, nodding, and turning, respectively. The reminding mode supports various voice utterances such as boys, girls, children and the like, and voices can be customized through a network.
According to the head posture monitoring method provided by the embodiment of the invention, the head deviation data of people is collected through the head intelligent wearing equipment worn on the head, so that people can be accurately and conveniently reminded to adjust the head posture when the head is in an incorrect posture, good brain using habits of people can be developed, cervical spondylosis can be prevented, and the head posture monitoring method has high popularization and application values.
Example two
Referring to fig. 2, a functional module diagram of a head posture monitoring device according to a second embodiment of the present invention is shown, where the device is suitable for executing the head posture monitoring method according to the second embodiment of the present invention. The device specifically comprises the following modules:
the data acquisition module 201 is configured to acquire offset data of the head of the user once and record duration when detecting that the head intelligent wearable device worn on the head of the user moves, where the offset data includes a roll angle, a pitch angle, and a yaw angle;
a frequency judging module 202, configured to judge whether the accumulated acquisition frequency reaches a set frequency;
the weight value calculation module 203 is configured to calculate a weight value of each duration and a sum of weight values of all durations if the collection times reach a set number;
a threshold judgment module 204, configured to judge whether a sum of the weight values of all the durations is greater than a set threshold;
the state determining module 205 is configured to determine that the head of the user is in an offset to-be-reminded state if the sum of the weight values of all the durations is greater than a set threshold;
and the offset reminding module 206 is configured to calculate weighted values of the roll angle, the pitch angle and the yaw angle respectively to determine an offset type of the head of the user, and send a reminder to the user.
Preferably, the weight value calculating module 203 is specifically configured to:
the weight value for each duration is calculated according to the following formula:
Wtn＝Wr*Drn*Tn+Wp*Dpn*Tn+Wy*Dyn*Tn；
wherein Wtn is a weighted value of the nth duration, Wr is a weight of the influence of the set yaw on the head, Wp is a weight of the influence of the set nod on the head, Wy is a weight of the influence of the set turn on the head, Drn is a roll angle of the nth duration, Dpn is a pitch angle of the nth duration, Dyn is a yaw angle of the nth duration, tn is the nth duration, and n is a positive integer;
the sum of the weight values for all durations is calculated according to the following formula:
WT＝Wt1+Wt2+……Wtn；
where WT is the sum of the weight values for all durations.
Preferably, the offset reminding module 206 includes:
the weighted value calculating unit is used for calculating weighted values of the roll angle, the pitch angle and the yaw angle respectively;
and the offset reminding unit is used for determining the offset type corresponding to the maximum weighted value in the roll angle, the pitch angle and the yaw angle as the offset type of the head of the user and sending a reminding to the user.
Preferably, the weight value calculating unit is specifically configured to:
calculating a weight value of the roll angle according to the following formula:
Wdr＝Wr*(Dr1*t1+Dr2*t2+……Drn*tn)；
wherein, Wdr is the weight value of the roll angle, Wr is the weight of the influence of the set head deviation on the head, Drn is the roll angle of the nth duration, tn is the nth duration, and n is a positive integer;
calculating a weight value of the pitch angle according to the following formula:
Wdp＝Wp*(Dp1*t1+Dp2*t2+……Dpn*tn)；
wherein, Wdp is the weight value of the pitch angle, Wp is the weight of the influence of the set nod on the head, Dpn is the pitch angle of the nth duration, tn is the nth duration, and n is a positive integer;
calculating the weight value of the yaw angle according to the following formula:
Wdy＝Wy*(Dy1*t1+Dy2*t2+……Dyn*tn)；
wdy is a weight value of the yaw angle, y is a weight of the influence of the set turning head on the head, Dyn is the yaw angle of the nth duration, tn is the nth duration, and n is a positive integer.
According to the head posture monitoring device provided by the embodiment of the invention, the head deviation data of people is collected through the head intelligent wearing equipment worn on the head, so that people can be accurately and conveniently reminded to adjust the head posture when the head is in an incorrect posture, good brain using habits of people can be developed, cervical spondylosis can be prevented, and the head posture monitoring device has high popularization and application values.
EXAMPLE III
Fig. 3 is a schematic structural diagram of a head intelligent wearable device according to a third embodiment of the present invention. Fig. 3 illustrates a block diagram of an exemplary head-worn smart device 12 suitable for use in implementing embodiments of the present invention. The head-mounted intelligent wearing device 12 shown in fig. 3 is only an example, and should not bring any limitation to the functions and the use range of the embodiment of the present invention.
As shown in fig. 3, head-mounted smart wearable device 12 is in the form of a general purpose computing device. The components of head-worn device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that couples various system components including the system memory 28 and the processing unit 16.
Head-worn device 12 typically includes a variety of computer system readable media. These media may be any available media that can be accessed by head-intelligent wearable device 12 and include both volatile and nonvolatile media, removable and non-removable media.
The system memory 28 may include computer system readable media in the form of volatile memory, such as Random Access Memory (RAM)30 and/or cache memory 32. Head-intelligent-wear device 12 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. By way of example only, storage system 34 may be used to read from and write to non-removable, nonvolatile magnetic media (not shown in FIG. 3, and commonly referred to as a "hard drive"). Although not shown in FIG. 3, a magnetic disk drive for reading from and writing to a removable, nonvolatile magnetic disk (e.g., a "floppy disk") and an optical disk drive for reading from or writing to a removable, nonvolatile optical disk (e.g., a CD-ROM, DVD-ROM, or other optical media) may be provided. In these cases, each drive may be connected to bus 18 by one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules that are configured to carry out the functions of embodiments of the invention.
A program/utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28, such program modules 42 including, but not limited to, an operating system, one or more application programs, other program modules, and program data, each of which examples or some combination thereof may comprise an implementation of a network environment. Program modules 42 generally carry out the functions and/or methodologies of the described embodiments of the invention.
Head intelligent-worn device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), with one or more devices that enable a user to interact with head intelligent-worn device 12, and/or with any devices (e.g., network card, modem, etc.) that enable head intelligent-worn device 12 to communicate with one or more other computing devices. Such communication may be through an input/output (I/O) interface 22. Also, head-worn device 12 may also communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network, such as the internet) through network adapter 20. As shown, network adapter 20 communicates with the other modules of head-intelligent wearable device 12 via bus 18. It should be understood that although not shown in fig. 3, other hardware and/or software modules may be used in conjunction with head-worn device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
The processing unit 16 executes various functional applications and data processing, such as implementing a head posture monitoring method provided by an embodiment of the present invention, by running a program stored in the system memory 28.
That is, the processing unit implements, when executing the program: every time when detecting that head intelligent wearing equipment worn on the head of a user moves, acquiring offset data of the head of the user once and recording duration, wherein the offset data comprises a roll angle, a pitch angle and a yaw angle; judging whether the accumulated collection times reach set times or not; if yes, calculating the sum of the weight value of each duration and the weight values of all the durations; judging whether the sum of the weighted values of all the duration is greater than a set threshold value; if so, determining that the head of the user is in a deviation state to be reminded; and respectively calculating the weighted values of the roll angle, the pitch angle and the yaw angle to determine the offset type of the head of the user and send a prompt to the user.
Example four
A fourth embodiment of the present invention provides a computer-readable storage medium, on which computer-executable instructions are stored, where the instructions, when executed by a processor, implement the head pose monitoring method provided in all the inventive embodiments of the present application:
that is, the processor, when executing the computer-executable instructions, implements: every time when detecting that head intelligent wearing equipment worn on the head of a user moves, acquiring offset data of the head of the user once and recording duration, wherein the offset data comprises a roll angle, a pitch angle and a yaw angle; judging whether the accumulated collection times reach set times or not; if yes, calculating the sum of the weight value of each duration and the weight values of all the durations; judging whether the sum of the weighted values of all the duration is greater than a set threshold value; if so, determining that the head of the user is in a deviation state to be reminded; and respectively calculating the weighted values of the roll angle, the pitch angle and the yaw angle to determine the offset type of the head of the user and send a prompt to the user.
Any combination of one or more computer-readable media may be employed. The computer readable medium may be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium would include the following: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device.
A computer readable signal medium may include a propagated data signal with computer readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device.
Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wireline, optical fiber cable, RF, etc., or any suitable combination of the foregoing.
Computer program code for carrying out operations for aspects of the present invention may be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C + + or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet service provider).
It is to be noted that the foregoing is only illustrative of the preferred embodiments of the present invention and the technical principles employed. It will be understood by those skilled in the art that the present invention is not limited to the particular embodiments described herein, but is capable of various obvious changes, rearrangements and substitutions as will now become apparent to those skilled in the art without departing from the scope of the invention. Therefore, although the present invention has been described in greater detail by the above embodiments, the present invention is not limited to the above embodiments, and may include other equivalent embodiments without departing from the spirit of the present invention, and the scope of the present invention is determined by the scope of the appended claims.
Claims (10)
1. A head pose monitoring method, the method comprising:
every time when detecting that head intelligent wearing equipment worn on the head of a user moves, acquiring offset data of the head of the user once and recording duration, wherein the offset data comprises a roll angle, a pitch angle and a yaw angle;
judging whether the accumulated collection times reach set times or not;
if yes, calculating the sum of the weight value of each duration and the weight values of all the durations;
judging whether the sum of the weighted values of all the duration is greater than a set threshold value;
if so, determining that the head of the user is in a deviation state to be reminded;
and respectively calculating the weighted values of the roll angle, the pitch angle and the yaw angle to determine the offset type of the head of the user and send a prompt to the user.
2. The head pose monitoring method of claim 1, wherein the step of calculating the sum of the weight value for each duration and the weight values for all durations comprises:
the weight value for each duration is calculated according to the following formula:
Wtn＝Wr*Drn*Tn+Wp*Dpn*Tn+Wy*Dyn*Tn；
wherein Wtn is a weighted value of the nth duration, Wr is a weight of the influence of the set yaw on the head, Wp is a weight of the influence of the set nod on the head, Wy is a weight of the influence of the set turn on the head, Drn is a roll angle of the nth duration, Dpn is a pitch angle of the nth duration, Dyn is a yaw angle of the nth duration, tn is the nth duration, and n is a positive integer;
the sum of the weight values for all durations is calculated according to the following formula:
WT＝Wt1+Wt2+……Wtn；
where WT is the sum of the weight values for all durations.
3. The method for monitoring head posture according to claim 1, wherein the step of calculating the weighted values of the roll angle, the pitch angle and the yaw angle respectively to determine the offset type of the head of the user and sending a prompt to the user comprises:
respectively calculating the weighted values of the roll angle, the pitch angle and the yaw angle;
and determining the corresponding offset type with the largest weight value among the roll angle, the pitch angle and the yaw angle as the offset type of the head of the user, and sending a prompt to the user.
4. The head posture monitoring method according to claim 3, wherein the step of calculating the weighted values of the roll angle, the pitch angle, and the yaw angle, respectively, comprises:
calculating a weight value of the roll angle according to the following formula:
Wdr＝Wr*(Dr1*t1+Dr2*t2+……Drn*tn)；
wherein, Wdr is the weight value of the roll angle, Wr is the weight of the influence of the set head deviation on the head, Drn is the roll angle of the nth duration, tn is the nth duration, and n is a positive integer;
calculating a weight value of the pitch angle according to the following formula:
Wdp＝Wp*(Dp1*t1+Dp2*t2+……Dpn*tn)；
wherein, Wdp is the weight value of the pitch angle, Wp is the weight of the influence of the set nod on the head, Dpn is the pitch angle of the nth duration, tn is the nth duration, and n is a positive integer;
calculating the weight value of the yaw angle according to the following formula:
Wdy＝Wy*(Dy1*t1+Dy2*t2+……Dyn*tn)；
wdy is a weight value of the yaw angle, y is a weight of the influence of the set turning head on the head, Dyn is the yaw angle of the nth duration, tn is the nth duration, and n is a positive integer.
5. A head pose monitoring device, the device comprising:
the data acquisition module is used for acquiring offset data of the head of the user and recording the duration when the head intelligent wearing equipment worn on the head of the user is detected to move, wherein the offset data comprises a roll angle, a pitch angle and a yaw angle;
the frequency judging module is used for judging whether the accumulated acquisition frequency reaches a set frequency or not;
the weight value calculation module is used for calculating the weight value of each duration and the sum of the weight values of all the durations if the acquisition times reach the set times;
the threshold judging module is used for judging whether the sum of the weighted values of all the duration is greater than a set threshold;
the state determining module is used for determining that the head of the user is in an offset state to be reminded if the sum of the weighted values of all the duration is greater than a set threshold;
and the offset reminding module is used for respectively calculating the weighted values of the roll angle, the pitch angle and the yaw angle so as to determine the offset type of the head of the user and send a reminder to the user.
6. The head pose monitoring device of claim 5, wherein the weight value calculation module is specifically configured to:
the weight value for each duration is calculated according to the following formula:
Wtn＝Wr*Drn*Tn+Wp*Dpn*Tn+Wy*Dyn*Tn；
wherein Wtn is a weighted value of the nth duration, Wr is a weight of the influence of the set yaw on the head, Wp is a weight of the influence of the set nod on the head, Wy is a weight of the influence of the set turn on the head, Drn is a roll angle of the nth duration, Dpn is a pitch angle of the nth duration, Dyn is a yaw angle of the nth duration, tn is the nth duration, and n is a positive integer;
the sum of the weight values for all durations is calculated according to the following formula:
WT＝Wt1+Wt2+……Wtn；
where WT is the sum of the weight values for all durations.
7. The head pose monitoring device of claim 5, wherein the offset alert module comprises:
the weighted value calculating unit is used for calculating weighted values of the roll angle, the pitch angle and the yaw angle respectively;
and the offset reminding unit is used for determining the offset type corresponding to the maximum weighted value in the roll angle, the pitch angle and the yaw angle as the offset type of the head of the user and sending a reminding to the user.
8. The head pose monitoring device according to claim 7, wherein the weight value calculating unit is specifically configured to:
calculating a weight value of the roll angle according to the following formula:
Wdr＝Wr*(Dr1*t1+Dr2*t2+……Drn*tn)；
wherein, Wdr is the weight value of the roll angle, Wr is the weight of the influence of the set head deviation on the head, Drn is the roll angle of the nth duration, tn is the nth duration, and n is a positive integer;
calculating a weight value of the pitch angle according to the following formula:
Wdp＝Wp*(Dp1*t1+Dp2*t2+……Dpn*tn)；
wherein, Wdp is the weight value of the pitch angle, Wp is the weight of the influence of the set nod on the head, Dpn is the pitch angle of the nth duration, tn is the nth duration, and n is a positive integer;
calculating the weight value of the yaw angle according to the following formula:
Wdy＝Wy*(Dy1*t1+Dy2*t2+……Dyn*tn)；
wdy is a weight value of the yaw angle, y is a weight of the influence of the set turning head on the head, Dyn is the yaw angle of the nth duration, tn is the nth duration, and n is a positive integer.
9. A head intelligent wearing device comprising a memory and a processor, the memory storing a computer program, wherein the processor implements the head posture monitoring method according to any one of claims 1 to 4 when executing the computer program.
10. A storage medium containing computer executable instructions for execution by a computer processor to implement a head pose monitoring method according to any one of claims 1 to 4.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110229355.8A CN113040757B (en) | 2021-03-02 | 2021-03-02 | Head posture monitoring method and device, head intelligent wearable device and storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110229355.8A CN113040757B (en) | 2021-03-02 | 2021-03-02 | Head posture monitoring method and device, head intelligent wearable device and storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113040757A true CN113040757A (en) | 2021-06-29 |
| CN113040757B CN113040757B (en) | 2022-12-20 |
Family
ID=76509477
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110229355.8A Active CN113040757B (en) | 2021-03-02 | 2021-03-02 | Head posture monitoring method and device, head intelligent wearable device and storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN113040757B (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117064375A (en) * | 2023-07-18 | 2023-11-17 | 江西瑞声电子有限公司 | Head posture monitoring method, main control equipment and intelligent wearable equipment |
Citations (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003335433A (en) * | 2002-03-12 | 2003-11-25 | Fuji Photo Film Co Ltd | Image recording device and method of monitoring winding state of recording material |
| US20060217233A1 (en) * | 2005-03-24 | 2006-09-28 | Kyungpook National University Industry-Academic Cooperation Foundation | Apparatus and method for lower-limb rehabilitation training using weight load and joint angle as variables |
| JP2010108257A (en) * | 2008-10-30 | 2010-05-13 | Nippon Telegr & Teleph Corp <Ntt> | Apparatus, method and program for measuring degree of attention of media information and recording medium with the program recorded thereon |
| WO2010084994A1 (en) * | 2009-01-20 | 2010-07-29 | Kabushiki Kaisha Toyota Chuo Kenkyusho | Driver operation prediction device, method, and driver operation prediction program |
| EP2388048A1 (en) * | 2010-05-19 | 2011-11-23 | Francis Chung Hwa Pan | Ball movement path measuring method |
| US20110285186A1 (en) * | 2008-11-18 | 2011-11-24 | Continental Automotive Gmbh | Method for automatically adjusting a seat and use thereof |
| CN105575048A (en) * | 2016-02-25 | 2016-05-11 | 京东方科技集团股份有限公司 | Head lowering and head turning reminding device, control method thereof and helmet |
| CN105962931A (en) * | 2015-03-13 | 2016-09-28 | 胡渐佳 | Learning scene sectional-type recording method and device |
| CN106054908A (en) * | 2016-06-17 | 2016-10-26 | 上海惠盛科技有限公司 | Unmanned aerial vehicle (UAV) attitude adjusting device and method |
| CN106933358A (en) * | 2017-02-28 | 2017-07-07 | 宇龙计算机通信科技(深圳)有限公司 | A kind of cervical vertebra guard method, device and intelligent helmet |
| US20170289144A1 (en) * | 2016-04-04 | 2017-10-05 | Mircea Ionita | Methods and systems for authenticating users |
| CN107493531A (en) * | 2017-08-04 | 2017-12-19 | 歌尔科技有限公司 | A kind of head pose detection method, device and earphone |
| CN108304829A (en) * | 2018-03-08 | 2018-07-20 | 北京旷视科技有限公司 | Face identification method, apparatus and system |
| CN109144271A (en) * | 2018-09-07 | 2019-01-04 | 武汉轻工大学 | Three-dimensional space audio frequency attention-degree analysis method, system, server and storage medium |
| CN208621860U (en) * | 2018-06-21 | 2019-03-19 | 北京阿法龙科技有限公司 | The package assembly of folding type intelligent glasses |
| CN109515356A (en) * | 2018-12-11 | 2019-03-26 | 许建国 | A kind of new-energy automobile safety monitoring system |
| CN109528205A (en) * | 2018-11-15 | 2019-03-29 | 歌尔科技有限公司 | A kind of reminding method, device, helmet and computer readable storage medium |
| WO2019200474A1 (en) * | 2018-04-16 | 2019-10-24 | Technologies Hop-Child, Inc. | Systems and methods for the determination of arousal states, calibrated communication signals and monitoring arousal states |
| CN110619628A (en) * | 2019-09-09 | 2019-12-27 | 博云视觉（北京）科技有限公司 | Human face image quality evaluation method |
| CN111078926A (en) * | 2019-12-19 | 2020-04-28 | 青岛海信电器股份有限公司 | Method for determining portrait thumbnail image and display equipment |
| US20200214589A1 (en) * | 2019-01-07 | 2020-07-09 | Siemens Medical Solutions Usa, Inc. | Tracking head motion for medical imaging |
| CN111464978A (en) * | 2019-01-22 | 2020-07-28 | 岳秀兰 | Vehicle remote driving system established by connection of primary wireless equipment and secondary wireless equipment through Internet of things |
| CN111582086A (en) * | 2020-04-26 | 2020-08-25 | 湖南大学 | Fatigue driving identification method and system based on multiple characteristics |
| CN112087565A (en) * | 2020-09-21 | 2020-12-15 | 江西台德智慧科技有限公司 | Artificial intelligence camera shooting structure |
-
2021
- 2021-03-02 CN CN202110229355.8A patent/CN113040757B/en active Active
Patent Citations (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2003335433A (en) * | 2002-03-12 | 2003-11-25 | Fuji Photo Film Co Ltd | Image recording device and method of monitoring winding state of recording material |
| US20060217233A1 (en) * | 2005-03-24 | 2006-09-28 | Kyungpook National University Industry-Academic Cooperation Foundation | Apparatus and method for lower-limb rehabilitation training using weight load and joint angle as variables |
| JP2010108257A (en) * | 2008-10-30 | 2010-05-13 | Nippon Telegr & Teleph Corp <Ntt> | Apparatus, method and program for measuring degree of attention of media information and recording medium with the program recorded thereon |
| US20110285186A1 (en) * | 2008-11-18 | 2011-11-24 | Continental Automotive Gmbh | Method for automatically adjusting a seat and use thereof |
| WO2010084994A1 (en) * | 2009-01-20 | 2010-07-29 | Kabushiki Kaisha Toyota Chuo Kenkyusho | Driver operation prediction device, method, and driver operation prediction program |
| EP2388048A1 (en) * | 2010-05-19 | 2011-11-23 | Francis Chung Hwa Pan | Ball movement path measuring method |
| CN105962931A (en) * | 2015-03-13 | 2016-09-28 | 胡渐佳 | Learning scene sectional-type recording method and device |
| CN105575048A (en) * | 2016-02-25 | 2016-05-11 | 京东方科技集团股份有限公司 | Head lowering and head turning reminding device, control method thereof and helmet |
| US20170289144A1 (en) * | 2016-04-04 | 2017-10-05 | Mircea Ionita | Methods and systems for authenticating users |
| CN106054908A (en) * | 2016-06-17 | 2016-10-26 | 上海惠盛科技有限公司 | Unmanned aerial vehicle (UAV) attitude adjusting device and method |
| CN106933358A (en) * | 2017-02-28 | 2017-07-07 | 宇龙计算机通信科技(深圳)有限公司 | A kind of cervical vertebra guard method, device and intelligent helmet |
| CN107493531A (en) * | 2017-08-04 | 2017-12-19 | 歌尔科技有限公司 | A kind of head pose detection method, device and earphone |
| CN108304829A (en) * | 2018-03-08 | 2018-07-20 | 北京旷视科技有限公司 | Face identification method, apparatus and system |
| WO2019200474A1 (en) * | 2018-04-16 | 2019-10-24 | Technologies Hop-Child, Inc. | Systems and methods for the determination of arousal states, calibrated communication signals and monitoring arousal states |
| CN208621860U (en) * | 2018-06-21 | 2019-03-19 | 北京阿法龙科技有限公司 | The package assembly of folding type intelligent glasses |
| CN109144271A (en) * | 2018-09-07 | 2019-01-04 | 武汉轻工大学 | Three-dimensional space audio frequency attention-degree analysis method, system, server and storage medium |
| CN109528205A (en) * | 2018-11-15 | 2019-03-29 | 歌尔科技有限公司 | A kind of reminding method, device, helmet and computer readable storage medium |
| CN109515356A (en) * | 2018-12-11 | 2019-03-26 | 许建国 | A kind of new-energy automobile safety monitoring system |
| US20200214589A1 (en) * | 2019-01-07 | 2020-07-09 | Siemens Medical Solutions Usa, Inc. | Tracking head motion for medical imaging |
| CN111464978A (en) * | 2019-01-22 | 2020-07-28 | 岳秀兰 | Vehicle remote driving system established by connection of primary wireless equipment and secondary wireless equipment through Internet of things |
| CN110619628A (en) * | 2019-09-09 | 2019-12-27 | 博云视觉（北京）科技有限公司 | Human face image quality evaluation method |
| CN111078926A (en) * | 2019-12-19 | 2020-04-28 | 青岛海信电器股份有限公司 | Method for determining portrait thumbnail image and display equipment |
| CN111582086A (en) * | 2020-04-26 | 2020-08-25 | 湖南大学 | Fatigue driving identification method and system based on multiple characteristics |
| CN112087565A (en) * | 2020-09-21 | 2020-12-15 | 江西台德智慧科技有限公司 | Artificial intelligence camera shooting structure |
Non-Patent Citations (4)
| Title |
|---|
| OH, HYUN-JU; SONG, GUI-BIN: "Effects of neurofeedback training on the cervical movement of adults with forward head posture.", 《JOURNAL OF PHYSICAL THERAPY SCIENCE》 * |
| 李本松.: "新常态下绿色化的内涵解析及其实践要求", 《理论与现代化》 * |
| 李本松: "资本主义社会的物役性留给我们的时代警示", 《南通纺织职业技术学院学报》 * |
| 龙承启: "基于ROS的无人驾驶汽车融合定位研究", 《万方》 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117064375A (en) * | 2023-07-18 | 2023-11-17 | 江西瑞声电子有限公司 | Head posture monitoring method, main control equipment and intelligent wearable equipment |
| CN117064375B (en) * | 2023-07-18 | 2024-03-22 | 江西瑞声电子有限公司 | Head posture monitoring method, main control equipment and intelligent wearable equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN113040757B (en) | 2022-12-20 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Monteiro et al. | Developing an e-health system based on IoT, fog and cloud computing | |
| Kunze et al. | Activity recognition for the mind: Toward a cognitive" Quantified Self" | |
| CN107647860B (en) | Heart rate detection method and device, electronic equipment and storage medium | |
| US11139079B2 (en) | Cognitive stroke detection and notification | |
| US20160256691A1 (en) | Analyzer for behavioral analysis and parameterization of neural stimulation | |
| US20220130415A1 (en) | Method for Detecting and Classifying Coughs or Other Non-Semantic Sounds Using Audio Feature Set Learned from Speech | |
| CN114283494A (en) | Early warning method, device, equipment and storage medium for user falling | |
| US11666269B2 (en) | Sleeping mask methods and panels with integrated sensors | |
| WO2021196456A1 (en) | Experimental living body behavior analysis method and apparatus, and device and storage medium | |
| CN113040757B (en) | Head posture monitoring method and device, head intelligent wearable device and storage medium | |
| CA3074999A1 (en) | Wearable health monitoring device | |
| Roy et al. | CovidAlert-a wristwatch-based system to alert users from face touching | |
| CN114190897A (en) | Training method of sleep staging model, sleep staging method and device | |
| CN116612894A (en) | Method and device for identifying sleep disorder and wearable equipment | |
| US20200323448A1 (en) | System of Determining Physiological State | |
| WO2023112384A1 (en) | Computer system and emotion estimation method | |
| CN113208566B (en) | Data processing method and device, electronic equipment and storage medium | |
| US20190163870A1 (en) | Effective patient state sharing | |
| US20220211283A1 (en) | Methods for blood pressure calibration selection and modeling methods thereof | |
| CN113990512A (en) | Abnormal data detection method and device, electronic equipment and storage medium | |
| Murnane et al. | Mobile and sensor technology as a tool for health measurement, management, and research with aging populations | |
| CN113223698B (en) | Emergency hierarchical processing method and device, electronic equipment and storage medium | |
| KR102353687B1 (en) | Server for providing service for educating english and method for operation thereof | |
| CN116823511B (en) | Method and device for identifying social isolation state of user and wearable device | |
| WO2023024748A1 (en) | Sleep quality assessment method and apparatus, and in-bed state monitoring method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |