CN113534500B - Intelligent glasses, method for monitoring human body posture, medium, terminal and system - Google Patents
Intelligent glasses, method for monitoring human body posture, medium, terminal and system Download PDFInfo
- Publication number
- CN113534500B CN113534500B CN202010290078.7A CN202010290078A CN113534500B CN 113534500 B CN113534500 B CN 113534500B CN 202010290078 A CN202010290078 A CN 202010290078A CN 113534500 B CN113534500 B CN 113534500B
- Authority
- CN
- China
- Prior art keywords
- motion
- wearer
- posture
- index
- glasses
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 239000011521 glass Substances 0.000 title claims abstract description 81
- 238000000034 method Methods 0.000 title claims abstract description 30
- 238000012544 monitoring process Methods 0.000 title claims abstract description 18
- 230000036544 posture Effects 0.000 claims abstract description 71
- 230000033001 locomotion Effects 0.000 claims abstract description 64
- 238000004891 communication Methods 0.000 claims abstract description 51
- 238000004364 calculation method Methods 0.000 claims abstract description 20
- 238000013473 artificial intelligence Methods 0.000 claims abstract description 18
- 239000004984 smart glass Substances 0.000 claims description 21
- 230000003068 static effect Effects 0.000 claims description 20
- 238000004422 calculation algorithm Methods 0.000 claims description 19
- 238000012545 processing Methods 0.000 claims description 13
- 238000004590 computer program Methods 0.000 claims description 9
- 230000000474 nursing effect Effects 0.000 claims description 7
- 238000012937 correction Methods 0.000 claims description 5
- 230000005236 sound signal Effects 0.000 claims description 5
- 230000009471 action Effects 0.000 claims description 4
- 230000033764 rhythmic process Effects 0.000 claims description 2
- 238000012549 training Methods 0.000 claims description 2
- 230000006870 function Effects 0.000 description 11
- 238000010586 diagram Methods 0.000 description 9
- 230000008878 coupling Effects 0.000 description 3
- 238000010168 coupling process Methods 0.000 description 3
- 238000005859 coupling reaction Methods 0.000 description 3
- 230000000694 effects Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 238000012546 transfer Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 238000010295 mobile communication Methods 0.000 description 2
- 230000001144 postural effect Effects 0.000 description 2
- 241000238558 Eucarida Species 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 238000005265 energy consumption Methods 0.000 description 1
- 238000009499 grossing Methods 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000008569 process Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000007619 statistical method Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
- G02C11/00—Non-optical adjuncts; Attachment thereof
- G02C11/10—Electronic devices other than hearing aids
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/103—Detecting, measuring or recording devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
- A61B5/11—Measuring movement of the entire body or parts thereof, e.g. head or hand tremor, mobility of a limb
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
-
- G—PHYSICS
- G02—OPTICS
- G02C—SPECTACLES; SUNGLASSES OR GOGGLES INSOFAR AS THEY HAVE THE SAME FEATURES AS SPECTACLES; CONTACT LENSES
- G02C11/00—Non-optical adjuncts; Attachment thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
- H04B1/3827—Portable transceivers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B1/00—Details of transmission systems, not covered by a single one of groups H04B3/00 - H04B13/00; Details of transmission systems not characterised by the medium used for transmission
- H04B1/38—Transceivers, i.e. devices in which transmitter and receiver form a structural unit and in which at least one part is used for functions of transmitting and receiving
- H04B1/3827—Portable transceivers
- H04B1/385—Transceivers carried on the body, e.g. in helmets
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
Landscapes
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- General Health & Medical Sciences (AREA)
- Ophthalmology & Optometry (AREA)
- Computer Networks & Wireless Communication (AREA)
- Dentistry (AREA)
- Medical Informatics (AREA)
- Otolaryngology (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Acoustics & Sound (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Physiology (AREA)
- Molecular Biology (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Telephone Function (AREA)
- Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
Abstract
The application is suitable for the technical field of intelligent wearing, and provides intelligent glasses and a method for monitoring human body postures. This intelligence glasses includes the glasses body, embeds there are audio device, proximity sensor, touch-control inductor, nine sensors, wireless communication module in the glasses body. This application adopts intelligent glasses and mobile intelligent terminal to combine together, carries out corresponding warning through real-time supervision person's gesture index parameter and carries out gesture index analysis when doing various motions, has realized certain artificial intelligence function. The intelligent glasses can carry out complex calculation of the attitude index parameters on the mobile intelligent terminal, the function born by the microcontroller arranged in the wireless communication module is simpler, the circuit structure of the intelligent glasses is simplified, the weight is reduced, the power consumption is reduced, in addition, the intelligent glasses do not need to be provided with a GPS module, the mobile intelligent terminal directly uses the GPS data of the mobile intelligent terminal when calculating, the weight is further reduced equivalently by the intelligent glasses, and a power-consuming part is also reduced.
Description
Technical Field
The application belongs to the technical field of intelligent wearing, and particularly relates to intelligent glasses, a method and medium for monitoring human body postures, a mobile intelligent terminal and an intelligent glasses system.
Background
The intelligent glasses are wearable glasses equipment which have independent operating systems like a smart phone and can realize various functions through software installation, and the intelligent glasses have the advantages of being simple and convenient to use, small in size and the like.
In the existing intelligent glasses, a microcontroller and sensors (such as a pedometer, a heart rate sensor, an accelerator, a gyroscope, a GPS and the like) are all built in a glasses main body, and all intelligent functions are calculated by receiving data of the relevant sensors by the built-in microcontroller. Such smart glasses have the following disadvantages:
1. the glasses are heavy, can generate uncomfortable feeling after being worn for a long time and cannot be worn all day long;
2. the power consumption is high;
3. the performance of the microprocessor is limited, most of the microprocessor only integrates certain intelligent functions, humanized control is not considered at all, and artificial intelligent functions cannot be provided.
Disclosure of Invention
The technical problem that this application embodiment will be solved is for how to provide artificial intelligence function when lightening intelligent glasses weight, power consumption.
In order to solve the technical problem, in a first aspect, an embodiment of the present application provides an intelligent glasses, which includes a glasses body, wherein: an audio device; a proximity sensor; a touch sensor; a nine-axis sensor; a wireless communication module connected with the audio device, the touch sensor, the proximity sensor, and the nine-axis sensor; the intelligent glasses are used for detecting whether the intelligent glasses are worn or not through the proximity sensor and controlling whether the audio device works or not according to a detection result; the audio device is also used for detecting touch operation on the touch sensor and correspondingly controlling the audio device in a working state according to the touch operation; the system is also used for sending nine-axis sensing data of the nine-axis sensor to an external mobile intelligent terminal, wherein the nine-axis sensing data are used for calculating posture index parameters of a wearer; and the reminding information is also used for receiving reminding information from an external mobile intelligent terminal and outputting the reminding information through the audio device, and the reminding information corresponds to the calculated posture index parameter of the wearer.
In a second aspect, the embodiment of the application further provides a method for monitoring human body posture, wherein the method is applied to a mobile intelligent terminal and is matched with intelligent glasses for use; the method comprises the following steps: communicating with the smart glasses based on a wireless communication protocol, receiving nine-axis sensing data from the smart glasses; calculating posture index parameters of the wearer according to the nine-axis sensing data; and when the calculated posture index parameter meets a preset reminding condition, outputting reminding information corresponding to the posture index parameter to the intelligent glasses.
In a third aspect, the embodiment of the application further provides a device for monitoring the human body posture, wherein the device is arranged in the mobile intelligent terminal and is matched with the intelligent glasses for use; the device comprises: the receiving module is used for communicating with the intelligent glasses based on a wireless communication protocol and receiving nine-axis sensing data from the intelligent glasses; the calculation module is used for calculating the posture index parameter of the wearer according to the nine-axis sensing data; and the reminding module is used for outputting reminding information corresponding to the attitude index parameter to the intelligent glasses when the calculated attitude index parameter meets a preset reminding condition.
In a fourth aspect, an embodiment of the present application further provides a mobile intelligent terminal, including: a memory, a processor and a computer program stored on the memory and executable on the processor, when executing the computer program, implementing the method of monitoring a posture of a human body as provided in the second aspect above.
In a fifth aspect, embodiments of the present application further provide a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements the method for monitoring the posture of the human body as provided in the second aspect.
In a sixth aspect, an embodiment of the present application further provides a smart glasses system, which includes the smart glasses provided in the first aspect and the mobile smart terminal provided in the fourth aspect.
According to the intelligent glasses and the mobile intelligent terminal, intelligent glasses are combined, posture index parameters of a wearer are monitored in real time, corresponding reminding is carried out, posture index analysis can be carried out when various sports are carried out, and a certain artificial intelligence function can be achieved. The intelligent glasses are internally provided with the microcontroller in the wireless communication module, the wireless communication module sends nine-axis sensing data of the nine-axis sensor to the mobile intelligent terminal in real time, the mobile intelligent terminal calculates posture index parameters of a wearer according to the nine-axis sensing data, and then corresponding reminding information is sent to the wearer through the wireless communication module, namely, the posture index parameters are calculated on the mobile intelligent terminal, and the wireless communication module does not undertake calculation of the posture index parameters and mainly plays a role in information transfer. The function that the built-in microcontroller of wireless communication module undertakes is comparatively simple for its circuit structure also can be simplified, the weight of whole intelligent glasses is lightened, and power consumption is also still less, and, because intelligent glasses need not undertake the calculation of gesture index parameter, just also need not set up the GPS module, mobile intelligent terminal directly use self GPS data when calculating can, be equivalent to intelligent glasses further lightened weight, also reduced a power consumptive part.
Drawings
Fig. 1 is a configuration diagram of smart glasses according to a first embodiment of the present application;
fig. 2 is a block diagram of smart glasses according to a first embodiment of the present application;
fig. 3 is an architecture diagram of a smart eyewear system provided in a second embodiment of the present application;
FIG. 4 is a flowchart of an artificial intelligent sports trainer application App in a first mode of operation, as provided by a second embodiment of the present application;
FIG. 5 is a schematic view of a calibration interface provided by a second embodiment of the present application;
FIG. 6 is a schematic diagram of a calibration provided by a second embodiment of the present application;
FIG. 7 is a schematic diagram of a second embodiment of the present application illustrating the calculation of values of various motion parameters by an artificial intelligent motion trainer application App in a first operating mode;
FIG. 8 is a schematic diagram of a second embodiment of the present application for correcting the deviation of various motion parameter values by an artificial intelligent motion trainer application App in a first operating mode;
FIG. 9 is a flowchart of an artificial intelligence gesture care application App in a second mode of operation as provided by the second embodiment of the present application;
fig. 10 is a block diagram of an apparatus for monitoring a posture of a human body according to a third embodiment of the present application;
fig. 11 is a block diagram of a mobile intelligent terminal according to a fourth embodiment of the present application;
fig. 12 is an architecture diagram of a smart eyewear system provided in a sixth embodiment of the present application.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of and not restrictive on the broad application.
Referring to fig. 1 and 2, a first embodiment of the present application provides smart glasses, which are used to cooperate with an external mobile smart terminal. This intelligent glasses includes the glasses body, and the glasses body includes picture frame, first mirror leg (right mirror leg promptly), second mirror leg (left mirror leg promptly), and built-in has in this glasses body: the device comprises a wireless communication module 1, an audio device 2, a proximity sensor 3, a touch sensor 4 and a nine-axis sensor 5, wherein the wireless communication module 1 is connected with the audio device 2, the proximity sensor 3, the touch sensor 4 and the nine-axis sensor 5.
The wireless communication module 1 is arranged in a cavity of one of the glasses legs and used as a master control of the intelligent glasses and a signal transfer, wherein the master control mainly refers to a wireless communication protocol, microphone input, loudspeaker output and the like, and the signal transfer refers to the fact that the data are wirelessly transmitted from the intelligent glasses to external intelligent equipment (such as a smart phone) through Bluetooth for algorithm processing and analysis. Specifically, the wireless communication module 1 may be a chip supporting short-distance communication, such as a bluetooth chip, or a mobile communication module supporting a mobile communication network, as long as the above functions are implemented.
As an implementation, the audio device 2 may be composed of a first mono speaker 21 and a second mono speaker 22, which may also be combined to form a stereo effect. The first mono speaker 21 is located on the first temple, the second mono speaker 22 is located on the second temple, and the sound outlet of the first mono speaker 21 is located at the rear of the first temple and the sound outlet of the second mono speaker 22 is located at the rear of the second temple, so that the two sound outlets can be brought close to the ears when worn.
The proximity sensor 3 is located inside the temples to be in contact with the skin, so as to accurately detect whether the smart glasses are worn.
The touch sensor 4 is generally located on the outer side of the temple for adjusting the volume, specifically, the touch sensor may be located on the outer side of the first temple, or may be located on the outer side of the second temple, so as to facilitate users with different handhabits.
The nine-axis sensor 5 is used to count steps for the wearer and also to collect some data, such as 3-dimensional accelerator data (Ax, ay, az), 3-dimensional gyroscope data (Gx, gy, gz), 3-dimensional magnetometer data (Mx, my, mz).
In addition, the intelligent glasses body does not have a Global Positioning System (GPS), and because the GPS module consumes power relatively, the GPS data required by algorithm processing and analysis are provided by the mobile intelligent terminal.
Specifically, the wireless communication module 1 mainly functions as follows:
1. the wireless communication module 1 is used for detecting whether the intelligent glasses are worn or not through the proximity sensor 3 and controlling whether the audio device 2 works or not according to a detection result. When it is detected that the user wears the smart glasses, the wireless communication module 1 controls the audio device 2 to start working, for example, music of an external mobile smart terminal can be played in the audio device 2 through the wireless communication module 1, and when it is detected that the user takes off the smart glasses, the wireless communication module 1 controls the audio device 2 to stop playing the music.
In addition, when the wireless communication module 1 detects that the smart glasses are not worn for a preset time period (for example, 30 minutes) through the proximity sensor 3, the smart glasses are controlled to be automatically turned off, so as to save energy consumption.
2. The wireless communication module 1 is configured to detect a touch operation on the touch sensor 4, and correspondingly control the audio device 2 in a working state according to the touch operation. When the audio device 2 is in an operating state, the wireless communication module 1 monitors in real time whether the wearer has a touch operation on the touch sensor 4 and a touch operation mode, for example, a finger of the wearer sweeps over the touch sensor 4 in a direction towards an ear to turn up the volume, and sweeps in a direction towards a glasses frame (i.e., away from the ear) to turn down the volume, and the wireless communication module 1 turns up or down the volume according to a specific touch operation mode.
3. The wireless communication module 1 is used for sending nine-axis sensing data of the nine-axis sensor 5 to an external mobile intelligent terminal, and the nine-axis sensing data are used for calculating posture index parameters of a wearer.
The nine-axis sensor 5 can also detect some operation instructions of the wearer and send the operation instructions to the external mobile intelligent terminal through the wireless communication module 1 for corresponding control, for example, when music is played, the operation of clicking the intelligent glasses by the wearer indicates that the playing is paused or resumed, the external mobile intelligent terminal responds after receiving the operation instructions, and the double click by the wearer indicates that a voice assistant, such as "OK Google" or "Siri", is called, and the voice assistant function is turned on after the external mobile intelligent terminal receives the operation instructions.
4. The wireless communication module 1 is used for receiving reminding information from an external mobile intelligent terminal and outputting the reminding information through the audio device 2, and the reminding information corresponds to the calculated posture index parameters of the wearer.
Furthermore, a microphone device 6 is also arranged in the glasses body, and the microphone device 6 is connected with the wireless communication module 1 and used for picking up the voice signal of the wearer. The wireless communication module 1 performs corresponding control according to the voice signal or forwards the voice signal to an external mobile intelligent terminal to realize voice control or voice input in telephone communication.
The microphone device 6 may have a dual-microphone structure, as shown in fig. 2, and specifically includes a first microphone 61 and a second microphone 62, which are used in cooperation to reduce noise.
Besides playing music and making a call, other application functions on the external mobile intelligent terminal, such as voice navigation, instant translation, interphone and the like, can also be used on the intelligent glasses through the wireless communication module 1.
Furthermore, a battery 7 connected with the wireless communication module 1 is also arranged in the glasses body, the battery 7 is used for supplying power for all active components through the wireless communication module 1, and the battery 7 can be charged and can be detachably replaced.
As shown in fig. 1, the wireless communication module 1, the proximity sensor 3, the touch sensor 4, the nine-axis sensor 5, and the microphone device 6 are all located on the first temple, and the battery 7 is located on the second temple, which is not limited to this, and in the specific implementation, other distribution modes may be adopted in order to facilitate the wiring principle.
The second embodiment of the application also provides a method for monitoring the human body posture, which is applied to a mobile intelligent terminal and is matched with the intelligent glasses provided by the first embodiment for use. Referring to fig. 3, the method of monitoring the posture of a human body includes:
and S31, communicating with the intelligent glasses based on a wireless communication protocol, and receiving nine-axis sensing data from the intelligent glasses.
The mobile intelligent terminal comprises devices such as Android and iOS system smart phones or Android Wear smart watches supporting wireless communication protocols, and the smart glasses are firstly required to be paired with the mobile intelligent terminal through Bluetooth. After pairing, the intelligent glasses can exchange data through the Bluetooth, nine-axis sensing data of the intelligent glasses are transmitted to the mobile intelligent terminal through the Bluetooth channel in real time, and when the mobile intelligent terminal plays music, the stereo effect can be output to the loudspeaker of the intelligent glasses through the Bluetooth channel.
In addition, because the intelligent glasses body of this application has two microphones, the person of wearing accessible intelligent glasses's microphone pick up voice signal, is used for sending out voice command and phone and answers. All voice signals are received from two microphones of the glasses, and the voice signals after noise reduction can be played and output through a loudspeaker of the intelligent glasses. During telephone communication, the mobile intelligent terminal can be placed in a bag or on a desk, and the free hands can be used for other purposes. In addition, a Global Positioning System (GPS) of the mobile intelligent terminal can provide position information as position location.
And S32, calculating the posture index parameter of the wearer according to the nine-axis sensing data.
The mobile intelligent terminal stores the nine-axis sensing data (namely Ax, ay, az; gx, gy, gz; mx, my, mz) transmitted in real time from the wireless communication module 1 of the intelligent glasses, and calculates running indexes, monitors postures and reminds through the artificial intelligence housekeeper App based on the nine-axis sensing data. Running indexes include pace, distance, number of steps, head left and right balance, number of steps, stride length, stride frequency, and the like.
The mobile intelligent terminal comprises a first working mode and a second working mode, wherein the first working mode is used for realizing artificial intelligent exercise coaching in an exercise state, and the second working mode is used for realizing artificial intelligent posture nursing in a static state. The artificial intelligence sports coach and the artificial intelligence posture nursing are artificial intelligence housekeeper apps installed on the mobile intelligent terminal.
And S33, outputting reminding information corresponding to the attitude index parameter to the intelligent glasses when the calculated attitude index parameter meets a preset reminding condition.
The running index calculated by nine-axis sensing data and GPS data through the artificial intelligence housekeeper App can be displayed on the mobile intelligent terminal in real time and inform/remind a wearer through Bluetooth in real time at the audio device 2 of the intelligent glasses.
And in the first working mode, running an application program of an artificial intelligent sports coach, judging whether the sports index parameters meet the preset reminding conditions in the sports state by the mobile intelligent terminal, and if so, outputting reminding information in the sports state corresponding to the posture index parameters to the intelligent glasses. In the working mode, the mobile intelligent terminal is further used for generating an audio signal with a preset running frequency, sending the audio signal to the wireless communication module 1, and controlling the audio device 2 to output the audio signal by the wireless communication module 1, so that the wearer can perform running training in the sound rhythm of the preset frequency. And, the index of running that the person of wearing can be customized, and the current index of running of person of wearing can be calculated to the mobile intelligent terminal, regularly through wireless communication module 1, 2 people of wearing speed up or slow down are reminded with the pronunciation to the audio frequency device.
And in a second working mode, operating an application program of artificial intelligence posture nursing, judging whether the static posture index parameter meets a preset reminding condition in a static state by the mobile intelligent terminal, and if so, outputting reminding information in the static state corresponding to the static posture index parameter to the intelligent glasses.
The specific algorithms of the artificial intelligence exercise trainer application App in the first operating mode and the artificial intelligence gesture care application App in the second operating mode are described in detail below.
As shown in fig. 4, in the first working mode, the mobile intelligent terminal obtains the exercise index parameter from the nine-axis sensing data by running the artificial intelligence exercise trainer application App, that is, step S32 includes:
step S3211, the inclination angles of the various heads of the wearer when sitting straight or standing straight are used as the initial standard vertical angles.
The purpose of this step is to provide a unified reference for the calculation of each subsequent attitude index parameter, reduce errors, and ensure accurate calculation. As shown in fig. 5, the wearer is required to keep the "sitting" or "standing" posture during calibration, and if the accuracy of the subsequent posture index parameters is not required, the calibration step can be skipped.
The calibration principle is as shown in fig. 6, the head yaw inclination angle, the head pitch angle, and the head left-right selection angle need to be calculated, and the algorithm is as follows:
horizontal swing inclination angle of head
Calibrating angle for initial yaw
Initial yaw calibration angle:
the yaw angle:
head yaw inclination angle:
similarly head pitch angle:
left-right rotation angle of head: ω = (G) y (t 1 )-G y (t 0 ))*(t 1 -t 0 )。
Step S3212, receiving the nine-axis sensing data in real time, calculating motion parameter values of the current time and motion parameter values of the previous time according to the nine-axis sensing data by using the initial upright standard angle as a reference, calculating a difference between the motion parameter values of the previous time and the motion parameter values of the current time according to the longitude and latitude coordinates of the current time and the longitude and latitude coordinates of the previous time, and determining the current motion state of the wearer.
It should be noted that the motion parameter value at each time is a relative value based on the above-mentioned vertical standard angle. In this Step, a time difference Δ t between the current time t and the previous time t-1, a movement distance difference Δ d between the current time t and the previous time t-1, and a movement Step difference Δ Step between the current time t and the previous time t-1 need to be calculated, and the calculation method is as follows:
Δ t, Δ d, Δ Step calculation:
Δt(t)＝t(t)-t(t-1)
Δd＝d(t)-d(t-1)
ΔStep＝Step(t)-Step(t-1)
remarking: lat (t) and Long (t) are GPS latitude and longitude coordinates at time t.
During specific calculation, as shown in fig. 7, the output data is further divided into different algorithm processes according to the monitored current state of the wearer, that is:
1. when the algorithm monitors that the wearer is in a static state (namely '0'), the data delta t, delta d and delta Step are output to the static processing algorithm of the next Step for correction.
2. When the algorithm monitors that the wearer is in a walking state (namely '1'), the algorithm outputs data delta t, delta d and delta Step to the walking processing algorithm of the next Step for correcting deviation.
3. When the algorithm monitors that the wearer is in a running state (namely '2'), the data delta t, delta d and delta Step are output to the running processing algorithm of the next Step for correcting deviation.
And step S3213, according to the current motion state of the wearer, shunting the motion parameter differences to a corresponding deviation correction algorithm for processing to obtain the corrected motion parameter differences.
In general, the values of Δ t, Δ d, and Δ Step calculated in the previous Step are not problematic when the GPS signals are correct, but the GPS signals may move quickly and far instantaneously, and therefore, it is necessary to correct the values of Δ t, Δ d, and Δ Step calculated by the GPS signals.
As shown in fig. 8, the still processing algorithm is assumed to have Δ t, Δ d, and Δ Step all equal to 0.
For the walking processing algorithm, firstly, the speed v (t) at the current moment is calculated according to the delta d and the delta t, then, whether the v (t) is larger than the fastest walking speed or not is judged, if yes, the delta d at the current moment is corrected to be the product of the delta t (t) and the speed v (t-1) at the previous moment.
For the running processing algorithm, firstly, the speed v (t) at the current moment is calculated according to the delta d and the delta t, then whether the v (t) is greater than the fastest running speed is judged, and if yes, the delta d at the current moment is corrected to be the product of the delta t (t) and the speed v (t-1) at the previous moment.
Step S3214, calculating a plurality of instantaneous motion indexes of the wearer according to the corrected motion parameter differences.
The calculation formula of the instantaneous motion index of the embodiment of the application is as follows:
step S3215, for each item of the instantaneous motion index, performing weighted calculation on the parameter value at the current time and the parameter value at the previous time according to a preset weight, so as to obtain each item of the weighted instantaneous motion index.
In the embodiment of the present application, the instantaneous motion index is related to the parameter values of the index at the current time and the previous time, and the algorithm is as follows:
v i (t)＝α*v i (t)+(1-α)*v i (t-1)
p i (t)＝a*p i (t)+(1-α)*p i (t-1)
c i (t)＝β*c i (t)+(1-β)*c i (t-1)
s i (t)＝γ*s i (t)+(1-γ)*s i (t-1)
weight value: alpha is more than or equal to 0, beta is more than or equal to 1, and gamma is less than or equal to 1.
And step S3216, carrying out mean operation on all weighted instantaneous motion indexes at all moments obtained by calculation within a preset time length to obtain smooth all motion average values serving as all motion index parameters.
The data smoothing calculation formula of the embodiment of the application is as follows:
speed:
matching the speed:
step frequency:
stride:
where N represents the number of times that need to be counted.
And if so, outputting prompting information in the motion state corresponding to the posture index parameter to the intelligent glasses. Wherein, remind the condition to support motion index such as the user-defined speed of wearer, join in marriage fast, stride frequency, stride, for example, when judging that the wearer stride frequency is too low, stride undersize or the speed of running is too fast, can remind, help the wearer to carry out scientific motion.
As shown in fig. 9, in the second working mode, the mobile intelligent terminal obtains the static posture index parameter from the nine-axis sensing data by running the artificial intelligence posture nursing application App, that is, the step S32 further includes:
step S3221, in the second working mode, the various head inclination angles when the wearer sits straight or stands straight are taken as the initial upright standard angles.
The principle of this step is the same as that of step S3211, and is not described again.
Step S3222, receiving the nine-axis sensing data in real time, calculating various static head or body postures of the wearer according to the nine-axis sensing data by using the initial upright standard angle as a reference, and taking the calculated static head or body postures as an effective stretching action when the inclination angle of the various static head or body postures reaches a preset inclination index.
The inclination angle at each moment when the head or body is at rest is a relative value with reference to the above-mentioned upright standard angle. If the inclination angle does not reach the inclination index, the posture of the wearer is considered to be temporary, and no reminding is needed. In addition, the number of times of squatting deeply of the wearer can be calculated in real time in the second working mode.
As one implementation, the artificial intelligence gesture care application App will classify head or body gestures into several levels, for example:
stage 1: upright (uphight), i.e. correct posture;
stage 2: slight (slide), i.e., slight deviation in pose;
stage 3: severe (serious), i.e. postural deviation severe;
and 4, stage: severe, i.e., the most Severe postural deviation.
And after the calculated inclination angles of various heads or bodies in the static state are calculated, classifying the heads or bodies to the corresponding grades.
Step S3223, determining whether the duration of the effective action is greater than a preset duration, and if so, determining that the reminding condition is met.
When the neck or sitting posture of the wearer is incorrect for a long time, the artificial intelligence nursing staff can remind the wearer through the intelligent glasses with voice in real time.
When there is a hierarchical division of head or body posture, the preset duration corresponding to each level may be further set, for example, a slight (slide) may set a duration that is allowed to be slightly longer, and a Severe (Severe) may set a minimum duration. The artificial intelligence posture nursing application program App is used for collecting long-time data through intelligent glasses, learning the posture of a wearer at the mobile intelligent terminal and reminding and correcting the wearer to use the correct posture.
Under the second mode of operation, the mobile intelligent terminal can also regularly remind the wearer to drink water, do head/neck and health stretching exercises or squat deeply through intelligent glasses to keep the wearer healthy.
Further, in the second operation mode, the step S32 may further include: and outputting a reminding mode of a corresponding grade to the wireless communication module according to the different calculated head inclination angles in the second working mode. The better reminding effect can be achieved by setting different reminding modes.
The third embodiment of the present application further provides a device for monitoring the posture of a human body, as shown in fig. 10, comprising
The receiving module 101 is configured to communicate with the smart glasses based on a wireless communication protocol, and receive nine-axis sensing data from the smart glasses;
the calculation module 102 is configured to calculate a posture index parameter of the wearer according to the nine-axis sensing data;
and the reminding module 103 is configured to output reminding information corresponding to the posture index parameter to the smart glasses when the calculated posture index parameter meets a preset reminding condition.
In the embodiment of the present application, the receiving module 101, the calculating module 102, the contrast module 803, and the reminding module 103 are respectively similar to the steps described in the second embodiment, and the calculating module 102 has a first working mode and a second working mode, which may be related to the second embodiment, and are not described herein again.
Referring to fig. 11, a fourth embodiment of the present application further provides a mobile intelligent terminal, including: a memory 111, a processor 112 and a computer program stored on the memory 111 and operable on the processor 112, the processor 112 implementing the method for monitoring the posture of the human body as described in the second embodiment when executing the computer program.
Alternatively, the memory 111 may be separate or integrated with the processor 112.
When the memory 111 is provided separately, the apparatus further includes a bus 113 for connecting the memory 111 and the processor 112.
The fifth embodiment of the present application further provides a computer-readable storage medium, in which computer-executable instructions are stored, and when a processor executes the computer-executable instructions, the method for monitoring the posture of the human body described in the second embodiment is implemented.
The sixth embodiment of the present application further provides a smart glasses system, as shown in fig. 12, including: the smart glasses according to the first embodiment and the mobile smart terminal according to the fourth embodiment.
Furthermore, the system can further comprise cloud intelligent equipment, wherein the cloud intelligent equipment is used for interacting with the mobile intelligent terminal, performing statistical analysis on the motion index parameters of the wearer, and providing reference suggestions for the mobile intelligent terminal by combining the motion index parameters of other mobile intelligent terminals. For example, when the cloud intelligent device finds that the motion index set by the user on other mobile intelligent terminals is more reasonable, the cloud intelligent device can suggest to the mobile intelligent terminal to remind the user of resetting.
In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules is only one logical functional division, and other divisions may be realized in practice, for example, a plurality of modules may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or modules, and may be in an electrical, mechanical or other form.
The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical units, may be located in one position, or may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, functional modules in the embodiments of the present application may be integrated into one processing unit, or each module may exist alone physically, or two or more modules are integrated into one unit. The unit formed by the modules can be realized in a hardware mode, and can also be realized in a mode of hardware and a software functional unit.
The integrated module implemented in the form of a software functional module may be stored in a computer-readable storage medium. The software functional module is stored in a storage medium and includes several instructions for enabling a computer device (which may be a personal computer, a server, or a network device) or a processor (processor) to execute some steps of the methods according to the embodiments of the present application.
It should be understood that the Processor may be a Central Processing Unit (CPU), other general purpose Processor, a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), etc. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like. The steps of the methods disclosed in the incorporated application may be directly implemented by a hardware processor, or may be implemented by a combination of hardware and software modules in the processor.
The memory may comprise a high speed RAM memory, and may further comprise a non-volatile storage NVM, such as at least one magnetic disk memory, and may also be a usb disk, a removable hard disk, a read-only memory, a magnetic or optical disk, or the like.
The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, an Extended ISA (EISA) bus, or the like. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, the buses in the figures of the present application are not limited to only one bus or one type of bus.
The storage medium may be implemented by any type or combination of volatile and non-volatile memory devices, such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.
An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. Of course, the storage medium may also be integral to the processor. The processor and the storage medium may reside in an Application Specific Integrated Circuits (ASIC). Of course, the processor and the storage medium may reside as discrete components in an electronic device or host device.
Those of ordinary skill in the art will understand that: all or a portion of the steps of implementing the above-described method embodiments may be performed by hardware associated with program instructions. The program may be stored in a computer-readable storage medium. When executed, the program performs steps comprising the method embodiments described above; and the aforementioned storage medium includes: various media that can store program codes, such as ROM, RAM, magnetic or optical disks.
The above description is only exemplary of the present application and should not be taken as limiting the present application, as any modification, equivalent replacement, or improvement made within the spirit and principle of the present application should be included in the protection scope of the present application.
Claims (8)
1. A method for monitoring human body posture is characterized in that the method is applied to a mobile intelligent terminal and is matched with intelligent glasses for use, the mobile intelligent terminal is provided with a first working mode, and the first working mode is used for realizing artificial intelligent sports coaching in a sports state; the method comprises the following steps:
communicating with the smart glasses based on a wireless communication protocol, receiving nine-axis sensing data from the smart glasses;
calculating posture index parameters of the wearer according to the nine-axis sensing data;
when the calculated attitude index parameters meet preset reminding conditions, reminding information corresponding to the attitude index parameters is output to the intelligent glasses;
the posture index parameters comprise motion index parameters, and the calculation of the posture index parameters of the wearer according to the nine-axis sensing data comprises the following steps:
in a first working mode, taking various head inclination angles of a wearer when sitting straight or standing straight as initial upright standard angles;
receiving the nine-axis sensing data in real time, calculating to obtain various motion parameter values at the current moment and various motion parameter values at the previous moment according to the nine-axis sensing data by taking the initial upright standard angle as a reference, calculating various motion parameter differences from the previous moment to the current moment by combining the longitude and latitude coordinates at the current moment and the longitude and latitude coordinates at the previous moment, and judging the current motion state of the wearer at the same time;
shunting the motion parameter difference values to corresponding deviation correction algorithms for processing according to the current motion state of the wearer to obtain corrected motion parameter difference values;
calculating a plurality of instantaneous motion indexes of the wearer according to the difference value of each motion parameter after deviation correction;
for each item of the instant motion index, performing weighted calculation on the parameter value at the current moment and the parameter value at the previous moment according to a preset weight to obtain each item of weighted instant motion index;
and carrying out mean operation on all weighted instantaneous motion indexes at all moments calculated in a preset time length to obtain smooth all motion average values serving as all motion index parameters.
2. The method of claim 1, wherein the pose index parameters further comprise a static pose index parameter; the mobile intelligent terminal is also provided with a second working mode, and the second working mode is used for realizing artificial intelligent posture nursing in a static state;
when the calculated posture index parameter meets a preset reminding condition, reminding information corresponding to the posture index parameter is output to the intelligent glasses, and the reminding information comprises the following steps:
in the first working mode, judging whether the motion index parameter meets a preset reminding condition in a motion state, if so, outputting reminding information in the motion state corresponding to the posture index parameter to the intelligent glasses;
and in the second working mode, judging whether the static posture index parameter meets a preset reminding condition in a static state, and if so, outputting reminding information in the static state corresponding to the static posture index parameter to the intelligent glasses.
3. The method of claim 1 or 2, wherein the method further comprises: and under the first working mode, generating an audio signal with a preset running frequency, sending the audio signal to a wireless communication module in the intelligent glasses, and controlling an audio device in the intelligent glasses to output by the wireless communication module so that the wearer can perform running training in the rhythm of the preset frequency.
4. The method of claim 2, wherein said calculating a wearer's posture index parameter from said nine-axis sensing data comprises:
in a second working mode, taking various head inclination angles of a wearer when sitting straight or standing straight as initial upright standard angles;
receiving the nine-axis sensing data in real time, calculating various static head or body postures of the wearer according to the nine-axis sensing data by taking the initial upright standard angle as a reference standard, and taking the rest head or body postures as an effective stretching action when the inclination angle of the rest head or body reaches a preset inclination index;
and judging whether the duration of the effective action is greater than the preset duration, and if so, determining that the reminding condition is met.
5. The method of claim 4, wherein the method further comprises:
and outputting a reminding mode of a corresponding grade to a wireless communication module in the intelligent glasses according to the different calculated head inclination angles in the second working mode.
6. A device for monitoring human body posture is characterized in that the device is arranged in a mobile intelligent terminal and is matched with intelligent glasses for use; the device comprises:
the receiving module is used for communicating with the intelligent glasses based on a wireless communication protocol and receiving nine-axis sensing data from the intelligent glasses;
the calculation module is used for calculating posture index parameters of the wearer according to the nine-axis sensing data; the computing module is provided with a first working mode, and the first working mode is used for realizing an artificial intelligence sport coach in a sport state;
the reminding module is used for outputting reminding information corresponding to the attitude index parameter to the intelligent glasses when the calculated attitude index parameter meets a preset reminding condition;
the posture index parameters comprise motion index parameters, and the calculation module calculates the posture index parameters of the wearer in the following mode:
in a first working mode, taking various head inclination angles of a wearer when sitting straight or standing straight as initial upright standard angles;
receiving the nine-axis sensing data in real time, calculating to obtain various motion parameter values of the current moment and various motion parameter values of the previous moment according to the nine-axis sensing data by taking the initial upright standard angle as a reference, calculating various motion parameter differences from the previous moment to the current moment by combining the longitude and latitude coordinates of the current moment and the longitude and latitude coordinates of the previous moment, and judging the current motion state of the wearer at the same time;
according to the current motion state of the wearer, shunting the motion parameter difference values to corresponding deviation correction algorithms for processing to obtain corrected motion parameter difference values;
calculating a plurality of instantaneous motion indexes of the wearer according to the difference values of the motion parameters after deviation rectification;
for each item of the instant motion index, performing weighted calculation on the parameter value at the current moment and the parameter value at the previous moment according to a preset weight to obtain each item of weighted instant motion index;
and carrying out mean operation on all weighted instantaneous motion indexes at all moments calculated in a preset time length to obtain smooth all motion average values serving as all motion index parameters.
7. A mobile intelligent terminal, comprising: memory, processor and computer program stored on the memory and executable on the processor, characterized in that the processor implements the method of monitoring a posture of a human body according to any one of claims 1 to 5 when executing the computer program.
8. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method of monitoring a posture of a human body of any one of claims 1 to 5.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010290078.7A CN113534500B (en) | 2020-04-14 | 2020-04-14 | Intelligent glasses, method for monitoring human body posture, medium, terminal and system |
| PCT/CN2020/140404 WO2021208505A1 (en) | 2020-04-14 | 2020-12-28 | Intelligent glasses, method for monitoring human body postures, medium, terminal and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010290078.7A CN113534500B (en) | 2020-04-14 | 2020-04-14 | Intelligent glasses, method for monitoring human body posture, medium, terminal and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN113534500A CN113534500A (en) | 2021-10-22 |
| CN113534500B true CN113534500B (en) | 2023-01-13 |
Family
ID=78085261
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010290078.7A Active CN113534500B (en) | 2020-04-14 | 2020-04-14 | Intelligent glasses, method for monitoring human body posture, medium, terminal and system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN113534500B (en) |
| WO (1) | WO2021208505A1 (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114035345B (en) * | 2021-11-03 | 2024-03-12 | 美新半导体（无锡）有限公司 | Intelligent glasses and working method thereof |
| CN114157950A (en) * | 2021-11-26 | 2022-03-08 | 歌尔科技有限公司 | Head movement detection method, smart headset, and computer-readable storage medium |
| CN114224328A (en) * | 2021-12-16 | 2022-03-25 | 中山大学附属口腔医院 | Dynamic head position measuring equipment |
| CN114486178B (en) * | 2022-02-15 | 2024-04-02 | 广州彩熠灯光股份有限公司 | Lamp motion performance detection method, device, system and terminal equipment |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090054814A1 (en) * | 2005-02-25 | 2009-02-26 | Schnapp Elma O | Posture monitoring device and method of use thereof |
| CN103479361B (en) * | 2013-09-03 | 2016-06-22 | 罗华 | Intelligent glasses and using method thereof |
| CN104090383A (en) * | 2014-05-09 | 2014-10-08 | 深圳市宏伟正和数码有限公司 | Intelligent cruise spectacles and control system thereof |
| JP6268281B2 (en) * | 2014-05-09 | 2018-01-24 | アルプス電気株式会社 | Electronics |
| CN204719348U (en) * | 2015-05-20 | 2015-10-21 | 深圳市瑞德恒创科技有限公司 | A kind of intelligent glasses possessing motion detection function |
| CN105227795A (en) * | 2015-09-06 | 2016-01-06 | 东莞市和乐电子有限公司 | The control method that Bluetooth spectacles is connected with mobile communication equipment |
| CN105068277B (en) * | 2015-09-07 | 2017-10-31 | 苏州成之一时装创意设计有限公司 | Intelligent glasses application system |
| CN105954888A (en) * | 2016-04-29 | 2016-09-21 | 四川长虹网络科技有限责任公司 | Intelligent glasses frame, control device and intelligent glasses system |
| CN106108909A (en) * | 2016-06-14 | 2016-11-16 | 夏烬楚 | A kind of human body attitude detection wearable device, system and control method |
| WO2018029064A1 (en) * | 2016-08-09 | 2018-02-15 | Peter Sonntag | System and method for posture and movement regulation |
| CN107817534B (en) * | 2017-10-31 | 2020-05-12 | 深圳市元征科技股份有限公司 | Data acquisition method and device of intelligent wearable device and intelligent wearable device |
| US11389109B2 (en) * | 2018-04-14 | 2022-07-19 | Y. Michael Lee | System and method for monitoring and treating head, spine and body health and wellness |
| CN110051359A (en) * | 2019-04-12 | 2019-07-26 | 上海掌门科技有限公司 | For detecting the method and apparatus of human posture |
-
2020
- 2020-04-14 CN CN202010290078.7A patent/CN113534500B/en active Active
- 2020-12-28 WO PCT/CN2020/140404 patent/WO2021208505A1/en active Application Filing
Also Published As
| Publication number | Publication date |
|---|---|
| WO2021208505A1 (en) | 2021-10-21 |
| CN113534500A (en) | 2021-10-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN113534500B (en) | Intelligent glasses, method for monitoring human body posture, medium, terminal and system | |
| US10001386B2 (en) | Automatic track selection for calibration of pedometer devices | |
| CN105632101B (en) | A kind of anti-tumble method for early warning of human body and system | |
| US10512819B2 (en) | Gait monitor and a method of monitoring the gait of a person | |
| CN106510719A (en) | User posture monitoring method and wearable equipment | |
| US20170095692A1 (en) | System and method for run tracking with a wearable activity monitor | |
| TWI669681B (en) | Electronic calculatiing apparatus, system, and method for providing body posture health information | |
| US10313781B2 (en) | Audio accelerometric feedback through bilateral ear worn device system and method | |
| US20180125423A1 (en) | System and method for activity monitoring eyewear and head apparel | |
| CN105675048B (en) | Balance the wireless system and method for identification accuracy and power consumption | |
| JP7101835B2 (en) | Motion recognition system | |
| US20170227375A1 (en) | Calibration of a primary pedometer device using a secondary pedometer device | |
| US11253747B2 (en) | Automated activity detection and tracking | |
| KR102043104B1 (en) | Motion sensing method and apparatus | |
| CN206473327U (en) | A kind of wearable device | |
| CN109074237A (en) | Information processing unit, information processing method and program | |
| CN106821383A (en) | Animation monitoring system | |
| CN105530581A (en) | Smart wearable device based on voice recognition and control method thereof | |
| CN105982768A (en) | Cervical vertebra and back posture rectifier and control method thereof | |
| KR20220014254A (en) | Method of providing traveling virtual reality contents in vehicle such as a bus and a system thereof | |
| CN207804991U (en) | Postural training correcting device | |
| CN106236102B (en) | Motion monitoring method and device | |
| US20230390608A1 (en) | Systems and methods including ear-worn devices for vestibular rehabilitation exercises | |
| KR20230043727A (en) | Posture transition detection and classification using linked biomechanical model | |
| CN111035365A (en) | Chest badge type human body posture correction instrument and operation method thereof |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |