CN113768497A - Action recognition system and method thereof - Google Patents
Action recognition system and method thereof Download PDFInfo
- Publication number
- CN113768497A CN113768497A CN202111192562.7A CN202111192562A CN113768497A CN 113768497 A CN113768497 A CN 113768497A CN 202111192562 A CN202111192562 A CN 202111192562A CN 113768497 A CN113768497 A CN 113768497A
- Authority
- CN
- China
- Prior art keywords
- light
- motion
- motion recognition
- module
- recognition system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000009471 action Effects 0.000 title claims abstract description 70
- 238000000034 method Methods 0.000 title claims abstract description 45
- 230000033001 locomotion Effects 0.000 claims description 150
- 210000000707 wrist Anatomy 0.000 claims description 28
- 230000006870 function Effects 0.000 claims description 19
- 210000003205 muscle Anatomy 0.000 claims description 17
- 238000012545 processing Methods 0.000 claims description 14
- 230000008859 change Effects 0.000 claims description 13
- 230000005540 biological transmission Effects 0.000 claims description 12
- 230000005484 gravity Effects 0.000 claims description 12
- 238000006073 displacement reaction Methods 0.000 claims description 10
- 238000005452 bending Methods 0.000 claims description 3
- 230000004118 muscle contraction Effects 0.000 claims description 3
- 238000005259 measurement Methods 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 12
- 238000013461 design Methods 0.000 description 7
- 239000013598 vector Substances 0.000 description 6
- 210000002027 skeletal muscle Anatomy 0.000 description 5
- 238000013186 photoplethysmography Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 230000008602 contraction Effects 0.000 description 2
- 238000002567 electromyography Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 210000003414 extremity Anatomy 0.000 description 2
- 230000003321 amplification Effects 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 238000003745 diagnosis Methods 0.000 description 1
- 210000004247 hand Anatomy 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000000691 measurement method Methods 0.000 description 1
- 210000004165 myocardium Anatomy 0.000 description 1
- 230000003183 myoelectrical effect Effects 0.000 description 1
- 210000005036 nerve Anatomy 0.000 description 1
- 238000003199 nucleic acid amplification method Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 210000002460 smooth muscle Anatomy 0.000 description 1
- 230000000392 somatic effect Effects 0.000 description 1
- 230000000638 stimulation Effects 0.000 description 1
Images
Landscapes
- Position Input By Displaying (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The embodiment of the invention provides an action identification system and a method thereof. The action identification system comprises an annular body, at least one light emitting unit, at least one light sensing unit and an action identification module. The ring-shaped body is used for being sleeved on a movable part of a user. One end of the light-emitting unit is exposed at the inner ring side of the annular body and is used for providing the first light beam to irradiate at least one part of the movable part. One end of the light sensing unit is exposed out of the inner ring side of the annular body and is used for sensing a second light beam generated by the reflection of the first light beam by at least one part of the movable part and generating a light sensing signal according to the second light beam. The action identification module is used for judging the action of the user according to the light sensing signal. The invention is not influenced by power noise and EMI, and has more measurable positions and better convenience, thereby realizing better action identification.
Description
Technical Field
The present invention relates to a motion recognition system and method, and more particularly, to a motion recognition system and method for effectively determining a motion of a user by sensing a muscle change on a movable portion.
Background
Muscles are one of the important components of the human body and are mainly divided into three types, namely skeletal muscles, smooth muscles and cardiac muscles, wherein the skeletal muscles mainly distributed in the limbs and trunk of the human body govern the basic activities of the human body. In detail, the contraction movement of skeletal muscle is governed by the consciousness of human, and the contraction and expansion of skeletal muscle can drive the movement of skeletal muscle through the stimulation of somatic nerves, so as to promote the movement of human body.
Surface Electromyography (SEMG) is a method of guiding and recording the electromyographic signals accompanying muscle contraction from the Surface of the muscle through electrodes, and it has different degrees of correlation with the activity state of the muscle, so it can help to reflect the change of muscle activity during exercise. Therefore, the conventional SEMG can be used not only for general medical diagnosis but also for recognizing an action.
However, the SEMG still has a lot of disadvantages when performing operation determination. For example, limited by the design of Field Programmable Gate Array (FPGA), the processing speed of the electromyographic signal processing apparatus is not easy to meet the requirement of identification, the signal amplification circuit technology of the sensing end is complex, the measurement position is limited to the chest and two hands, and the electromyographic signal is also easily affected by power noise and ElectroMagnetic Interference (EMI). Therefore, there are still many problems to be solved in the prior art of the SEMG-based motion recognition system. This also means that the increasingly developed wearable technology for identification by surface electromyography is still not suitable for wearable devices in the consumer electronics field.
Disclosure of Invention
An embodiment of the invention provides an action recognition system, which includes an annular body, at least one light emitting unit, at least one light sensing unit, and an action recognition module. The ring-shaped body is used for being sleeved on a movable part of a user. One end of the light-emitting unit is exposed at the inner ring side of the annular body and is used for providing the first light beam to irradiate at least one part of the movable part. One end of the light sensing unit is exposed out of the inner ring side of the annular body and is used for sensing a second light beam generated by the reflection of the first light beam by at least one part of the movable part and generating a light sensing signal according to the second light beam. The action identification module is used for judging the action of the user according to the light sensing signal.
The embodiment of the invention also provides an action identification method, which is suitable for an action identification system, wherein the action identification system comprises an annular body, at least one light-emitting unit, at least one light sensing unit and an action identification module, wherein the annular body is used for being sleeved on the movable part of a user. The action recognition method comprises the following steps. The light-emitting unit is used for providing a first light beam to irradiate at least one part of the movable part, wherein one end of the light-emitting unit is exposed out of the inner ring side of the annular body. The light sensing unit is used for sensing a second light beam generated by the reflection of the first light beam by at least one part of the movable part and generating a light sensing signal according to the second light beam, wherein one end of the light sensing unit is exposed out of the inner ring side of the annular body. The action of the user is judged by the action identification module according to the light sensing signal.
In summary, the motion recognition system and the motion recognition method thereof provided by the embodiments of the present invention mainly generate the sensing signal by the photo sensing muscle change, so that the system is less affected by power noise and EMI, and has more measurable positions and better convenience, thereby achieving better motion recognition.
For a better understanding of the nature and technical content of the present invention, reference should be made to the following detailed description of the invention and the accompanying drawings, which are provided for illustration purposes only and are not intended to limit the scope of the invention.
Drawings
Fig. 1 is a functional block diagram of an action recognition system according to an embodiment of the present invention.
Fig. 2 is an external view of a ring body of the motion recognition system according to an embodiment of the invention.
Fig. 3 is a schematic diagram illustrating an operation of the motion recognition system according to an embodiment of the invention.
FIG. 4 is a functional block diagram of a motion recognition system according to another embodiment of the present invention.
Fig. 5 is a functional block diagram of a wearable device configured by a motion recognition system according to another embodiment of the invention.
Fig. 6 is an external view of a wearable device composed of a motion recognition system according to another embodiment of the invention.
Fig. 7 is a functional block diagram of a wearable device configured by a motion recognition system according to another embodiment of the invention.
FIG. 8 is a schematic diagram illustrating an operation of the motion recognition system according to another embodiment of the present invention.
Fig. 9 is a flowchart illustrating an action recognition method according to an embodiment of the present invention.
Fig. 10 is a flowchart illustrating an action recognition method according to another embodiment of the present invention.
Fig. 11 is a flowchart illustrating an action recognition method according to another embodiment of the present invention.
Fig. 12 is a flowchart illustrating an action recognition method according to another embodiment of the present invention.
Wherein the reference numerals are as follows:
1. 4, 5, 7: action recognition system
10: ring body
10 a: inner ring side
10 b: outer ring side
12: light emitting unit
14: light sensing unit
16: action identification module
40: gravity sensing module
42: gyroscope module
44: light source controller
50: processing module
52: multimedia module
54: display screen
70: transmission unit
2: wrist
5a, 7 a: wearable device
7 b: electronic device
S901 to S905, S101 to S103, S111, S121 to S123: procedure step
Detailed Description
Hereinafter, the present invention will be described in detail by illustrating various embodiments of the present invention through the accompanying drawings. The inventive concept may, however, be embodied in many different forms and should not be construed as limited to the exemplary embodiments set forth herein. Moreover, in the drawings, like reference numerals may be used to designate like elements.
Referring to fig. 1 to fig. 3, fig. 1 is a functional block diagram of an action recognition system according to an embodiment of the present invention, fig. 2 is an external view of a ring body of the action recognition system according to the embodiment of the present invention, and fig. 3 is a schematic usage view of the action recognition system according to the embodiment of the present invention. The motion recognition system 1 mainly includes at least one light emitting unit 12, at least one light sensing unit 14, and a motion recognition module 16. The above elements may be implemented by a pure hardware circuit, or implemented by a hardware circuit and firmware or software, and in short, the invention is not limited to the specific implementation manner of the motion recognition system 1. In addition, the above components may be integrated or separately arranged, and the invention is not limited thereto. It should be noted that the above components may also be configured to transmit data through a wired or wireless manner, and the invention is not limited thereto.
In addition, the motion recognition system 1 provided in the embodiment of the present invention can be implemented by a wearable device, or a system formed by a wearable device and another electronic device, and in short, the present invention is not limited thereto. Therefore, if the motion recognition system 1 is configured as a wearable device for convenience, the motion recognition system 1 must further include a ring body 10.
It can be seen that the ring-shaped body 10 is one of the main components for enabling the motion recognition system 1 to be configured as a wearable device. Referring to fig. 2, the ring body 10 is used to cover a movable portion of a user. For example, the movable part may be any body part of the user that facilitates movement by muscle contraction, such as a hand limb or a leg limb, and in any case, the invention is not limited to the type of movable part.
In addition, as shown in fig. 2, the appearance of the ring body 10 can be divided into an inner ring side 10a and an outer ring side 10b, wherein the ring body 10 can be a combination of a chain body and a buckle ring made of special materials or adjustable length, and the size of the ring body 10 can be adjusted according to the position and size of the sleeved movable portion, so that the ring body 10 is not easily loosened or dropped when the ring body 10 is sleeved on the movable portion of the user. In summary, the present invention is not limited to the detailed implementation of the annular body 10, and the design of the annular body 10 can be performed by those skilled in the art according to actual needs or applications.
On the other hand, based on the above teachings, those skilled in the art should understand that the wearable device configured by the motion recognition system 1 is not necessarily ring-shaped. In other words, the main body is not easy to be loosened or dropped, and can be easily worn on a movable part of a user. Therefore, the design of the body appearance can be performed by those skilled in the art according to the actual needs or applications. The following manner of using the ring-shaped body is merely exemplary, and not intended to limit the present invention.
In this regard, the following will be described using the example of fig. 3, but the present invention is not limited thereto. The ring-shaped body 10 may be used to be sleeved on the wrist 2 of the user and attached to the surface of the wrist 2 by the inner ring side 10a, wherein the motion recognition system 1 provided in the embodiment of the present invention generates a sensing signal by sensing the change of the muscle at the wrist 2, and determines the motion of the user, such as the motion of each finger or the up-and-down bending, left-and-right moving, gripping, opening, and rotating motions of the palm according to the sensing signal.
One end of the light emitting unit 12 is exposed to the inner ring side 10a of the ring-shaped body 10 and is used for providing the first light beam to irradiate at least one part of the wrist 2. In detail, the light emitting unit 12 may be any semiconductor electronic element capable of emitting light, such as a light emitting diode. In short, the present invention is not limited to the kind of the light emitting unit 12.
It should be noted that the positions or the number of the light emitting units 12 disposed on the annular body 10 are not limited to the positions or the number illustrated in fig. 2 and 3. In terms of design, if the muscle change at the wrist 2 is sensed for convenience, the light-emitting unit 12 may be disposed at a position where the wrist 2 has more muscle groups as described above. In addition, the number of the light emitting units 12 may be increased as required in order to recognize more subtle operations. In summary, the present invention is not limited by the location and number of the light emitting units 12.
One end of the light sensing unit 14 is also exposed to the inner ring side 10a of the ring-shaped body 10, and is configured to sense the second light beam generated by the at least one portion of the wrist 2 reflecting the first light beam, and accordingly generate a light sensing signal. For example, the light sensing unit 14 may be any light sensor, such as a photoplethysmography (PPG) sensor, and the light sensing signal is obtained by the PPG sensor, and the signal obtained by sensing the change of the reflected light is recorded based on the principle that the light sensing element absorbs the energy of the reflected light. Therefore, compared with the conventional SEMG sensor using the myoelectric signal representation, the PPG sensor mainly uses the light sensing muscle changes to generate the light sensing signal, which is less susceptible to the power noise and EMI, thereby providing more effective and accurate motion recognition.
It should be noted that the number or the positions of the light sensing units 14 on the ring body 10 are not limited to those illustrated in fig. 2 and 3. In design, if the second light beam generated by the first light beam reflected by the wrist 2 is collected conveniently, the light sensing units 14 may be disposed near the light emitting unit 12 as described above, or the number of the light sensing units 14 may be increased as required. In summary, the present invention does not limit the light sensing units 14 to be the same as the light emitting units 12. In addition, the present invention does not limit the type of the photo sensing unit 14.
The motion recognition module 16 is used for determining the motion of the user according to the light sensing signal. It should be noted that the motion recognition module 16 may be directly built in the ring body 10, or disposed in another housing (not shown) externally connected to the ring body 10. In summary, the present invention is not limited by the location of the motion recognition module 16.
For example, the motion recognition module 16 may be any central processing unit with sufficient computing capability to perform computing and analyzing on the received light sensing signal, so as to establish a corresponding characteristic value vector for subsequent motion recognition. The mapping between the feature value vectors and the actions may be recorded in a lookup table, and the lookup table may be stored in a memory space built in the action recognition module 16 or stored in a memory device (not shown) externally connected to the action recognition module 16 for the action recognition module 16 to query (look up). It should be noted that the present invention is not limited to the detailed implementation of the determining operation by the operation identifying module 16, and those skilled in the art can design the operation according to actual requirements or applications.
Specifically, when the motion recognition module 16 performs operation and analysis on the received light sensing signal to create a feature value vector, the look-up table is queried to find that the motion corresponding to the feature value vector is a palm grip, and then the motion recognition module 16 can determine that the current motion of the user is a "palm grip". Or, assuming that another eigenvalue vector is established, the action corresponding to the eigenvalue vector can be found as a V-shaped gesture (i.e. the finger is represented as a V-shape) through the query of the lookup table, and then the action recognition module 16 can determine the current action of the user as a "V-shaped gesture". In summary, the above mentioned table lookup method is only used as an example and not to limit the present invention.
On the other hand, the motion recognition system 1 may wish to further determine the displacement or the rotation direction and angle of the wrist 2 for more accurate motion recognition. Therefore, referring to fig. 4, fig. 4 is a functional block diagram of an action recognition system 4 according to another embodiment of the present invention. Compared to the motion recognition system 1 in fig. 1, the motion recognition system 4 may further include a gravity sensing module 40 and/or a gyroscope module 42, wherein the gravity sensing module 40 and the gyroscope module 42 may also communicate data with the motion recognition module 16 through a wired or wireless manner. Likewise, the gravity sensing module 40 and the gyroscope module 42 may be built in the ring-shaped body 10 directly or disposed in another housing (not shown) externally connected to the ring-shaped body 10, and in short, the present invention is not limited to the disposition of the gravity sensing module 40 and the gyroscope module 42.
Specifically, the gravity sensing module 40 is used for determining the displacement of the wrist 2, and the gyroscope module 42 is used for determining the rotation direction and angle of the wrist 2. For the user, the motion recognition module 16 can more accurately determine the motion of the user according to the displacement of the wrist 2, the rotation direction and angle of the wrist 2, and the light sensing signal generated by the light sensing unit 14, so that the recognized motion can be more diversified. In addition, regarding the measurement and analysis methods of the gravity sensing module 40 and the gyroscope module 42, those skilled in the art can design them according to actual requirements or applications, and therefore, the detailed description thereof is omitted here.
In addition, as mentioned above, since the light sensing unit 14 generates the light sensing signal by collecting the light beam reflected by the muscle change with the light sensing element, the sensitivity of the light sensing unit 14 to the light is very high. Therefore, the motion recognition system 4 may further include a light source controller 44, wherein the light source controller 44 may be disposed in the annular body 10 and electrically connected to the light emitting unit 12 to control the brightness of the first light beam provided by the light emitting unit 12.
On the other hand, according to the above teachings, a person skilled in the art should be able to generalize several specific implementations of the motion recognition system 1. As mentioned above, the motion recognition system 1 can be implemented by a wearable device, or a system formed by a wearable device and another electronic device. Therefore, please refer to fig. 5 and fig. 6 together, wherein fig. 5 is a functional block diagram of a wearable device formed by an action recognition system according to another embodiment of the present invention, and fig. 6 is an appearance schematic diagram of a wearable device formed by an action recognition system according to another embodiment of the present invention. In addition, the same elements as those in fig. 1 in fig. 5 and 6 are denoted by the same reference numerals, and thus the details thereof will not be described herein.
Specifically, the ring-shaped body 10, the light-emitting unit 12, the light-sensing unit 14 and the motion recognition module 16 may constitute the wearable device 5 a. In addition, the action recognition system 5 further includes a processing module 50 also disposed in the wearable device 5a, and the processing module 50 is configured to control the wearable device 5a to execute the function corresponding to the action determined by the action recognition module 16.
Further, since each action can be represented as a corresponding function executed by the wearable device 5a, when the action recognition module 16 determines the action of the user, the action determination result is simultaneously output to the processing module 50, so that the processing module 50 can control the corresponding function executed by the wearable device 5a according to the action determination result.
For example, other application modules, such as the multimedia module 52, may be disposed in the wearable device 5a, or a display screen 54 may be disposed on the wearable device 5a for selectively displaying related multimedia information. Therefore, when the wearable device 5a is currently executed as an application for playing music in the multimedia module 52, the action of the user can be directly determined by the action recognition module 16, so that the processing module 50 can control the multimedia module 52 in the wearable device 5a according to the determination result of the action to execute corresponding various functions, such as functions of playing front/back, switching pages, connecting or disconnecting a call, pausing, fast forwarding/fast rewinding or volume turning up/down. In summary, the manner of controlling the wearable device 5a to execute the function corresponding to the determined action by the processing module 50 is only used for example, and is not intended to limit the present invention.
In addition, please refer to fig. 7 and fig. 8, wherein fig. 7 is a functional block diagram of a wearable device composed of an action recognition system according to another embodiment of the present invention, and fig. 8 is a schematic usage diagram of the action recognition system according to another embodiment of the present invention. In addition, the same elements as those in fig. 1 in fig. 7 and 8 are denoted by the same reference numerals, and thus the details thereof will not be described herein.
Specifically, the motion recognition system 7 further includes a transmission unit 70, and the transmission unit 70 transmits the light sensing signal to the motion recognition module 16 in a wired or wireless manner. The ring-shaped body 10, the light-emitting unit 12, the light-sensing unit 14 and the transmission unit 70 constitute a wearable device 7 a. Therefore, compared to the wearable device 5a in fig. 5, the wearable device 7a does not include the motion recognition module 16.
Further, the motion recognition system 7 may further include an electronic device 7b, and the motion recognition module 16 is disposed in the electronic device 7 b. The electronic device 7b may be an intelligent communication device, a tablet computer, a desktop computer, a notebook computer, etc., or other electronic products with computing functions, such as a multimedia playing device, etc., and in short, the invention is not limited by the type of the electronic device 7 b.
As described above, since the wearable device 7a only transmits the light sensing signal to the motion recognition module 16 in the electronic device 7b through the transmission unit 70, compared to the wearable device 5a in fig. 5, the wearable device 7a does not actively determine the motion of the user, but instead determines the motion of the user through the motion recognition module 16 built in the electronic device 7 b. Therefore, when the action recognition module 16 determines the action of the user, the electronic device 7b executes the function corresponding to the action.
For example, the electronic device 7b is a multimedia playing device, wherein each action of the user can be represented as a corresponding function performed by the electronic device 7b, such as playing forward/backward, pausing, fast-forwarding/fast-rewinding or volume-up/down. Therefore, after the wearable device 7a transmits the light sensing signal to the motion recognition module 16 in the electronic device 7b through the transmission unit 70, the motion recognition module 16 can determine the motion of the user, and the electronic device 7b can execute various corresponding functions according to the motion determination result. In summary, the manner of using the motion recognition module 16 to control the electronic device 7b to execute the function corresponding to the determined motion is only for example and is not intended to limit the present invention.
In summary, the motion recognition system provided in the embodiments of the present invention mainly generates the sensing signal by the light sensing muscle change, so that the motion recognition system is less affected by power noise and EMI, and has more measurable positions and better convenience, thereby achieving better motion recognition.
To further explain the operation flow of the motion recognition system, the present invention further provides an embodiment of the motion recognition method. Referring to fig. 9, fig. 9 is a flowchart illustrating an action recognition method according to an embodiment of the present invention. The method of the present embodiment can be performed by the motion recognition systems 1, 4, 5, and 7 shown in fig. 1, 4, 5, and 7, so please refer to fig. 1, 4, 5, and 7 together for understanding. In addition, the detailed step flow is as described in the foregoing embodiments, which are only summarized here and not described in detail.
First, in step S901, a first light beam is provided by a light emitting unit to irradiate at least a portion of the movable portion, wherein one end of the light emitting unit is exposed to an inner ring side of the ring-shaped body. Then, in step S903, the light sensing unit senses a second light beam generated by the at least one portion of the movable portion reflecting the first light beam, and generates a light sensing signal according to the second light beam, wherein one end of the light sensing unit is exposed to the inner ring side of the ring-shaped body. Finally, in step S905, the motion recognition module is used to determine the motion of the user according to the light sensing signal.
On the other hand, please refer to fig. 10, in which fig. 10 is a flowchart illustrating an action recognition method according to another embodiment of the present invention. The same process steps in fig. 10 as in fig. 9 are denoted by the same reference numerals and therefore their details are not described in detail here. Compared to the motion recognition method of fig. 9, the motion recognition method of fig. 10 also takes into account the displacement, rotation direction, and angle of the movable portion. However, the following is only one detailed implementation of the motion recognition method, and is not intended to limit the invention.
The motion recognition method described in the embodiment of fig. 10 can be implemented in the motion recognition system 4 shown in fig. 4, so please refer to fig. 4 for understanding. In addition, the detailed step flow is as described in the foregoing embodiments, which are only summarized here and not described in detail.
Steps S901 and S903 of fig. 10 are the same as steps S901 and S903 of fig. 9. In step S101, the displacement of the movable portion is determined by the gravity sensing module and/or the rotation direction and angle of the movable portion are determined by the gyroscope module. In step S103, the motion recognition module is used to determine the motion of the user according to the displacement and/or rotation direction and angle and the light sensing signal.
In another aspect, the motion recognition system may be implemented by a wearable device alone, or a system formed by the wearable device and another electronic device. Therefore, several detailed implementations of the motion recognition methods executed in the motion recognition systems 5 and 7 shown in fig. 5 and 7 will be described in detail below, which are not intended to limit the invention.
Referring to fig. 11, fig. 11 is a flowchart illustrating an action recognition method according to another embodiment of the present invention. The motion recognition method described in the embodiment of fig. 11 can be implemented in the motion recognition system 5 shown in fig. 5, so please refer to fig. 5 for understanding. In addition, the detailed step flow is as described in the foregoing embodiments, which are only summarized here and not described in detail.
Steps S901, S903, and S905 in fig. 11 are the same as steps S901, S903, and S905 in fig. 9. In step S111, the processing module controls the wearable device to execute a function corresponding to the operation.
In addition, referring to fig. 12, fig. 12 is a schematic flow chart of an action recognition method according to another embodiment of the present invention. The motion recognition method described in the embodiment of fig. 11 can be implemented in the motion recognition system 7 shown in fig. 7, so please refer to fig. 7 for understanding. In addition, the detailed step flow is as described in the foregoing embodiments, which are only summarized here and not described in detail.
Steps S901, S903, and S905 in fig. 12 are the same as steps S901, S903, and S905 in fig. 9. In step S121, the transmission unit transmits the light sensing signal to the motion recognition module in a wired or wireless manner. In step S123, the electronic device executes a function corresponding to the operation.
In summary, the motion recognition system and the method thereof provided by the embodiments of the present invention mainly generate the sensing signal by the photo sensing muscle change, so that the system is less affected by power noise and EMI, and has more measurable positions and better convenience, thereby achieving better motion recognition.
The above description is only an embodiment of the present invention, and is not intended to limit the scope of the present invention.
Claims (20)
1. An action recognition system, comprising:
a ring-shaped body for fitting over a body part of a user having muscle contraction to facilitate exercise;
at least one light emitting unit located at an inner ring side of the ring-shaped body and used for providing a first light beam to irradiate the body part;
at least one light sensing unit, which is positioned at the inner ring side of the annular body and is used for sensing a second light beam generated by the reflection of the first light beam by the body part and generating a light sensing signal according to the second light beam; and
the motion recognition module is used for judging a motion of the user according to the light sensing signal, wherein the annular body is sleeved on the wrist of the user and attached to the surface of the wrist by the inner ring side, the motion recognition system generates the sensing signal by sensing the change of muscles at the wrist and judges the motion of the user according to the sensing signal, and the motion comprises the motion of each finger of the user or the vertical bending, the left and right movement, the tight holding, the opening and the rotation of the palm of the user.
2. The motion recognition system of claim 1, wherein the light emitting unit is a light emitting diode.
3. The motion recognition system of claim 1, wherein the light sensing unit is a light volume sensor.
4. The motion recognition system of claim 1, further comprising a light source controller disposed on the annular body and electrically connected to the light-emitting unit for controlling the brightness of the first light beam of the light-emitting unit.
5. The motion recognition system of claim 1, further comprising a gravity sensor module and/or a gyroscope module, wherein the gravity sensor module is configured to determine a displacement of the wrist, the gyroscope module is configured to determine a rotation direction and an angle of the wrist, and the motion recognition module determines the motion of the user according to the displacement and/or the rotation direction and the angle and the light sensing signal.
6. The motion recognition system of claim 1, wherein the ring body, the light emitting unit, the light sensing unit and the motion recognition module form a wearable device.
7. The system of claim 6, wherein the motion recognition system further comprises a processing module disposed in the wearable device for controlling the wearable device to execute a function corresponding to the motion.
8. The motion recognition system of claim 1, further comprising a transmission unit for transmitting the light sensing signal to the motion recognition module in a wired or wireless manner, wherein the ring body, the light emitting unit, the light sensing unit and the transmission unit form a wearable device, and the motion recognition module is located outside the wearable device.
9. The motion recognition system of claim 8, wherein the motion recognition system further comprises an electronic device, and the motion recognition module is disposed in the electronic device, and the electronic device is configured to execute a function corresponding to the motion.
10. A motion identification method is suitable for a motion identification system, wherein the motion identification system comprises an annular body, at least one light-emitting unit, at least one light sensing unit and a motion identification module, the annular body is used for being sleeved on a wrist of a user, and the motion identification method is characterized by comprising the following steps of:
providing a first light beam to irradiate at least one part of the wrist by using the light-emitting unit, wherein one end of the light-emitting unit is exposed out of one inner ring side of the annular body;
sensing a second light beam generated by the first light beam reflected by the wrist of the user by using the light sensing unit, and generating a light sensing signal according to the second light beam, wherein one end of the light sensing unit is exposed out of the inner ring side of the annular body; and
and judging a motion of the user by using the motion identification module according to the light sensing signal, wherein the motion identification system generates the sensing signal by sensing the change of muscles at the wrist and judges the motion of the user according to the sensing signal, and the motion comprises the motion of each finger of the user or the vertical bending, the left-right movement, the gripping, the opening and the rotation of the palm of the user.
11. The method of claim 10, wherein the light emitting unit is a light emitting diode.
12. A method for motion recognition according to claim 10, wherein the light sensing unit is a light volume measurement sensor.
13. The method of claim 10, wherein the motion recognition system further comprises a light source controller disposed on the ring body, and the motion recognition method further comprises:
and controlling the brightness of the first light beam of the light-emitting unit by using the light source controller.
14. A method for recognizing motion as claimed in claim 10, wherein the motion recognition system further comprises a gravity sensing module and/or a gyroscope module, and the method further comprises:
judging a displacement of the wrist by using the gravity sensing module and/or judging a rotation direction and an angle of the wrist by using the gyroscope module;
the motion recognition module judges the motion of the user according to the displacement and/or the rotation direction and angle and the light sensing signal.
15. The motion recognition method according to claim 10, wherein the ring body, the light emitting unit, the light sensing unit and the motion recognition module form a wearable device.
16. The method of claim 15, wherein the motion recognition system further comprises a processing module disposed in the wearable device, and the motion recognition method further comprises:
and controlling the wearable device to execute the function corresponding to the action by utilizing the processing module.
17. The motion recognition method of claim 10, wherein the motion recognition system further comprises a transmission unit, the ring body, the light emitting unit, the light sensing unit and the transmission unit form a wearable device, the motion recognition module is located outside the wearable device, and the motion recognition method further comprises:
the transmission unit is used for transmitting the light sensing signal to the action identification module in a wired or wireless mode.
18. The method of claim 17, wherein the motion recognition system further comprises an electronic device, the motion recognition module is disposed in the electronic device, and the motion recognition method further comprises:
and executing the function corresponding to the action by using the electronic device.
19. An action recognition system, comprising:
a body for wearing on a wrist of a user;
at least one light emitting unit located at an inner side of the body and used for providing a first light beam to irradiate the wrist of the user;
at least one light sensing unit, which is positioned at the inner side of the body and is used for sensing a second light beam generated by the first light beam reflected by the wrist muscle change of the user and generating a light sensing signal according to the second light beam;
the motion identification module is used for judging a motion of the hand of the user according to the light sensing signal generated by the muscle change; and
a display screen for selectively displaying related multimedia information, wherein when the action recognition system executes an application for playing music in a multimedia module, the action recognition module directly judges the action of the user to control the multimedia module on the display screen so as to execute corresponding various functions, and the functions comprise playing front/back, page switching, call connection or hang-up, pause, fast turn/fast back or volume turning up/down.
20. The motion recognition system of claim 19, further comprising a light source controller disposed in the body and electrically connected to the light-emitting unit for controlling the brightness variation of the first light beam provided by the light-emitting unit.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111192562.7A CN113768497A (en) | 2015-05-04 | 2015-05-04 | Action recognition system and method thereof |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201510220779.2A CN106200887A (en) | 2015-05-04 | 2015-05-04 | Action recognizing system and method thereof |
| CN202111192562.7A CN113768497A (en) | 2015-05-04 | 2015-05-04 | Action recognition system and method thereof |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510220779.2A Division CN106200887A (en) | 2015-05-04 | 2015-05-04 | Action recognizing system and method thereof |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN113768497A true CN113768497A (en) | 2021-12-10 |
Family
ID=57458662
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111192562.7A Pending CN113768497A (en) | 2015-05-04 | 2015-05-04 | Action recognition system and method thereof |
| CN201510220779.2A Pending CN106200887A (en) | 2015-05-04 | 2015-05-04 | Action recognizing system and method thereof |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201510220779.2A Pending CN106200887A (en) | 2015-05-04 | 2015-05-04 | Action recognizing system and method thereof |
Country Status (1)
| Country | Link |
|---|---|
| CN (2) | CN113768497A (en) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100145171A1 (en) * | 2008-12-05 | 2010-06-10 | Electronics And Telecommunications Research Institute | Apparatus for measuring motion noise robust pulse wave and method thereof |
| US20110054360A1 (en) * | 2009-08-27 | 2011-03-03 | Electronics And Telecommunications Research Institute | Finger motion detecting apparatus and method |
| CN103268153A (en) * | 2013-05-31 | 2013-08-28 | 南京大学 | Human-computer interactive system and man-machine interactive method based on computer vision in demonstration environment |
| CN103581428A (en) * | 2012-07-27 | 2014-02-12 | Lg电子株式会社 | Terminal and control method thereof |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101561708B (en) * | 2008-04-15 | 2012-09-05 | 宏碁股份有限公司 | Method for sensing and judging input mode by utilizing actions and input device thereof |
| CN103246344A (en) * | 2012-02-02 | 2013-08-14 | 联想(北京)有限公司 | Method for controlling electronic device and electronic device |
| KR102170321B1 (en) * | 2013-06-17 | 2020-10-26 | 삼성전자주식회사 | System, method and device to recognize motion using gripped object |
| CN103654774B (en) * | 2014-01-02 | 2016-08-17 | 北京思睿博创科技有限公司 | Wearable movable bracelet |
| CN103885590A (en) * | 2014-03-10 | 2014-06-25 | 可牛网络技术（北京）有限公司 | Method and user equipment for obtaining user instructions |
-
2015
- 2015-05-04 CN CN202111192562.7A patent/CN113768497A/en active Pending
- 2015-05-04 CN CN201510220779.2A patent/CN106200887A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100145171A1 (en) * | 2008-12-05 | 2010-06-10 | Electronics And Telecommunications Research Institute | Apparatus for measuring motion noise robust pulse wave and method thereof |
| US20110054360A1 (en) * | 2009-08-27 | 2011-03-03 | Electronics And Telecommunications Research Institute | Finger motion detecting apparatus and method |
| CN103581428A (en) * | 2012-07-27 | 2014-02-12 | Lg电子株式会社 | Terminal and control method thereof |
| CN103268153A (en) * | 2013-05-31 | 2013-08-28 | 南京大学 | Human-computer interactive system and man-machine interactive method based on computer vision in demonstration environment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106200887A (en) | 2016-12-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20210181855A1 (en) | Systems, apparatuses and methods for controlling prosthetic devices by gestures and other modalities | |
| US11231786B1 (en) | Methods and apparatus for using the human body as an input device | |
| US10397686B2 (en) | Detection of movement adjacent an earpiece device | |
| US11016569B2 (en) | Wearable device and method for providing feedback of wearable device | |
| AU2013347935B2 (en) | Computing interface system | |
| CN112424730A (en) | Computer system with finger device | |
| US11969243B2 (en) | Action recognition system and method thereof | |
| Bainbridge et al. | Wireless hand gesture capture through wearable passive tag sensing | |
| TWI635419B (en) | Gesture input device | |
| CN112189178A (en) | Sensor for electronic finger device | |
| WO2021227651A1 (en) | Finger action acquisition method and finger action acquisition device | |
| KR20050047329A (en) | Input information device and method using finger motion | |
| Devrio et al. | DiscoBand: Multiview Depth-Sensing Smartwatch Strap for Hand, Body and Environment Tracking | |
| Calvo et al. | Pointing devices for wearable computers | |
| KR20130061777A (en) | Signal input device by activity of fingers | |
| CN113768497A (en) | Action recognition system and method thereof | |
| WO2018020513A1 (en) | A system for recognizing muscle activities and method thereof. | |
| CN209265388U (en) | Finger equipment | |
| Sharma et al. | A Gesture based Remote Control for Home Appliances | |
| TW201640278A (en) | Action recognizing system and method | |
| Panduranga et al. | Sensors for virtual musical environment: A short survey | |
| TWI640899B (en) | Contactless gesture determining system for wearable device and determining method thereof | |
| Parizi | Towards Subtle and Continuously Available Input Devices for the Modern Wearable Devices | |
| Rupavatharam | Omnidirectional and blindspot-free pre-touch sensing systems | |
| Tamaki et al. | Gesturenail: Wireless Hand Gesture System |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |