KR20190063048A - Wristwatch Capable of Recognizing Hand-Motion By Using Strain Gauges and Recognition Method thereof - Google Patents

Abstract

A wrist watch capable of recognizing a motion using a strain gauge and a motion recognition method thereof are disclosed. The wrist watch of the present invention can recognize a motion combined with a spatial movement of a wrist and a hand shape, and can recognize a continuous motion with a previously registered control command.

Description

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a wristwatch and a wristwatch capable of recognizing motion using a strain gauge,

The present invention relates to a wrist watch capable of recognizing motion using a strain gauge while being a wrist watch, and a motion recognition method thereof.

With the development of sensor technology, motion recognition technology has been developing rapidly in recent years and leading to the development of derivative technologies in related fields.

For example, augmented reality is a field of virtual reality, which is a computer graphics technique that combines virtual objects or information into a real environment to make it look like objects in the original environment. A wearable type motion recognition device worn by the user on the wrist or the like is used in the virtual augmented reality field, thereby realizing a much stronger virtual reality or augmented reality. Known for its virtual augmented reality are Google Glass, Samsung Gear Virtual Reality, Ocurus VR acquired by Facebook, and Google's Smart Contact Lens.

According to ABI, a research firm specializing in wearable devices, the wearable market is expected to grow more than 10 times faster than 2013 in 2018, with Smart Band products accounting for 25% of all wearable devices Which will take up a large portion of the total. It is emphasized the importance of wearable devices that are always connected with users in a situation of evolving into a world of intelligent all-internet internet that is fused with people, objects, and virtual worlds. However, there is no wearable device based input device that can control the functions of virtual augmented reality devices.

The wearable device for the virtual augmented reality to which the present invention belongs can be used in various ways. For example, in the fields of orthopedics and rehabilitation medicine, the physician can accurately recognize and diagnose the behavior of the patient by using the wearable device worn by the patient. In the field of computer games, especially simulation games, a wearable device can be used as a means to recognize the gestures or actions of gamers. Since these wearable devices act as means for connecting the three-dimensional physical space with the virtual space, the virtual reality can be sensed realistically, and the wearable device can guarantee the user's free activity. In addition, as a means of interface for controlling various electronic devices, a motion-recognizable wired device can be developed in the future.

Nevertheless, there is no wearable device based input means capable of controlling the functions of the virtual augmented reality system.

[Related Prior Art]

The present invention relates to a sensor array including a plurality of sensors each sensing a physical change of a skin region of a body region, And a body motion determiner for determining a motion of a body part based on the sensing signals received from the plurality of sensors.

An object of the present invention is to provide a wristwatch capable of recognizing motion using a strain gauge and a motion recognition method thereof.

In order to attain the above object, the wristwatch according to the present invention recognizes a hand gesture to be worn on the wrist. The watch of the present invention includes a clock display unit, a first sensor unit, a second sensor unit, a control unit, and a bracelet-type body, and is worn on the wrist in a form in close contact with the inside of the wrist.

The clock display part displays the current time. The first sensor portion includes a plurality of strain gauges arranged in a line across the wrist of the user along the wrist strap to output a resistance value corresponding to the morphological strain of the user's lateral wrist ligament portion along the wrist. The second sensor unit recognizes the movement of the wrist in the space.

The control unit recognizes the shape of the hand (first operation) based on the patterns of the resistance values of the plurality of strain gauges of the first sensor unit, and based on the output of the second sensor unit, ), And recognizes as a control instruction of the user when the at least one first operation and the at least one second operation are connected in a predetermined pattern.

According to an embodiment, the at least one first operation may include different forms of the first-first operation and the first-second operation. In this case, the control unit may recognize the control operation as the control command of the user when the second operation and the 1-2 operation are sequentially connected at the start of the 1-1 operation.

Furthermore, when the first operation is continuously recognized even while the second operation is being recognized, the control unit recognizes the first operation as the control command of the user when the operation of the first operation is switched to the operation of the first operation And may not recognize the control operation as the control instruction of the user when the first operation is not recognized during the recognition of the second operation.

According to another embodiment, the wristwatch of the present invention may further include a magnet provided at one end of the wristwatch, which is disposed on both sides of the wristwatch main body. The wrist strap is made of a magnetic material, and the magnet is attached to the other side of the wrist strap by a magnetic force, so that the wrist strap can be brought into close contact with the wrist ligament.

The present invention also relates to a motion recognition method of a wristwatch worn on a wrist. The motion recognition method of the present invention comprises the steps of: (a) wearing the wristwatch having the first sensor part and the second sensor part on the wrist, wherein a plurality of strain gauges are disposed at positions opposite to the inner part of the wrist on which the wrist ligament is located, The wristwatch is worn so as to be arranged in a line across the wrist, the first sensor part having a plurality of strain gauges, and the second sensor part recognizing movement in space of the wrist; (b) a plurality of strain gauges of the first sensor unit have a resistance value corresponding to a morphological deformation of the inner part of the wrist according to a hand shape, Recognizing the shape of the hand (first operation) based on the pattern of the resistance value of the hand; (c) the control unit recognizing the operation of the wrist (second operation) in space based on the output of the second sensor unit; (d) recognizing the control instruction as a control instruction of the user when the at least one first operation and the at least one second operation are connected in a predetermined pattern.

The clock of the present invention can recognize a motion combined with the spatial movement of the hand and the wrist, and can recognize the continuous motion as a previously registered control command. Furthermore, in the case where the wristwatch is composed of a watch body and a wristwatch, the wristwatch can be implemented in various ways by inserting a circuit part related to motion recognition into the wristwatch main body.

In addition, by using the method of fixing the wristwatch of the wristwatch using a magnet, the strain gauge can be easily mounted on the wristwatch, and the wristwatch can be easily worn by closely contacting the wrist wrist of the wrist .

BRIEF DESCRIPTION OF THE DRAWINGS Figure 1 is a view of a watch of the present invention,
2 is a block diagram of a clock of the present invention,
3 is a graph exemplarily showing changes in resistance values of a plurality of strain gauges due to deformation of the inner part of the wrist,
4 shows an example of a user control command combined with a hand shape and a hand operation, and
5 is a flowchart provided in an operation description of a clock of the present invention.

BEST MODE FOR CARRYING OUT THE INVENTION The present invention will be described in more detail with reference to the drawings.

5 (b) is a partially cutaway view of the wristwatch 100 of the present invention, and Fig. 5 (c) is a view showing the wrist watch 100 according to the present invention. Fig. (100) is worn on the wrist. Referring to FIGS. 1 and 2, the watch 100 of the present invention is worn on the wrist and includes a watch body 110 and a watch band 130. Particularly, the wristwatch 100 of the present invention can recognize the wearer's hand shape (first movement) and the wrist space motion (second movement). Based on this recognition, the user can input the control command of the user using the wristwatch 100 of the present invention.

2, the wristwatch 100 of the present invention includes a clock display unit 111, a power unit 201, a wireless communication interface 203, a first sensor unit 205, a second sensor unit 207, (210). The clock display unit 111, the power supply unit 201, the wireless communication interface 203 and the control unit 210 are provided on the watch body 110 and the first sensor unit 205 is provided on the watch strap 130. The second sensor unit 207 may be provided on the watch body 110 or on the watch band 130.

The clock display unit 111 is a basic configuration for operating the wrist watch 100 of the present invention as a clock, and may be any form capable of displaying time. For example, the clock display unit 111 may include a movement and a dial, and may include a display unit and a circuit unit such as an electronic clock. In the case of an electronic clock, the circuit unit may be integrated with the control unit 210 described below or may be provided in a separate configuration.

The power supply unit 201 includes a battery (not shown) to supply the operating power of the wrist watch 100.

The wireless communication interface 203 is a means for communicating with an external device (not shown) according to a wireless communication protocol, and can use a protocol such as Bluetooth, wireless LAN, Zigbee, or the like. The wireless communication interface 203 may provide an external device (not shown) with a code or control command corresponding to the hand and / or wrist motion of the user who is motion-recognized by the control unit 210. [ When the clock display unit 111 is an electronic clock, the wireless communication interface 203 can be shared by the clock display unit 111 and the control unit 210.

The first sensor unit 205 includes a plurality of strain gauges 101. Referring to FIGS. 1B and 1C, the first sensor unit 205 is located at a portion of the wristband 130 which is in close contact with the wrist inner portion 10a, and the plurality of strain gauges 101 Are placed in line across the wrist (i.e., in parallel with the lateral wrist ligaments). The wearer should wear the first sensor portion 205 so that the first sensor portion 205 is positioned on the inner wrist portion 10a, i.e., the lateral wrist ligament portion, when the wristwatch 100 is worn.

The inner part of the wrist (10a) is where the position and shape of the bones and muscles change with the shape of the hand. For example, when you hold your fist, only the index finger and the stop finger open your hands, you make a scissors shape, you pinch your fingers like a ball, you put your hands on your hands, The shape of the wrist inner portion 10a is slightly different.

The strain gauge is a device in which the resistance of the conductive pattern inside the sensor increases when the tension is applied and the resistance decreases when the stress is applied. Therefore, as shown in Fig. 1, the resistance values of the plurality of strain gauges 101 arranged in a line in the wrist inner part 10a are different from each other depending on the morphological change of the inner part of the wrist according to the hand shape.

The controller 210 reads a plurality of resistance values provided by the first sensor unit 205 to recognize the shape change of the inner part 10a of the wrist and compare the shape of the inner part 10a with the predetermined shape change . Referring to FIG. 3, it can be seen that the resistance values of the plurality of strain gauges 101 vary according to various hand shapes. 3, the vertical axis represents the magnitude of the resistance value, and the horizontal axis represents each of the plurality of strain gages. The actual magnitude of the resistance value of the vertical axis is not important in the present invention and is not shown because it may vary according to the embodiment, and is a graph for showing that the resistance value changes according to the shape of the hand. Therefore, the magnitude of the individual resistance value of the plurality of strain gauges 101 of the first sensor unit 205, or the relative change of the plurality of resistance values such as the graph of FIG. 3, ).

A plurality of strain gauges 101 arranged in a line in the watch band 130 may be arranged in the form of a wrist strap 130 or at least a plurality of strain gauges 101 in order to change the resistance value according to the morphological change of the wrist inner portion 10a. Should have a structure in which a change in the wrist inner portion 10a can be transmitted to the plurality of strain gauges 101. [

The plurality of strain gauges 101 can be made by coating a stretchable conductive material such as silver (Ag) nanowire or carbon nanotube (CNT) on a stretchable PCB. For example, Korean Patent Publication No. 10-2011-0105026 of Korea Research Institute of Standards and Science (titled: force or pressure sensor array using semiconductor strain gauge, method of manufacturing force or pressure sensor array, and force using force or pressure sensor array Or a pressure measuring method).

The second sensor unit 207 is a motion sensor for recognizing the movement (second movement) in the space of the wrist, and recognizes the posture and the motion of the wrist in space. The second sensor unit 207 is preferably an inertial measurement unit (IMU) having an acceleration sensor, a gyro sensor and a geomagnetic sensor as one module. Unlike the first sensor unit 205, the position of the second sensor unit 207 does not need to be specially specified, so it may be located anywhere in the watch body 110 or the wristband 130. It is sufficient for the user to wear the wristwatch 100 so that the first sensor portion 205 is positioned at the inner wrist portion 10a or the lateral wrist ligament portion, There is no need to consider the location.

Here, it is preferable that the acceleration sensor is a sensor that is the basis of the angle measurement and is used to measure and output the linear acceleration value in three or more axes (X, Y, Z axis). It is preferable to use a gyro sensor that measures and outputs a rotational angular velocity at least at three or more axes.

As described above, the control unit 210 may be implemented integrally with the circuit in the clock display unit 111, but the following description is limited to the operation for controlling the motion recognition of the wristwatch 100. [ In particular, the control unit 210 includes a first motion recognition unit 211, a second motion recognition unit 213, and a control command recognition unit 215 to recognize a user control command based on a user's hand shape and hand motion .

The first operation recognition unit 211 recognizes the shape of the hand (first operation) based on the pattern of the resistance values of the plurality of strain gauges 101 of the first sensor unit 205. At this time, recognition of the shape of the hand may correspond to confirming the first code mapped to the shape of the hand. The first operation recognition unit 211 provides the first code identified by the resistance value of the first sensor unit 205 to the control command recognition unit 215. [

The second motion recognition unit 213 recognizes the operation of the wrist (second operation) on the space based on the output of the second sensor unit 207 and outputs the second code mapped to the operation to the control command recognition unit 215).

The control command recognizing unit 215 recognizes at least one first operation (i.e., first code) recognized by the first operation recognizing unit 211 and at least one second operation recognized by the second operation recognizing unit 213 (I.e., the second code) is continuously connected in a predetermined pattern, and recognizes the result as a control command of the user. Since the present invention is characterized by recognizing the combination of the first operation and the second operation as a control command, it is excluded from the present invention to recognize a certain control command by only the first operation or the second operation.

The manner in which the first operation and the second operation are combined and set as a control command can be very diverse. However, it is necessary to distinguish between the daily operation of the user and the operation for the control command. Accordingly, each control command includes a start operation and a termination operation, wherein the start operation is constituted by at least one operation selected from the first operation and the second operation, and the termination operation also includes at least one selected from among the first operation and the second operation Operation. The connection operation may be inserted between the start operation and the termination operation as required, and the connection operation may also be composed of at least one operation selected from the first operation and the second operation.

For example, referring to FIG. 4, when a user first moves a hand in space with an operation like (b) in a hand shape as shown in (a), and a series of continuous motions like a hand like Suppose you register with a control command. The first motion recognition unit 211 recognizes the hand shapes of (a) and (c) and the second motion recognition unit 213 recognizes the posture change of (b) Or not. The control command recognizing unit 215 judges that the registered control command is inputted at the moment when (a) operation → (a) operation state, (b) operation → (c) operation is continuously recognized.

At this time, the start operation is the operation (a) corresponding to the first operation, the termination operation is also the operation (c) corresponding to the first operation, and the connection operation is the operation (a) (B) corresponding to the operation.

Hand motion motion recognition method

Hereinafter, a method of inputting a control command based on the motion recognition method of the wristwatch 100 according to the present invention will be described with reference to FIG.

≪ Input of start operation, connection operation and end operation: S501, S503, S505 >

First, the wristwatch 100 has already registered a plurality of control commands in motion. While the wristwatch 100 is worn by the user and the power is turned on to start the operation, the first motion recognition unit 211 always recognizes the first motion through the first sensor unit 205 The second operation recognition unit 213 always recognizes the second operation through the second sensor unit 207 and outputs the corresponding second code to the control command recognition unit 215. [ And provides it to the recognition unit 215.

<Control command recognition: S507>

The control command recognizing unit 215 recognizes a combination of a first code and a second code which are successively recognized and provided by the first operation recognizing unit 211 and the second operation recognizing unit 213 through steps S501 through S505, When the connection is completed (start operation, end operation) or (start operation, connection operation and termination operation) of a specific control command previously registered, it is determined that the corresponding control command is inputted.

When the control command is recognized, the control command recognizing unit 215 can transmit the control command to an external device such as a user's mobile terminal or a TV, a computer, or an automobile through the wireless communication interface 203. [

Example: Watch band

The watch frame 130 houses the first sensor unit 205 and / or the second sensor unit 207 and supports the watch body 110. The position of the first sensor unit 205 of the watchband 130 when the watch 100 is worn is positioned on the side of the user's lateral wrist of the user, Should be close to the part. Therefore, it is preferable that the wrist strap 130 is in close contact with the wrist as a whole, but it is preferable that the wrist strap 130 has at least a resilient or close structural form that is in close contact with the wrist inner portion 10a.

Typically, the user wears the watch in a somewhat loose form with the wrist strap adjusted to be greater than the width of the wrist. The usual watch strap is a way to puncture one of the watch straps on the watch body and fit the catch on the other watch strap to the hole so that it matches the width of the wrist of the various users and the user's personal taste. Otherwise, use a buckle that connects both watch straps. However, according to the present invention, it is difficult to apply a hole punching method because the first sensor unit 205 is installed on the wrist strap 130, and similarly, it is difficult to appropriately arrange the buckle with the first sensor unit 205.

Therefore, in the present invention, both the watch rings 130 are made of a magnetic material and the magnet 131 is provided at the end of one watch ring 130. The user places the magnets 131 provided at the end of one wrist strap 130 on the other wrist strap 130 on the wrist strap in order to wear the wrist watch 100, As shown in Fig. Such a wearing method is convenient because it is possible to adjust the degree to which the wrist strap 130 is brought into close contact with the lateral wrist ligaments by adjusting the attachment position of the magnet 131. [

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is clearly understood that the same is by way of illustration and example only and is not to be construed as limiting the scope of the invention as defined by the appended claims. It will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present invention.

Claims (5)

CLAIMS 1. A wristwatch comprising a watch body and a wrist strap for supporting the wrist body, the wrist watch comprising:
A first sensor unit including a plurality of strain gauges arranged in a line across the wrist of the user along the wrist strap to output a resistance value corresponding to a morphological strain of the user's lateral wrist ligament part according to the shape of the wrist;
A second sensor for recognizing movement of the wrist in space; And
(First operation) on the basis of a pattern of the resistance values of a plurality of strain gauges of the first sensor unit and detects an operation (second operation) of the wrist on the space based on the output of the second sensor unit And a control unit for recognizing the control command as a user's control command when the at least one first operation and the at least one second operation are connected in a predetermined pattern and is worn on the wrist in close contact with the inner part of the wrist A wrist watch characterized by.
The method according to claim 1,
When the at least one first operation includes different types of the first-first operation and the first-second operation,
Wherein the control unit recognizes, as the control command of the user, when the second operation and the 1-2 operation are sequentially connected at the start of the 1-1 operation.
3. The method of claim 2,
The watch frame supporting the watch body
The first operation is continuously recognized even while the second operation is recognized, and the first operation is recognized as the control instruction of the user when the operation of the first operation is switched to the operation of the first operation, Is not recognized as the control instruction of the user when the first-first operation is not recognized during the recognition of the first-first operation.
The method according to claim 1,
Further comprising a magnet disposed at one end of the wristwatch, the magnet being divided into two portions of the wristwatch main body,
Wherein the wrist strap is made of a magnetic material and is magnetically attached to the other side of the wrist strap so that the wrist strap is brought into close contact with the wrist strap.
A motion recognition method for a wristwatch worn on a wrist,
A wristwatch having a first sensor part and a second sensor part is worn on a wrist, and a plurality of strain gauges are arranged at a position opposite to an inner part of the wrist on which the wrist ligament is located, Wherein the first sensor unit includes a plurality of strain gauges and the second sensor unit recognizes movement of the wrist in a space;
Wherein the control unit of the wristwatch detects a resistance value of a plurality of strain gauges of the first sensor unit as the strain gages of the first sensor unit have a resistance value corresponding to the morphological deformation of the inner part of the wrist along the hand shape, Recognizing the shape of the hand (first operation) based on the pattern of the hand;
The control unit recognizing the operation of the wrist (second operation) in space based on the output of the second sensor unit; And
And recognizing the control instruction as a control instruction of the user when the control unit is connected to the at least one first operation and the at least one second operation in a predetermined pattern.

Images