CN211149310U - Wrist formula intelligent device of high recognition rate - Google Patents

Abstract

The utility model discloses a wrist-type intelligent device with a high recognition rate. The wrist-type intelligent device includes a belt part and a wrist-type intelligent terminal. The wrist-type intelligent terminal includes an input device, an output device, a computing device, a storage device and a power supply battery. , the input device collects the infrared image of the wearing hand, and the computing device processes the image to obtain gesture operation information. Different gesture operation information corresponds to different control commands, so that the wrist-type smart device or the wrist-type smart device can be completed with one hand. The control of other devices connected to the smart device greatly improves the convenience and controllability of operation.

Description

A wrist-type smart device with high recognition rate

technical field

The utility model relates to an intelligent control technology, in particular to a wrist-type intelligent device with high recognition rate.

Background technique

With the rapid development of software and hardware-related technologies, wrist-type smart devices, such as smart watches and smart bracelets, are becoming more and more integrated and have more and more functions. There are already many mature wrist-type smart devices on the market that are controlled by touch screen, and many terminal devices, such as mobile phones, can be connected to wrist-type smart devices through Bluetooth modules, so that these can be realized through smart watches, smart bracelets, etc. The control of the terminal greatly simplifies the method for users to receive and transmit information.

However, compared with traditional smart phones, wrist-type smart devices are limited by the small size of the display screen. On the one hand, it is difficult for users to use the touch screen or buttons to complete the operation of related functions, which is easy to cause misoperation. On the other hand, when a wrist-type smart device such as a Bluetooth watch paired with a mobile phone is worn on one hand, it needs to be operated. Except for simple operations such as waking up and sleeping, which do not require the other hand to operate, the rest are more complicated. Both need the help of another hand, and it is impossible to use one hand to operate the wrist-type smart device or the terminal connected to it independently. Therefore, the wrist-type smart device still has great defects in content display and operation, and generally only Being used as an auxiliary peripheral of smart phones makes the practicability not strong enough, which affects the popularization of wrist-type smart devices.

In view of the above technical defects, the prior art CN201310712050 discloses a wearable input device and a wearable input system, including: a receiving device for receiving a first wave signal and a second wave corresponding to the second wave after the signal is transmitted to the receiving device through a transmission medium The signal, the transmission medium includes the user's hand; wherein, the signal characteristics of the second wave signal change with the change of the characteristics of the transmission medium, and are used to determine the corresponding instruction. Wearable devices such as smart watches, smart gloves, smart accessories, etc. The system and method utilize the user's body to realize instruction input, thereby expanding the input area and improving the input capability. The first wave signal and the second wave signal are both ultrasonic signals or electromagnetic wave signals. In fact, the above-mentioned prior art utilizes the variation of different contact positions between the thumb of one hand of the user and other parts of the hand, such as the index finger, middle finger, ring finger and/or little finger, which are divided by the knuckles to generate different contact points. According to the wave signal, different commands are determined according to the change of the wave signal, and during the operation, the degree of correlation between the different contact positions and the different wave signals is weak. high, even the correct transmission of the instruction cannot be performed.

In view of the problems existing in the above-mentioned prior art, the applicant proposes a wrist-type smart device based on gesture recognition technology. By using an infrared camera device to collect image data of the wearing hand, the processor or computing device processes the image and filters the image data. The infrared image data as fine as the finger is obtained, and the corresponding gesture operation information is obtained by analyzing and calculating the infrared image data of the finger.

Utility model content

In order to overcome the above-mentioned defects of existing wrist-type smart devices, a wrist-type smart device with high recognition rate is proposed. The specific technical solutions are:

A wrist-type smart device, the wrist-type smart device includes: a belt component and a wrist-type smart terminal; wherein, the wrist-type smart terminal includes an input device for completing gesture action collection, an output device for display, and a computing device. , a storage device, and a power supply battery; wherein, the input device includes two or more infrared camera devices A, arranged on the side of the main casing of the wrist-type smart terminal, for collecting infrared image data of the wearing hand The computing device is used to perform image processing on the collected infrared image data, calculate and obtain gesture operation information in the collected infrared image data, determine a control command according to the obtained gesture operation information, and perform an The other terminal equipment connected to the wrist-type smart device performs control operations; the storage device stores a database of gesture operation information, and control commands corresponding to the gesture operation information; the power supply equipment controls the input equipment, output equipment, computing equipment, The storage device is powered.

In addition, the input device may further include two or more infrared camera devices B, and the infrared camera devices B are arranged on the side of a part of the belt part opposite to the wrist-type smart terminal, inside the belt part or on the wrist The inside of the buckle includes a flexible PCB board to complete the power supply and information data communication for the infrared camera B.

The input device of the wrist-type smart device may also be only the infrared camera device B.

The computing device performs image processing on the collected infrared image data, and obtains corresponding gesture operation information by calculating the relationship between the infrared image data of the five finger parts.

Preferably, linear simulation is performed on the tracked image data of the five-finger part, five fingers correspond to five polylines, and corresponding gesture operation information is obtained by calculating the relationship between the five polyline data.

As another preferred method, contour simulation is performed on the tracked image data of the five fingers, five fingers correspond to five contour lines, and corresponding gesture operation information is obtained by calculating the relationship between the five contour data.

Wherein, the gesture operation information includes a single finger click, a double click, a long press, a multi-finger gathering, and the like.

Preferably, the belt member includes an engaging member, and the infrared camera B is integrated into the engaging member of the belt member.

This application has the following advantages:

1. A terminal device capable of inputting instruction information with the help of the user's body, operating the wrist-type smart device or connecting to the wrist-type smart device;

2. The control operation can be completed only by wearing one hand of the wrist-type smart device;

3. Only the operation actions of the fingers of the wearing hand are recognized, which greatly reduces the computational difficulty of the recognition process and improves the accuracy of action recognition;

4. The command input can be realized by wearing one hand and one hand, which greatly improves the input ability and efficiency, and the operation process is extremely convenient;

5. For the terminal equipment connected to the wrist-type smart device, it is convenient to realize remote control through the wrist-type smart device, which increases the convenience of remote control and expands the remote control space of the device;

6. The upper and lower split input devices make it possible to obtain more and more complete infrared images of gestures in the state of various wrist movements, which greatly improves the recognition rate of gestures.

Description of drawings

Figure 1 - System structure block diagram of the wrist-type smart terminal of the present application

Fig. 2 - A schematic view of the top view of the wrist-type smart device of the present application

Fig. 3 - Schematic diagram of the overall structure of the wrist-type smart device of the present application

FIG. 4 - Schematic diagram of the wearing hand partition of the wrist-type smart device in the embodiment of the present application

Fig. 5-Linear simulation diagram of infrared image of the wrist worn by the wrist-type smart device in the embodiment of the present application

Figure 6 - A linear simulation diagram of an infrared image of a hand worn by a wrist-type smart device when a specific gesture action occurs in the embodiment of the present application

The reference numerals are as follows:

100-with parts

200 - Input Devices

200A-Infrared Camera A

200B-Infrared Camera B

210 - Output Devices

220 - Computing Equipment

230 - Storage Devices

240-battery

300-Thumb fingertip joint

301, 302, 303 - index finger 1st, 2nd, 3rd joints

304, 305, 306 - Middle finger 1st, 2nd, 3rd joints

307, 308, 309 - index finger 1st, 2nd, 3rd joints

310, 311, 312 - 1st, 2nd, 3rd joints of the little finger

Detailed ways

In order to make the purpose, technical solutions and advantages of the present utility model more clear, the present utility model will be further described in detail below with reference to the specific embodiments and the accompanying drawings.

1-3, from the overall appearance, the wrist-type smart terminal includes a belt part 100, an input device 200, an output device 210, a storage device 230 of the wrist-type smart terminal, a computing device 220, and a power supply battery 240. The inside of the housing of the terminal is not visible from the outside.

Wherein, the input device 200 includes a plurality of infrared cameras, which are divided into two groups A and B. The first group A is disposed on the side of the main casing of the wrist-type smart terminal. For example, FIG. 2 shows that each side of the main casing is provided with two infrared cameras as input devices. The above design is adopted because in the actual application process, everyone has different habits of wearing watches. For example, some people like to wear the left hand, and some people like to wear the right hand. Therefore, in order to increase the universality, input devices are provided on both sides of the main casing. The above description does not limit the number of each side to two. In practical applications, more input devices can be added according to the actual requirements for gesture recognition. Of course, the increase of input devices will inevitably bring about an increase in manufacturing costs. In addition, according to the wearing habits of wrist devices, some people like to wear the output device, that is, the display screen on the wrist on the back side of the hand, some people like to wear the display screen on the wrist on the side of the hand; Gesture operations, such as finger taps, some people like to gesture with their wrists slightly raised. In order to adapt to various wearing modes and operation modes, the infrared camera device as the input device can obtain the infrared image during gesture operation completely and clearly, a second group of input devices B is also provided. The infrared camera B is arranged on the side of the part of the belt member opposite to the main casing of the wrist-type smart terminal. Correspondingly, the inside of the belt member or the inside of the wrist buckle adjacent to this area may include a flexible PCB board for completing the power supply and information data communication to the infrared camera B.

Both the infrared camera device A and the infrared camera device B are used to collect infrared image data of the wearing hand. Since the actual position of the infrared camera device B is set in the middle of the belt part, a flexible PCB board needs to be installed in the belt part or in the adjacent wrist buckle. It is used to send the collected image data to the computing device for processing. Similarly, operation commands, control commands, etc. are also transmitted through the flexible PCB. Both the infrared camera device A and the infrared camera device B only have different positions as input devices, and there is no primary or secondary function. Both can complete infrared image acquisition, and their structures can be the same or different. Preferably, the belt component includes a card. The infrared camera device B is integrated with the engaging part of the belt part, so that the appearance of the whole device is more concise and beautiful.

The specific working principle of the wrist-type smart terminal is as follows:

1. Wake up the wrist-type smart terminal, and there are many ways to wake up the wrist-type smart terminal, such as button type, acceleration induction type, etc. After waking up the smart wrist terminal, its input device starts infrared camera, and the output device lights up at the same time.

At this time, the wrist-type smart terminal has been worn on the hand. During the initialization process, a preliminary judgment is first made according to the image obtained by the input device to determine whether the wrist-type smart terminal is worn on the left hand or the right hand, and whether the output device is facing the back of the hand or the palm direction. . After the direction is determined, the infrared camera device capable of obtaining clear gesture images is adaptively enabled to work. For example, when worn on the left hand and the output device faces the palm of the hand, the input device on the right side of the main casing of the wrist-type smart terminal enters a shooting state, while other input devices enter a sleep state. Such operations are used to save power and system computing/storage resources or to improve recognition accuracy.

2. The input device entering the shooting state collects the infrared image data of the wearing hand, and transmits the influence data to the computing device.

3. The computing device performs image processing on the collected infrared image data, and calculates and obtains gesture operation information in the collected infrared image data.

4. The storage device stores a database of gesture operation information, and a control command corresponding to the gesture operation information; the computing device compares the gesture operation information obtained by calculation with the gesture operation information stored in the storage device, and when the similarity reaches the similarity level When the value is above the threshold, the control command corresponding to the gesture operation information is queried, and then the wrist-type smart terminal or other terminal devices connected to the wrist-type smart terminal are controlled according to the control command. When the similarity does not reach the similarity level threshold, no operation is performed, and image processing is continued on the collected infrared image data.

In the above process, the power supply device (such as a battery) supplies power to the input device, the output device, the computing device, and the storage device.

In the above implementation process, the computing device involved in step 3 performs image processing on the collected infrared image data, and calculates and obtains the gesture operation information in the collected infrared image data, which is an important part of the entire implementation process, which determines the energy Whether the recognition accuracy is refined to the finger. For ease of description, FIG. 4 shows that the fingers wearing the wrist-type smart terminal are partitioned, 300—the thumb and fingertip joints; 301, 302, 303—the first, second, and third joints of the index finger; 304, 305, 306—the first and second joints of the middle finger , the third joint; 307, 308, 309 - the first, second, and third joints of the ring finger; 310, 311, 312 - the first, second, and third joints of the little finger. From the perspective of human physiology, the easiest way to operate gestures is to open the fingers, Pick up or hit. An example of a finger strike is that the fingers other than the thumb are bent 90 degrees, and the thumb tip and the third joint of the other four fingers complete the finger strike operation. That is, the thumb tip 300 and any one of the third joints (303, 306, 309, 312) of the other four fingers complete the finger-clicking action. Of course, the thumb tip joint 300 can be connected with any one or more of the second joints (302, 305, 308, 311) of the other four fingers. The thumb-finger joint 300 can complete the finger-clicking action with any one or more of the first joints (301, 304, 307, 310) of the other four fingers, and the operation convenience is not as good as that with the third joint directly, but it is not impossible to perform operate.

The infrared image data processing of the finger can be carried out in the following two ways:

1. As shown in Figure 5, perform linear simulation on the tracked image data of the five fingers. The five fingers correspond to five polylines, and each straight part in each polyline corresponds to the joints of the corresponding fingers in Figure 4. , by calculating the relationship between the five polyline data, the corresponding gesture operation information is obtained. For example, Figure 6 shows a linear simulation diagram when the thumb joint and the third joint of the index finger are in contact. It is believed that the fingertip joint of the thumb and the fingertip of the index finger have completed a finger-tapping gesture operation.

2. Perform contour simulation on the tracked image data of the five-finger part, five fingers correspond to five contour lines, and obtain corresponding gesture operation information by calculating the relationship between the five contour line data.

Further, the gesture action itself may include a single action, a double action, a long press action, and the like. For example, the computing device can detect two consecutive finger strikes in a short period of time through the input device, and then it is recognized as a double-click action.

The control commands corresponding to each gesture action can be set according to personal habits and preferences. For example, the finger-clicking action of the thumb tip and the index finger tip is set to "OK", and the finger-clicking action of the thumb tip and the little finger tip is set to "OK". "Return" or "Undo", the thumb and middle finger actions are set to "Previous" or "Previous", and the thumb and ring finger actions are set to "Next" Or "Next Song", the five-finger fingertip gathering operation is set to "Home", and the correspondence between other control commands and finger-clicking actions can also be added, modified, or deleted according to personal wishes.

In the present application, gesture actions are captured by an infrared camera, and a computing device performs linear simulation and contour simulation on the captured images, which can quickly and accurately determine what kind of gesture actions it is. Different gesture actions correspond to different control commands, that is, through gestures The action completes the one-hand control of the wrist-type smart device or other terminal equipment connected to it, which overcomes the problem in the prior art that the hand wearing the wrist-type smart terminal is only used as a carrier, and the other hand must be used to operate the smart terminal. Inconvenient, the controllability and operation convenience of the wrist-type smart device and the corresponding terminal equipment are greatly improved, and the computing device only processes the infrared image of the finger, which improves the efficiency of gesture action recognition, and further adopts linear simulation and contour simulation. recognition, which further improves the accuracy and processing speed of recognition.

The above are only the preferred embodiments of the present invention. It should be pointed out that for those skilled in the art, without departing from the technical principles of the present invention, several improvements and modifications can be made. These improvements and modifications It should also be regarded as the protection scope of the present invention.

Claims (3)

1. A wrist-type intelligent device, characterized in that, the wrist-type intelligent device comprises: Band components and wrist smart terminals; Wherein, the wrist-type smart terminal includes an input device for completing gesture action collection, an output device for display, a computing device, a storage device, and a power supply device; Wherein, the input device includes two or more infrared camera devices A, which are arranged on each side of the main casing of the wrist-type smart terminal to collect infrared image data of the wearing hand; the input device Also includes two or more infrared camera devices B, the infrared camera devices B are arranged on each side of the part of the belt component opposite to the wrist-type smart terminal, and are used to collect infrared image data of the wearing hand. The power supply device supplies power to input devices, output devices, computing devices, and storage devices. 2 . The wrist-type smart device according to claim 1 , wherein a flexible PCB board is included in the inside of the belt member or the inside of the wrist buckle to complete the power supply and information data communication to the infrared camera device B. 3 . 3 . The wrist-type smart device according to claim 1 , wherein the belt member comprises an engaging member, and the infrared camera device B is integrated with the engaging member of the belt member. 4 .

Images