CN104917878A - Method, device and system for inputting number by using gesture for intelligent wearable device - Google Patents

Abstract

The invention relates to the technical field of intelligent wearable equipment, in particular to a method, a device and a system for inputting numbers by using gestures for the intelligent wearable equipment. The invention discloses a method for inputting numbers by using gestures for intelligent wearable equipment, which comprises the following steps: sampling the gesture motion track of the wrist by using a sensor in the intelligent wearable device worn on the wrist to obtain a relative displacement coordinate corresponding to each sampling point; sequentially connecting and drawing a graph according to the obtained relative displacement coordinates and the sequence of the coordinate points; and performing image recognition on the graph, and realizing dialing by inputting a number by using a wrist gesture according to the recognized number. The invention automatically identifies the number represented by the gesture of the current wrist by utilizing gesture identification, thereby realizing the requirement of dialing the phone even if no input area is arranged on the intelligent wearable device.

Description

Method, device and system for smart wearable device to input number by gesture

technical field

The present invention relates to the technical field of smart wearable devices, in particular to a method, device and system for a smart wearable device to input numbers by using gestures.

Background technique

At present, there are many smart wearable devices on the market, such as smart watches, smart bracelets, smart glasses, etc., which have the function of making calls, especially for children. However, due to the small screen size of such smart wearable devices , so the phone number is pre-stored in the smart wearable device through the app, and it is difficult to dial directly on the smart wearable device.

Contents of the invention

The purpose of the present invention is to propose a method, device and system for smart wearable devices to input numbers using gestures. The present invention uses gesture recognition to automatically recognize the number represented by the current wrist gesture, thereby realizing that even if there is no The input area can also realize the demand of making a phone call.

For reaching this purpose, the present invention adopts following technical scheme:

A method for a smart wearable device to input a number using gestures, comprising:

Use the sensor in the smart wearable device worn on the wrist to sample the gesture trajectory of the wrist, and obtain the relative displacement coordinates corresponding to each sampling point;

According to the obtained relative displacement coordinates, the coordinate points are sequentially connected and drawn into graphics in the order in which they appear;

Image recognition is carried out on the graphic, and a call is made by inputting a number with a wrist gesture according to the recognized number.

Wherein, the sensor in the smart wearable device worn on the wrist is used to sample the gesture trajectory of the wrist to obtain the relative displacement coordinates corresponding to each sampling point, specifically:

Use the sensor in the smart wearable device worn on the wrist to sample the gesture movement acceleration of the wrist, and calculate the acceleration components on the X-axis and Y-axis according to the established XY two-dimensional coordinate system;

Calculate the sampling interval time according to the sampling frequency of the sensor, and use the displacement formula Calculate the relative displacement coordinates corresponding to each sampling point;

Among them, a represents the acceleration corresponding to each sampling point, and t represents the sampling time corresponding to each sampling point.

Wherein, the method also includes:

The recognized numbers are played by voice or displayed on the display screen of the smart wearable device in the form of images.

Wherein, the smart wearable device is a smart watch or a smart bracelet.

A device for a smart wearable device to input a number using gestures, comprising:

The data acquisition and processing unit is used to use the sensor in the smart wearable device worn on the wrist to sample the gesture trajectory of the wrist to obtain the relative displacement coordinates corresponding to each sampling point;

A graphics drawing unit, configured to sequentially connect and draw graphics according to the obtained relative displacement coordinates in the order in which the coordinate points appear;

The graphic recognition unit is configured to perform image recognition on the graphic, and realize dialing a phone by inputting a number with wrist gestures according to the recognized numbers.

Wherein, the data acquisition and processing unit is specifically used to use the sensor in the smart wearable device worn on the wrist to sample the gesture movement acceleration of the wrist, and calculate the acceleration in the X-axis and Y-axis according to the established XY two-dimensional coordinate system. The acceleration component on the axis; the sampling interval time is calculated according to the sampling frequency of the sensor, and the displacement formula is used Calculate the relative displacement coordinates corresponding to each sampling point; where a represents the acceleration corresponding to each sampling point, and t represents the sampling time corresponding to each sampling point.

Wherein, the device also includes:

The number reminding unit is used to play the recognized number in the form of voice, or display it in the form of image on the display screen of the smart wearable device.

Wherein, the smart wearable device is a smart watch or a smart bracelet.

A system for smart wearable devices to input numbers by gestures, comprising: a gesture recognition module, a processor and a phone module, the gesture recognition module is connected to a processor, and the processor is connected to a phone module;

The gesture recognition module is used to sample the gesture trajectory of the wrist by using the sensor in the smart wearable device worn on the wrist, and send the sampled data to the processor;

The processor is used to calculate and obtain the relative displacement coordinates corresponding to each sampling point, and according to the obtained relative displacement coordinates, connect and draw the graphs sequentially according to the order in which the coordinate points appear; and then perform image recognition on the graphs, And send the recognized number to the phone module;

The phone module is used to realize the function of dialing a phone by inputting a number with a wrist gesture according to the number recognized by the processor.

Beneficial effect:

A method for a smart wearable device to input a number using gestures according to the present invention includes: using a sensor in the smart wearable device worn on the wrist to sample the gesture movement trajectory of the wrist, and obtaining the relative number corresponding to each sampling point. Displacement coordinates; according to the obtained relative displacement coordinates, the coordinate points are sequentially connected and drawn into graphics in the order in which they appear; image recognition is performed on the graphics, and dialing is realized by using wrist gestures to input numbers according to the recognized numbers. The present invention uses gesture recognition to automatically recognize the number represented by the current wrist gesture, so that even if there is no input area on the smart wearable device, it can also realize the need to make a call.

Description of drawings

Fig. 1 is a flow chart of a method for a smart wearable device to input a number using gestures provided by a specific embodiment of the present invention.

Fig. 2 is a gesture recording diagram provided by a specific embodiment of the present invention using a method for inputting a number by gestures on a smart wearable device.

Fig. 3 is a schematic structural diagram of an apparatus for a smart wearable device to input a number by gesture according to a specific embodiment of the present invention.

Fig. 4 is a schematic structural diagram of a system for a smart wearable device to input a number using gestures provided by a specific embodiment of the present invention.

Detailed ways

The technical solutions of the present invention will be further described below in conjunction with the accompanying drawings and through specific implementation methods.

Example 1:

Fig. 1 is a flow chart of a method for a smart wearable device to input a number using gestures provided by a specific embodiment of the present invention. As shown in Figure 1, a method for inputting a number by a gesture for a smart wearable device according to the present invention includes:

Use the sensor in the smart wearable device worn on the wrist to sample the gesture trajectory of the wrist, and obtain the relative displacement coordinates corresponding to each sampling point;

According to the obtained relative displacement coordinates, the coordinate points are sequentially connected and drawn into graphics in the order in which they appear;

Image recognition is carried out on the graphic, and a call is made by inputting a number with a wrist gesture according to the recognized number.

The present invention uses gesture recognition to automatically recognize the number represented by the current wrist gesture, so that even if there is no input area on the smart wearable device, the demand for making a call can be realized. When the user uses a smart wearable device, such as a smart watch to make a call and needs to input a number, the hand wearing the smart watch gestures in the air to draw the number to be input. For example, when entering 1, draw a vertical line in the air.

In this solution, the sensor in the smart wearable device worn on the wrist is used to sample the gesture trajectory of the wrist to obtain the relative displacement coordinates corresponding to each sampling point, specifically:

Use the sensor in the smart wearable device worn on the wrist to sample the gesture movement acceleration of the wrist, and calculate the acceleration components on the X-axis and Y-axis according to the established XY two-dimensional coordinate system;

Calculate the sampling interval time according to the sampling frequency of the sensor, and use the displacement formula Calculate the relative displacement coordinates corresponding to each sampling point;

Among them, a represents the acceleration corresponding to each sampling point, and t represents the sampling time corresponding to each sampling point.

If the smart wearable device is a smart watch, use the movement of the smart watch to determine an x-axis and y-axis plane in the air, such as the X-axis and Y-axis in the horizontal direction, or the X-axis and Y-axis in the vertical direction;

Set the sampling frequency of the sensor as f, then the sampling interval time t is 1/f, if the acceleration of hand movement is a, the displacement within time t Let the acceleration in the x-axis direction be a _x , and the acceleration in the y-axis direction be a _y ;

As shown in Figure 2, then $x1=\frac{1}{2}{a}_{x1}{t_1}^2,\mathrm{the\; y}1=\frac{1}{2}{a}_{\mathrm{the\; y}1}{t_1}^2;x2=\frac{1}{2}{a}_{x2}{t_2}^2,\mathrm{the\; y}2=\frac{1}{2}{a}_{\mathrm{the\; y}2}{t_2}^2;x3=\frac{1}{2}{a}_{x3}{t_3}^2,$ $\mathrm{the\; y}3=\frac{1}{2}{a}_{\mathrm{the\; y}3}{t_3}^2;x4=\frac{1}{4}{a}_{x3}{t_4}^2,\mathrm{the\; y}4=\frac{1}{2}{a}_{\mathrm{the\; y}4}{t_4}^2;$

Then the coordinates of m1 are (x1, y1), m2(x2, y2), m3(x3, y3), m4(x4, y4);

Connect m1, m2, m3, and m4 in sequence according to the order in which the coordinate points appear;

Perform image recognition on the connected graphics, and present the number with the recognized voice or image;

When all the numbers (telephone numbers) have been input, the dialing can be realized.

The method also includes:

The recognized numbers are played by voice or displayed on the display screen of the smart wearable device in the form of images.

Preferably, the smart wearable device is a smart watch or smart bracelet.

Example 2:

The device embodiment and the method embodiment described in the present invention belong to the same technical concept, and for the content not described in detail in the device embodiment, please refer to the method embodiment.

Fig. 3 is a schematic structural diagram of an apparatus for a smart wearable device to input a number by gesture according to a specific embodiment of the present invention. As shown in Figure 3, a device for inputting numbers by gestures for smart wearable devices according to the present invention includes:

The data acquisition and processing unit is used to use the sensor in the smart wearable device worn on the wrist to sample the gesture trajectory of the wrist to obtain the relative displacement coordinates corresponding to each sampling point;

A graphics drawing unit, configured to sequentially connect and draw graphics according to the obtained relative displacement coordinates in the order in which the coordinate points appear;

The graphic recognition unit is configured to perform image recognition on the graphic, and realize dialing a phone by inputting a number with wrist gestures according to the recognized numbers.

The present invention uses gesture recognition to automatically recognize the number represented by the current wrist gesture, so that even if there is no input area on the smart wearable device, the demand for making a call can be realized. When the user uses a smart wearable device, such as a smart watch to make a call and needs to input a number, the hand wearing the smart watch gestures in the air to draw the number to be input. For example, when entering 1, draw a vertical line in the air.

The data acquisition and processing unit is specifically used to use the sensor in the smart wearable device worn on the wrist to sample the gesture motion acceleration of the wrist, and calculate the acceleration on the X-axis and Y-axis according to the established XY two-dimensional coordinate system. Acceleration component; Calculate the sampling interval time according to the sampling frequency of the sensor, and use the displacement formula Calculate the relative displacement coordinates corresponding to each sampling point; where a represents the acceleration corresponding to each sampling point, and t represents the sampling time corresponding to each sampling point.

If the smart wearable device is a smart watch, use the movement of the smart watch to determine an x-axis and y-axis plane in the air, such as the X-axis and Y-axis in the horizontal direction, or the X-axis and Y-axis in the vertical direction;

Set the sampling frequency of the sensor as f, then the sampling interval time t is 1/f, if the acceleration of hand movement is a, the displacement within time t Let the acceleration in the x-axis direction be a _x , and the acceleration in the y-axis direction be a _y ;

As shown in Figure 2, then $x1=\frac{1}{2}{a}_{x1}{t_1}^2,\mathrm{the\; y}1=\frac{1}{2}{a}_{\mathrm{the\; y}1}{t_1}^2;x2=\frac{1}{2}{a}_{x2}{t_2}^2,\mathrm{the\; y}2=\frac{1}{2}{a}_{\mathrm{the\; y}2}{t_2}^2;x3=\frac{1}{2}{a}_{x3}{t_3}^2,$ $\mathrm{the\; y}3=\frac{1}{2}{a}_{\mathrm{the\; y}3}{t_3}^2;x4=\frac{1}{4}{a}_{x3}{t_4}^2,\mathrm{the\; y}4=\frac{1}{2}{a}_{\mathrm{the\; y}4}{t_4}^2;$

Then the coordinates of m1 are (x1, y1), m2(x2, y2), m3(x3, y3), m4(x4, y4);

Connect m1, m2, m3, and m4 in sequence according to the order in which the coordinate points appear;

Perform image recognition on the connected graphics, and present the number with the recognized voice or image;

When all the numbers (telephone numbers) have been input, the dialing can be realized.

The device also includes:

The number reminding unit is used to play the recognized number in the form of voice, or display it in the form of image on the display screen of the smart wearable device.

The smart wearable device is a smart watch or a smart bracelet.

Example 3:

The implementation of the system described in the present invention belongs to the same technical concept as the above-mentioned method embodiments. Please refer to the method embodiments for the contents not described in detail in the system embodiments.

Fig. 4 is a schematic structural diagram of a system for a smart wearable device to input a number using gestures provided by a specific embodiment of the present invention. As shown in Figure 4, a system for smart wearable devices to input numbers using gestures according to the present invention includes: a gesture recognition module, a processor and a phone module, the gesture recognition module is connected to the processor, and the processing The device is connected with the telephone module;

The gesture recognition module is used to sample the gesture trajectory of the wrist by using the sensor in the smart wearable device worn on the wrist, and send the sampled data to the processor;

The processor is used to calculate and obtain the relative displacement coordinates corresponding to each sampling point, and according to the obtained relative displacement coordinates, connect and draw the graphs sequentially according to the order in which the coordinate points appear; and then perform image recognition on the graphs, And send the recognized number to the phone module;

The phone module is used to realize the function of dialing a phone by inputting a number with a wrist gesture according to the number recognized by the processor.

The present invention uses gesture recognition to automatically recognize the number represented by the current wrist gesture, so that even if there is no input area on the smart wearable device, the demand for making a call can be realized. When the user uses a smart wearable device, such as a smart watch to make a call and needs to input a number, the hand wearing the smart watch gestures in the air to draw the number to be input. For example, when entering 1, draw a vertical line in the air.

The above is only a preferred embodiment of the present invention, but the scope of protection of the present invention is not limited thereto, any person familiar with the technical field within the technical scope disclosed in the present invention, according to the technical solution of the present invention Any equivalent replacement or change of the inventive concepts thereof shall fall within the protection scope of the present invention.

Claims (9)

1. A method for smart wearable devices to utilize gesture input numbers, characterized in that, comprising: Use the sensor in the smart wearable device worn on the wrist to sample the gesture trajectory of the wrist, and obtain the relative displacement coordinates corresponding to each sampling point; According to the obtained relative displacement coordinates, the coordinate points are sequentially connected and drawn into graphics in the order in which they appear; Image recognition is carried out on the graphic, and a call is made by inputting a number with a wrist gesture according to the recognized number. 2. The method according to claim 1, wherein the sensor in the smart wearable device worn on the wrist is used to sample the gesture trajectory of the wrist to obtain the relative displacement coordinates corresponding to each sampling point, specifically for: Use the sensor in the smart wearable device worn on the wrist to sample the gesture movement acceleration of the wrist, and calculate the acceleration components on the X-axis and Y-axis according to the established XY two-dimensional coordinate system; Calculate the sampling interval time according to the sampling frequency of the sensor, and use the displacement formula Calculate the relative displacement coordinates corresponding to each sampling point; Among them, a represents the acceleration corresponding to each sampling point, and t represents the sampling time corresponding to each sampling point. 3. The method according to claim 1, characterized in that, the method further comprises: The recognized numbers are played by voice or displayed on the display screen of the smart wearable device in the form of images. 4. The method according to claim 1, wherein the smart wearable device is a smart watch or a smart bracelet. 5. A device for smart wearable devices to input numbers using gestures, characterized in that it comprises: The data acquisition and processing unit is used to use the sensor in the smart wearable device worn on the wrist to sample the gesture trajectory of the wrist to obtain the relative displacement coordinates corresponding to each sampling point; A graphics drawing unit, configured to sequentially connect and draw graphics according to the obtained relative displacement coordinates in the order in which the coordinate points appear; The graphic recognition unit is configured to perform image recognition on the graphic, and realize dialing a phone by inputting a number with wrist gestures according to the recognized numbers. 6. The device according to claim 5, wherein the data acquisition and processing unit is specifically configured to use the sensor in the smart wearable device worn on the wrist to sample the acceleration of the gesture movement of the wrist, according to the established In the XY two-dimensional coordinate system, calculate the acceleration components on the X-axis and Y-axis; calculate the sampling interval time according to the sampling frequency of the sensor, and use the displacement formula Calculate the relative displacement coordinates corresponding to each sampling point; where a represents the acceleration corresponding to each sampling point, and t represents the sampling time corresponding to each sampling point. 7. The device according to claim 5, wherein the device further comprises: The number reminding unit is used to play the recognized number in the form of voice, or display it in the form of image on the display screen of the smart wearable device. 8. The device according to claim 5, wherein the smart wearable device is a smart watch or a smart bracelet. 9. A system for smart wearable devices to input numbers using gestures, characterized in that it includes: a gesture recognition module, a processor and a phone module, the gesture recognition module is connected to the processor, and the processor is connected to the phone module ; The gesture recognition module is used to sample the gesture trajectory of the wrist by using the sensor in the smart wearable device worn on the wrist, and send the sampled data to the processor; The processor is used to calculate and obtain the relative displacement coordinates corresponding to each sampling point, and according to the obtained relative displacement coordinates, connect and draw the graphs sequentially according to the order in which the coordinate points appear; and then perform image recognition on the graphs, And send the recognized number to the phone module; The phone module is used to realize the function of dialing a phone by inputting a number with a wrist gesture according to the number recognized by the processor.