CN111857326A

CN111857326A - Signal control method and device

Info

Publication number: CN111857326A
Application number: CN201910340496.XA
Authority: CN
Inventors: 颜嘉甫
Original assignee: Beijing Xiaomi Mobile Software Co Ltd
Current assignee: Beijing Xiaomi Mobile Software Co Ltd
Priority date: 2019-04-25
Filing date: 2019-04-25
Publication date: 2020-10-30

Abstract

The disclosure relates to a signal control method and a signal control device. The method comprises the following steps: collecting an electromyographic signal of a target limb, wherein the electromyographic signal indicates a target action of the target limb; and sending a data signal to the terminal according to the electromyographic signal, so that the terminal executes a second operation instruction corresponding to the data signal before acquiring the first operation instruction according to the target action, wherein the second operation instruction is the same as the first operation instruction. According to the technical scheme, the wearable device sends the data signal to the terminal according to the collected myoelectric signal, so that when a user sends a first operation instruction to the terminal, the terminal executes a second operation instruction corresponding to the data signal before receiving the first operation instruction, and the second operation instruction is the same as the first operation instruction, so that the user can feel that the first operation instruction is sent, the terminal executes the first operation instruction without waiting for the time of sending the first operation instruction to the terminal by the user, the control time is shortened, and the user experience is improved.

Description

Signal control method and device

Technical Field

The present disclosure relates to the field of communications technologies, and in particular, to a signal control method and apparatus.

Background

With the continuous development of information technology and the increasing popularization of network technology, terminals such as mobile phones, tablets, computers, game machines and the like have become indispensable devices in people's lives.

In the related art, when people use limbs to control a terminal, usually, a brain sends a command of corresponding operation, then a nerve transmission system sends the command of corresponding operation to the corresponding limbs, and after receiving the command, the limbs execute the operation corresponding to the command on the terminal, thereby realizing the control of the terminal.

Disclosure of Invention

In order to overcome the problem that the feedback time of the muscular system of the limb in the related art causes the control time to be prolonged, the embodiment of the disclosure provides a signal control method and a signal control device. The technical scheme is as follows:

according to a first aspect of the embodiments of the present disclosure, there is provided a signal control method applied to a wearable device, including acquiring an electromyographic signal of a target limb, the electromyographic signal indicating a target motion of the target limb;

and sending a data signal to a terminal according to the electromyographic signal so that the terminal executes a second operation instruction corresponding to the data signal before acquiring a first operation instruction according to the target action, wherein the second operation instruction is the same as the first operation instruction.

The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: the wearable device sends the data signal to the terminal according to the collected electromyographic signal, so that when the user sends the first operation instruction to the terminal, the terminal executes the second operation instruction corresponding to the data signal before receiving the first operation instruction, and the second operation instruction is the same as the first operation instruction, so that the user can feel that the first operation instruction is sent, the terminal executes the first operation instruction without waiting for the time of sending the first operation instruction to the terminal by the user, the control time is shortened, and the user experience is improved.

In one embodiment, before the transmitting the data signal to the terminal according to the electromyographic signal, the method further comprises:

extracting feature information of the electromyographic signals;

the sending of the data signal to the terminal according to the electromyographic signal comprises:

and acquiring a data signal according to the feature information of the electromyographic signal, and sending the data signal to a terminal.

In one embodiment, the transmitting the data signal to the terminal according to the electromyographic signal comprises:

sending a data signal to a terminal through a wired data transmission interface; the wired data transmission interface comprises one of an RS232 interface, an RS242 interface and an RS485 interface;

Or;

sending a data signal to a terminal through a wireless transmission module; the wireless transmission module comprises one of a WIFI module, a Zigbee wireless module and a Bluetooth module.

In one embodiment, after the transmitting the data signal to the terminal according to the electromyographic signal, the method further comprises:

receiving a response message sent by a terminal; the response message carries a success identifier or a failure identifier of the terminal for receiving the data signal;

when the response message is determined to carry the successful identification for receiving the data signal, displaying the successful sending information;

and when determining that the response message carries a failure identifier for receiving the data signal, sending the data signal to the terminal again according to the electromyographic signal.

According to a second aspect of the embodiments of the present disclosure, there is provided a signal control method applied to a terminal, including:

receiving a data signal;

executing a second operation instruction corresponding to the data signal;

and if a first operation instruction is acquired according to the target action, the first operation instruction is forbidden to be executed, and the first operation instruction is the same as the second operation instruction.

The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: when the user sends the first operation instruction to the terminal, because the terminal already executes the second operation instruction corresponding to the data signal before receiving the first operation instruction, and the second operation instruction is the same as the first operation instruction, the user can feel that the terminal executes the first operation instruction while sending the first operation instruction, and does not need to wait for the time for the user to send the first operation instruction to the terminal, thereby shortening the control time and further improving the user experience.

In one embodiment, the executing the second operation instruction corresponding to the data signal includes:

extracting characteristic information of the data signal;

and acquiring a second operation instruction according to the characteristic information of the data signal, and executing the second operation instruction.

In one embodiment, after the receiving the data signal, the method further includes:

sending a response message to the wearable device; and the response message carries a success identifier or a failure identifier of the terminal for receiving the data signal.

According to a third aspect of the embodiments of the present disclosure, there is provided a signal control apparatus including:

the system comprises an acquisition module, a display module and a control module, wherein the acquisition module is used for acquiring an electromyographic signal of a target limb, and the electromyographic signal indicates a target action of the target limb;

the first sending module is used for sending a data signal to the terminal according to the electromyographic signal so that the terminal executes a second operation instruction corresponding to the data signal before acquiring the first operation instruction according to the target action, and the second operation instruction is the same as the first operation instruction.

In one embodiment, the system further comprises an extraction module, and the first sending module comprises a first obtaining submodule and a first sending submodule;

The extraction module is used for extracting the characteristic information of the electromyographic signals;

the first acquisition submodule is used for acquiring a data signal according to the characteristic information of the electromyographic signal;

and the first sending submodule is used for sending the data signal to a terminal.

In one embodiment, the first transmission module includes a second transmission submodule;

the second sending submodule is used for sending a data signal to the terminal through the wired data transmission interface; the wired data transmission interface comprises one of an RS232 interface, an RS242 interface and an RS485 interface;

or;

In one embodiment, the system further comprises a first receiving module, a first determining module and a second determining module;

the first receiving module is used for receiving a response message sent by the terminal; the response message carries a success identifier or a failure identifier of the terminal for receiving the data signal;

the first determining module is configured to, when it is determined that the response message carries a successful identifier for receiving the data signal, display a transmission success message;

And the second determining module is used for sending the data signal to the terminal again according to the electromyographic signal when determining that the response message carries the failure identification for receiving the data signal.

According to a fourth aspect of the embodiments of the present disclosure, there is provided a signal control apparatus including:

the second receiving module is used for receiving the data signal;

the first execution module is used for executing a second operation instruction corresponding to the data signal;

and the second execution module is used for prohibiting executing the first operation instruction when the first operation instruction is obtained according to the target action, and the first operation instruction is the same as the second operation instruction.

In one embodiment, the first execution module includes an extraction submodule, a second acquisition submodule, and an execution submodule;

the extraction submodule is used for extracting the characteristic information of the data signal;

the second obtaining submodule is used for obtaining a second operation instruction according to the characteristic information of the data signal;

and the execution submodule is used for executing the second operation instruction.

In one embodiment, the system further comprises a second sending module;

the second sending module is used for sending a response message to the wearable device; and the response message carries a success identifier or a failure identifier of the terminal for receiving the data signal.

According to a fifth aspect of the embodiments of the present disclosure, there is provided a signal control apparatus including:

a first processor;

a first memory for storing first processor-executable instructions;

wherein the first processor is configured to:

acquiring an electromyographic signal of a target limb, wherein the electromyographic signal indicates a target action of the target limb;

According to a sixth aspect of the embodiments of the present disclosure, there is provided a signal control device including:

a second processor;

a second memory for storing second processor-executable instructions;

wherein the second processor is configured to:

receiving a data signal;

executing a second operation instruction corresponding to the data signal;

According to a seventh aspect of embodiments of the present disclosure, there is provided a computer-readable storage medium having stored thereon computer instructions which, when executed by a processor, implement the steps of the method according to any one of the embodiments of the first aspect.

According to an eighth aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium having stored thereon computer instructions which, when executed by a processor, implement the steps of the method according to any one of the embodiments of the second aspect.

The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: the terminal can execute the first operation instruction while the user feels that the first operation instruction is sent, the time for the user to send the first operation instruction to the terminal does not need to be waited, the control time is shortened, and the response speed of the terminal is improved; in addition, the terminal can be ensured to correctly receive the data signal, and the operation accuracy is improved.

It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.

Drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.

FIG. 1a is a flow chart illustrating a signal control method according to an exemplary embodiment.

FIG. 1b is a flow chart illustrating a signal control method according to an exemplary embodiment.

Fig. 2a is a flow chart illustrating a signal control method according to an exemplary embodiment.

Fig. 2b is a flow chart illustrating a signal control method according to an exemplary embodiment.

Fig. 3 is an interaction diagram illustrating a signal control method according to an exemplary embodiment.

Fig. 4 is an interaction diagram illustrating a signal control method according to an exemplary embodiment.

Fig. 5a is a schematic structural diagram of a signal control device according to an exemplary embodiment.

Fig. 5b is a schematic structural diagram of a signal control device according to an exemplary embodiment.

Fig. 5c is a schematic diagram illustrating a structure of a signal control device according to an exemplary embodiment.

Fig. 5d is a schematic diagram illustrating a structure of a signal control apparatus according to an exemplary embodiment.

Fig. 6a is a schematic structural diagram of a signal control device according to an exemplary embodiment.

Fig. 6b is a schematic structural diagram of a signal control device according to an exemplary embodiment.

Fig. 6c is a schematic diagram illustrating a structure of a signal control device according to an exemplary embodiment.

Fig. 7 is a block diagram illustrating a structure of a signal control apparatus according to an exemplary embodiment.

Detailed Description

Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

The technical scheme provided by the embodiment of the disclosure relates to wearable equipment and a terminal, wherein the wearable equipment can be an intelligent bracelet, an intelligent watch, an intelligent sports shoe and other intelligent equipment arranged on a limb; the terminal can be a mobile phone, a tablet computer, a notebook computer, an intelligent game machine and other intelligent devices used by a user, and the embodiment of the disclosure is not limited thereto. In the related art, the limbs are adopted to receive a command of corresponding operation sent by the brain, and then the operation corresponding to the command is executed on the terminal, so that the terminal is controlled. However, after the limb receives the command of the corresponding operation, the muscle system of the limb has feedback time, that is, after the limb receives the command, the terminal can be controlled after the feedback time, so that the control time is prolonged. In the technical scheme provided by the embodiment of the disclosure, the wearable device sends the data signal to the terminal according to the collected myoelectric signal, so that when the user sends the first operation instruction to the terminal, the terminal executes the second operation instruction corresponding to the data signal before receiving the first operation instruction, and the second operation instruction is the same as the first operation instruction, so that the user can feel that the terminal executes the first operation instruction while sending the first operation instruction, the time for the user to send the first operation instruction to the terminal does not need to be waited, the control time is shortened, and further the user experience is improved.

The embodiment of the disclosure provides a signal control method, and an execution main body implementing the method comprises a wearable device and a terminal. According to different implementation main bodies of the method, the embodiment of the disclosure arranges two sets of embodiments as follows:

wearable device side

Fig. 1a is a flowchart illustrating a signal control method applied to a wearable device according to an exemplary embodiment, and as shown in fig. 1a, the signal control method includes the following steps 101 and 102:

in step 101, an electromyographic signal of a target limb is collected.

Wherein the electromyographic signals indicate a target movement of a target limb.

According to the embodiment, the wearable device is provided with the electromyographic sensor or the electromyographic neural interface, the electromyographic sensor or the electromyographic neural interface is attached to a target limb of a user, the electromyographic signal of the target limb is collected through the electromyographic sensor or the electromyographic neural interface, and the electromyographic signal collected through the electromyographic sensor or the electromyographic neural interface is a weak electric signal and is easily interfered by other signals of a body and external environment and noise, so that the electromyographic sensor or the electromyographic neural interface is provided with the signal conditioning circuit and the AD converter, the collected electromyographic signal is amplified, filtered and the like through the signal conditioning circuit, the signal to noise ratio of the electromyographic signal is increased, and the conditioned electromyographic signal is converted into the digital electromyographic signal through the AD converter.

It should be noted that the target limb in the present embodiment may be a limb that can fix the wearable device, such as a wrist, a foot, a knee, and the like, and is not limited herein.

It should be noted that the electromyographic sensor and the electromyographic neural interface in this embodiment may adopt an electromyographic sensor and an electromyographic neural interface in the prior art, and details are not described here.

In step 102, a data signal is sent to the terminal according to the electromyographic signal, so that the terminal executes a second operation instruction corresponding to the data signal before acquiring the first operation instruction according to the target action, wherein the second operation instruction is the same as the first operation instruction.

For example, the wearable device sends the data signal to the terminal, and after the terminal executes the second operation instruction corresponding to the data signal, the terminal delays by 40ms to receive the first operation instruction sent by the user according to the target action, and since the first operation instruction and the second operation instruction are the same, the terminal is equivalent to the first operation instruction already executed before 40ms, and the muscle system of the user also has a certain feedback time, and assuming that the feedback time is 30ms, so that when the user presses the key or the mouse or the touch screen, the time for the user to press the key or the mouse or the touch screen and the second operation instruction corresponding to the data signal of the terminal are only 10ms different, so that for the user, the terminal executes the first operation instruction when pressing the key or the mouse or the touch screen can be sensed, and the control time is shortened, thereby improving the user experience.

Optionally, the wearable device sends the data signal to the terminal through a wired data transmission interface, or sends the data signal to the terminal through a wireless transmission module. The wired data transmission interface comprises one of an RS232 interface, an RS242 interface and an RS485 interface, and the wireless transmission module comprises one of a WIFI module, a Zigbee wireless module and a Bluetooth module; when the wearable device sends the data signals in a wired mode, an RS232 interface, an RS242 interface, an RS485 interface and the like are correspondingly arranged on the terminal side, then the wearable device is connected with the terminal through corresponding data lines, and the wearable device sends the data signals to the terminal in a wired mode; when the wearable device sends the data signal in a wireless mode, the terminal side is correspondingly provided with a WIFI module or a Zigbee wireless module or a Bluetooth module and the like, so that the wearable device sends the data signal to the terminal in a wireless mode.

Optionally, a specific method for sending the data signal to the terminal according to the electromyographic signal is as follows:

in the first method, wearable equipment sends an electromyographic signal to a terminal, and the data signal at the moment is the electromyographic signal.

In the second method, a wearable device extracts characteristic information of the electromyographic signal; and acquiring a data signal according to the feature information of the electromyographic signal, and sending the data signal to a terminal.

In an example, the wearable device performs fast fourier transform on each collected electromyographic signal to obtain a frequency spectrum or a power spectrum of each electromyographic signal, can reflect the change of each electromyographic signal in a frequency dimension, further obtains the frequency of each electromyographic signal through the distribution of the frequency spectrum or the power spectrum, and displays the frequency of each electromyographic signal, so that a user can determine the corresponding relationship among the frequency of each electromyographic signal, the target action of a target limb and the instruction corresponding to the target action of the target limb through experiments, and then stores the corresponding relationship between the frequency of each electromyographic signal and the instruction corresponding to the target action of the target limb in the wearable device, so that when the wearable device collects one electromyographic signal, the wearable device performs fast fourier transform on the electromyographic signal to obtain the frequency spectrum or the power spectrum of the electromyographic signal, finally, the frequency of the electromyographic signal is obtained according to the distribution of the frequency spectrum or the power spectrum of the electromyographic signal, then whether the frequency of the electromyographic signal is stored is determined, if the frequency of the electromyographic signal is determined to be stored, an instruction corresponding to the frequency of the electromyographic signal is searched, the collected electromyographic signal is processed, the instruction corresponding to the electromyographic signal is obtained, then a data signal is sent to the terminal according to the instruction, the data signal at the moment is the instruction, the instruction is a second operation instruction, so that the terminal directly executes the second operation instruction, the control of the terminal is realized, the control of the terminal comprises the control of each interface displayed on the terminal, the control of a terminal touch screen or the control of a terminal key and the like, and the embodiment is not limited herein.

For example, a tetris game is installed on a terminal, a user controls the game through a morph key, a down key, a left key and a right key, the number of collected electromyographic signals is four, the wearable device processes the four electromyographic signals to obtain that the frequency of a first electromyographic signal is 1HZ, the frequency of a second electromyographic signal is 2HZ, the frequency of a third electromyographic signal is 3HZ, the frequency of a fourth electromyographic signal is 4HZ, the user can know through experiments that the target movement of the target limb corresponding to the frequency 1HZ of the first electromyographic signal is used as a 'press morph key', the target movement of the target limb corresponding to the frequency 2HZ of the second electromyographic signal is used as a 'press down key', the target movement of the target limb corresponding to the frequency 3HZ of the third electromyographic signal is used as a 'press left key', and the target movement of the target limb corresponding to the frequency 4HZ of the fourth electromyographic signal is used as a 'press right key', setting a command corresponding to 'pressing a deformation key' as a deformation command, setting a command corresponding to 'pressing a downward key' as a downward command, setting a command corresponding to 'pressing a leftward key' as a leftward command, setting a command corresponding to 'pressing a rightward key' as a rightward command, then storing the frequency of each electromyographic signal and a command of a target action of a corresponding target limb into the wearable device, when the wearable device collects the electromyographic signals, processing the electromyographic signals, and then determining whether the wearable device stores the frequency 1HZ of the electromyographic signals or not if the frequency of the electromyographic signals is 1HZ, if the wearable device stores the frequency 1HZ of the electromyographic signals, finding the command corresponding to the frequency 1HZ of the electromyographic signals as the deformation command, sending the wearable device the data signals to the terminal, namely sending the deformation command to the terminal, when the terminal receives the deformation instruction, the deformation instruction is executed, so that the currently running Russian block is deformed, the Russian block game is directly controlled, then, a user can send the deformation instruction to the terminal through the deformation key, at the moment, when the terminal receives the deformation instruction, the deformation instruction is directly ignored, the user feels that the current Russian block is deformed after the deformation key is just pressed down, and the user experience is improved; in the same way, the instruction corresponding to the frequency 2HZ of the electromyographic signal can be obtained as a downward instruction; the command corresponding to the frequency 3HZ of the electromyographic signal is a leftward command; the command corresponding to the frequency 4HZ of the electromyographic signal is a rightward command.

For example, after acquiring the electromyographic signals, the wearable device extracts time-domain characteristic data or frequency-domain characteristic data of each electromyographic signal, where the time-domain characteristic data mainly includes an integral electromyographic value, a root mean square value, an absolute value integral, a zero-crossing point number, a variance, a Willison amplitude, a time-sequence model of the electromyographic signal, an electromyographic signal histogram, and the like, and a method for extracting the time-domain characteristic data of the electromyographic signals by specifically adopting a time-domain analysis may refer to a corresponding method in the prior art, and this embodiment is not described herein again.

The frequency characteristic data mainly includes average power, average frequency and median frequency, and the method for analyzing and extracting the frequency domain characteristic data of the electromyographic signal by using the frequency domain method may refer to a corresponding method in the prior art, which is not described herein again in this embodiment.

Taking the frequency domain characteristic data of the extracted electromyographic signals as an example, the wearable device takes all the frequency domain characteristic data of each electromyographic signal as training data after acquiring the frequency domain characteristic data of each electromyographic signal, presetting a naive Bayes classifier on the wearable device, inputting each training data into the naive Bayes classifier, then obtaining the instruction corresponding to the target action of the target limb calculated by the naive Bayes classifier, comparing the calculated instruction with the known instruction corresponding to the target action of the target limb, and adjusting parameters in the naive Bayes classifier according to the comparison result, so that the instruction obtained by calculation of the naive Bayes classifier is the same as the instruction corresponding to the target action of the known target limb, and the naive Bayes classifier is the classifier model obtained by training.

When the wearable device acquires an instruction corresponding to an electromyographic signal by using the classifier model, extracting frequency domain characteristic data of the electromyographic signal according to the method, inputting the extracted frequency domain characteristic data of the electromyographic signal into the classifier model for instruction prediction, processing the electromyographic signal to obtain an instruction corresponding to the electromyographic signal, and then sending the data signal to a terminal according to the instruction, wherein the instruction is a second operation instruction, so that the terminal directly executes the second operation instruction to realize control of the terminal, the control of the terminal comprises control over each interface displayed on the terminal, control over a terminal touch screen or control over a terminal key and the like, and the embodiment is not limited herein.

For example, a tetris game is installed on a terminal, a user controls the game through a morph key, a down key, a left key and a right key, the number of collected electromyographic signals is four, wearable equipment processes the four electromyographic signals to obtain that frequency domain characteristic data of a first electromyographic signal is 1HZ, frequency domain characteristic data of a second electromyographic signal is 2HZ, frequency domain characteristic data of a third electromyographic signal is 3HZ, frequency domain characteristic data of a fourth electromyographic signal is 4HZ, the user can experimentally find that a target movement of a target limb corresponding to the frequency domain characteristic data 1HZ of the first electromyographic signal is used as a 'morph key', a target movement of a target limb corresponding to the frequency 2HZ of the second electromyographic signal is used as a 'press down key', a target movement of a target limb corresponding to the frequency 3HZ of the third electromyographic signal is used as a 'press left key', the target movement of the target limb corresponding to the frequency 4HZ of the fourth electromyographic signal is used as a 'right key press', a command corresponding to the 'deformation key press' is set as a deformation command, a command corresponding to the 'down key press' is set as a downward command, a command corresponding to the 'left key press' is set as a leftward command, and a command corresponding to the 'right key press' is set as a rightward command; then, taking the frequency domain feature data as 1HZ as an example, selecting a plurality of frequency domain feature data about 1HZ as training data, for example, selecting 0.98HZ, 0.99HZ, 0.995HZ, 1HZ, 1.05HZ, 1.1HZ and the like as the training data, respectively inputting the training data into a naive bayesian classifier, then obtaining the target motion of the target limb calculated by the naive bayesian classifier, checking whether the instruction corresponding to the target motion of the target limb calculated by the naive bayesian classifier is a deformation instruction, if not, adjusting the parameters in the naive bayesian classifier, and finally enabling the instruction calculated by the naive bayesian classifier to be the same as the instruction corresponding to the target motion of the known target limb; and training other frequency domain characteristic data by adopting the same method to finally obtain a classifier model. When the wearable device collects the electromyographic signals, after the electromyographic signals are processed, if the frequency domain characteristic data of the electromyographic signals is 1HZ, inputting the frequency domain characteristic data 1HZ into a classifier model, calculating by the classifier model to obtain a command corresponding to the frequency domain characteristic data 1HZ as a deformation command, the wearable device sends the data signal to the terminal, that is, sends the deformation instruction to the terminal, so that the terminal executes the deformation instruction when receiving the deformation instruction, so that the currently running tetris is deformed to realize the direct control of tetris games, and then, the user can send a deformation instruction to the terminal through the deformation key, at the moment, the terminal directly ignores the deformation instruction when receiving the deformation instruction, the user can feel that the current Russian square is deformed just after the deformation key is pressed, and the user experience is improved.

In the same way, the instruction corresponding to the frequency domain characteristic data 2HZ of the electromyographic signal can be obtained as a downward instruction; the command corresponding to the frequency 3HZ of the electromyographic signal is a leftward command; the command corresponding to the frequency 4HZ of the electromyographic signal is a right command, which is not described herein again in this embodiment.

It should be noted that, a method for the wearable device to obtain the corresponding instruction according to the time domain characteristic data of the electromyographic signal is the same as the method for obtaining the corresponding instruction according to the frequency domain characteristic data of the electromyographic signal, which can be referred to above, and this embodiment is not described herein again.

According to the technical scheme, after the wearable device collects the electromyographic signals, the electromyographic signals are processed, then the data signals are sent to the terminal according to the processed electromyographic signals, the data signals are the second operation instructions, when the user sends the first operation instructions to the terminal, the terminal executes the second operation instructions before receiving the first operation instructions, the processing time of the terminal on the electromyographic signals is saved, the user can further feel that the terminal executes the first operation instructions when sending the first operation instructions, the time for the user to send the first operation instructions to the terminal is not needed to wait, the control time is shortened, and user experience is improved.

Further, as shown in fig. 1b, after the step 102 is executed, the following

steps

103 and 105 are also included:

in step 103, a response message sent by the terminal is received.

Wherein, the response message carries a success identifier or a failure identifier of the terminal for receiving the data signal.

It should be noted that, according to different contents indicated by the received response message, the following executed steps are also different, and when it is determined that the response message carries the successful identifier of the received data signal, step 104 is executed; when it is determined that the response message carries the failure flag of the received data signal, step 105 is executed.

In step 104, when it is determined that the response message carries the successful identifier for receiving the data signal, the transmission success information is displayed.

In step 105, when it is determined that the response message carries the failure identifier for receiving the data signal, the data signal is sent to the terminal again according to the electromyographic signal.

For example, when receiving a response message, the wearable device analyzes the response message, determines whether the response message carries a successful data signal transmission identifier or a failed data signal transmission identifier, and if the response message is determined to be the successful data signal transmission identifier, sends successful information through voice broadcast, or vibrates the wearable device, so that a user knows that the data signal transmission is successful; and if the data signal transmission failure identification is determined, transmitting the data signal to the terminal again according to the electromyographic signal, and ensuring that the terminal receives the correct data signal.

Terminal side

Fig. 2a is a flowchart illustrating a signal control method applied to a terminal according to an exemplary embodiment, and as shown in fig. 2a, the signal control method includes the following steps 201 to 203:

in step 201, a data signal is received.

For example, the terminal receives the data signal sent by the wearable device through the wired data transmission interface or the wireless transmission module, and for the specific type of the wired data transmission interface and the type of the wireless transmission module, reference may be made to the description in step 101, which is not described herein again in this embodiment.

It should be noted that, when the data signal sent to the terminal by the wearable device is an electromyographic signal, the data signal received by the terminal is the electromyographic signal; when the data signal sent to the terminal by the wearable device is the instruction corresponding to the target action of the target limb, the data signal received by the terminal is the instruction corresponding to the target action of the target limb.

In step 202, a second operation instruction corresponding to the data signal is executed.

For example, if the data signal is an electromyographic signal, the terminal needs to process the data signal, and execute a corresponding second operation instruction according to the processed data signal; and if the data signal is an instruction corresponding to the target action of the target limb, the data signal is a second operation instruction, and the terminal directly executes the second operation instruction.

Optionally, when the data signal is an electromyographic signal, a specific method for executing the second operation instruction corresponding to the data signal is as follows:

extracting characteristic information of the data signal;

For example, after the terminal receives the data signal, the data signal needs to be processed, the data signal is an electromyographic signal acquired by the wearable device, the terminal performs fast fourier transform on each data signal to obtain a frequency spectrum or a power spectrum of each data signal, the change of each data signal can be reflected on a frequency dimension, the frequency of each data signal is further obtained through the distribution of the frequency spectrum or the power spectrum, and the frequency of each data signal is displayed, so that a user can determine the corresponding relationship among the frequency of each data signal, the target motion of a target limb and the instruction corresponding to the target motion of the target limb through experiments, and then the corresponding relationship between the frequency of each data signal and the instruction corresponding to the target motion of the target limb is stored in the terminal, so that when the terminal receives the data signal, the data signal is subjected to fast fourier transform, obtaining a frequency spectrum or a power spectrum of the data signal, finally obtaining the frequency of the data signal according to the distribution of the frequency spectrum or the power spectrum of the data signal, then determining whether the frequency of the data signal is stored, if it is determined that the frequency of the data signal is stored, searching for an instruction corresponding to the frequency of the data signal, and implementing processing on the received data signal, where the processed data signal is an instruction corresponding to a target action of a target limb, and the instruction is a second operation instruction, and the terminal directly executes the second operation instruction, so that the control of the terminal is implemented, and the control of the terminal includes control over each interface displayed on the terminal, control over a touch screen of the terminal, control over keys of the terminal, and the like, and the embodiment is not limited herein. For an example of specifically processing the data signal by using the method, reference may be made to the corresponding description in step 102, and details of this embodiment are not repeated herein.

For example, the terminal extracts time domain characteristic data or frequency domain characteristic data of each data signal, where the time domain characteristic data mainly includes an integral myoelectricity value, a root mean square value, an absolute value integral, a zero-crossing point number, a variance, a Willison amplitude, a time sequence model of a myoelectricity signal, a myoelectricity signal histogram, and the like, and a method for analyzing and extracting time domain characteristic data of a data signal by using a time domain method may refer to a corresponding method in the prior art, and this embodiment is not described herein again. The frequency characteristic data mainly includes average power, average frequency and median frequency, and the method for analyzing and extracting the frequency domain characteristic data of the data signal by using the frequency domain method may refer to a corresponding method in the prior art, which is not described herein again in this embodiment.

Taking the frequency domain feature data of the extracted data signal as an example, after the terminal acquires the frequency domain feature data of each data signal, all the frequency domain feature data of each data signal are used as training data, a naive Bayes classifier is preset on the terminal, then each training data is input into the naive Bayes classifier, then an instruction corresponding to the target motion of the target limb calculated by the naive Bayes classifier is acquired, the calculated instruction is compared with the instruction corresponding to the target motion of the known target limb, parameters in the naive Bayes classifier are adjusted according to the comparison result, finally the instruction calculated by the naive Bayes classifier is the same as the instruction corresponding to the target motion of the known target limb, and at the moment, the naive Bayes classifier is the classifier model obtained by training.

When the terminal acquires the target action of the target limb corresponding to the data signal by using the classifier model, the frequency domain feature data of the data signal is extracted from the received data signal according to the method, and then the extracted frequency domain feature data of the data signal is input to the classifier model for instruction prediction, so that the data signal is processed, the processed data signal is an instruction corresponding to the target action of the target limb, the instruction is a second operation instruction, the terminal directly executes the second operation instruction, so that the terminal is controlled, the terminal is controlled by the terminal, and the control on the terminal comprises control on each interface displayed on the terminal, control on a terminal touch screen, control on terminal keys and the like, and the embodiment is not limited herein. For an example of specifically processing the data signal by using the method, reference may be made to the corresponding description in step 102, and details of this embodiment are not repeated herein.

It should be noted that, a method for the terminal to obtain the corresponding instruction according to the time domain characteristic data of the data signal is the same as the method for obtaining the corresponding instruction according to the frequency domain characteristic data of the data signal, which can be referred to above, and this embodiment is not described herein again.

In step 203, if a first operation instruction is obtained according to the target action, the first operation instruction is prohibited from being executed, and the first operation instruction is the same as the second operation instruction.

For example, after executing the second operation instruction corresponding to the data signal, if the first operation instruction corresponding to the target action is acquired, at this time, the first operation instruction is compared with the second operation instruction, and when it is determined that the first operation instruction is the same as the second operation instruction, the first operation instruction is ignored, and repeated execution of the same instruction is avoided.

According to the technical scheme provided by the embodiment of the disclosure, after the terminal receives the data signal, the data signal needs to be processed, and the time required by the terminal for processing the data signal is negligible for the feedback time of the muscle of the user, so that when the user sends the first operation instruction to the terminal, the terminal already executes the second operation instruction corresponding to the data signal before receiving the first operation instruction, and the second operation instruction is the same as the first operation instruction, so that the user can feel that the terminal executes the first operation instruction while sending the first operation instruction, the time for sending the first operation instruction to the terminal by the user does not need to be waited, the control time is shortened, and the user experience is further improved.

Further, as shown in fig. 2b, after the step 201 is executed, the method further includes a step 204:

in step 204, a response message is sent to the wearable device.

For example, when receiving a data signal, a terminal needs to determine whether the data signal is received completely or not, and whether there is a packet loss or not, and if it is determined that the data signal is received completely or there is no packet loss, it is determined that the data signal is received successfully, and at this time, a response message carrying a successful identifier is fed back to the wearable device; and if the data signal is determined to be incomplete and have packet loss, determining that the data signal is failed to be received, and feeding back a response message carrying a failure identifier to the wearable device at the moment, so that the wearable device sends the data signal to the terminal again, and the terminal receives the data signal again, thereby ensuring the accuracy of the terminal in receiving the data signal.

The implementation is described in detail below by way of several embodiments.

Fig. 3 is an interaction diagram illustrating a signal control method according to an exemplary embodiment, where the execution subjects are a wearable device and a terminal, as shown in fig. 3, including the following steps 301 to 305.

In step 301, the wearable device collects electromyographic signals of a target limb.

In step 302, the wearable device extracts feature information of the electromyographic signal.

In step 303, the wearable device acquires a data signal according to the characteristic information of the electromyographic signal, and sends the data signal to the terminal, and the terminal receives the data signal.

In step 304, the terminal executes a second operation instruction corresponding to the data signal.

In step 305, if a first operation instruction is obtained according to the target action, the first operation instruction is prohibited from being executed, and the first operation instruction is the same as the second operation instruction.

The embodiment of the disclosure provides a signal control method, in which a wearable device sends a data signal to a terminal according to a collected myoelectric signal, so that when a user sends a first operation instruction to the terminal, the terminal executes a second operation instruction corresponding to the data signal before receiving the first operation instruction, and the second operation instruction is the same as the first operation instruction, so that the user can feel that the terminal executes the first operation instruction while sending the first operation instruction, without waiting for the time for the user to send the first operation instruction to the terminal, the control time is shortened, and further the user experience is improved.

Fig. 4 is an interaction diagram illustrating a signal control method according to an exemplary embodiment, where the execution subjects are a wearable device and a terminal, as shown in fig. 4, including the following steps 401 to 405.

In step 401, the wearable device collects electromyographic signals of a target limb.

In step 402, the wearable device transmits a data signal to the terminal according to the electromyographic signal, and the terminal receives the data signal.

In step 403, the terminal extracts characteristic information of the data signal.

In step 404, the terminal obtains a second operation instruction according to the characteristic information of the data signal, and executes the second operation instruction.

In step 405, if a first operation instruction is obtained according to the target action, the first operation instruction is prohibited from being executed, and the first operation instruction is the same as the second operation instruction.

The following are embodiments of the disclosed apparatus that may be used to perform embodiments of the disclosed methods.

Fig. 5a is a schematic structural diagram illustrating a signal control apparatus 50 according to an exemplary embodiment, where the apparatus 50 may be implemented as part or all of an electronic device through software, hardware, or a combination of the two. As shown in fig. 5a, the signal control device 50 includes an acquisition module 501 and a first transmission module 502.

The collecting module 501 is configured to collect an electromyographic signal of a target limb, where the electromyographic signal indicates a target motion of the target limb.

A first sending module 502, configured to send a data signal to a terminal according to the electromyographic signal, so that the terminal executes a second operation instruction corresponding to the data signal before acquiring the first operation instruction according to the target action, where the second operation instruction is the same as the first operation instruction.

In one embodiment, as shown in FIG. 5b, the apparatus 50 further comprises an extraction module 503, and the first sending module 502 comprises a first obtaining submodule 5021 and a first sending submodule 5022.

The extraction module 503 is configured to extract feature information of the electromyographic signal.

The first obtaining sub-module 5021 is configured to obtain a data signal according to the feature information of the electromyographic signal.

The first transmitting submodule 5022 is used for transmitting the data signal to the terminal.

In one embodiment, as shown in fig. 5c, the first transmission module 502 includes a second transmission submodule 5023.

The second sending submodule 5023 is used for sending a data signal to a terminal through a wired data transmission interface; the wired data transmission interface comprises one of an RS232 interface, an RS242 interface and an RS485 interface;

or;

In one embodiment, as shown in fig. 5d, the apparatus 50 further comprises a first receiving module 504, a first determining module 505, and a second determining module 506.

The first receiving module 504 is configured to receive a response message sent by a terminal; and the response message carries a success identifier or a failure identifier of the terminal for receiving the data signal.

The first determining module 505 is configured to, when it is determined that the response message carries a successful identifier for receiving the data signal, display sending success information.

The second determining module 506 is configured to send the data signal to the terminal again according to the electromyographic signal when it is determined that the response message carries the failure identifier for receiving the data signal.

The embodiment of the disclosure provides a signal control device, which sends a data signal to a terminal according to an acquired electromyographic signal, so that when a user sends a first operation instruction to the terminal, the terminal executes a second operation instruction corresponding to the data signal before receiving the first operation instruction, and the second operation instruction is the same as the first operation instruction, so that the user can feel that the terminal executes the first operation instruction while sending the first operation instruction, the time for the user to send the first operation instruction to the terminal does not need to be waited, the control time is shortened, and further the user experience is improved.

Fig. 6a is a schematic structural diagram illustrating a signal control apparatus 60 according to an exemplary embodiment, where the apparatus 60 may be implemented as part or all of an electronic device through software, hardware, or a combination of the two. As shown in fig. 6a, the signal control device 60 includes a second receiving module 601, a first executing module 602, and a second executing module 603.

The second receiving module 601 is configured to receive a data signal.

The first executing module 602 is configured to execute a second operation instruction corresponding to the data signal.

The second executing module 603 is configured to prohibit execution of a first operation instruction when the first operation instruction is obtained according to a target action, where the first operation instruction is the same as the second operation instruction.

In one embodiment, as shown in fig. 6b, the first execution module 602 includes an extraction sub-module 6021, a second acquisition sub-module 6022, and an execution sub-module 6023.

The extraction submodule 6021 is configured to extract feature information of the data signal.

The second obtaining sub-module 6022 is configured to obtain a second operation instruction according to the characteristic information of the data signal.

The execution sub-module 6023 is configured to execute the second operation instruction.

In one embodiment, as shown in fig. 6c, the apparatus 60 further comprises a second sending module 604.

Wherein the second sending module 604 is configured to send a response message to the wearable device; and the response message carries a success identifier or a failure identifier of the terminal for receiving the data signal.

The embodiment of the disclosure provides a signal control device, when a user sends a first operation instruction to a terminal, because the terminal already executes a second operation instruction corresponding to a data signal before receiving the first operation instruction, and the second operation instruction is the same as the first operation instruction, the terminal can execute the first operation instruction while the user feels that the first operation instruction is sent, and there is no need to wait for the time for the user to send the first operation instruction to the terminal, so that the control time is shortened, and further the user experience is improved.

The disclosed embodiment provides a signal control device, which includes:

a first processor;

a first memory for storing first processor-executable instructions;

wherein the first processor is configured to:

In one embodiment, the first processor may be further configured to:

extracting feature information of the electromyographic signals;

In one embodiment, the first processor may be further configured to:

or;

In one embodiment, the first processor may be further configured to:

The disclosed embodiment provides a signal control device, which includes:

A second processor;

a second memory for storing second processor-executable instructions;

wherein the second processor is configured to:

receiving a data signal;

executing a second operation instruction corresponding to the data signal;

In one embodiment, the second processor may be further configured to:

extracting characteristic information of the data signal;

In one embodiment, the second processor may be further configured to:

With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.

Fig. 7 is a block diagram illustrating a structure of a signal control apparatus 70 according to an exemplary embodiment, the apparatus 70 being adapted to a terminal. For example, the apparatus 70 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, an exercise device, a personal digital assistant, and the like.

The apparatus 70 may include one or more of the following components: a processing component 702, a memory 704, a power component 706, a multimedia component 708, an audio component 710, an input/output (I/O) interface 712, a sensor component 714, and a communication component 716.

The processing component 702 generally controls overall operation of the device 70, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing element 702 may include one or more processors 720 to execute instructions to perform all or part of the steps of the methods described above. Further, the processing component 702 may include one or more modules that facilitate interaction between the processing component 702 and other components. For example, the processing component 702 can include a multimedia module to facilitate interaction between the multimedia component 708 and the processing component 702.

The memory 704 is configured to store various types of data to support operations at the device 70. Examples of such data include instructions for any application or method operating on the device 70, contact data, phonebook data, messages, pictures, videos, and so forth. The memory 704 may be implemented by any type or combination of volatile or non-volatile memory devices such as Static Random Access Memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic or optical disks.

The power component 706 provides power to the various components of the device 70. The power components 706 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the device 70.

The multimedia component 708 includes a screen that provides an output interface between the device 70 and the user. In some embodiments, the screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive an input signal from a user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the device 70 is in an operating mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

The audio component 710 is configured to output and/or input audio signals. For example, the audio component 710 includes a Microphone (MIC) configured to receive external audio signals when the apparatus 70 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may further be stored in the memory 704 or transmitted via the communication component 716. In some embodiments, audio component 710 also includes a speaker for outputting audio signals.

The I/O interface 712 provides an interface between the processing component 702 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a home button, a volume button, a start button, and a lock button.

The sensor assembly 714 includes one or more sensors for providing various aspects of status assessment for the device 70. For example, the sensor assembly 714 may detect an open/closed state of the device 70, the relative positioning of the components, such as a display and keypad of the device 70, the sensor assembly 714 may also detect a change in the position of the device 70 or a component of the device 70, the presence or absence of user contact with the device 70, the orientation or acceleration/deceleration of the device 70, and a change in the temperature of the device 70. The sensor assembly 714 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 714 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

The communication component 716 is configured to facilitate wired or wireless communication between the apparatus 70 and other devices. The device 70 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication section 716 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

In an exemplary embodiment, the apparatus 70 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described methods.

In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as the memory 704 comprising instructions, executable by the processor 720 of the device 70 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.

The disclosed embodiments provide a non-transitory computer-readable storage medium, wherein when instructions in the storage medium are executed by a processor of a wearable device, the wearable device is enabled to perform the above signal control method, and the method includes:

extracting feature information of the electromyographic signals;

Or;

The disclosed embodiments provide a non-transitory computer-readable storage medium, wherein when instructions in the storage medium are executed by a processor of a terminal, the terminal is enabled to execute the above signal control method, and the method includes:

receiving a data signal;

executing a second operation instruction corresponding to the data signal;

extracting characteristic information of the data signal;

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A signal control method is applied to a wearable device and comprises the following steps:

2. The method according to claim 1, before the transmitting the data signal to the terminal according to the electromyographic signal, further comprising:

extracting feature information of the electromyographic signals;

3. The method according to claim 1, wherein the transmitting a data signal to a terminal according to the electromyographic signal comprises:

Or;

4. The method according to claim 1, after the transmitting data signal to the terminal according to the electromyographic signal, further comprising:

5. A signal control method is applied to a terminal and comprises the following steps:

receiving a data signal;

executing a second operation instruction corresponding to the data signal;

6. The method of claim 5, wherein executing the second operation instruction corresponding to the data signal comprises:

Extracting characteristic information of the data signal;

7. The method of claim 5, further comprising, after said receiving a data signal:

8. A signal control apparatus, comprising:

9. The apparatus of claim 8, further comprising an extraction module, the first sending module comprising a first acquisition sub-module and a first sending sub-module;

10. The apparatus of claim 8, wherein the first transmitting module further comprises a second transmitting submodule;

or;

11. The method of claim 8, further comprising a first receiving module, a first determining module, and a second determining module;

12. A signal control apparatus, comprising:

the second receiving module is used for receiving the data signal;

13. The apparatus of claim 12, wherein the first execution module comprises an extraction sub-module, a second acquisition sub-module, and an execution sub-module;

14. The apparatus of claim 12, further comprising a second transmitting module;

15. A signal control apparatus, comprising:

a first processor;

a first memory for storing first processor-executable instructions;

wherein the first processor is configured to:

16. A signal control apparatus, comprising:

a second processor;

a second memory for storing second processor-executable instructions;

wherein the second processor is configured to:

receiving a data signal;

executing a second operation instruction corresponding to the data signal;

17. A computer-readable storage medium having stored thereon computer instructions, which when executed by a processor, perform the steps of the method of claims 1 to 4.

18. A computer-readable storage medium having stored thereon computer instructions, which when executed by a processor, perform the steps of the method of claims 5 to 7.