CN109727596B - Method for controlling remote controller and remote controller - Google Patents
Method for controlling remote controller and remote controller Download PDFInfo
- Publication number
- CN109727596B CN109727596B CN201910008580.1A CN201910008580A CN109727596B CN 109727596 B CN109727596 B CN 109727596B CN 201910008580 A CN201910008580 A CN 201910008580A CN 109727596 B CN109727596 B CN 109727596B
- Authority
- CN
- China
- Prior art keywords
- remote controller
- voice
- user
- instruction
- head
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Selective Calling Equipment (AREA)
Abstract
The invention provides a method for controlling a remote controller and the remote controller, comprising the following steps: starting a remote controller according to a first limb action instruction of a user; opening a control mode of the function of the equipment controlled by the remote controller according to at least one voice instruction of a user; and controlling the function of the equipment controlled by the remote controller according to the second limb action instruction of the user. According to the method for controlling the remote controller and the remote controller, the functions of the equipment controlled by the remote controller are controlled by combining the voice command and the limb action of the user, the technical problem that the group with disabled upper limbs cannot control the household appliances by operating the keys of the remote controller by hands is solved, and different use requirements of the user are met.
Description
Technical Field
The invention relates to the technical field of remote controllers, in particular to a method for controlling a remote controller and the remote controller.
Background
At present, household appliances in families, such as televisions, air conditioners and electric lamps, are provided with remote control functions, particularly the air conditioners, and almost all the functions are controlled by using a remote controller.
For normal people, the remote controller is very simple to use, and for the group with physical disabilities, especially the disabled upper limbs, the operation of the keys on the common remote controller is almost impossible.
At present, some methods which can be controlled without hands, such as the latest smart televisions, can be controlled through voice recognition, but the voice and somatosensory control equipment which is suitable for household electrical control in the market at present has the following defects: the device is a part of exclusive equipment, can only be applied to electric appliances of a certain exclusive brand, and is lack of universality; when the remote controller is used, the keys on the remote controller are operated.
Disclosure of Invention
In view of this, the embodiment of the invention provides a method for controlling a remote controller and the remote controller, which solve the technical problem that a group with disabled upper limbs cannot control a household appliance by operating keys of the remote controller with hands, and meet different use requirements of users.
A first aspect of embodiments of the present invention is to provide a method for controlling a remote controller and a remote controller, where the method includes: starting a remote controller according to a first limb action instruction of a user; opening a control mode of the remote controller for the functions of the controlled equipment according to at least one voice instruction of a user; and controlling the function of the equipment controlled by the remote controller according to the second limb action instruction of the user.
In some embodiments, the at least one voice instruction comprises a first voice instruction and a second voice instruction, wherein turning on a control mode of the remote controller for a function of the controlled device according to the at least one voice instruction of the user comprises: receiving a first voice instruction of a user, and matching the first voice instruction with first preset voice data stored in a remote controller; when the first voice instruction is matched with the first preset voice data, starting a control mode of the remote controller on the controlled equipment; receiving a second voice instruction of the user, and matching the second voice instruction with second preset voice data stored in the remote controller; and when the second voice instruction is matched with the second preset voice data, starting a control mode of the remote controller for the function of the controlled equipment.
In some embodiments, before the turning on the control mode of the remote controller for the function of the controlled device according to at least one voice instruction of the user, the method further comprises: after the remote controller starts, output first voice prompt, the suggestion user opens the equipment that the remote controller controlled, wherein, before receiving user's second voice command, still include: and outputting a second voice prompt to prompt the user that the equipment controlled by the remote controller is started or has error information.
In some embodiments, in the non-stationary state, controlling the function of the device controlled by the remote controller according to the third voice instruction, wherein controlling the function of the device controlled by the remote controller according to the second limb action instruction of the user includes: and under the static state, controlling the functions of the equipment controlled by the remote controller according to the second limb action command of the user.
In some embodiments, the motion corresponding to the first limb motion command and the motion corresponding to the second limb motion command comprise head motions.
In some embodiments, the head action includes nodding up and down or deflecting the head left and right; the action corresponding to the first limb action command and the action corresponding to the second limb action command comprise left-right head deflection or up-down head pointing.
In some embodiments, turning on the remote control according to the first limb action instruction of the user comprises: acquiring first position information of a user when limbs are static; acquiring second position information of the user during the first limb action; and comparing the second position information with the first position information, judging the type of the second limb movement according to the comparison result, and controlling the remote controller to be turned on or turned off according to the type of the second limb movement.
In some embodiments, the remote controller detects a first limb action instruction and a second limb action instruction by using the acceleration sensor, the action corresponding to the first limb action instruction and the action corresponding to the second limb action instruction comprise head lowering, head raising, head left deviation and head right deviation, and compared with the limb at rest, when the head is lowered, the parameter value of the x axis of the acceleration sensor is reduced, the parameter value of the y axis is unchanged, and the parameter value of the z axis is increased; during head raising, the parameter value of the x axis of the acceleration sensor is increased, the parameter value of the y axis is unchanged, and the parameter value of the z axis is reduced; when the head is deviated to the left, the parameter value of the x axis of the acceleration sensor is reduced, the parameter value of the y axis is increased, and the parameter value of the z axis is unchanged; when the head deviates to the right, the parameter value of the x axis of the acceleration sensor is increased, the parameter value of the y axis of the acceleration sensor is decreased, and the parameter value of the z axis of the acceleration sensor is unchanged.
In some embodiments, the remote control is worn on the head, using a three-point head-mount approach.
A second aspect of an embodiment of the present invention is to provide a remote controller, including: the starting module is used for starting the remote controller according to the first limb action instruction of the user and starting a control mode of the remote controller for the function of the controlled equipment according to at least one voice instruction of the user; and the control module is used for controlling the functions of the equipment controlled by the remote controller according to the second limb action instruction of the user.
A third aspect of embodiments of the present invention provides a remote controller, including: a memory for storing voice data and limb motion data; the voice recognition chip is used for recognizing the received at least one voice instruction and the voice data stored in the memory or recognizing the received limb action instruction and the limb action data stored in the memory to obtain a voice recognition result; the acceleration sensor is used for detecting a first limb action instruction and a second limb action instruction of a user; and the main controller is connected with the acceleration sensor and the voice recognition chip and is used for receiving a first limb action instruction, a second limb action instruction and a voice recognition result of the user, which are detected by the acceleration sensor, starting the remote controller according to the first limb action instruction of the user, starting a control mode of the remote controller on the functions of the controlled equipment according to the voice recognition result, and controlling the functions of the equipment controlled by the remote controller according to the second limb action instruction of the user.
In some embodiments, fixing rope grooves are arranged on three adjacent edges of the remote controller, and the fixing rope grooves are used for fixing the remote controller on the head in a three-point head-wearing manner.
In some embodiments, the remote control further comprises: the microphone is connected with the voice recognition chip and used for receiving at least one voice instruction; and the voice player is connected with the voice recognition chip and used for playing prompt voice.
Yet another aspect of embodiments of the present invention provides a computer-readable storage medium having stored thereon computer-executable instructions, wherein the executable instructions, when executed by a processor, implement the method as described above.
Yet another aspect of an embodiment of the present invention provides a computer apparatus, including: the system comprises a memory, a processor and executable instructions stored in the memory and executable in the processor, wherein the processor implements the method as described above when executing the executable instructions.
The method for controlling the remote controller and the remote controller provided by the embodiment of the invention have the following technical effects:
according to the method for controlling the remote controller and the remote controller, the functions of the equipment controlled by the remote controller are controlled by combining the voice command and the limb action of the user, the technical problem that the group with disabled upper limbs cannot control the household appliances by operating the keys of the remote controller by hands is solved, and different use requirements of the user are met.
Drawings
In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings needed to be used in the description of the embodiments are briefly introduced below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and other drawings can be obtained by those skilled in the art without inventive efforts, wherein:
fig. 1 is a flowchart of a method of controlling a remote controller according to an embodiment of the present invention.
Fig. 2 is a flowchart of a method of controlling a remote controller according to another embodiment of the present invention.
Fig. 3 is a flowchart of a method of controlling a remote controller according to another embodiment of the present invention.
Fig. 4 is a flowchart of a method of controlling a remote controller according to another embodiment of the present invention.
Fig. 5 is a flowchart of a method of controlling a remote controller according to another embodiment of the present invention.
Fig. 6 is a schematic diagram of a method for wearing a remote controller according to another embodiment of the present invention.
Fig. 7 is a flowchart of a method of controlling a remote controller according to another embodiment of the present invention.
Fig. 8 is a diagram of an overall control hierarchy of a remote controller according to another embodiment of the present invention.
Fig. 9 is a schematic structural diagram of a remote controller according to another embodiment of the present invention.
Fig. 10 is a hardware general block diagram of a remote controller according to another embodiment of the present invention.
Fig. 11 is a block diagram illustrating a computer apparatus for controlling a remote controller according to an exemplary embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
Fig. 1 is a flowchart of a method of controlling a remote controller according to an embodiment of the present invention. The method may be performed by a master controller in a remote control, for example.
As shown in fig. 1, a first aspect of the embodiments of the present invention provides a method for controlling a remote controller, the method including:
110: and starting the remote controller according to the first limb action instruction of the user.
120: and starting a control mode of the remote controller for the functions of the controlled equipment according to at least one voice command of the user.
130: and controlling the function of the equipment controlled by the remote controller according to the second limb action instruction of the user.
Specifically, in this embodiment, the first limb action does not include a pressing action of a finger, where the first limb action includes up and down nodding or left and right deflecting the head to wake up the remote controller, and the type of the first limb action is not particularly limited by the present invention, as long as the limb action capable of waking up the remote controller is within the protection scope of the present invention.
According to the method for controlling the remote controller and the remote controller, the functions of the equipment controlled by the remote controller are controlled by combining the voice command and the limb action of the user, the technical problem that the group with disabled upper limbs cannot control the household appliances by operating the keys of the remote controller by hands is solved, and different use requirements of the user are met.
It should be noted that the method for controlling a remote controller according to the embodiment of the present invention is not only suitable for an air conditioner, but also suitable for a television, an electric lamp, and other household appliances.
Fig. 2 is a flowchart of a method of controlling a remote controller according to another embodiment of the present invention. The method of fig. 2 is an example of the embodiment of fig. 1.
As shown in fig. 2, in an embodiment of the present invention, the at least one voice command includes a first voice command and a second voice command, wherein the turning on the control mode of the function of the device controlled by the remote controller according to the at least one voice command of the user includes:
121: and receiving a first voice instruction of a user, and matching the first voice instruction with first preset voice data stored in the remote controller.
122: and when the first voice command is matched with the first preset voice data, starting a control mode of the remote controller for the controlled equipment.
123: and receiving a second voice instruction of the user, and matching the second voice instruction with second preset voice data stored in the remote controller.
124: and when the second voice instruction is matched with the second preset voice data, starting a control mode of the remote controller for the function of the controlled equipment.
Specifically, the first voice instruction refers to selection of an electric appliance such as a television, an air conditioner, an electric lamp and a mouse, the type of equipment selected by the first voice instruction is not specifically limited, which is the first layer of the overall control hierarchy of the remote controller in the embodiment of the present invention, and the second voice instruction refers to control of turning on and off the television or adjustment of a signal source, a channel and volume; or the control of heating, refrigeration and shutdown of the air conditioner; or a direct switching operation performed on the electric lamp; or the mouse is provided with an analog mouse operation, which is the second layer of the overall control hierarchy of the remote controller of the embodiment of the present invention.
Based on the embodiment of the invention, on the basis of awakening the remote controller through somatosensory, the remote controller of the embodiment of the invention is controlled by the first layer and the second layer of the overall control layer through a simple voice command, so that the control of the remote controller on the household appliance can be carried out on the level of function control, the operation of both hands of a user is not needed, both hands of the user are liberated, and the use of the user is facilitated.
Fig. 3 is a flowchart of a method of controlling a remote controller according to another embodiment of the present invention. The method of fig. 3 is an example of the embodiment of fig. 1.
As shown in fig. 3, before the control mode of the remote controller for the functions of the controlled device is turned on according to at least one voice instruction of the user, the method further includes:
114: and after the remote controller is started, outputting a first voice prompt to prompt a user to start equipment controlled by the remote controller.
Before receiving a second voice instruction of the user, the method further comprises the following steps:
115: and outputting a second voice prompt to prompt the user that the equipment controlled by the remote controller is started or has error information.
Specifically, the remote controller may output a voice prompt to prompt a user about a current operation and a control result, for example, after the remote controller is turned on, the remote controller may output a "device selection" voice through a speaker provided thereon to prompt the user to select a device, and after the user makes a selection, the remote controller repeats the user's selection of the device or prompts an error message.
Further, after the user selects the equipment, the remote controller outputs a voice of 'function selection' to prompt the user to select the function of the equipment, and after the user selects, the voice of the remote controller repeats the selection of the user to the function of the equipment or prompts error information.
According to the embodiment of the invention, the voice broadcasting device such as a loudspeaker is arranged on the remote controller, the current operation of the user is broadcasted, and the control result of the user on the function of the equipment is broadcasted, so that the function of the equipment to be controlled can be accurately and infallibly controlled, and the user experience is improved.
Fig. 4 is a flowchart of a method of controlling a remote controller according to another embodiment of the present invention. The method of fig. 4 is an example of the embodiment of fig. 1.
As shown in fig. 4, in one embodiment of the invention, the method further comprises:
132: and in the non-static state, controlling the functions of the equipment controlled by the remote controller according to the third voice command.
Wherein, controlling the function of the equipment controlled by the remote controller according to the second limb action instruction of the user comprises:
131: and under the static state, controlling the functions of the equipment controlled by the remote controller according to the second limb action command of the user.
Specifically, the second body motion includes left-right head swinging or up-down head nodding, where the third voice instruction is applied in a scene that the remote controller cannot be controlled through the second body motion under a non-static condition, and the effect of controlling the functions of the device controlled by the remote controller can be achieved only through the third voice instruction, where the third voice instruction includes a television execution start-up command, a television execution shutdown command, a television information source selection command, a television channel selection command and a television volume selection command, a start-up heating command, a start-up cooling command and a shutdown command of an air conditioner, for example, the third voice instruction is a reduction of the television volume or an increase of the television volume, and the remote controller correspondingly adjusts the television volume according to the third voice instruction without matching with the body motion; the application scenario of the method may also be that, in a static state, in a very noisy environment and under the condition that the second voice instruction (selecting a function of a device controlled by the remote controller) has been identified, when the remote controller cannot be controlled through the third voice instruction, the remote controller is controlled by combining the second voice instruction and the second body action (executing the control of the remote controller on the function of the electrical appliance).
According to the embodiment of the invention, by considering different application environments of the remote controller, the functions of the equipment controlled by the remote controller are set to be suitable for static and noisy environments and can be used in non-static environments and the like, and a user can flexibly select a proper mode for controlling the remote controller in different environments, so that the use requirements of the user are met.
In one embodiment of the invention, the motion corresponding to the first limb motion command and the motion corresponding to the second limb motion command comprise head motions.
In this embodiment, the head action includes nodding the head up and down or deflecting the head left and right; the action corresponding to the first limb action command and the action corresponding to the second limb action command comprise left-right head deflection or up-down head nodding, wherein the judgment of the head nodding is realized by successfully finishing the judgment of the combined action of 'head lowering' + 'head raising' within a limited time.
Specifically, the head movements include up and down nodding and left and right deflecting heads and rapid up and down nodding and rapid left and right shaking, which all enable the remote control to make corresponding adjustments to the functions of the controlled device.
Based on the embodiment of the invention, the functions of the equipment controlled by the remote controller can be controlled through different head motions, and different head motions correspond to the functions of the equipment controlled by different remote controllers, so that the invention has the characteristic of personalized control.
Fig. 5 is a flowchart of a method of controlling a remote controller according to another embodiment of the present invention. The method of fig. 4 is an example of the embodiment of fig. 1.
As shown in fig. 5, in an embodiment of the present invention, turning on the remote controller according to the first limb action command of the user includes:
111: first position information of a user when a limb is stationary is acquired.
112: and acquiring second position information of the user during the first limb action.
113: and comparing the second position information with the first position information, judging the type of the second limb movement according to the comparison result, and controlling the remote controller to be turned on or turned off according to the type of the second limb movement.
Specifically, in this embodiment, the remote controller detects a first limb action instruction and a second limb action instruction by using a three-axis acceleration sensor, where the action corresponding to the first limb action instruction and the action corresponding to the second limb action instruction include head lowering, head raising, head left deviation, and head right deviation, and when the head is lowered, compared with the static limb, the parameter value of the x-axis of the acceleration sensor is reduced, the parameter value of the y-axis is unchanged, and the parameter value of the z-axis is increased; during head raising, the parameter value of the x axis of the acceleration sensor is increased, the parameter value of the y axis is unchanged, and the parameter value of the z axis is reduced; when the head is deviated to the left, the parameter value of the x axis of the acceleration sensor is reduced, the parameter value of the y axis is increased, and the parameter value of the z axis is unchanged; when the head deviates to the right, the parameter value of the x axis of the acceleration sensor is increased, the parameter value of the y axis of the acceleration sensor is decreased, and the parameter value of the z axis of the acceleration sensor is unchanged. In this embodiment, the remote controller is worn on the head, and a three-point head wearing manner is applied.
Based on the embodiment of the invention, the state of the limb action is judged by monitoring the parameter state values of the x-axis, the y-axis and the z-axis corresponding to different limb actions through the three-axis acceleration sensor in the remote controller, and the main controller in the remote controller controls the remote controller to adjust the corresponding functions of the household appliance according to the state of the limb action, so that the use function of the household appliance can be accurately controlled.
Fig. 6 is a schematic diagram of a method for wearing a remote controller according to another embodiment of the present invention.
As shown in fig. 6, in one embodiment of the present invention, the remote controller is worn on the head, and fixing rope grooves for fixing the remote controller to the head in a three-point head wearing manner are provided on three adjacent sides of the remote controller.
Specifically, the remote controller is designed to be worn on the head, so that the remote controller is convenient for disabled users to use, the users can control various functions of the household appliance only through voice and head actions without hands, great convenience is brought to the users, and the use requirements of different users are met.
In addition, the remote controller also has a learning function, the remote controller needs to be learned before normal control operation is carried out, the learning operation aims at recording correct infrared remote control codes of other infrared remote controllers and storing the correct infrared remote control codes in the remote controller, and after voice and action instructions are correctly recognized, the corresponding infrared remote control codes are output through an infrared emission unit of the remote controller, so that the purpose of replacing the original remote controller to control electrical equipment is achieved; as the infrared remote controllers of different electrical appliances use different coding protocols, the remote controller of the embodiment of the invention can automatically identify the 33bit, 35bit and 67bit protocols of NEC-5 and the RC-5 protocol of Philips. In the infrared learning of the remote controller, a parallel mechanism is adopted to try codes of all received protocols at the same time, and then successfully decoded data are selected according to priority, so that automatic adaptation of the protocols is realized, a new infrared protocol can be expanded at any time in the future, and the remote controller currently supports three types of infrared remote control equipment such as a television air conditioner and an electric lamp (the electric lamp is provided with an infrared switch).
Specifically, the learning function of the remote controller is started by pressing a learning key on the remote controller, starting the remote controller after the learning key is pressed, entering learning operation, using voice output in the whole learning process to prompt a user of the current learning content, and directly stopping the remote controller to quit the learning operation after the learning item is skipped by pressing the learning key in the learning process.
Optionally, as another embodiment, the remote controller further includes a microphone connected to the voice recognition chip for receiving the at least one voice instruction; and the voice player is connected with the voice recognition chip and used for playing prompt voice.
Based on the embodiment of the invention, the infrared codes of the remote controller which can only control one household appliance can be learned and stored by arranging the learning keys on the remote controller and training the remote controller, so that the infrared codes of the remote controller which can only control one household appliance are compatible with the remote control function of the existing remote controller which can only control a specific household appliance, the main functions of the household appliance can be controlled by completely using voice and motion recognition by using a head wearing mode, the remote controller is convenient for users to use, and the use requirements of different users can be met.
Fig. 7 is a flowchart of a method of controlling a remote controller according to another embodiment of the present invention.
As shown in fig. 7, in order to further understand the technical solution of the present invention, the following describes the using process of the present invention in detail with specific embodiments.
111: first position information of a user when a limb is stationary is acquired.
112: and acquiring second position information of the user during the first limb action.
113: and comparing the second position information with the first position information, judging the type of the second limb movement according to the comparison result, and controlling the remote controller to be turned on or turned off according to the type of the second limb movement.
114: and after the remote controller is started, outputting a first voice prompt to prompt a user to start equipment controlled by the remote controller.
115: and outputting a second voice prompt to prompt the user that the equipment controlled by the remote controller is started or has error information.
121: and receiving a first voice instruction of a user, and matching the first voice instruction with first preset voice data stored in the remote controller.
122: and when the first voice command is matched with the first preset voice data, starting a control mode of the remote controller for the controlled equipment.
123: and receiving a second voice instruction of the user, and matching the second voice instruction with second preset voice data stored in the remote controller.
124: and when the second voice instruction is matched with the second preset voice data, starting a control mode of the remote controller for the function of the controlled equipment.
131: and under the static state, controlling the functions of the equipment controlled by the remote controller according to the second limb action command of the user.
132: and in the non-static state, controlling the functions of the equipment controlled by the remote controller according to the third voice command.
It can be understood that the numerical sequence of the method for controlling the remote controller is not limited, for example, the device to be used may be controlled by the first voice command while the remote controller is turned on according to the first limb motion command, so as to save time and improve the control efficiency of the remote controller on the controlled device.
Fig. 8 is a diagram of an overall control hierarchy of a remote controller according to another embodiment of the present invention.
As another embodiment of the present invention, as shown in fig. 8, a method of controlling functions of a controlled apparatus by a remote controller is described as a whole:
the remote controller is worn on the head, the remote controller is started through quick head nod awakening, control logic in the remote controller is divided into three layers, namely selection of a first-layer device type, selection of a second-layer device function and execution of a third-layer device function, the selection of the first-layer device type is firstly introduced, a device to be controlled, such as a television, an air conditioner, an electric lamp or a mouse, is selected through a first voice instruction, specifically, the remote controller can output voice prompt and prompt current operation and control results of a user, for example, after the remote controller is started, the remote controller outputs 'device selection' voice and prompts the user to select the device, after the user selects the device, the remote controller outputs voice repeated user selection or prompts error information, and then selection of the second-layer device function, such as television starting, television shutdown, television information source selection, television channel selection or television volume adjustment The remote controller can output the voice of 'function selection' after the user selects the equipment to prompt the user to select the function of the equipment, when the user selects, the voice of the remote controller repeats the selection of the function of the equipment or prompts error information, and finally, the third layer carries out somatosensory control on the function of the equipment controlled by the remote controller, the layer is completed by combining voice instructions with body actions, for example, the adjustment of the volume of the television is taken as an example, the volume of the television is adjusted by selecting the voice instructions on the layer, then the head is deflected left and right to be directly converted into the output of volume increasing and decreasing remote control, so that the volume of the television is controlled to carry out corresponding adjustment, and the remote controller is not operated by the voice instructions or the body actions after the third layer, the remote controller is directly dormant or enters a dormant state after not being operated for 10 seconds, and particularly, the remote controller enters the dormant state after the corresponding equipment enters the simulated mouse mode and is not operated for 30 seconds.
Fig. 9 is a schematic structural diagram of a remote controller according to another embodiment of the present invention.
As shown in fig. 9, an embodiment of the present invention provides a remote controller, where the remote controller executes the method for controlling a remote controller, including: the starting module 910 is configured to start a remote controller according to a first limb action instruction of a user, and start a control mode of the remote controller for a function of a controlled device according to at least one voice instruction of the user; and the control module 920 is configured to control a function of the device controlled by the remote controller according to the second limb movement instruction of the user.
Specifically, in this embodiment, the first limb action does not include a pressing action of a finger, where the first limb action includes up and down nodding or left and right deflecting the head to wake up the remote controller, and the type of the first limb action is not particularly limited by the present invention, as long as the limb action capable of waking up the remote controller is within the protection scope of the present invention.
According to the method for controlling the remote controller and the remote controller, the functions of the equipment controlled by the remote controller are controlled by combining the voice command and the limb action of the user, the technical problem that the group with disabled upper limbs cannot control the household appliances by operating the keys of the remote controller by hands is solved, and different use requirements of the user are met.
Fig. 10 is a hardware general block diagram of a remote controller according to another embodiment of the present invention.
As shown in fig. 10, an embodiment of the present invention provides a remote controller, where the remote controller executes the method for controlling a remote controller, including: the motion sensing module 1020 is configured to receive and recognize a first limb motion instruction of a user, for example, the motion sensing module may be an acceleration sensor, and may also be configured to detect a second limb motion instruction of the user; a storage module 1010 for storing voice data and limb motion data, which may be, for example, a memory; a voice recognition module 1030, configured to recognize the received at least one voice instruction with the voice data stored in the storage module 1010 or recognize the received limb action instruction with the limb action data stored in the storage module 1010, where for example, the voice recognition module may be a voice recognition chip, and configured to recognize the received at least one voice instruction with the voice data stored in the storage or recognize the received limb action instruction with the limb action data stored in the storage, so as to obtain a voice recognition result; main control unit module 1040, with feel module 1020 and speech recognition module 1030 and be connected for open the remote controller or open the function control mode of the equipment that the remote controller controlled according to the first limbs action instruction of correct discernment or according to the at least one speech instruction of correct discernment, for example, can be main control unit, with acceleration sensor with the speech recognition chip is connected, is used for receiving the acceleration sensor detection user's first limbs action instruction and second limbs action instruction and speech recognition result, according to user's first limbs action instruction is opened the remote controller, according to the speech recognition result is opened the control mode of the function of the equipment that the remote controller controlled, and according to user's second limbs action instruction is right the function of the equipment that the remote controller controlled is controlled.
Optionally, as another embodiment, the remote controller further includes a radio frequency module 1050, and the remote controller includes a radio frequency transmitting module, and cooperates with the radio frequency receiving module to directly control electrical appliances such as an electric lamp (the electric lamp has an infrared switch or a receiving module matching with the transmitting module is built in); specifically, the model of the main controller module 1040 is STM32F103RDT6, the model of the voice recognition module 1030 is LD320A, the model of the motion sensing module 1020 is ADXL345, and the model of the radio frequency module 1050 is NRF24L 01.
Based on the embodiment of the invention, through the matching of all modules in the remote controller, the control of the household appliance can be realized by combining voice instructions with limb actions, and the requirements of various users including users with disabled upper limbs are greatly met.
Fig. 11 is a block diagram illustrating a computer apparatus for controlling a remote controller according to an exemplary embodiment of the present invention.
Referring to fig. 11, the apparatus 1100 includes a processing component 1110 that further includes one or more processors, and memory resources, represented by memory 1120, for storing instructions, such as application programs, that are executable by the processing component 1110. The application programs stored in memory 1120 may include one or more modules that each correspond to a set of instructions. Further, the processing component 1110 is configured to execute instructions to perform the above-described method of controlling a remote control.
The device 1100 may also include a power component configured to perform power management of the device 1100, a wired or wireless network interface configured to connect the device 1100 to a network, and an input-output (I/O) interface. The apparatus 1100 may operate based on an operating system, such as Windows Server, stored in the memory 1120TM，Mac OS XTM，UnixTM，LinuxTM，FreeBSDTMOr the like.
A non-transitory computer readable storage medium having instructions stored thereon that, when executed by a processor of the apparatus 1100, enable the apparatus 1100 to perform a method of controlling a remote control, comprising: starting a remote controller according to a first limb action instruction of a user; opening a control mode of the remote controller for the functions of the controlled equipment according to at least one voice instruction of a user; and controlling the function of the equipment controlled by the remote controller according to the second limb action instruction of the user.
Those of ordinary skill in the art will appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the implementation. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
It is clear to those skilled in the art that, for convenience and brevity of description, the specific working processes of the above-described systems, apparatuses and units may refer to the corresponding processes in the foregoing method embodiments, and are not described herein again.
In the several embodiments provided in the present application, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the units is only one logical division, and other divisions may be realized in practice, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program check codes, such as a U disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk.
The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.
Claims (5)
1. A method of controlling a remote control, comprising:
opening the remote controller according to a first limb action instruction of a user;
starting a control mode of the remote controller for the functions of the controlled equipment according to at least one voice instruction of the user;
controlling a function of the device controlled by the remote controller according to the second limb action instruction of the user,
wherein the at least one voice instruction comprises a first voice instruction and a second voice instruction,
the starting of the control mode of the remote controller for the functions of the controlled equipment according to at least one voice instruction of the user comprises the following steps:
receiving a first voice instruction of the user, and matching the first voice instruction with first preset voice data stored in the remote controller;
when the first voice instruction is matched with the first preset voice data, starting a control mode of the remote controller for the controlled equipment;
receiving a second voice instruction of the user, and matching the second voice instruction with second preset voice data stored in the remote controller;
when the second voice instruction is matched with the second preset voice data, starting a control mode of the remote controller for the function of the controlled equipment; the method further comprises the following steps:
in a non-static state, controlling the function of the equipment controlled by the remote controller according to a third voice instruction,
the controlling the function of the device controlled by the remote controller according to the second limb action instruction of the user comprises:
under the static state, controlling the functions of the equipment controlled by the remote controller according to the second limb action instruction of the user;
the action corresponding to the first limb action instruction and the action corresponding to the second limb action instruction comprise head actions, and the head actions comprise head nodding up and down or head deflection left and right; the action corresponding to the first limb action instruction and the action corresponding to the second limb action comprise left-right head deflection or up-down head pointing;
the turning on of the remote controller according to the first limb action instruction of the user comprises:
acquiring first position information of the user when the limb is static;
acquiring second position information of the user during the first limb action;
comparing the second position information with the first position information, judging the type of the second limb action according to the comparison result, and controlling the remote controller to be turned on or turned off according to the type of the second limb action;
the remote control employs an acceleration sensor to detect the first limb motion command and the second limb motion command,
the motion corresponding to the first limb motion instruction and the motion corresponding to the second limb motion instruction comprise head lowering, head raising, head left deviation and head right deviation, and compared with the static state of the limbs, when the head is lowered, the parameter value of the x axis of the acceleration sensor is reduced, the parameter value of the y axis is unchanged, and the parameter value of the z axis is increased; during the head raising, the parameter value of the x axis of the acceleration sensor is increased, the parameter value of the y axis is unchanged, and the parameter value of the z axis is reduced; when the head is deviated to the left, the parameter value of the x axis of the acceleration sensor is reduced, the parameter value of the y axis of the acceleration sensor is increased, and the parameter value of the z axis of the acceleration sensor is unchanged; when the head is deviated to the right, the parameter value of the x axis of the acceleration sensor is increased, the parameter value of the y axis of the acceleration sensor is decreased, and the parameter value of the z axis of the acceleration sensor is unchanged.
2. The method of claim 1, further comprising, prior to said turning on a control mode of the remote control over the functions of the controlled device according to the at least one voice instruction of the user:
after the remote controller is started, outputting a first voice prompt to prompt a user to start equipment controlled by the remote controller,
before the receiving of the second voice instruction of the user, the method further includes:
and outputting a second voice prompt to prompt the user that the equipment controlled by the remote controller is started or has error information.
3. A remote control for implementing the method of claim 1 or 2, characterized in that the remote control comprises: the device comprises a memory, a voice recognition chip, an acceleration sensor and a main controller, wherein the main controller is connected with the acceleration sensor and the voice recognition chip.
4. The remote controller according to claim 3, wherein fixing rope grooves for fixing the remote controller to a head in a three-point head-wearing manner are provided on adjacent three sides of the remote controller.
5. The remote control of claim 3, further comprising:
the microphone is connected with the voice recognition chip and used for receiving the at least one voice instruction;
and the voice player is connected with the voice recognition chip and used for playing prompt voice.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910008580.1A CN109727596B (en) | 2019-01-04 | 2019-01-04 | Method for controlling remote controller and remote controller |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910008580.1A CN109727596B (en) | 2019-01-04 | 2019-01-04 | Method for controlling remote controller and remote controller |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN109727596A CN109727596A (en) | 2019-05-07 |
| CN109727596B true CN109727596B (en) | 2020-03-17 |
Family
ID=66298824
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910008580.1A Expired - Fee Related CN109727596B (en) | 2019-01-04 | 2019-01-04 | Method for controlling remote controller and remote controller |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN109727596B (en) |
Families Citing this family (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111160318B (en) * | 2020-01-07 | 2023-10-31 | 百度在线网络技术（北京）有限公司 | Electronic equipment control method and device |
| CN112712683B (en) * | 2020-12-14 | 2022-06-14 | 珠海格力电器股份有限公司 | Control method and system of household appliance, remote controller and server |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101472066A (en) * | 2007-12-27 | 2009-07-01 | 华晶科技股份有限公司 | Near-end control method of image viewfinding device and image viewfinding device applying the method |
| CN102945672A (en) * | 2012-09-29 | 2013-02-27 | 深圳市国华识别科技开发有限公司 | Voice control system for multimedia equipment, and voice control method |
| CN103092337A (en) * | 2011-11-07 | 2013-05-08 | 三星电子株式会社 | Electronic apparatus and method for controlling thereof |
| CN105872685A (en) * | 2016-03-24 | 2016-08-17 | 深圳市国华识别科技开发有限公司 | Intelligent terminal control method and system, and intelligent terminal |
| CN106028104A (en) * | 2016-05-27 | 2016-10-12 | 王增飞 | Method and system for realizing motion sensing operation based on 2D vision |
| CN108271078A (en) * | 2018-03-07 | 2018-07-10 | 康佳集团股份有限公司 | Pass through voice awakening method, smart television and the storage medium of gesture identification |
| CN108492825A (en) * | 2018-03-12 | 2018-09-04 | 陈火 | A kind of startup method, headset equipment and the speech recognition system of speech recognition |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8745541B2 (en) * | 2003-03-25 | 2014-06-03 | Microsoft Corporation | Architecture for controlling a computer using hand gestures |
| US20120239396A1 (en) * | 2011-03-15 | 2012-09-20 | At&T Intellectual Property I, L.P. | Multimodal remote control |
-
2019
- 2019-01-04 CN CN201910008580.1A patent/CN109727596B/en not_active Expired - Fee Related
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101472066A (en) * | 2007-12-27 | 2009-07-01 | 华晶科技股份有限公司 | Near-end control method of image viewfinding device and image viewfinding device applying the method |
| CN103092337A (en) * | 2011-11-07 | 2013-05-08 | 三星电子株式会社 | Electronic apparatus and method for controlling thereof |
| CN102945672A (en) * | 2012-09-29 | 2013-02-27 | 深圳市国华识别科技开发有限公司 | Voice control system for multimedia equipment, and voice control method |
| CN105872685A (en) * | 2016-03-24 | 2016-08-17 | 深圳市国华识别科技开发有限公司 | Intelligent terminal control method and system, and intelligent terminal |
| CN106028104A (en) * | 2016-05-27 | 2016-10-12 | 王增飞 | Method and system for realizing motion sensing operation based on 2D vision |
| CN108271078A (en) * | 2018-03-07 | 2018-07-10 | 康佳集团股份有限公司 | Pass through voice awakening method, smart television and the storage medium of gesture identification |
| CN108492825A (en) * | 2018-03-12 | 2018-09-04 | 陈火 | A kind of startup method, headset equipment and the speech recognition system of speech recognition |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109727596A (en) | 2019-05-07 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3847543B1 (en) | Method for controlling plurality of voice recognizing devices and electronic device supporting the same | |
| US10796694B2 (en) | Optimum control method based on multi-mode command of operation-voice, and electronic device to which same is applied | |
| EP2696572B1 (en) | Power saving control method and electronic device supporting the same | |
| JP7193180B2 (en) | METHOD AND SYSTEM FOR PROVIDING CONTROL USER INTERFACE FOR HOME ELECTRONICS | |
| JP5998861B2 (en) | Information processing apparatus, information processing method, and program | |
| WO2014190886A1 (en) | Intelligent interaction system and software system thereof | |
| CN109727596B (en) | Method for controlling remote controller and remote controller | |
| CN105700372A (en) | Intelligent device and control method thereof | |
| CN105257140B (en) | Method and device for controlling intelligent door and window | |
| EP2237131A1 (en) | Gesture-based remote control system | |
| CN112530430A (en) | Vehicle-mounted operating system control method and device, earphone, terminal and storage medium | |
| CN108038947B (en) | Intelligent door lock system based on Bluetooth | |
| CN111768604B (en) | Remote controller control method, remote controller and electrical equipment | |
| CN112835452A (en) | Man-machine interaction method and system based on gesture and motion recognition | |
| CN110686372B (en) | Air conditioner control method and device and air conditioner | |
| CN115268293A (en) | Touch screen control panel based on whole-house intelligent household appliance control | |
| CN115718433A (en) | Control method and device of intelligent equipment, intelligent system and storage medium | |
| CN211694479U (en) | Intelligent desk lamp | |
| CN112289319A (en) | Code allocation-free voice remote control method convenient to operate | |
| CN106125911B (en) | Human-computer interaction learning method for machine and machine | |
| JP2021145198A (en) | Equipment operation system by eye contact | |
| CN111128163A (en) | Controller of voice electric appliance, control method and device thereof and storage medium | |
| KR100423495B1 (en) | Operation control system by speech recognition for portable device and a method using the same | |
| CN111781843A (en) | Apparatus and method for controlling smart home device | |
| WO2020173000A1 (en) | Interactive monitoring system and interactive monitoring method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20200317 Termination date: 20210104 |