CN113835606A - Electronic equipment, interactive control system and method thereof, and interactive controller - Google Patents

Electronic equipment, interactive control system and method thereof, and interactive controller Download PDF

Info

Publication number
CN113835606A
CN113835606A CN202110899555.4A CN202110899555A CN113835606A CN 113835606 A CN113835606 A CN 113835606A CN 202110899555 A CN202110899555 A CN 202110899555A CN 113835606 A CN113835606 A CN 113835606A
Authority
CN
China
Prior art keywords
recognition result
voice recognition
controller
value
interactive
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110899555.4A
Other languages
Chinese (zh)
Other versions
CN113835606B (en
Inventor
谢立寅
张帆
熊华
陈细武
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Xiamen Hualian Electronics Co Ltd
Original Assignee
Xiamen Hualian Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xiamen Hualian Electronics Co Ltd filed Critical Xiamen Hualian Electronics Co Ltd
Priority to CN202110899555.4A priority Critical patent/CN113835606B/en
Publication of CN113835606A publication Critical patent/CN113835606A/en
Application granted granted Critical
Publication of CN113835606B publication Critical patent/CN113835606B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/26—Speech to text systems
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command

Abstract

The invention discloses an electronic device and an interactive control system, method and interactive controller thereof, wherein the method comprises the following steps: the at least one interactive controller recognizes the touch gesture command to obtain a touch gesture recognition result, recognizes the received voice control command to obtain a voice recognition result and a voice recognition result threshold value, and obtains a distance value between the user and the interactive controller through the human body distance sensor; sending control information containing voice recognition information and/or touch gesture recognition results and an interactive controller ID to an electronic equipment controller, selecting the voice recognition results and/or touch gesture recognition results to be executed according to preset rules, determining logic control signals corresponding to the selected voice recognition results and/or touch gesture recognition results according to a preset control table, and executing control on corresponding components by using the logic control signals. By the invention, the problem of noise interference of voice control and the limitation of space control is solved by combining multiple interactive modes.

Description

Electronic equipment, interactive control system and method thereof, and interactive controller
Technical Field
The present invention relates to the field of interactive control, and in particular, to an electronic device, an interactive control system and method thereof, and an interactive controller.
Background
With the progress of science and technology and the improvement of the living standard of materials, various intelligent multifunctional electronic devices are generally configured in modern home space, such as a refrigerator, a micro-steamer, an air conditioner, an intelligent bathroom, an intelligent television, a lighting system, a sweeping robot and the like. It is expected that the interactive control technology for the electronic equipment with complex functions will be fully developed into the modern home space along with the development of artificial intelligence.
For example, patent CN201911241725.9 discloses a voice control device and an electric appliance, which discloses a split design scheme of voice recognition, short-range communication (NFC, infrared, bluetooth), voice control device and kitchen appliance. Patent CN201910234068.9 electrical appliance control device and method, electrical appliance and electrical appliance control method, medium, disclose a rotation control method independent of controlled electronic device, the rotation control command controls external electrical appliance through wireless communication.
The above prior art realizes a single separated human-computer interaction control scheme through near field short-distance communication, and has the following control limitations, for example: the voice recognition control cannot be completely effective and is easily interfered by the noise of the machine or external noise; the single separated controller cannot realize interactive control of any home position of the controlled electronic equipment.
In addition, some traditional electronic devices, such as existing micro-steaming ovens, are controlled by traditional touch, buttons, mechanical switches and other modes, and perform close-range voice prompt through buzzers and loudspeakers, and do not have remote control and reminding functions. Some electronic devices can notify and remind a user of a mobile phone APP through a wireless network, but when the user does not carry the mobile phone with the user, the user cannot timely receive the notification and reminding.
Disclosure of Invention
The invention mainly solves the technical problem of providing an electronic device, an interactive control system and method thereof and an interactive controller, which can solve the space limitation of interactive control.
In order to solve the technical problems, the invention adopts a technical scheme that: the electronic equipment interaction control method comprises the following steps: s3, when a touch gesture command is received, at least one interactive controller recognizes the touch gesture command to obtain a touch gesture recognition result, when a voice control command is received, at least one interactive controller recognizes the touch gesture command to obtain a voice recognition result and a voice recognition result threshold, and obtains a distance value between a user and the interactive controller through a human body distance sensor, wherein the voice control command or the touch gesture command is a function control command or a query command for operating the electronic equipment, and the voice recognition result, the voice recognition result threshold and the distance value form voice recognition information; s4, the at least one interaction controller sends control information containing the voice recognition information and/or the touch gesture recognition result and the ID of the interaction controller to the electronic equipment controller; and S5, after receiving the control information, the electronic device controller selects a voice recognition result and/or a touch gesture recognition result to be executed according to a preset rule, determines a logic control signal corresponding to the selected voice recognition result and/or touch gesture recognition result according to a preset control table, and controls a corresponding component by using the logic control signal, wherein the control table is used for recording the corresponding relation between the voice recognition result and/or touch gesture recognition result and the logic control signal.
Wherein, the voice control instruction or the touch gesture instruction may also be a wake-up instruction for operating the interactive controller, and before the step S3, the method further includes the following steps: s1, the electronic equipment controller controls the electronic equipment to be powered on and initialized, controls the wireless power supply communication unit to supply power for at least one interactive controller, and receives the interactive controller ID and the interactive controller communication address sent by the at least one interactive controller through the wireless power supply communication unit; s2, the electronic device controller stores the ID of the interactive controller and the communication address of the interactive controller in a correlation mode, and returns pairing confirmation information and the communication address of the electronic device controller to the interactive controller to complete pairing; when the voice recognition result or the touch gesture recognition result in the step S3 is a wake-up command, the step S3 further includes the following steps: and S8, when the at least one interaction controller confirms that the awakening instruction is received, establishing a communication channel with the paired electronic equipment controller in a wireless radio frequency communication mode.
Wherein, after the step S5, the method further comprises the following steps: s6, the electronic device controller sends a feedback signal corresponding to the logic control signal to an interaction controller communication address corresponding to the interaction controller ID; and S7, after the interactive controller corresponding to the interactive controller ID receives the feedback signal, analyzing the feedback signal to obtain feedback information, driving a loudspeaker to play voice corresponding to the feedback information, and driving a light control unit to light the light corresponding to the feedback information.
When the electronic device controller receives at least two sets of control information including speech recognition information, the step S5 of "selecting a speech recognition result to be executed according to a preset rule" specifically includes the following steps: s501, the electronic equipment controller receives the voice recognition information and the M distance values sent by the M interactive controllers; each voice recognition information comprises N corresponding voice recognition results, wherein M is more than or equal to 2, and M is more than or equal to N is more than or equal to 1; the M distance values are obtained by respectively carrying out distance detection on one operation user by the M interactive controllers; s502, when N is larger than or equal to 1, determining a corresponding voice recognition result according to the relation between the difference value of the maximum value and the second maximum value in all voice recognition result threshold values and a preset threshold value difference value so as to select an interactive controller; s503, when the difference value between the maximum value and the second maximum value in all the speech recognition result threshold values is larger than the preset threshold value difference value, selecting the speech recognition result corresponding to the maximum value of the speech recognition result threshold value to select the corresponding interactive controller; s504, when the difference value between the maximum value and the second maximum value in all the voice recognition result threshold values is not larger than the preset threshold value difference value, judging whether all the voice recognition result threshold values are the same; s505, when all the speech recognition result thresholds are different, judging whether the distance value corresponding to the maximum value of the speech recognition result threshold and the distance value corresponding to the second largest value of the speech recognition result threshold have a smaller value: if the distance value is smaller, selecting a voice recognition result corresponding to the smaller distance value to select a corresponding interactive controller; if the distance value is smaller, selecting a voice recognition result corresponding to the maximum value of the voice recognition result threshold value to select a corresponding interaction controller; s506, when all the voice recognition result threshold values are the same and the distance values corresponding to all the voice recognition result threshold values are also the same, any interactive controller is selected.
When the electronic device controller receives at least two sets of control information including speech recognition information, the step S5 of "selecting a speech recognition result to be executed according to a preset rule" specifically includes the following steps: s511, the electronic equipment controller receives the voice recognition information and the X distance values sent by the M interactive controllers; each voice recognition information comprises corresponding N voice recognition results, wherein M is more than or equal to 2, M is more than or equal to N is more than or equal to 1, and X is more than or equal to 3; the X distance values are obtained by respectively carrying out distance detection on at least one operating user and at least one non-operating user by the M interactive controllers; s512, when N is larger than or equal to 1, judging whether the difference value between the maximum value and the second maximum value in all the voice recognition result threshold values is larger than a preset threshold value difference value or not; if so, selecting a voice recognition result corresponding to the maximum value of the voice recognition result threshold value to select a corresponding interactive controller; if not, any interactive controller is selected.
The invention adopts another technical scheme that an electronic equipment interaction control system is provided, which comprises electronic equipment with an electronic equipment controller and a functional component control unit, and at least one interaction controller in communication connection with the electronic equipment; the electronic equipment controller comprises a radio frequency transceiving unit, an electronic equipment processing unit and an electronic equipment storage unit, wherein the electronic equipment processing unit comprises a control information processing module; the interactive controller comprises an interactive controller processing unit, the interactive controller processing unit comprises a functional logic processing unit, and a digital signal interface unit and a voice recognition processing unit which are respectively connected with the functional logic processing unit, and the voice recognition processing unit is connected with the digital signal interface unit; the interactive controller also comprises a storage unit, a radio frequency wireless control unit, a human body distance sensor, a touch gesture control unit connected with a touch electrode, a wireless power supply and receiving communication unit and a microphone input unit connected with a microphone, wherein the storage unit, the radio frequency wireless control unit, the human body distance sensor, the touch gesture control unit connected with the touch electrode, the wireless power supply and receiving communication unit and the microphone input unit are respectively connected with the digital interface unit; the functional logic processing unit comprises a touch gesture recognition module and a control information generation module; the touch gesture recognition module is used for recognizing a touch gesture command to obtain a touch gesture recognition result when receiving the touch gesture command sent by the touch electrode; the voice recognition processing unit is used for recognizing when receiving a voice control instruction input by the microphone input unit to obtain a voice recognition result and a voice recognition result threshold value, the human body distance sensor is used for obtaining a distance value between a user and the interactive controller when the voice recognition processing unit receives the voice control instruction, wherein the voice recognition result, the voice recognition result threshold value and the distance value form voice recognition information, and the voice control instruction or the touch gesture instruction is a function control instruction or a query instruction for operating the electronic equipment; the control information generation module is used for sending control information containing the voice recognition information and/or the touch gesture recognition result and the interactive controller ID to the electronic equipment controller; the control information processing module is used for selecting a voice recognition result and/or a touch gesture recognition result to be executed according to a preset rule after receiving control information, and determining a logic control signal corresponding to the selected voice recognition result and/or touch gesture recognition result according to a preset control table, the functional component control unit is used for controlling a corresponding component by using the logic control signal, and the control table is used for recording the corresponding relation between the voice recognition result and/or the touch gesture recognition result and the logic control signal.
Wherein, the voice control instruction or the touch gesture instruction can also be a wake-up instruction for operating the interactive controller, the electronic device further includes a wireless power supply communication unit, and the electronic device controller further includes: the initialization module is used for controlling the initialization of power-on parameters of the electronic equipment and controlling the wireless power supply communication unit to supply power to at least one interactive controller; the pairing module is used for receiving the interactive controller ID and the interactive controller communication address which are sent by the at least one interactive controller through the wireless power supply communication unit, storing the interactive controller ID and the interactive controller communication address to the electronic equipment storage unit in a correlation mode, and returning pairing confirmation information and the electronic equipment controller communication address to the interactive controller to complete pairing; the functional logic processing unit of the interaction controller further comprises: and the awakening module is used for informing the radio frequency wireless control unit to establish a communication channel with the paired electronic equipment controller in a radio frequency communication mode when the voice recognition result or the touch gesture recognition result is an awakening instruction.
The electronic equipment controller also comprises an execution feedback module, and the interactive controller also comprises a feedback analysis module, a power amplification unit connected with a loudspeaker and a light control unit; the execution feedback module is used for sending a feedback signal corresponding to the logic control signal to an interaction controller communication address corresponding to the interaction controller ID through a radio frequency transceiving unit; and the feedback analysis module of the interactive controller corresponding to the interactive controller ID is used for analyzing the feedback signal to obtain feedback information and driving the loudspeaker to play voice corresponding to the feedback information and driving the light control unit to lighten light corresponding to the feedback information after receiving the feedback signal.
The control information processing module of the electronic equipment controller comprises a first submodule and a second submodule; the first submodule is used for judging whether N is equal to 1 or not when the electronic equipment controller receives voice recognition information containing N voice recognition results and M distance values sent by M interactive controllers, wherein M is more than or equal to 2, and M is more than or equal to N is more than or equal to 1; the M distance values are obtained by respectively carrying out distance detection on one operation user by the M interactive controllers; the second submodule is used for determining a corresponding voice recognition result according to the relation between the difference value of the maximum value and the second maximum value in all the voice recognition result threshold values and the difference value of the preset threshold value when the first submodule judges that N is larger than or equal to 1 so as to select the interactive controller; when the difference value between the maximum value and the second maximum value in all the speech recognition result threshold values is larger than the preset threshold value difference value, the second sub-module is used for selecting the speech recognition result corresponding to the maximum value of the speech recognition result threshold value so as to select the corresponding interactive controller; when the difference value between the maximum value and the second maximum value in all the speech recognition result threshold values is not larger than the preset threshold value difference value, the second sub-module is further used for judging whether all the speech recognition result threshold values are the same; when all the speech recognition result thresholds are different, the second sub-module is further configured to determine whether a smaller value exists between a distance value corresponding to the maximum speech recognition result threshold and a distance value corresponding to the second largest speech recognition result threshold: if the distance value is smaller, selecting a voice recognition result corresponding to the smaller distance value to select a corresponding interactive controller; if the distance value is smaller, selecting the voice recognition result corresponding to the maximum value of the voice recognition result threshold value to select a corresponding interactive controller; and when all the voice recognition result threshold values are the same, the second sub-module is also used for judging that the distance values corresponding to all the voice recognition result threshold values are also the same, and then any interactive controller is selected.
The control information processing module of the electronic equipment controller comprises a first submodule and a second submodule; the first submodule is used for judging whether N is equal to 1 or not when the electronic equipment controller receives voice recognition information containing N voice recognition results and X distance values sent by M interactive controllers, wherein M is more than or equal to 2, M is more than or equal to N and more than or equal to 1, and X is more than or equal to 3; the X distance values are obtained by respectively carrying out distance detection on at least one operation user and at least one non-operation user by the M interactive controllers; the second submodule is used for judging whether the difference value between the maximum value and the second maximum value in all the voice recognition result threshold values is larger than the preset threshold value difference value or not when the first submodule judges that N is larger than or equal to 1; if so, selecting a voice recognition result corresponding to the maximum value of the voice recognition result threshold value to select a corresponding interactive controller; if not, any interactive controller is selected.
Another technical solution adopted by the present invention is to provide an electronic device interaction controller, which includes an interaction controller processing unit, the interaction controller processing unit includes a functional logic processing unit, and a digital signal interface unit and a voice recognition processing unit connected thereto, respectively, and the voice recognition processing unit is connected to the digital signal interface unit; the interactive controller also comprises a storage unit, a radio frequency wireless control unit, a human body distance sensor, a touch gesture control unit connected with a touch electrode, a wireless power supply and receiving communication unit and a microphone input unit connected with a microphone, wherein the storage unit, the radio frequency wireless control unit, the human body distance sensor, the touch gesture control unit connected with the touch electrode, the wireless power supply and receiving communication unit and the microphone input unit are respectively connected with the digital interface unit; the functional logic processing unit comprises a touch gesture recognition module and a control information generation module; the voice recognition processing unit is used for recognizing to obtain a voice recognition result and a voice recognition result threshold when receiving a voice control instruction input by the microphone input unit, the human body distance sensor is used for acquiring a distance value between a user and the interactive controller when the voice recognition processing unit receives a voice control instruction, the touch gesture recognition module is used for recognizing when receiving a touch gesture instruction to obtain a gesture recognition result, the control information generation module is used for sending control information containing the voice recognition information and/or the touch gesture recognition result and the interactive controller ID to the electronic equipment controller, wherein the voice recognition result, the voice recognition result threshold value and the distance value form voice recognition information, the voice control instruction or the touch gesture instruction is a function control instruction or a query instruction for operating the electronic equipment.
Another technical solution adopted by the present invention is to provide an electronic device, including an electronic device controller and a functional component control unit, where the electronic device controller includes a radio frequency transceiver unit, an electronic device processing unit, and an electronic device storage unit, and the electronic device processing unit includes a control information processing module; the control information processing module is used for selecting a voice recognition result and/or a touch gesture recognition result to be executed according to a preset rule after receiving control information, and determining a logic control signal corresponding to the selected voice recognition result and/or touch gesture recognition result according to a preset control table, wherein the control information comprises voice recognition information and/or touch gesture recognition result, an interactive controller ID, and the voice recognition result, a voice recognition result threshold value and a distance value form the voice recognition information; the functional component control unit is used for controlling the corresponding component by using the logic control signal, wherein the control table is used for recording the corresponding relation between the voice recognition result and/or the touch gesture recognition result and the logic control signal; the control information processing module of the electronic equipment controller comprises a first sub-module and a second sub-module; the first submodule is used for judging whether N is equal to 1 or not when the electronic equipment controller receives voice recognition information containing N voice recognition results and M distance values sent by M interactive controllers, wherein M is more than or equal to 2, and M is more than or equal to N is more than or equal to 1; the M distance values are obtained by respectively carrying out distance detection on one operation user by the M interactive controllers; the second submodule is used for determining a corresponding voice recognition result according to the relation between the difference value of the maximum value and the second maximum value in all the voice recognition result threshold values and the difference value of the preset threshold value when the first submodule judges that N is larger than or equal to 1 so as to select the interactive controller; when the difference value between the maximum value and the second maximum value in all the speech recognition result threshold values is larger than the preset threshold value difference value, the second sub-module is used for selecting the speech recognition result corresponding to the maximum value of the speech recognition result threshold value so as to select the corresponding interactive controller; when the difference value between the maximum value and the second maximum value in all the speech recognition result threshold values is not larger than the preset threshold value difference value, the second sub-module is further used for judging whether all the speech recognition result threshold values are the same; when all the speech recognition result thresholds are different, the second sub-module is further configured to determine whether a smaller value exists between a distance value corresponding to the maximum speech recognition result threshold and a distance value corresponding to the second largest speech recognition result threshold: if the distance value is smaller, selecting a voice recognition result corresponding to the smaller distance value to select a corresponding interactive controller; if the distance value is smaller, selecting the voice recognition result corresponding to the maximum value of the voice recognition result threshold value to select a corresponding interactive controller; and when all the voice recognition result threshold values are the same, the second sub-module is also used for judging that the distance values corresponding to all the voice recognition result threshold values are also the same, and then any interactive controller is selected.
Another technical solution adopted by the present invention is to provide an electronic device, including an electronic device controller and a functional component control unit, where the electronic device controller includes a radio frequency transceiver unit, an electronic device processing unit, and an electronic device storage unit, and the electronic device processing unit includes a control information processing module; the control information processing module is used for selecting a voice recognition result and/or a touch gesture recognition result to be executed according to a preset rule after receiving control information, and determining a logic control signal corresponding to the selected voice recognition result and/or touch gesture recognition result according to a preset control table, wherein the control information comprises voice recognition information and/or touch gesture recognition result, an interactive controller ID, and the voice recognition result, a voice recognition result threshold value and a distance value form the voice recognition information; the functional component control unit is used for controlling the corresponding component by using the logic control signal, wherein the control table is used for recording the corresponding relation between the voice recognition result and/or the touch gesture recognition result and the logic control signal; the control information processing module of the electronic equipment controller comprises a first sub-module and a second sub-module; the first submodule is used for judging whether N is equal to 1 or not when the electronic equipment controller receives X distance values of voice recognition information containing N voice recognition results sent by M interactive controllers, wherein M is more than or equal to 2, M is more than or equal to N and more than or equal to 1, and X is more than or equal to 3; the X distance values are obtained by respectively carrying out distance detection on at least one operation user and at least one non-operation user by the M interactive controllers; the second submodule is used for judging whether the difference value between the maximum value and the second maximum value in all the voice recognition result threshold values is larger than the preset threshold value difference value or not when the first submodule judges that N is larger than or equal to 1; if so, selecting a voice recognition result corresponding to the maximum value of the voice recognition result threshold value to select a corresponding interactive controller; if not, any interactive controller is selected.
According to the electronic equipment and the interaction control system, method and interaction controller thereof provided by the embodiment of the invention, the interaction control of the electronic equipment is carried out by using the combination of the voice recognition control mode and the touch gesture recognition control mode, the control can be realized by the touch gesture control under a strong noise environment, and the problem of control limitation of the electronic equipment is solved by combining multiple interaction modes. Furthermore, when the electronic device controller receives control information containing voice recognition information sent by at least two interactive controllers simultaneously, the interactive controller closest to the user is selected to send the control information by recognizing a voice recognition result threshold value and a distance value, and the electronic device controller generates a corresponding logic control signal to control the corresponding load of the device after selecting the recognition result, because the interactive controller closest to the user has the optimal recognition result and the optimal interactive experience, the accuracy of voice recognition control and the user experience are improved.
Drawings
Fig. 1 is an execution flowchart of an electronic device interaction control method according to an embodiment of the present invention;
FIG. 2 is an initial pairing execution flow diagram of an interaction controller and an electronic device controller;
fig. 3 is a flowchart illustrating an implementation of "the control module of the electronic device controller selects a result of performing speech recognition according to a preset rule after receiving control information" in step S5 in fig. 1 when the electronic device controller receives at least two sets of control information;
fig. 4 is an execution flowchart of "the control module of the electronic device controller selects a result of speech recognition to be executed according to a preset rule after receiving control information" in another embodiment in step S5 in fig. 1 when the electronic device controller receives at least two sets of control information;
FIG. 5 is a block diagram of an electronic device interaction control system according to an embodiment of the present invention;
FIG. 6 is a block diagram of an interactive controller according to an embodiment of the present invention;
FIG. 7 is a schematic diagram of an example of full scene interactive control operation of example five;
FIG. 8 is a schematic diagram of an example of interaction control in which the micro-steaming oven of operation example six receives a voice control command;
FIG. 9 is a schematic diagram of an example of interaction control of the micro-steaming oven receiving a voice control command according to the seventh embodiment.
Detailed Description
In order to explain technical contents, structural features, and objects and effects of the present invention in detail, the present invention will be explained in detail with reference to the accompanying drawings and examples.
Referring to fig. 1, an execution flowchart of an electronic device interaction control method according to an embodiment of the present invention is shown, where the method includes the following steps:
s3, when a touch gesture command is received, at least one interactive controller recognizes the touch gesture command to obtain a touch gesture recognition result, when a voice control command is received, at least one interactive controller recognizes the touch gesture command to obtain a voice recognition result and a voice recognition result threshold, and obtains a distance value between a user and the interactive controller through a human body distance sensor, wherein the voice control command or the touch gesture command is a function control command or a query command for operating the electronic equipment, and the voice recognition result, the voice recognition result threshold and the distance value form voice recognition information;
the voice recognition method comprises the steps that after a command word of a voice control instruction is recognized, each command word in a built-in word bank of the voice recognition is recognized through an acoustic model and a language model, a probability value is obtained, the larger the probability value is, the closer the voice recognition result of the current voice control instruction is to the voice control instruction, and the voice recognition result threshold value is equivalent to the highest probability value.
For example, one says that: the fish steaming is started, and the built-in word stock of the beginning of the language model comprises: starting to steam fish, starting to steam shrimp, starting to microwave and stopping cooking. Through recognition model calculation, each word can output a probability value, namely:
starting to steam the fish by 0.95; starting to steam the shrimps by 0.5; starting microwave 0.3; stopping cooking for 0.1; then the command word with the highest probability value is selected as the voice recognition result of this time. The specific reference data of the prior art are as follows: https:// www.zhihu.com/query/20398418/answer/18080841.
The human body distance sensor is an infrared sensor, a microwave sensor, a pyroelectric sensor, an ultrasonic sensor, a UWB sensor or a thermopile sensor.
The capacitive touch electrode array method is adopted for touch gesture recognition, when a touch electrode array receives a certain touch gesture, capacitance values of a plurality of touched electrodes on the array change according to touch sequence, and the touch gesture recognition module is used for recognizing according to the capacitance value changes of the electrodes and time of the change and obtaining a touch gesture recognition result in a certain time period.
S4, the at least one interaction controller sends control information containing the voice recognition information and/or the touch gesture recognition result and the ID of the interaction controller to the electronic equipment controller;
and S5, after receiving the control information, the electronic device controller selects a voice recognition result and/or a touch gesture recognition result to be executed according to a preset rule, determines a logic control signal corresponding to the selected voice recognition result and/or touch gesture recognition result according to a preset control table, and controls a corresponding component by using the logic control signal, wherein the control table is used for recording the corresponding relation between the voice recognition result and/or touch gesture recognition result and the logic control signal.
S6, the electronic device controller sends a feedback signal corresponding to the logic control signal to an interaction controller communication address corresponding to the interaction controller ID;
and S7, after the interactive controller corresponding to the interactive controller ID receives the feedback signal, analyzing the feedback signal to obtain feedback information, driving a loudspeaker to play voice corresponding to the feedback information, and driving a light control unit to light the light corresponding to the feedback information.
The voice control instruction or the touch gesture instruction may also be a wake-up instruction for operating the interactive controller, please refer to fig. 2, which is a flowchart for performing initial pairing between the interactive controller and the electronic device controller. Before the step S3, the method further includes the following steps:
s1, the electronic equipment controller controls the electronic equipment to be powered on and initialized, controls the wireless power supply communication unit to supply power for at least one interactive controller, and receives the interactive controller ID and the interactive controller communication address sent by the at least one interactive controller through the wireless power supply communication unit;
s2, the electronic device controller stores the ID of the interactive controller and the communication address of the interactive controller in a correlation mode, and returns pairing confirmation information and the communication address of the electronic device controller to the interactive controller to complete pairing;
when the voice recognition result or the touch gesture recognition result in the step S3 is a wake-up command, the step S3 further includes the following steps:
and S8, when the at least one interaction controller confirms that the awakening instruction is received, establishing a communication channel with the paired electronic equipment controller in a wireless radio frequency communication mode.
The specific implementation steps of "the interactive controller confirms that the wake-up command is received" in step S8 may be:
s811, after receiving the awakening word voice (such as intelligent cooking), the interactive controller performs front-end noise reduction processing and voice recognition processing on the received awakening word voice to confirm whether the awakening word voice is an awakening instruction;
s222, when the command is confirmed to be a wake-up command, and the interactive controller receives a signal sent by the human body distance sensor, the wake-up command is confirmed to be received. Therefore, the interaction controller can be ensured that the human body distance sensor on the interaction controller senses that the user is currently in the sensing range of the interaction controller under the condition that the control is confirmed without touch, so that the user can be ensured to use the awakening instruction to perform voice awakening currently, and the phenomenon that the external environment noise such as a television and the sound of a sound box possibly cause mistaken awakening of the interaction controller is avoided.
The specific implementation steps of "the interactive controller confirms that the wake-up command is received" in step S8 may be:
and S82, confirming that the wake-up command is received when the interactive controller receives the touch gesture command for wake-up. This ensures that the interactive controller quickly enters the voice wake-up state.
The interaction controller and the electronic equipment controller are in data communication (including but not limited to WiFi, Bluetooth, ZigBee, Sub-1G, 2.4G and the like) in a radio frequency wireless communication mode. Through the initialization process, all the interactive controllers can control the electronic equipment, and the interactive controllers can be taken down from the electronic equipment and placed in other positions with standard wireless power supply to interactively control the electronic equipment. Meanwhile, one electronic device can be controlled by a plurality of interactive controllers placed at different positions, so that many-to-one communication interaction between the interactive controllers and the micro-steaming oven is realized.
Please refer to fig. 3, which is an execution flowchart of "the control module of the electronic device controller selects a result of performing speech recognition according to a preset rule after receiving the control information" in step S5 of fig. 1 when the electronic device controller receives at least two sets of control information (one-man multi-interaction controller application scenario).
When the electronic device controller receives at least two sets of control information including speech recognition information, the step S5 of "selecting a speech recognition result to be executed according to a preset rule" specifically includes the following steps:
s501, the electronic equipment controller receives the voice recognition information and the M distance values sent by the M interactive controllers; each voice recognition information comprises N corresponding voice recognition results, wherein M is more than or equal to 2, and M is more than or equal to N is more than or equal to 1; the M distance values are obtained by respectively carrying out distance detection on one operation user by the M interactive controllers;
s502, when N is larger than or equal to 1, determining a corresponding voice recognition result according to the relation between the difference value of the maximum value and the second maximum value in all voice recognition result threshold values and a preset threshold value difference value so as to select an interactive controller;
s503, when the difference value between the maximum value and the second maximum value in all the speech recognition result threshold values is larger than the preset threshold value difference value, selecting the speech recognition result corresponding to the maximum value of the speech recognition result threshold value to select the corresponding interactive controller;
s504, when the difference value between the maximum value and the second maximum value in all the voice recognition result threshold values is not larger than the preset threshold value difference value, judging whether all the voice recognition result threshold values are the same;
s505, when all the speech recognition result thresholds are different, judging whether the distance value corresponding to the maximum value of the speech recognition result threshold and the distance value corresponding to the second largest value of the speech recognition result threshold have a smaller value: if the distance value is smaller, selecting a voice recognition result corresponding to the smaller distance value to select a corresponding interactive controller; if the distance value is smaller, selecting a voice recognition result corresponding to the maximum value of the voice recognition result threshold value to select a corresponding interaction controller;
s506, when all the voice recognition result threshold values are the same and the distance values corresponding to all the voice recognition result threshold values are also the same, any interactive controller is selected.
By the method, the electronic equipment selects the logic control signal sent by the interactive controller closest to the user, and the interactive controller closest to the user has the optimal recognition result and the optimal interactive experience, so that the accuracy rate of voice recognition control and the user experience are improved.
Please refer to fig. 4, which is an execution flowchart of "the control module of the electronic device controller selects a result of performing speech recognition according to a preset rule after receiving the control information" in step S5 of fig. 1 when the electronic device controller receives at least two sets of control information (multi-user multi-interaction controller application scenario).
When the electronic device controller receives at least two sets of control information including speech recognition information, the step S5 of "selecting a speech recognition result to be executed according to a preset rule" specifically includes the following steps:
s511, the electronic equipment controller receives the voice recognition information and the X distance values sent by the M interactive controllers; each voice recognition information comprises corresponding N voice recognition results, wherein M is more than or equal to 2, M is more than or equal to N is more than or equal to 1, and X is more than or equal to 3; the X distance values are obtained by respectively carrying out distance detection on at least one operation user and at least one non-operation user by the M interactive controllers;
s512, when N is larger than or equal to 1, judging whether the difference value between the maximum value and the second maximum value in all the voice recognition result threshold values is larger than a preset threshold value difference value or not; if so, selecting a voice recognition result corresponding to the maximum value of the voice recognition result threshold value to select a corresponding interactive controller; if not, any interactive controller is selected.
The specific implementation steps of "the voice control instruction of the interactive controller and the touch gesture instruction recognition module confirm that the wake-up instruction is received" in step S2 are as follows:
s21, after the interactive controller receives the awakening word voice (such as intelligent cooking), the received awakening word voice is subjected to front-end noise reduction processing and voice recognition processing to confirm whether the awakening word voice is the awakening voice, and when the awakening word voice is confirmed, the interactive controller confirms that the awakening command is received;
fig. 5 is a block diagram of an interactive control system of an electronic device according to an embodiment of the present invention.
An electronic device interaction control system 200 includes an electronic device 100 with an electronic device controller 10 and a functional component control unit 110, and at least one interaction controller 20 communicatively coupled to the electronic device 100. The electronic device controller 10 includes a radio frequency transceiver unit 11, an electronic device processing unit 12, and an electronic device storage unit 13. The electronic device processing unit 12 includes a control information processing module 121, an initialization module 122, and a pairing module 123.
Fig. 6 is a block diagram of an interactive controller according to an embodiment of the present invention.
The interactive controller 20 comprises an interactive controller processing unit 21, the interactive controller processing unit 21 comprises a functional logic processing unit 213, and a digital signal interface unit 211 and a voice recognition processing unit 212 respectively connected with the functional logic processing unit 213, and the voice recognition processing unit 212 is connected with the digital signal interface unit 211. The interactive controller 10 further includes a storage unit 23, a radio frequency wireless control unit 24, a human body distance sensor 26, a touch gesture control unit 25 connected with a touch electrode 251, a wireless power supply and power receiving communication unit 27 and a microphone input unit 28 connected with a microphone 281, which are respectively connected with the functional logic processing unit 213; the functional logic processing unit 213 includes a touch gesture recognition module 2131 and a control information generation module 2132.
The touch gesture recognition module 2131 is configured to, when receiving a touch gesture instruction sent by the touch electrode 251, recognize the touch gesture instruction to obtain a touch gesture recognition result, where the touch gesture instruction is a touch gesture operation received by a capacitive touch electrode on the interactive controller, and the touch gesture operation includes a single-click touch operation, a double-click touch operation, a long-press touch operation, a sliding gesture operation, or a combined touch operation of the above gesture operations.
The voice recognition processing unit 212 is configured to recognize the voice recognition result and the voice recognition result threshold when receiving the voice control instruction input by the microphone input unit 28. The human body distance sensor 26 is configured to obtain a distance value between the user and the interaction controller 20 when the voice recognition processing unit 212 receives a voice control instruction, where the voice recognition result, the voice recognition result threshold, and the distance value form voice recognition information, and the voice control instruction or the touch gesture instruction is a function control instruction or a query instruction for operating the electronic device; the control information generating module 2132 is configured to send control information including the speech recognition information and/or the touch gesture recognition result and the interaction controller ID to the electronic device controller 10; the human body distance sensor is an infrared sensor, a microwave sensor, a pyroelectric sensor, an ultrasonic sensor, a UWB sensor or a thermopile sensor.
The control information processing module 121 is configured to select a voice recognition result and/or a touch gesture recognition result to be executed according to a preset rule after receiving the control information, and determine a logic control signal corresponding to the selected voice recognition result and/or touch gesture recognition result according to a preset control table, where the functional component control unit 110 is configured to execute control on a corresponding component by using the logic control signal, and the control table is configured to record a correspondence between the voice recognition result and/or the touch gesture recognition result and the logic control signal.
The voice control instruction or the touch gesture instruction may also be a wake-up instruction for operating the interactive controller 20, the electronic device 100 further includes a wireless power supply communication unit 30, and the electronic device controller 10 further includes:
an initialization module 122, configured to control the electronic device 100 to initialize power-on parameters and control the wireless power supply communication unit 30 to supply power to the at least one interactive controller 20; and
the pairing module 123 is configured to receive the interaction controller ID and the interaction controller communication address sent by the at least one interaction controller 20 through the wireless power supply communication unit 27, store the interaction controller ID and the interaction controller communication address in the electronic device storage unit 13 in an associated manner, and send back pairing confirmation information and the electronic device controller communication address to the interaction controller to complete pairing.
The functional logic processing unit 213 of the interactive controller further includes:
and the waking module 2133 is configured to, when the voice recognition result or the touch gesture recognition result is a waking instruction, notify the radio frequency wireless control unit 24 to establish a communication channel with the paired electronic device controller 10 in a wireless radio frequency communication manner.
The electronic device controller further comprises an execution feedback module 124, and the interactive controller further comprises a feedback analysis module 2134, a power amplification unit 29 connected with a loudspeaker 291, and a light control unit 22; the execution feedback module 124 is configured to send a feedback signal corresponding to the logic control signal to an interaction controller communication address corresponding to the interaction controller ID; the feedback analysis module 2134 of the interactive controller corresponding to the interactive controller ID is configured to, after receiving the feedback signal, analyze the feedback signal to obtain feedback information, drive the speaker to play a voice corresponding to the feedback information, and drive the light control unit 22 to light the light corresponding to the feedback information.
The control information processing module of the electronic equipment controller comprises a first submodule, a second submodule and a third submodule;
in an embodiment, the first sub-module is configured to, when the electronic device controller receives voice recognition information including N types of voice recognition results and M distance values sent by M interactive controllers, determine whether N is equal to 1, where M is greater than or equal to 2, and M is greater than or equal to N is greater than or equal to 1; the M distance values are obtained by the M interactive controllers respectively performing distance detection on an operation user (i.e., a single-person multi-interactive controller application scenario).
The second submodule is used for determining a corresponding voice recognition result according to the relation between the difference value of the maximum value and the second maximum value in all the voice recognition result threshold values and the difference value of the preset threshold value when the first submodule judges that N is larger than or equal to 1 so as to select the interactive controller;
when the difference value between the maximum value and the second maximum value in all the speech recognition result threshold values is larger than the preset threshold value difference value, the second sub-module is used for selecting the speech recognition result corresponding to the maximum value of the speech recognition result threshold value so as to select the corresponding interactive controller;
when the difference value between the maximum value and the second maximum value in all the speech recognition result threshold values is not larger than the preset threshold value difference value, the second sub-module is further used for judging whether all the speech recognition result threshold values are the same;
when all the speech recognition result thresholds are different, the second sub-module is further configured to determine whether a smaller value exists between a distance value corresponding to the maximum speech recognition result threshold and a distance value corresponding to the second largest speech recognition result threshold: if the distance value is smaller, selecting a voice recognition result corresponding to the smaller distance value to select a corresponding interactive controller; if the distance value is smaller, selecting the voice recognition result corresponding to the maximum value of the voice recognition result threshold value to select a corresponding interactive controller;
and when all the voice recognition result threshold values are the same, the second sub-module is also used for judging that the distance values corresponding to all the voice recognition result threshold values are also the same, and then any interactive controller is selected.
In another embodiment, the first sub-module is configured to, when the electronic device controller receives X distance values of voice recognition information including N types of voice recognition results sent by M interactive controllers, determine whether N is equal to 1, where M is greater than or equal to 2, M is greater than or equal to N is greater than or equal to 1, and X is greater than or equal to 3; the X distance values are obtained by the M interactive controllers respectively performing distance detection on at least one operating user and at least one non-operating user (i.e., a multi-user multi-interactive controller application scenario).
The second submodule is used for judging whether the difference value between the maximum value and the second maximum value in all the voice recognition result threshold values is larger than the preset threshold value difference value or not when the first submodule judges that N is larger than or equal to 1; if so, selecting a voice recognition result corresponding to the maximum value of the voice recognition result threshold value to select a corresponding interactive controller; if not, any interactive controller is selected.
Interactive control operation example (for electronic equipment as micro-steaming oven)
Operation example one, when receiving voice control instruction
When a user speaks voice, the interactive controller carries out recognition to obtain voice recognition information consisting of a voice recognition result, a voice recognition result threshold value and a distance value, control information containing the voice recognition information and an interactive controller ID is sent to the electronic equipment controller through the radio frequency wireless control circuit, after the electronic equipment controller receives the control information, the electronic equipment controller selects the voice recognition result to be executed according to a preset rule, determines a logic control signal corresponding to the selected voice recognition result according to a preset control table, and uses the logic control signal to execute control on the corresponding component.
(1) When the instruction is a function control instruction of the micro-steaming oven, if the voice is 'begin to steam fish', the power assembly required by 'begin to steam fish' is started, if the execution is correct, the electronic device controller also sends a feedback signal to the interactive controller through the radio frequency wireless control unit, and after the interactive controller receives the feedback signal, the power amplification unit is driven to play a corresponding voice prompt through a loudspeaker, for example, 'begin to steam fish'.
(2) When the command is an inquiry command of the micro-steaming oven, if the voice is ' remaining time of steaming fish ', the electronic device controller executes inquiry processing and sends an inquiry result to the interactive controller through the radio frequency transceiver unit, and after the interactive controller receives a feedback signal, the power amplification unit is driven to play a corresponding voice prompt, so that a user can acquire the inquired information, and if ' remaining 5 minutes of cooking time ' is played through a loudspeaker '.
Operation example two, when receiving the touch gesture instruction
The interaction controller recognizes to obtain a gesture recognition result, and sends a logic control signal corresponding to control information containing the gesture recognition result and the interaction controller ID to the electronic equipment controller through the radio frequency wireless control circuit, after receiving the control information, the electronic equipment controller selects a gesture recognition result to be executed according to a preset rule, determines a logic control signal corresponding to the selected gesture recognition result according to a preset control table, and executes control on a corresponding component by using the logic control signal. If, control function operations such as little steaming oven switching on and shutting down, temperature regulation, culinary art time control, culinary art mode selection, equipment start, the electronic equipment controller also can feed back the operation result to interactive controller simultaneously, and interactive controller can carry out voice broadcast or light suggestion according to actual need.
Operation example three, when receiving the combined control of the voice control instruction and the touch gesture instruction
(1) The touch gesture instruction is a voice recognition awakening instruction, namely the awakening touch gesture and the voice control instruction can be used for quickly carrying out equipment voice operation without awakening words;
(2) the touch gesture instruction is used for controlling a voice interaction control process, namely, the voice control instruction and the touch gesture instruction can be used for selecting and confirming a feedback result executed by the voice control instruction, and a voice interaction mode is optimized, so that a user can utilize the interaction controller to realize more convenient operation on the micro-steaming oven. For example, a meat menu of the micro-steaming oven is obtained through a voice control instruction such as 'pork', different menus are selected through touch gesture sliding, the interactive controller can broadcast the name of the menu selected through the touch gesture sliding through the loudspeaker, and when a user hears a desired menu, the user can control the electronic device controller to cook according to the selected menu through the voice control instruction 'starting' or touch operation of the starting gesture.
Operation example four, full scene interaction control
Please refer to fig. 7, which is a schematic diagram of an exemplary operation of full scene interactive control.
When the number of the interactive controllers is multiple, the interactive controllers are placed on a wireless power supply board with a standard wireless power supply protocol, which is placed in the controlled electronic equipment or other household spaces.
In this way, the user can perform operations on the controlled electronic device and can also perform control through a plurality of interaction controllers placed in different spaces, such as a living room, a restaurant, a bedroom and the like, so that many-to-one communication interaction between the interaction controllers and the controlled electronic device is realized.
After the controlled electronic equipment executes the operation instruction, the controlled electronic equipment sends feedback information to all interactive controllers through the radio frequency wireless communication circuit or sends the feedback information to the interactive controllers where the user is currently performing voice or touch gesture operation, and the interactive controllers receiving the feedback information can inform the user of completing the operation in a voice broadcasting or light reminding mode, so that full-scene intelligent operation experience is realized.
Operation example six, interactive control example (single-person multi-interactive controller application scene) of the micro-steaming oven receiving the voice control instruction:
please refer to fig. 8, which is a schematic diagram illustrating an example of interaction control when the micro-steaming oven of the sixth operation example receives a voice control command. For example, two interactive controllers which are already paired with the kitchen micro-steaming oven are respectively placed at two ends of a living room by a user, and when the user operates the interactive controllers, the interactive controllers are sent out at a certain position of the living room: when a voice control instruction of 'barbecue preheating' is received, the interactive controller 1 and the interactive controller 2 simultaneously receive the voice control instruction and recognize the voice control instruction to obtain a recognition result and a result threshold value, and obtain a distance value between an operating user and the interactive controller through a distance sensor, after the two interactive controllers obtain the recognition result, the result threshold value and the distance value, the data are sent to the micro-steaming and baking controller through a radio frequency wireless control circuit to be distinguished, the voice control instruction required to be executed is selected according to the distinguishing result, and the specific distinguishing method comprises the following steps:
firstly, defining a recognition result threshold as a recognition confidence coefficient, wherein the higher the confidence coefficient is, the more credible the recognition result is, the interactive controller is represented by A1 and A2, the recognition result thresholds corresponding to the recognition result threshold are represented by C1 and C2, the distance values between a user and the interactive controller are represented by D1 and D2, and the difference value of a preset threshold is represented by 'delta'; wherein, the 'delta' is a constant, and the preset threshold difference value is set to different values according to different application scenes.
(1) When the two interactive controllers have consistent recognition results (such as 'barbecue preheating')
When the difference between the recognition result threshold values of the two controllers is C1-C2 > -delta or C2-C1> -delta, selecting the voice recognition result corresponding to the larger voice recognition result threshold value to select the corresponding interactive controller;
when the value is more than 0 and less than or equal to C1-C2 and less than or equal to delta or more than 0 and less than or equal to C2-C1, further judging whether the value of the difference between the distance values D1-D2 or D2-D1 is 0; if so, selecting a result with a higher threshold value, and if D1-D2>0 or D2-D1>0, selecting a voice recognition result corresponding to a smaller distance value to select a corresponding interactive controller; and if C1 is C2 and D1 is D2, selecting an interaction controller corresponding to the voice recognition result.
(2) When the two interactive controller identification results are inconsistent
The interactive controller A1 recognizes the command of 'steaming and baking preheating', and simultaneously outputs a recognition threshold value C1-25 and a distance value D1-105; the interactive controller A2 recognizes the command of 'barbecue preheating' and simultaneously outputs the recognition threshold value C2 to 26 and the distance value D2 to 55, and according to the above-mentioned discrimination rule, the micro-steaming and baking controller selects the recognition result of the interactive controller A2, so that although one interactive controller A1 has the condition of error recognition, the condition of error operation caused by error recognition is avoided through the discrimination method, the recognition accuracy is improved, and meanwhile, the interactive controller which is closer to the user is correctly selected, the execution result can be timely and effectively fed back to the user, and the user experience is improved.
Operation example seven, the interactive control example (multi-person multi-interactive controller application scene) of the micro-steaming oven receiving the voice control instruction:
please refer to fig. 9, which is a schematic diagram of an interactive control example (multi-user multi-interactive controller application scenario) in which the micro-steaming oven of the seventh operation example receives a voice control command. For example, two interactive controllers which are already paired with the kitchen micro-steaming ovens are respectively placed at two ends of a living room by a user, and meanwhile, a plurality of non-operators are arranged in the living room besides the current operation outdoor of the micro-steaming ovens. When an operating user sends out at a certain position of a living room: when a voice control instruction of 'steam preheating' is carried out, the interactive controller 1 and the interactive controller 2 receive the voice control instruction at the same time and carry out recognition to obtain a recognition result and a result threshold value, the interactive controller 1 also obtains distance values between a plurality of same or different operation users and the interactive controller 1, and the interactive controller 2 also obtains distance values between a plurality of same or different non-operation persons and the interactive controller 2, so as to prove that the non-operation persons except the operation users exist in the current application scene, the two interactive controllers send the recognition result and the result threshold value data to the micro-steaming and baking controller for discrimination through a radio frequency wireless control circuit, and the voice control instruction required to be executed is selected according to the discrimination result, and the specific discrimination method is as follows:
firstly, defining a recognition result threshold as a recognition confidence coefficient, wherein the higher the confidence coefficient is, the more credible the recognition result is, the interactive controller is represented by A1 and A2, the recognition result thresholds corresponding to the interactive controller are represented by C1 and C2 respectively, and the difference value of the preset thresholds is represented by 'delta'; wherein, the 'delta' is a constant, and the preset threshold difference value is set to different values according to different application scenes.
(1) When the identification results of the two interactive controllers are consistent (such as 'steam preheating')
When the difference between the recognition result threshold values of the two controllers is C1-C2 > -delta or C2-C1> -delta, selecting the voice recognition result corresponding to the larger voice recognition result threshold value to select the corresponding interactive controller;
when the value is more than or equal to 0 and less than or equal to C1-C2 and less than or equal to 0 and less than or equal to C2-C1 and less than or equal to delta, any interactive controller is selected.
(2) When the two interactive controller identification results are inconsistent
The interactive controller A1 recognizes the command of 'steaming and baking preheating' and simultaneously outputs the recognition threshold value C1 to 25, the interactive controller A2 recognizes the command of 'steam preheating' and simultaneously outputs the recognition threshold value C2 to 26, and according to the judgment rule, the micro-steaming and baking controller selects the recognition result of the interactive controller A2, so that although one interactive controller A1 has the condition of error recognition, the condition of error operation caused by error recognition is avoided through the judgment method, the recognition accuracy is improved, and the use experience of a user is improved.
According to the electronic equipment and the interaction control system, method and interaction controller thereof provided by the embodiment of the invention, the interaction control of the electronic equipment is carried out by using the combination of the voice recognition control mode and the touch gesture recognition control mode, the control can be realized by the touch gesture control under a strong noise environment, and the problem of control limitation of the electronic equipment is solved by combining multiple interaction modes. Further, when the electronic device controller receives control information containing voice recognition information sent by at least two interactive controllers simultaneously, under the condition that only one operating user is available, the interactive controller closest to the user is selected to send the control information by recognizing a voice recognition result threshold value and a distance value, and the electronic device controller generates a corresponding logic control signal to control a corresponding load of the device after selecting a recognition result, because the interactive controller closest to the user has an optimal recognition result and an optimal interactive experience, the accuracy of voice recognition control and the user experience are improved. Further, when the electronic device controller receives control information containing voice recognition information sent by at least two interactive controllers simultaneously, under the condition that one operating user and a plurality of non-operating users exist, the interactive controller with the best recognition result is selected to send the control information through the recognition voice recognition result and the threshold value, and the electronic device controller selects the recognition result and then generates a corresponding logic control signal to control the corresponding load of the device, so that the best interactive experience is brought to the user. The interactive controller can be placed in other spaces different from the electronic equipment, after the electronic equipment is remotely started, after execution is finished, an end signal can be sent to all the interactive controllers in a radio frequency wireless communication mode, when a user is carrying out voice or touch gesture operation, the interactive controller can inform the user of the current position in real time in the radio frequency wireless communication mode, the electronic equipment can know that the current user uses a certain interactive controller more accurately, therefore, a cooking end notice can be accurately sent to a certain interactive controller operated by the user, and the interactive controller can inform the user of cooking completion or abnormal occurrence in a loudspeaker broadcasting or light warning mode.
In the embodiments provided in the present invention, it should be understood that the disclosed system, apparatus and method may be implemented in other ways. For example, the above-described apparatus embodiments are merely illustrative, and for example, the division of the modules or units is only one logical division, and there may be other divisions when actually implemented, for example, a plurality of units or components may be combined or may be integrated into another system, or some features may be omitted, or not executed. In addition, the mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical or other form.
The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, all or part of the technical solution of the present invention may be embodied in the form of a software product, which is stored in a storage medium and includes instructions for causing a computer device (which may be a personal computer, a management server, or a network device) or a processor to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a read-only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only an embodiment of the present invention, and not intended to limit the scope of the present invention, and all modifications of equivalent structures and equivalent processes performed by the present specification and drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.

Claims (13)

1. An electronic device interaction control method is characterized by comprising the following steps:
s3, when a touch gesture command is received, at least one interactive controller recognizes the touch gesture command to obtain a touch gesture recognition result, when a voice control command is received, at least one interactive controller recognizes the touch gesture command to obtain a voice recognition result and a voice recognition result threshold, and obtains a distance value between a user and the interactive controller through a human body distance sensor, wherein the voice control command or the touch gesture command is a function control command or a query command for operating the electronic equipment, and the voice recognition result, the voice recognition result threshold and the distance value form voice recognition information;
s4, the at least one interaction controller sends control information containing the voice recognition information and/or the touch gesture recognition result and the ID of the interaction controller to the electronic equipment controller;
and S5, after receiving the control information, the electronic device controller selects a voice recognition result and/or a touch gesture recognition result to be executed according to a preset rule, determines a logic control signal corresponding to the selected voice recognition result and/or touch gesture recognition result according to a preset control table, and controls a corresponding component by using the logic control signal, wherein the control table is used for recording the corresponding relation between the voice recognition result and/or touch gesture recognition result and the logic control signal.
2. The method according to claim 1, wherein the voice control instruction or the touch gesture instruction is also a wake-up instruction for operating an interactive controller, and the step S3 is preceded by the following steps:
s1, the electronic equipment controller controls the electronic equipment to be powered on and initialized, controls the wireless power supply communication unit to supply power for at least one interactive controller, and receives the interactive controller ID and the interactive controller communication address sent by the at least one interactive controller through the wireless power supply communication unit;
s2, the electronic device controller stores the ID of the interactive controller and the communication address of the interactive controller in a correlation mode, and returns pairing confirmation information and the communication address of the electronic device controller to the interactive controller to complete pairing;
when the voice recognition result or the touch gesture recognition result in the step S3 is a wake-up command, the step S3 further includes the following steps:
and S8, when the at least one interaction controller confirms that the awakening instruction is received, establishing a communication channel with the paired electronic equipment controller in a wireless radio frequency communication mode.
3. The electronic device interaction control method according to claim 2, wherein step S5 is followed by the following steps:
s6, the electronic device controller sends a feedback signal corresponding to the logic control signal to an interaction controller communication address corresponding to the interaction controller ID;
and S7, after the interactive controller corresponding to the interactive controller ID receives the feedback signal, analyzing the feedback signal to obtain feedback information, driving a loudspeaker to play voice corresponding to the feedback information, and driving a light control unit to light the light corresponding to the feedback information.
4. The method according to claim 1, wherein when the electronic device controller receives at least two sets of control information including speech recognition information, the step S5 of "selecting a speech recognition result to be executed according to a preset rule" specifically includes the following steps:
s501, the electronic equipment controller receives the voice recognition information and the M distance values sent by the M interactive controllers; each voice recognition information comprises N corresponding voice recognition results, wherein M is more than or equal to 2, and M is more than or equal to N is more than or equal to 1; the M distance values are obtained by respectively carrying out distance detection on one operation user by the M interactive controllers;
s502, when N is larger than or equal to 1, determining a corresponding voice recognition result according to the relation between the difference value of the maximum value and the second maximum value in all voice recognition result threshold values and a preset threshold value difference value so as to select an interactive controller;
s503, when the difference value between the maximum value and the second maximum value in all the speech recognition result threshold values is larger than the preset threshold value difference value, selecting the speech recognition result corresponding to the maximum value of the speech recognition result threshold value to select the corresponding interactive controller;
s504, when the difference value between the maximum value and the second maximum value in all the voice recognition result threshold values is not larger than the preset threshold value difference value, judging whether all the voice recognition result threshold values are the same;
s505, when all the speech recognition result thresholds are different, judging whether the distance value corresponding to the maximum value of the speech recognition result threshold and the distance value corresponding to the second largest value of the speech recognition result threshold have a smaller value: if the distance value is smaller, selecting a voice recognition result corresponding to the smaller distance value to select a corresponding interactive controller; if the distance value is smaller, selecting a voice recognition result corresponding to the maximum value of the voice recognition result threshold value to select a corresponding interaction controller;
s506, when all the voice recognition result threshold values are the same and the distance values corresponding to all the voice recognition result threshold values are also the same, any interactive controller is selected.
5. The method according to claim 1, wherein when the electronic device controller receives at least two sets of control information including speech recognition information, the step S5 of "selecting a speech recognition result to be executed according to a preset rule" specifically includes the following steps:
s511, the electronic equipment controller receives the voice recognition information and the X distance values sent by the M interactive controllers; each voice recognition information comprises corresponding N voice recognition results, wherein M is more than or equal to 2, M is more than or equal to N is more than or equal to 1, and X is more than or equal to 3; the X distance values are obtained by respectively carrying out distance detection on at least one operating user and at least one non-operating user by the M interactive controllers;
s512, when N is larger than or equal to 1, judging whether the difference value between the maximum value and the second maximum value in all the voice recognition result threshold values is larger than a preset threshold value difference value or not; if so, selecting a voice recognition result corresponding to the maximum value of the voice recognition result threshold value to select a corresponding interactive controller; if not, any interactive controller is selected.
6. An electronic equipment interaction control system is characterized by comprising electronic equipment with an electronic equipment controller and a functional component control unit, and at least one interaction controller in communication connection with the electronic equipment; the electronic equipment controller comprises a radio frequency transceiving unit, an electronic equipment processing unit and an electronic equipment storage unit, wherein the electronic equipment processing unit comprises a control information processing module; the interactive controller comprises an interactive controller processing unit, the interactive controller processing unit comprises a functional logic processing unit, and a digital signal interface unit and a voice recognition processing unit which are respectively connected with the functional logic processing unit, and the voice recognition processing unit is connected with the digital signal interface unit; the interactive controller also comprises a storage unit, a radio frequency wireless control unit, a human body distance sensor, a touch gesture control unit connected with a touch electrode, a wireless power supply and receiving communication unit and a microphone input unit connected with a microphone, wherein the storage unit, the radio frequency wireless control unit, the human body distance sensor, the touch gesture control unit connected with the touch electrode, the wireless power supply and receiving communication unit and the microphone input unit are respectively connected with the digital interface unit; the functional logic processing unit comprises a touch gesture recognition module and a control information generation module;
the touch gesture recognition module is used for recognizing a touch gesture command to obtain a touch gesture recognition result when receiving the touch gesture command sent by the touch electrode; the voice recognition processing unit is used for recognizing when receiving a voice control instruction input by the microphone input unit to obtain a voice recognition result and a voice recognition result threshold value, the human body distance sensor is used for obtaining a distance value between a user and the interactive controller when the voice recognition processing unit receives the voice control instruction, wherein the voice recognition result, the voice recognition result threshold value and the distance value form voice recognition information, and the voice control instruction or the touch gesture instruction is a function control instruction or a query instruction for operating the electronic equipment; the control information generation module is used for sending control information containing the voice recognition information and/or the touch gesture recognition result and the interactive controller ID to the electronic equipment controller;
the control information processing module is used for selecting a voice recognition result and/or a touch gesture recognition result to be executed according to a preset rule after receiving control information, and determining a logic control signal corresponding to the selected voice recognition result and/or touch gesture recognition result according to a preset control table, the functional component control unit is used for controlling a corresponding component by using the logic control signal, and the control table is used for recording the corresponding relation between the voice recognition result and/or the touch gesture recognition result and the logic control signal.
7. The electronic device interaction control system according to claim 6, wherein the voice control instruction or the touch gesture instruction is also a wake-up instruction for operating an interaction controller, the electronic device further comprises a wireless power supply communication unit, and the electronic device controller further comprises:
the initialization module is used for controlling the initialization of power-on parameters of the electronic equipment and controlling the wireless power supply communication unit to supply power to at least one interactive controller; and
the pairing module is used for receiving the interactive controller ID and the interactive controller communication address which are sent by the at least one interactive controller through the wireless power supply communication unit, storing the interactive controller ID and the interactive controller communication address to the electronic equipment storage unit in a correlation mode, and returning pairing confirmation information and the electronic equipment controller communication address to the interactive controller to complete pairing;
the functional logic processing unit of the interaction controller further comprises:
and the awakening module is used for informing the radio frequency wireless control unit to establish a communication channel with the paired electronic equipment controller in a radio frequency communication mode when the voice recognition result or the touch gesture recognition result is an awakening instruction.
8. The electronic device interaction control system according to claim 6, wherein the electronic device controller further comprises an execution feedback module, and the interaction controller further comprises a feedback analysis module, a power amplification unit connected with a speaker, and a light control unit;
the execution feedback module is used for sending a feedback signal corresponding to the logic control signal to an interaction controller communication address corresponding to the interaction controller ID through a radio frequency transceiving unit;
and the feedback analysis module of the interactive controller corresponding to the interactive controller ID is used for analyzing the feedback signal to obtain feedback information and driving the loudspeaker to play voice corresponding to the feedback information and driving the light control unit to lighten light corresponding to the feedback information after receiving the feedback signal.
9. The electronic equipment interaction control system according to claim 6, wherein the control information processing module of the electronic equipment controller comprises a first sub-module and a second sub-module;
the first submodule is used for judging whether N is equal to 1 or not when the electronic equipment controller receives voice recognition information containing N voice recognition results and M distance values sent by M interactive controllers, wherein M is more than or equal to 2, and M is more than or equal to N is more than or equal to 1; the M distance values are obtained by respectively carrying out distance detection on one operation user by the M interactive controllers;
the second submodule is used for determining a corresponding voice recognition result according to the relation between the difference value of the maximum value and the second maximum value in all the voice recognition result threshold values and the difference value of the preset threshold value when the first submodule judges that N is larger than or equal to 1 so as to select the interactive controller;
when the difference value between the maximum value and the second maximum value in all the speech recognition result threshold values is larger than the preset threshold value difference value, the second sub-module is used for selecting the speech recognition result corresponding to the maximum value of the speech recognition result threshold value so as to select the corresponding interactive controller;
when the difference value between the maximum value and the second maximum value in all the speech recognition result threshold values is not larger than the preset threshold value difference value, the second sub-module is further used for judging whether all the speech recognition result threshold values are the same;
when all the speech recognition result thresholds are different, the second sub-module is further configured to determine whether a smaller value exists between a distance value corresponding to the maximum speech recognition result threshold and a distance value corresponding to the second largest speech recognition result threshold: if the distance value is smaller, selecting a voice recognition result corresponding to the smaller distance value to select a corresponding interactive controller; if the distance value is smaller, selecting the voice recognition result corresponding to the maximum value of the voice recognition result threshold value to select a corresponding interactive controller;
and when all the voice recognition result threshold values are the same, the second sub-module is also used for judging that the distance values corresponding to all the voice recognition result threshold values are also the same, and then any interactive controller is selected.
10. The electronic equipment interaction control system according to claim 6, wherein the control information processing module of the electronic equipment controller comprises a first sub-module and a second sub-module;
the first submodule is used for judging whether N is equal to 1 or not when the electronic equipment controller receives voice recognition information containing N voice recognition results and X distance values sent by M interactive controllers, wherein M is more than or equal to 2, M is more than or equal to N and more than or equal to 1, and X is more than or equal to 3; the X distance values are obtained by respectively carrying out distance detection on at least one operation user and at least one non-operation user by the M interactive controllers;
the second submodule is used for judging whether the difference value between the maximum value and the second maximum value in all the voice recognition result threshold values is larger than the preset threshold value difference value or not when the first submodule judges that N is larger than or equal to 1; if so, selecting a voice recognition result corresponding to the maximum value of the voice recognition result threshold value to select a corresponding interactive controller; if not, any interactive controller is selected.
11. An electronic device interaction controller, comprising: the electronic equipment interaction controller comprises an interaction controller processing unit, the interaction controller processing unit comprises a functional logic processing unit, a digital signal interface unit and a voice recognition processing unit, the digital signal interface unit and the voice recognition processing unit are respectively connected with the functional logic processing unit, and the voice recognition processing unit is connected with the digital signal interface unit; the interactive controller also comprises a storage unit, a radio frequency wireless control unit, a human body distance sensor, a touch gesture control unit connected with a touch electrode, a wireless power supply and receiving communication unit and a microphone input unit connected with a microphone, wherein the storage unit, the radio frequency wireless control unit, the human body distance sensor, the touch gesture control unit connected with the touch electrode, the wireless power supply and receiving communication unit and the microphone input unit are respectively connected with the digital interface unit; the functional logic processing unit comprises a touch gesture recognition module and a control information generation module;
the voice recognition processing unit is used for recognizing to obtain a voice recognition result and a voice recognition result threshold when receiving a voice control instruction input by the microphone input unit, the human body distance sensor is used for acquiring a distance value between a user and the interactive controller when the voice recognition processing unit receives a voice control instruction, the touch gesture recognition module is used for recognizing when receiving a touch gesture instruction to obtain a gesture recognition result, the control information generation module is used for sending control information containing the voice recognition information and/or the touch gesture recognition result and the interactive controller ID to the electronic equipment controller, wherein the voice recognition result, the voice recognition result threshold value and the distance value form voice recognition information, the voice control instruction or the touch gesture instruction is a function control instruction or a query instruction for operating the electronic equipment.
12. An electronic device is characterized by comprising an electronic device controller and a functional component control unit, wherein the electronic device controller comprises a radio frequency transceiving unit, an electronic device processing unit and an electronic device storage unit, and the electronic device processing unit comprises a control information processing module;
the control information processing module is used for selecting a voice recognition result and/or a touch gesture recognition result to be executed according to a preset rule after receiving control information, and determining a logic control signal corresponding to the selected voice recognition result and/or touch gesture recognition result according to a preset control table, wherein the control information comprises voice recognition information and/or touch gesture recognition result, an interactive controller ID, and the voice recognition result, a voice recognition result threshold value and a distance value form the voice recognition information;
the functional component control unit is used for controlling the corresponding component by using the logic control signal, wherein the control table is used for recording the corresponding relation between the voice recognition result and/or the touch gesture recognition result and the logic control signal;
the control information processing module of the electronic equipment controller comprises a first sub-module and a second sub-module;
the first submodule is used for judging whether N is equal to 1 or not when the electronic equipment controller receives voice recognition information containing N voice recognition results and M distance values sent by M interactive controllers, wherein M is more than or equal to 2, and M is more than or equal to N is more than or equal to 1; the M distance values are obtained by respectively carrying out distance detection on one operation user by the M interactive controllers;
the second submodule is used for determining a corresponding voice recognition result according to the relation between the difference value of the maximum value and the second maximum value in all the voice recognition result threshold values and the difference value of the preset threshold value when the first submodule judges that N is larger than or equal to 1 so as to select the interactive controller;
when the difference value between the maximum value and the second maximum value in all the speech recognition result threshold values is larger than the preset threshold value difference value, the second sub-module is used for selecting the speech recognition result corresponding to the maximum value of the speech recognition result threshold value so as to select the corresponding interactive controller;
when the difference value between the maximum value and the second maximum value in all the speech recognition result threshold values is not larger than the preset threshold value difference value, the second sub-module is further used for judging whether all the speech recognition result threshold values are the same;
when all the speech recognition result thresholds are different, the second sub-module is further configured to determine whether a smaller value exists between a distance value corresponding to the maximum speech recognition result threshold and a distance value corresponding to the second largest speech recognition result threshold: if the distance value is smaller, selecting a voice recognition result corresponding to the smaller distance value to select a corresponding interactive controller; if the distance value is smaller, selecting the voice recognition result corresponding to the maximum value of the voice recognition result threshold value to select a corresponding interactive controller;
and when all the voice recognition result threshold values are the same, the second sub-module is also used for judging that the distance values corresponding to all the voice recognition result threshold values are also the same, and then any interactive controller is selected.
13. An electronic device is characterized by comprising an electronic device controller and a functional component control unit, wherein the electronic device controller comprises a radio frequency transceiving unit, an electronic device processing unit and an electronic device storage unit, and the electronic device processing unit comprises a control information processing module;
the control information processing module is used for selecting a voice recognition result and/or a touch gesture recognition result to be executed according to a preset rule after receiving control information, and determining a logic control signal corresponding to the selected voice recognition result and/or touch gesture recognition result according to a preset control table, wherein the control information comprises voice recognition information and/or touch gesture recognition result, an interactive controller ID, and the voice recognition result, a voice recognition result threshold value and a distance value form the voice recognition information;
the functional component control unit is used for controlling the corresponding component by using the logic control signal, wherein the control table is used for recording the corresponding relation between the voice recognition result and/or the touch gesture recognition result and the logic control signal;
the control information processing module of the electronic equipment controller comprises a first sub-module and a second sub-module;
the first submodule is used for judging whether N is equal to 1 or not when the electronic equipment controller receives X distance values of voice recognition information containing N voice recognition results sent by M interactive controllers, wherein M is more than or equal to 2, M is more than or equal to N and more than or equal to 1, and X is more than or equal to 3; the X distance values are obtained by respectively carrying out distance detection on at least one operation user and at least one non-operation user by the M interactive controllers;
the second submodule is used for judging whether the difference value between the maximum value and the second maximum value in all the voice recognition result threshold values is larger than the preset threshold value difference value or not when the first submodule judges that N is larger than or equal to 1; if so, selecting a voice recognition result corresponding to the maximum value of the voice recognition result threshold value to select a corresponding interactive controller; if not, any interactive controller is selected.
CN202110899555.4A 2021-08-06 2021-08-06 Electronic equipment, interaction control system and method thereof and interaction controller Active CN113835606B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110899555.4A CN113835606B (en) 2021-08-06 2021-08-06 Electronic equipment, interaction control system and method thereof and interaction controller

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110899555.4A CN113835606B (en) 2021-08-06 2021-08-06 Electronic equipment, interaction control system and method thereof and interaction controller

Publications (2)

Publication Number Publication Date
CN113835606A true CN113835606A (en) 2021-12-24
CN113835606B CN113835606B (en) 2024-02-02

Family

ID=78963046

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110899555.4A Active CN113835606B (en) 2021-08-06 2021-08-06 Electronic equipment, interaction control system and method thereof and interaction controller

Country Status (1)

Country Link
CN (1) CN113835606B (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101577118A (en) * 2009-06-12 2009-11-11 北京大学 Implementation method of voice interaction system facing intelligent service robot
CN108461084A (en) * 2018-03-01 2018-08-28 广东美的制冷设备有限公司 Speech recognition system control method, control device and computer readable storage medium
CN110827811A (en) * 2018-08-13 2020-02-21 格力电器（武汉）有限公司 Voice control method and device for household electrical appliance
US20200241829A1 (en) * 2019-01-29 2020-07-30 Foshan Shunde Midea Electrical Heating Appliances Manufacturing Co., Ltd. Method and system for controlling smart home appliances by voice

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101577118A (en) * 2009-06-12 2009-11-11 北京大学 Implementation method of voice interaction system facing intelligent service robot
CN108461084A (en) * 2018-03-01 2018-08-28 广东美的制冷设备有限公司 Speech recognition system control method, control device and computer readable storage medium
CN110827811A (en) * 2018-08-13 2020-02-21 格力电器（武汉）有限公司 Voice control method and device for household electrical appliance
US20200241829A1 (en) * 2019-01-29 2020-07-30 Foshan Shunde Midea Electrical Heating Appliances Manufacturing Co., Ltd. Method and system for controlling smart home appliances by voice

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
陈希祥; 黄伍; 李德英: "《基于语音识别的智能家居控制系统设计》", 《 自动化与仪表》, pages 1 - 5 *

Also Published As

Publication number Publication date
CN113835606B (en) 2024-02-02

Similar Documents

Publication Publication Date Title
CN108600059A (en) Apparatus control method and Related product
EP3599605A1 (en) Home appliance and speech recognition server system using artificial intelligence and method for controlling thereof
WO2019184300A1 (en) Ai control element, smart household control system and control method
EP3291034A1 (en) System and method for controlling device location determination
US20120112995A1 (en) Information Processing Apparatus, Information Processing Method, and Computer-Readable Storage Medium
EP3497467A1 (en) Control system and control processing method and apparatus
CN105161099A (en) Voice-controlled remote control device and realization method thereof
CN105807624A (en) Method for controlling intelligent home equipment through VR equipment and VR equipment
CN104168167A (en) Wireless network configuration method, system and device for household appliance
CN113170000A (en) Equipment control method, device, system, electronic equipment and cloud server
JP2008512881A (en) Object discovery method and system, device control method and system, interface, and pointing device
TW201204061A (en) Method and device for the remote control of terminal units
CN109410950A (en) A kind of sound control method and system of cooking equipment
CN109432568B (en) Sleep assisting method, device, storage medium and terminal
CN110021299B (en) Voice interaction method, device, system and storage medium
CN109542053A (en) A kind of control method of smart kitchen systems and smart kitchen systems
CN106960530A (en) Alarm method, device and terminal based on vital sign parameter
CN111785267A (en) Interaction control method and device and computer readable storage medium
CN103645690A (en) Method for controlling digital home smart box by using voices
CN112731817B (en) Control device and method for household appliance and mobile communication device
CN113835606B (en) Electronic equipment, interaction control system and method thereof and interaction controller
CN113282008A (en) Household appliance control method, system and storage medium based on unspecified person voice recognition technology
CN109215649B (en) Remote control device
CN204515375U (en) Voice control electric appliance
WO2019128632A1 (en) Audio playback method, device, and system

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant