WO2023284562A1

WO2023284562A1 - Control device, household appliance, and control method

Info

Publication number: WO2023284562A1
Application number: PCT/CN2022/103163
Authority: WO
Inventors: 杨香斌; 孔祥键; 崔文华; 卢可敬
Original assignee: 海信视像科技股份有限公司
Priority date: 2021-07-14
Filing date: 2022-06-30
Publication date: 2023-01-19
Also published as: CN117413493A

Abstract

Disclosed are a control method, a control device, and a household appliance. The control device comprises: a communication apparatus, and a processor which is configured to: in response to a control instruction, which acts on the control device, broadcast a first signal by means of the communication apparatus, so as to send an action request to a plurality of household appliances; receive at least one sound source signal by means of a communication interface, wherein the sound source signal is sent by the household appliance in response to the first signal, and the sound source signal at least comprises the ID number of the household appliance; according to the at least one sound source signal, determine a target device from among at least one corresponding household appliance; and control the target device to perform an action corresponding to the control instruction.

Description

Control device, home appliance, and control method

technical field

The embodiments of the present application relate to the technical field of smart home appliances, and in particular, to a control method and device.

Background technique

With the rapid development of science and technology, various smart home appliances have gradually entered thousands of households, providing great convenience for people's lives.

At present, smart home appliances can be controlled by voice or remote control. For example, it is possible to control the start-up, shutdown, and temperature adjustment of the air conditioner through the remote control of the air conditioner, and to control the start-up, shutdown, and channel adjustment of the TV set through the remote control of the TV.

However, the above control method needs to be equipped with corresponding remote controllers for different home appliances, and the operation is relatively complicated.

Contents of the invention

The present application provides a control device, including: a communication device; a processor configured to: respond to a control instruction acting on the control device, broadcast a first signal through the communication device to send an action request to a plurality of home appliances; The interface receives at least one sound source signal, the sound source signal is sent by the home appliance in response to the first signal, and the sound source signal includes at least the ID number of the home appliance; according to the at least one sound source The signal determines a target device in at least one corresponding household appliance;

and controlling the target device to execute an action corresponding to the control instruction.

The present application provides an electronic device, including a communication device, a sounding device, and a processor; the processor is configured to: receive a first signal from a control device through a communication device, and the first signal is used to send to the The household electrical appliance sends out an action request; in response to the first signal, transmits a sound source signal to the control device through the sound emitting device, and the sound source signal includes at least the ID number of the household electrical appliance; receives through the communication device A second signal, where the second signal includes the device identifier of the target device; according to the second signal, determine whether to execute the action corresponding to the first signal.

Description of drawings

Embodiments of the application will be described in detail below with reference to the accompanying drawings, wherein:

FIG. 1 is a view of a usage scenario of a display device according to some embodiments;

FIG. 2 is a block diagram of a hardware configuration of a control device 100 according to some embodiments;

FIG. 3 is a block diagram of a hardware configuration of a display device 200 according to some embodiments;

FIG. 4 is a software configuration diagram in a display device 200 according to some embodiments;

Fig. 5 is a schematic structural diagram of a terminal device according to some embodiments;

Fig. 6 is a schematic diagram of a software architecture of a terminal device according to some embodiments;

FIG. 7 is a schematic diagram of an application scenario according to an embodiment of the present application;

FIG. 8 is a schematic flowchart of a control method according to an embodiment of the present application;

FIG. 9 is a schematic flowchart of determining a target device according to an embodiment of the present application;

FIG. 10 is a schematic diagram of determining direction information of a sound source signal according to an embodiment of the present application;

FIG. 11 is a simulation diagram of a signal subspace spectrum according to an embodiment of the present application;

FIG. 12 is a schematic diagram of a control target device according to an embodiment of the present application;

FIG. 13 is a schematic flowchart of a control method according to an embodiment of the present application;

FIG. 14 is a schematic structural diagram of a control device according to an embodiment of the present application;

FIG. 15 is a schematic structural diagram of another control device according to an embodiment of the present application;

FIG. 16 is a schematic diagram of a hardware structure of a control device according to an embodiment of the present application;

FIG. 17 is a schematic diagram of a hardware structure of a home appliance according to an embodiment of the present application;

FIG. 18 is a schematic structural diagram of a control system according to an embodiment of the present application;

FIG. 19 is a display diagram of an icon control interface of an application program in the display device 200 according to some embodiments;

FIG. 20A is a schematic diagram of a user interface used by a control device to control a display device and a set-top box according to an embodiment of the present application;

FIG. 20B is a schematic diagram of a user interface used by a control device to control a display device and a set-top box according to another embodiment of the present application;

FIG. 20C is a schematic diagram of a user interface used by a control device to control a display device and a set-top box according to another embodiment of the present application;

FIG. 20D is a schematic diagram of a user interface used by a control device to control a display device and a set-top box according to another embodiment of the present application;

21A to 21F are schematic diagrams of a user interface for configuring a set-top box to link a TV with a remote controller according to another embodiment of the present application;

21G to 21H are schematic diagrams of a user interface for controlling multiple air conditioners by a remote controller according to another embodiment of the present application; and

Fig. 22 is a flowchart of a control device controlling a linkage device according to an embodiment of the present application.

detailed description

The following will describe the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, but not all of the embodiments.

It should be noted that the brief description of the terms in this application is only for the convenience of understanding the implementations described below, and is not intended to limit the implementations of this application. These terms are to be understood according to their ordinary and usual meaning unless otherwise stated.

Fig. 1 is a schematic diagram of a usage scenario of a display device according to an embodiment. As shown in FIG. 1 , the display device 200 also performs data communication with the server 400 , and the user can operate the display device 200 through the terminal device 300 or the control device 100 . In addition, the control device 100 can also control other devices, such as electronic devices such as refrigerators, air conditioners, washing machines, and household lights.

In some embodiments, the control device 100 may be a remote control, and the communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and other short-distance communication methods, etc., and the display device 200 is controlled by wireless or other wired methods. Wherein, the wireless mode may be direct connection or non-direct connection, and may be routed or not routed. The user can control the display device 200 by inputting user commands through buttons on the remote controller, voice input, control panel input, and the like.

In some embodiments, the terminal device 300 may include any one of a mobile terminal, a tablet computer, a computer, a notebook computer, an AR/VR device, and the like.

In some embodiments, the terminal device 300 can also be used to control the display device 200 . For example, the display device 200 is controlled using an application program running on the smart device. The app can be configured to provide users with various controls in an intuitive user interface (UI) on the screen associated with the smart device.

In some embodiments, the terminal device 300 and the display device 200 are capable of data communication.

In some embodiments, the display device 200 can also be controlled in a way other than the control device 100 and the terminal device 300, for example, the display device 200 can directly receive the user's voice command control through the module for acquiring voice commands configured inside the display device 200. , the user's voice command control can also be received through the voice control device installed outside the display device 200.

Fig. 2 is a configuration block diagram of the control device 100 according to some embodiments. As shown in FIG. 2 , the control device 100 includes a controller 110 , a communication interface 130 , a user input/output interface 140 , a memory, and a power supply. The control device 100 can receive the user's input operation instruction, and convert the operation instruction into an instruction that the display device 200 can recognize and respond to, and play an intermediary role between the user and the display device 200 .

In some embodiments, the communication interface 130 is used for communicating with the outside, and includes at least one of a WIFI chip, a Bluetooth module, NFC or an alternative module.

In some embodiments, the user input/output interface 140 includes at least one of a microphone, a touch pad, a sensor, a button or an alternative module.

FIG. 3 is a block diagram of a hardware configuration of a display device 200 according to some embodiments.

In some embodiments, the display device 200 includes a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface. at least one.

In some embodiments the processor includes a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, a first interface to an nth interface for input/output.

In some embodiments, the communicator 220 is a component for communicating with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 may establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220 .

In some embodiments, the user input interface can be used to receive a control signal of the control device 100 (such as an infrared remote controller, etc.).

In some embodiments, the detector 230 is used to collect signals of the external environment or interaction with the outside. For example, the detector 230 includes a light receiver, which is a sensor for collecting ambient light intensity; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environmental scenes, user attributes or user interaction gestures, or , the detector 230 includes a sound collector, such as a microphone, for receiving external sound.

In some embodiments, the external device interface 240 may include, but is not limited to, the following: High Definition Multimedia Interface Interface (HDMI), Analog or Data High Definition Component Input Interface (Component), Composite Video Input Interface (CVBS), USB Input Interface (USB) , RGB port, etc. any one or more interfaces.

In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different split devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box Wait.

In some embodiments, the control device 100 also includes a display.

Referring to Fig. 4, in some embodiments, the system is divided into four layers, from top to bottom are respectively the application (Applications) layer (abbreviated as "application layer"), application framework (Application Framework) layer (abbreviated as "framework layer") "), Android runtime (Android runtime) and system library layer (referred to as "system runtime layer"), and the kernel layer.

Fig. 5 is a block diagram of a hardware configuration of a terminal device 300 shown in some embodiments of the present application.

It should be understood that the terminal device 300 shown in FIG. 5 is only an example, and the terminal device 300 may have more or fewer components than those shown in FIG. 5, two or more components may be combined, or Different component configurations are possible. The various components shown in the figures may be implemented in hardware, software, or a combination of hardware and software including one or more signal processing and/or application specific integrated circuits.

As shown in Figure 5, the terminal device 300 includes: a radio frequency (radio frequency, RF) circuit 310, a memory 320, a display unit 130, a camera 340, a sensor 350, an audio circuit 360, and a wireless fidelity (Wireless Fidelity, Wi-Fi) module 370, processor 380, bluetooth module 381, and power supply 390 and other components.

Fig. 6 is a block diagram showing a software structure of a terminal device 300 according to some embodiments of the present application. Among them, the layered architecture divides the software into several layers, and each layer has a clear role and division of labor. Layers communicate through software interfaces. In some embodiments, the Android system is divided into four layers, which are respectively the application program layer, the application program framework layer, the Android runtime (Android runtime) and the system library, and the kernel layer from top to bottom. The application layer can consist of a series of application packages.

As shown in FIG. 6, the application package may include application programs such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, and short message.

The terminal device 300 in the embodiment of the present application may be a mobile phone, a tablet computer, a wearable device, a notebook computer, a TV, and the like. The above display device may be an example of a terminal device.

The term "remote controller" used in this application refers to a component of an electronic device (such as the display device disclosed in this application), which can usually control the electronic device wirelessly within a relatively short distance. Infrared rays and/or radio frequency (RF) signals and/or Bluetooth are generally used to connect with electronic devices, and functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors may also be included. For example, a hand-held touch remote control uses a user interface on a touch screen to replace most of the physical built-in hard keys in a general remote control device.

First, an application scenario applicable to this application is introduced.

FIG. 7 is a schematic diagram of an application scenario provided by the embodiment of the present application. As shown in FIG. 1 , it includes a lamp 11 , an air conditioner 12 and a TV 13 , all of which are smart home appliances.

These smart home appliances can be controlled through corresponding instructions, wherein the instructions to control the smart home appliances can be voice commands, key commands, or a combination of the two.

For example, the button command can be realized by operating the remote control 10 shown in FIG. 7 . For the interaction between the remote control and smart home appliances, the current interactive communication protocol is mainly based on bluetooth or infrared. The interaction based on bluetooth or infrared is broadcast type, that is, if an instruction is sent based on bluetooth or infrared, all smart home appliances can receive it.

Based on Bluetooth interaction, device binding can be performed before use. For example, turn on the Bluetooth switch of the TV 13 to bind with the remote control 10 . After the binding is completed, only the TV 13 can respond to all the commands sent by the remote controller 10 , and other home appliances, such as the lamp 11 and the air conditioner 12 , will not respond to the commands sent by the remote controller 10 . If it is necessary to use the remote controller 10 to control the electric lamp 11 or the air conditioner 12, it is necessary to unbind the remote controller 10 and the TV 13, and then perform Bluetooth binding with the home appliance to be controlled. In this way, every time a new home appliance needs to be controlled, it is necessary to unbind and rebind the Bluetooth, and the operation is cumbersome. Another way is to equip each household appliance with a remote controller for control, and there is a corresponding relationship between the household appliances and the remote controller, without unbinding and rebinding between the household appliances and the remote controller. However, in this way, the number of remote controllers equipped is large, and the operation is also troublesome.

When the command to control the smart home appliance is a voice command, since each home appliance can receive the command, the specific home appliance to be operated must also be indicated in the voice command. For example, when the user wants to turn off the air conditioner 12, an instruction such as "turn off the air conditioner" needs to be issued. If the voice instruction is "off", each household appliance does not know which device the user wants to turn off, and cannot respond. .

Based on this, the embodiment of the present application can control all household appliances through one control device without binding and unbinding between devices, and the operation is relatively simple. Embodiments of the present application will be introduced below.

Fig. 8 is a schematic flow chart of a control method provided in the embodiment of the present application, the method is applied to control equipment, as shown in Fig. 8, the method may include:

In response to the control instruction acting on the control device, a first signal is broadcasted through the communication device to send an action request to a plurality of household electrical appliances.

For example, in S21, in response to a control instruction acting on the control device, broadcast a first infrared signal according to the control instruction.

The method provided in the embodiment of the present application is applicable to the application scenario shown in FIG. 7 . Wherein, the control device can control different home appliances. The control device may be, for example, a remote controller, and there are one or more home appliances, and the home appliances may include, for example, air conditioners, refrigerators, electric lights, and the like.

When the user wants to control a certain target device, the user can first issue a control command to act on the control device. After receiving the control command, the control device responds and broadcasts the first signal according to the control command. The control command may be a voice command issued by the user, or an operation command acting on the control device. For example, when the control device is a remote control, the control command may be a key command acting on the remote control.

In the embodiment of the present application, the first signal is used to send an action request to a plurality of home appliances to perform a specific operation.

In the embodiment of the present application, the first signal may be an infrared signal, so it may also be referred to as a first infrared signal hereinafter.

At S22, at least one sound source signal is received, and the sound source signal is sent by the household electrical appliance in response to the first signal (for example, an infrared signal). The sound source signal includes at least the ID number of the home appliance.

After the control device broadcasts the first infrared signal, all household appliances in the scene can receive the first infrared signal. After each household electrical appliance receives the first infrared signal, it will respond to the first infrared signal, generate and send a sound source signal. The sound source signals generated by each household appliance will be received by the control device.

In S23, a target device is determined in at least one corresponding household electrical appliance according to the at least one sound source signal.

After receiving the sound source signal generated by each home appliance, the control device can perform sound source location according to the received sound source signal, and determine the target device among at least one home appliance corresponding to each sound source signal, and the target device is the at least one A device in a home appliance that the user wishes to control.

In S24, the target device is controlled to perform an operation corresponding to the control instruction.

After the target device is determined, the control device can control the target device to perform the operation corresponding to the control command, where the operation corresponding to the control command can be basic operations such as power on, power off, etc., or can be unique to different types of home appliances. operation. According to the embodiment of the present application, the target device that the user wants to control is determined based on the sound source signal sent by each home appliance, so that all the home appliances can be controlled by one control device, and the operation is convenient and simple.

Embodiments of the present application will be described in detail below with reference to the accompanying drawings.

Fig. 9 is a schematic flow chart of determining the target device provided by the embodiment of the present application, as shown in Fig. 9, including:

S31. Acquire direction information of each of the sound source signals.

Each sound source signal may be sent by the corresponding home appliance in response to the first infrared signal, and the sound source signal has a certain directionality. Therefore, the home appliance can be positioned according to the direction information of the sound source signal.

In one embodiment, the sound source signal is an ultrasonic sound source signal, or an infrasonic sound source signal. Since ultrasonic waves and infrasonic waves are sounds that cannot be heard by human ears, it is possible to prevent noise generated by household appliances from affecting users.

Taking the sound source signal as an ultrasonic sound source signal as an example, after receiving the first infrared signal, the household electrical appliance sends out a corresponding ultrasonic sound source signal in response to the first infrared signal. Optionally, the frequency bands of the sound source signals emitted by different household appliances are different, and the control device may know in advance the frequency bands of the sound source signals emitted by each household appliance, so as to obtain the corresponding relationship between the frequency bands of each sound source signal and the household appliances.

A microphone array is installed inside the control device, and the microphone array is used to receive the sound source signal sent by the home appliance. Wherein, the direction information of the sound source signal is an angle between the sound source signal and the microphone array in the control device. FIG. 10 is a schematic diagram of determining the direction information of the sound source signal provided by the embodiment of the present application. As shown in FIG. 10 , the home appliances include lamps 11 , air conditioners 12 and TVs 13 , and the control devices include a microphone array 40 .

The microphone array 40 is used to receive the sound source signal A sent by the lamp 11, the sound source signal B sent by the air conditioner 12, and the sound source signal C sent by the TV, and obtain the direction information of these three sound source signals, that is, the three sound source signals The angle between the signal and the microphone array.

For example, in FIG. 10 , the angle between the sound source signal A and the microphone array is α, the angle between the sound source signal B and the microphone array is β, and the angle between the sound source signal C and the microphone array is angle γ.

At present, indoor home appliances can be positioned through Ultra Wide Band (UWB), that is, positioning is achieved through wireless carrier communication technology with a frequency bandwidth above 1GHz. However, the cost is high, the power consumption is large, and the layout is complicated, so it is difficult to promote in the home scene. The following will introduce how to obtain the angle between the corresponding sound source signal and the microphone array according to the sound source signal.

After receiving multiple sound source signals, the microphone array can establish a matrix based on the multiple sound source signals as follows:

Wherein, P represents the number of microphones in the microphone array, M represents the number of preset sound sources, and t is an independent variable time.

Formula (1) can be simplified as follows:

X(t)＝A(θ)s(t)+n(t); (2)

Discretization of formula (2) can get:

X(k)＝A(θ)s(k)+n(k); (3)

Among them, X(k) is the discrete expression form of X(t), that is, X(t) is continuous in time, and X(k) is a discrete function obtained by sampling X(t) in time. A(θ) is the steering vector of the matrix X(k), s(k) is the sound source signal, and n(k) is the noise vector.

Estimate the direction of arrival (DOA) based on the multiple signal classification (Multiple Signal Classification, MUSIC) algorithm for formula (3), and obtain the covariance matrix of the sound source signal as follows:

R=E{X(k) ^XH (k)}; (4)

Among them, R is the covariance matrix of the sound source signal. Since the frequency bands of each sound source signal are different, do not overlap, and are not correlated, and each sound source signal is orthogonal to the noise signal, the decomposition of the covariance matrix eigenvalue of formula (4) can be obtained as follows:

R = AR _s A ^H + δ ² I; (5)

Among them, A is the steering vector of the matrix, that is, A(θ) in formula (3). The eigenvalues in the matrix R can be obtained by formula (5). Then, sort the eigenvalues in the matrix R. Taking MATLAB simulation as an example, the eigenvalues of the matrix can be obtained by the function [V,D]=eig_sort(R), where V is the vector matrix and D is the eigenvalue of the vector matrix.

Wherein, the number of eigenvalues of the matrix is M, and M is the number of preset sound sources. After obtaining the M eigenvalues, the first N eigenvalues can be understood as the signal subspace corresponding to the sound source signal, and its energy is relatively strong. For example, in the signal subspaces of the sound source signal A, the sound source signal B and the sound source signal C illustrated in FIG. 10 , N=3 at this time. The remaining M-N eigenvalues can be understood as noise subspaces, for example, including scattering noise with less energy. According to the above formula (5), the distribution of the sound source signal and the noise signal in the space can be obtained.

For example, the eigenvalue obtained through the function [V,D]=eig_sort(R) is as follows:

34.4792 29.0823 4.9426 0.6438 0.0227 0.0200 0.0178

The first three values are relatively large, which can correspond to the three sound source signals in the space, and the latter few values are relatively small, which can correspond to the noise signal in the space.

After obtaining the eigenvalues corresponding to each signal space, the spatial spectrum can be calculated based on the MUSIC algorithm. For example, through the function J(t)=MUSIC_DOA(D, theta), wherein, D is the eigenvalue obtained according to the above embodiment, and theta (ie) is the angle of the sound source signal corresponding to each eigenvalue. Then, according to the steering vector a=exp(coefficient*f0*d*sind(theta)/c corresponding to each angle, multiply by the autocorrelation matrix, namely:

J=a*Rx*a', generate signal subspace spectrum.

Wherein, J represents the beam gain value corresponding to the microphone array at the theta angle, that is, the degree of radio energy gain corresponding to the microphone array at the theta angle. Rx is the covariance matrix in formula (4). Each feature value is related to the frequency of the sound source signal, that is, the frequency band of the sound source signal can be used to characterize the characteristics of the sound source. Then, according to the frequency band of the sound source signal corresponding to its eigenvalue, the household appliance corresponding to the sound source signal is estimated. For example, in FIG. 10 , the eigenvalue corresponding to the 90-degree sound source signal is 34.4792, which can correspond to a sound source signal whose frequency band is 2kHz around 30k, so that it can be fixed as the sound frequency band emitted by the air conditioner 12.

FIG. 11 is a simulation diagram of a signal subspace spectrum provided by an embodiment of the present application. As shown in FIG. 11 , the abscissa represents an angle, and the ordinate represents a signal magnitude. It can be seen from Fig. 11 that in the three directions of about 65 degrees, about 88 degrees and about 114 degrees, there are sound sources emitting sound energy, indicating that the angle of sound source signal A, sound source signal B and sound source signal C is 65° degrees, 88 degrees and 114 degrees.

As shown in FIG. 9, at S32, the target device is determined in the at least one household electrical appliance according to the direction information of each of the sound source signals.

After determining the angle between each sound source signal and the microphone array, the target sound source signal can be determined in the sound source signal according to the angle between each sound source signal and the microphone array, wherein, the target sound source signal and the microphone array The angle between is within the preset range.

The preset range is determined according to the orientation of the microphone array in the control device. Taking the control device as a remote control as an example, when the user wants to control a certain home appliance through the remote control, he usually points the remote control at the home appliance. At this time, the angle between the sound source signal from the home appliance and the microphone array is within the preset range.

For example, when the microphone array is horizontally located in the control device, if the control device is aimed at the target device, the angle between the sound source signal emitted by the target device and the microphone array should be about 90 degrees. At this time, the preset range can be set to The range of about 90 degrees, for example, between 80-100 degrees.

For example, in Fig. 10, the angle β between the sound source signal B and the microphone array is 90 degrees, which is within the preset range, while α is 130 degrees, and γ is 40 degrees, which are not within the preset range. Therefore, The sound source signal B is determined as the target sound source signal.

If the angle between any sound source signal and the microphone array is not within the preset range, it means that the control device is not aimed at any home appliance. At this time, the control device can play voice prompt information to indicate at least one home appliance No target device exists in .

After the target sound source signal is determined, the target device can be determined in at least one household electrical appliance according to the target sound source signal.

Specifically, the frequency band where the target sound source signal is located may be obtained, and then the target device is determined in at least one home appliance device according to the correspondence between the frequency bands where each sound source signal is located and the household appliances and the frequency band where the target sound source signal is located.

After the target device is determined, it is necessary to control the target device to execute the operation corresponding to the control instruction. In a possible implementation manner, the control device may broadcast the second infrared signal according to the control instruction. It will be described below with reference to FIG. 12 .

Fig. 12 is a schematic diagram of the control target device provided by the embodiment of the present application. As shown in Fig. 12 , the household appliances include electric lamp 11, air conditioner 12 and TV 13, wherein the control device 10 determines that the air conditioner 12 is the target device, and then broadcasts the second infrared signal. Since the second infrared signal is propagated in the form of broadcast, each household appliance can receive the second infrared signal.

In the second infrared signal, the device identification of the target device is also included. For example, in FIG. 12 , the second infrared signal includes the equipment identification of the air conditioner 12 . After each household electrical appliance receives the second infrared signal, it can obtain the device identifier of the target device, and then judge whether the device identifier of the target device is its own device identifier.

If the device identification of the household electrical appliance is different from the equipment identification of the target device, it means that the household electrical appliance is not the target device, and at this time the household electrical appliance does not respond to the second infrared signal. For example, after the electric light 11 receives the second infrared signal, it obtains the equipment identification of the air conditioner 12, compares it with the equipment identification of its own electric light 11, and finds that it is not the same equipment identification, so the corresponding operation of the control command is not executed. .

If the device identifier of the household electrical appliance is the same as that of the target device, it means that the household electrical appliance is the target device. At this time, the household electrical appliance responds to the second infrared signal, and executes the operation corresponding to the control instruction according to the second infrared signal. For example, after the air conditioner 12 receives the second infrared signal, it obtains the equipment identification of the air conditioner 12, compares it with the equipment identification of its own air conditioner 12, and finds that it is the same equipment identification, so it executes the corresponding operation of the control command.

Fig. 13 is a schematic flowchart of the control method provided in the embodiment of the present application, as shown in Fig. 13, including:

S701. Receive a voice or key input instruction through the control device.

The control device may be a remote controller, and may receive voice or key input instructions in response to user input, and the instructions are control instructions. Since different home appliances can perform different operations, there are common operations among home appliances, and there are also different operations. For common operations, corresponding instructions can be set on the remote control, such as "starting up" and "shutting down", which exist in all household appliances and can be set on the remote control.

For different operations, you can receive voice commands. For example, for electric lights, you can adjust the brightness. This command is unresponsive to air conditioners, refrigerators and other household appliances. Therefore, such commands are usually not set on the remote control, but Operate through voice commands.

For key commands, there is no need to bind or unbind the remote control with any home appliances, and only one remote control can control all home appliances. For the voice command, there is no need to specifically specify the household appliances that need to be operated. For example, when the user wants to adjust the temperature of the air conditioner to 23 degrees, there is no need to say "adjust the temperature of the air conditioner to 23 degrees", but only need to say "adjust to 23 degrees". That is, there is no need to specify the device to be controlled in the voice command, but only the remote controller needs to be pointed at the device to control it.

S702, the button is pressed and the remote controller is pointed at the target device.

When an action is required, usually the remote is pointed at the target device.

S703, the instruction is sent to each home appliance through infrared, and the button is released.

When the remote controller is operated, the remote controller will broadcast the first infrared signal, and each household appliance will receive the first infrared signal.

S704, each household appliance sends out a sound source signal in response to the control command.

After each household appliance receives the first infrared signal, it responds to the first infrared signal and sends out a sound source signal. Wherein, frequency bands of sounds emitted by various household appliances are different, for example, ultrasonic signals of different frequency bands may be used.

S705. The remote controller performs sound source localization according to the sound source signal.

After the microphone array in the remote controller receives the sound source signals from each household appliance, it can perform sound source localization according to the sound source signals, and determine the direction information of each sound source signal.

S706, judging whether there is a sound source signal at about 90 degrees, if yes, execute S707, if not, execute S707.

In the embodiment of the present application, when the remote controller is aimed at the target device, the angle between the sound source signal emitted by the target device and the microphone array is about 90 degrees. Therefore, after the sound source localization obtains the direction information of each sound source signal, the remote controller determines whether there is a sound source signal at about 90 degrees.

S707, prompting "failed to find the target device, please align and re-enter".

If there is no sound source signal at about 90 degrees, it means that the remote control is not aimed at any home appliance. At this time, the remote control can send out a reminder to remind the user to re-align the target device to be controlled.

S708, the remote controller analyzes the frequency band corresponding to the 90-degree sound source signal.

If there is a sound source signal at about 90 degrees, it means that the remote control is aimed at a certain home appliance. At this time, the remote control analyzes and obtains the frequency band corresponding to the sound source signal.

S709, the remote controller confirms the device in the corresponding frequency band.

Since the frequency bands of the sound source signals emitted by different home appliances are different, the target device can be determined according to the correspondence between the frequency bands and the home appliances and the frequency bands of the sound source signals.

S710, the remote control performs target device verification through infrared.

Specifically, the remote controller broadcasts a second infrared signal, and the second infrared signal includes the device identifier of the target device.

S711, the home appliance receives the infrared information, compares it, and confirms whether it is the target device, if yes, executes S712, and if not, ends the process.

Since the second infrared signal includes the device identifier of the target device, each household appliance obtains the device identifier of the target device after receiving the second infrared signal, and then judges whether the device identifier of the target device is consistent with its own device identifier. If they are consistent, it means that it is the target device and responds to the control command. If different, it is not the target device and no response will be made.

S712, performing an instruction operation.

The target device executes corresponding operations according to the control instructions, such as "shut down", "start up" and so on.

The control method provided by the embodiment of the present application firstly responds to the control instruction acting on the control device, broadcasts the first infrared signal according to the control instruction, then receives at least one sound source signal, and broadcasts the first infrared signal according to the at least one sound source signal to the corresponding at least one household electrical appliance. Determine the target device, so as to control the target device to execute the operation corresponding to the control instruction. The embodiment provided by the embodiment of the present application determines the target device that the user wants to control based on the sound source signal sent by each home appliance, so that all the home appliances can be controlled by one control device, and the operation is convenient and simple.

Fig. 14 is a schematic structural diagram of a control device provided in the embodiment of the present application. As shown in Fig. 14, the control device 80 includes:

A broadcast module 81, configured to respond to a control instruction acting on the control device, and broadcast a first infrared signal according to the control instruction;

A receiving module 82, configured to receive at least one sound source signal, the sound source signal is sent by the household electrical appliance in response to the first infrared signal;

A processing module 83, configured to determine a target device in at least one corresponding household electrical appliance according to the at least one sound source signal;

The control module 84 is configured to control the target device to execute the operation corresponding to the control instruction.

FIG. 15 is a schematic structural diagram of another control device provided by the embodiment of the present application. As shown in Figure 15, the control device 90 includes:

The first receiving module 91 is configured to receive a first infrared signal, and the first infrared signal is a signal broadcast by the control device according to a control instruction;

A sending module 92, configured to send a sound source signal to the control device, where the sound source signal is used to instruct the household electrical appliance to determine a target device according to the received sound source signal;

The second receiving module 93 is configured to receive a second infrared signal, where the second infrared signal includes the device identification of the target device;

The processing module 94 is configured to determine whether to execute the operation corresponding to the control instruction according to the second infrared signal.

FIG. 16 is a schematic diagram of a hardware structure of a control device provided by an embodiment of the present application. As shown in FIG. 16 , the control device includes: a microphone array 101 , at least one processor 102 and a memory 103 . Wherein, the microphone array 101 , the processor 102 and the memory 103 are connected through a bus 104 .

Optionally, the control device further includes a communication component. For example, a communication component may include a receiver and/or a transmitter.

In a specific implementation process, at least one processor 102 executes the computer-executed instructions stored in the memory 103, so that at least one processor 102 executes the above control method, wherein, when the processor 102 receives at least one sound source signal, it is received by the microphone array 101. For a specific implementation process of the processor 102, reference may be made to the foregoing method embodiments.

FIG. 17 is a schematic diagram of a hardware structure of a home appliance provided by an embodiment of the present application. As shown in FIG. 17 , the home appliance includes: at least one processor 111 and a memory 112 . Wherein, the processor 111 and the memory 112 are connected through a bus 113 . Optionally, the household electrical appliance further includes a communication component. For example, a communication component may include a receiver and/or a transmitter. In a specific implementation process, at least one processor 111 executes the computer-executed instructions stored in the memory 112, and at least one processor 111 executes the above control method. For the specific implementation process of the processor 111, reference may be made to the foregoing method embodiments.

FIG. 18 is a schematic structural diagram of a control system provided by an embodiment of the present application. As shown in FIG. 18 , it includes a control device 121 and a home appliance device 122 . For the method steps executed by the control device 121 and the household electrical appliance 122, refer to the foregoing embodiments for details.

The control device provided by this application can not only control the above-mentioned various types of home appliances, but also control the display device and the corresponding external devices at the same time. In some embodiments, after the display device is started, it can directly enter the interface of the preset video-on-demand program. The interface of the video-on-demand program can be as shown in FIG. , the content displayed in the content display area will change with the selected control in the navigation bar. The program in the application layer can be integrated in the video-on-demand program and displayed through a control in the navigation bar, or can be further displayed after the application control in the navigation bar is selected.

In some embodiments, after the display device is started, it can directly enter the display interface of the signal source selected last time, or the signal source selection interface, wherein the signal source can be a preset video-on-demand program, or an HDMI interface, a live TV interface At least one of the above, after the user selects different signal sources, the display can display the content obtained from different signal sources.

The control device in the embodiment of the present application may be implemented as the remote controller or the control part of the controlled device. The remote controller may include an infrared remote controller, a Bluetooth remote controller, or other types of wireless remote controllers. In the following, the embodiment of multi-device simultaneous power-on/off linkage control implemented by an infrared remote control and a set-top box, and the user interface will be taken as examples to describe the linkage control method of the control device, display device, set-top box, and multi-device simultaneous power-on/off.

FIG. 20A is a schematic diagram of a user interface in which a control device controls a display device and a set-top box according to an embodiment of the present application.

In some embodiments, the control device provided in the present application can be implemented as the control device 100 that communicates using an infrared protocol, that is, an infrared remote controller commonly used in smart TV configurations. The infrared remote control controls the display device wirelessly, and the user can control the display device by inputting user commands through buttons on the remote control, voice input, and control panel input.

In some embodiments, the control device provided by this application can be implemented as a terminal device 300, which can include a mobile terminal, a tablet computer, a computer, a notebook computer, etc. equipped with an infrared communication function, for example, using a remote control application program running on a smart device Control display devices.

In some embodiments, the remote controller includes a display, and the user interface of the display can display information about the device that can be controlled by the remote controller, for example, including an on/off key, a confirmation key, and a navigation key of the device, as shown in FIG. 20A .

For example, the user interface of the remote controller screen shown in FIG. 20A indicates that its current control device is a set-top box, and the middle part of the user interface is 4 direction navigation keys and a confirmation key; the lower side of the user interface is a return key, a home key, a setting key, And the commonly used volume up, volume down and mute keys; the top display of the user interface includes the on/off key used to control the target device on and off, the device name of the target device, associated logo, associated device and more content keys.

For example, the first device is a set-top box, the second device is a TV, and the processor, the second device and the second device are configured as associated devices; when the remote control switches to the set-top box control interface, the target device information at the top of the remote control user interface will be displayed as For set-top boxes, the corresponding associated device information will be displayed as TV; similarly, when the remote control switches to the TV control interface, the target device information at the top of the remote control user interface will be displayed as TV, and the corresponding associated device information will be displayed as set-top box.

It should be noted that if the user does not configure the associated device of the first device or the second device, the user interface of the remote controller will not display the associated information and associated identifier of the target device, that is, the first processor of the remote controller Before receiving the power-on/off operation of the user on the corresponding switch key of the first device in the user interface, if there is an associated second device on the first device, the first processor of the remote control will control the user interface of the remote control to be on the first device. The associated logo and the name of the second device are displayed around the name to achieve the effect of prompting the user to perform linkage control on multiple devices.

In some embodiments, the user operates the remote control to turn on or off the set-top box of the first device, and the user can click the power button on the top of the set-top box control user interface of the remote control to input the power on or off of the first device. Shutdown control command. It can be understood as a switching control operation in which the first click is for powering on, and the second click is for powering off.

For example, when the TV and set-top box are associated and both are turned off; the user can turn on the set-top box and the TV at the same time by using the on/off key in the user interface of the set-top box on the remote control to start the set-top box.

It should be noted that although this application uses the remote control to control multiple devices to turn on and off at the same time as an example, this application does not limit the content of the control commands of the remote control to the devices. Through the embodiments of the application and the inventive concept, the remote control The device can completely control the set-top box and TV at the same time to realize functions such as timing power-on, timing power-off, and parameter setting.

In some embodiments, when there is an associated TV of the second device in the set-top box of the first device, the first processor will control the user interface of the remote controller to display an on/off prompt about the TV of the second device, as shown in FIG. 20B . The on/off prompt about the TV can be implemented, for example, to include the name TV of the associated device, an associated activation button, and a disassociated activation button. Wherein, the switch prompt is used to trigger the first processor of the remote controller to obtain and determine the first control code corresponding to the set-top box according to the first device ID after receiving the user's confirmation operation, and obtain and determine the second control code according to the second device ID. Control code; it should be noted that, in the infrared remote controller, the first control code and the second control code may also be referred to as the first infrared code and the second infrared code.

For example, the user interface of the remote controller displays a switching prompt as shown in FIG. 20B , reminding the user whether to switch the TV synchronously; for example, as shown in FIG. 22 , it is determined in step S2210 whether the TV needs to be switched synchronously. After the user clicks the "Yes" button, the first processor can obtain the infrared code information for switching on and off, that is, the first control code, from the infraredCodesInfo (supporting infrared code information) field of the local linkage list of the set-top box device.

The first processor also obtains the second device ID, namely the TV ID, according to the associatedDeviceId (associated device ID) field of the local linkage list of the set-top box, and queries the corresponding bound TV, TV, TV, And obtain the infrared code information of the TV's infraredCodesInfo (supporting infrared code information) field, that is, the second control code.

It can be understood that, based on the first device ID, the first processor of the remote controller acquires the second device ID associated with the first device ID and the first control code corresponding to the first device ID in the linkage list of the control device; A processor then obtains the corresponding second control code from the device list corresponding to the user account according to the obtained second device ID.

Among them, the linkage list contains the information of all devices that the user has already associated with the device in advance and has established an association relationship; the device list is a collection of devices bound to the user account. For example, the devices bound to the user account may include TVs, set-top boxes, air conditioners, air conditioners, Purifiers, etc., the device information of the above-mentioned devices will be recorded in the device list; and the device information of the devices with configured associations in the device list will be recorded in the linkage list; it can be understood that the device list and the linkage list are inclusive relationship from the device object dimension .

In some embodiments, the linkage list described in this application may include the following field information:

deviceId: indicates the ID information of the target device, and the ID is a unique identification attribute of each device;

deviceName: Indicates the target device name information;

deviceRoom: Indicates the room information of the target device;

deviceType: Indicates the target device type information, which may include TV, set-top box, air conditioner, washing machine, etc.;

deviceControlType: Indicates the control type information of the target device, including infrared control, wifi control, and Bluetooth control;

associatedDeviceId: Indicates associated device ID information;

infraredCodesInfo: Indicates the supporting infrared code information corresponding to the target device, such as the first control code and the second control code in this application.

In some embodiments, as shown in FIG. 22 , in step S2212 , the first processor will send the control command including the control code to the corresponding target devices after obtaining the infrared code information of the set-top box and the TV. For example, the first processor sends a first control instruction comprising a first control code to a set-top box of a first device, so as to control the set-top box to start or shut down; the first processor sends a second control instruction comprising a second control code to a second device TV, to control the TV to turn on/off, so as to realize the linkage control of multiple devices turning on and off at the same time; in the embodiment of this application, the control instructions can be sent synchronously, or asynchronously within the allowable time, but The predetermined time of action is specified in the instruction so as to realize synchronous control of actions of multiple home appliances. For example, when any device executes an operation issued by the first processor, it will execute the operation synchronously and in conjunction with its associated device.

After sending the first control instruction to the set-top box, as shown in Figure 22, in step S2213, the set-top box obtains the first control code, and the set-top box will switch from the off state to the on state; after sending the second control instruction to the TV, the TV obtains the first control code. With the second control code, the TV will switch from the off state to the on state, as shown in FIG. 20C , the state of the TV and the set-top box.

In some embodiments, after the first processor of the remote controller acquires the infrared codes of the target device and the associated device, it simultaneously sends the switch infrared code values of the two associated devices through corresponding control instructions to realize one-key Turn on/off the set-top box and associated TV. Similarly, in the operation interface of the TV remote controller, as shown in FIG. 22 , in step S2209 , clicking the on/off key button can also synchronize the on/off operation of the set-top box.

In some embodiments, as shown in FIG. 22 , when the TV does not need to be turned on and off synchronously, in step S2211, the first device currently controlled by the remote controller does not have an associated second device, and the user operates the first device to start, Or when shutting down, the first processor will control its user interface not to display the switch prompt in the above embodiment, directly obtain the corresponding first control code according to the first device ID and carry the first control code through the first control command Send to the first device to control the power on/off of the first device.

It can be found that when the set-top box is not associated with the TV, only the target device is displayed on the top of the user interface of the remote control, and the association logo and the corresponding associated device are not displayed, as shown in FIG. 20D .

FIG. 21A to FIG. 21F show schematic diagrams of a user interface for configuring a set-top box to be linked with a TV by a remote controller according to another embodiment of the present application.

In some embodiments, as shown in FIG. 22 , in steps S2201 and S2202 , a set-top box and an associated television device are bound. The target device currently controlled by the remote control is a set-top box, and the user needs to associate the TV with the set-top box. First, the user performs an operation of adding a device on the home page of the set-top box control user interface, as shown in FIG. 21A . The user interface includes selectable product categories, such as televisions, set-top boxes, and air conditioners.

The user's current requirement is to add a TV. After the user clicks the TV button, the user interface of the remote controller will jump to the one shown in FIG. 21B . The user interface of the remote control will display the TV brand selection interface, and the user can select the device brand to be bound, such as brand 1; after brand 1 is selected and confirmed, the user interface will jump to the infrared code verification interface as shown in Figure 21C, The infrared code is the first control code or the second control code provided in this application. After receiving the infrared code, the TV or other target equipment will perform the power-on or power-off operation.

As shown in Figure 21C, under the operation of the user, the first processor of the remote control sends different on/off infrared code values to the TV to be associated to verify whether the TV can respond normally; if the TV cannot respond, the user can click on the remote control If the "No Response" button in the user interface, the first processor will automatically switch to the next set of infrared codes to continue testing; if the TV responds, the user clicks the "Response" button in the remote control user interface, the first processor will Control the user interface of the remote control to jump to the room and name selection interface of the TV equipment, as shown in FIG. 21D .

In the room selection interface shown in Figure 21D, the user can configure the room information of the device and the device name, for example, it can be configured as: room name + device name; or brand name + device name; after the above information is set, the user clicks Finish the button, the first processor will control the user interface to jump to the home page, and the home page will automatically refresh and display the newly added TV.

After the TV is bound to the remote controller according to the above process, the user interface of the remote controller will be displayed as shown in the user interface of the remote controller in Figure 20D. When the user clicks the More button on the top of the user interface, the user interface will jump to the screen shown in Figure 21E The user interface displayed; the top right of the user interface of the remote control will prompt the linkage status, and the set-top box will prompt "unlinked" before it is linked to other devices.

When the user clicks "Unlinked", the user interface will jump to the linked TV setting interface as shown in Figure 21E. When entering this interface, the remote control will obtain a list of all bound devices under the current account through the interface server cloud. According to the device The two fields of device type information and device control type in the list filter the device list.

For example, as shown in Figure 22, in step S2203, all TV devices are first screened according to the device type, and then in step S2204, all TVs that support infrared control are screened out according to the device control type field, and finally all TVs that support infrared control are obtained Device List.

After the data is obtained, the interface will refresh and display all TV information in the filtered list, as shown in FIG. 21E , which may include living room TVs and bedroom TVs, for example.

In some embodiments, after the user selects the TV that needs to be associated, in step S2205 the first processor of the remote control will associate the current set-top box with the selected TV.

For example, in FIG. 21F , after the user clicks "living room TV", the first processor writes the ID information of the living room TV into the associatedDeviceId field of the set-top box device information, and at the same time updates the current set-top box ID information into the associatedDeviceId field of the living room TV.

As shown in Figure 22, after the device information of the set-top box and living room TV is updated in steps S2206-S2208, it will be synchronously updated to the linkage list of the local database of the remote control, and the new linkage list and equipment list will be uploaded to the cloud server for updating and saving.

After the TV association is successful, the user interface will be refreshed back to the set-top box operation interface, and the association information will be displayed on the top title, as shown in the remote control user interface in FIG. 20C .

It can be understood that when the third device needs to be associated with the first device, the first processor will obtain a device list corresponding to the user account from a server having a communication connection with the remote control, and the device list includes the devices bound to the user account. Device Information. The user selects and confirms the third device through the screened device list displayed in the remote control user interface; then the first processor writes the obtained third device information into the linkage list; then the first processor writes the third device ID into Enter the association field of the first device, write the first device ID into the association field of the third device, the mutual association between the first device and the third device has been completed; finally save the updated linkage list to the local remote control, And upload it to the server storage synchronously.

FIG. 21G shows a schematic diagram of a user interface for controlling multiple air conditioners by a remote controller according to another embodiment of the present application.

In some embodiments, the control device provided by this application can also be used for the linkage control of multiple air conditioners in the home. The user operates the remote control, and the first processor can associate the settings of the multiple air conditioners in the home; When operating any one air conditioner, other linked air conditioners will perform the same operation.

For example, first bind multiple air conditioners to the user account, and set specific names for each air conditioner, such as living room air conditioners, bedroom air conditioners, study room air conditioners, etc. If there are multiple bedroom air conditioners, different air conditioners can be set. Numbering.

In the user interface shown in Figure 21G, the user selects the devices to be associated, including the living room air conditioner, the bedroom air conditioner 2, and the study room air conditioner; then clicks the "OK" button, and the first processor will associate the above multiple devices, specifically The ID information of the associated device can be written into the associatedDeviceId field of the device information, and at the same time, the ID information of the currently bound device box can be updated into the associatedDeviceId field of the associated device. This information can also be saved in the cloud.

After the multi-device association is completed on the control device side, after the user clicks on any associated device, the user interface is shown in Figure 21H. After the user issues instructions such as cooling, wind direction, wind speed, and temperature adjustment to the control device, the first processing The controller will generate multiple corresponding control commands according to the current device and all associated devices, and each control command contains a control code that can control the corresponding air conditioner to realize the input command function, so as to realize the linkage between the control device and multiple devices control.

In some embodiments, when the user selects a certain control (for example, user adjustment mode), the first processor will respectively determine whether each device supports this instruction, and screen out devices that can support this instruction to carry device information and control instructions through the network. Go to the cloud platform, and send the control command to the specified device according to the device information, so that the user can control multiple devices on a single page.

Based on the above description of the embodiment of the simultaneous power on and off linkage control of multiple devices realized by the control device and the introduction of related drawings, the embodiment of the present application also provides a linkage control method for simultaneous power on and off of multiple devices, the method includes: controlling the second The device is associated with the first device, and when any device executes the issued operation, it will perform the operation synchronously with its associated device; receive the input command input by the user for controlling the power on/off of the first device, and based on The input command, the associated device determines a first control command, and a second control command, the first control command is used to control the power on/off of the first device, and the second control command is used to control the power on/off of the second device Shut down; send a first control command to the first device, and send a second control command to the second device, so as to control the second device to start/shut down synchronously with the first device. The method has been described in detail in the embodiment in which the control device realizes simultaneous power-on/off linkage control of multiple devices, and will not be repeated here.

In some embodiments, after receiving the input instruction input by the user, the method further includes: displaying a switch prompt about the second device, and the switch prompt is used to trigger the first The device ID determines the first control instruction corresponding to the first control code, and determines the second control instruction corresponding to the second control code according to the second device ID. The method has been described in detail in the embodiment in which the control device realizes simultaneous power-on/off linkage control of multiple devices, and will not be repeated here.

In some embodiments, the method further includes: when there is no second device associated with the first device, not displaying the switch prompt, and directly determining the first control command containing the corresponding first control code according to the first device ID , and send the first control instruction to the first device to control the first device to be turned on/off. The method has been described in detail in the embodiment in which the control device realizes simultaneous power-on/off linkage control of multiple devices, and will not be repeated here.

In some embodiments, determining the corresponding first control code according to the first device ID and determining the corresponding second control code according to the second device ID specifically includes: obtaining the first device in the linkage list based on the first device ID The ID of the second device ID associated with the first device ID and the first control code corresponding to the first device ID, the linkage list contains the information of all devices that have established an association relationship; according to the second device ID in the device list, determine the corresponding Second control code. The method has been described in detail in the embodiment in which the control device realizes simultaneous power-on/off linkage control of multiple devices, and will not be repeated here.

In some embodiments, before receiving an input command input by the user for controlling the power on/off of the first device, the method further includes: displaying an associated logo and the name of the second device around the name of the first device; displaying the first An on/off key corresponding to the device, the on/off key is used to receive a power-on/off operation input by a user. The method has been described in detail in the embodiment in which the control device realizes simultaneous power-on/off linkage control of multiple devices, and will not be repeated here.

In some embodiments, when the third device is associated with the first device, the method further includes: obtaining a device list corresponding to the user account from a server, the device list including device information bound to the user account; Write the third device information obtained based on the device list into the linkage list; write the third device ID into the associated field of the first device, and write the first device ID into the associated field of the third device; update The final linkage list is saved locally and uploaded to the server storage synchronously. The method has been described in detail in the embodiment in which the control device realizes simultaneous power-on/off linkage control of multiple devices, and will not be repeated here.

The beneficial effect of the embodiment of the present application is that by establishing device association, coordinated control of associated devices can be realized; further through the first control instruction and the second control instruction, it is possible to control different associated devices at the same time through one input instruction. Operate the on/off key under the operation interface of the remote control of any device, and the associated devices will be turned on or off at the same time, without the need for the user to switch the remote control interface for repeated operations.

The entire contents of each patent, patent application, patent application publication, and other material, such as article, book, specification, publication, document, etc., cited in this application are hereby incorporated by reference into this application. Application history documents that are inconsistent with or conflict with the content of this application are excluded, as are documents (currently or hereafter appended to this application) that limit the broadest scope of the claims of this application. It should be noted that if there is any inconsistency or conflict between the descriptions, definitions, and/or terms used in the attached materials of this application and the contents of this application, the descriptions, definitions and/or terms used in this application shall prevail .

Finally, it should be noted that: the above embodiments are only used to illustrate the embodiments of the application, rather than limit it; although the application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: It is still possible to modify the embodiments described in the foregoing embodiments, or perform equivalent replacements for some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding embodiments depart from the scope of the embodiments of the present application.

Claims

A control device comprising:

communication device;

Processor, configured as:

In response to the control instruction acting on the control device, broadcast a first signal through the communication device to send an action request to a plurality of household electrical appliances;

receiving at least one sound source signal through a communication interface, the sound source signal is sent by the household electrical appliance in response to the first signal, and the sound source signal includes at least the ID number of the household electrical appliance;

determining a target device in at least one corresponding household electrical appliance according to the at least one sound source signal;

and controlling the target device to execute an action corresponding to the control instruction.
The control device according to claim 1, wherein said determining the target device in the corresponding at least one household electrical appliance according to the at least one sound source signal comprises:

acquiring direction information of each of the sound source signals;

The target device is determined in the at least one household appliance according to the direction information of each of the sound source signals.
The control device according to claim 2, wherein, the direction information of each of the sound source signals is the angle between the sound source signal and the microphone array in the control device, and according to each of the sound source signals The direction information for determining the target device in the at least one household appliance includes:

According to the angle between each of the sound source signals and the microphone array, the target sound source signal is determined in the at least one sound source signal, wherein the angle between the target sound source signal and the microphone array is between within the preset range;

The target device is determined in the at least one household appliance according to the target sound source signal.
The control device of claim 3, wherein the processor is further configured to:

When there is no angle between the sound source signal and the microphone array within the preset range, playing voice prompt information, the voice prompt information is used to indicate that the target device does not exist in the at least one household electrical appliance. .
The control device according to claim 3, wherein said determining the target device in the at least one household electrical appliance according to the target sound source signal comprises:

Acquiring the frequency band where the target sound source signal is located, wherein the frequency bands where different sound source signals are located are different;

The target device is determined in the at least one household electrical device according to the corresponding relationship between the frequency bands of the sound source signals and the household appliances and the frequency band of the target sound source signal.
The control device according to any one of claims 2-5, wherein controlling the target device to execute an operation corresponding to the control instruction comprises:

Broadcasting a second signal according to the control instruction, where the second signal includes the device identifier of the target device, and the second signal is used to instruct the target device to perform an operation corresponding to the control instruction.
The control device according to any one of claims 1-5, wherein the sound source signal is an ultrasonic sound source signal, or an infrasonic sound source signal.
The control device of claim 1, wherein the processor is further configured to:

Establishing an association between the second device and the first device in response to the control instruction;

When the control instruction is an input instruction for controlling the power on/off of the first device, the first control instruction and the second control instruction are determined based on the associated device, and the first control instruction is used to control the power on/off of the first device. The shutdown and the second control instruction are used to control the startup/shutdown of the associated second device;

Sending the first control instruction to the first device and sending the second control instruction to the second device, so as to control the second device to start/shut down synchronously with the first device.
The control device according to claim 8, wherein, after the processor receives the input instruction input by the user, the processor is further configured to:

controlling the user interface to display a switch prompt about the second device, and the switch prompt is used to trigger the processor to determine the first control instruction containing the corresponding first control code according to the first device ID after receiving the user's confirmation operation , and determining the second control instruction including the corresponding second control code according to the second device ID.
The control device of claim 9, wherein the processor is further configured to:

When the first device does not have an associated second device, control the user interface not to display the switch prompt, directly determine the first control instruction containing the corresponding first control code according to the first device ID, and set the first The control command is sent to the first device to control the power on/off of the first device.
The control device according to claim 9, wherein the processor determines the corresponding first control code according to the first device ID, and determines the corresponding second control code according to the second device ID, specifically comprising the processor:

Based on the first device ID, obtain the second device ID associated with the first device ID and the first control code corresponding to the first device ID in the linkage list of the control device, the linkage list includes all the devices that have been associated information;

Determine the corresponding second control code in the device list according to the second device ID.
The control device of claim 8, wherein the processor is further configured to:

Before receiving the input command input by the user for controlling the power on/off of the first device, the user interface is controlled to display the associated logo and the name of the second device around the name of the first device; wherein the user interface displays the first device The corresponding on/off key is used to receive the power-on/off operation input by the user.
The control device of claim 11, wherein the processor is further configured to:

When the third device is associated with the first device, obtaining a device list corresponding to the user account from the server, the device list including device information bound to the user account;

writing the third device information obtained based on the device list into the linkage list;

Writing the third device ID into the associated field of the first device, and writing the first device ID into the associated field of the third device;

Save the updated linkage list to the local control device, and upload it to the server storage synchronously.
A household electrical appliance, including a communication device, a sounding device and a processor;

the processor, configured to:

receiving a first signal from the control device through the communication device, where the first signal is used to send an action request to the household electrical appliance;

In response to the first signal, sending a sound source signal to the control device through the sound generating device, the sound source signal at least including ID information of the household electrical appliance;

receiving a second signal by the communication means, the second signal including a device identification of the target device;

Determine whether to execute the action corresponding to the first signal according to the second signal.
The household electrical appliance according to claim 14, wherein the processor is further configured to:

If the device identifier included in the second signal is the device identifier of the household electrical appliance, execute the action corresponding to the first signal according to the second signal;

Otherwise, determine not to execute the action corresponding to the first signal.
The household electrical appliance according to claim 14 or 15, wherein the sound source signal is an ultrasonic sound source signal or an infrasonic sound source signal.
A control method applied to a control device, the control method comprising:

broadcasting a first signal in response to a control instruction acting on the control device, so as to send an action request to a plurality of household electrical appliances;

receiving at least one sound source signal, the sound source signal is sent by the household electrical appliance in response to the first signal, and the sound source signal includes at least the ID number of the household electrical appliance;

determining a target device in at least one corresponding household electrical appliance according to the at least one sound source signal;

and controlling the target device to execute an action corresponding to the control instruction.
The control method according to claim 17, wherein the method further comprises:

Establishing an association between the second device and the first device in response to the control instruction;

When the control instruction is an input instruction for controlling the power on/off of the first device, the first control instruction and the second control instruction are determined based on the input instruction and the associated device, and the first control instruction is used to control The first device is turned on/off, and the second control instruction is used to control the second device to be turned on/off;

Sending the first control instruction to the first device and sending the second control instruction to the second device, so as to control the second device to start/shut down synchronously with the first device.
A control method applied to home appliances, including:

sending a sound source signal to the control device in response to a first signal from the control device, the sound source signal including the ID number of the household electrical appliance;

receiving a second signal, where the second signal includes the device identifier of the target device;

Determine whether to execute the operation corresponding to the control instruction according to the second signal.