CN103631210B - Human-computer interaction method and system in smart home - Google Patents

Abstract

The invention provides a human-computer interaction method and system in an intelligent home. The method mainly includes: the signal acquisition device collects signal information in the smart home, and sends the signal information to the human-computer interaction controller, and the human-computer interaction controller calculates the signal information according to the set signal priority calculation method According to the priority value of the signal information, the sending order and the sending time interval between the signal information are determined, and the signal information is sent to the signal processing device according to the sending order and sending time interval, and a processing result is generated. The signal processing device converts the processing results into control instructions and sends them to each intelligent terminal. In the embodiment of the present invention, when multiple signals are processed, differential processing is performed on each signal according to different priority values of each signal, so as to increase the processing speed of signals with high priority and improve signal processing efficiency.

Description

Human-computer interaction method and system in smart home

technical field

The invention relates to the technical field of human-computer interaction, in particular to a method and system for human-computer interaction in a smart home.

Background technique

A smart home is a multi-functional network system that uses advanced technologies such as computers, network communications, and automatic control to integrate various application subsystems (such as TV systems, online entertainment systems, mobile phones, and PADs) related to home network life. Organic combination, centralized control through central control machine or home gateway. The introduction of human-computer interaction modules in smart homes has very innovative application value in the field of digital homes.

Human-computer interaction technology is in the stage of multi-channel and multimedia intelligent human-computer interaction. Many research results have been obtained, and many products have come out. E-books made with screens, 3D displays that are moving from movie theaters to living rooms, retinal imaging displays using red, green, and blue laser diodes, etc.

In the process of realizing the present invention, the inventor found that the existing human-computer interaction technology still has the following deficiencies: the human-computer interaction module has not been fully applied to the smart home, and has certain limitations; Signal processing is slow.

Contents of the invention

Embodiments of the present invention provide a method and system for human-computer interaction in a smart home, so as to efficiently process multiple signals in the smart home.

A method for human-computer interaction in a smart home, the method comprising:

Step 1, the signal acquisition device collects signal information in the smart home, and sends the signal information to the human-computer interaction controller;

Step 2. After receiving the signal information sent by the signal acquisition device, the human-computer interaction controller calculates the priority of the signal information according to the set signal priority calculation method;

Step 3, the human-computer interaction controller determines the sending order of the signal information and the sending time interval between the signal information according to the priority value of the signal information;

Step 4, sending the signal information to a signal processing device according to the sending order and sending time interval, and generating a processing result;

Step 5, the signal processing device converts the processing result into a control command and sends it to each smart terminal.

A human-computer interaction system in a smart home, comprising:

A signal collection device, used to collect signal information in the smart home, and send the signal information to the human-machine interaction controller;

The human-computer interaction controller includes a priority calculation module and a signal sending module, wherein the priority calculation module is used to calculate the priority of the signal information according to the set signal priority calculation method, and according to the set The priority value of the signal information determines the sending order of the signal information and the sending time interval between the signal information; the signal sending module is used to send the signal information respectively according to the sending order and sending time interval For signal processing devices in smart homes;

A signal processing device, configured to receive the signal information sent by the human-computer interaction controller, and process the signal information to form a processing result;

The instruction sending device is used to convert the processing result into a control instruction and send it to the smart terminal.

It can be seen from the technical solutions provided by the above-mentioned embodiments of the present invention that the embodiments of the present invention calculate the priority of signal information such as infrared signals, image signals, and voice signals through the human-computer interaction controller in the smart home. The priority value of the information determines the sending order and sending time interval of the signal information, and when multiple signal processing can be realized, each signal is processed differently according to the priority value of each signal, and the signal with high priority is improved The processing speed improves the signal processing efficiency.

Description of drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following will briefly introduce the accompanying drawings that need to be used in the description of the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present invention. For Those of ordinary skill in the art can also obtain other drawings based on these drawings without any creative effort.

FIG. 1 is a schematic diagram of the principle of a human-computer interaction method in a smart home provided by Embodiment 1 of the present invention;

FIG. 2 is a specific processing flowchart of a human-computer interaction method in a smart home provided by Embodiment 1 of the present invention;

FIG. 3 is a specific structural diagram of a human-computer interaction system in a smart home provided by Embodiment 2 of the present invention.

detailed description

In order to facilitate the understanding of the embodiments of the present invention, several specific embodiments will be taken as examples for further explanation below in conjunction with the accompanying drawings, and each embodiment does not constitute a limitation to the embodiments of the present invention.

Embodiment one

In the embodiment of the present invention, the signal acquisition device collects signal information in the smart home, and sends the signal information to the human-computer interaction controller. After the human-computer interaction controller receives the signal information sent by the signal acquisition device, it The signal priority calculation method calculates the priority of the signal information. Then, the human-computer interaction controller determines the sending order and the sending time interval between the signal information according to the priority value of the signal information, and sends the signal information to the signal processing device according to the sending order and sending time interval, and generate processing results. Afterwards, the signal processing device converts the processing results into control instructions and sends them to each smart terminal.

The above-mentioned signal information includes at least one of an infrared signal, an image signal, and a voice signal.

The principle schematic diagram of a human-computer interaction method in a smart home provided by this embodiment is shown in Figure 1, and the specific processing flow is shown in Figure 2, including the following processing steps:

Step 21. In the embodiment of the present invention, at least one infrared sensor, sound sensor and camera are installed in the smart home. The above infrared sensor collects infrared signals in the smart home, the above sound sensor collects voice signals in the smart home, and the above camera collects image signal.

In the embodiment of the present invention, a human-computer interaction controller is also set in the smart home. The human-computer interaction controller communicates with the above-mentioned infrared sensor, sound sensor and camera through a wireless communication network, and controls the above-mentioned infrared sensor, sound sensor and camera. and management.

Step 22. After the infrared sensor, the sound sensor and the camera device collect signals, different signals are encoded differently.

The infrared sensor encodes the collected infrared signal according to the infrared signal encoding method, and adds an infrared signal identification, such as NO.1. The camera encodes the collected image signal according to the image coding method, and adds the image signal identification, such as NO.2; the sound sensor encodes the collected voice signal according to the voice signal coding method, and adds the voice signal identification, such as NO. 3;

The infrared sensor sends the encoded infrared signal to the human-computer interaction controller, and the camera sends the encoded image signal to the human-computer interaction controller. The sound sensor sends the encoded voice signal to the human-computer interaction controller.

Step 23. After the human-computer interaction controller receives the above-mentioned signal information, it calculates the priority of the above-mentioned signal information according to the set signal priority calculation method. The calculation method of the priority Priority is as follows:

Priority＝ID*W1+Amount*W2+First_Time*W3+Last_Time*W4

The ID in the above formula represents the identification of signal information such as the above-mentioned infrared signal, image signal, and voice signal, and W1 indicates the weight corresponding to the identification of the above-mentioned signal information set in advance. For example, the priority of the image signal is 1, and the priority of the voice signal is 1. The priority of the infrared signal is 2, and the priority of the infrared signal is 3. The weight corresponding to the identifier of each signal can be adjusted according to the actual situation. If the image signal needs to be processed preferentially, the weight corresponding to the identifier of the image signal can be increased.

Amoun in the above formula represents the total amount of the above signal information, and W2 represents a preset weight corresponding to the total amount of the above signal information.

First_Time in the above formula represents the first collection time of the above signal information, and W3 represents a preset weight corresponding to the first collection time of the above signal information.

Last_Time in the above formula represents the last collection time of the above signal information, and W represents a preset weight corresponding to the last collection time of the above signal information.

Step 24, the human-computer interaction controller determines the sending sequence and time interval of the above-mentioned signal information according to the priority value of the above-mentioned signal information. The priority values of the signal information are sorted in descending order, and the sorting order is used as the sending order of the signal information.

The embodiment of the present invention sets three processors in the smart home: ARM (Advanced RlSC Machine, Advanced Reduced Instruction Set Machine) processor, DSP (Digital Signal Processing, digital signal processing) processor, CPU (Central Processing Unit, central processor) processor. The above-mentioned ARM processor is used for processing infrared signals, the DSP processor is used for processing image signals, and the above-mentioned CPU is used for processing voice signals.

After the human-computer interaction controller calculates the priorities of the infrared signals, image signals, and voice signals, the priorities of the infrared signals, image signals, and voice signals are sorted in descending order, and the sorting order As the transmission sequence of the above-mentioned infrared signal, image signal, and voice signal. For example, the order of sorting the priorities of the above-mentioned infrared signal, image signal, and voice signal in descending order is: infrared signal, image signal, and voice signal. The signal is sent to the above-mentioned ARM processor, and then the above-mentioned image signal is sent to the above-mentioned DSP processor, and finally the above-mentioned voice signal is sent to the above-mentioned CPU.

The above human-computer interaction controller obtains the sending time interval between the signal information according to the difference between the priority values of the signal information multiplied by the corresponding conversion coefficient. For example, the time interval between the above-mentioned human-computer interaction controller sending the above-mentioned infrared signal, image signal, and voice signal can be obtained by multiplying the difference between the priorities of the above-mentioned infrared signal, image signal, and voice signal by the corresponding conversion coefficient. For example, the priority values of the above-mentioned infrared signal, image signal, and voice signal are respectively Priority1, Priority2, and Priority3, and the time interval between the above-mentioned human-computer interaction controller sending the above-mentioned infrared signal and image signal can be: (Priority1-Priorit2 )×K, the time interval between sending the above-mentioned image signal and voice signal may be: (Priority2-Priority3)×K, the above-mentioned K is a set conversion coefficient.

Step 26. The human-computer interaction controller sends the signal information to the signal processing device according to the sending order and sending time interval, and generates a processing result. The signal processing device converts the processing results into control instructions and sends them to each intelligent terminal.

After the above-mentioned ARM processor receives the above-mentioned infrared signal, it first performs decoding processing according to the decoding method of the infrared signal, and then processes the signal and generates a processing result. After the above-mentioned DSP processor receives the above-mentioned image signal, it first performs decoding processing according to the decoding method of the image signal, and then processes the signal and generates a processing result. After the above-mentioned CPU receives the above-mentioned voice signal, it first performs decoding processing according to the decoding method of the voice signal, and then processes the signal and generates a processing result.

Then, the signal processing device converts the processing result into a control command and sends it to each smart terminal. For example, the above-mentioned ARM processor, DSP processor and CPU send control instructions to each intelligent terminal according to the processing results of the above-mentioned infrared signal, image signal and voice signal, instructing each intelligent terminal to perform corresponding operations, and the end user realizes intelligent control.

Embodiment two

This embodiment provides a human-computer interaction system in a smart home, its specific structure is shown in Figure 3, including:

The signal collection device 31 is used to collect signal information in the smart home, and send the signal information to the human-machine interaction controller, and the signal information includes at least one of an infrared signal, an image signal, and a voice signal.

The human-computer interaction controller 32 is configured to calculate the priority of the signal information according to the set signal priority calculation method after receiving the signal information sent by the signal acquisition device in the smart home, and calculate the priority of the signal information according to the signal information The priority value determines the sending order and sending time interval of the signal information, and sends the signal information to the signal processing device in the smart home according to the sending order and sending time interval;

The signal processing device 33 is configured to receive the signal information sent by the human-computer interaction controller, and process the signal information.

The instruction sending device 34 is configured to convert the processing result into a control instruction and send it to the smart terminal.

Specifically, the signal acquisition device 31 includes at least one infrared sensor, sound sensor and camera set in the smart home, the infrared sensor encodes the collected infrared signal according to the infrared signal encoding method, and adds an infrared signal identification, The encoded infrared signal is sent to the human-computer interaction controller; the camera encodes the collected image signal according to the image encoding method, and adds an image signal identifier, and sends the encoded image signal to the human-computer interaction controller The sound sensor encodes the collected voice signal according to the voice signal encoding method, adds a voice signal identifier, and sends the encoded voice signal to the human-computer interaction controller.

Specifically, the human-computer interaction controller 32 is also used to calculate the priority Priority of signal information such as the infrared signal, image signal, and voice signal as follows:

Priority＝ID*W1+Amount*W2+First_Time*W3+Last_Time*W4

The ID represents the identifier of the signal information, the W1 represents the preset weight corresponding to the identifier of the signal information, the Amoun represents the total amount of the signal information, and the W2 represents the preset weight of the signal information. The weight corresponding to the total amount of the signal information, the First_Time represents the first collection time of the signal information, W3 represents the preset weight corresponding to the first collection time of the signal information, and the Last_Time represents the The last acquisition time of the signal information, and the W represents a preset weight corresponding to the last acquisition time of the signal information.

The priority values of the signal information are sorted in descending order, and the sorting order is used as the sending order of the signal information.

The sending time interval between the signal information is obtained by multiplying the difference between the priority values of the signal information by the corresponding conversion coefficient. For example, according to the difference between the priority values of the infrared signal and the image signal multiplied by the corresponding conversion coefficient to obtain the sending time interval between the infrared signal and the image signal, according to the value of the image signal and the voice signal The difference between the priority values is multiplied by the corresponding conversion coefficient to obtain the sending time interval between the infrared signal and the voice signal.

Specifically, the signal processing device 33 includes:

The ARM processor is used for receiving the infrared signal sent by the human-computer interaction controller, first performing decoding processing according to the decoding method of the infrared signal, and then processing the signal;

DSP is used to process the signal after receiving the image signal, first performing decoding processing according to the decoding method of the image signal;

The CPU is configured to, after receiving the voice signal, perform decoding processing according to the decoding method of the voice signal, and then process the signal;

The ARM processor, DSP processor and CPU send control instructions to each smart terminal according to the processing results of the infrared signal, image signal and voice signal, instructing each smart terminal to perform corresponding operations.

Those skilled in the art can understand that the accompanying drawing is only a schematic diagram of an embodiment, and the modules or processes in the accompanying drawing are not necessarily necessary for implementing the present invention.

Those skilled in the art can understand that: the modules in the device in the embodiment may be distributed in the device in the embodiment according to the description in the embodiment, and may also be changed and located in one or more devices different from the embodiment. The modules in the above embodiments can be combined into one module, and can also be further split into multiple sub-modules.

The specific process of using the device of the embodiment of the present invention to perform human-computer interaction in a smart home is similar to the foregoing method embodiment, and will not be repeated here.

In summary, the embodiment of the present invention calculates the priority of infrared signals, image signals, and voice signals through the human-computer interaction controller in the smart home, and determines the priority according to the values of the infrared signals, image signals, and voice signals. The sending order and sending time interval of the infrared signal, the image signal, and the voice signal can realize that when multiple signals are processed, each signal is differentially processed according to the value of the priority of each signal, and the efficiency of the signal with high priority is improved. Processing speed, improve signal processing efficiency.

In the embodiment of the present invention, a human-computer interaction controller is added to the smart home, so that the signals collected by different signal collection devices (infrared sensors, sound sensors, and cameras) can be sent to different signal processing devices (ARM, DSP, CPU) for processing. Processing, multiple signals in the human-computer interaction system are combined and invoked to realize networked control.

The above is only a preferred embodiment of the present invention, but the scope of protection of the present invention is not limited thereto. Any person skilled in the art within the technical scope disclosed in the present invention can easily think of changes or Replacement should be covered within the protection scope of the present invention. Therefore, the protection scope of the present invention should be determined by the protection scope of the claims.

Claims (12)

1. A human-computer interaction method in an intelligent family, characterized in that the method comprises: Step 1, the signal acquisition device collects signal information in the smart home, and sends the signal information to the human-computer interaction controller; Step 2. After receiving the signal information sent by the signal acquisition device, the human-computer interaction controller calculates the priority of the signal information according to the set signal priority calculation method; Step 3, the human-computer interaction controller determines the sending order of the signal information and the sending time interval between the signal information according to the priority value of the signal information; Step 4, sending the signal information to a signal processing device according to the sending order and sending time interval, and generating a processing result; Step 5, the signal processing device converts the processing result into a control command and sends it to each smart terminal. 2. The human-computer interaction method in a smart home according to claim 1, wherein the signal information includes at least one of an infrared signal, an image signal, and a voice signal. 3. The human-computer interaction method in a smart home according to claim 1, characterized in that before step 1, it further comprises: setting at least one infrared sensor, sound sensor and camera in the smart home. 4. The human-computer interaction method in a smart home according to claim 1, wherein said step 1 includes at least one of the following steps: the infrared sensor encodes the collected infrared signal according to the infrared signal encoding method, and Add an infrared signal identification, and send the encoded infrared signal to the human-computer interaction controller; The camera encodes the collected image signal according to the image encoding method, and adds an image signal identifier, and sends the encoded image signal to the human-computer interaction controller; The sound sensor encodes the collected voice signal according to the voice signal encoding method, adds a voice signal identifier, and sends the encoded voice signal to the human-computer interaction controller. 5. The human-computer interaction method in a smart home according to claim 1 or 2 or 3 or 4, wherein said step 2 specifically includes: The calculation method of Priority of the signal information is as follows: Priority = ID*W1+Amount*W2+First_Time*W3+Last_Time*W4 The ID represents the identification of the signal information, the W1 represents the preset weight corresponding to the identification of the signal information, the Amoun represents the total amount of the signal information, and the W2 represents the preset weight of the signal information. The weight corresponding to the total amount of the signal information, the First_Tim represents the first collection time of the signal information, W3 represents the preset weight corresponding to the first collection time of the signal information, and the Last_Time represents the The last acquisition time of the signal information, and the W4 represents a preset weight corresponding to the last acquisition time of the signal information. 6. The human-computer interaction method in the smart home according to claim 3, wherein step 3 specifically comprises: The human-computer interaction controller sorts the priority values of the signal information in descending order, and uses the sorting order as the sending order of the signal information; The human-computer interaction controller obtains the sending time interval between the signal information according to the difference between the priority values of the signal information multiplied by the corresponding conversion coefficient. 7. The human-computer interaction method in a smart home according to claim 6, wherein said signal information includes an infrared signal, an image signal, and a voice signal; Step 4 includes: the human-computer interaction controller sends the signal information to the advanced reduced instruction set machine ARM processor, digital signal processor DSP and central Processor CPU; After the ARM processor receives the infrared signal, it first performs decoding processing according to the decoding method of the infrared signal, and then processes the signal to form a processing result; After the decoding process is performed by the decoding mode, the signal is processed to form a processing result; after the CPU receives the voice signal, it is decoded according to the voice signal decoding mode, and then the signal is processed to form a processing result. 8. A human-computer interaction system in a smart home, characterized in that it comprises: A signal collection device, used to collect signal information in the smart home, and send the signal information to the human-machine interaction controller; The human-computer interaction controller includes a priority calculation module and a signal sending module, wherein the priority calculation module is used to calculate the priority of the signal information according to the set signal priority calculation method, and according to the set The priority value of the signal information determines the sending order of the signal information and the sending time interval between the signal information; the signal sending module is used to send the signal information respectively according to the sending order and sending time interval For signal processing devices in smart homes; A signal processing device, configured to receive the signal information sent by the human-computer interaction controller, and process the signal information to form a processing result; The instruction sending device is used to convert the processing result into a control instruction and send it to the smart terminal. 9. The human-computer interaction system in a smart home according to claim 8, wherein the signal information includes at least one of an infrared signal, an image signal, and a voice signal. 10. The human-computer interaction system in the smart home according to claim 8, wherein the signal collection device includes at least one infrared sensor, sound sensor and camera set in the smart home, and the infrared sensor will collect The infrared signal is encoded according to the infrared signal encoding method, and the infrared signal identification is added, and the encoded infrared signal is sent to the human-computer interaction controller; the image signal collected by the camera is encoded according to the image encoding method, and the added Image signal identification, sending the encoded image signal to the human-computer interaction controller; the sound sensor encodes the collected voice signal according to the voice signal encoding method, and adds the voice signal identification, and sends the encoded voice signal to the human-computer interaction controller. 11. The human-computer interaction system in the smart home according to claim 8 or 9 or 10, characterized in that: The human-computer interaction controller is further configured to sort the priority values of the signal information in descending order, and use it as the sending order of the signal information; The sending time interval between the signal information is obtained by multiplying the difference between the priority values of the signal information by the corresponding conversion coefficient. 12. The human-computer interaction system in a smart home according to claim 11, wherein said signal information includes an infrared signal, an image signal, and a voice signal; Described signal processing device comprises: The ARM processor is used for receiving the infrared signal sent by the human-computer interaction controller, first performing decoding processing according to the decoding method of the infrared signal, and then processing the signal to form a processing result; The digital signal processor DSP is used for receiving the image signal, first performing decoding processing according to the decoding method of the image signal, and then processing the signal to form a processing result; The central processing unit CPU is configured to, after receiving the voice signal, perform decoding processing according to the decoding mode of the voice signal, and then process the signal to form a processing result.