WO2018023515A1

WO2018023515A1 - Gesture and emotion recognition home control system

Info

Publication number: WO2018023515A1
Application number: PCT/CN2016/093161
Authority: WO
Inventors: 易晓阳
Original assignee: 易晓阳
Priority date: 2016-08-04
Filing date: 2016-08-04
Publication date: 2018-02-08

Abstract

A gesture and emotion recognition home control system comprises a gesture recognition module (40), an emotion recognition determination module (30), an audio signal acquisition module (10), a video signal acquisition module (20), an integrated information processing module (50), a control module (60) and a wireless transceiver module (70), wherein the gesture recognition module (40) and the emotion recognition determination module (30) are electrically connected to the integrated information processing module (50); the audio signal acquisition module (10) is connected with the emotion recognition determination module (30); the video signal acquisition module (20) is connected with the gesture recognition module (40) and the emotion recognition determination module (30); the integrated information processing module (50) is connected with the wireless transceiver module (70) via the control module (60); and the integrated information processing module (50) integrally processes a gesture recognition result and an emotion recognition result to obtain integrated determination information, and controls each smart home device to perform a corresponding operation according to the integrated determination information. This invention provides a user with a variety of options, making the use of smart home more humane.

Description

Gesture and emotion recognition home control system

Technical field

The present invention relates to the field of smart home technology, and more particularly to a gesture and emotion recognition home control system.

Background technique

Smart home is the embodiment of materialization under the influence of the Internet. Smart Home connects various devices in the home through IoT technology, providing home appliance control, lighting control, telephone remote control, indoor and outdoor remote control, burglar alarm, environmental monitoring, HVAC control, infrared forwarding and programmable timing control. Functions and means. Compared with ordinary homes, smart homes not only have traditional living functions, but also combine construction, network communication, information appliances, equipment automation, and integrate efficient systems, structures, services and management into a highly efficient, comfortable, safe, convenient and environmentally friendly living environment. Provide a full range of information interaction functions to help families and the outside to maintain information exchange, optimize people's lifestyles, help people to effectively arrange time, enhance the safety of home life, and even save money for various energy costs.

With the increasing popularity of smart homes, a single identification control model can no longer meet people's needs.

Summary of the invention

The technical problem to be solved by the present invention is to provide a gesture and emotion recognition home control system for the above-mentioned drawbacks of the prior art.

The technical solution adopted by the present invention to solve the technical problem thereof is:

Constructing a gesture and emotion recognition home control system, comprising: a gesture recognition module, an emotion recognition judgment module, an audio signal acquisition module, a video signal acquisition module, an integrated information processing module, a control module, a wireless transceiver module; the gesture recognition module, The emotion recognition judging module is electrically connected to the integrated information processing module; the audio signal acquisition module is connected to the emotion recognition judging module; and the video signal acquisition module is connected to the gesture recognition module and the emotion recognition judging module; The integrated information processing module is electrically connected to the wireless transceiver module through the control module; the comprehensive information processing module is configured to comprehensively process the gesture recognition result and the emotion recognition result, and obtain comprehensive judgment information, and according to the The comprehensive judgment information controls each smart home device to perform corresponding operations.

The gesture and emotion recognition home control system of the present invention, wherein the integrated information processing module comprises:

The identification state determining unit is configured to determine a current recognition state according to the user setting input parameter, where the current recognition state includes: a first recognition state that is determined only according to the gesture recognition, a second recognition state that is only determined according to the emotion recognition, and a The third recognition state in which the gesture and emotion recognition are judged.

The gesture and emotion recognition home control system of the present invention, wherein the integrated information processing module further comprises:

The comprehensive judgment information generating unit is configured to output the comprehensive judgment information according to the preset judgment formula, using the gesture recognition result as the first parameter and the emotion recognition result as the second parameter when the current recognition state is the third recognition state.

The gesture and emotion recognition home control system of the present invention, wherein the emotion recognition determination module comprises:

a first emotion recognition unit, configured to perform voice tone emotion recognition on the voice information, and generate a first emotion recognition result;

a second emotion recognition unit, configured to convert the voice information into text information, and perform semantic emotion recognition on the text information to generate a second emotion recognition result;

The emotion recognition result output unit is configured to generate a user emotion recognition result according to the predetermined emotion recognition result determination method based on the first emotion recognition result and the second emotion recognition result.

The gesture and emotion recognition home control system of the present invention, wherein the gesture recognition module is connected with a gesture recognition enhancement glove.

The gesture and emotion recognition home control system of the present invention, wherein the gesture recognition enhancement glove has an infrared light source built therein, and the outer surface of the gesture recognition reinforcement glove is provided with a plurality of small holes to facilitate the emission of the infrared light source. The infrared light transmits to enhance the recognition of the gesture of the user by the gesture recognition module.

The gesture and emotion recognition home control system of the present invention, wherein the emotion recognition comprises a sinister emotion recognition and a swearing emotion recognition.

The third emotion recognition unit is configured to perform image recognition determination on the facial image information acquired by the video signal acquisition module to generate a third emotion recognition result.

The invention has the beneficial effects that the smart home control is adopted by adopting the recognition mode combining the emotion recognition and the gesture recognition mode, and the user is provided with various options, so that the use of the smart home is more humanized.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the present invention will be further described below in conjunction with the accompanying drawings and embodiments, and the drawings in the following description are only a part of the present invention. For example, those skilled in the art can obtain other drawings according to these drawings without any creative work:

1 is a block diagram showing the principle of a gesture and emotion recognition home control system in accordance with a preferred embodiment of the present invention.

detailed description

The present invention will be described in detail with reference to the embodiments of the present invention. Not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without any inventive effort are within the scope of the present invention.

The block diagram of the gesture and emotion recognition home control system of the preferred embodiment of the present invention is shown in FIG. 1 , which includes: a gesture recognition module, an emotion recognition judgment module, an audio signal acquisition module, a video signal acquisition module, an integrated information processing module, and a control module. Wireless transceiver module; gesture recognition module, emotion recognition judgment module and integrated information processing module; audio signal acquisition module and emotion recognition judgment module; video signal acquisition module and gesture recognition module and emotion recognition judgment module; integrated information processing The module is electrically connected to the wireless transceiver module through the control module; the integrated information processing module is configured to comprehensively process the gesture recognition result and the emotion recognition result, and obtain comprehensive judgment information, and control each smart home device to perform corresponding according to the comprehensive judgment information. operating. In this embodiment, smart home control is implemented by using a combination of emotion recognition and gesture recognition modes, and the user is provided with various options, so that the use of the smart home is more humanized.

In the above-mentioned gesture and emotion recognition home control system, the integrated information processing module includes: an identification state determining unit, configured to determine a current recognition state according to a user setting input parameter, wherein the current recognition state includes: first identification based on only gesture recognition State, judge only based on emotion recognition The second recognition state, the third recognition state that is judged based on the gesture and the emotion recognition.

In the above gesture and emotion recognition home control system, the integrated information processing module further includes: a comprehensive judgment information generating unit, configured to use the gesture recognition result as the first parameter and the emotion recognition result as the first recognition state when the current recognition state is the third recognition state The second parameter outputs comprehensive judgment information according to a preset judgment formula.

In the gesture and emotion recognition home control system, the emotion recognition determination module includes: a first emotion recognition unit configured to perform voice tone emotion recognition on the voice information to generate a first emotion recognition result; and a second emotion recognition unit configured to use the voice After the information is converted into the text information, the semantic emotion recognition is performed on the text information to generate a second emotion recognition result; the emotion recognition result output unit is configured to determine the method according to the predetermined emotion recognition result based on the first emotion recognition result and the second emotion recognition result. Generate user emotion recognition results.

In the above gesture and emotion recognition home control system, the gesture recognition module is connected with gesture recognition enhancement gloves. The gesture recognition enhancement glove has an infrared light source built therein, and the outer surface of the gesture recognition enhancement glove is provided with a plurality of small holes to facilitate the transmission of infrared light emitted by the infrared light source to enhance the recognition of the gesture of the gesture by the gesture recognition module.

In the above gesture and emotion recognition home control system, emotion recognition includes derogatory emotion recognition and derogatory emotion recognition. For example, a number of derogatory seed words and a number of derogatory seed words are selected to generate an sentiment dictionary; the word similarity between the words in the text information and the derogatory seed words and the derogatory seed words in the sentiment dictionary are respectively calculated; The semantic sentiment analysis method is set to generate the second emotion recognition result. Specifically, the word similarity between the word in the text information and the ambiguous seed word and the word similarity between the word in the text information and the swearing seed word may be respectively calculated according to a semantic similarity calculation method.

In the above embodiment, according to the word similarity, the generated by the preset semantic sentiment analysis method The specific method of the second emotion recognition result is: calculating the word sentiment tendency value by using the word sentiment tendency formula: when the word sentiment tendency value is greater than a predetermined threshold, determining that the word in the text information is a derogatory emotion; when the word sentiment tendency value is less than a predetermined When the threshold is reached, the words in the text information are judged as derogatory emotions.

In the gesture and emotion recognition home control system, the emotion recognition determination module includes: a third emotion recognition unit configured to perform image recognition judgment on the facial image information acquired by the video signal acquisition module to generate a third emotion recognition result.

It is to be understood that those skilled in the art will be able to make modifications and changes in accordance with the above description, and all such modifications and variations are intended to be included within the scope of the appended claims.

Claims

A gesture and emotion recognition home control system, comprising: a gesture recognition module, an emotion recognition judgment module, an audio signal acquisition module, a video signal acquisition module, an integrated information processing module, a control module, and a wireless transceiver module; The identification module and the emotion recognition determination module are electrically connected to the integrated information processing module; the audio signal collection module is connected to the emotion recognition determination module; the video signal acquisition module and the gesture recognition module and the emotion recognition determination The integrated information processing module is electrically connected to the wireless transceiver module through the control module; the integrated information processing module is configured to comprehensively process the gesture recognition result and the emotion recognition result, and obtain comprehensive judgment information. And controlling each smart home device to perform a corresponding operation according to the comprehensive judgment information.
The gesture and emotion recognition home control system according to claim 1, wherein the integrated information processing module comprises:

The identification state determining unit is configured to determine a current recognition state according to the user setting input parameter, where the current recognition state includes: a first recognition state that is determined only according to the gesture recognition, a second recognition state that is only determined according to the emotion recognition, and a The third recognition state in which the gesture and emotion recognition are judged.
The gesture and emotion recognition home control system according to claim 2, wherein the integrated information processing module further comprises:

The comprehensive judgment information generating unit is configured to output the comprehensive judgment information according to the preset judgment formula, using the gesture recognition result as the first parameter and the emotion recognition result as the second parameter when the current recognition state is the third recognition state.
The gesture and emotion recognition home control system according to claim 1, wherein The emotion recognition judgment module includes:

a first emotion recognition unit, configured to perform voice tone emotion recognition on the voice information, and generate a first emotion recognition result;

a second emotion recognition unit, configured to convert the voice information into text information, and perform semantic emotion recognition on the text information to generate a second emotion recognition result;

The emotion recognition result output unit is configured to generate a user emotion recognition result according to the predetermined emotion recognition result determination method based on the first emotion recognition result and the second emotion recognition result.
The gesture and emotion recognition home control system according to claim 1, wherein the gesture recognition module is connected with a gesture recognition enhancement glove.
The gesture and emotion recognition home control system according to claim 5, wherein the gesture recognition enhancement glove has an infrared light source built therein, and the outer surface of the gesture recognition reinforcement glove is provided with a plurality of small holes to facilitate the infrared The infrared light emitted by the light source transmits to enhance the recognition of the gesture of the user by the gesture recognition module.
The gesture and emotion recognition home control system according to claim 1, wherein the emotion recognition comprises derogatory emotion recognition and derogatory emotion recognition.
The gesture and emotion recognition home control system according to claim 1, wherein the emotion recognition determination module comprises:

The third emotion recognition unit is configured to perform image recognition determination on the facial image information acquired by the video signal acquisition module to generate a third emotion recognition result.