CN204462679U - Based on the Smart Home interaction systems of multi-mode man-machine interaction - Google Patents

Based on the Smart Home interaction systems of multi-mode man-machine interaction Download PDF

Info

Publication number
CN204462679U
CN204462679U CN201520118186.0U CN201520118186U CN204462679U CN 204462679 U CN204462679 U CN 204462679U CN 201520118186 U CN201520118186 U CN 201520118186U CN 204462679 U CN204462679 U CN 204462679U
Authority
CN
China
Prior art keywords
interaction
mode
lexicon
interactive
module
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201520118186.0U
Other languages
Chinese (zh)
Inventor
黄进财
尹海昌
王红梅
廖建飞
陈明芳
陈斗雪
李永祥
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhuhai Yiner Science & Technologies Inc
Guangdong Institute of Science and Technology
Original Assignee
Zhuhai Yiner Science & Technologies Inc
Guangdong Institute of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhuhai Yiner Science & Technologies Inc, Guangdong Institute of Science and Technology filed Critical Zhuhai Yiner Science & Technologies Inc
Priority to CN201520118186.0U priority Critical patent/CN204462679U/en
Application granted granted Critical
Publication of CN204462679U publication Critical patent/CN204462679U/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Landscapes

  • Machine Translation (AREA)
  • Document Processing Apparatus (AREA)

Abstract

The utility model discloses the Smart Home interaction systems based on multi-mode man-machine interaction, described interaction systems comprises multi-mode dialog box interactive engine, multi-mode man-machine interface, ad-hoc location lexicon, specific area lexicon, guides storehouse alternately.Described multi-mode man-machine interface connects multi-mode dialog box interactive engine.Described multi-mode dialog box interactive engine comprises enquiry module, interactive module, device command module, output module, described enquiry module connects multi-mode man-machine interface and ad-hoc location lexicon, specific area lexicon, and the interactive object of generation delivers to interactive module.Interactive object retrieves corresponding rules of interaction object after transferring to mutual guiding storehouse.Described device command module produces device command according to rules of interaction object, and described device command transfers to local device.The utility model is in conjunction with multi-mode man-machine interaction and intelligent domestic system, and user controls different home equipments and articles for use by various ways, user friendly life.

Description

Based on the Smart Home interaction systems of multi-mode man-machine interaction
Technical field
The Smart Home field that the utility model relates to, what be specifically related to is Smart Home interaction systems based on multi-mode man-machine interaction.
Background technology
Along with the development of internet and sensor technology, Smart Home becomes the inexorable trend of household field development from now on gradually.So-called Smart Home is connected together by the various equipment (as illuminator, curtain, air-conditioning system, safety-protection system etc.) in man by technology of Internet of things, provides several functions and the means such as Lighting control, indoor and outdoor remote control and programmable Timer control.One of them ingredient of Smart Home is exactly home automation, namely utilizes micro-process electronic technology, comes electronic and electrical equipment that is integrated or that control in family or system.But control Smart Home particularly home automation time the user interface that adopts still very complicated, be difficult to operation, need user adaptation intelligent domestic system itself.But in human-computer interaction interface, have certain development at present, available by Voice command intelligent domestic system, but system Chang Buneng distinguishes clear, and depend merely on the needs that voice can not meet active user.Multimodal interaction is a kind of human-computer interaction technology developed rapidly in recent years, the man-machine interaction mode of the multiple passage of a kind of practicality and compunication, cover subscriber's meter express one's ideas figure, perform an action or the various communication meanss of perceptible feedback information, as dynamic in speech, expression in the eyes, countenance, lip, gesture etc.Current, do not have intelligent domestic system to use this Multimodal interaction technology.
Utility model content
For the problems referred to above, the purpose of this utility model is to provide the Smart Home interaction systems based on multi-mode man-machine interaction, in conjunction with multi-mode man-machine interaction and intelligent domestic system, realizing user can utilize various ways to control the object of household, solve current intelligent domestic system input command mode single simultaneously, real intelligentized technical matters cannot be realized.
For solving the problems of the technologies described above, the technical solution adopted in the utility model is, based on the Smart Home interaction systems of multi-mode man-machine interaction, user carries out interaction by multiple input signal and described interaction systems, and described input signal comprises signal, the signal of text event detection, the signal of medical energy converter, the signal of optical sensor of phonetic entry.Described interaction systems also connects multiple local device.
Described interaction systems comprises multi-mode dialog box interactive engine, multi-mode man-machine interface, ad-hoc location lexicon, specific area lexicon, guides storehouse, equipment interface alternately.
Described multi-mode man-machine interface connects multi-mode dialog box interactive engine.The different input signal received is sent to multi-mode dialog box interactive engine by multi-mode man-machine interface.
Described multi-mode man-machine interface comprises user interface and sensor interface, and described user interface is smart mobile phone, hidden microphone, game machine, panel computer, the vehicles, computer, server or other forms of input equipment.The signal of user interface primary recipient phonetic entry and the signal of text event detection.Described sensor interface connects medical energy converter and optical sensor, the signal that reception medical energy converter and optical sensor transmit.The signal received is for further processing and is converted to the electronic signal being applicable to interaction systems by multi-mode man-machine interface, transfers to multi-mode dialog box interactive engine.
Described multi-mode dialog box interactive engine comprises enquiry module, interactive module, device command module, output module.Described enquiry module connects multi-mode man-machine interface and ad-hoc location lexicon, specific area lexicon, multi-mode dialog box interactive engine analyzes input signal, input signal is converted to interactive object according to the standardization vocabulary of ad-hoc location lexicon and specific area lexicon by enquiry module, interaction systems is made contents known and responds clearly.
Described interactive object is the numeral performance of input signal semanteme.The interactive object that enquiry module generates transfers to interactive module.Described interactive module connects guides storehouse alternately, goes out corresponding rules of interaction object after interactive object transfers to mutual guiding storehouse in mutual guiding library searching.
Device command module produces one or more device command according to rules of interaction object, and device command transfers to equipment interface, and equipment interface connects local device, the order of corresponding local device actuating equipment.Meanwhile, output module produces and exports response, is sent to corresponding local device.
As preferably, the standardization vocabulary of ad-hoc location lexicon can be used as the Indexing Mechanism in mutual guiding storehouse to store rules of interaction object.
As preferably, the corresponding a set of independent rules of interaction object of each home automation function, controls corresponding local device.
As preferably, ad-hoc location lexicon mainly contains the vocabulary about system, and specific area lexicon mainly contains vocabulary or the phrase of conventional specific area.
As preferably, described local device comprises the household articles such as electric equipment, electronic product.
The utility model is in conjunction with multi-mode man-machine interaction and intelligent domestic system, and user to intelligent domestic system, thus controls different home equipments and articles for use by various ways movement order, is very easy to the life of user.
Accompanying drawing explanation
Fig. 1 is the general introduction figure of the Smart Home interaction systems based on multi-mode man-machine interaction
Wherein: 110, interaction systems, 115, input signal, 116, phonetic entry, 117, text event detection, 118, medical energy converter, 119, optical sensor, 120, multi-mode man-machine interface, 125, user interface, 127, sensor interface, 130, multi-mode dialog box interactive engine, 133, enquiry module, 135, interactive object, 140, interactive module, 145, device command module, 147, output module, 150, device command, 160, ad-hoc location lexicon, 165, specific area lexicon, 170, mutual guiding storehouse, 175, rules of interaction object, 180, equipment interface, 185, local device.
Embodiment
Below in conjunction with specific embodiment, the utility model is described in further detail.
Based on the Smart Home interaction systems of multi-mode man-machine interaction, user carries out interaction by multiple input signal 115 with described interaction systems 110, and described input signal 115 comprises signal, the signal of text event detection 117, the signal of medical energy converter 118, the signal of optical sensor 119 of phonetic entry 116.Interaction systems 110 also connects multiple local device 185.
Described interaction systems 110 comprises multi-mode dialog box interactive engine 130, multi-mode man-machine interface 120, ad-hoc location lexicon 160, specific area lexicon 165, mutual guiding storehouse 170, equipment interface 180.
Described multi-mode man-machine interface 120 connects multi-mode dialog box interactive engine 130.After multi-mode man-machine interface 120 receives different input signals 115, be sent to multi-mode dialog box interactive engine 130.
Described multi-mode man-machine interface 120 comprises user interface 125 and sensor interface 127, and described user interface 125 is smart mobile phone, hidden microphone, game machine, panel computer, the vehicles, computer, server or other forms of input equipment.The signal of user interface 125 primary recipient phonetic entry 116 and the signal of text event detection 117.Described sensor interface 127 connects medical energy converter 118 and optical sensor 119, receives the signal that medical energy converter 118 transmits with optical sensor 119.The signal received is for further processing and is converted to the electronic signal being applicable to interaction systems 110 by multi-mode man-machine interface 120, and transfers to multi-mode dialog box interactive engine 130.
Described multi-mode dialog box interactive engine 130 comprises enquiry module 133, interactive module 140, device command module 145, output module 147.Described enquiry module 133 connects multi-mode man-machine interface 120 and ad-hoc location lexicon 160, specific area lexicon 165, multi-mode dialog box interactive engine 130 analyzes input signal 115, input signal 115 is converted to interactive object 135 according to ad-hoc location lexicon 160 and the standardization vocabulary of specific area lexicon 165 by enquiry module 133, interaction systems 110 pairs of contents known is made and responds clearly.
Described interactive object 135 is numeral performances of input signal 115 semanteme.The interactive object 135 that enquiry module 133 generates transfers to interactive module 140.Described interactive module 140 connects mutual guiding storehouse 170, retrieves corresponding rules of interaction object 175 after interactive object 135 transfers to mutual guiding storehouse 170 in mutual guiding storehouse 170.
Device command module 145 produces one or more device command 150 according to rules of interaction object 175, and device command 150 transfers to equipment interface 180, and equipment interface 180 connects local device 185, corresponding local device 185 actuating equipment order 150.Meanwhile, output module 147 produces and exports response, is sent to corresponding local device 185.
In concrete enforcement, the standardization vocabulary of ad-hoc location lexicon 160 can be used as the Indexing Mechanism in mutual guiding storehouse 170 to store rules of interaction object 175.
In concrete enforcement, the corresponding a set of independent rules of interaction object 175 of each home automation function, controls corresponding local device 185.
In concrete enforcement, ad-hoc location lexicon 160 mainly contains the vocabulary about system, and specific area lexicon 165 mainly contains vocabulary or the phrase of conventional specific area.
In concrete enforcement, described local device 185 comprises the household articles such as electric equipment, electronic product.

Claims (4)

1. based on the Smart Home interaction systems of multi-mode man-machine interaction, user carries out interaction by multiple input signal and described interaction systems, described input signal comprises voice input signal, text event detection signal, medical energy converter signal, optical sensor signals, described interaction systems also connects multiple local device, it is characterized in that, described interaction systems comprises multi-mode dialog box interactive engine, multi-mode man-machine interface, ad-hoc location lexicon, specific area lexicon, mutual guiding storehouse, equipment interface, described multi-mode man-machine interface connects multi-mode dialog box interactive engine, the varying input signal received is sent to multi-mode dialog box interactive engine by multi-mode man-machine interface, described multi-mode man-machine interface comprises the user interface of primary recipient voice input signal and text event detection signal and is connected the sensor interface of medical energy converter and optical sensor, described multi-mode dialog box interactive engine comprises enquiry module, interactive module, device command module, output module, described enquiry module connects multi-mode man-machine interface and ad-hoc location lexicon, specific area lexicon, multi-mode dialog box interactive engine analyzes input signal, and input signal is converted to interactive object according to the standardization vocabulary of ad-hoc location lexicon and specific area lexicon by enquiry module, the interactive object that enquiry module generates transfers to interactive module, and described interactive module connects guides storehouse alternately, goes out corresponding rules of interaction object after interactive object transfers to mutual guiding storehouse in mutual guiding library searching, described device command module produces one or more device command according to rules of interaction object, and described device command transfers to equipment interface, and described equipment interface connects local device, described output module produces and exports response, is sent to corresponding local device.
2. according to claim 1 based on the Smart Home interaction systems of multi-mode man-machine interaction, it is characterized in that, described user interface can be smart mobile phone, hidden microphone, game machine, panel computer, the vehicles, computer, server or other forms of input equipment.
3. according to claim 1 based on the Smart Home interaction systems of multi-mode man-machine interaction, it is characterized in that, the standardization vocabulary of ad-hoc location lexicon can be used as the Indexing Mechanism in mutual guiding storehouse to store rules of interaction object.
4. according to claim 1 based on the Smart Home interaction systems of multi-mode man-machine interaction, it is characterized in that, ad-hoc location lexicon mainly contains the vocabulary about system, and specific area lexicon mainly contains vocabulary or the phrase of conventional specific area.
CN201520118186.0U 2015-02-27 2015-02-27 Based on the Smart Home interaction systems of multi-mode man-machine interaction Expired - Fee Related CN204462679U (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201520118186.0U CN204462679U (en) 2015-02-27 2015-02-27 Based on the Smart Home interaction systems of multi-mode man-machine interaction

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201520118186.0U CN204462679U (en) 2015-02-27 2015-02-27 Based on the Smart Home interaction systems of multi-mode man-machine interaction

Publications (1)

Publication Number Publication Date
CN204462679U true CN204462679U (en) 2015-07-08

Family

ID=53669540

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201520118186.0U Expired - Fee Related CN204462679U (en) 2015-02-27 2015-02-27 Based on the Smart Home interaction systems of multi-mode man-machine interaction

Country Status (1)

Country Link
CN (1) CN204462679U (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109325153A (en) * 2018-08-30 2019-02-12 上海与德科技有限公司 Storing approaches to IM, electronic equipment and computer-readable deposit medium
CN115622829A (en) * 2022-11-22 2023-01-17 威海海洋职业学院 Smart home Internet of things interaction platform building method and system

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109325153A (en) * 2018-08-30 2019-02-12 上海与德科技有限公司 Storing approaches to IM, electronic equipment and computer-readable deposit medium
CN115622829A (en) * 2022-11-22 2023-01-17 威海海洋职业学院 Smart home Internet of things interaction platform building method and system

Similar Documents

Publication Publication Date Title
CN103730116B (en) Intelligent watch realizes the system and method that intelligent home device controls
CN203038075U (en) Android phone and computer based remote voice intelligent control system
CN206097455U (en) Speech recognition controlgear
EP2770445A2 (en) Method and system for supporting a translation-based communication service and terminal supporting the service
CN106847274B (en) Man-machine interaction method and device for intelligent robot
CN103744411A (en) Control method related to ZigBee technology for realizing smart home
CN110675873B (en) Data processing method, device and equipment of intelligent equipment and storage medium
CN106847291A (en) Speech recognition system and method that a kind of local and high in the clouds is combined
CN112735418B (en) Voice interaction processing method, device, terminal and storage medium
CN204462679U (en) Based on the Smart Home interaction systems of multi-mode man-machine interaction
CN205377906U (en) Intelligence house speech control host computer
CN109830232A (en) Man-machine interaction method, device and storage medium
CN205176507U (en) Smart home systems based on zigbee
CN104820651B (en) A kind of USB bridge, USB control system and method for smart home
CN106933122A (en) Train display intelligent interactive method and system
CN202661866U (en) Intelligent household interactive terminal
CN206039831U (en) Voice recognition function's start -up system and remote controller
CN204790512U (en) System of wisdom family
CN203366084U (en) Intelligent panel control system
WO2018023518A1 (en) Smart terminal for voice interaction and recognition
CN203502912U (en) Touch keyboard
CN105334972A (en) Mouse voice positioning and clicking apparatus
CN202059429U (en) Home intelligent terminal and home intelligent terminal network system
CN111048079A (en) Man-machine conversation method, system, electronic device and storage medium
CN202443569U (en) Internet access box with voice input and control and remote controller

Legal Events

Date Code Title Description
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20150708

Termination date: 20160227

CF01 Termination of patent right due to non-payment of annual fee