CN109754804A - A kind of sound control method, device, storage medium and smart home system - Google Patents

A kind of sound control method, device, storage medium and smart home system Download PDF

Info

Publication number
CN109754804A
CN109754804A CN201910130165.3A CN201910130165A CN109754804A CN 109754804 A CN109754804 A CN 109754804A CN 201910130165 A CN201910130165 A CN 201910130165A CN 109754804 A CN109754804 A CN 109754804A
Authority
CN
China
Prior art keywords
equipment
data
control
voice data
controlled
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910130165.3A
Other languages
Chinese (zh)
Inventor
李明杰
宋德超
贾巨涛
吴伟
张伟伟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Gree Electric Appliances Inc of Zhuhai
Original Assignee
Gree Electric Appliances Inc of Zhuhai
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Gree Electric Appliances Inc of Zhuhai filed Critical Gree Electric Appliances Inc of Zhuhai
Priority to CN201910130165.3A priority Critical patent/CN109754804A/en
Publication of CN109754804A publication Critical patent/CN109754804A/en
Priority to PCT/CN2019/109934 priority patent/WO2020168725A1/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00Programme-control systems
    • G05B19/02Programme-control systems electric
    • G05B19/418Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208Noise filtering
    • G10L21/0216Noise filtering characterised by the method used for estimating noise
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/02Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Quality & Reliability (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • General Engineering & Computer Science (AREA)
  • Manufacturing & Machinery (AREA)
  • General Physics & Mathematics (AREA)
  • Automation & Control Theory (AREA)
  • Selective Calling Equipment (AREA)

Abstract

The invention discloses a kind of sound control method, device, storage medium and smart home systems, this method comprises: obtaining voice data;According to the equipment knowledge mapping of the voice data and setting, the equipment control command that linkage control is carried out to more than one equipment in device systems to be controlled is determined;According to the equipment control command, more than one equipment teamwork in apparatus to be controlled system is controlled.The solution of the present invention, can solve voice control command can not carry out intelligent interlink control to household appliance all types of in smart home system, there are inconvenient problem with use, achieve the effect that promote property easy to use.

Description

A kind of sound control method, device, storage medium and smart home system
Technical field
The invention belongs to voice control technology fields, and in particular to a kind of sound control method, device, storage medium and intelligence Household appliance interconnection, control method, device, storage medium and the intelligence of energy house system more particularly to a kind of knowledge based map It can house system.
Background technique
As how the continuous development of smart home system carries out household appliance during system equipment control Accurately, efficiently, quickly interconnection and systematization linkage control become research hotspot.Using air-conditioning or other equipment as house system Control centre more equipment, multi-functional voice operating and intelligent interlink are realized by voice interactive system.
Traditional smart home technology formulates corresponding solution generally according to different user, to be adapted to different individuals Demand, these schemes can enable user by wireless communication or the mode of wire communication, and management is deployed in user's living environment In various smart machines, the effective life for simplifying user.But this seed type compares in terms of the intelligence of service user Shortcoming compares the direct single-point control dependent on user, and therefore, user control command can be accurately identified by how designing one kind, Understand that user is intended to and efficiently can meet user demand by amalgamation response user behavior, more intelligentized novel intelligence Energy house system is prior art urgent problem to be solved.
Above content is only used to facilitate the understanding of the technical scheme, and is not represented and is recognized that above content is existing skill Art.
Summary of the invention
It is an object of the present invention in view of the foregoing drawbacks, a kind of sound control method, device, storage medium and intelligence are provided Energy house system can not carry out intelligent connection to solve voice control command to household appliance all types of in smart home system Dynamic control achievees the effect that promote property easy to use there are inconvenient problem with use.
The present invention provides a kind of sound control method, comprising: obtains voice data;According to the voice data and setting Equipment knowledge mapping determines the equipment control command that linkage control is carried out to more than one equipment in device systems to be controlled;According to The equipment control command controls more than one equipment teamwork in apparatus to be controlled system.
Optionally, voice data is obtained, comprising: obtain the voice data collected by voice capture device;Wherein, institute State voice capture device, comprising: microphone array;And/or the voice data, it is for one in device systems to be controlled The above equipment carries out voice control so that the voice data that more than one equipment linkage responds;The voice data, comprising: language Sound wakes up at least one of word, phonetic order.
Optionally, it according to the equipment knowledge mapping of the voice data and setting, determines to one in device systems to be controlled The above equipment carries out the equipment control command of linkage control, comprising: determines semantic information according to the voice data;According to described Semantic information determines the usage scenario that user currently needs;According to the equipment knowledge mapping determine the usage scenario it is next with The equipment control command of upper equipment and its coordination and response relationship.
Optionally, wherein semantic information is determined according to the voice data, comprising: the voice data is carried out semantic Parsing, obtains the semantic information that the voice data is included;And/or the current needs of user are determined according to institute's semantic information Usage scenario, comprising: according to setting semantic information and set scene between corresponding relationship, determine in the corresponding relationship with The identical usage scenario for setting the corresponding set scene of semantic information and currently being needed as user of institute's semantic information;And/or root The equipment control command of the next above equipment of the usage scenario and its coordination and response relationship is determined according to the equipment knowledge mapping, It include: that the equipment is determined according to the coordination and response relationship under different scenes in the equipment knowledge mapping between distinct device More than one equipment corresponding with the usage scenario and the coordination and response relationship of more than one equipment room in knowledge mapping;It is based on The coordination and response of institute's semantic information and more than one corresponding equipment of the usage scenario and more than one equipment room closes System, generates the equipment control command of more than one equipment and its coordination and response relationship under the usage scenario.
Optionally, further includes: collect apparatus to be controlled system device data and to each equipment in device systems to be controlled into The control data of row control;According to the device data and the control data, determine in apparatus to be controlled system each equipment and its Between incidence relation;Based on the equipment entity and its between incidence relation, carry out knowledge mapping processing, obtain equipment Entity and its between coordination and response relationship, the equipment knowledge mapping as apparatus to be controlled system.
Optionally, according to the device data and the control data, determine in apparatus to be controlled system each equipment and its it Between incidence relation, comprising: the device data and the control data are pre-processed, current information is obtained;From described In current information, the incidence relation between apparatus to be controlled devices in system entity and different equipment entities is extracted, as In apparatus to be controlled system each equipment and its between incidence relation.
Optionally, wherein the device data, comprising: device name, device mac address, in IP address at least it One;And/or the control data, comprising: control command text and corresponding operation;And/or the pretreatment, comprising: At least one of missing values processing, standardization and noise reduction process;And/or the knowledge mappingization processing, comprising: know Know at least one of expression, knowledge fusion, knowledge reasoning processing.
Match with the above method, another aspect of the present invention provides a kind of phonetic controller, comprising: acquiring unit is used In acquisition voice data;Control unit, for the equipment knowledge mapping according to the voice data and setting, determination is set to be controlled More than one equipment carries out the equipment control command of linkage control in standby system;Described control unit is also used to set according to Standby control command, controls more than one equipment teamwork in apparatus to be controlled system.
Optionally, the acquiring unit obtains voice data, comprising: obtains the voice collected by voice capture device Data;Wherein, the voice capture device, comprising: microphone array;And/or the voice data, it is for being set to be controlled More than one equipment carries out voice control so that the voice data that more than one equipment linkage responds in standby system;The voice Data, comprising: voice wakes up at least one of word, phonetic order.
Optionally, described control unit is determined and is set to be controlled according to the equipment knowledge mapping of the voice data and setting More than one equipment carries out the equipment control command of linkage control in standby system, comprising: is determined according to the voice data semantic Information;The usage scenario that user currently needs is determined according to institute's semantic information;Determine that this makes according to the equipment knowledge mapping With the next above equipment of scene and its equipment control command of coordination and response relationship.
Optionally, wherein described control unit determines semantic information according to the voice data, comprising: to the voice Data carry out semantic parsing, obtain the semantic information that the voice data is included;And/or described control unit is according to Semantic information determines the usage scenario that user currently needs, comprising: according to corresponding between setting semantic information and set scene Relationship determines that the corresponding set scene of semantic information that sets identical with institute semantic information is worked as user in the corresponding relationship The usage scenario of preceding needs;And/or described control unit according to the equipment knowledge mapping determine the usage scenario it is next with The equipment control command of upper equipment and its coordination and response relationship, comprising: according under different scenes in the equipment knowledge mapping not With the coordination and response relationship between equipment, more than one equipment corresponding with the usage scenario in the equipment knowledge mapping is determined And the coordination and response relationship of more than one equipment room;Based on institute's semantic information and the usage scenario it is corresponding one with The coordination and response relationship of upper equipment and more than one equipment room generates more than one equipment and its linkage under the usage scenario The equipment control command of response relation.
Optionally, further includes: the acquiring unit is also used to collect the device data of apparatus to be controlled system and treats The control data that each equipment is controlled in control device systems;Described control unit is also used to according to the device data and institute State control data, determine each equipment in apparatus to be controlled system and its between incidence relation;Described control unit is also used to be based on The equipment entity and its between incidence relation, carry out knowledge mapping processing, obtain equipment entity and its between linkage Response relation, the equipment knowledge mapping as apparatus to be controlled system.
Optionally, described control unit determines in apparatus to be controlled system according to the device data and the control data Each equipment and its between incidence relation, comprising: the device data and the control data are pre-processed, obtained current Information;From in the current information, the pass between apparatus to be controlled devices in system entity and different equipment entities is extracted Connection relationship, as each equipment in apparatus to be controlled system and its between incidence relation.
Optionally, wherein the device data, comprising: device name, device mac address, in IP address at least it One;And/or the control data, comprising: control command text and corresponding operation;And/or the pretreatment, comprising: At least one of missing values processing, standardization and noise reduction process;And/or the knowledge mappingization processing, comprising: know Know at least one of expression, knowledge fusion, knowledge reasoning processing.
Match with above-mentioned apparatus, further aspect of the present invention provides a kind of smart home system, comprising: above-described language Sound control device.
Match with the above method, further aspect of the present invention provides a kind of storage medium, comprising: deposited in the storage medium Contain a plurality of instruction;The a plurality of instruction, for being loaded by processor and executing above-described sound control method.
Match with the above method, further aspect of the present invention provides a kind of smart home system, comprising: processor is used for Execute a plurality of instruction;Memory, for storing a plurality of instruction;Wherein, a plurality of instruction, for being stored by the memory, And it is loaded by the processor and executes above-described sound control method.
The solution of the present invention builds household appliance by the method for knowledge mapping and controls Information Atlas, can be to various languages Sound control command provides timely, accurate response, can promote the intelligence degree of smart home system, promotes what user used Convenience.
Further, the solution of the present invention, by building the household electrical appliances interacted system of knowledge based map, can provide interconnection, Intelligent knowledge services promote the convenience that user uses.
Further, the solution of the present invention makes equipment by the way that household appliance control knowledge mapping to be integrated into house system Different scenes are perceived, and after carrying out semantic analysis to voice control command, provides the response of corresponding joint and runs, can be promoted The intelligence degree of smart home system.
Further, the solution of the present invention carries out the linkage of equipment room by the relational graph of equipment rooms various in knowledge mapping Response, can satisfy the various control demand of user, user experience is good.
Further, the solution of the present invention, by utilizing household appliance related data structure on the basis of knowledge mapping technology Interconnection and control system are built, analyzes voice data in real time, timely and accurately provides the joint response of household appliance, the company of may be implemented It connects and the diversification of control mode, is able to ascend the household appliance even intelligence degree of smart home system, and promote user Experience.
The solution of the present invention as a result, controls Information Atlas by building household appliance, household appliance is controlled Information Atlas It is integrated into house system, makes device-aware different scenes, and after carrying out semantic analysis to voice control command, provide corresponding Joint respond operation, solve voice control command all types of household appliance in smart home system can not be carried out it is intelligent Linkage control, there are inconvenient problems with use, thus, overcome in the prior art that connection type is single, intelligence degree is low and Defect inconvenient to use realizes the high and easy to use beneficial effect of connection type multiplicity, intelligence degree.
Other features and advantages of the present invention will be illustrated in the following description, also, partly becomes from specification It obtains it is clear that understand through the implementation of the invention.
Below by drawings and examples, technical scheme of the present invention will be described in further detail.
Detailed description of the invention
Fig. 1 is the flow diagram of an embodiment of sound control method of the invention;
Fig. 2 is the equipment knowledge mapping in method of the invention according to the voice data and setting, and determination is set to be controlled More than one equipment carries out the flow diagram of an embodiment of the equipment control command of linkage control in standby system;
Fig. 3 be method of the invention according to the equipment knowledge mapping determine the next above equipment of the usage scenario and The flow diagram of one embodiment of the equipment control command of its coordination and response relationship;
Fig. 4 is the process signal for the embodiment of equipment knowledge mapping that apparatus to be controlled system is built in method of the invention Figure;
Fig. 5 is to be determined in apparatus to be controlled system in method of the invention according to the device data and the control data Each equipment and its between incidence relation an embodiment flow diagram;
Fig. 6 is the structural schematic diagram of an embodiment of phonetic controller of the invention;
Fig. 7 is the knot of the household appliance interconnection of the knowledge based map of an embodiment of air-conditioning of the invention, control system Structure schematic diagram;
Fig. 8 is the stream of the household appliance interconnection of the knowledge based map of an embodiment of air-conditioning of the invention, control algolithm Journey schematic diagram.
In conjunction with attached drawing, appended drawing reference is as follows in the embodiment of the present invention:
102- acquiring unit;104- control unit.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, below in conjunction with the specific embodiment of the invention and Technical solution of the present invention is clearly and completely described in corresponding attached drawing.Obviously, described embodiment is only the present invention one Section Example, instead of all the embodiments.Based on the embodiments of the present invention, those of ordinary skill in the art are not doing Every other embodiment obtained under the premise of creative work out, shall fall within the protection scope of the present invention.
According to an embodiment of the invention, providing a kind of sound control method, the one of method of the invention is real as shown in Figure 1 Apply the flow diagram of example.The sound control method may include: step S110 to step S130.
At step S110, voice data is obtained.Wherein, the voice data can be used for treating control equipment system Any appliance carries out the voice data of voice control in system (such as smart home system).The voice data may include that voice wakes up The voice messagings such as word, phonetic order.
Optionally, voice data is obtained in step S110, may include: the language for obtaining and being collected by voice capture device Sound data.
Specifically, the voice capture device may include: microphone array.
Voice data is acquired by microphone array as a result, acquisition mode is flexibly and collection result is accurate and reliable.
Specifically, the voice data can be used for carrying out voice control to more than one equipment in device systems to be controlled Make the voice data so that the response of more than one equipment linkage.The voice data may include: that voice wakes up word, voice At least one of instruction.
Such as: voice data may include: voice audio data.
As a result, by the voice data of diversified forms, the voice control under a variety of user demands, versatility may be implemented By force, flexibility is good.
At step S120, according to the equipment knowledge mapping of the voice data and setting, determine to device systems to be controlled In more than one equipment carry out linkage control equipment control command.
It is alternatively possible to as shown in connection with fig. 2 according to the equipment knowledge of the voice data and setting in method of the invention Map determines the embodiment process that the equipment control command of linkage control is carried out to more than one equipment in device systems to be controlled Schematic diagram, further illustrates the equipment knowledge mapping in step S120 according to the voice data and setting, and determination is set to be controlled More than one equipment carries out the detailed process of the equipment control command of linkage control in standby system, may include: step S210 extremely Step S230.
Step S210 determines semantic information according to the voice data.
More optionally, semantic information is determined according to the voice data in step S210, may include: to the voice number According to semantic parsing is carried out, the semantic information that the voice data is included is obtained.Wherein, the semantic information may include: semanteme Keyword.
Such as: semanteme parsing can be voice data being converted to text data.Semanteme parsing: voice data is converted At text data, and extract and identify equipment entity, control class entity.
As a result, by carrying out the semantic semantic information for parsing determining voice data to voice data, so as to voice data Semantic information determination it is accurate and reliable.
Step S220 determines the usage scenario that user currently needs according to institute's semantic information.
Such as: household appliance knowledge mapping: according to the semanteme of parsing, is searched and matched in knowledge mapping.
More optionally, the usage scenario that user currently needs is determined according to institute's semantic information in step S220, can wrap Include: according to setting semantic information and set scene between corresponding relationship, determine in the corresponding relationship with institute's semantic information The identical usage scenario for setting the corresponding set scene of semantic information and currently being needed as user.
As a result, by determining the semanteme of the voice data according to the corresponding relationship between setting semantic information and set scene The corresponding usage scenario of information, method of determination are easy and reliable.
Step S230 determines the next above equipment of the usage scenario and its coordination and response according to the equipment knowledge mapping The equipment control command of relationship.
Such as: household appliance control knowledge mapping is integrated into house system, makes device-aware different scenes, and to language After sound control command carries out semantic analysis, corresponding joint response operation is provided.
Usage scenario that user currently needs is determined by the semantic information based on voice data as a result, and then according to setting Standby knowledge mapping determines the equipment control command of the next above equipment of the usage scenario and its coordination and response relationship, so as to one The determination of the equipment control command of a above equipment linkage response is accurate and reliable.
More it is alternatively possible to determine the use according to the equipment knowledge mapping in method of the invention as shown in connection with fig. 3 One embodiment flow diagram of the equipment control command of the next above equipment of scene and its coordination and response relationship, furtherly The next above equipment of the usage scenario and its coordination and response relationship are determined according to the equipment knowledge mapping in bright step S230 Equipment control command detailed process, may include: step S310 and step S320.
Step S310, according to the coordination and response relationship under different scenes in the equipment knowledge mapping between distinct device, Determine the linkage of more than one equipment corresponding with the usage scenario and more than one equipment room in the equipment knowledge mapping Response relation.
Step S320, based on institute's semantic information and more than one corresponding equipment of the usage scenario and this with The coordination and response relationship of upper equipment room generates the equipment control of more than one equipment and its coordination and response relationship under the usage scenario System order.Such as: according to the coordination and response relationship under different scenes in the equipment knowledge mapping between distinct device, determine institute The coordination and response of more than one equipment corresponding with the usage scenario and more than one equipment room in equipment knowledge mapping is stated to close System, and generate the equipment control command of more than one equipment and its coordination and response relationship under the usage scenario.
It is to be controlled under the usage scenario by being determined according to the coordination and response relationship under different scenes between distinct device as a result, More than one equipment and its coordination and response relationship of system, and the semantic information of voice data is combined to determine under the usage scenario to this The equipment control command of more than one equipment and its coordination and response relationship, high reliablity, the convenience of control are good.
At step S130, according to the equipment control command, more than one equipment joint in apparatus to be controlled system is controlled Movement, to realize the linkage control to more than one equipment in device systems to be controlled.
Such as: equipment control command may include: the equipment control extracted from text data (such as semantic text data) Class order;Household appliance joint response: by equipment control command as shown in Figure 8, linkage control is carried out to multiple equipment.Again Such as: equipment control command: jointly controlling order until equipment.Equipment joint response: corresponding equipment carries out coordination and response.
Such as: provide the joint response of household appliance, comprising: by the relational graph of equipment rooms various in knowledge mapping, into The coordination and response of row equipment room.Household appliance, which is built, by the method for knowledge mapping controls Information Atlas, it can be to various voices Control command provides timely, accurate response, promotes the intelligence degree of smart home system, meets user demand, lifting body Test effect;Household appliance knowledge mapping can be the knowledge mapping as made of household appliance data aggregate.Pass through household appliance control Platform collecting voice data in real time processed, and semantic parsing in real time is carried out, realize corresponding equipment amalgamation, intelligent response; According to the speech intention of user, precise and high efficiency completes corresponding operation.
As a result, by the equipment knowledge mapping based on voice data and the apparatus to be controlled system of setting, determination is set to be controlled More than one equipment carries out the equipment control command of linkage control in standby system, and then to be controlled according to equipment control command control The linkage control to more than one equipment in device systems to be controlled, intelligence are realized in more than one equipment teamwork in device systems Degree height can be changed, the convenience that user uses is good.
It can also include: the process for building the equipment knowledge mapping of apparatus to be controlled system in an optional embodiment.
Below with reference to an embodiment of the equipment knowledge mapping for building apparatus to be controlled system in method of the invention shown in Fig. 4 Flow diagram further illustrates the detailed process for building the equipment knowledge mapping of apparatus to be controlled system, may include: step S410 to step S430.
Step S410 collects the device data of apparatus to be controlled system and controls to each equipment in device systems to be controlled The control data (historical data of such as control command) of system.
Wherein, the device data may include: at least one of device name, device mac address, IP address; And/or the control data, it may include: control command text and corresponding operation.Such as: household appliance data: equipment Title, device mac address, IP address;Control command historical data: control command text and corresponding operation.
As a result, by the device data of diversified forms, be conducive to promote the equipment knowledge mapping structure to device systems to be controlled The accuracy and reliability built.
Step S420, according to the device data and the control data, determine in apparatus to be controlled system each equipment and its Between incidence relation.
Such as: data are collected on household appliance interconnection platform, and establish database.Data are collected, may include: to pass through Equipment interconnection platform obtains the device data in smart home system.Wherein, the data of collection may include: household appliance data With control command historical data.Household appliance data: device name, device mac address, IP address;Control command historical data: Control command text and corresponding operation.The corresponding operation of control command text may include: the operational order to equipment. Such as: " opening air-conditioning " corresponding operational order is " airconditioner_control_on ".
It is alternatively possible to as shown in connection with fig. 5 according to the device data and the control data in method of the invention, really Determine each equipment in apparatus to be controlled system and its between incidence relation an embodiment flow diagram, further illustrate step According to the device data and the control data in S420, determine each equipment in apparatus to be controlled system and its between association close The detailed process of system may include: step S510 and step S520.
Step S510 pre-processes the device data and the control data, obtains current information.
Wherein, the pretreatment may include: at least one of missing values processing, standardization and noise reduction process.
Such as: collect the historical data of above-mentioned historical Device and control command.Data prediction: processing is carried out to data and is lacked The pretreatment such as mistake value, standardization, noise reduction.
As a result, by device data and control data diversified forms pretreatment, be conducive to lifting means data and Control the accuracy and reliability of data itself.
Step S520 extracts apparatus to be controlled devices in system entity and different equipment from the current information Incidence relation between entity, as each equipment in apparatus to be controlled system and its between incidence relation.
Such as: information extraction: entity and relationship are extracted from pretreated data.
Extract equipment entity again after being pre-processed as a result, by device data to device systems to be controlled and control data And its incidence relation, as each equipment in apparatus to be controlled system and its between incidence relation, the accuracy of processing is good, reliability It is high.
Step S430, based on the equipment entity and its between incidence relation, carry out knowledge mapping processing, set Standby entity and its between coordination and response relationship, the equipment knowledge mapping as apparatus to be controlled system.
Such as: the household electrical appliances interacted system by building knowledge based map: is automatically or semi-automatically obtained from house system The relevant knowledge data of equipment are taken, household appliance knowledge mapping is constructed, to provide interconnection, intelligent knowledge services.
Such as: using above-mentioned database by a series of technological means automatically or semi-automatically changed, the knowledge fact is extracted, And it is deposited into the data Layer and mode layer of knowledge base, build household appliance knowledge mapping.Database is established, may include: benefit Technology is built with chart database, household appliance data and corresponding control planning are combined into triplet deposit chart database. Wherein, knowledge base includes database, and database is storing data.Data Layer is made of a series of facts, mainly uses ternary Group expression is true;Mode layer is on data Layer, for managing data Layer.
As a result, by collecting the device data and control data of apparatus to be controlled system, and then it is based on the device data and control Data processed carry out knowledge mapping and handle to obtain the equipment knowledge mapping of apparatus to be controlled system, so as to build to be controlled set in advance The equipment knowledge mapping of standby system, to realize more than one equipment in the apparatus to be controlled system based on the equipment knowledge mapping Link voice control, greatly promotes the convenience and reliability that user uses.
Wherein, knowledge mappingization processing may include: the representation of knowledge, knowledge fusion, at least one in knowledge reasoning Kind processing.
Such as: the representation of knowledge: with attributed graph (chart database) Lai Jinhang representation of knowledge of entity and relationship.Knowledge fusion: The description information of entity and relationship is merged, determines equivalence attribute and equivalence relation.Knowledge reasoning: what reasoning implied knows Know, map of enriching one's knowledge, carries out knowledge cleaning, obtain household appliance knowledge mapping.
It is handled as a result, by the knowledge mappingization of diversified forms, is conducive to the accuracy for promoting gained equipment knowledge mapping And reliability.
Household electrical appliances are built by the method for knowledge mapping and are set using the technical solution of the present embodiment through a large amount of verification experimental verification Various voice control commands can be provided timely, accurate response, can promote smart home system by standby control Information Atlas Intelligence degree, promote the convenience that uses of user.
According to an embodiment of the invention, additionally providing a kind of phonetic controller corresponding to sound control method.Referring to The structural schematic diagram of one embodiment of the device of the invention shown in Fig. 6.The phonetic controller may include: acquiring unit 102 With control unit 104.
In an optional example, acquiring unit 102 can be used for obtaining voice data.Wherein, the voice data, can Can be used for carrying out any appliance in device systems to be controlled (such as smart home system) voice data of voice control.It should Voice data may include that voice wakes up the voice messagings such as word, phonetic order.The concrete function and processing ginseng of the acquiring unit 102 See step S110.
Optionally, the acquiring unit 102 obtains voice data, may include: the acquiring unit 102, specifically may be used also For obtaining the voice data collected by voice capture device.
Specifically, the voice capture device may include: microphone array.
Voice data is acquired by microphone array as a result, acquisition mode is flexibly and collection result is accurate and reliable.
Specifically, the voice data can be used for carrying out voice control to more than one equipment in device systems to be controlled Make the voice data so that the response of more than one equipment linkage.The voice data may include: that voice wakes up word, voice At least one of instruction.
Such as: voice data may include: voice audio data.
As a result, by the voice data of diversified forms, the voice control under a variety of user demands, versatility may be implemented By force, flexibility is good.
In an optional example, control unit 104 can be used for the equipment knowledge according to the voice data and setting Map determines the equipment control command that linkage control is carried out to more than one equipment in device systems to be controlled.The control unit 104 Concrete function and processing referring to step S120.
Optionally, described control unit 104 is determined according to the equipment knowledge mapping of the voice data and setting to be controlled More than one equipment carries out the equipment control command of linkage control in device systems, may include:
Described control unit 104 specifically can be also used for determining semantic information according to the voice data.The control unit 104 concrete function and processing see also step S210.
More optionally, described control unit 104 determines semantic information according to the voice data, may include: the control Unit 104 processed specifically can be also used for carrying out the voice data semantic parsing, obtain the language that the voice data is included Adopted information.Wherein, the semantic information may include: semantic key words.
Such as: semanteme parsing can be voice data being converted to text data.Semanteme parsing: voice data is converted At text data, and extract and identify equipment entity, control class entity.
As a result, by carrying out the semantic semantic information for parsing determining voice data to voice data, so as to voice data Semantic information determination it is accurate and reliable.
Described control unit 104 specifically can be also used for determining the use that user currently needs according to institute's semantic information Scene.The concrete function of the control unit 104 and processing see also step S220.
Such as: household appliance knowledge mapping: according to the semanteme of parsing, is searched and matched in knowledge mapping.
More optionally, described control unit 104 determines usage scenario that user currently needs according to institute's semantic information, can To include: described control unit 104, specifically can be also used for according to the corresponding pass between setting semantic information and set scene System determines that identical with institute semantic information in the corresponding relationship to set the corresponding set scene of semantic information current as user The usage scenario needed.
As a result, by determining the semanteme of the voice data according to the corresponding relationship between setting semantic information and set scene The corresponding usage scenario of information, method of determination are easy and reliable.
Described control unit 104 specifically can be also used for being determined one under the usage scenario according to the equipment knowledge mapping The equipment control command of a above equipment and its coordination and response relationship.The concrete function of the control unit 104 and processing are seen also Step S230.
Such as: household appliance control knowledge mapping is integrated into house system, makes device-aware different scenes, and to language After sound control command carries out semantic analysis, corresponding joint response operation is provided.
Usage scenario that user currently needs is determined by the semantic information based on voice data as a result, and then according to setting Standby knowledge mapping determines the equipment control command of the next above equipment of the usage scenario and its coordination and response relationship, so as to one The determination of the equipment control command of a above equipment linkage response is accurate and reliable.
More optionally, more than described control unit 104 determines that the usage scenario is next according to the equipment knowledge mapping The equipment control command of equipment and its coordination and response relationship may include:
Described control unit 104 specifically can be also used for being set according to difference under different scenes in the equipment knowledge mapping Coordination and response relationship between standby determines more than one equipment corresponding with the usage scenario in the equipment knowledge mapping and is somebody's turn to do The coordination and response relationship of more than one equipment room.The concrete function of the control unit 104 and processing see also step S310.
Described control unit 104 specifically can be also used for based on institute's semantic information and the usage scenario corresponding one The coordination and response relationship of a above equipment and more than one equipment room, generate under the usage scenario more than one equipment and its The equipment control command of coordination and response relationship.Such as: according under different scenes in the equipment knowledge mapping between distinct device Coordination and response relationship, determine in the equipment knowledge mapping more than one equipment corresponding with the usage scenario and this with The coordination and response relationship of upper equipment room, and generate the equipment of more than one equipment and its coordination and response relationship under the usage scenario Control command.The concrete function of the control unit 104 and processing see also step S320.
It is to be controlled under the usage scenario by being determined according to the coordination and response relationship under different scenes between distinct device as a result, More than one equipment and its coordination and response relationship of system, and the semantic information of voice data is combined to determine under the usage scenario to this The equipment control command of more than one equipment and its coordination and response relationship, high reliablity, the convenience of control are good.
In an optional example, described control unit 104 be can be also used for according to the equipment control command, control More than one equipment teamwork in apparatus to be controlled system, to realize the linkage control to more than one equipment in device systems to be controlled System.The concrete function of the control unit 104 and processing see also step S130.
Such as: equipment control command may include: the equipment control extracted from text data (such as semantic text data) Class order;Household appliance joint response: by equipment control command as shown in Figure 8, linkage control is carried out to multiple equipment.Again Such as: equipment control command: jointly controlling order until equipment.Equipment joint response: corresponding equipment carries out coordination and response.
Such as: provide the joint response of household appliance, comprising: by the relational graph of equipment rooms various in knowledge mapping, into The coordination and response of row equipment room.Household appliance, which is built, by the method for knowledge mapping controls Information Atlas, it can be to various voices Control command provides timely, accurate response, promotes the intelligence degree of smart home system, meets user demand, lifting body Test effect;Household appliance knowledge mapping can be the knowledge mapping as made of household appliance data aggregate.Pass through household appliance control Platform collecting voice data in real time processed, and semantic parsing in real time is carried out, realize corresponding equipment amalgamation, intelligent response; According to the speech intention of user, precise and high efficiency completes corresponding operation.
As a result, by the equipment knowledge mapping based on voice data and the apparatus to be controlled system of setting, determination is set to be controlled More than one equipment carries out the equipment control command of linkage control in standby system, and then to be controlled according to equipment control command control The linkage control to more than one equipment in device systems to be controlled, intelligence are realized in more than one equipment teamwork in device systems Degree height can be changed, the convenience that user uses is good.
It can also include: the process for building the equipment knowledge mapping of apparatus to be controlled system in an optional embodiment, Specifically it can be such that
The acquiring unit 102 can be also used for collecting the device data of apparatus to be controlled system and to apparatus to be controlled system The control data (historical data of such as control command) that each equipment is controlled in system.The concrete function of the acquiring unit 102 and Processing sees also step S410.
Wherein, the device data may include: at least one of device name, device mac address, IP address; And/or the control data, it may include: control command text and corresponding operation.Such as: household appliance data: equipment Title, device mac address, IP address;Control command historical data: control command text and corresponding operation.
As a result, by the device data of diversified forms, be conducive to promote the equipment knowledge mapping structure to device systems to be controlled The accuracy and reliability built.
Described control unit 104 can be also used for determining apparatus to be controlled according to the device data and the control data In system each equipment and its between incidence relation.The concrete function of the control unit 104 and processing see also step S420.
Such as: data are collected on household appliance interconnection platform, and establish database.Data are collected, may include: to pass through Equipment interconnection platform obtains the device data in smart home system.Wherein, the data of collection may include: household appliance data With control command historical data.Household appliance data: device name, device mac address, IP address;Control command historical data: Control command text and corresponding operation.The corresponding operation of control command text may include: the operational order to equipment. Such as: " opening air-conditioning " corresponding operational order is " airconditioner_control_on ".
Optionally, described control unit 104 determines apparatus to be controlled system according to the device data and the control data In each equipment and its between incidence relation, may include:
Described control unit 104 specifically can be also used for pre-processing the device data and the control data, Obtain current information.The concrete function of the control unit 104 and processing see also step S510.
Wherein, the pretreatment may include: at least one of missing values processing, standardization and noise reduction process.
Such as: collect the historical data of above-mentioned historical Device and control command.Data prediction: processing is carried out to data and is lacked The pretreatment such as mistake value, standardization, noise reduction.
As a result, by device data and control data diversified forms pretreatment, be conducive to lifting means data and Control the accuracy and reliability of data itself.
Described control unit 104 specifically can be also used for extracting and setting in apparatus to be controlled system from the current information Incidence relation between standby entity and different equipment entities, as each equipment in apparatus to be controlled system and its between pass Connection relationship.The concrete function of the control unit 104 and processing see also step S520.
Such as: information extraction: entity and relationship are extracted from pretreated data.
Extract equipment entity again after being pre-processed as a result, by device data to device systems to be controlled and control data And its incidence relation, as each equipment in apparatus to be controlled system and its between incidence relation, the accuracy of processing is good, reliability It is high.
Described control unit 104, can be also used for based on the equipment entity and its between incidence relation, carry out knowledge Mapization processing, obtain equipment entity and its between coordination and response relationship, the equipment knowledge mapping as apparatus to be controlled system. The concrete function of the control unit 104 and processing see also step S430.
Such as: the household electrical appliances interacted system by building knowledge based map: is automatically or semi-automatically obtained from house system The relevant knowledge data of equipment are taken, household appliance knowledge mapping is constructed, to provide interconnection, intelligent knowledge services.
Such as: using above-mentioned database by a series of technological means automatically or semi-automatically changed, the knowledge fact is extracted, And it is deposited into the data Layer and mode layer of knowledge base, build household appliance knowledge mapping.Database is established, may include: benefit Technology is built with chart database, household appliance data and corresponding control planning are combined into triplet deposit chart database. Wherein, knowledge base includes database, and database is storing data.Data Layer is made of a series of facts, mainly uses ternary Group expression is true;Mode layer is on data Layer, for managing data Layer.
As a result, by collecting the device data and control data of apparatus to be controlled system, and then it is based on the device data and control Data processed carry out knowledge mapping and handle to obtain the equipment knowledge mapping of apparatus to be controlled system, so as to build to be controlled set in advance The equipment knowledge mapping of standby system, to realize more than one equipment in the apparatus to be controlled system based on the equipment knowledge mapping Link voice control, greatly promotes the convenience and reliability that user uses.
Wherein, knowledge mappingization processing may include: the representation of knowledge, knowledge fusion, at least one in knowledge reasoning Kind processing.
Such as: the representation of knowledge: with attributed graph (chart database) Lai Jinhang representation of knowledge of entity and relationship.Knowledge fusion: The description information of entity and relationship is merged, determines equivalence attribute and equivalence relation.Knowledge reasoning: what reasoning implied knows Know, map of enriching one's knowledge, carries out knowledge cleaning, obtain household appliance knowledge mapping.
It is handled as a result, by the knowledge mappingization of diversified forms, is conducive to the accuracy for promoting gained equipment knowledge mapping And reliability.
The processing and function realized by the device of the present embodiment essentially correspond to earlier figures 1 to method shown in fig. 5 Embodiment, principle and example, therefore not detailed place in the description of the present embodiment may refer to mutually speaking on somebody's behalf in previous embodiment Bright, this will not be repeated here.
Through a large amount of verification experimental verification, using technical solution of the present invention, the household electrical appliances by building knowledge based map are interconnected System can provide interconnection, intelligent knowledge services, promote the convenience that user uses.
According to an embodiment of the invention, additionally providing a kind of smart home system corresponding to phonetic controller.The intelligence Energy house system may include: above-described phonetic controller.
With deep learning (deep learning is a kind of method based on to data progress representative learning in machine learning) skill Art makes it possible the various home equipments of intelligent voice control in the development of natural language processing field.Such as: knowledge mapping (Knowledge Graph, also known as mapping knowledge domains) is known as knowledge domain visualization in books and information group or ken reflects Map is penetrated, is a series of a variety of different figures of explicit knowledge's development process and structural relation, is known with visualization technique description Resource and its carrier, excavation, analysis, building, drafting and explicit knowledge and connecting each other between them are known, with its powerful language Adopted processing capacity and development organizations ability, can be by extensive, the heterogeneous household electrical appliances polynary, organizational structure is loose in house system Equipment carries out more educated tissue.It can be able to achieve using the technology and all types of, amalgamation control is carried out to the equipment in house system.
In an optional embodiment, the solution of the present invention, provide a kind of knowledge based map household appliance interconnection, Control method, various equipment, sensor, radio frequency identification in smart home system etc. may be constructed a kind of smart home device net Network, and be managed by a kind of intelligent management system (such as: intelligent gateway, cloud gateway etc.), intelligent Service is provided for user. To which in the smart home system based on voice control, can solve voice control command can not be to various types of household electrical appliances Equipment carries out meeting user demand, intelligent interlink control, and existing connection type is single, effect not smart enoughization, adds newly The problems such as equipment is difficult, centralization control difficulty is big.
As it can be seen that the interconnection of household appliance and systematization control problem are a technological difficulties, pass through the method for knowledge mapping Household appliance control Information Atlas is built, various voice control commands can be provided with timely, accurate response, promotes intelligent family The intelligence degree for occupying system meets user demand, promotes experience effect.
In an optional example, the solution of the present invention passes through the household electrical appliances interacted system for building knowledge based map: be from The relevant knowledge data of equipment are automatically or semi-automatically obtained in house system, construct household appliance knowledge mapping, interconnected with offer, Intelligent knowledge services.
Optionally, full automatic method does not need manual intervention or auxiliary, semi-automatic then on the contrary.
Optionally, relevant knowledge data may include: household appliance data: device name, device mac address, IP Location;Control command historical data: control command text and corresponding operation.
In an optional example, the solution of the present invention designs household appliance combination control method: household appliance is controlled Knowledge mapping is integrated into house system, makes device-aware different scenes, and after carrying out semantic analysis to voice control command, is given Corresponding joint response operation out.
Wherein, " different scenes " for making device-aware are primarily referred to as various household appliance compositions present in house system Scene.Such as: device-aware different scenes can refer to that there are which household appliance and the phases of equipment in identification house system Close information, such as title, type, function.After each household appliance networking, device network is formed, equipment networking scene is formed, from And realizing the solution of the present invention can perceive and rendering apparatus networked system scene.
In an optional specific embodiment, Fig. 7 and example shown in Fig. 8 may refer to, to the solution of the present invention Specific implementation process illustrates.
In an optional specific example, the solution of the present invention mainly includes: knowledge mapping, big data processing, edge meter The relevant technologies of calculation, cloud computing etc., are divided into three functional modules: household appliance interconnection platform, household appliance control platform.
The household appliance of knowledge based map shown in Fig. 7 interconnects, in control system, and household appliance data can wrap It includes: device name, device mac address, IP address etc.;Control command historical data may include: control command text and right The operation answered;Knowledge mapping builds technology, may refer to example shown in Fig. 8;Household appliance knowledge mapping, can be by household electrical appliances Knowledge mapping made of device data joint;Voice data may include: voice audio data;Semanteme parsing, can be language Sound data are converted to text data;Equipment control command may include: from extracting in text data (such as semantic text data) Equipment controls class order;Household appliance joint response: by equipment control command as shown in Figure 8, multiple equipment is joined Dynamic control.
Example shown in Figure 7, a kind of household appliance interconnection of knowledge based map provided by the invention, control method Realization principle, may include:
Step 11 collects data on household appliance interconnection platform, and establishes database.
Optionally, data are collected, may include: the number of devices obtained by equipment interconnection platform in smart home system According to.
Wherein, the data of collection may include: household appliance data and control command historical data.Household appliance data: Device name, device mac address, IP address;Control command historical data: control command text and corresponding operation.Control The corresponding operation of command text may include: the operational order to equipment.Such as: " opening air-conditioning " corresponding operational order is “airconditioner_control_on”。
Step 12 passes through a series of technological means automatically or semi-automatically changed, extraction knowledge thing using above-mentioned database It is real, and it is deposited into the data Layer and mode layer of knowledge base, build household appliance knowledge mapping.
Optionally, database is established, may include: to build technology using chart database, by household appliance data and correspondence Control planning be combined into triplet deposit chart database in.
Wherein, knowledge base includes database, and database is storing data.Data Layer is made of a series of facts, mainly It is to reach the fact with triple table;Mode layer is on data Layer, for managing data Layer.
Step 13 passes through household appliance control platform collecting voice data in real time, and carries out semantic parsing in real time, realization phase Corresponding equipment amalgamation, intelligent response.According to the speech intention of user, precise and high efficiency completes corresponding operation.
In an optional specific example, example shown in Figure 8, the solution of the present invention propose based on knowledge based The household electrical appliances interconnection of map, control algolithm process may include:
Step 21, knowledge mapping build technology, can specifically include:
Step 31, the historical data for collecting above-mentioned historical Device and control command.
Step 32, data prediction: the pretreatment such as processing missing values, standardization, noise reduction is carried out to data.
Such as: processing missing values are to be filled to the data item that may be lacked with population mean or other methods.Mark Standardization is to allow similarization of different data by data normalization or with measurementization, such as allows audio data and position data can be with Become same class data.
Step 33, information extraction: entity and relationship are extracted from above-mentioned data.
Step 34, the representation of knowledge: with attributed graph (chart database) Lai Jinhang representation of knowledge of entity and relationship.
Step 35, knowledge fusion: the description information of entity and relationship is merged, and determines equivalence attribute and pass of equal value System.
Step 36, knowledge reasoning: reasoning knowledge in secret, map of enriching one's knowledge carry out knowledge cleaning, obtain household appliance Knowledge mapping.
Step 22, real-time voice: real-time monitoring is carried out to the voice of air-conditioning.
Step 23, semantic parsing: being converted to text data for voice data, and extracts and identify equipment entity, control class Entity.
Step 24, household appliance knowledge mapping: it according to the semanteme of parsing, is searched and is matched in knowledge mapping.
Step 25, equipment control command: jointly control order until equipment.
Step 26, equipment joint response: corresponding equipment carries out coordination and response.
As it can be seen that in view of smart home system voice control other equipment during, need accurate, efficient, real-time Joint respond various voice control commands, need it is a kind of it is intelligent, efficient, accuracy is high, highly reliable household appliance Interconnection and control system.And voice control other equipment currently on the market, unification is carried out mainly in the form of matched Control, can not carry out the intelligent interlink of equipment, temporarily without a kind of high accuracy, reliable equipment combination control method.Institute With the solution of the present invention constructs interconnection using household appliance related data and control is on the basis of knowledge mapping technology System, analyzes voice data in real time, timely and accurately provides the joint response of household appliance, provides and meet user demand, intelligence Convergence voice control smart home system.
Wherein, the joint response of household appliance is provided, comprising: by the relational graph of equipment rooms various in knowledge mapping, into The coordination and response of row equipment room.Such as: it says " I returns ", after semanteme parsing, according to the device relationships in map, generation " is beaten Open a window curtain " instruction " windowcurtain_control_on ", " open air-conditioning " instruction " airconditioner_ The instruction " lamp_control_on " of control_on ", " opening electric light " etc. relevant device directive, form household equipment Amalgamation response.
The processing and function realized by the smart home system of the present embodiment essentially correspond to aforementioned dress shown in fig. 6 Embodiment, principle and the example set, therefore not detailed place in the description of the present embodiment, may refer to the correlation in previous embodiment Illustrate, this will not be repeated here.
Through a large amount of verification experimental verification, using technical solution of the present invention, by the way that household appliance control knowledge mapping is integrated Into house system, make device-aware different scenes, and after carrying out semantic analysis to voice control command, provides corresponding Response operation is closed, the intelligence degree of smart home system can be promoted.
According to an embodiment of the invention, additionally providing a kind of storage medium corresponding to sound control method.The storage is situated between Matter may include: that a plurality of instruction is stored in the storage medium;The a plurality of instruction, for being loaded by processor and being executed Above-described sound control method.
The processing and function realized by the storage medium of the present embodiment essentially correspond to earlier figures 1 to shown in fig. 5 Embodiment, principle and the example of method, therefore not detailed place in the description of the present embodiment, may refer to the phase in previous embodiment It speaks on somebody's behalf bright, this will not be repeated here.
The relationship of equipment rooms various in knowledge mapping is passed through using technical solution of the present invention through a large amount of verification experimental verification Figure, carries out the coordination and response of equipment room, can satisfy the various control demand of user, user experience is good.
According to an embodiment of the invention, additionally providing a kind of smart home system corresponding to sound control method.The intelligence Energy house system, may include: processor, for executing a plurality of instruction;Memory, for storing a plurality of instruction;Wherein, described A plurality of instruction for being stored by the memory, and is loaded by the processor and executes above-described sound control method.
The processing and function realized by the smart home system of the present embodiment essentially correspond to earlier figures 1 to Fig. 5 institute Embodiment, principle and the example for the method shown, therefore not detailed place in the description of the present embodiment, may refer in previous embodiment Related description, this will not be repeated here.
Through a large amount of verification experimental verification, using technical solution of the present invention, by utilizing on the basis of knowledge mapping technology Household appliance related data building interconnection and control system, analyze voice data in real time, timely and accurately provide household appliance Connection and the diversification of control mode may be implemented in joint response, is able to ascend the household appliance even intelligence of smart home system Degree can be changed, and promote user experience.
To sum up, it will be readily appreciated by those skilled in the art that under the premise of not conflicting, above-mentioned each advantageous manner can be certainly It combined, be superimposed by ground.
The above description is only an embodiment of the present invention, is not intended to restrict the invention, for those skilled in the art For member, the invention may be variously modified and varied.All within the spirits and principles of the present invention, it is made it is any modification, Equivalent replacement, improvement etc., should be included within scope of the presently claimed invention.

Claims (17)

1. a kind of sound control method characterized by comprising
Obtain voice data;
According to the equipment knowledge mapping of the voice data and setting, determination carries out more than one equipment in device systems to be controlled The equipment control command of linkage control;
According to the equipment control command, more than one equipment teamwork in apparatus to be controlled system is controlled.
2. the method according to claim 1, wherein obtaining voice data, comprising:
Obtain the voice data collected by voice capture device;
Wherein,
The voice capture device, comprising: microphone array;And/or
The voice data is for carrying out voice control so that more than one sets to more than one equipment in device systems to be controlled The voice data of standby coordination and response;The voice data, comprising: voice wakes up at least one of word, phonetic order.
3. method according to claim 1 or 2, which is characterized in that according to the equipment knowledge of the voice data and setting Map determines the equipment control command that linkage control is carried out to more than one equipment in device systems to be controlled, comprising:
Semantic information is determined according to the voice data;
The usage scenario that user currently needs is determined according to institute's semantic information;
The equipment control of the next above equipment of the usage scenario and its coordination and response relationship is determined according to the equipment knowledge mapping System order.
4. according to the method described in claim 3, it is characterized in that, wherein,
Semantic information is determined according to the voice data, comprising:
Semantic parsing is carried out to the voice data, obtains the semantic information that the voice data is included;
And/or
The usage scenario that user currently needs is determined according to institute's semantic information, comprising:
According to setting semantic information and set scene between corresponding relationship, determine in the corresponding relationship with institute's semantic information The identical usage scenario for setting the corresponding set scene of semantic information and currently being needed as user;
And/or
The equipment control of the next above equipment of the usage scenario and its coordination and response relationship is determined according to the equipment knowledge mapping System order, comprising:
According to the coordination and response relationship under different scenes in the equipment knowledge mapping between distinct device, determine that the equipment is known Know more than one equipment corresponding with the usage scenario and the coordination and response relationship of more than one equipment room in map;
Linkage based on institute's semantic information and more than one corresponding equipment of the usage scenario and more than one equipment room Response relation generates the equipment control command of more than one equipment and its coordination and response relationship under the usage scenario.
5. method described in one of -4 according to claim 1, which is characterized in that further include:
The control data collected the device data of apparatus to be controlled system and each equipment in device systems to be controlled is controlled;
According to the device data and the control data, determine each equipment in apparatus to be controlled system and its between association close System;
Based on the equipment entity and its between incidence relation, carry out knowledge mapping processing, obtain equipment entity and its it Between coordination and response relationship, the equipment knowledge mapping as apparatus to be controlled system.
6. according to the method described in claim 5, it is characterized in that, being determined according to the device data and the control data In apparatus to be controlled system each equipment and its between incidence relation, comprising:
The device data and the control data are pre-processed, current information is obtained;
From in the current information, the pass between apparatus to be controlled devices in system entity and different equipment entities is extracted Connection relationship, as each equipment in apparatus to be controlled system and its between incidence relation.
7. according to the method described in claim 6, it is characterized in that, wherein,
The device data, comprising: at least one of device name, device mac address, IP address;And/or
The control data, comprising: control command text and corresponding operation;
And/or
The pretreatment, comprising: at least one of missing values processing, standardization and noise reduction process;
And/or
The knowledge mappingization processing, comprising: at least one of the representation of knowledge, knowledge fusion, knowledge reasoning processing.
8. a kind of phonetic controller characterized by comprising
Acquiring unit, for obtaining voice data;
Control unit is determined for the equipment knowledge mapping according to the voice data and setting in device systems to be controlled one A above equipment carries out the equipment control command of linkage control;
Described control unit is also used to control more than one equipment connection in apparatus to be controlled system according to the equipment control command Conjunction movement.
9. device according to claim 8, which is characterized in that the acquiring unit obtains voice data, comprising:
Obtain the voice data collected by voice capture device;
Wherein,
The voice capture device, comprising: microphone array;And/or
The voice data is for carrying out voice control so that more than one sets to more than one equipment in device systems to be controlled The voice data of standby coordination and response;The voice data, comprising: voice wakes up at least one of word, phonetic order.
10. device according to claim 8 or claim 9, which is characterized in that described control unit is according to the voice data and sets Fixed equipment knowledge mapping determines the equipment control command that linkage control is carried out to more than one equipment in device systems to be controlled, Include:
Semantic information is determined according to the voice data;
The usage scenario that user currently needs is determined according to institute's semantic information;
The equipment control of the next above equipment of the usage scenario and its coordination and response relationship is determined according to the equipment knowledge mapping System order.
11. device according to claim 10, which is characterized in that wherein,
Described control unit determines semantic information according to the voice data, comprising:
Semantic parsing is carried out to the voice data, obtains the semantic information that the voice data is included;
And/or
Described control unit determines the usage scenario that user currently needs according to institute's semantic information, comprising:
According to setting semantic information and set scene between corresponding relationship, determine in the corresponding relationship with institute's semantic information The identical usage scenario for setting the corresponding set scene of semantic information and currently being needed as user;
And/or
Described control unit determines the next above equipment of the usage scenario and its coordination and response according to the equipment knowledge mapping The equipment control command of relationship, comprising:
According to the coordination and response relationship under different scenes in the equipment knowledge mapping between distinct device, determine that the equipment is known Know more than one equipment corresponding with the usage scenario and the coordination and response relationship of more than one equipment room in map;
Linkage based on institute's semantic information and more than one corresponding equipment of the usage scenario and more than one equipment room Response relation generates the equipment control command of more than one equipment and its coordination and response relationship under the usage scenario.
12. the device according to one of claim 8-11, which is characterized in that further include:
The acquiring unit is also used to collect the device data of apparatus to be controlled system and to each equipment in device systems to be controlled The control data controlled;
Described control unit is also used to determine and respectively set in apparatus to be controlled system according to the device data and the control data It is standby and its between incidence relation;
Described control unit, be also used to based on the equipment entity and its between incidence relation, carry out knowledge mapping processing, Obtain equipment entity and its between coordination and response relationship, the equipment knowledge mapping as apparatus to be controlled system.
13. device according to claim 12, which is characterized in that described control unit is according to the device data and described Control data, determine each equipment in apparatus to be controlled system and its between incidence relation, comprising:
The device data and the control data are pre-processed, current information is obtained;
From in the current information, the pass between apparatus to be controlled devices in system entity and different equipment entities is extracted Connection relationship, as each equipment in apparatus to be controlled system and its between incidence relation.
14. device according to claim 13, which is characterized in that wherein,
The device data, comprising: at least one of device name, device mac address, IP address;And/or
The control data, comprising: control command text and corresponding operation;
And/or
The pretreatment, comprising: at least one of missing values processing, standardization and noise reduction process;
And/or
The knowledge mappingization processing, comprising: at least one of the representation of knowledge, knowledge fusion, knowledge reasoning processing.
15. a kind of smart home system characterized by comprising the phonetic controller as described in claim 8-14 is any.
16. a kind of storage medium, which is characterized in that be stored with a plurality of instruction in the storage medium;The a plurality of instruction, is used for It is loaded by processor and executes sound control method as claimed in claim 1.
17. a kind of smart home system characterized by comprising
Processor, for executing a plurality of instruction;
Memory, for storing a plurality of instruction;
Wherein, a plurality of instruction for being stored by the memory, and is loaded by the processor and is executed such as claim Any sound control method of 1-7.
CN201910130165.3A 2019-02-21 2019-02-21 A kind of sound control method, device, storage medium and smart home system Pending CN109754804A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201910130165.3A CN109754804A (en) 2019-02-21 2019-02-21 A kind of sound control method, device, storage medium and smart home system
PCT/CN2019/109934 WO2020168725A1 (en) 2019-02-21 2019-10-08 Voice control method and apparatus, storage medium and smart home system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910130165.3A CN109754804A (en) 2019-02-21 2019-02-21 A kind of sound control method, device, storage medium and smart home system

Publications (1)

Publication Number Publication Date
CN109754804A true CN109754804A (en) 2019-05-14

Family

ID=66406761

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910130165.3A Pending CN109754804A (en) 2019-02-21 2019-02-21 A kind of sound control method, device, storage medium and smart home system

Country Status (2)

Country Link
CN (1) CN109754804A (en)
WO (1) WO2020168725A1 (en)

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110246496A (en) * 2019-07-01 2019-09-17 珠海格力电器股份有限公司 Audio recognition method, system, computer equipment and storage medium
CN110263183A (en) * 2019-06-20 2019-09-20 珠海格力电器股份有限公司 A kind of smart home DSS and decision support method
CN110286601A (en) * 2019-07-01 2019-09-27 珠海格力电器股份有限公司 Control the method, apparatus, control equipment and storage medium of smart home device
CN110286602A (en) * 2019-07-02 2019-09-27 珠海格力电器股份有限公司 The intelligent home furnishing control method of knowledge based map, control equipment and system
CN110333663A (en) * 2019-07-02 2019-10-15 珠海格力电器股份有限公司 The method, system and computer storage media of smart home administration authority are set
CN110361982A (en) * 2019-08-14 2019-10-22 珠海格力电器股份有限公司 A kind of home equipment control method, storage medium and smart home device
CN110457489A (en) * 2019-08-12 2019-11-15 珠海格力电器股份有限公司 Resource regulating method and system, computer readable storage medium
CN110570854A (en) * 2019-08-23 2019-12-13 珠海格力电器股份有限公司 intelligent voice output method and device
CN110579977A (en) * 2019-09-17 2019-12-17 珠海格力电器股份有限公司 control method and device of electrical equipment and computer readable storage medium
CN110618613A (en) * 2019-09-03 2019-12-27 珠海格力电器股份有限公司 Linkage control method and device for intelligent equipment
CN110719217A (en) * 2019-10-17 2020-01-21 杭州涂鸦信息技术有限公司 Control method and system based on affair map, readable storage medium and computer
CN110989370A (en) * 2019-11-06 2020-04-10 珠海格力电器股份有限公司 Intelligent household interaction control method and system
CN111261158A (en) * 2020-01-15 2020-06-09 上海思依暄机器人科技股份有限公司 Function menu customization method, voice shortcut control method and robot
CN111736476A (en) * 2020-05-28 2020-10-02 珠海格力电器股份有限公司 Linkage control device, building management system and linkage control method thereof
CN112164400A (en) * 2020-09-18 2021-01-01 广州小鹏汽车科技有限公司 Voice interaction method, server and computer-readable storage medium
CN112286062A (en) * 2020-09-23 2021-01-29 青岛经济技术开发区海尔热水器有限公司 Intelligent household appliance linkage control method and device, electronic equipment and storage medium
CN113111186A (en) * 2021-03-31 2021-07-13 青岛海尔科技有限公司 Method for controlling household appliance, storage medium and electronic device
CN113485144A (en) * 2021-07-27 2021-10-08 广州市威士丹利智能科技有限公司 Intelligent household control method and system based on Internet of things
CN113593565A (en) * 2021-09-29 2021-11-02 深圳大生活家科技有限公司 Intelligent home device management and control method and system
CN113674749A (en) * 2021-08-26 2021-11-19 珠海格力电器股份有限公司 Control method, control device, electronic equipment and storage medium
CN114035442A (en) * 2021-11-17 2022-02-11 珠海格力电器股份有限公司 Intelligent household appliance voice linkage system and use method
WO2022061925A1 (en) * 2020-09-28 2022-03-31 西门子股份公司 Method and apparatus for generating control chart of automatic control system, and computer readable medium
CN114898751A (en) * 2022-06-15 2022-08-12 中国电信股份有限公司 Automatic configuration method and system, storage medium and electronic equipment
WO2023000945A1 (en) * 2021-07-21 2023-01-26 青岛海信智慧生活科技股份有限公司 Device linkage scheme recommendation method, and device and medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104881013A (en) * 2015-05-29 2015-09-02 四川长虹电器股份有限公司 Intelligent household electrical appliance linkage control method based on user living habit mining
CN106713083A (en) * 2016-11-24 2017-05-24 海信集团有限公司 Intelligent home appliance control method and device based on knowledge map, and system
CN108107754A (en) * 2017-11-17 2018-06-01 新奥泛能网络科技股份有限公司 The control method and system of smart machine
CN108306797A (en) * 2018-01-30 2018-07-20 百度在线网络技术(北京)有限公司 Sound control intelligent household device, method, system, terminal and storage medium
CN108885608A (en) * 2016-06-09 2018-11-23 苹果公司 Intelligent automation assistant in home environment
CN108931924A (en) * 2018-08-06 2018-12-04 珠海格力电器股份有限公司 The control method and device of smart home system, processor, storage medium

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104881013A (en) * 2015-05-29 2015-09-02 四川长虹电器股份有限公司 Intelligent household electrical appliance linkage control method based on user living habit mining
CN108885608A (en) * 2016-06-09 2018-11-23 苹果公司 Intelligent automation assistant in home environment
CN106713083A (en) * 2016-11-24 2017-05-24 海信集团有限公司 Intelligent home appliance control method and device based on knowledge map, and system
CN108107754A (en) * 2017-11-17 2018-06-01 新奥泛能网络科技股份有限公司 The control method and system of smart machine
CN108306797A (en) * 2018-01-30 2018-07-20 百度在线网络技术(北京)有限公司 Sound control intelligent household device, method, system, terminal and storage medium
CN108931924A (en) * 2018-08-06 2018-12-04 珠海格力电器股份有限公司 The control method and device of smart home system, processor, storage medium

Cited By (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110263183A (en) * 2019-06-20 2019-09-20 珠海格力电器股份有限公司 A kind of smart home DSS and decision support method
WO2021000791A1 (en) * 2019-07-01 2021-01-07 珠海格力电器股份有限公司 Method and apparatus for controlling smart home appliance, control device and storage medium
CN110286601A (en) * 2019-07-01 2019-09-27 珠海格力电器股份有限公司 Control the method, apparatus, control equipment and storage medium of smart home device
CN110246496A (en) * 2019-07-01 2019-09-17 珠海格力电器股份有限公司 Audio recognition method, system, computer equipment and storage medium
CN110286602A (en) * 2019-07-02 2019-09-27 珠海格力电器股份有限公司 The intelligent home furnishing control method of knowledge based map, control equipment and system
CN110333663A (en) * 2019-07-02 2019-10-15 珠海格力电器股份有限公司 The method, system and computer storage media of smart home administration authority are set
CN110333663B (en) * 2019-07-02 2021-04-23 珠海格力电器股份有限公司 Method and system for setting intelligent household management authority and computer storage medium
CN110457489A (en) * 2019-08-12 2019-11-15 珠海格力电器股份有限公司 Resource regulating method and system, computer readable storage medium
WO2021027437A1 (en) * 2019-08-12 2021-02-18 珠海格力电器股份有限公司 Resource scheduling method and system, and computer-readable storage medium
CN110361982A (en) * 2019-08-14 2019-10-22 珠海格力电器股份有限公司 A kind of home equipment control method, storage medium and smart home device
CN110570854A (en) * 2019-08-23 2019-12-13 珠海格力电器股份有限公司 intelligent voice output method and device
CN110618613A (en) * 2019-09-03 2019-12-27 珠海格力电器股份有限公司 Linkage control method and device for intelligent equipment
CN110579977A (en) * 2019-09-17 2019-12-17 珠海格力电器股份有限公司 control method and device of electrical equipment and computer readable storage medium
WO2021051955A1 (en) * 2019-09-17 2021-03-25 珠海格力电器股份有限公司 Method and apparatus for controlling electrical appliance, and computer-readable storage medium
CN110719217A (en) * 2019-10-17 2020-01-21 杭州涂鸦信息技术有限公司 Control method and system based on affair map, readable storage medium and computer
CN110989370A (en) * 2019-11-06 2020-04-10 珠海格力电器股份有限公司 Intelligent household interaction control method and system
CN111261158A (en) * 2020-01-15 2020-06-09 上海思依暄机器人科技股份有限公司 Function menu customization method, voice shortcut control method and robot
CN111736476A (en) * 2020-05-28 2020-10-02 珠海格力电器股份有限公司 Linkage control device, building management system and linkage control method thereof
CN111736476B (en) * 2020-05-28 2021-07-27 珠海格力电器股份有限公司 Linkage control device, building management system and linkage control method thereof
CN112164400A (en) * 2020-09-18 2021-01-01 广州小鹏汽车科技有限公司 Voice interaction method, server and computer-readable storage medium
CN112286062A (en) * 2020-09-23 2021-01-29 青岛经济技术开发区海尔热水器有限公司 Intelligent household appliance linkage control method and device, electronic equipment and storage medium
WO2022061925A1 (en) * 2020-09-28 2022-03-31 西门子股份公司 Method and apparatus for generating control chart of automatic control system, and computer readable medium
CN113111186A (en) * 2021-03-31 2021-07-13 青岛海尔科技有限公司 Method for controlling household appliance, storage medium and electronic device
WO2023000945A1 (en) * 2021-07-21 2023-01-26 青岛海信智慧生活科技股份有限公司 Device linkage scheme recommendation method, and device and medium
CN113485144A (en) * 2021-07-27 2021-10-08 广州市威士丹利智能科技有限公司 Intelligent household control method and system based on Internet of things
CN113485144B (en) * 2021-07-27 2023-11-03 广州市威士丹利智能科技有限公司 Intelligent home control method and system based on Internet of things
CN113674749A (en) * 2021-08-26 2021-11-19 珠海格力电器股份有限公司 Control method, control device, electronic equipment and storage medium
CN113593565A (en) * 2021-09-29 2021-11-02 深圳大生活家科技有限公司 Intelligent home device management and control method and system
CN113593565B (en) * 2021-09-29 2021-12-17 深圳大生活家科技有限公司 Intelligent home device management and control method and system
CN114035442A (en) * 2021-11-17 2022-02-11 珠海格力电器股份有限公司 Intelligent household appliance voice linkage system and use method
CN114035442B (en) * 2021-11-17 2024-03-19 珠海格力电器股份有限公司 Intelligent household appliance voice linkage system and use method
CN114898751A (en) * 2022-06-15 2022-08-12 中国电信股份有限公司 Automatic configuration method and system, storage medium and electronic equipment
CN114898751B (en) * 2022-06-15 2024-04-23 中国电信股份有限公司 Automatic configuration method and system, storage medium and electronic equipment

Also Published As

Publication number Publication date
WO2020168725A1 (en) 2020-08-27

Similar Documents

Publication Publication Date Title
CN109754804A (en) A kind of sound control method, device, storage medium and smart home system
CN110198237A (en) A kind of wireless configuration method for being intended to driving network
CN104460328B (en) Smart machine control method and device based on set scene mode
CN107622767A (en) The sound control method and appliance control system of appliance system
CN108694266A (en) intelligent decoration design method and system based on machine learning
CN108121210A (en) Authority distributing method and device, storage medium, the processor of home appliance
CN110333703A (en) A kind of intelligent home control system and control method based on depth learning technology
CN108470568A (en) Smart machine control method and device, storage medium, electronic equipment
CN104318006B (en) A kind of optimization method of virtual terminals of intelligent substation design
CN108200111A (en) Resource allocation information update method, device and resource interface equipment
CN110379441A (en) A kind of voice service method and system based on countering type smart network
CN110442700A (en) Man-machine more wheel dialogue methods and system, smart machine for human-computer interaction
WO2021212907A1 (en) Voice control method and appparatus, computer device, and storage medium
CN109360579A (en) Charging pile phonetic controller and system
CN109448721A (en) Sound control method, system, Cloud Server and speech ciphering equipment
EP3979563A1 (en) Inter-domain data interaction method and apparatus
CN104778528A (en) Method and system for obtaining smart city evaluation indexes by utilizing big data
CN109709814A (en) The method, apparatus of dynamic construction conflict verification rule list in a kind of smart home
CN107911251A (en) A kind of method for configuring network equipment, device and medium
CN110457489A (en) Resource regulating method and system, computer readable storage medium
CN106251871A (en) A kind of Voice command music this locality playing device
CN108959356A (en) A kind of intelligence adapted TV university Data application system Data Mart method for building up
CN111724769A (en) Production method of intelligent household voice recognition model
CN114203176A (en) Control method and device of intelligent equipment, storage medium and electronic device
CN112418735A (en) Power grid AI scheduling system and method based on graph calculation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20190514