CN111884887A - Voice interaction method and device, storage medium and electronic device - Google Patents
Voice interaction method and device, storage medium and electronic device Download PDFInfo
- Publication number
- CN111884887A CN111884887A CN202010621931.9A CN202010621931A CN111884887A CN 111884887 A CN111884887 A CN 111884887A CN 202010621931 A CN202010621931 A CN 202010621931A CN 111884887 A CN111884887 A CN 111884887A
- Authority
- CN
- China
- Prior art keywords
- target
- function
- voice
- voice information
- equipment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
- H04L12/282—Controlling appliance services of a home automation network by calling their functionalities based on user interaction within the home
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/90—Details of database functions independent of the retrieved data types
- G06F16/903—Querying
- G06F16/90335—Query processing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N5/00—Computing arrangements using knowledge-based models
- G06N5/02—Knowledge representation; Symbolic representation
- G06N5/022—Knowledge engineering; Knowledge acquisition
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N5/00—Computing arrangements using knowledge-based models
- G06N5/02—Knowledge representation; Symbolic representation
- G06N5/027—Frames
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L2012/2847—Home automation networks characterised by the type of home appliance used
Abstract
The invention provides a voice interaction method and device, a storage medium and an electronic device, wherein the method comprises the following steps: acquiring voice information of a target object through target equipment, and determining a target function of the target equipment corresponding to the voice information according to the voice information; acquiring a device identifier of the target device; inquiring a pre-established knowledge base according to the device identifier of the target device and the target function to obtain an inquiry result, and controlling whether the target device carries out voice response on the voice information according to the inquiry result, wherein the knowledge base is used for storing a function set supported by the target device, and the inquiry result is used for indicating whether the function set comprises the target function. The invention solves the technical problem of low accuracy rate of voice response of the target equipment in the related technology.
Description
Technical Field
The present invention relates to the field of communications, and in particular, to a method and an apparatus for voice interaction, a storage medium, and an electronic apparatus.
Background
In the related art, the target device can be controlled through the voice instruction, the target device can work under the control of the voice instruction, and the target device with the voice interaction function can perform voice response. For example, the target object may control the target device to operate by emitting voice information. When the target device recognizes the intention of the target object according to the voice information, the characteristics of the target device are not utilized, so that the accuracy of recognizing the intention of the target object is low, the target device responds incorrectly, and the response accuracy is reduced.
Aiming at the technical problem that the voice response accuracy of the target equipment is low in the related technology, an effective technical scheme is not provided yet.
Disclosure of Invention
The embodiment of the invention provides a voice interaction method and device, a storage medium and an electronic device, which at least solve the technical problem of low voice response accuracy of target equipment in the related art.
According to an embodiment of the present invention, there is provided a method of voice interaction, including: acquiring voice information of a target object through target equipment, and determining a target function of the target equipment corresponding to the voice information according to the voice information; acquiring a device identifier of the target device; inquiring a pre-established knowledge base according to the device identifier of the target device and the target function to obtain an inquiry result, and controlling whether the target device carries out voice response on the voice information according to the inquiry result, wherein the knowledge base is used for storing a function set supported by the target device, and the inquiry result is used for indicating whether the function set comprises the target function.
Optionally, before the acquiring, by the target device, the voice information of the target object, the method further includes: establishing the knowledge base, wherein the knowledge base at least stores: the device identification of a specified device, the function set supported by the specified device, and a status code included in each function in the function set, the status code indicating a status of the specified device associated with the function, the specified device including the target device.
Optionally, the querying a pre-established knowledge base according to the device identifier of the target device and the target function to obtain a query result, and controlling whether the target device performs a voice response to the voice information according to the query result includes: inquiring the knowledge base according to the equipment identifier of the target equipment to obtain the function set corresponding to the equipment identifier of the target equipment; and controlling the target equipment not to perform voice response on the voice information under the condition that the query result is that the function set does not comprise the target function.
Optionally, the method further comprises: acquiring a state code corresponding to the target function in the knowledge base under the condition that the query result is that the function set comprises the target function; determining the current operation state of the target equipment and a state code corresponding to the current operation state in the state codes corresponding to the target function; and controlling whether the target equipment carries out voice response on the voice information or not according to the state code corresponding to the current running state.
Optionally, the controlling, according to the status code corresponding to the current operating status, whether the target device performs a voice response on the voice information includes: controlling the target equipment not to perform voice response on the voice information under the condition that the state code corresponding to the current running state belongs to a first type of state code; under the condition that the state code corresponding to the current running state belongs to a second type of state code, controlling the target equipment to perform voice response on the voice information; wherein, the state code corresponding to the target function includes: the first-class status code is used for indicating that the current operating state does not meet specified conditions, the second-class status code is used for indicating that the current operating state meets at least one condition of the specified conditions, and the specified conditions are used for indicating conditions required for enabling the target device to operate the target function correctly.
Optionally, the controlling, when the status code corresponding to the current operating status belongs to a second type of status code, the voice response of the target device to the voice information includes: when the current running state meets all conditions in the specified conditions, controlling the target equipment to send out a first voice response, wherein the first voice response is used for prompting the target equipment to start running the target function; and when the current running state meets part of conditions in the specified conditions, controlling the target equipment to send out a second voice response, wherein the second voice response is used for prompting the target object to send out an operation instruction to the target equipment so as to enable the target equipment to run the function correctly.
According to another embodiment of the present invention, there is provided an apparatus for voice interaction, including: the determining module is used for acquiring voice information of a target object through target equipment and determining a target function of the target equipment corresponding to the voice information according to the voice information; an obtaining module, configured to obtain a device identifier of the target device; and the control module is used for inquiring a pre-established knowledge base according to the equipment identifier of the target equipment and the target function to obtain an inquiry result, and controlling whether the target equipment performs voice response on the voice information according to the inquiry result, wherein the knowledge base is used for storing a function set supported by the target equipment, and the inquiry result is used for indicating whether the function set comprises the target function.
Optionally, the apparatus further comprises: an establishing module, configured to establish the knowledge base, where the knowledge base at least stores: the device identification of a specified device, the function set supported by the specified device, and a status code included in each function in the function set, the status code indicating a status of the specified device associated with the function, the specified device including the target device.
Alternatively, according to another embodiment of the present invention, a storage medium is provided, in which a computer program is stored, wherein the computer program is arranged to perform the above-mentioned method when executed.
Alternatively, according to another embodiment of the present invention, there is provided an electronic apparatus, including a memory in which a computer program is stored and a processor configured to execute the computer program to perform the above method.
According to the invention, the voice information of the target object is collected through the target equipment, and the target function of the target equipment corresponding to the voice information is determined according to the voice information; acquiring a device identifier of the target device; inquiring a pre-established knowledge base according to the device identifier of the target device and the target function to obtain an inquiry result, and controlling whether the target device carries out voice response on the voice information according to the inquiry result, wherein the knowledge base is used for storing a function set supported by the target device, and the inquiry result is used for indicating whether the function set comprises the target function. Therefore, the technical problem of low voice response accuracy of the target device in the related technology can be solved, the intention recognition accuracy of the target object is improved, the false response of the target device is avoided, the voice response accuracy of the target device is improved, and the user experience is optimized.
Drawings
The accompanying drawings, which are included to provide a further understanding of the invention and are incorporated in and constitute a part of this application, illustrate embodiment(s) of the invention and together with the description serve to explain the invention without limiting the invention. In the drawings:
FIG. 1 is a flow diagram of a method of voice interaction in accordance with an embodiment of the present invention;
FIG. 2 is a schematic diagram of an application scenario of a method of voice interaction according to another embodiment of the present invention;
FIG. 3 is a block diagram of an apparatus for voice interaction according to an embodiment of the present invention;
FIG. 4 is a block diagram of an apparatus for voice interaction according to another embodiment of the present invention;
FIG. 5 is a block diagram of an apparatus for voice interaction according to another embodiment of the present invention;
FIG. 6 is a block diagram of a voice interaction apparatus according to another embodiment of the present invention;
FIG. 7 is a block diagram of the structure of a voice interaction device according to another embodiment of the present invention;
FIG. 8 is a block diagram (IV) of the apparatus for voice interaction according to still another embodiment of the present invention;
FIG. 9 is a block diagram of the structure of a voice interaction device according to another embodiment of the present invention;
fig. 10 is a schematic structural diagram of an alternative electronic device according to an embodiment of the invention.
Detailed Description
The invention will be described in detail hereinafter with reference to the accompanying drawings in conjunction with embodiments. It should be noted that the embodiments and features of the embodiments in the present application may be combined with each other without conflict.
It should be noted that the terms "first," "second," and the like in the description and claims of the present invention and in the drawings described above are used for distinguishing between similar elements and not necessarily for describing a particular sequential or chronological order.
An embodiment of the present invention provides a voice interaction method, and fig. 1 is a flowchart of the voice interaction method according to the embodiment of the present invention, as shown in fig. 1, including:
step S102, voice information of a target object is collected through target equipment, and a target function of the target equipment corresponding to the voice information is determined according to the voice information;
step S104, acquiring the equipment identification of the target equipment;
step S106, querying a pre-established knowledge base according to the device identifier of the target device and the target function to obtain a query result, and controlling whether the target device performs voice response on the voice information according to the query result, wherein the knowledge base is used for storing a function set supported by the target device, and the query result is used for indicating whether the function set includes the target function.
According to the invention, the voice information of the target object is collected through the target equipment, and the target function of the target equipment corresponding to the voice information is determined according to the voice information; acquiring a device identifier of the target device; inquiring a pre-established knowledge base according to the device identifier of the target device and the target function to obtain an inquiry result, and controlling whether the target device carries out voice response on the voice information according to the inquiry result, wherein the knowledge base is used for storing a function set supported by the target device, and the inquiry result is used for indicating whether the function set comprises the target function. Therefore, the technical problem of low voice response accuracy of the target device in the related technology can be solved, the intention recognition accuracy of the target object is improved, the false response of the target device is avoided, the voice response accuracy of the target device is improved, and the user experience is optimized.
Based on the above embodiment, before the voice information of the target object is collected by the target device, the above embodiment may further perform the following technical solutions: establishing the knowledge base, wherein the knowledge base at least stores: the device identification of a specified device, the function set supported by the specified device, and a status code included in each function in the function set, the status code indicating a status of the specified device associated with the function, the specified device including the target device.
By pre-establishing a knowledge base, at least an equipment identifier of specified equipment, a function set supported by the specified equipment and a state code included by each function in the function set supported by the specified equipment are stored in the knowledge base, wherein the state code is used for indicating the state of the specified equipment associated with the function, so that the standard unified management of the function set and the state code of the specified equipment is realized, and a basis is provided for subsequently judging whether the target equipment performs voice response on voice information of a target object.
The specified object in the above embodiment includes a target object, that is, the device identifier of the target device, the set of functions supported by the target device, and a status code included in each function in the set of functions supported by the target device are stored in the knowledge base, where the status code is used to indicate a status of the target device associated with a function in the combination of functions supported by the target device.
The designated object can be equipment in the field of household appliances, namely household appliances, such as intelligent washing machines, intelligent air conditioners, intelligent refrigerators, sweeping robots and the like. When the target device is an intelligent washing machine, a device identifier of the intelligent washing machine, such as an ID, a device number, or a device model of the intelligent washing machine, may be stored in the knowledge base, and a function set supported by the intelligent washing machine may include a washing function and a drying function, where the washing function includes a status code corresponding to a status of the intelligent washing machine associated with the washing function. For example, the states of the intelligent washing machine associated with the washing function include normal washing, water shortage of the washing machine, overweight of clothes in the washing machine, and the like, and the knowledge base stores the state codes corresponding to the states of normal washing, water shortage of the washing machine, overweight of clothes in the washing machine, one to one.
The method of voice interaction in the above embodiment can be applied to the scenario shown in fig. 2. Fig. 2 is a schematic view of an application scenario of a voice interaction method according to another embodiment of the present invention, as shown in fig. 2, a plurality of home appliances, such as an intelligent washing machine, an intelligent air conditioner, an intelligent refrigerator, and a sweeping robot, exist in a designated area. The plurality of household appliances in the designated area can acquire the voice information sent by the target object.
In the above embodiment, the querying a pre-established knowledge base according to the device identifier of the target device and the target function to obtain a query result, and controlling whether the target device performs a voice response to the voice information according to the query result includes: inquiring the knowledge base according to the equipment identifier of the target equipment to obtain the function set corresponding to the equipment identifier of the target equipment; and controlling the target equipment not to perform voice response on the voice information under the condition that the query result is that the function set does not comprise the target function.
It should be noted that, for the voice information uttered by the target object, the voice information can be captured by the devices in the same designated area as the target object. For example, the other home appliances in the same room as the target object can acquire the voice information of the target object, that is, the number of the target objects acquiring the voice information may be plural. For example, after the target object sends the voice message, the intelligent washing machine, the intelligent air conditioner and the intelligent refrigerator all collect the voice message. At this time, the target device is required to determine the intention of the target object, i.e., whether the target object is intended to control the target device through the voice information.
Based on the above embodiment, when the query result obtained by the query indicates that the function set supported by the device does not include the target function, the target device is controlled not to perform voice response on the voice information. When the target device does not support the target function, the target device is controlled not to perform voice response on the target object, namely, the rejection judgment of the voice information of the target object by the target device is realized. For example, when the voice information of the target object is "good and not washed yet", the target function corresponding to the voice information is obtained by recognizing the voice information and is a washing function, the target object which acquires the voice information is an intelligent refrigerator, and the query result obtained by querying the knowledge base is that the function set supported by the intelligent refrigerator does not include the washing function, so that the intelligent refrigerator is controlled not to perform voice response on the voice information of the target object, and the target device is prevented from mistakenly responding to the voice information.
It should be noted that the foregoing embodiment is also used for implementing the following technical solutions: acquiring a state code corresponding to the target function in the knowledge base under the condition that the query result is that the function set comprises the target function; determining the current operation state of the target equipment and a state code corresponding to the current operation state in the state codes corresponding to the target function; and controlling whether the target equipment carries out voice response on the voice information or not according to the state code corresponding to the current running state.
In the above embodiment, when the query result indicates that the function set supported by the target device includes the target function, it needs to further determine whether the target device performs a voice response on the voice information according to the state code corresponding to the current operating state of the target device, so that the accuracy of identifying the intention of the target device on the target object can be further improved, a false response of the target object is avoided, and the accuracy of performing the voice response on the target object is improved.
Wherein the controlling whether the target device performs voice response on the voice information according to the status code corresponding to the current operating status includes: controlling the target equipment not to perform voice response on the voice information under the condition that the state code corresponding to the current running state belongs to a first type of state code; under the condition that the state code corresponding to the current running state belongs to a second type of state code, controlling the target equipment to perform voice response on the voice information; wherein, the state code corresponding to the target function includes: the first-class status code is used for indicating that the current operating state does not meet specified conditions, the second-class status code is used for indicating that the current operating state meets at least one condition of the specified conditions, and the specified conditions are used for indicating conditions required for enabling the target device to operate the target function correctly.
Based on the embodiment, whether the target device performs voice response on the voice information of the target object is determined according to the type of the state code to which the state code corresponding to the current operating state of the target device belongs, so that the purpose of accurately identifying the target object in combination with the operating characteristics of the target device is realized, and the accuracy of performing voice response on the target object is improved.
As an example, in the above embodiment, when the target device is an intelligent washing machine and the target function is a washing function, the execution condition may include a condition that a door of the washing machine is closed, the laundry detergent has been added, the laundry to be washed has been placed in the washing machine, a washing mode has been determined, and the like. When the query result obtained by querying the knowledge base is that the target device supports the target function, it is further required to determine whether to respond to the voice of the target object according to the type of the status code to which the status code corresponding to the current operating status of the target device belongs. And under the condition that the state code corresponding to the current operation state belongs to a first type of state code, controlling the target equipment not to perform voice response on the voice information, wherein the first type of state code is used for indicating that the current operation state does not meet the specified conditions, namely controlling the target equipment not to perform voice response on the voice information when the current operation state of the target equipment does not meet any one of the specified conditions. For example, when a target object (e.g., a user) goes home: when the clothes are thoroughly wetted due to the fact that the clothes are really hot today, the current running state of the intelligent washing machine does not meet any one of the specified conditions, and the intelligent washing machine does not respond at the moment. For another example, the user continues to say: "the laundry is washed", at this time, the current operation state of the intelligent washing machine does not satisfy any one of the specified conditions as well, and thus the intelligent washing machine does not respond. And when the user opens the intelligent washing machine door, put dirty clothes into the washing machine, say: the intelligent washing machine is used for washing clothes, although the voice information sent by the user at the moment is the same as the voice information sent at the previous moment, namely the voice information sent by the user at the moment is the same as the voice information sent at the moment earlier than the current moment, the current operation state of the intelligent washing machine is changed, namely the intelligent washing machine is changed into the state that the door cover of the washing machine is closed, clothes to be washed are placed in the washing machine, two conditions in the specified conditions are met, the intention of the user for sending the voice information is determined to enable the target equipment to operate the target function, and the target equipment is controlled to perform voice response on the voice information of the target object at the moment.
Based on the above embodiment, in the case that the status code corresponding to the current operating status belongs to the second type of status code, controlling the target device to perform voice response on the voice information includes: when the current running state meets all conditions in the specified conditions, controlling the target equipment to send out a first voice response, wherein the first voice response is used for prompting the target equipment to start running the target function; and when the current running state meets part of conditions in the specified conditions, controlling the target equipment to send out a second voice response, wherein the second voice response is used for prompting the target object to send out an operation instruction to the target equipment so as to enable the target equipment to run the function correctly.
In the above embodiment, when the status code corresponding to the current operating status belongs to the second type of status code, the voice response sent by the target device is further determined according to the condition that the current operating status satisfies the specified condition, so that the accuracy of voice interaction with the target device is improved. For example, when the current operating state meets all the conditions in the specified conditions, controlling a first voice response sent by the target device to be 'starting an intelligent washing mode and entering a washing program'; and when the current running state meets part of the specified conditions, controlling a second voice response sent by the target device to be 'ready for you, please select a washing mode'. Therefore, targeted voice response is carried out on the target equipment according to the specific running state of the target equipment, and the user experience is improved.
It should be noted that, the above embodiment may implement the following technical solutions: and extracting the fundamental frequency characteristics of the voice information to obtain a fundamental frequency curve of the voice signal, and controlling the target equipment not to perform voice response on the voice information under the condition that an interruption point exists in the fundamental frequency curve. And controlling the target equipment not to perform voice response on the voice information under the condition that the voice information comprises the voice information sent by at least two target objects.
In the above embodiment, when there is an interruption point in the fundamental frequency curve, it is described that the voice information sent by the target object is interrupted, so that the target device is controlled not to perform voice response on the voice information, so that the target object may preferentially perform other things, and the target device is prevented from disturbing the target object. And under the condition that the voice information is recognized to comprise the voice information sent by at least two target objects, the voice communication between two or more target objects is carried out, or the voice information sent by other target objects has interference on the voice information sent by another target object, so that the target equipment is controlled not to carry out voice response on the voice information, and the target equipment is prevented from disturbing the target object.
The following explains the method of voice interaction in the above embodiment with an example, but is not intended to limit the technical solution of the embodiment of the present invention.
The embodiment of the invention provides the function of a full-duplex intelligent voice assistant for target equipment, particularly equipment in the field of household appliances, aims at signal voice and semantic understanding, and is combined with a knowledge base and a state code of the household appliance to be used as a basis for refusal judgment in a full-duplex dialogue system.
The method of voice interaction in the above embodiment can be applied to the voice interaction apparatus shown in fig. 3. Fig. 3 is a block diagram of a voice interaction apparatus according to an embodiment of the present invention, as shown in fig. 3, the apparatus includes: the system comprises an audio stream feature extraction module, a device state query module, a knowledge base module, a user intention analysis module, a full-duplex rejection identification module and a full-duplex dialogue management module. Wherein the content of the first and second substances,
and the audio stream feature extraction module is used for extracting the signal features of the audio stream and can be used for voice endpoint detection of the audio signal and position tracking of a sound source.
The device state query module is used for acquiring the current running state of the household appliance awakened by the user;
the knowledge base module is used for establishing a knowledge base of the household appliance. Optionally, the knowledge base is used to store the general household appliance characteristics of the household appliance and the household appliance characteristics of a specific model of household appliance, and the household appliance characteristics may be functions supported or provided by the household appliance. For example, a set of functions supported by the home device and a status code included in each function are stored in the knowledge base. The state code is used for identifying the state of the household appliance, for example, the device state code may include a state code corresponding to the states of normal operation, water shortage of the washing machine, overweight of the washing machine, dehumidification of the refrigerator and the like;
and the user intention analyzing module is used for identifying the user intention according to the signal characteristics of the audio stream, the current running state of the household appliance and the knowledge base established in the knowledge base module. As an optional implementation manner, the user intention analysis module performs voice recognition on the same voice from the same sound source to obtain a result, performs semantic analysis by combining a knowledge base and the current running state of the equipment, and judges the intention of the user;
the full-duplex rejection identification module is used for controlling the full-duplex dialogue management module according to the analysis result of the user intention analysis module;
and the full-duplex dialogue management module is used for controlling the household appliance equipment to perform full-duplex voice interaction (namely, full-duplex voice dialogue) with the target object under the control of the full-duplex rejection identification module.
According to the embodiment of the invention, the user intention is identified by using the characteristics in the field of household appliances, the user intention can be clearly and accurately judged, and the accuracy of full-duplex voice interaction of target equipment (such as household appliances) is effectively improved. Moreover, by utilizing more sufficient household appliance information and combining the voice of the user, more effective semantic understanding can be carried out, and the intention of the user can be judged, so that the success rate of voice interaction between the user and household appliance equipment can be improved.
The embodiment of the invention can be applied to a full-duplex voice interaction scene between a target device (such as a household appliance) and a user in an intelligent home scene, namely, the voice interaction method in the embodiment can be applied to a household appliance voice assistant. In the embodiment of the invention, the effective audio characteristic clue and the device state clue in the multi-information flow are combined to assist semantic understanding, and the effective audio characteristic clue and the device state clue are used as the basis for judging whether the user performs voice interaction with the target device by a machine, namely, the full-duplex man-machine interaction intention is judged, so that the rejection judgment of the voice assistant of the household appliance is realized based on the multi-information flow.
Through the above description of the embodiments, those skilled in the art can clearly understand that the method according to the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but the former is a better implementation mode in many cases. Based on such understanding, the technical solutions of the present invention may be embodied in the form of a software product, which is stored in a storage medium (e.g., ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal device (e.g., a mobile phone, a computer, a server, or a network device) to execute the method according to the embodiments of the present invention.
According to another embodiment of the present invention, a voice interaction apparatus is provided, which is used for implementing the above embodiments and preferred embodiments, and the description of the apparatus is omitted for brevity. As used below, the term "module" may be a combination of software and/or hardware that implements a predetermined function. Although the means described in the embodiments below are preferably implemented in software, an implementation in hardware, or a combination of software and hardware is also possible and contemplated.
Fig. 4 is a block diagram of a voice interaction apparatus according to another embodiment of the present invention, the apparatus including:
a determining module 42 (i.e., the audio stream feature extraction module in the above embodiment) configured to acquire, by a target device, voice information of a target object, and determine, according to the voice information, a target function of the target device corresponding to the voice information;
an obtaining module 44, configured to obtain a device identifier of the target device;
a control module 46 (i.e., the user intention analyzing module, the full-duplex rejection identifying module, and the full-duplex dialog management module in the above embodiments) configured to query a pre-established knowledge base according to the device identifier of the target device and the target function to obtain a query result, and control whether the target device performs a voice response on the voice information according to the query result, where the knowledge base is used to store a function set supported by the target device, and the query result is used to indicate whether the function set includes the target function or not
According to the invention, the voice information of the target object is collected through the target equipment, and the target function of the target equipment corresponding to the voice information is determined according to the voice information; acquiring a device identifier of the target device; inquiring a pre-established knowledge base according to the device identifier of the target device and the target function to obtain an inquiry result, and controlling whether the target device carries out voice response on the voice information according to the inquiry result, wherein the knowledge base is used for storing a function set supported by the target device, and the inquiry result is used for indicating whether the function set comprises the target function. Therefore, the technical problem of low voice response accuracy of the target device in the related technology can be solved, the intention recognition accuracy of the target object is improved, the false response of the target device is avoided, the voice response accuracy of the target device is improved, and the user experience is optimized.
Fig. 5 is a block diagram (a) of a voice interaction apparatus according to another embodiment of the present invention. It should be noted that, as shown in fig. 5, the apparatus further includes: an establishing module 48, configured to establish the knowledge base, where the knowledge base at least stores: the device identification of a specified device, the function set supported by the specified device, and a status code included in each function in the function set, the status code indicating a status of the specified device associated with the function, the specified device including the target device.
Fig. 6 is a block diagram (ii) illustrating a voice interaction apparatus according to another embodiment of the present invention. As shown in fig. 6, in the above embodiment, the control module 46 includes: the query unit 62 is configured to query the knowledge base according to the device identifier of the target device, so as to obtain the function set corresponding to the device identifier of the target device; a control unit 64, configured to control the target device not to perform a voice response on the voice information if the query result indicates that the function set does not include the target function.
Fig. 7 is a block diagram (iii) illustrating a voice interaction apparatus according to another embodiment of the present invention. As an alternative embodiment, as shown in fig. 7, the control module 46 further includes: an obtaining unit 72, configured to obtain a status code corresponding to the target function in the knowledge base when the query result indicates that the function set includes the target function; a determining unit 74, configured to determine a current operating state of the target device and a state code corresponding to the current operating state in the state codes corresponding to the target function; the control unit 64 is further configured to control whether the target device performs a voice response on the voice information according to the status code corresponding to the current operating status.
Fig. 8 is a block diagram (iv) of a voice interaction apparatus according to another embodiment of the present invention. As shown in fig. 8, in the above embodiment, the control unit 64 includes: a first control subunit 82, configured to control the target device not to perform voice response on the voice information when the status code corresponding to the current operating status belongs to a first class of status codes; a second control subunit 84, configured to control the target device to perform a voice response on the voice information when the status code corresponding to the current operating status belongs to a second type of status code; wherein, the state code corresponding to the target function includes: the first-class status code is used for indicating that the current operating state does not meet specified conditions, the second-class status code is used for indicating that the current operating state meets at least one condition of the specified conditions, and the specified conditions are used for indicating conditions required for enabling the target device to operate the target function correctly.
Fig. 9 is a block diagram (v) of a voice interaction apparatus according to another embodiment of the present invention, and as shown in fig. 9, the second control subunit 84 includes: a first response unit 92, configured to control the target device to issue a first voice response when the current operating state meets all of the specified conditions, where the first voice response is used to prompt the target device to start operating the target function; a second responding unit 94, configured to control the target device to issue a second voice response when the current operating state meets some of the specified conditions, where the second voice response is used to prompt the target object to issue an operation instruction to the target device so that the target device correctly operates the function.
An embodiment of the present invention further provides a storage medium including a stored program, wherein the program executes any one of the methods described above.
Alternatively, in the present embodiment, the storage medium may be configured to store program codes for performing the following steps:
s1, acquiring voice information of a target object through target equipment, and determining a target function of the target equipment corresponding to the voice information according to the voice information;
s2, acquiring the device identification of the target device;
and S3, querying a pre-established knowledge base according to the device identifier of the target device and the target function to obtain a query result, and controlling whether the target device performs voice response on the voice information according to the query result, wherein the knowledge base is used for storing a function set supported by the target device, and the query result is used for indicating whether the function set includes the target function.
Optionally, in this embodiment, the storage medium may include, but is not limited to: various media capable of storing program codes, such as a usb disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a removable hard disk, a magnetic disk, or an optical disk.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again.
Embodiments of the present invention also provide an electronic device comprising a memory having a computer program stored therein and a processor arranged to run the computer program to perform the steps of any of the above method embodiments.
Optionally, the electronic apparatus may further include a transmission device and an input/output device, wherein the transmission device is connected to the processor, and the input/output device is connected to the processor.
Optionally, in this embodiment, the processor may be configured to execute the following steps by a computer program:
s1, acquiring voice information of a target object through target equipment, and determining a target function of the target equipment corresponding to the voice information according to the voice information;
s2, acquiring the device identification of the target device;
and S3, querying a pre-established knowledge base according to the device identifier of the target device and the target function to obtain a query result, and controlling whether the target device performs voice response on the voice information according to the query result, wherein the knowledge base is used for storing a function set supported by the target device, and the query result is used for indicating whether the function set includes the target function.
Fig. 10 is a schematic structural diagram of an alternative electronic device according to an embodiment of the invention. Alternatively, it can be understood by those skilled in the art that the structure shown in fig. 10 is only an illustration, and the electronic device may also be a terminal device such as a smart phone (e.g., an Android phone, an iOS phone, etc.), a tablet computer, a palm computer, and a Mobile Internet Device (MID), a PAD, and the like. Fig. 10 is a diagram illustrating a structure of the electronic device. For example, the electronic device may also include more or fewer components (e.g., network interfaces, etc.) than shown in FIG. 10, or have a different configuration than shown in FIG. 10.
The memory 1002 may be used to store software programs and modules, such as program instructions/modules corresponding to the voice interaction method and the voice interaction apparatus in the embodiment of the present invention, and the processor 1004 executes various functional applications and data processing by executing the software programs and modules stored in the memory 1002, that is, implementing the above-described voice interaction method. The memory 1002 may include high-speed random access memory, and may also include non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 1002 may further include memory located remotely from the processor 1004, which may be connected to the terminal over a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof. As an example, the memory 1002 may include, but is not limited to, the determining module 42, the obtaining module 44, the controlling module 46, and the establishing module 48 of the voice interaction apparatus. In addition, the device may further include, but is not limited to, other module units in the above-mentioned voice interaction device, which is not described in this example again.
Optionally, the transmission device 1006 is used for receiving or transmitting data via a network. Examples of the network may include a wired network and a wireless network. In one example, the transport device 1006 includes a Network adapter (NIC) that can be connected to a router via a Network cable to communicate with the internet or a local area Network. In one example, the transmission device 1006 is a Radio Frequency (RF) module, which is used for communicating with the internet in a wireless manner.
In addition, the electronic device further includes: a display 1008 for displaying a screen; and a connection bus 1010 for connecting the respective module parts in the above-described electronic apparatus.
In other embodiments, the terminal or the server may be a node in a distributed system, wherein the distributed system may be a blockchain system, and the blockchain system may be a distributed system formed by connecting a plurality of nodes through a network communication form. Nodes can form a Peer-To-Peer (P2P, Peer To Peer) network, and any type of computing device, such as a server, a terminal, and other electronic devices, can become a node in the blockchain system by joining the Peer-To-Peer network.
Optionally, the specific examples in this embodiment may refer to the examples described in the above embodiments and optional implementation manners, and this embodiment is not described herein again.
It will be apparent to those skilled in the art that the modules or steps of the present invention described above may be implemented by a general purpose computing device, they may be centralized on a single computing device or distributed across a network of multiple computing devices, and alternatively, they may be implemented by program code executable by a computing device, such that they may be stored in a storage device and executed by a computing device, and in some cases, the steps shown or described may be performed in an order different than that described herein, or they may be separately fabricated into individual integrated circuit modules, or multiple ones of them may be fabricated into a single integrated circuit module. Thus, the present invention is not limited to any specific combination of hardware and software.
The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, or improvement made within the principle of the present invention should be included in the protection scope of the present invention.
Claims (10)
1. A method of voice interaction, comprising:
acquiring voice information of a target object through target equipment, and determining a target function of the target equipment corresponding to the voice information according to the voice information;
acquiring a device identifier of the target device;
inquiring a pre-established knowledge base according to the device identifier of the target device and the target function to obtain an inquiry result, and controlling whether the target device carries out voice response on the voice information according to the inquiry result, wherein the knowledge base is used for storing a function set supported by the target device, and the inquiry result is used for indicating whether the function set comprises the target function.
2. The method of claim 1, wherein prior to said capturing speech information of the target object by the target device, the method further comprises:
establishing the knowledge base, wherein the knowledge base at least stores: the device identification of a specified device, the function set supported by the specified device, and a status code included in each function in the function set, the status code indicating a status of the specified device associated with the function, the specified device including the target device.
3. The method according to claim 2, wherein the querying a pre-established knowledge base according to the device identifier of the target device and the target function to obtain a query result, and controlling whether the target device responds to the voice message in a voice manner according to the query result comprises:
inquiring the knowledge base according to the equipment identifier of the target equipment to obtain the function set corresponding to the equipment identifier of the target equipment;
and controlling the target equipment not to perform voice response on the voice information under the condition that the query result is that the function set does not comprise the target function.
4. The method of claim 3, further comprising:
acquiring a state code corresponding to the target function in the knowledge base under the condition that the query result is that the function set comprises the target function;
determining the current operation state of the target equipment and a state code corresponding to the current operation state in the state codes corresponding to the target function;
and controlling whether the target equipment carries out voice response on the voice information or not according to the state code corresponding to the current running state.
5. The method of claim 4, wherein the controlling whether the target device responds to the voice message in accordance with the status code corresponding to the current operating status comprises:
controlling the target equipment not to perform voice response on the voice information under the condition that the state code corresponding to the current running state belongs to a first type of state code;
under the condition that the state code corresponding to the current running state belongs to a second type of state code, controlling the target equipment to perform voice response on the voice information;
wherein, the state code corresponding to the target function includes: the first-class status code is used for indicating that the current operating state does not meet specified conditions, the second-class status code is used for indicating that the current operating state meets at least one condition of the specified conditions, and the specified conditions are used for indicating conditions required for enabling the target device to operate the target function correctly.
6. The method according to claim 5, wherein the controlling the target device to perform voice response on the voice information in case that the status code corresponding to the current operation status belongs to a second type of status code comprises:
when the current running state meets all conditions in the specified conditions, controlling the target equipment to send out a first voice response, wherein the first voice response is used for prompting the target equipment to start running the target function;
and when the current running state meets part of conditions in the specified conditions, controlling the target equipment to send out a second voice response, wherein the second voice response is used for prompting the target object to send out an operation instruction to the target equipment so as to enable the target equipment to run the function correctly.
7. An apparatus for voice interaction, comprising:
the determining module is used for acquiring voice information of a target object through target equipment and determining a target function of the target equipment corresponding to the voice information according to the voice information;
an obtaining module, configured to obtain a device identifier of the target device;
and the control module is used for inquiring a pre-established knowledge base according to the equipment identifier of the target equipment and the target function to obtain an inquiry result, and controlling whether the target equipment performs voice response on the voice information according to the inquiry result, wherein the knowledge base is used for storing a function set supported by the target equipment, and the inquiry result is used for indicating whether the function set comprises the target function.
8. The apparatus of claim 7, further comprising:
an establishing module, configured to establish the knowledge base, where the knowledge base at least stores: the device identification of a specified device, the function set supported by the specified device, and a status code included in each function in the function set, the status code indicating a status of the specified device associated with the function, the specified device including the target device.
9. A storage medium, in which a computer program is stored, wherein the computer program is arranged to perform the method of any of claims 1 to 6 when executed.
10. An electronic device comprising a memory and a processor, characterized in that the memory has stored therein a computer program, the processor being arranged to execute the method of any of claims 1 to 6 by means of the computer program.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010621931.9A CN111884887A (en) | 2020-07-01 | 2020-07-01 | Voice interaction method and device, storage medium and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010621931.9A CN111884887A (en) | 2020-07-01 | 2020-07-01 | Voice interaction method and device, storage medium and electronic device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111884887A true CN111884887A (en) | 2020-11-03 |
Family
ID=73156666
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010621931.9A Pending CN111884887A (en) | 2020-07-01 | 2020-07-01 | Voice interaction method and device, storage medium and electronic device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111884887A (en) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112735406A (en) * | 2020-12-23 | 2021-04-30 | 青岛海尔科技有限公司 | Device control method and apparatus, storage medium, and electronic apparatus |
| CN112782997A (en) * | 2020-12-31 | 2021-05-11 | 青岛海尔科技有限公司 | Device control method and apparatus, storage medium, and electronic apparatus |
| CN113596234A (en) * | 2021-06-29 | 2021-11-02 | 青岛海尔科技有限公司 | Method and device for determining equipment function model, storage medium and electronic device |
| CN114108239A (en) * | 2021-10-22 | 2022-03-01 | 青岛海尔科技有限公司 | Voice information playing method and device, storage medium and electronic device |
| WO2024001189A1 (en) * | 2022-06-28 | 2024-01-04 | 青岛海尔科技有限公司 | Food storage information determination method and apparatus, storage medium, and electronic apparatus |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105637139A (en) * | 2013-10-16 | 2016-06-01 | 萨罗尼科斯贸易与服务一人有限公司 | Laundry washing machine with speech recognition and response capabilities and method for operating same |
| CN107564518A (en) * | 2017-08-21 | 2018-01-09 | 百度在线网络技术（北京）有限公司 | Smart machine control method, device and computer equipment |
| CN107808669A (en) * | 2017-09-30 | 2018-03-16 | 深圳市艾特智能科技有限公司 | Sound control method, intelligent domestic system, storage medium and computer equipment |
| CN108305626A (en) * | 2018-01-31 | 2018-07-20 | 百度在线网络技术（北京）有限公司 | The sound control method and device of application program |
| CN108389580A (en) * | 2018-02-11 | 2018-08-10 | 广东美的厨房电器制造有限公司 | Household electrical appliance and its audio recognition method, server |
| US20200020336A1 (en) * | 2018-07-13 | 2020-01-16 | Lg Electronics Inc. | Washing machine and control system operating based on voice recognition using artificial intelligence, and method for controlling them |
| CN111240214A (en) * | 2018-11-29 | 2020-06-05 | 青岛海尔洗衣机有限公司 | Control method for intelligent household system |
-
2020
- 2020-07-01 CN CN202010621931.9A patent/CN111884887A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105637139A (en) * | 2013-10-16 | 2016-06-01 | 萨罗尼科斯贸易与服务一人有限公司 | Laundry washing machine with speech recognition and response capabilities and method for operating same |
| CN107564518A (en) * | 2017-08-21 | 2018-01-09 | 百度在线网络技术（北京）有限公司 | Smart machine control method, device and computer equipment |
| CN107808669A (en) * | 2017-09-30 | 2018-03-16 | 深圳市艾特智能科技有限公司 | Sound control method, intelligent domestic system, storage medium and computer equipment |
| CN108305626A (en) * | 2018-01-31 | 2018-07-20 | 百度在线网络技术（北京）有限公司 | The sound control method and device of application program |
| CN108389580A (en) * | 2018-02-11 | 2018-08-10 | 广东美的厨房电器制造有限公司 | Household electrical appliance and its audio recognition method, server |
| US20200020336A1 (en) * | 2018-07-13 | 2020-01-16 | Lg Electronics Inc. | Washing machine and control system operating based on voice recognition using artificial intelligence, and method for controlling them |
| CN111240214A (en) * | 2018-11-29 | 2020-06-05 | 青岛海尔洗衣机有限公司 | Control method for intelligent household system |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112735406A (en) * | 2020-12-23 | 2021-04-30 | 青岛海尔科技有限公司 | Device control method and apparatus, storage medium, and electronic apparatus |
| CN112782997A (en) * | 2020-12-31 | 2021-05-11 | 青岛海尔科技有限公司 | Device control method and apparatus, storage medium, and electronic apparatus |
| CN113596234A (en) * | 2021-06-29 | 2021-11-02 | 青岛海尔科技有限公司 | Method and device for determining equipment function model, storage medium and electronic device |
| CN113596234B (en) * | 2021-06-29 | 2023-03-31 | 青岛海尔科技有限公司 | Method and device for determining equipment function model, storage medium and electronic device |
| CN114108239A (en) * | 2021-10-22 | 2022-03-01 | 青岛海尔科技有限公司 | Voice information playing method and device, storage medium and electronic device |
| CN114108239B (en) * | 2021-10-22 | 2024-03-22 | 青岛海尔科技有限公司 | Voice information playing method and device, storage medium and electronic device |
| WO2024001189A1 (en) * | 2022-06-28 | 2024-01-04 | 青岛海尔科技有限公司 | Food storage information determination method and apparatus, storage medium, and electronic apparatus |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111884887A (en) | Voice interaction method and device, storage medium and electronic device | |
| CN107886952B (en) | Method, device and system for controlling intelligent household electrical appliance through voice and electronic equipment | |
| CN112073471B (en) | Control method and device of equipment, storage medium and electronic device | |
| CN113412469A (en) | Equipment network distribution method and device, electronic equipment and storage medium | |
| CN107632526B (en) | Control device, method, storage medium and equipment | |
| EP3869112B1 (en) | Air-conditioning device control method and air-conditioning device | |
| CN114244644B (en) | Control method and device for intelligent home, storage medium and electronic device | |
| CN109561002B (en) | Voice control method and device for household electrical appliance | |
| CN109725543B (en) | Equipment control code configuration method and device, cloud server and network system | |
| CN108932947B (en) | Voice control method and household appliance | |
| CN113498594A (en) | Control method and device of intelligent household system, electronic equipment and storage medium | |
| CN105187480A (en) | Configuration file acquisition method, configuration file acquisition device and configuration file acquisition system | |
| CN112908321A (en) | Device control method, device, storage medium, and electronic apparatus | |
| CN103761123A (en) | Method and device for function starting and terminal | |
| CN107742520B (en) | Voice control method, device and system | |
| CN112423368A (en) | Gateway, intelligent device, mobile terminal, network access method and network access auxiliary method and system | |
| CN113518125A (en) | Offline data uploading method and system, storage medium and electronic device | |
| CN113053369A (en) | Voice control method and device of intelligent household appliance and intelligent household appliance | |
| CN112002316A (en) | Electric appliance control method and device, storage medium and terminal | |
| CN107770009B (en) | Control device, method, storage medium and equipment | |
| WO2017041558A1 (en) | Analyzing and processing method, device and system | |
| CN115499333A (en) | Method, system, storage medium and electronic device for determining association relationship | |
| CN112820273B (en) | Wake-up judging method and device, storage medium and electronic equipment | |
| CN115065508A (en) | Method and apparatus for processing device twin data, storage medium, and electronic apparatus | |
| CN105607498B (en) | A kind of matched method, apparatus of smart home device, equipment and system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20201103 |
|
| RJ01 | Rejection of invention patent application after publication |