WO2017028678A1 - 通信方法、服务器及设备 - Google Patents

通信方法、服务器及设备 Download PDF

Info

Publication number
WO2017028678A1
WO2017028678A1 PCT/CN2016/092736 CN2016092736W WO2017028678A1 WO 2017028678 A1 WO2017028678 A1 WO 2017028678A1 CN 2016092736 W CN2016092736 W CN 2016092736W WO 2017028678 A1 WO2017028678 A1 WO 2017028678A1
Authority
WO
WIPO (PCT)
Prior art keywords
voice instruction
voice
information
server
instruction
Prior art date
Application number
PCT/CN2016/092736
Other languages
English (en)
French (fr)
Chinese (zh)
Inventor
李小娟
王雅辉
郜文美
Original Assignee
华为技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 华为技术有限公司 filed Critical 华为技术有限公司
Priority to EP16836542.7A priority Critical patent/EP3316121B1/en
Priority to JP2018508731A priority patent/JP6571273B2/ja
Priority to KR1020187005455A priority patent/KR102105295B1/ko
Priority to KR1020207011463A priority patent/KR102327279B1/ko
Priority to EP19213931.9A priority patent/EP3683672A1/en
Priority to KR1020217036714A priority patent/KR102508619B1/ko
Priority to US15/752,139 priority patent/US11049499B2/en
Publication of WO2017028678A1 publication Critical patent/WO2017028678A1/zh
Priority to US17/320,909 priority patent/US12094462B2/en

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26—Power supply means, e.g. regulation thereof
    • G06F1/32—Means for saving power
    • G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3206—Monitoring of events, devices or parameters that trigger a change in power modality
    • G06F1/3231—Monitoring the presence, absence or movement of users
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16—Sound input; Sound output
    • G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/08—Speech classification or search
    • G10L15/18—Speech classification or search using natural language modelling
    • G10L15/1815—Semantic context, e.g. disambiguation of the recognition hypotheses based on word meaning
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/02—Details
    • H04L12/12—Arrangements for remote connection or disconnection of substations or of equipment thereof
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/28—Constructional details of speech recognition systems
    • G10L15/30—Distributed recognition, e.g. in client-server systems, for mobile phones or network applications
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/08—Speech classification or search
    • G10L2015/088—Word spotting
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/225—Feedback of the input speech
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00—Data switching networks
    • H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/40—Bus networks

Definitions

  • the present invention relates to the field of communications, and in particular, to a communication method, a server, and a device.
  • voice assistants Most of the current mobile phones have voice assistants. In addition, with smart watches, smart bracelets, and voice assistants integrated into smart devices, voice assistants in future devices will be “standard”.
  • the device's voice assistant After the device's voice assistant is woken up, it will perform the corresponding operation according to the received voice command.
  • the same user may have multiple smart devices, such as a mobile phone, a smart watch, a tablet, a wearable device, etc., when the user invokes a voice command to wake up the voice assistant, the voice assistant of multiple devices is simultaneously awake at the same time.
  • Embodiments of the present invention provide a communication method, a server, and a device, which are capable of determining a device that responds to a voice instruction from a plurality of devices of the same user, thereby implementing intelligent selection of a device that responds to the voice instruction.
  • a communication method including: receiving information sent by each of a plurality of devices of the same user, the information including a device type; determining, according to at least the received information, the plurality of devices And a device responsive to the voice command; sending a message to the other device in the plurality of devices that is responsive to the voice command, the message being used to indicate that the voice assistant of the other device does not respond to the voice command.
  • the information further includes at least one of a scene mode and a voice instruction in which the device is located.
  • the device responsive to the voice instruction includes: identifying a semantic of the voice instruction; determining the device responsive to the voice instruction based on the device type and a semantic of the voice instruction.
  • the method when the information includes a device type and a voice instruction, the method further includes: determining the voice instruction Corresponding operation; transmitting an indication to the device responding to the voice instruction to indicate the operation information.
  • another communication method including: receiving the same voice instruction sent by each of a plurality of devices of the same user; determining an operation corresponding to the voice instruction; and responding to the voice in the multiple devices
  • the instructed device transmits indication information indicating the operation, the device responsive to the voice instruction being determined according to information transmitted by each of the plurality of devices, the information including a device type.
  • the information further includes at least one of a scenario mode and a voice instruction in which the device is located.
  • another communication method comprising: receiving a first voice instruction; entering an awake state according to the first voice instruction; acquiring information, the information including a device type; transmitting the information to a server; The first message sent by the server according to the information, the first message is used to indicate that the voice assistant of the device does not respond to the voice instruction; or the second message sent by the server according to the information is received, The second message is used to indicate that the voice assistant of the device responds to the voice command.
  • the information further includes at least one of a scene mode and a voice instruction in which the device is located.
  • the method further includes: receiving an indication sent by the server to indicate an operation corresponding to the voice instruction Information that also includes the voice command.
  • the method when the first message sent by the server according to the information is received, the method also includes receiving a second voice instruction; not responding to the second voice command.
  • the method further includes: receiving a third voice instruction; transmitting the third voice instruction to the server; receiving a third message sent by the server according to the third voice instruction, where the third message is used And an operation corresponding to the third voice instruction; and an operation corresponding to the third voice instruction according to the third message.
  • another communication method comprising: receiving a first voice instruction; entering an awake state according to the first voice instruction; acquiring information, the information including a device type; transmitting the information to a server; Two voice commands; transmitting the second voice command to the server; receiving The indication information sent by the server according to the information for indicating an operation corresponding to the second voice instruction.
  • the information further includes at least one of a scenario mode and a voice instruction in which the device is located.
  • a communication method including: receiving a first voice instruction; entering an awake state according to the first voice instruction; receiving a second voice instruction; determining that the second voice instruction includes information of a device, and responding The second voice instruction.
  • a sixth aspect provides a server, comprising: a receiving unit, configured to receive information sent by each device of a plurality of devices of the same user, where the information includes a device type; and the processing unit receives at least the receiving unit according to the And the sending unit is configured to send a message to the other device in the plurality of devices that is in response to the voice instruction, where the message is used to indicate The voice assistant of the other device does not respond to voice commands.
  • the information further includes at least one of a scenario mode and a voice instruction in which the device is located.
  • the processing unit when the information includes a device type and a voice instruction, is specifically configured to: Resolving the semantics of the voice instruction; determining the device responsive to the voice instruction based on the device type and the semantics of the voice instruction.
  • the processing The unit is further configured to: determine an operation corresponding to the voice instruction; the sending unit is further configured to: send, to the device that responds to the voice instruction, indication information that is used to indicate the operation.
  • a server including: a receiving unit, configured to receive the same voice command sent by each device of the multiple devices of the same user; and a processing unit, configured to determine the voice received by the receiving unit An operation corresponding to the instruction, the sending unit, configured to send, to the device that responds to the voice instruction, the indication information for indicating the operation, where the device that responds to the voice instruction is according to each of the multiple devices The information sent by the device is determined, and the information includes the device type.
  • the information further includes at least one of a scene mode and a voice instruction in which the device is located.
  • the eighth aspect provides an apparatus, including: a receiving unit, configured to receive a first voice instruction; and a processing unit, configured to enter an awake state according to the first voice instruction received by the receiving unit; An acquiring unit, configured to acquire information, where the information includes a device type, a sending unit, configured to send the information to a server, where the receiving unit is further configured to: receive a first message sent by the server according to the information, where The first message is used to indicate that the voice assistant of the device does not respond to the voice instruction; or the second message sent by the server according to the information is received, and the second message is used to indicate that the voice assistant of the device responds to the voice instruction.
  • the information further includes at least one of a scenario mode and a voice instruction in which the device is located.
  • the receiving unit is further configured to receive, by the server, The indication information of the corresponding operation, the information further including the voice instruction.
  • the receiving unit when the receiving unit receives the first message, the receiving unit further And for receiving the second voice instruction; the processing unit is further configured to: not respond to the second voice instruction received by the receiving unit.
  • the receiving unit when the receiving unit receives the second message, The receiving unit is further configured to: receive a third voice instruction; the sending unit is further configured to: send the third voice instruction received by the receiving unit to the server; the receiving unit is further configured to receive The third message sent by the server according to the third voice instruction, the third message is used to indicate an operation corresponding to the third voice instruction, and the processing unit is further configured to execute the first message according to the third message The operation corresponding to the three voice commands.
  • a device including: a receiving unit, configured to receive a first voice instruction; a processing unit, configured to enter an awake state according to the first voice instruction; and an acquiring unit, configured to acquire information, where The information includes a device type, a sending unit, configured to send the information to the server, the receiving unit is further configured to receive the second voice instruction, and the sending unit is further configured to send the second voice command to the server.
  • the receiving unit is further configured to receive indication information that is sent by the server according to the information to indicate an operation corresponding to the second voice instruction.
  • the information further includes at least one of a scene mode and a voice instruction in which the device is located.
  • a device including: a receiving unit, configured to receive a first voice instruction; a processing unit, configured to enter an awake state according to the first voice instruction; Receiving a second voice instruction; the processing unit is further configured to: determine that the second voice instruction includes information of the device, and respond to the second voice instruction.
  • another server comprising: one or more processors, a memory, a bus system, a transceiver, and one or more programs, the processor, the memory, and the transceiver
  • the bus system is coupled; wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for Receiving, by the transceiver, information sent by each of the plurality of devices of the same user, the information including a device type; determining, according to the information received by the transceiver, the response voice command in the multiple devices And transmitting, by the transceiver, to a device other than the device that responds to the voice instruction in the plurality of devices, the message is used to indicate that the voice assistant of the other device does not respond to the voice instruction.
  • the information further includes at least one of a scene mode and a voice instruction in which the device is located.
  • the instruction when the information includes a device type and a voice instruction, the instruction further And a method for: identifying a voice of the voice instruction; determining, according to the device type and a semantic of the voice instruction, the device that responds to the voice instruction.
  • the instructions are further configured to: determine an operation corresponding to the voice instruction; and send, by the transceiver, indication information for indicating the operation to a device that responds to the voice instruction among the plurality of devices.
  • another server comprising: one or more processors, a memory, a bus system, a transceiver, and one or more programs, the processor, the memory, and the transceiver
  • the bus system is coupled; wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for Receiving, by the transceiver, the same voice command sent by each of the plurality of devices of the same user; determining an operation corresponding to the voice command received by the transceiver; and transmitting, by the transceiver, the plurality of devices
  • the device in response to the voice instruction transmits indication information indicating the operation, the device responsive to the voice instruction being determined according to information transmitted by each of the plurality of devices, the information including a device type.
  • the information is further Include at least one of a profile and a voice command in which the device is located.
  • another apparatus comprising: one or more processors, a memory, a bus system, a transceiver, and one or more programs, the processor, the memory, and the transceiver
  • the bus system is coupled; wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for Receiving, by the transceiver, a first voice instruction; entering an awake state according to the first voice instruction received by the transceiver; acquiring information, the information including a device type; transmitting, by the transceiver, the server to the server Receiving, by the transceiver, a first message sent by the server according to the information, where the first message is used to indicate that the voice assistant of the device does not respond to the voice instruction, or receives the server by using the transceiver And according to the second message sent by the information, the second message is used to indicate that the voice assistant of the device responds to the voice instruction.
  • the information further includes at least one of a scene mode and a voice instruction in which the device is located.
  • the instruction is further configured to receive the server by using the transceiver The indication information sent to indicate an operation corresponding to the voice instruction, the information further including the voice instruction.
  • the instruction is further configured to: when received by the transceiver When the first message is described, the second voice instruction is received by the transceiver; and the second voice instruction received by the transceiver is not responded.
  • the instruction is further configured to: when the Receiving, by the transceiver, a third voice instruction; transmitting, by the transceiver, the third voice instruction to the server; receiving, by the transceiver, the server sending according to the third voice instruction
  • the third message is used to indicate an operation corresponding to the third voice instruction; and the operation corresponding to the third voice instruction is performed according to the third message.
  • another apparatus comprising: one or more processors, a memory, a bus system, a transceiver, and one or more programs, the processor, the memory, and the transceiver Said bus system being connected; wherein said one or more programs are stored in said memory and configured to be executed by said one or more processors, said one or more programs comprising instructions, said fingers Used to: receive a first voice instruction through the transceiver; enter an awake state according to the first voice instruction; acquire information, the information includes a device type; send the information to a server by using the transceiver; Transceiver receiving a second voice instruction; transmitting, by the transceiver, the second voice instruction to the server; receiving, by the transceiver, the second voice instruction sent by the server according to the information The indication of the corresponding operation.
  • the information further includes at least one of a scene mode and a voice instruction in which the device is located.
  • another apparatus comprising: one or more processors, a memory, a bus system, a transceiver, and one or more programs, the processor, the memory, and the transceiver
  • the bus system is coupled; wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, the one or more programs comprising instructions for Receiving, by the transceiver, a first voice instruction; entering an awake state according to the first voice instruction; receiving a second voice instruction by the transceiver; determining that the second voice instruction includes information of a device, in response to the Two voice commands.
  • the embodiment of the present invention can receive information sent by multiple devices of the same user, and determine, according to the information, a device that responds to the voice instruction from the multiple devices, and can be used by a user who has multiple different devices.
  • the intelligent selection of devices that respond to voice commands provides users with a more convenient human-computer interaction experience.
  • FIG. 1A is a schematic diagram of a scenario in which a communication method is applied according to an embodiment of the present invention.
  • FIG. 1B is another schematic diagram of a scenario in which a communication method is applied according to an embodiment of the present invention.
  • FIG. 2 is a schematic flow chart of a communication method according to an embodiment of the present invention.
  • FIG. 3 is a schematic flowchart of a communication method according to another embodiment of the present invention.
  • FIG. 4 is a schematic flowchart of a communication method according to another embodiment of the present invention.
  • FIG. 5 is a schematic flowchart of a communication method according to another embodiment of the present invention.
  • FIG. 6 is a schematic flowchart of a communication method according to another embodiment of the present invention.
  • FIG. 7 is a schematic flowchart of a communication method according to another embodiment of the present invention.
  • FIG. 8 is a schematic flowchart of a communication method according to another embodiment of the present invention.
  • FIG. 9 is a schematic flowchart of a communication method according to another embodiment of the present invention.
  • FIG. 10 is a schematic flowchart of a communication method according to another embodiment of the present invention.
  • FIG. 11 is a schematic flowchart of a communication method according to another embodiment of the present invention.
  • FIG. 12 is a schematic flowchart of a communication method according to another embodiment of the present invention.
  • Figure 13 is a schematic block diagram of a server in accordance with an embodiment of the present invention.
  • Figure 14 is a schematic block diagram of a server in accordance with another embodiment of the present invention.
  • Figure 15 is a schematic block diagram of a device in accordance with an embodiment of the present invention.
  • Figure 16 is a schematic block diagram of an apparatus in accordance with another embodiment of the present invention.
  • 17 is a schematic block diagram of a device in accordance with another embodiment of the present invention.
  • Figure 18 is a schematic block diagram of a server in accordance with another embodiment of the present invention.
  • FIG. 19 is a schematic block diagram of a server in accordance with another embodiment of the present invention.
  • Figure 20 is a schematic block diagram of a device in accordance with another embodiment of the present invention.
  • 21 is a schematic block diagram of a device in accordance with another embodiment of the present invention.
  • Figure 22 is a schematic block diagram of a device in accordance with another embodiment of the present invention.
  • the size of the sequence numbers of the processes does not imply a sequence of executions, and the order of execution of the processes should be determined by its function and internal logic, and should not be taken in accordance with the embodiments of the present invention.
  • the implementation process constitutes any qualification.
  • the devices referred to herein refer to smart devices or mobile devices that are closely related to the user's life.
  • the devices may include, but are not limited to, smart phones, wearable devices, smart homes, in-vehicle devices, and the like.
  • the wearable device may include, but is not limited to, a smart watch, a wristband, smart glasses, and the like.
  • the server involved in this document may be the voice assistant server in FIG. 1A, other devices that can recognize voice commands, or a controller that can recognize voice commands in FIG. 1B.
  • multiple devices of the same user referred to herein means that the plurality of devices have phases.
  • the same user account, and the multiple devices maintain a wireless connection using the same user account.
  • voice commands include voice manipulation instructions and/or voice wakeup instructions.
  • FIG. 1A is a schematic diagram of a scenario in which a communication method is applied according to an embodiment of the present invention.
  • the voice assistant server communicates with multiple devices of the same user, and multiple devices can simultaneously receive the same voice wake-up command or voice operation command issued by the user.
  • FIG. 1A is only an example in which a voice assistant server communicates with a mobile phone, a wearable device, an in-vehicle device, or a smart home of the same user.
  • the device of the embodiment of the present invention is not limited thereto.
  • the multiple devices in FIG. 1A may also be formed into an ad hoc network, and the controller of the ad hoc network may be an independent device, or may be any one of the multiple devices. .
  • the voice assistant may be a processing module integrated in the device or a client installed in the device, and the client corresponding to the voice assistant may display a corresponding icon or interface on the display screen of the device, You can run only in the background without displaying the corresponding icon or interface.
  • the voice assistant can identify the corresponding voice data through pre-stored voice data.
  • the voice assistant in the embodiment of the present invention may also be referred to as a smart assistant, or a personal assistant, and the like, which is not limited by the embodiment of the present invention.
  • the voice assistant server can receive the voice operation analysis request sent by the device, and parse the voice operation instruction carried in the voice operation analysis request, determine an operation corresponding to the voice operation instruction, and deliver the operation instruction information to the device.
  • FIG. 2 is a schematic flow diagram of a communication method 200 in accordance with an embodiment of the present invention.
  • the server communicates with a plurality of devices of the same user, and the plurality of devices can simultaneously receive the same voice command issued by the user, and the method 200 can be performed by a server (such as a voice assistant server or a controller of the ad hoc network).
  • a server such as a voice assistant server or a controller of the ad hoc network.
  • method 200 includes the following.
  • the device corresponding to the voice instruction performs an operation corresponding to the voice instruction.
  • the message may further carry identifier information of the device that responds to the voice instruction to notify other devices to respond to the voice command by the device.
  • each device can be any of the following: mobile phones, wristbands, car terminals, audio, television, and the like.
  • a device that responds to a voice command may also be referred to as a priority response device, a master device, and an implementation.
  • the server may pre-store response priority information of multiple device types, and the server may determine the device that responds to the voice command preferentially according to the response priority of the device type. If the server pre-stores the following device types, the response priority is from high to low: car device, wristband, mobile phone, stereo.
  • the device types received in step 210 are: a wristband, an in-vehicle device, and a mobile phone, the in-vehicle device can be determined to be a device that responds to the voice command according to the locally pre-stored response priority information.
  • the message sent by the device other than the device that responds to the voice instruction may further carry the sleep indication information, so that the device that does not respond to the voice instruction enters the sleep state according to the sleep indication information.
  • the low-power voice wake-up module of the device entering the sleep state is still in the listening state, but does not respond to the received voice command.
  • the user who has multiple different devices can respond
  • the intelligent selection of voice-instructed devices provides users with a more convenient and natural human-computer interaction experience.
  • the device may default to the device responding to the voice instruction, and may respond to receive.
  • the voice command to For example, the device may send a voice operation parsing request carrying a voice instruction to the server, request an operation corresponding to the voice instruction from the server, and perform the operation.
  • the embodiment of the present invention is not limited thereto.
  • the method 200 may simultaneously send a message to the device responding to the voice instruction to notify the device to respond to the voice command, and after receiving the message, the device may request the server. The operation corresponding to the received voice command and perform the operation.
  • the information sent by each device may further include at least one of a scene mode and a voice instruction in which the device is located.
  • the profile in which each device is located may include any of the following: driving, living room, bedroom, sports, work, headset mode, external mode, and the like.
  • the voice assistant server or the controller may pre-store different device information of the same user, different context modes, and priority information of the corresponding response device under different device types.
  • the correspondence between the device type, the scene mode, and the device that responds to the voice command is as shown in Table 1 below.
  • the server After receiving the device type and profile of multiple devices, the server pairs the profile and device type with pre-stored pre-stored information as shown in Table 1, such as the scenario: driving, and the current receiving Device types include mobile phones, hands For ring and in-vehicle devices, the server automatically selects the in-vehicle device as the current device that responds to voice commands.
  • the device in the table 1 indicates the device that responds to the voice command, but the embodiment of the present invention is not limited thereto.
  • the correspondence between the device identifier and the device type may be pre-stored in the server.
  • the device corresponding to the voice instruction can also be indicated by the device identifier in the corresponding correspondence table.
  • the server may also pre-store the correspondence between the device type, the scene mode, and/or the semantics and the plurality of devices with the prioritized priorities, and the device with the higher priority among the plurality of devices may be preset as the device that responds to the voice instruction. . For example, when the device type received by the server does not have a device type corresponding to the device with the highest priority stored in advance, it is determined that the device with the lower priority among the plurality of devices is a device that responds to the voice instruction, and so on.
  • Scene mode Semantics Equipment type Device responsive to voice commands Driving / Mobile phone, wristband, car equipment Car Equipment In sports / Mobile phone, bracelet wristband working / Mobile phone, bracelet Mobile phone / Call Mobile phone, bracelet Mobile phone / Texting Mobile phone, bracelet wristband Headphone mode listen to music Mobile phone, stereo Mobile phone External mode listen to music Mobile phone, stereo sound in living room listen to music Mobile phone, stereo sound In the bedroom listen to music Mobile phone, bracelet Mobile phone in living room watch TV Mobile phone, TV TV In the bedroom watch TV Mobile phone, TV Mobile phone, TV Mobile phone
  • step 220 includes:
  • a device that responds to voice instructions is determined from a plurality of devices based on the device type and the semantics of the voice instructions.
  • the correspondence between the device type, the semantics, and the device that responds to the voice command may also be pre-stored in the server.
  • the server recognizes the semantics of the voice instruction, such as the semantics: the phone is called, and the received device type is a mobile phone or a wristband, and then the device that responds to the voice instruction is determined to be a mobile phone.
  • step 220 specifically includes:
  • a device that responds to voice instructions is determined from a plurality of devices based on device type, semantics of voice commands, and context patterns.
  • the correspondence between the scene mode, the device type, the semantics, and the device that responds to the voice command can also be pre-stored in the server.
  • the semantics is “listening to music”, and the acquired device types are mobile phones, stereos, and in-vehicle devices, and then continue to acquire their scene modes.
  • the scene mode is “in the living room”, it is determined that the device currently responding to the voice command is an audio.
  • the device that responds to the voice instruction is determined according to the semantics, the scene mode, and the device type of the voice instruction, so that the device selection can be made more precise.
  • the method 200 may further include:
  • the indication information indicating the operation is sent to the device that responds to the voice instruction.
  • the controller of the ad hoc network cannot parse the voice command, after the controller determines the device that responds to the voice command according to the device type and the context mode, the controller needs to send a message to the device responding to the voice command to indicate the response voice.
  • the instructed device sends a voice operation parsing request carrying a voice instruction to a server (such as a voice assistant server).
  • the server may send a message to the device that does not respond to the voice command, to notify the voice assistant of the device that does not respond to the voice instruction does not respond to the received message.
  • a message may also be sent to the device responsive to the voice command to notify the device to respond to the received voice command.
  • only the voice assistant of the device responding to the voice instruction sends a voice operation resolution request to the server after receiving the voice operation instruction.
  • the user who has multiple different devices can respond
  • the intelligent selection of voice-instructed devices provides users with a more convenient and natural human-computer interaction experience.
  • FIG. 3 is a schematic flowchart of a communication method 300 according to another embodiment of the present invention.
  • the server communicates with multiple devices of the same user, and multiple devices can simultaneously receive the same language from the user. Tone instructions.
  • the communication method 300 can be performed by a server. As shown in FIG. 3, the communication method 300 includes the following.
  • the user who has multiple different devices can realize the intelligent selection of the device responding to the voice instruction, thereby providing the user with more convenient Natural human-computer interaction experience.
  • the communication method 300 may further include:
  • a device that responds to voice commands among a plurality of devices is determined based on the information.
  • the server continues to receive the voice operation resolution request sent by each of the multiple devices, and after determining the operation corresponding to the voice instruction, sending the device to the device that responds to the voice command in the multiple devices. Instructions for operation.
  • the communication method 300 may further include: sending a message to the device that does not respond to the voice instruction among the multiple devices, to notify the device that the device responding to the voice instruction performs a corresponding operation, and instructs the device to enter a sleep state.
  • the information sent by each device may further include at least one of a scene mode and a voice instruction in which the device is located.
  • the method for determining the device that responds to the voice instruction according to the information sent by each device may refer to the related description of the embodiment shown in FIG. 2, and to avoid repetition, details are not described herein again.
  • the user who has multiple different devices can realize the intelligent selection of the device responding to the voice instruction, thereby providing the user with more convenient Natural human-computer interaction experience.
  • FIG. 4 is a schematic flow diagram of a communication method 400 in accordance with another embodiment of the present invention.
  • Multiple devices of the same user can simultaneously receive the same voice command from the user. It should be understood that there are three situations in which the connection status of multiple devices of the same user and the server are as follows: 1. The voice of each device of the user The assistants are all connected to the server; 2. The voice assistant of some users of the user is connected to the server, and the voice assistant of some devices is not connected to the server; 3. The voice assistants of multiple devices of the user are not connected to the server. . For voice assistants of devices that are not connected to the server, they can connect to the server after receiving a voice wake-up command from the user. Optionally, multiple devices of the same user may also form an ad hoc network.
  • the communication method 400 can be performed by any of a plurality of devices of the same user.
  • communication method 400 can be performed by a voice aid in a device or device.
  • the communication method 400 includes the following.
  • the voice assistant in the device enters an awake state according to the first voice instruction.
  • the first voice instruction may be a voice wake-up instruction, and the user or the device manufacturer may set the content corresponding to the voice wake-up instruction in the unit, module or client corresponding to the voice assistant. For example, if the preset voice wake-up command is "hi, Allen", when the voice assistant receives the voice command of "hi, Allen", it will enter the awake state.
  • the server may be a voice assistant server or a controller of the ad hoc network.
  • the device sends the information to the server such that the server can determine from the information whether the device is a device that responds to the voice command.
  • the information may further include at least one of a scene mode and a voice instruction in which the device is located.
  • the communication method 400 may further include: receiving, by the server, indication information for indicating an operation corresponding to the voice instruction.
  • the acquiring the voice instruction includes: receiving the voice instruction.
  • the first message sent by the receiving server according to the information where the first message is used to indicate that the voice assistant of the device does not respond to the voice instruction; or the second message sent by the receiving server according to the information, the second message is used to indicate the voice of the device.
  • the assistant responds to voice commands.
  • the server by acquiring information and transmitting the information to the server, the server is capable of determining, from the plurality of devices, the device that responds to the voice instruction, and for the user having the plurality of different devices, enabling the response voice command. Intelligent selection of equipment to provide users with more convenient Natural human-computer interaction experience.
  • the response duration of the voice assistant of the device after waking up may also be set, for example, 1 minute. That is, after the user wakes up the voice assistant through "hi, Allen", the voice assistant can respond only by receiving the voice command directly within the response duration (for example, 1 minute). For example, after receiving the voice command such as “hi, Allen, open map” and completing the voice operation of the open map, the voice assistant can continue to input the voice command “to Zhongguancun” to the voice assistant, and the voice assistant can directly obtain and Find the optimal route of Zhongguancun, without the user inputting voice commands such as “hi, Allen, to Zhongguancun” to the voice assistant, thus facilitating the user's operation and improving the user experience.
  • the voice assistant can continue to input the voice command “to Zhongguancun” to the voice assistant, and the voice assistant can directly obtain and Find the optimal route of Zhongguancun, without the user inputting voice commands such as “hi, Allen, to Zhongguancun” to the
  • the first message received in step 450 may further carry the sleep indication information, and the method 400 further includes: entering the sleep state according to the sleep indication information.
  • the device In the sleep state, the device is still in the listening state, that is, the voice command (such as a voice wake-up command and/or voice operation command) issued by the user can be monitored, but the device does not respond to the received voice command.
  • the voice command such as a voice wake-up command and/or voice operation command
  • the communication method 400 may further include:
  • the second voice command can be a voice operation command.
  • the communication method 500 may further include:
  • the operation corresponding to the third voice instruction is performed according to the third message.
  • the third voice command can be a voice command.
  • the device may send the obtained information and the received third voice command to the server at the same time, or may separately send the information and the third voice command to the server, which is not limited by the embodiment of the present invention.
  • the server by acquiring information and transmitting the information to the server, the server is capable of determining a device that responds to the voice instruction from the plurality of devices, and enabling the response voice for the user having the plurality of different devices.
  • the intelligent selection of the commanded device provides users with more Convenient and natural human-computer interaction experience.
  • FIG. 5 is a schematic flowchart of a communication method 500 according to another embodiment of the present invention. Multiple devices of the same user can simultaneously receive the same voice command from the user. Communication method 500 can be performed by any of a plurality of devices of the same user. In particular, communication method 500 can be performed by a voice aid in a device or device. As shown in FIG. 5, the communication method 500 includes:
  • Acquire information where the information includes a device type.
  • the receiving server sends, according to the information, indication information that is used to indicate an operation corresponding to the second voice instruction.
  • the information may further include at least one of a scene mode and a voice instruction in which the device is located.
  • step 540 and step 560 can be performed separately or simultaneously.
  • the information and the second voice instruction may be separately sent to the server, and the information and the second voice command may be simultaneously sent to the server.
  • the server can send the obtained information and the received voice instruction to the server, so that the server can determine, according to the information, the device that responds to the voice instruction from the multiple devices of the same user, and the operation corresponding to the voice instruction.
  • the indication information is sent to the device that responds to the voice instruction. For a user who has multiple different devices, the intelligent selection of the device that responds to the voice instruction can be realized, and the user is provided with a more convenient and natural human-computer interaction experience.
  • FIG. 6 is a schematic flowchart of a communication method 600 according to another embodiment of the present invention. Multiple devices of the same user can simultaneously receive the same voice command from the user.
  • the communication method 600 can be performed by any of a plurality of devices of the same user.
  • communication method 600 can be performed by a voice aid in a device or device. As shown in FIG. 6, the communication method 600 includes:
  • the information of the device is used to distinguish multiple devices of the same user.
  • the information of the device may be a device type, for example, a mobile phone, a wristband, an in-vehicle device, an audio device, and the like, and may also be a name of the device, or a number of the device, and the like. Multiple devices of the same user can be used.
  • a voice operation parsing request is sent to the server, and the voice operation parsing request carries the second voice command.
  • the second voice instruction when it is determined that the second voice instruction does not include the information of the device, the second voice instruction is not responded.
  • the voice resolution request is not sent to the server.
  • the device can discard the second voice instruction.
  • the device may also stop processing the second voice instruction.
  • the information of the device may be pre-stored in the device, and when the information received by the device includes the information of the device, the voice operation parsing request is sent to the server. When the voice command received by the device does not include the information of the device, the voice command is not responded.
  • the device may further send, for example, a device type to the server, to request the server to determine a device that responds to the voice instruction from the plurality of devices of the user.
  • the first voice command may be a voice wake-up command
  • the second voice command may be a voice operation command.
  • the voice wake-up command and the voice operation command can be simultaneously received, for example, receiving a voice command “hi, Allen, and calling the phone with the mobile phone” issued by the user.
  • the voice wake-up command and the voice operation command may also be separately received.
  • the voice wake-up command “hi, Allen” sent by the user is first received into the awake state, and the voice operation command sent by the user is received again during the response duration. Zhang San called.” This embodiment of the present invention is not limited thereto.
  • the intelligent selection of the device responding to the voice instruction can be realized, thereby providing the user with more convenient and natural. Human-computer interaction experience.
  • FIG. 7 is a schematic flowchart of a communication method 700 according to another embodiment of the present invention. As shown in FIG. 7, the communication method 700 includes the following.
  • Steps 701a, 701b, and 701c the voice assistants of the first device, the second device, and the third device simultaneously receive the voice command of "hi, Allen, open map", wherein “hi, Allen” is voice The wake-up command, "open map” is a voice operation command.
  • Steps 702a, 702b, and 702c after the voice assistants of the first device, the second device, and the third device enter the awake state according to "hi, Allen", the voice operation instruction is cached and the scene mode and device type in which the device is located are respectively obtained. ;
  • Steps 703a, 703b, and 703c the voice assistants of the first device, the second device, and the third device respectively send a voice operation parsing request to the server, where the voice operation parsing request carries the current scene mode, device type, and voice operation instruction of the device. Open the map";
  • Step 704 The server parses the voice operation instruction, determines that the operation to be performed is “open map”, and determines the device that needs to perform the operation, for example, the second device, according to the scenario mode and the device type;
  • Step 705a The server returns a response message carrying the dormancy indication information to the voice assistant of the first device, and notifies the voice assistant of the first device to perform an operation of “opening the map” by the voice assistant of the second device;
  • Step 705b The server returns a response message to the voice assistant in the second device, that is, returns indication information indicating that the performed operation "open map" is performed;
  • Step 705c The server returns a response message carrying the dormancy indication information to the voice assistant in the third device, and notifies the voice assistant of the third device to perform an operation of “opening the map” by the voice assistant of the second device;
  • Steps 706a and 706c the voice assistant of the first device and the voice assistant of the third device enter a sleep state, and in the sleep state, the low-power voice wake-up module is still in the listening state;
  • Step 705b The voice assistant of the second device is in an awake state.
  • the voice assistant of the first device and the voice assistant of the third device can switch from the sleep state to the normal state.
  • FIG. 8 is a schematic flow chart of a communication method 800 in accordance with another embodiment of the present invention. As shown in FIG. 8, communication method 800 includes the following.
  • Steps 801a, 801b, and 801c the voice assistants of the first device, the second device, and the third device simultaneously receive the voice wake-up command of "hi, Allen";
  • Steps 802a, 802b, and 802c the voice assistants of the first device, the second device, and the third device respectively acquire the scene mode and device type in which the three devices access the awake state according to "hi, Allen";
  • Steps 803a, 803b, and 803c the respective voice assistants of the first device, the second device, and the third device respectively send the acquisition response device carrying the scenario mode and device type in which the device is located to the server. begging;
  • Step 804 The server determines, according to the scenario mode and the device type, a device that needs to perform an operation corresponding to the voice operation instruction, for example, a second device.
  • Steps 805a, 805b, and 805c the voice assistants of the first device, the second device, and the third device continue to receive the voice operation instruction while performing the foregoing operation steps;
  • Steps 806a, 806b, and 806c the respective voice assistants of the first device, the second device, and the third device respectively cache the voice operation instruction "open map".
  • Steps 807a, 807b, and 807c the voice assistants of the first device, the second device, and the third device respectively send a voice operation analysis request carrying the voice operation instruction "open map" to the server;
  • Step 808 The server parses the sound operation instruction, and analyzes that the operation that needs to be performed is “open map”;
  • Step 809a The server returns a response message carrying the dormancy indication information to the voice assistant of the first device, and notifies the voice assistant to perform an operation of “opening the map” by the voice assistant of the second device;
  • Step 809b The server returns response information to the voice assistant of the second device, that is, returns indication information for indicating the performed operation "open map";
  • Step 809c The server returns a response message carrying the dormancy indication information to the voice assistant of the third device, and notifies the voice assistant to perform an operation of “opening the map” by the voice assistant of the second device;
  • Steps 810a and 810c the voice assistant of the first device and the voice assistant of the third device enter a sleep state, and in the sleep state, the low-power voice wake-up module is still in the listening state;
  • Step 810b the voice assistant of the second device is in an awake state
  • the voice assistant of the first device and the voice assistant of the third device can switch from the sleep state to the normal state.
  • step 803 (803a, 803b, 803c) and step 804, and step 805 (805a, 805b, 805c), step 806 (806a, 806b, 806c), step 807 (807a, 807b, 807c) can be synchronized, no time.
  • FIG. 9 is a schematic flow chart of a communication method 900 in accordance with another embodiment of the present invention. As shown in FIG. 9, the communication method 900 includes the following.
  • Steps 901a, 901b, and 901c the voice assistants of the first device, the second device, and the third device simultaneously receive the voice wake-up command of "hi, Allen";
  • Steps 902a, 902b, and 902c the voice assistants of the first device, the second device, and the third device enter the awake state according to "hi, Allen", respectively acquiring the scene mode and device where the device is located.
  • Steps 903a, 903b, and 903c the respective voice assistants of the first device, the second device, and the third device respectively send a request for acquiring a response device carrying the context mode and the device type to the server;
  • Step 904 The server determines, according to the scenario mode and the device type, a device that needs to perform an operation, for example, a second device.
  • Step 905a The server returns a response message carrying the sleep indication information to the voice assistant of the first device, and notifies the voice assistant of the first device to perform an operation by the voice assistant of the second device.
  • Step 905b The server returns response information to the voice assistant of the second device, that is, the device that responds to the voice command is notified to be the second device.
  • Step 905c The server returns a response message carrying the dormancy indication information to the voice assistant in the third device, and notifies the voice assistant of the third device to perform an operation by the voice assistant of the second device.
  • Steps 906a and 906c the voice assistant of the first device and the voice assistant of the third device enter a sleep state, and in the sleep state, the low-power voice wake-up module is still in the listening state;
  • Step 906b The voice assistant of the second device is in an awake state
  • Steps 907a, 907b, and 907c the voice assistants of the first device, the second device, and the third device continue to receive the voice operation instruction while performing the foregoing operation steps;
  • Steps 908a, 908b, 908c the respective voice assistants of the first device, the second device, and the third device respectively cache the voice operation instruction "open map";
  • Step 909 The voice assistant of the second device sends a voice operation parsing request carrying the voice operation instruction “open map” to the server;
  • Step 910 The server parses the voice operation instruction, and analyzes that the operation that needs to be performed is “opening the map”;
  • Step 911 The server returns response information to the voice assistant of the second device, that is, returns indication information for indicating the performed operation "open map”.
  • the voice assistant of the second device After receiving the response message, the voice assistant of the second device performs an operation of “opening the map” according to the indication information;
  • the voice assistant of the first device and the voice assistant of the third device can switch from the sleep state to the normal state.
  • step 907 (907a, 907b, 907c) and step 908 (908a, 908b, 908c), and steps 903 (903a, 903b, 903c), 904, 905 (905a, 905b, 905c) and 906 (906a, The order of execution of 906b, 906c) is not chronological.
  • FIG. 10 is a schematic flow chart of a communication method 1000 according to another embodiment of the present invention. As shown in FIG. 10, the communication method 1000 includes the following.
  • Steps 1001a, 1001b, and 1001c the voice assistants of the first device, the second device, and the third device simultaneously receive the voice command of “hi, Allen, open map”, where “hi, Allen” is a voice wake-up command, “open” "Map” is a voice operation instruction;
  • Steps 1002a, 1002b, and 1002c the voice assistants of the first device, the second device, and the third device enter the awake state according to "hi, Allen", and after the voice assistant enters the awake state, the voice operation command is cached and acquired respectively to the device. Its equipment type;
  • Steps 1003a, 1003b, and 1003c respective voice assistants of the first device, the second device, and the third device respectively send a voice operation parsing request to the server, where the voice operation parsing request includes a device type and a voice request command "open map";
  • Step 1004 The server parses the voice operation instruction “open map”, and obtains the operation and semantic “open map” that need to be performed currently, and determines that the current device has an in-vehicle device, such as the second device, according to the type of the device carried by the voice parsing request. And determining, according to the semantics and the device type, that the current device that responds to the voice instruction is the second device;
  • Step 1005a The server returns a response message that is performed by the voice assistant of the second device to the voice assistant of the first device;
  • Step 1005b The server returns a response message to the second voice assistant, where the response message carries indication information for indicating the operation.
  • Step 1005c The server returns a response message to the third voice assistant to perform an operation by the voice assistant of the second device.
  • FIG. 11 is a schematic flow chart of a communication method 1100 according to another embodiment of the present invention. As shown in FIG. 11, the communication method 1100 includes the following.
  • Steps 1101a, 1101b, and 1101c the voice assistants of the first device, the second device, and the third device simultaneously receive the voice command of “hi, Allen, the phone calls Zhang San”;
  • the device type and/or the device name are defined and stored in the first device, the second device, and the third device of the same user, for example, the device type is a mobile phone, an in-vehicle device, or a wristband.
  • the voice assistant of the first device and the voice assistant of the third device are in a sleep state (in this state, the low power wakeup module is still in an active state), and the voice assistant of the second device is in an awake state.
  • a voice command of "hi, Allen, open navigation with the vehicle device” may also be used; “hi, Allen, turn on the TV”; “hi, Allen, use the ring to send a text message to Li Si, “I am here” and so on.
  • Step 1102a The voice assistant of the first device enters the awake state from the sleep state according to the voice wake-up instruction "hi, Allen", and determines that the voice operation instruction includes information of the first device, such as "mobile phone”;
  • Step 1102b The voice assistant of the second device continues to maintain the awake state according to "hi, Allen", and determines that the voice operation instruction does not include local information, such as "second device”, and does not respond to the voice operation instruction;
  • Step 1102c The voice assistant of the third device enters the awake state from the sleep state according to “hi, Allen”, and determines that the information of the third device is not included in the voice operation instruction, such as “hand ring”, and does not respond to the voice operation instruction;
  • Step 1103 The voice assistant of the first device sends a voice parsing request carrying a voice operation instruction “calling to Zhang San” to the server;
  • Step 1104 The server parses the voice operation instruction, and analyzes that the operation required to be performed is “calling”, and the phone receiver is “Zhang San”;
  • Step 1105 The server returns a response message to the voice assistant of the first device, where the response message carries indication information for indicating the operation.
  • the voice assistant of the first device After receiving the response message, the voice assistant of the first device searches for the phone number of Zhang San according to the instruction information and calls him.
  • FIG. 12 is a schematic flow chart of a communication method 1200 according to another embodiment of the present invention. As shown in FIG. 12, the communication method 1200 includes the following.
  • Step 1201 The first device, the second device, and the third device implement an ad hoc network.
  • Steps 1202a, 1202b, and 1202c the voice assistants of the first device, the second device, and the third device simultaneously receive the voice command of “hi, Allen, open map”, where “hi, Allen” is a voice wake-up command, “open” "Map” is a voice operation instruction;
  • Steps 1203a, 1203b, and 1203c the voice assistants of the first device, the second device, and the third device respectively enter the awake state according to "hi, Allen", and the voice assistant caches the voice operation command and obtains the scenario in which the device is located. Mode and device type;
  • Step 1204 The controller of the ad hoc network determines, according to the scenario mode and the device type, a device that responds to the voice instruction in the scenario mode, such as the second device.
  • Step 1205a The voice assistant of the first device receives the response message carrying the sleep indication information, and notifies the voice assistant to complete the operation corresponding to the voice operation instruction by the second device.
  • Step 1205b The second device is a device that responds to the voice instruction, so the voice assistant of the second device In the awake state;
  • Step 1205c The voice assistant of the third device receives the response message carrying the sleep indication information, and notifies the voice assistant to complete the operation corresponding to the voice operation instruction by the voice assistant of the second device.
  • Step 1206 The voice assistant of the second device sends a voice operation parsing request carrying the voice operation instruction “open map” to the server;
  • Step 1207 The server parses the voice operation instruction “Open Map”, and determines that the operation required by the voice assistant of the second device is “open map”;
  • Step 1208 The server returns a response message to the voice assistant of the second device, where the response message carries indication information indicating that the operation "open map" is indicated.
  • FIG. 13 is a schematic block diagram of a server 1300 in accordance with an embodiment of the present invention.
  • the server communicates with multiple devices of the same user, and multiple devices can simultaneously receive the same voice operation instruction issued by the user.
  • the server 1300 includes:
  • the receiving unit 1310 is configured to receive information sent by each device of the multiple devices of the same user, where the information includes a device type.
  • the processing unit 1320 is configured to determine, according to the information received by the receiving unit 1310, a device that responds to the voice instruction from the plurality of devices;
  • the sending unit 1330 is configured to send a message to other devices in the plurality of devices that respond to the voice command, where the message is used to indicate that the voice assistant of the other device does not respond to the voice command.
  • the user who has multiple different devices can respond
  • the intelligent selection of voice-instructed devices provides users with a more convenient and natural human-computer interaction experience.
  • the information sent by each device may further include at least one of a scene mode and a voice instruction in which the device is located.
  • the processing unit 1320 is specifically configured to:
  • a device that responds to voice instructions is determined from a plurality of devices based on the device type and the semantics of the voice instructions.
  • the processing unit 1320 is further configured to determine an operation corresponding to the voice instruction.
  • the transmitting unit 1330 transmits indication information indicating the operation to the device that responds to the voice instruction.
  • the message sent to the other device may also carry the dormancy indication information.
  • the controller can be any of a plurality of devices.
  • server 1300 may correspond to the server in the aforementioned communication method 200, and the above and other operations and/or functions of the respective modules/units in the server 1300 are respectively implemented in order to implement the corresponding flow of the communication method 200 of FIG. I will not repeat them here.
  • the user who has multiple different devices can respond
  • the intelligent selection of voice-instructed devices provides users with a more convenient and natural human-computer interaction experience.
  • FIG. 14 is a schematic block diagram of a server 1400 in accordance with an embodiment of the present invention.
  • the server communicates with multiple devices of the same user, and multiple devices can simultaneously receive the same voice operation instruction issued by the user.
  • the server 1400 includes:
  • the receiving unit 1410 is configured to receive the same voice command sent by each device of the multiple devices of the same user;
  • the processing unit 1420 is configured to determine an operation corresponding to the voice instruction received by the receiving unit 1410;
  • the sending unit 1430 is configured to: send, by the device that responds to the voice instruction, indication information for indicating the operation, where the device that responds to the voice instruction is determined according to information sent by each of the multiple devices, where the information includes a device type.
  • the information may further include at least one of a scene mode and a voice instruction in which the device is located.
  • the method for determining, by the server 1400, the device that responds to the voice command according to the information sent by each device of the multiple devices may refer to the related description of the server 1100. To avoid repetition, details are not described herein again.
  • server 1400 may correspond to a server in the aforementioned communication method 300, and that the above and other operations and/or functions of the various modules/units in the server 1400 are respectively implemented in order to implement the corresponding flow of the communication method 300 of FIG. , will not repeat them here.
  • the intelligent selection of the device responding to the voice instruction can be realized. Choice, to provide users with a more convenient and natural human-computer interaction experience.
  • Figure 15 is a schematic block diagram of an apparatus 1500 in accordance with an embodiment of the present invention.
  • a plurality of devices of the same user can simultaneously receive the same voice wake-up command or voice operation command issued by the user, and the device 1500 can be any one of the plurality of devices.
  • the device 1500 includes:
  • the receiving unit 1510 is configured to receive a first voice instruction.
  • the processing unit 1520 is configured to enter an awake state according to the first voice instruction received by the receiving unit 1510.
  • An obtaining unit 1530 configured to acquire information, where the information includes a device type
  • a sending unit 1540 configured to send the information by the server
  • the receiving unit 1510 is further configured to: receive a first message sent by the server according to the information, where the first message is used to indicate that the voice assistant of the device 1500 does not respond to the voice instruction; or the second message sent by the receiving server according to the information, the second message The voice assistant for indicating the device 1500 responds to the voice command.
  • the server by acquiring information and transmitting the information to the server, the server is capable of determining, from the plurality of devices, the device that responds to the voice instruction, and for the user having the plurality of different devices, enabling the response voice command.
  • the intelligent selection of devices provides users with a more convenient and natural human-computer interaction experience.
  • the information further includes at least one of a context mode and a voice command in which the device 1500 is located.
  • the receiving unit 1510 is further configured to: receive, by the server, indication information for indicating an operation corresponding to the voice instruction, where the information further includes the voice instruction.
  • the first message may further carry the dormant indication information
  • the processing unit 1520 may be further configured to enter the dormant state according to the dormancy indication information.
  • the receiving unit 1510 when the receiving unit 1510 receives the first message, the receiving unit 1510 is further configured to receive the second voice instruction, and the processing unit 1520 is further configured to: not respond to the second voice instruction received by the receiving unit 1510.
  • the receiving unit 1510 when the receiving unit 1510 receives the second message, the receiving unit 1510 is further configured to receive the third voice instruction, and the sending unit 1520 is further configured to: send the third voice command received by the receiving unit 1510 to the server;
  • the unit 1510 is further configured to: receive a third message that is sent by the server according to the third voice instruction, where the third message is used to indicate an operation corresponding to the third voice instruction; and the processing unit 1520 is further configured to perform, according to the third message, the third voice instruction corresponding to the third voice instruction. Operation.
  • the device 1500 may correspond to the devices in the aforementioned communication method 400, and the above and other operations and/or functions of the respective modules/units in the device 1500 respectively implement the communication method of FIG. The corresponding flow of 400 is not repeated here for brevity.
  • the server by acquiring information and transmitting the information to the server, the server is capable of determining, from the plurality of devices, the device that responds to the voice instruction, and for the user having the plurality of different devices, enabling the response voice command.
  • the intelligent selection of devices provides users with a more convenient and natural human-computer interaction experience.
  • FIG. 16 is a schematic block diagram of a device 1600 in accordance with an embodiment of the present invention.
  • a plurality of devices of the same user can simultaneously receive the same voice wake-up command or voice operation command issued by the user, and the device 1600 can be any one of the plurality of devices.
  • the device 1600 includes a receiving unit 1610, a processing unit 1620, an obtaining unit 1630, and a transmitting unit 1640.
  • the receiving unit 1610 is configured to receive a first voice instruction.
  • the processing unit 1620 is configured to enter an awake state according to the first voice instruction
  • An obtaining unit 1630 configured to acquire information, where the information includes a device type
  • the sending unit 1640 is configured to send the information to the server.
  • the receiving unit 1610 is further configured to receive a second voice instruction.
  • the sending unit 1640 is further configured to send a second voice instruction to the server;
  • the receiving unit 1610 is further configured to: receive, by the server, indication information that is used to indicate an operation corresponding to the second voice instruction, according to the information.
  • the information may further include at least one of a scene mode and a voice instruction in which the device is located.
  • 1600 may correspond to the devices in accordance with the aforementioned communication method 500, and that the above and other operations and/or functions of the various modules/units in device 1600, respectively, in order to implement the respective processes of communication method 500 of FIG. 5, for brevity, I will not repeat them here.
  • the server can send the obtained information and the received voice instruction to the server, so that the server can determine, according to the information, the device that responds to the voice instruction from the multiple devices of the same user, and the operation corresponding to the voice instruction.
  • the indication information is sent to the device that responds to the voice instruction. For a user who has multiple different devices, the intelligent selection of the device that responds to the voice instruction can be realized, and the user is provided with a more convenient and natural human-computer interaction experience.
  • FIG. 17 is a schematic block diagram of another device 1700 in accordance with an embodiment of the present invention.
  • a plurality of devices of the same user can simultaneously receive the same voice command issued by the user, and the device 1400 can be any one of the plurality of devices.
  • the device 1700 includes:
  • the receiving unit 1710 is configured to receive a first voice instruction.
  • the processing unit 1720 is configured to enter an awake according to the first voice instruction received by the receiving unit 1710. state;
  • the receiving unit 1710 is further configured to receive a second voice instruction.
  • the processing unit 1720 is further configured to determine that the second voice instruction received by the receiving unit 1710 includes information of the device 1700 in response to the second voice instruction.
  • the device 1700 can correspond to the devices in the aforementioned communication method 600, and the above and other operations and/or functions of the various modules/units in the device 1700 are respectively implemented in order to implement the corresponding flow of the communication method 600 of FIG. I will not repeat them here.
  • the voice command is automatically responded, so that the intelligent selection of the device responding to the voice instruction can be realized, and the user is provided with a more convenient and natural man-machine. Interactive experience.
  • FIG. 18 is a schematic block diagram of a server 1800 in accordance with an embodiment of the present invention.
  • the server communicates with multiple devices of the same user, and multiple devices can simultaneously receive the same voice command from the user.
  • server 1800 includes one or more processors 1810, memory 1820, bus system 1830, transceiver 1840, and one or more programs.
  • processors 1810, memory 1820, and transceiver 1840 are coupled by a bus system 1830.
  • One or more of the programs are stored in memory 1820 and configured to be executed by the one or more processors 1810, the one or more programs including instructions for:
  • a message is sent by the transceiver 1840 to other devices in the plurality of devices that respond to the voice command, the message being used to indicate that the voice assistant of the other device does not respond to the voice command.
  • the response voice can be implemented for users having multiple different devices.
  • the intelligent selection of the commanded device provides users with a more convenient and natural human-computer interaction experience.
  • the processor 1810 may be a central processing unit (CPU), and the processor 1810 may also be other general-purpose processors, digital signal processing (Digital Signal Processing, referred to as DSP), Application Specific Integrated Circuit (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic device, discrete gate or transistor logic Pieces, discrete hardware components, etc.
  • DSP Digital Signal Processing
  • ASIC Application Specific Integrated Circuit
  • FPGA Field-Programmable Gate Array
  • the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
  • the memory 1820 can include read only memory and random access memory and provides instructions and data to the processor 1810. A portion of memory 1820 may also include non-volatile random access memory. For example, the memory 1820 can also store information of the device type.
  • the bus system 1830 may include a power bus, a control bus, a status signal bus, and the like in addition to the data bus. However, for clarity of description, various buses are labeled as bus system 1830 in the figure.
  • each step of the above method may be completed by an integrated logic circuit of hardware in the processor 1810 or an instruction in a form of software.
  • the steps of the method disclosed in the embodiments of the present invention may be directly implemented as a hardware processor, or may be performed by a combination of hardware and software modules in the processor.
  • the software modules can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory, or electrically erasable programmable memory, registers, and the like.
  • the storage medium is located in the memory 1820, and the processor 1810 reads the information in the memory 1820 and, in conjunction with its hardware, performs the steps of the above method. To avoid repetition, it will not be described in detail here.
  • the memory 1820 may also store response priority information of multiple device types, and may also store different device information of the same user, different context modes, and priority information of corresponding response devices under different device types.
  • the information sent by each device may further include at least one of a scene mode and a voice instruction in which the device is located.
  • the instruction is further used to:
  • the device that responds to the voice command is determined based on the device type and the semantics of the voice command.
  • the instruction is further configured to: determine an operation corresponding to the voice instruction; and send, by the transceiver 1840, indication information for indicating the operation to the device that responds to the voice instruction.
  • server 1800 may correspond to a server in the aforementioned communication method 200, and the above and other operations and/or functions of the respective modules/units in the server 1800 are respectively implemented in order to implement the corresponding flow of the communication method 200 of FIG. I will not repeat them here.
  • a computer readable medium comprising computer readable instructions that, when executed, perform the operations of 210 to 230 in the aforementioned communication method 200.
  • a computer program product including the computer readable medium described above.
  • the user who has multiple different devices can respond
  • the intelligent selection of voice-instructed devices provides users with a more convenient and natural human-computer interaction experience.
  • server 1900 is a schematic block diagram of a server 1900 in accordance with an embodiment of the present invention.
  • the server communicates with multiple devices of the same user, and multiple devices can simultaneously receive the same voice command from the user.
  • server 1900 includes one or more processors 1910, memory 1920, bus system 1930, transceiver 1940, and one or more programs.
  • Processor 1910, memory 1920, and transceiver 1940 are coupled by a bus system 1930.
  • the one or more programs are stored in the memory 1920 and configured to be executed by the one or more processors 1910, the one or more programs including instructions for:
  • the indication information indicating the operation is sent to the device in response to the voice instruction in the plurality of devices by the transceiver 1940, and the device responding to the voice instruction is determined according to the information sent by each of the plurality of devices, the information including the device type .
  • the information may further include at least one of a scene mode and a voice instruction in which the device is located.
  • the processor 1910 may be a CPU, and the processor 1910 may also be other general-purpose processors, DSPs, ASICs, FPGAs, or other programmable logic devices, discrete gates or transistor logic devices, and discrete Hardware components, etc.
  • the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
  • the memory 1920 can include read only memory and random access memory and provides instructions and data to the processor 1910.
  • a portion of the memory 1920 may also include a non-volatile random access memory.
  • the memory 1920 can also store information of the device type.
  • the bus system 1930 may include a power bus, a control bus, a status signal bus, and the like in addition to the data bus. However, for clarity of description, various buses are labeled as bus system 1930 in the figure.
  • each step of the above method may pass through an integrated logic of hardware in the processor 1910. Completion of instructions in circuit or software form.
  • the steps of the method disclosed in the embodiments of the present invention may be directly implemented as a hardware processor, or may be performed by a combination of hardware and software modules in the processor.
  • the software modules can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory, or electrically erasable programmable memory, registers, and the like.
  • the storage medium is located in memory 1920, and processor 1910 reads the information in memory 1920 and, in conjunction with its hardware, performs the steps of the above method. To avoid repetition, it will not be described in detail here.
  • server 1900 can correspond to the servers in the aforementioned communication method 300, and that the above and other operations and/or functions of the various modules/units in the server 1900 are respectively implemented in order to implement the corresponding flow of the communication method 300 of FIG. I will not repeat them here.
  • a computer readable medium comprising computer readable instructions that, when executed, perform the operations of 310 to 330 of the aforementioned communication method 300.
  • the operations of the optional steps in the aforementioned communication method 300 may also be performed.
  • a computer program product including the computer readable medium described above.
  • the user who has multiple different devices can realize the intelligent selection of the device responding to the voice instruction, thereby providing the user with more convenient Natural human-computer interaction experience.
  • FIG. 20 is a schematic block diagram of an apparatus 2000 in accordance with another embodiment of the present invention. Multiple devices of the same user can receive the same voice command from the user at the same time, and the device 2000 can be any device of multiple devices. As shown in FIG. 20, device 2000 includes one or more processors 2010, memory 2020, bus system 2030, transceiver 2040, and one or more programs. Processor 2010, memory 2020, and transceiver 2040 are coupled by a bus system 2030. Wherein the one or more programs are stored in the memory 2020 and configured to be executed by the one or more processors 2010, the one or more programs comprising instructions for:
  • Get information including the device type
  • the transceiver 2040 Receiving, by the transceiver 2040, the first message sent by the server according to the information, where the first message is used to indicate that the voice assistant of the device 2000 does not respond to the voice command, or the second message sent by the server according to the information is received by the transceiver, and the second message is used by the second message.
  • the voice assistant of the pointing device 2000 responds to the voice command.
  • the instruction may acquire information of the device 2000 from the memory 2020.
  • the server by acquiring information and transmitting the information to the server, the server is capable of determining, from the plurality of devices, the device that responds to the voice instruction, and for the user having the plurality of different devices, enabling the response voice command.
  • the intelligent selection of devices provides users with a more convenient and natural human-computer interaction experience.
  • the processor 2010 may be a CPU, and the processor 2010 may also be other general-purpose processors, DSPs, ASICs, field programmable gate array FPGAs or other programmable logic devices, discrete doors or Transistor logic devices, discrete hardware components, etc.
  • the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
  • the memory 2020 can include read only memory and random access memory and provides instructions and data to the processor 2010.
  • a portion of the memory 2020 can also include a non-volatile random access memory.
  • the memory 2020 can also store information of the device type.
  • the bus system 2030 may include a power bus, a control bus, a status signal bus, and the like in addition to the data bus. However, for clarity of description, various buses are labeled as bus system 2030 in the figure.
  • each step of the foregoing method may be completed by an integrated logic circuit of hardware in the processor 2010 or an instruction in a form of software.
  • the steps of the method disclosed in the embodiments of the present invention may be directly implemented as a hardware processor, or may be performed by a combination of hardware and software modules in the processor.
  • the software modules can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory, or electrically erasable programmable memory, registers, and the like.
  • the storage medium is located in the memory 2020, and the processor 2010 reads the information in the memory 2020 and completes the steps of the above method in combination with its hardware. To avoid repetition, it will not be described in detail here.
  • the information of the device 2000 may further include at least one of a scene mode and a voice instruction in which the device 2000 is located.
  • the instruction may be further configured to receive, by the transceiver 2040, indication information sent by the server for indicating an operation corresponding to the voice instruction, the information further including the voice instruction.
  • the first message may further carry the dormancy indication information, where the instruction may further be used to cause the device 2000 to enter a dormant state according to the dormancy indication information.
  • the instruction is further used to:
  • the second voice instruction received by the transceiver 2040 is not responded to.
  • the instruction is further used to:
  • the operation corresponding to the third voice instruction is performed according to the third message.
  • the device 2000 may correspond to the devices in the aforementioned communication method 400, and the above and other operations and/or functions of the respective modules/units in the device 2000 are respectively implemented in order to implement the corresponding flow of the communication method 400 of FIG. I will not repeat them here.
  • a computer readable medium comprising computer readable instructions that, when executed, perform the operations 410 through 450 of the aforementioned communication method 400.
  • the operations of the optional steps in the aforementioned communication method 400 may also be performed.
  • a computer program product including the computer readable medium described above.
  • the server by acquiring information and transmitting the information to the server, the server is capable of determining, from the plurality of devices, the device that responds to the voice instruction, and for the user having the plurality of different devices, enabling the response voice command.
  • the intelligent selection of devices provides users with a more convenient and natural human-computer interaction experience.
  • device 2100 is a schematic block diagram of a device 2100 in accordance with another embodiment of the present invention.
  • a plurality of devices of the same user can simultaneously receive the same voice command issued by the user, and the device 2100 can be any one of the plurality of devices.
  • device 2100 includes one or more processors 2110, memory 2120, bus system 2130, transceiver 2140, and one or more programs.
  • the processor 2110, the memory 2120, and the transceiver 2140 are connected by a bus system 2130.
  • the one or more programs are stored in the memory 2120 and configured to be executed by the one or more processors 2110, the one or more programs including instructions for:
  • Get information including the device type
  • the indication information sent by the server according to the information for indicating an operation corresponding to the second voice instruction is received by the transceiver.
  • the information further includes at least one of a profile and/or a voice command in which the device can be located.
  • the processor 2110 may be a CPU, and the processor 2110 may also be other general-purpose processors, DSPs, ASICs, field programmable gate array FPGAs or other programmable logic devices, discrete gates or Transistor logic devices, discrete hardware components, etc.
  • the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
  • the memory 2120 can include read only memory and random access memory and provides instructions and data to the processor 2110. A portion of the memory 2120 can also include a non-volatile random access memory. For example, the memory 2120 can also store information of the device type.
  • the bus system 2130 may include a power bus, a control bus, a status signal bus, and the like in addition to the data bus. However, for clarity of description, various buses are labeled as bus system 2130 in the figure.
  • each step of the above method may be completed by an integrated logic circuit of hardware in the processor 2110 or an instruction in a form of software.
  • the steps of the method disclosed in the embodiments of the present invention may be directly implemented as a hardware processor, or may be performed by a combination of hardware and software modules in the processor.
  • the software modules can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory, or electrically erasable programmable memory, registers, and the like.
  • the storage medium is located in the memory 2120, and the processor 2110 reads the information in the memory 2120 and completes the steps of the above method in combination with its hardware. To avoid repetition, it will not be described in detail here.
  • the device 2100 may correspond to the devices in the aforementioned communication method 500, and the above and other operations and/or functions of the respective modules/units in the device 2100, respectively, in order to implement the corresponding flow of the communication method 500 of FIG. 5, for the sake of brevity, I will not repeat them here.
  • a computer readable medium comprising computer readable instructions that, when executed, perform the operations of 510 through 570 of the aforementioned communication method 500.
  • the operations of the optional steps in the aforementioned communication method 500 may also be performed.
  • a computer program product including the computer readable medium described above.
  • the server can send the obtained information and the received voice instruction to the server, so that the server can determine, according to the information, the device that responds to the voice instruction from the multiple devices of the same user, and the operation corresponding to the voice instruction.
  • the indication information is sent to the device responding to the voice instruction, and for the user having multiple different devices, the intelligent selection of the device responding to the voice instruction can be realized. Provide users with a more convenient and natural human-computer interaction experience.
  • FIG. 22 is a schematic block diagram of a device 2200 in accordance with another embodiment of the present invention.
  • a plurality of devices of the same user can simultaneously receive the same voice command issued by the user, and the device 2200 can be any one of the plurality of devices.
  • device 2200 includes one or more processors 2210, memory 2220, bus system 2230, transceiver 2240, and one or more programs.
  • Processor 2210, memory 2220, and transceiver 2240 are coupled by a bus system 2230.
  • One or more of the programs are stored in memory 2220 and configured to be executed by the one or more processors, the one or more programs including instructions for:
  • Determining that the second voice instruction includes information of device 2200 in response to the second voice instruction.
  • the processor 2210 may be a CPU, and the processor 2210 may also be other general-purpose processors, DSPs, ASICs, field programmable gate array FPGAs or other programmable logic devices, discrete gates or Transistor logic devices, discrete hardware components, etc.
  • the general purpose processor may be a microprocessor or the processor or any conventional processor or the like.
  • the memory 2220 can include read only memory and random access memory and provides instructions and data to the processor 2210. A portion of the memory 2220 can also include a non-volatile random access memory. For example, the memory 2220 can also store information of the device type.
  • the bus system 2230 may include a power bus, a control bus, a status signal bus, and the like in addition to the data bus. However, for clarity of description, various buses are labeled as bus system 2230 in the figure.
  • each step of the above method may be completed by an integrated logic circuit of hardware in the processor 2210 or an instruction in a form of software.
  • the steps of the method disclosed in the embodiments of the present invention may be directly implemented as a hardware processor, or may be performed by a combination of hardware and software modules in the processor.
  • the software modules can be located in a conventional storage medium such as random access memory, flash memory, read only memory, programmable read only memory, or electrically erasable programmable memory, registers, and the like.
  • the storage medium is located in the memory 2220, and the processor 2210 reads the information in the memory 2220 and performs the steps of the above method in combination with its hardware. To avoid repetition, it will not be described in detail here.
  • the device 2200 may correspond to the devices in accordance with the aforementioned communication method 600, and the above and other operations and/or functions of the various modules/units in the device 2200, respectively, in order to implement the communication method of FIG.
  • the corresponding process of 600 for the sake of brevity, will not be repeated here.
  • a computer readable medium comprising computer readable instructions that, when executed, perform the operations of 610 through 640 of the aforementioned communication method 600. Alternatively, the operations of the optional steps in the aforementioned communication method 600 may also be performed.
  • a computer program product including the computer readable medium described above.
  • the voice command is automatically responded, so that the intelligent selection of the device responding to the voice instruction can be realized, and the user is provided with a more convenient and natural man-machine. Interactive experience.
  • the term "and/or" is merely an association relationship describing an associated object, indicating that there may be three relationships.
  • a and/or B may indicate that A exists separately, and A and B exist simultaneously, and B cases exist alone.
  • the disclosed systems, devices, and methods may be implemented in other manners.
  • the device embodiments described above are merely illustrative.
  • the division of the unit is only a logical function division.
  • there may be another division manner for example, multiple units or components may be combined or Can be integrated into another system, or some features can be ignored or not executed.
  • the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.
  • the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, may be located in one place, or may be distributed to multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of the embodiment.
  • each functional unit in various embodiments of the present invention may be integrated in one processing unit. It is also possible that each unit physically exists alone, or two or more units may be integrated in one unit.
  • the functions may be stored in a computer readable storage medium if implemented in the form of a software functional unit and sold or used as a standalone product.
  • the technical solution of the present invention which is essential or contributes to the prior art, or a part of the technical solution, may be embodied in the form of a software product, which is stored in a storage medium, including
  • the instructions are used to cause a computer device (which may be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods described in various embodiments of the present invention.
  • the foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, and the program code can be stored. Medium.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Computational Linguistics (AREA)
  • General Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Telephonic Communication Services (AREA)
  • Telephone Function (AREA)
  • User Interface Of Digital Computer (AREA)
PCT/CN2016/092736 2015-08-19 2016-08-01 通信方法、服务器及设备 WO2017028678A1 (zh)

Priority Applications (8)

Application Number Priority Date Filing Date Title
EP16836542.7A EP3316121B1 (en) 2015-08-19 2016-08-01 Communication method, server and device
JP2018508731A JP6571273B2 (ja) 2015-08-19 2016-08-01 通信方法、サーバー、およびデバイス
KR1020187005455A KR102105295B1 (ko) 2015-08-19 2016-08-01 통신 방법, 서버 및 장치
KR1020207011463A KR102327279B1 (ko) 2015-08-19 2016-08-01 통신 방법, 서버 및 장치
EP19213931.9A EP3683672A1 (en) 2015-08-19 2016-08-01 Communication method, server, and device
KR1020217036714A KR102508619B1 (ko) 2015-08-19 2016-08-01 통신 방법, 서버 및 장치
US15/752,139 US11049499B2 (en) 2015-08-19 2016-08-01 Communication method, server, and device
US17/320,909 US12094462B2 (en) 2015-08-19 2021-05-14 Communication method, server, and device

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201510511714.3A CN106469040B (zh) 2015-08-19 2015-08-19 通信方法、服务器及设备
CN201510511714.3 2015-08-19

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US15/752,139 A-371-Of-International US11049499B2 (en) 2015-08-19 2016-08-01 Communication method, server, and device
US17/320,909 Continuation US12094462B2 (en) 2015-08-19 2021-05-14 Communication method, server, and device

Publications (1)

Publication Number Publication Date
WO2017028678A1 true WO2017028678A1 (zh) 2017-02-23

Family

ID=58051904

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2016/092736 WO2017028678A1 (zh) 2015-08-19 2016-08-01 通信方法、服务器及设备

Country Status (6)

Country Link
US (2) US11049499B2 (ko)
EP (2) EP3683672A1 (ko)
JP (3) JP6571273B2 (ko)
KR (3) KR102327279B1 (ko)
CN (1) CN106469040B (ko)
WO (1) WO2017028678A1 (ko)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3718105B1 (de) * 2017-12-02 2023-06-14 Tobias Rückert Dialogsystem und verfahren zur umsetzung von anweisungen eines nutzers

Families Citing this family (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10592611B2 (en) * 2016-10-24 2020-03-17 Conduent Business Services, Llc System for automatic extraction of structure from spoken conversation using lexical and acoustic features
CN107135443B (zh) * 2017-03-29 2020-06-23 联想(北京)有限公司 一种信号处理方法及电子设备
CN107146611B (zh) * 2017-04-10 2020-04-17 北京猎户星空科技有限公司 一种语音响应方法、装置及智能设备
US11250844B2 (en) * 2017-04-12 2022-02-15 Soundhound, Inc. Managing agent engagement in a man-machine dialog
CN107436750A (zh) * 2017-08-16 2017-12-05 联想(北京)有限公司 配置电子设备的方法、设备以及存储设备
CN108305621B (zh) * 2017-08-25 2020-05-05 维沃移动通信有限公司 一种语音指令处理方法及电子设备
KR102417524B1 (ko) * 2017-10-13 2022-07-07 현대자동차주식회사 음성 인식 기반의 자동차 제어 방법
CN107919123B (zh) * 2017-12-07 2022-06-03 北京小米移动软件有限公司 多语音助手控制方法、装置及计算机可读存储介质
US10971173B2 (en) 2017-12-08 2021-04-06 Google Llc Signal processing coordination among digital voice assistant computing devices
WO2019112625A1 (en) * 2017-12-08 2019-06-13 Google Llc Signal processing coordination among digital voice assistant computing devices
CN111386566A (zh) * 2017-12-15 2020-07-07 海尔优家智能科技（北京）有限公司 设备控制方法、云端设备、智能设备、计算机介质及设备
US11151991B2 (en) * 2018-03-30 2021-10-19 Verizon Media Inc. Electronic message transmission
CN108766422B (zh) * 2018-04-02 2020-09-15 青岛海尔科技有限公司 语音设备的响应方法、装置、存储介质及计算机设备
CN110710158B (zh) * 2018-05-07 2022-08-09 谷歌有限责任公司 验证与数字助理应用交接的代理的操作状态
US10198877B1 (en) 2018-05-23 2019-02-05 Google Llc Providing a communications channel between instances of automated assistants
JP6603001B1 (ja) * 2018-05-23 2019-11-06 グーグル エルエルシー 自動アシスタントのインスタンス間への通信チャネルの提供
US11869496B2 (en) * 2018-05-25 2024-01-09 Sony Corporation Information processing device and information processing method, and information processing system
CN109117233A (zh) * 2018-08-22 2019-01-01 百度在线网络技术（北京）有限公司 用于处理信息的方法和装置
CN110875041A (zh) * 2018-08-29 2020-03-10 阿里巴巴集团控股有限公司 语音控制方法、装置及系统
CN109391528A (zh) * 2018-08-31 2019-02-26 百度在线网络技术（北京）有限公司 语音智能设备的唤醒方法、装置、设备及存储介质
CN109377987B (zh) * 2018-08-31 2020-07-28 百度在线网络技术（北京）有限公司 智能语音设备间的交互方法、装置、设备及存储介质
CN109541953A (zh) * 2018-11-27 2019-03-29 深圳狗尾草智能科技有限公司 拓展辅助设备、基于智能机器人的拓展平台及方法
CN109243459A (zh) * 2018-11-30 2019-01-18 广东美的制冷设备有限公司 设备的语音唤醒方法、装置、家电设备和控制系统
EP3874489A1 (en) 2018-12-03 2021-09-08 Google LLC Speech input processing
CN111354336B (zh) * 2018-12-20 2023-12-19 美的集团股份有限公司 分布式语音交互方法、装置、系统及家电设备
KR20200107058A (ko) 2019-03-06 2020-09-16 삼성전자주식회사 복수 개의 엔드 포인트가 포함된 플랜들을 처리하는 방법 및 그 방법을 적용한 전자 장치
CN111696534B (zh) * 2019-03-15 2023-05-23 阿里巴巴集团控股有限公司 语音交互设备和系统、设备控制方法、计算设备以及介质
CN111756604B (zh) * 2019-03-29 2022-04-12 华为技术有限公司 一种设备配合方法、装置及系统
CN111754997B (zh) * 2019-05-09 2023-08-04 北京汇钧科技有限公司 控制装置及其操作方法，和语音交互装置及其操作方法
KR20210008696A (ko) * 2019-07-15 2021-01-25 삼성전자주식회사 전자 장치 및 이의 음성 인식 방법
CN110459221B (zh) * 2019-08-27 2022-02-22 思必驰科技股份有限公司 多设备协同语音交互的方法和装置
CN110718219B (zh) * 2019-09-12 2022-07-22 百度在线网络技术（北京）有限公司 一种语音处理方法、装置、设备和计算机存储介质
CN110784830B (zh) * 2019-09-18 2022-07-29 华为技术有限公司 数据处理方法、蓝牙模块、电子设备与可读存储介质
KR102266413B1 (ko) * 2019-10-30 2021-06-18 에스케이텔레콤 주식회사 단말 제어 장치 및 방법
CN110890092B (zh) * 2019-11-07 2022-08-05 北京小米移动软件有限公司 唤醒控制方法及装置、计算机存储介质
CN110855772B (zh) * 2019-11-08 2022-06-03 北京奇艺世纪科技有限公司 跨设备数据存储方法、系统、装置、设备、服务器及介质
CN111031492B (zh) * 2019-11-25 2021-11-19 荣耀终端有限公司 呼叫需求响应方法、装置及电子设备
EP3836582B1 (en) * 2019-12-09 2024-01-31 Google LLC Relay device for voice commands to be processed by a voice assistant, voice assistant and wireless network
KR20210098250A (ko) * 2020-01-31 2021-08-10 삼성전자주식회사 전자 장치 및 이의 제어 방법
JP7465700B2 (ja) * 2020-03-27 2024-04-11 株式会社デンソーテン 車載装置および車載装置における音声処理方法
CN111694605A (zh) 2020-05-18 2020-09-22 Oppo广东移动通信有限公司 语音信息处理方法及装置、存储介质和电子设备
CN111722824B (zh) * 2020-05-29 2024-04-30 北京小米松果电子有限公司 语音控制方法、装置及计算机存储介质
US11887589B1 (en) * 2020-06-17 2024-01-30 Amazon Technologies, Inc. Voice-based interactions with a graphical user interface
CN111968641B (zh) * 2020-08-20 2023-01-06 Oppo（重庆）智能科技有限公司 语音助手唤醒控制方法及装置、存储介质和电子设备
WO2022102893A1 (ko) 2020-11-11 2022-05-19 삼성전자주식회사 전자 장치, 시스템 및 그 제어 방법
CN112420043A (zh) * 2020-12-03 2021-02-26 深圳市欧瑞博科技股份有限公司 基于语音的智能唤醒方法、装置、电子设备及存储介质
CN112929724B (zh) * 2020-12-31 2022-09-30 海信视像科技股份有限公司 显示设备、机顶盒及远场拾音唤醒控制方法
CN113138559A (zh) * 2021-04-02 2021-07-20 Oppo广东移动通信有限公司 设备交互方法、装置、电子设备及存储介质
CN113450791B (zh) * 2021-04-28 2023-08-04 珠海格力电器股份有限公司 一种语音设备控制方法、装置、存储介质及语音设备
CN113689857B (zh) * 2021-08-20 2024-04-26 北京小米移动软件有限公司 语音协同唤醒方法、装置、电子设备及存储介质
EP4421070A1 (en) 2021-10-18 2024-08-28 Sapiensbio Inc. Novel compound and pharmaceutical composition comprising same
CN116346896A (zh) * 2021-12-23 2023-06-27 比亚迪股份有限公司 车辆信息传递方法、装置和系统
CN114708858A (zh) * 2022-03-07 2022-07-05 云知声智能科技股份有限公司 语音服务方法、装置、电子设备和存储介质
CN116578264A (zh) * 2023-05-16 2023-08-11 润芯微科技(江苏)有限公司 一种投屏内使用语音控制的方法、系统、设备及存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8453058B1 (en) * 2012-02-20 2013-05-28 Google Inc. Crowd-sourced audio shortcuts
CN103456306A (zh) * 2012-05-29 2013-12-18 三星电子株式会社 用于在电子装置中执行语音命令的方法和设备
CN104538030A (zh) * 2014-12-11 2015-04-22 科大讯飞股份有限公司 一种可以通过语音控制家电的控制系统与方法

Family Cites Families (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS58208799A (ja) 1982-05-28 1983-12-05 トヨタ自動車株式会社 車両用音声認識方式
DE69631458T2 (de) * 1995-10-04 2004-07-22 Aisin AW Co., Ltd., Anjo Fahrzeugnavigationssystem
EP0911808B1 (en) * 1997-10-23 2002-05-08 Sony International (Europe) GmbH Speech interface in a home network environment
EP1063636A3 (en) 1999-05-21 2001-11-14 Winbond Electronics Corporation Method and apparatus for standard voice user interface and voice controlled devices
JP2002116787A (ja) 2000-07-10 2002-04-19 Matsushita Electric Ind Co Ltd 優先順位決定装置、優先順位決定方法及び優先順位決定プログラム
JP2003051887A (ja) * 2001-08-06 2003-02-21 Minolta Co Ltd 制御システムおよび制御方法
JP4086280B2 (ja) 2002-01-29 2008-05-14 株式会社東芝 音声入力システム、音声入力方法及び音声入力プログラム
KR100574519B1 (ko) 2003-03-19 2006-04-27 삼성전자주식회사 네트워크를 통한 기기정보의 관리장치 및 방법
JP4131978B2 (ja) 2006-02-24 2008-08-13 本田技研工業株式会社 音声認識機器制御装置
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
JP2008257566A (ja) 2007-04-06 2008-10-23 Kyocera Mita Corp 電子機器
US20110177780A1 (en) * 2010-01-15 2011-07-21 Kabushiki Kaisha Toshiba Wireless communication apparatus
US8359020B2 (en) 2010-08-06 2013-01-22 Google Inc. Automatically monitoring for voice input based on context
TWI488174B (zh) 2011-06-03 2015-06-11 Apple Inc 自動地建立文字資料與音訊資料間之映射
EP3392876A1 (en) 2011-09-30 2018-10-24 Apple Inc. Using context information to facilitate processing of commands in a virtual assistant
US8340975B1 (en) * 2011-10-04 2012-12-25 Theodore Alfred Rosenberger Interactive speech recognition device and system for hands-free building control
US9899040B2 (en) 2012-05-31 2018-02-20 Elwha, Llc Methods and systems for managing adaptation data
CN102831894B (zh) 2012-08-09 2014-07-09 华为终端有限公司 指令处理方法、装置和系统
US9443272B2 (en) * 2012-09-13 2016-09-13 Intel Corporation Methods and apparatus for providing improved access to applications
KR102070196B1 (ko) 2012-09-20 2020-01-30 삼성전자 주식회사 사용자 디바이스에서 상황 인식 서비스 제공 방법 및 장치
US9319019B2 (en) * 2013-02-11 2016-04-19 Symphonic Audio Technologies Corp. Method for augmenting a listening experience
US9361885B2 (en) * 2013-03-12 2016-06-07 Nuance Communications, Inc. Methods and apparatus for detecting a voice command
US9703350B2 (en) * 2013-03-15 2017-07-11 Maxim Integrated Products, Inc. Always-on low-power keyword spotting
US9432499B2 (en) * 2013-05-18 2016-08-30 Loralee Hajdu Peripheral specific selection of automated response messages
WO2014210429A1 (en) * 2013-06-28 2014-12-31 Harman International Industries, Inc. Wireless control of linked devices
US9871865B2 (en) * 2013-07-11 2018-01-16 Neura, Inc. Physical environment profiling through internet of things integration platform
US9978267B2 (en) * 2013-07-21 2018-05-22 Wizedsp Ltd. Systems and methods using acoustic communication
CN103442138A (zh) * 2013-08-26 2013-12-11 华为终端有限公司 语音控制方法、装置及终端
KR20180114252A (ko) * 2013-08-30 2018-10-17 콘비다 와이어리스, 엘엘씨 디지털 홈에서의 스마트 객체 식별
WO2015034295A1 (en) * 2013-09-05 2015-03-12 Samsung Electronics Co., Ltd. Method and apparatus for configuring and recommending device action using user context
US9240182B2 (en) 2013-09-17 2016-01-19 Qualcomm Incorporated Method and apparatus for adjusting detection threshold for activating voice assistant function
JP6463768B2 (ja) * 2013-10-21 2019-02-06 コンヴィーダ ワイヤレス， エルエルシー Ｍ２ｍデバイスのクローリング
CN103561175B (zh) 2013-11-05 2015-04-01 广东欧珀移动通信有限公司 一种使用移动终端进行语音唤醒的方法及其装置
CN103945062B (zh) * 2014-04-16 2017-01-18 华为技术有限公司 一种用户终端的音量调节方法、装置及终端
US20160050315A1 (en) * 2014-08-14 2016-02-18 Harman International Industries, Incorporated Driver status indicator
US10609196B2 (en) * 2014-09-26 2020-03-31 Huawei Technologies Co., Ltd. Method and apparatus for controlling application program, and electronic device
US9318107B1 (en) * 2014-10-09 2016-04-19 Google Inc. Hotword detection on multiple devices
CN104363517B (zh) 2014-11-12 2018-05-11 科大讯飞股份有限公司 基于电视场景及语音助手的语音切换方法及系统
US20160366528A1 (en) * 2015-06-11 2016-12-15 Sony Mobile Communications, Inc. Communication system, audio server, and method for operating a communication system
US10133443B2 (en) * 2015-06-14 2018-11-20 Google Llc Systems and methods for smart home automation using a multifunction status and entry point icon
CN105185379B (zh) * 2015-06-17 2017-08-18 百度在线网络技术（北京）有限公司 声纹认证方法和装置
US20180018973A1 (en) * 2016-07-15 2018-01-18 Google Inc. Speaker verification

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8453058B1 (en) * 2012-02-20 2013-05-28 Google Inc. Crowd-sourced audio shortcuts
CN103456306A (zh) * 2012-05-29 2013-12-18 三星电子株式会社 用于在电子装置中执行语音命令的方法和设备
CN104538030A (zh) * 2014-12-11 2015-04-22 科大讯飞股份有限公司 一种可以通过语音控制家电的控制系统与方法

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3718105B1 (de) * 2017-12-02 2023-06-14 Tobias Rückert Dialogsystem und verfahren zur umsetzung von anweisungen eines nutzers

Also Published As

Publication number Publication date
EP3316121B1 (en) 2020-02-26
EP3683672A1 (en) 2020-07-22
JP6571273B2 (ja) 2019-09-04
US20180247645A1 (en) 2018-08-30
US11049499B2 (en) 2021-06-29
JP6953482B2 (ja) 2021-10-27
KR20180034556A (ko) 2018-04-04
KR102105295B1 (ko) 2020-04-28
EP3316121A4 (en) 2018-07-25
US12094462B2 (en) 2024-09-17
KR20200044156A (ko) 2020-04-28
CN106469040B (zh) 2019-06-21
JP2020003804A (ja) 2020-01-09
US20210272566A1 (en) 2021-09-02
EP3316121A1 (en) 2018-05-02
JP2022008594A (ja) 2022-01-13
KR102327279B1 (ko) 2021-11-16
KR20210138794A (ko) 2021-11-19
JP2018533036A (ja) 2018-11-08
CN106469040A (zh) 2017-03-01
KR102508619B1 (ko) 2023-03-09

Similar Documents

Publication Publication Date Title
WO2017028678A1 (zh) 通信方法、服务器及设备
EP3379853B1 (en) Electronic device for transmitting audio data to multiple external devices
US9704503B2 (en) Command handling method, apparatus, and system
KR20180083587A (ko) 전자 장치 및 그의 동작 방법
KR102356969B1 (ko) 통신 수행 방법 및 이를 지원하는 전자장치
KR102390713B1 (ko) 전자 장치 및 전자 장치의 통화 서비스 제공 방법
CN106201816B (zh) 提醒方法及装置
EP3157003B1 (en) Terminal control method and device, voice control device and terminal
CN106779601B (zh) 可穿戴设备任务计划调整方法和设备
CN112230877A (zh) 一种语音操作方法、装置、存储介质及电子设备
CN104424148B (zh) 发送内容的方法及其电子设备
CN103491240B (zh) 一种闹钟响铃方法、装置及移动终端
US20150153921A1 (en) Apparatuses and methods for inputting a uniform resource locator
CN109544183A (zh) 一种业务咨询方法及装置
US20180367669A1 (en) Input during conversational session
KR20160084778A (ko) 상황별 정보 공유 지원 방법 및 이를 지원하는 전자 장치
US20190320032A1 (en) Method, apparatus, user device and server for displaying personal homepage
US20180314417A1 (en) Electronic device for outputting graphic indication
KR20150086932A (ko) 데이터 처리 방법 및 그 전자 장치
CN111083285A (zh) 一种移动终端通话定位系统和方法
CN117725157A (zh) 对话信息展示方法、装置、电子设备及存储介质
CN115240674A (zh) 终端设备的免唤醒语音控制方法、终端设备及服务器
CN116416987A (zh) 服务器、终端设备、语音唤醒方法及介质
CN114967897A (zh) 一种功耗优化方法、装置及移动终端

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16836542

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2016836542

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 15752139

Country of ref document: US

ENP Entry into the national phase

Ref document number: 2018508731

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20187005455

Country of ref document: KR

Kind code of ref document: A