GB2619894A - Techniques for communication between hub device and multiple endpoints - Google Patents

Techniques for communication between hub device and multiple endpoints Download PDF

Info

Publication number
GB2619894A
GB2619894A GB2315593.0A GB202315593A GB2619894A GB 2619894 A GB2619894 A GB 2619894A GB 202315593 A GB202315593 A GB 202315593A GB 2619894 A GB2619894 A GB 2619894A
Authority
GB
United Kingdom
Prior art keywords
accessory
user device
audio input
accessories
accessory interaction
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
GB2315593.0A
Inventor
S Grubb Jared
M Stewart Robert
Sanchez Gabriel
Jain Anshul
Ur Rehman Ashraf Zaka
J Chandler David
Byrne Andrew
Biswas Anumita
Lee Minsub
Shanbhag Mahesh
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Apple Inc
Original Assignee
Apple Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US17/719,086 external-priority patent/US20220337691A1/en
Priority claimed from US17/718,984 external-priority patent/US11914537B2/en
Priority claimed from US17/718,977 external-priority patent/US20220335938A1/en
Application filed by Apple Inc filed Critical Apple Inc
Priority claimed from PCT/US2022/024531 external-priority patent/WO2022221360A1/en
Publication of GB2619894A publication Critical patent/GB2619894A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

Techniques are disclosed for coordinating interactions between a user device and a plurality of accessory devices. In one example, a user device receives information identifying one or more accessory devices in communication with the user device. The user device may implement accessory interaction instances for each of the identified accessories. A first accessory interaction instance can be associated with a first accessory among the identified accessories and receive a first audio input from the first accessory corresponding to a user request. The first accessory interaction instance can process a portion of the received audio input and receive a first response from a server computer. The user device may then transmit the first response to the first accessory device.

Claims (20)

  1. WHAT IS CLAIMED IS: 1. A method, comprising: receiving, by a user device, information that identifies a plurality of accessories configured to communicate with the user device; implementing, by the user device, respective accessory interaction instances for each accessory of the plurality of accessories; receiving a first audio input from a first accessory of the plurality of accessories and second audio input from a second accessory of the plurality of accessories; processing, by a first accessory interaction instance of the respective accessory interaction instances, at least a portion of the first audio input; receiving, by the first accessory interaction instance of the respective accessory interaction instances, a first response from a server computer, the first response corresponding to the processed portion of the first audio input; and transmitting, by the user device, the first response to the first accessory of the plurality of accessories.
  2. 2. The method of claim 1, wherein the processing, by the first accessory interaction instance of the respective accessory interaction instances, of the portion of the first audio input comprises: transmitting, by the first accessory interaction instance, the processed portion of the first audio input to the server computer.
  3. 3. The method of claim 2, wherein the processing, by the first accessory interaction instance of the respective accessory interaction instances, of the portion of the first audio input further comprises: delegating, by the first accessory interaction instance, an action to one or more other processes.
  4. 4. The method of claim 3, wherein the one or more other processes comprise at least one of a music service or a voice communication service, and wherein the action comprises instructions for the one or more other processes to provide audio content for the first accessory.
  5. 5. The method of claim 1, further comprising: determining, by the user device, whether at least a portion of the second audio input matches a wake word; and determining, by the user device, whether the second accessory is authorized to interact with a second accessory interaction instance of the respective accessory interaction instances.
  6. 6. The method of claim 5, further comprising: processing, by the second accessory interaction instance of the respective accessory interaction instances, at least a portion of the second audio input in accordance with at least one of the determination that the portion of the second audio input matches the wake word or the determination that the second accessory is authorized to interact with the second accessory interaction instance of the respective accessory interaction instances.
  7. 7. The method of claim 1, wherein each of the plurality of accessories are configured to implement a software development kit provided by an entity associated with the user device.
  8. 8. The method of claim 7, wherein each of the respective accessory interaction instances are configured to communicate with a corresponding software development kit of respective accessory of the plurality of accessories.
  9. 9. The method of claim 1, further comprising managing, by the user device, respective accessory settings for each of the plurality of accessories.
  10. 10. The method of claim 1, wherein the user device is a first user device, and wherein the information comprises at least one of: a request, from at least one of the accessories of the plurality of accessories, to connect to the first user device; or an instruction, from a second user device, to connect the first user device to at least one of the accessories of the plurality of accessories.
  11. 11. A user device, comprising: a memory configured to store computer-executable instructions; and a processor configured to connect to the memory and execute the computer- executable instructions to at least: receive information that identifies a plurality of accessories configured to communicate with the user device; implement respective accessory interaction instances for each accessory of the plurality of accessories; receive first audio input from a first accessory of the plurality of accessories and second audio input from a second accessory of the plurality of accessories; process, by a first accessory interaction instance of the respective accessory interaction instances, at least a portion of the first audio input; receive, by the first accessory interaction instance of the respective accessory interaction instances, a first response from a server computer, the first response corresponding to the processed portion of the first audio input; and transmit the first response to the first accessory of the plurality of accessories.
  12. 12. The user device of claim 11, wherein the processing, by the first accessory interaction instance of the respective accessory interaction instances, of the portion of the first audio input comprises at least one of: transmitting, by the first accessory interaction instance, the processed portion of the first audio input to the server computer; or delegating, by the first accessory interaction instance, an action to one or more other processes.
  13. 13. The user device of claim 11, wherein the processor is configured to execute the computer-executable instructions to at least: determine whether at least a portion of the second audio input matches a wake word; and determine whether the second accessory is authorized to interact with a second accessory interaction instance of the respective accessory interaction instances.
  14. 14. The user device of claim 13, wherein the processor is configured to execute the computer-executable instructions to at least: process, by the second accessory interaction instance of the respective accessory interaction instances, at least a portion of the second audio input in accordance with at least one of the determination that the portion of the second audio input matches the wake word or the determination that the second accessory is authorized to interact with the second accessory interaction instance of the respective accessory interaction instances.
  15. 15. The user device of claim 11, wherein each of the plurality of accessories are configured to implement a software development kit provided by an entity associated with the user device.
  16. 16. A computer-readable storage medium configured to store computer- executable instructions that, when executed by a user device, cause the user device to perform operations comprising: receiving information that identifies a plurality of accessories configured to communicate with the user device; implementing respective accessory interaction instances for each accessory of the plurality of accessories; receive first audio input from a first accessory of the plurality of accessories and second audio input from a second accessory of the plurality of accessories; process, by a first accessory interaction instance of the respective accessory interaction instances, at least a portion of the first audio input; receive, by the first accessory interaction instance of the respective accessory interaction instances, a first response from a server computer, the first response corresponding to the processed portion of the first audio input; and transmit the first response to the first accessory of the plurality of accessories.
  17. 17. The computer-readable storage medium of claim 16, wherein the processing, by the first accessory interaction instance of the respective accessory interaction instances, of the portion of the first audio input comprises at least one of: transmitting, by the first accessory interaction instance, the processed portion of the first audio input to the server computer; or delegating, by the first accessory interaction instance, an action to one or more other processes.
  18. 18. The computer-readable storage medium of claim 16, wherein the operations further comprise: determining, by the user device, whether at least a portion of the second audio input matches a wake word; and determining, by the user device, whether the second accessory is authorized to interact with a second accessory interaction instance of the respective accessory interaction instances
  19. 19. The computer-readable storage medium of claim 18, wherein the operations further comprise: processing, by the second accessory interaction instance of the respective accessory interaction instances, at least a portion of the second audio input in accordance with at least one of the determination that the portion of the second audio input matches the wake word or the determination that the second accessory is authorized to interact with the second accessory interaction instance of the respective accessory interaction instances .
  20. 20. The computer-readable storage medium of claim 16, wherein each of the plurality of accessories are configured to implement a software development kit provided by an entity associated with the user device.
GB2315593.0A 2021-04-15 2022-04-13 Techniques for communication between hub device and multiple endpoints Pending GB2619894A (en)

Applications Claiming Priority (7)

Application Number Priority Date Filing Date Title
US202163175480P 2021-04-15 2021-04-15
US202163175473P 2021-04-15 2021-04-15
US202163175478P 2021-04-15 2021-04-15
US17/719,086 US20220337691A1 (en) 2021-04-15 2022-04-12 Techniques for establishing communications with third-party accessories
US17/718,984 US11914537B2 (en) 2021-04-15 2022-04-12 Techniques for load balancing with a hub device and multiple endpoints
US17/718,977 US20220335938A1 (en) 2021-04-15 2022-04-12 Techniques for communication between hub device and multiple endpoints
PCT/US2022/024531 WO2022221360A1 (en) 2021-04-15 2022-04-13 Techniques for communication between hub device and multiple endpoints

Publications (1)

Publication Number Publication Date
GB2619894A true GB2619894A (en) 2023-12-20

Family

ID=88863279

Family Applications (1)

Application Number Title Priority Date Filing Date
GB2315593.0A Pending GB2619894A (en) 2021-04-15 2022-04-13 Techniques for communication between hub device and multiple endpoints

Country Status (2)

Country Link
CN (1) CN117136352A (en)
GB (1) GB2619894A (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190081810A1 (en) * 2017-09-13 2019-03-14 Samsung Electronics Co., Ltd. Electronic device and method for controlling thereof
WO2019231537A1 (en) * 2018-06-01 2019-12-05 Apple Inc. Virtual assistant operation in multi-device environments
US20200051558A1 (en) * 2018-08-08 2020-02-13 Samsung Electronics Co., Ltd. Electronic device supporting personalized device connection and method thereof

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20190081810A1 (en) * 2017-09-13 2019-03-14 Samsung Electronics Co., Ltd. Electronic device and method for controlling thereof
WO2019231537A1 (en) * 2018-06-01 2019-12-05 Apple Inc. Virtual assistant operation in multi-device environments
US20200051558A1 (en) * 2018-08-08 2020-02-13 Samsung Electronics Co., Ltd. Electronic device supporting personalized device connection and method thereof

Also Published As

Publication number Publication date
CN117136352A (en) 2023-11-28

Similar Documents

Publication Publication Date Title
KR102660922B1 (en) Management layer for multiple intelligent personal assistant services
US11922937B2 (en) Electronic message transmission
US10671448B2 (en) Session processing interaction between two or more virtual assistants
KR102043365B1 (en) Local maintenance of data for voice actions that can be selectively performed offline on a speech recognition electronic device
CN111052230A (en) Selective memory for voice activation of a voice capture device
CN108600219A (en) A kind of sound control method and equipment
WO2018022085A1 (en) Identification of preferred communication devices
EP3405885B1 (en) Facilitation of offline semantic processing in a resource-constrained device
EP3803731A1 (en) A hybrid cognitive system for ai/ml data privacy
JP6972408B2 (en) Pairing a voice-enabled device with a display device
KR20210099533A (en) Vehicle-based voice processing method, voice processor, and vehicle-mounted processor
US11703343B2 (en) Methods and systems for managing communication sessions
EP4047489A1 (en) Human-machine conversation processing method
US20160329051A1 (en) Multiple microphones for synchronized voice interaction
GB2619894A (en) Techniques for communication between hub device and multiple endpoints
JP7288885B2 (en) Voice interaction method, device, equipment and storage medium
US10873662B2 (en) Identifying a media item to present to a user device via a communication session
CN110874343B (en) Method for processing voice based on deep learning chip and deep learning chip
US20210287666A1 (en) Natural Language Recognition Assistant Which Handles Information in Data Sessions
CN112911074B (en) Voice communication processing method, device, equipment and machine-readable medium
CN112489644A (en) Voice recognition method and device for electronic equipment
CN112203181A (en) Automatic switching method and device of equalizer, electronic equipment and storage medium
CN109697980A (en) A kind of response method, device, storage medium and intelligent sound box waking up word
US20210193132A1 (en) Communication apparatuses
WO2019000473A1 (en) Coefficient calculation method, component calling method, device, medium, server, and terminal