TW201640920A - System and method for controlling output of multiple audio output devices - Google Patents

Abstract

Multiple audio output devices are individually triggered to generate an acoustic identification signal. A controller device may perform a comparison of the acoustic identification signal from each of the multiple audio output devices. The output from one or multiple audio output devices is controlled based on the comparison.

Description

System and method for controlling the output of a plurality of audio output devices

There are audio systems that utilize network-connected audio output devices (eg, speakers). In such systems, multiple connected speakers can be used to output the same content.

100‧‧‧Optical output system

101‧‧‧Network

102‧‧‧ access point

103‧‧‧Media files

105‧‧‧Media cabinet

107‧‧‧Internet services

109‧‧‧Content source

110‧‧‧Controller device

111‧‧‧Leaders choose

112‧‧‧Optical dissemination logic

113‧‧‧ audio content

114‧‧‧Dynamic selection logic

115‧‧‧ channel configuration

116‧‧‧Channel configuration logic

117‧‧‧Configuration plan

118‧‧‧ Calibration logic

119‧‧‧ adjustment

120‧‧‧ audio output device

121‧‧‧Channel section

122‧‧‧Operation output device

123‧‧‧ channel assignment

124‧‧‧Operation output device

126‧‧‧ audio output device

133‧‧‧Audited audio

200‧‧‧ audio output device

201‧‧‧ audio content

210‧‧‧Optical Receiver

212‧‧‧ audio content

215‧‧‧ channel section

217‧‧‧ audio content

219‧‧‧Amplified stream

220‧‧‧Control logic

221‧‧‧ channel configuration data

222‧‧‧ channel filter

226‧‧‧ channel amplification

230‧‧‧ audio output resources

240‧‧‧ device interface

243‧‧‧User input

244‧‧‧Channel configuration logic

245‧‧‧Setting

249‧‧‧ Calibration input

250‧‧‧ calibration control

251‧‧‧Delay control

253‧‧‧Volume control

300‧‧‧Controller device

301‧‧‧Enter information

306‧‧‧Acoustic input interface

309‧‧‧Group size information

310‧‧‧User interface

311‧‧‧Device location information

312‧‧‧Time Series Analysis Component

313‧‧‧Respond to the inquiry

314‧‧‧Content-related analysis components

315‧‧‧Content related judgment

317‧‧‧ Timing parameters

320‧‧‧Optical output device control logic

321‧‧‧Control order

322‧‧‧Delay control

323‧‧‧Delay order

324‧‧‧Volume control

325‧‧‧Volume order

329‧‧‧Configuration Library

330‧‧‧Device location logic

333‧‧‧ channel configuration

337‧‧‧Configuration layout

339‧‧‧ channel assignment

340‧‧‧ audio output interface

361‧‧‧Acoustic Reference Transmission

363‧‧‧ arrival time

400‧‧‧Mobile computing device

410‧‧‧Microphone

420‧‧‧ processor

430‧‧‧ display

431‧‧‧User interface

433‧‧‧Configuration input

440‧‧‧ memory

441‧‧‧Device Control Instructions

443‧‧‧User interface instructions

445‧‧‧Location logic instructions

450‧‧‧Internet interface

453‧‧‧ channel configuration

467‧‧‧ coded signal

500‧‧‧ audio output device

501‧‧‧Enter information

505‧‧‧ audio streaming

508‧‧‧buffer

509‧‧‧Group size information

510‧‧‧ processor

512‧‧‧Digital Signal Processor (DSP)

515‧‧‧ audio output data

517‧‧‧Channel layout information

525‧‧‧ audio transmission data

530‧‧‧Audio output component

535‧‧‧Audio content output

540‧‧‧Internet interface

550‧‧‧ memory

551‧‧‧ interface instructions

552‧‧‧ calibration order

553‧‧ ‧ leader device instructions

555‧‧‧ channel assignment

557‧‧‧ calibration action

559‧‧‧Configuration input

561‧‧‧Channel selection instruction

571‧‧‧Filter logic

573‧‧‧Channel section

600‧‧‧ method

610‧‧‧Steps

612‧‧ steps

620‧‧‧Steps

630‧‧ steps

632‧‧‧Steps

634‧‧‧Steps

636‧‧‧Steps

638‧‧‧Steps

640‧‧‧Steps

642‧‧‧Steps

644‧‧‧Steps

646‧‧‧Steps

700‧‧‧ method

710‧‧ steps

712‧‧‧Steps

720‧‧ steps

730‧‧‧Steps

732‧‧‧Steps

740‧‧‧Steps

742‧‧‧Steps

744‧‧‧Steps

746‧‧‧Steps

750‧‧ steps

760‧‧‧Steps

762‧‧‧Steps

764‧‧‧Steps

800‧‧‧ method

810‧‧‧Steps

812‧‧‧ steps

820‧‧‧Steps

822‧‧‧Steps

824‧‧‧Steps

900‧‧‧ method

910‧‧ steps

912‧‧ steps

914‧‧‧Steps

920‧‧‧Steps

930‧‧‧Steps

932‧‧‧Steps

934‧‧‧Steps

1000‧‧‧ method

1010‧‧‧Steps

1020‧‧‧Steps

1030‧‧‧Steps

1040‧‧‧Steps

1100‧‧‧User interface

1106‧‧‧ number selection characteristics

1108‧‧‧Placement functionality

1109‧‧‧Layout selection features

1111‧‧‧ device representation

1112‧‧‧ Room representation

1120‧‧‧ calibration features

1 illustrates a network-based audio output system capable of dynamic configuration and/or calibration in accordance with various embodiments.

2 illustrates an audio output device that can be selected and operated as a leader device in accordance with various embodiments.

Figure 3 illustrates an example of a controller device for use with various embodiments.

4 illustrates an action computing device in which various embodiments may be implemented.

Figure 5 illustrates an audio output device in which various embodiments may be implemented.

6 illustrates a method for dynamically determining and implementing a channel configuration for a network-based audio system, in accordance with various embodiments.

7 illustrates a method for operating an audio output device as a leader device when distributing audio content to other audio output devices on the network, in accordance with various embodiments.

8 illustrates a method for calibrating the output of a plurality of audio output components on a network based on the relative position of the user, in accordance with various embodiments.

9 illustrates a method for calibrating an audio output device based on a user's location, in accordance with various embodiments.

10 illustrates a method for implementing a user interface to initiate dynamic configuration of a network-based audio system, in accordance with various embodiments.

Figure 11 illustrates a user interface for enabling speaker selection and assignment in accordance with various embodiments.

According to some embodiments, a set of audio output devices can be established and configured to output channel specific audio. Once established, the channel configuration can be changed and updated in response to events such as changes in user preferences or additions or reductions in the audio output device to the network. In some embodiments, reconfiguration can be performed in operation while audio content is output by the devices.

In some embodiments, the audio output device can be controlled such that the output of the device is calibrated to the location of the user. In particular, the arrival time and/or volume of the calibratable audio allows the user to experience an output based on the point of separation from each audio output device, wherein each audio output device provides a uniform audio output.

Embodiments described herein provide a system, method and apparatus for outputting audio content via a network. In some embodiments, a plurality of audio output devices are coupled to the network to form an audio output set for receiving and outputting at least a portion of the audio content originating from a source. The controller device can determine the channel configuration for the audio output group. The channel configuration can include channel assignments for each of the audio output devices connected to the network to form an audio output set. When audio content is being output, the controller device can respond to an event or condition by changing the channel configuration.

In some embodiments, the controller device determines a channel configuration for the audio output group. The channel configuration can include channel assignments for each of the audio output devices connected to the network to form an audio output set. The controller device receives the audio content from a source and outputs a channel portion of the audio content based on a channel assignment of the given audio output device. For each of the other audio output devices, the controller device communicates at least another portion of the audio content to the other audio output device. In addition, the controller changes the channel configuration and then based on the new frequency The channel is assigned to output the channel portion of the audio content to respond to an event or condition.

In some embodiments, each of the plurality of audio output devices is triggered to generate an acoustic identification signal. The controller device can perform a comparison of acoustic recognition signals from each of the plurality of audio output devices. The output from one or more of the audio output devices is controlled based on the comparison.

As used herein, a speaker is intended to mean an audio output device, such as a network-connected audio output device. An example of a speaker includes a dedicated device that outputs audio such as music. Another non-limiting example of a speaker includes a multi-function device, such as a mobile device or tablet, that can output video, capture and store audio content, enable user interaction, and/or perform numerous other actions.

The various embodiments described herein provide that the methods, techniques, and actions performed by a computing device are performed programmatically or as a computer implemented method. Programmatic means that instructions are executed via code or computer. The steps performed in a programmed manner may or may not be automatic.

The various embodiments described herein can be implemented using a programming module or component. A programming module or component can include a program, a subroutine, a portion of a program, or a software or hardware component capable of performing one or more of the stated tasks or functions. As used herein, a module or component can reside on a hardware component independently of other modules or components. Alternatively, a module or component can be a shared component or process of other modules, programs, or machines.

In addition, the various embodiments described herein can be implemented via instructions executable by one or more processors. These instructions can be carried on a computer readable medium. </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; </ RTI> <RTIgt; In particular, the numerous machines shown in the embodiments of the present invention include a processor and various forms of memory for holding data and instructions. Examples of computer readable media include permanent memory storage devices, A hard disk drive such as a personal computer or a server. Other examples of computer storage media include portable storage units such as CD or DVD units, flash or solid state memory (such as carried on many cellular phones and consumer electronic devices), and magnetic memory. Computers, terminals, network-enabled devices (e.g., mobile devices such as cellular phones) are all examples of machines and devices that utilize processors, memory, and instructions stored on a computer-readable medium. In addition, the embodiments may be implemented in the form of a computer program or a computer capable of carrying the program in the form of a carrier medium.

System specification

FIG. 1 illustrates a network-based audio output system 100 capable of dynamic configuration and/or calibration in accordance with various embodiments. The audio output system 100 can be implemented in a local or closed network 101, such as provided by a home or regional network. The network 101 can include a plurality of connected devices, including a controller device 110 and a plurality of network-enabled audio output devices 120, 122, 124, and 126. In some variations, network 101 includes an access point 102 for providing wireless connectivity media. As an example, each of controller device 110 and audio output devices 120, 122, 124, 126 can be at 802.11(a), 802.11(b), 802.11(g), 802.11(n), 802.11(ac), or The similarities (collectively operating under the IEEE specifications of "Wi-Fi", "Wi-Fi Network" or "802.11 Protocol"). Still further, in some implementations, controller device 110 and/or some or all of audio output devices 120, 122, 124, 126 can perform wireless peer-to-peer communication, such as provided by Wi-Fi Direct. Still further, some or all of the audio output devices 120, 122, 124, and 126 can be able to communicate directly with other devices on the network as peers. As an example, individual audio output devices 120, 122, 124, and 126 can communicate using a direct wireless inter-pair communication protocol such as provided by Wi-Fi Direct. Still further, in some variations, one or more of the audio output devices 120, 122, 124, and 126 can utilize connectivity media such as provided via an Ethernet connection or other network-based wired connection.

Audio output devices 120, 122, 124, and 126 can be connected based on user preferences And located in the physical area of the network 101. The physical area of the network 101 may correspond to a residence, or alternatively to a room or space within the residence. As an example, the environment of network 101 may correspond to a home network in which multiple speakers or other audio output devices have network connectivity for the purpose of outputting audio content selected by the user. In this context, the user can selectively position individual connected speakers around the room to enhance the user's enjoyment of the presented audio content.

In some embodiments, audio output devices 120, 122, 124, and 126 may be heterogeneous in nature, which means that audio output devices 120, 122, 124, and 126 may have different manufacturers, capabilities, resources, and/or purposes. For example, one or more of the audio output devices 120, 122, 124, and 126 may correspond to a television, and for television, audio output is not a primary purpose. The one or more audio output devices 120, 122, 124, and 126 may also include programming or other logic to enable the audio output device to communicate with other devices on the network. Examples of such programming or logic include the ALLPLAY platform manufactured by QUALCOMM CONNECTED EXPERIENCES, which may be installed or otherwise provided via a firmware to a wireless speaker. While some examples describe audio output devices 120, 122, 124, and 126 as speakers (or dedicated audio output devices), other variations provide versatile audio output devices 120, 122, 124, and 126, including televisions and desktops. Computer, or other multi-function audio output device.

Controller device 110 operates to execute an application, software platform or other programming logic to communicate with and control audio output devices 120, 122, 124 and 126. As an example, controller device 110 may correspond to a mobile computing device, such as a multi-function cellular phone/messaging device, a tablet computer, a hybrid device (so-called "phablet"), or a wearable computing device.

Controller device 110 is operative to use audio output devices 120, 122, 124, and 126 to control and configure the output of the audio. Multiple audio may be used for the purpose of outputting audio content on a plurality of audio output devices 120, 122, 124, and 126 in accordance with a dynamically selected channel configuration Distribute any of the configurations. In some embodiments, controller device 110 can be modally operated to select from a plurality of possible audio distribution configurations.

Controller device 110 distributes the audio content ("AC") 113 directly or indirectly to each of the plurality of audio output devices 120, 122, 124 or 126. In some implementations, controller device 110 is the source of interspersed audio content 113. For example, the audio content 113 can correspond to a media file ("MF") 103 accessed from the user's media cabinet 105. Depending on the implementation, the media cabinet 105 can be at the local end of the controller device 110, among a plurality of devices interspersed on the network 101, or at the remote end of the controller device 110. For example, some or all of the media cabinets 105 may be stored on other devices (including one or more audio output devices 120, 122, 124, or 126) or resources of the network 101, and the controller device 110 may be connected to the network 101. Another device (e.g., a home computer, cable converter, etc.) communicates to retrieve the media file 103 from the media cabinet 105. Still further, the controller device 110 can access a web service ("NS") 107 for the audio content 113, such as an online media website (eg, PANDORA, SPOTIFY, GOOGLE PLUS, etc.). Controller device 110 may also generate audio content 113 from other content sources ("CS") 109, such as cable, satellite or airborne broadcasts. Additionally, controller device 110 can distribute audio content 113 originating from the multimedia content presented on the device. For example, the controller device 110 can execute different applications that generate multimedia content (eg, games), and can interleave audio from such active applications into audio content 113. In other variations, controller device 110 can access another device or resource on network 101, such as a device that communicates with one or more audio output devices 120, 122, 124, or 126 via access point 102. Depending on the capabilities of the respective devices, the controller device 110 can use inter-stage wireless communication (e.g., Wi-Fi Direct) to directly transmit the audio content 113 to each of the desired audio output devices 120, 122 on the network 101. 124 and 126.

In some implementations, the controller device 110 is via an audio output device 120, 122 that implements functionality for operation as the leader of the active output device on the network 101, 124, 126 distributes the audio content 113. Controller device 110 can select an audio output device 120, 122, 124, 126 to act as a leader device. In the example of FIG. 1, the audio output device 120 selected as the leader can receive the audio content 113 from the controller device 110 (which can access the media cabinet 105, the network service 107, or the content source 109) for distribution to other Audio output devices 122, 124, 126. In a variation, the audio output device 120 can receive the audio content 113 from another source (eg, another device of the network 101) for distribution to other audio output devices 122, 124, under the direction or control of the controller device 110. 126.

In an alternate variation or mode, the controller device 110 or the audio output device 120 operating as the leader may channel filter or amplify the audio content 113 for transmission to the respective audio output device. When filtered by the channel, the audio content 113 can be divided into a plurality of channel portions 121, and each channel portion 121 of the audio content 113 is communicated to the assigned audio output devices 120, 122, 124, and 126. When augmented, the audio content 113 can be pre-structured into a channelization component, and the amplified audio ("aug.audio") 133 can be transmitted to other audio output devices 122, 124, 126, where the amplified audio 133 is filtered into a corresponding channel portion 121.

In the example of FIG. 1, controller device 110 includes audio distribution logic 112, dynamic selection logic 114, channel configuration logic 116, and calibration logic 118. Moreover, in the example of FIG. 1, one or more of the audio output devices 120, 122, 124, and 126 can be selected to implement the functionality of the leader, which can include components and functionality (eg, as in FIG. 2) The example is described). The functionality described as being utilized by the controller device 110 or the audio output device 120 selected as the leader can be among the two devices (or can be replaced with another device for the leader of the audio output device 120) Among them) are interchangeable. For example, in some variations, controller device 110 may include functionality for implementing channel filtering or channel amplification (eg, as shown in FIG. 2). Similarly, in some variations, the audio output device 120 can operate as a leader and also include one or more components of the controller device 110, such as one of the dynamic selection logic 114, the channel configuration logic 116, or the calibration logic 118. More.

According to some embodiments, the controller device 110 includes channel configuration logic 116 for performing operations to determine the channel configuration 115 of the set of audio output devices 120, 122, 124, and 126. The channel configuration 115 can be determined by (i) the number of available audio output devices 120, 122, 124, and 126; (ii) a group based on the number of preferences and/or available audio output devices 120, 122, 124, and 126. State scheme 117 or layout; and/or (iii) relative positioning of each audio output device 120, 122, 124, and 126 within the space or environment of network 101. Thus, given the relative positioning of the desired configuration 117 and the audio output device, the channel configuration 115 can specify a channel assignment 123 for each of the audio output devices 120, 122, 124, and 126. Once determined, the channel assignment 123 can be communicated to the audio output devices 122, 124, 126 as control or command material. Depending on the implementation or mode of operation, the channel assignment 123 can be communicated directly from the controller device 110 or from the audio output device 120 acting as the leader. Channel configuration logic 116 can dynamically re-determine and implement channel configuration 115 based on the occurrence of conditions and events affecting the usage of audio output devices 120, 122, 124, and 126 on network 101, as described using various examples. .

Still further, in some variations, the controller device 110 can have different modes of operation to implement an audio distribution configuration, wherein the audio distribution logic 112 directly distributes the audio content 113 to each of the audio output devices 120, 122, 124, and 126. . The audio distribution logic 112 of the controller device 110 can communicate all or a portion of the stream to a plurality of audio output devices.

Depending on the variation, in an alternate mode, the controller device 110 can use the dynamic selection logic 114 to select one of the plurality of audio output devices 120, 122, 124, 126 as the leader. In some variations, the determination to use the particular audio output device 120 as the leader can be made programmatically based on, for example, available resources of the controller device 110 and/or user preferences. Various standards may be used to select an audio output device 120 as the leader for other audio output devices 122, 124 or 126 for network 101. Among these criteria, the audio output devices 120, 122, 124, and 126 selected as the leader may be required to have a minimum set of resources, such as minimum processing power and/or establishment with other devices on the network 101. The ability to connect multiple simultaneous peers. Alternatively, the audio output device 120 selected as the leader may have the most or optimal desired resources or capabilities. For example, the audio output device 120 can be selected as the leader because the audio output device 120 satisfies the standard containing a digital signal processor ("DSP"), or because the audio output device 120 is compared to other audio output devices. It is considered to have the largest available bandwidth.

In some variations, control device 110 can communicate leader selection 111 to selected audio output device 120, 122, 124 or 126. In some embodiments, controller device 110 uses, for example, dynamic selection logic 114 to make leader selection 111 in a programmed manner.

In some implementations, the audio output device 120 receives the audio content 113 from the content source (CS) 109 and then distributes the audio content 113 as a channel portion 121 to each of the other audio output devices 122, 124, 126 of the network 101. One. The source of the audio content 113 may, for example, correspond to the controller device 110. For example, controller device 110 can generate audio content 113 (eg, game content) and/or portions of storage media cabinet 105 (such as a library of songs or albums), and audio content 113 can correspond to media from media cabinet 105. File 103. Alternatively, controller device 110 can also serve as a source of audio content for both the local network and the remote source. For example, the controller device 110 can access other media resource devices (eg, home computers, cable converters, etc.) on the network 101 to retrieve the media files 103 of the user's media cabinet. Still further, the controller device 110 can access a commercially available third party network service 107 (eg, PANDORA, SPOTIFY, GOOGLE PLUS, etc.) for the audio content 113. In other variations, content source 109 for audio content 113 can be another device on network 101, such as a device that communicates with controller device 110 and/or output device 120 via wireless access point 102. Still further, in other variations, the source of the audio content 113 can be another content source 109 (eg, cable or over-the-air broadcast) available via the network 101.

According to some variations, the audio output device 120 processes the audio content 113 (audio material) to delineate the channel portion 121 from the audio content 113. Each channel portion 121 can then be communicated to Corresponding to the audio output devices 122, 124, 126. The local audio output resource can be used to play the channel portion 121 for the audio output device 120 in accordance with the playback of the channel portion 121 of the other audio output devices 122, 124, 126.

According to some embodiments, the channel configuration 115 can be dynamically determined in operation based on conditions or events detected on the network 101. For example, controller device 110 can detect a particular network condition (eg, limited bandwidth) and then output channel configuration 115 to include alternate group channel assignments for respective audio output devices 120, 122, 124, and 126. 123. Still further, the controller device 110 can receive input or otherwise detect the addition or subtraction of the audio output device 122, 124 or 126 to affect the number of audio output devices 120, 122, 124 and 126 in use. In some cases, the number of audio output devices 120, 122, 124, and 126 in use may also change configuration scheme 117 (e.g., from 7.1 to 5.1) and/or require further changes to channel assignment 123 so that A different number of audio output devices 120, 122, 124, and 126 are in use (or available for use) on the network 101. The ability of controller device 110 to dynamically determine and implement channel configuration may enable, for example, playback of audio content from some or all of audio output devices 120, 122, 124, and 126 to be capable of one or more channel assignments 123. Continue without interruption. In addition to dynamically determining the channel configuration 115, the controller device 110 can also dynamically select the audio output device 120 as the leader. The determination of which audio output device 120 acts as the leader can be based, for example, on the available bandwidth for each of the audio output devices 120, 122, 124, or 126 that meet one or more criteria that are the leader.

As a further example, the modal operation of the controller device 110 when distributing the audio content 113 can also be dynamically changed. For example, controller device 110 can switch from using one audio output device 120 as a leader to transmit audio content 113 (or its channel portion 121) directly to each of audio output devices 120, 122, 124, and 126. Still further, based on factors such as the bandwidth available for the respective audio output devices 120, 122, 124, 126, the choice of which audio output device 120, 122, 124, 126 acts as the leader may also be dynamic.

In some variations, controller device 110 includes calibration logic 118. The calibration logic 118 is operable to adjust the output of the audio output devices 120, 122, 124, 126 to accommodate the relative position of the user in the physical space of the environment of the network 101. The calibration logic 118 is operative to accommodate the proximity of the user to one or more of the audio output devices 120, 122, 124, and 126. The calibration logic 118 can perform operations such that the audio experienced by the user at a given location is uniform for all directions. In particular, calibration logic 118 may implement adjustments 119 in the form of delays in individual audio output devices 120, 122, 124, and 126 such that audio transmissions from each of the individual audio output devices 120, 122, 124, 126 are The arrival time is nearly simultaneous with respect to the user, even if the user is closer to one of the audio output devices 120, 122, 124, 126 than to another audio output device. Still further, the calibration logic 118 can implement an adjustment 119 in the form of a volume adjustment for the individual audio output devices 120, 122, 124, 126 such that the user experiences the same volume from each of the audio output devices 120, 122, 124, 126. Even when the user is closer to an audio output device than to another audio output device.

2 illustrates an audio output device that can be selected and operated as a leader, in accordance with various embodiments. The audio output device 200, such as that shown and described with respect to the example of FIG. 2, can operate as the audio output device 120 of the example of FIG. Referring to FIGS. 1 through 2, in more detail, the audio output device 200 includes an audio receiver 210, control logic 220, an audio output resource 230, and a device interface 240. Control logic 220 may be coupled to channel filter 222 and/or channel amplification 226 or include channel filter 222 and/or channel amplification 226.

The audio receiver 210 can receive the audio content 201 from the controller device 110. Alternatively, the audio receiver 210 can receive the audio content 201 from another source, such as from a source on the line or from another device. The audio content 201 can be received directly or indirectly (e.g., via the access point 102 or from the controller device 110).

The audio output device 200 can also receive the channel configuration data 221 from the controller device 110. (shown via device interface 240). In a variation, the audio output device 200 includes channel configuration logic 244 for determining channel configuration data 221 independently of any communication from another device. The channel configuration logic 244 can determine the channel configuration data 221 from, for example, user input 243, such as provided by user interaction with the user interface of the audio output device 200. Channel configuration logic 244 can also determine channel configuration data 221 based on user or device settings 245 or preferences.

In some implementations or modes of operation, the audio receiver 210 can communicate the entire stream of audio content ("all stream AC") 212 to the channel filter 222 of the control logic 220. Channel filter 222 filters all of the audio content 212 into a channelized portion based on the channel assignments defined by channel configuration material 221. Once the channel is delimited from the audio content 212, the audio output resource 230 receives the channel portion 215 for the channel assigned to the audio output device 200. Portions of outgoing audio content (AC) 217 for channels assigned to other audio output devices 122, 124, 126 may be transmitted to other audio output devices via device interface 240.

In a variation, the audio output device 200 can implement channel amplification 226. Channel amplification 226 may structure audio content 212 into an amplified stream 219 that may be transmitted via device interface 240 to other audio output devices 122, 124, 126. The amplified stream 219 can be filtered for the appropriate channel at the corresponding audio output device 122, 124, 126, which coincides with the output point for the particular channel output. Device interface 240 can convey an amplified stream 219 that can be filtered for a given channel. In this manner, channel amplification 226 can provide an alternative to filtering audio content prior to transmission.

Device interface 240 may include programming or logic to enable audio output device 200 to be interconnected and operable with a plurality of other devices of different types on network 101. In some implementations, device interface 240 includes an application interface provided via, for example, ALLPLAY manufactured by QUALCOMM CONNECTED EXPERIENCES.

In some embodiments, the audio output device 200 includes means for triggering or implementing a calibration control The functionality of the system 250. In some implementations, calibration control 250 receives calibration input 249 from another device, such as from controller device 110. In one example, controller device 110 includes resources and logic for receiving an input indicative of a calibration change, and further includes determining that one or more audio output devices 120, 122, 124, 126 can be taken to target the user The part is used to calibrate the resources and logic of the calibration action of the audio output. As mentioned with other examples, the calibration action is used to affect the audio output experienced by the user, with the user and the relative proximity of the individual audio output devices 120, 122, 124, 126 of the network 101 being specifically considered.

In some embodiments, the calibration action of calibration control 250 can include delay control 251. Control logic 220 can process delay control 251 and communicate delay control 251 to other audio output devices 122, 124, 126 via device interface 240. Another example of a calibration action of calibration control 250 includes a volume control 253. Control logic 220 can communicate volume control 253 to other audio output devices via device interface 240.

Controller device

FIG. 3 illustrates an example of a controller device 300 in accordance with various embodiments. Referring to Figures 1 through 3, a controller device 300 (which may be implemented) may be implemented using software executed on a mobile computing device, such as a device that may be carried by a space in a network 101 or a person in a physical area, in accordance with various embodiments. In the controller device 110). As an example, controller device 300 may correspond to a device such as a cellular phone/message device (eg, a feature phone), a tablet or hybrid device, a wearable computing device, or a laptop computer. In some embodiments, controller device 300 is operative to receive input information 301 for determining (i) the number of audio output devices 120, 122, 124, 126 connected to network 101; and (ii) Each audio output device 120, 122, 124, 126 is relative to a given area of coverage within the network 101. The software implemented on controller device 300 may correspond to, for example, an application, a suite of applications, or alternatively to a hierarchy of operating system levels. The controller device 300 can share an application architecture or other devices with the network. Pick up. For example, controller device 300 and each of the various audio output devices 120, 122, 124, 126 used on network 101 can implement a media platform such as that provided by the QUALCOMM ALLPLAY media platform.

As an addition or alternative, in some embodiments, controller device 300 operates to detect for the purpose of estimating the proximity of the controller device to individual audio output devices 120, 122, 124, 126 that are operating on network 101. Measure and process transmissions. In the event that this proximity information is utilized, the controller device 300 is operable to calibrate the output of one or more of the audio output devices 120, 122, 124, 126 on the network 101.

In some embodiments, the controller device 300 includes a user interface 310, audio output device control logic ("AOD Control Logic") 320, device location logic 330, and an audio output interface 340. The user interface 310 can display a prompt to provide input to the user that identifies basic input information 301 regarding the audio output devices 120, 122, 124, 126 used on the network 101. For example, the user interface 310 can display a virtualized room or space within the home and provide features that enable the user to indicate the following information and other information: (i) the audio output devices 120, 122 used on the network 101, 124, 126; and (ii) for a general portion of a given audio output device 120, 122, 124, 126 that can be marked. The user interface 310 can also be executed to prompt the user to provide input information 301 that identifies additional information about the audio output device, such as manufacturer, capability, or connectivity status. The user interface 310 can output device location information 311 that identifies the number of audio output devices and the relative position of the audio output device in the space represented by the user interface 310. Device location logic 330 can receive location information 311 and optionally configure content on user interface 310 to, for example, prompt the user to provide one or more response queries 313 for additional input information 301.

As an example, the response query 313 can prompt the user to provide additional input information 301 that approximates the length or total distance between the audio output devices 120, 122, 124, 126 on the network 101 to provide virtual space within the network. The dimension of the representation. Further, back The query 313 may prompt the user to specify the audio output devices 120, 122, 124, 126 for different rooms of the home of the network 101. More generally, the response query 313 can prompt the user interface 310 to display content for enabling the user to define different rooms or spaces of the home covered by the network 101. In some variations, the input information 301 can prompt the user to enter information corresponding to: (i) group size information 309 corresponding to the number of audio output devices on the network 101; and (ii) device location Information 311 identifies the general or relative locations of the audio output devices 120, 122, 124, 126 within the space of the network 101 (e.g., within individual rooms). Further, although some embodiments provide a user interface 310 to prompt the user for input information 301, other embodiments provide a user interface 310 to guide the user to select one of the audio output devices 120, 122, 124, 126 or Multiple configurations, including inputs for selecting channel configuration 333.

In some embodiments, device location logic 330 is operative to determine a set of channel configurations 333 based at least in part on group size information 309 and device location information 311 of individual audio output devices 120, 122, 124, 126. The channel configuration 333 can specify a speaker configuration layout ("C.Lay") 337, such as a 3, 5, 7, (or larger) surround sound layout, or a Dolby 5.1 or 7.1 speaker layout. The channel configuration 333 for the audio output devices 120, 122, 124, 126 may include a channel assignment 339 ("Chan. Ass. 339") for the individual audio output devices. In some variations, the configuration layout 337 can be based on one or more criteria, such as the number of audio output devices 120, 122, 124, 126 (eg, having group size information 309) and/or audio output devices 120, 122, The positioning of 124, 126 (e.g., as specified by device location information 311). In some variations, the configuration layout 337 can be selected in advance. In another variation, the user may be provided with a selection feature via user interface 310 to make a selection for a particular configuration layout 337. Configuration library 329 can maintain information about different possible configuration layouts 337 and provide for selecting one or based on group size information 309 and/or device location information 311 for each audio output device 120, 122, 124, 126. Multiple mechanisms for configuring layout 337. Device location information for each audio output device 120, 122, 124, 126 311 may also be indicated by input information 301 received via user interface 310 and other input from the user (eg, input indicating user preferences). The channel assignment 339 can be programmatically based on, for example, the configuration layout 337 of the audio output devices 120, 122, 124, 126 in the space of the home, the group size information 309, and/or the device location information 311.

Channel configuration 333 can be communicated to audio output interface 340. As mentioned with other examples, the audio output interface 340 can provide an application programming interface that enables the controller device 300 to communicate with other connected devices of the network 101. For example, the audio output interface 340 can be used for wireless peer-to-peer communication, such as provided via Wi-Fi Direct media. In some variations, the audio output interface 340 communicates the channel configuration 333 to the audio output devices 120, 200 that are selected for use by the leader of the particular operational phase on the network.

As mentioned, in some embodiments, controller device 300 includes functionality for calibrating the output of audio output devices 120, 122, 124, 126 on network 101 based on the user's location at a given time. As the location of the user changes, the controller device 300 can implement functionality to dynamically control the output of the individual audio output devices 120, 122, 124, 126 on the network 101 such that the user's audio experience is equally reflected from the individual The output of the audio output device.

In some embodiments, controller device 300 includes an acoustic input interface 306, a timing analysis component 312, and audio output device control logic 320. The audio output device control logic 320 can include a delay (or delay) control 322 and a volume control 324. The acoustic input interface 306 can include a programming component that interfaces with a microphone for implementing the mobile computing device of the controller device 300. In particular, the acoustic input interface 306 can be configured to detect a reference acoustic reference transmission ("AREFTR") 361 from each of the active audio output devices 120, 122, 124, 126 on the network 101. Acoustic input interface 306 can include logic to identify, for example, predetermined characteristics of acoustic reference transmission 361, such as signal patterns.

In some embodiments, each audio output device 120, 122, 124, 126 transmits A unique acoustic reference transmission 361 is transmitted to the identifier of the transmission device. Depending on the implementation, the acoustic reference transmission 361 of each of the audio output devices 120, 122, 124, 126 may be within an audible or inaudible range. In some embodiments, the acoustic reference transmission 361 of each of the audio output devices 120, 122, 124, 126 is communicated in a frequency range detectable by a microphone provided by the mobile computing device of the controller device 300. In addition, each of the audio output devices 120, 122, 124, 126 communicates a corresponding acoustic reference transmission 361 representing a portion of the audio content (eg, a song) output from each of the individual audio output devices (eg, a frame or a series of frames).

The acoustic input interface 306 can include logic to detect the acoustic reference transmission 361 from each of the audio output devices 120, 122, 124, 126. The acoustic input interface 306 can also compare the arrival time 363 of each acoustic reference transmission 361 to determine the delay between arrival times of acoustic reference transmissions from different audio output devices 120, 122, 124, 126 on the network 101 or other difference. As an example, the embodiment recognizes that the sound takes slightly less than 1 millisecond to travel 1 呎, and if the user moves a relatively small amount (eg, one 呎), it can cause the user to listen to the collective from the audio output system 100. The detectable delay of the quality of experience in audio output.

The timing analysis component 312 can analyze the arrival time 363 of each acoustic reference transmission 361 to detect a significant change in the arrival time 363 due to the individual audio output devices 120, 122, 124, 126. The difference in arrival time 363 may indicate the location of the user and, more specifically, the location or proximity of the individual audio output devices 120, 122, 124, 126 relative to the system.

In some variations, the content correlation analysis component 314 can also be implemented in conjunction with the timing analysis component 312. The content correlation analysis component 314 can determine content related information based on timing differences (as identified by the arrival time 363) from the acoustic reference transmissions 361 of the different audio output devices 120, 122, 124, 126. In some variations, the content-related analysis component 314 can detect trends or events from movement of the user in the cyberspace or region. For example The content-related analysis component 314 can refer to known information about the locations of the individual audio output devices 120, 122, 124, 126 (which can be approximated based on the input information 301 and/or based on the location detection technique) to determine that the user has Switch rooms. Accordingly, one of the decisions that may be made from the content correlation analysis component 314 includes a determination to power down or power the selected audio output device 120, 122, 124, 126 based on the determined location of the user. The content correlation analysis component 314 can communicate a content related decision ("CD") 315 to the audio output device control logic 320, which in turn can power the audio output device 120, 122, 124, 126 based on the content related determination 315 or A control command ("CC") 321 is sent for the purpose of powering down to select their audio output devices. As an example, content related decision 315 can include positioning a particular audio output device in one room or floor and positioning the user's information in another room or floor of the home.

Additionally, timing analysis component 312 can generate timing parameters ("TP") 317 that indicate the difference in arrival times 363 of one or more acoustic reference transmissions 361. Delay control 322 of audio output device control logic 320 may utilize timing parameters 317 to generate a delayed command ("DC") 323 for one or more of audio output devices 120, 122, 124, 126. As an example, the output provided from the acoustic input interface 306 indicates that the user has become one of the audio output devices 120, 122, 124, 126 and is remote from the audio output devices 120, 122, 124, 126. In the other case, a delay command 323 can be provided to the immediate audio output device. The delay command 323 can be used to slow or delay the output of the audio output devices 120, 122, 124, 126. The delay caused by the audio output devices 120, 122, 124, 126 may be based on the detected difference in arrival time 363 from the far end and the acoustic reference transmission 361 of the audio output device 120, 122, 124, 126. The delay command 323 can generate a delay that substantially equalizes the arrival time 363 of the immediate and remote audio output devices 120, 122, 124, 126.

Further, the volume control 324 of the audio output device control logic 320 can use the timing parameter 317 to determine the adjustment of the volume of one or more of the output devices 120, 122, 124, 126 for the purpose of the user from all audio output devices. 120, 122, 124, 126 body The same volume is measured regardless of the fact that the user can move or otherwise become close to one or more audio output devices at the expense of another audio output device. In some implementations, the volume control 324 can generate a volume command ("VC") 325 to cause one of: (i) in response to user movement to the immediately adjacent audio output device 120, 122, 124, 126 And (ii) an increase in the volume of the remote audio output devices 120, 122, 124, 126 in response to user movement; or (iii) in response to user movement, respectively The combination of the increase and decrease of the volume of the audio output devices 120, 122, 124, 126 is followed. The particular volume command 325 selected may be based on, for example, a preset setting or a user preference.

The audio output interface 340 can communicate one or more of the control commands 321, the delay commands 323, and/or the volume commands 325 to the connected audio output devices 120, 122, 124, 126 of the network 101. In particular, the delay command 323 and/or the volume command 325 may be generated in response to a continuous poll or check of the user portion as determined by the mobile computing device of the controller device 300. In this manner, delay command 323 and/or volume command 325 can provide a mechanism for calibrating the output characteristics of individual audio output devices 120, 122, 124, 126 on network 101. The calibration functionality enables the user to experience as an equal contribution of audio content, as well as other benefits, from a plurality of audio output devices 120, 122, 124, 126 of the network 101 that are not equally spaced. The calibration functionality also enables the user to experience the audio content equally from the plurality of contributing audio output devices 120, 122, 124, 126, even when the user is in motion or when the user is in close proximity to an audio output device. The same is true when the measurable extent is greater than the proximity to another audio output device. The calibrated functionality, such as described, can also enable the collective audio output from the different audio output devices 120, 122, 124, 126 that are producing output on the network 101 to be equalized in contribution, regardless of the manufacture of the individual audio output devices. There are differences in quality or ability.

4 illustrates an action computing device in which various embodiments may be implemented. The mobile computing device 400 of FIG. 4 can be used to implement a controller device such as that described using the examples of FIGS. 1 and 3. 110, 300. The mobile computing device 400 can include a microphone 410, a processor 420, a display 430, a memory 440, and a network interface 450.

Referring to FIGS. 1-4, memory 440 can store instructions for implementing various functionalities described, for example, by controller devices 110, 300. In some variations, memory 440 stores a device control instruction ("Device Control Instruct.") 441 that can be executed by processor 420 in conjunction with control and calibration functionality (e.g., as described using the example of FIG. 3). The microphone 410 of the mobile computing device 400 receives an acoustic reference transmission ("AREFTR") 361 from the individual audio output devices 120, 122, 124, 126. The acoustic reference transmission 361 can be received as an encoded signal 467 ("Enc. Signal") and can include information identifying the particular audio output device 120, 122, 124, 126 from which the acoustic reference transmission 361 originated. Processor 420 can execute device control instructions 441 to: (i) collect acoustic reference transmissions 361 from different audio output devices 120, 122, 124, 126 for a given point in time; and (ii) implement timing analysis component 312 to determine reflection acoustics The timing parameter 317 of the difference in arrival time 363 of the transmission 361 is referenced.

According to some embodiments, processor 420 may execute device control instructions 441 to determine a calibration command based at least in part on determined timing parameters 317. Moreover, processor 420 can use network interface 450 to communicate calibration commands to one or more of audio output devices 120, 122, 124, 126 on network 101 of mobile computing device 400. The calibration commands may include, for example, a delay command ("DC") 323 that causes the particular audio output device 120, 122, 124, 126 to selectively delay or otherwise adjust the timing of its respective output to calibrate the audio content. Set the segment to the user's arrival time. As an addition or variation, the calibration command can include a volume command ("VC") 325 that is based on, for example, a user and an audio output device being in close proximity to another audio output device 120, 122, 124, 126. The volume of the audio output devices 120, 122, 124, 126 is turned up or down.

According to some variations, processor 420 can also execute device control instructions 441 to implement content correlation analysis component 314 (as described using the example of FIG. 3) and make content related decisions 315. Based on the content related decision 315, a control command ("CC") 321 can be communicated to selectively energize or de-energize the audio output devices 120, 122, 124, 126 based on the user's location relative to the individual audio output devices. The content-related analysis component 314 can make content-related decisions 315 based on content-related information, such as information defining the spacing, flatness, or segmentation (eg, room) of the home of the network 101.

As an addition or alternative, the memory 440 can also store a user interface command ("UI Instruct.") 443. The processor 420 can execute the user interface instructions 443 to generate a user interface ("UI") 431 on the display 430. The user interface 431 can provide prompts and other interfaces to the user to facilitate the user to provide input information 301 regarding the audio output devices 120, 122, 124, 126 in use on the network 101. In particular, the input information 301 received via the user interface 431 can include a configuration input ("Config.Input") 433 that includes: (i) group size information 309 (FIG. 3) that identifies the network 101. The number of audio output devices 120, 122, 124, 126; (ii) device location information 311, including location indications for one or more audio output devices 120, 122, 124, 126; and/or (iii) Selected or preferred layout. In one example, the mobile computing device 400 determines the channel configuration 453 based at least in part on the user's configuration input. The configuration input can be determined via interaction of the user with the user interface 431 provided on the display 430.

Still further, memory 440 can include a location logic instruction ("Position Logic Instruct.") 445 that, when executed by processor 420, causes processor 420 to generate channel configuration 453. As described with some other examples, channel configuration 453 can include one or more of: (i) an audio output device layout or scheme; and/or (ii) based on a selected device layout for network 101. The channel assignment of each of the audio output devices 120, 122, 124, 126. The location logic instruction 445 can determine the channel based on additional information, such as input information 301 provided by the user, and/or known information about a particular type or model of one or more of the audio output devices 120, 122, 124, 126. Configuration 453. For example, the user can use the user interface 431 to type information about a particular audio output device, and is specific to The capabilities known to the audio output device may facilitate the use of the device as a channel assignment for a particular location.

Figure 5 illustrates an audio output device in which various embodiments may be implemented. In particular, the example of FIG. 5 illustrates an audio output device 500 that can also be operated as a leader device (e.g., 120) as described in the example of FIG.

Referring to FIGS. 1 through 5, in more detail, the audio output device 500 includes a buffer 508, a processor 510, an audio output component 530, a network interface 540, and a memory 550. In a variation, the audio output device 500 includes a digital signal processor (DSP) 512. Memory 550 can store instructions for execution by processor 510, such instructions including interface instructions 551 and/or leader device instructions 553. When operating in network 101, processor 510 can execute interface instructions 551 to receive incoming audio stream 505 at buffer 508 via network interface 540. In some implementations, at least a portion of (i) audio stream 505 is directed to audio output component 530, which produces an audio content output ("ACO") 535, and (ii) transmits at least a portion of audio stream 505 To other audio output devices 120, 122, 124, 126. In some embodiments, DSP 512 processes audio stream 505 into audio output data 515 that can, for example, structure audio stream 505 into a delineable channelized portion that can be easily filtered at the playback location. The audio output component 530 can receive the audio output data 515 from the DSP 512. In a variation, audio output component 530 receives audio stream 505 from buffer 508. Still further, the audio output component 530 can receive the channel portion 573 of the audio stream 505 based on the channel assignment as determined by the processor 510. The audio output component 530 can convert the audio output data 515 (or audio stream 505) into sound that is transmitted from the audio output device 500 to the physical space of the network 101.

Additionally, as a leader, processor 510 of audio output device 500 can execute leader device instructions 553 to: (i) determine channel assignment 555 and communicate channel assignment 555 to other audio output devices 120, 122 on network 101, 124, 126; (ii) distributing the audio stream 505 (or a portion thereof) to other audio output devices 120, 122, 124, 126; and/or (iii) Implementing or otherwise communicating a calibration action 557 that affects the generation of audio output on other audio output devices 120, 122, 124, 126. In a variation, processor 510 can execute leader device instructions 553 to utilize and disseminate an enhanced version of audio stream 505 from DSP 512 (shown as audio output material 515).

The audio output device 500 can also execute the leader device command 553 to receive input information 501 from the controller devices 110, 300. The input information 501 may include group size information ("GS") 509, channel layout information ("CL") 517 (eg, positioning of individual audio output devices around the home according to Dolby 5.1/7.1, etc.), and configuration input. ("CI") 559, and other items. The input information 501 can be received by, for example, user input provided through interaction with the user interface 310.

In some implementations, channel assignment 555 can be determined by controller device 110, 300 and received by audio output device 500 via network interface 540. In some variations, channel assignment 555 can be determined by channel selection command 561 executing on audio output device 500. The channel selection command 561 can utilize the input information 501, which includes: (i) group size information 509 corresponding to the number of audio output devices 120, 122, 124, 126; (ii) channel layout information 517; and (iii) The general configuration of the audio output devices 120, 122, 124, 126 is provided as a configuration input 559. Channel selection command 561 utilizes various inputs to determine channel assignments 555 for individual audio output devices 120, 122, 124, 126. Input for the channel selection command 561 can be received via the network interface 540 from, for example, the mobile computing device 400 as the controller device 110,300.

Some embodiments provide audio output device 500 as a leader to distribute audio transmission data ("ATD") 525 to other audio output devices 120, 122, 124, 126 using network interface 540. Depending on the implementation, the audio transmission material 525 may correspond to: (i) all of the audio stream 505, which may be filtered by other audio output devices 120, 122, 124, 126 that receive the audio stream 505; (ii) the audio output data 515, It structures all of the audio stream 505 into predetermined and definable channelized portions that can be easily filtered at the playback location; and/or (iii) Separate channel portion 573, which can be individually transmitted to a particular audio output device based on the channel assignments of audio output devices 120, 122, 124, 126.

In some embodiments, selecting a leader among the audio output devices 120, 122, 124, 126 can be modally implemented, which can be dynamically implemented by the controller device 110, 300. In an alternative mode, the audio output devices 120, 122, 124, 126 for the leader may be, for example, a source of audio streams, an access point 102, and a mobile computing device 400 acting as a controller device 110, 300 (which may also Acting as the source of content or replacing the other of the audio output devices 120, 122, 124, 126. In other variations, designating an audio output device 120, 122, 124, 126 as a leader can be subject to changes based on selection logic on the controller device 110, 300. For example, the controller device 110, 300 can execute selection logic to change the leader in response to an event or condition, such as the presence of a low frequency width at the original selected leader device.

According to some embodiments, audio stream 505 can be received via network interface 540, then buffered and processed at buffer 508. Input audio stream 505 can represent all streams without any channel demarcation or segmentation from larger content. Processor 510 (or DSP 512 (if used)) may perform filtering logic ("filter") 571 to generate a plurality of channel portions 573 of audio stream 505. Each channel portion 573 can correspond to one of the channels of the determined channel configuration. In particular, audio stream 505 can be filtered into a plurality of channel portions 573, wherein each channel portion 573 is designated for a particular channel assigned to an audio output device 120, 122, 124, 126 on network 101. . Channel portion 573 of audio stream 505 can then be transmitted to other audio output devices 122, 124, 126 using network interface 540.

Regarding the calibration action, the audio output device 500 can receive a calibration command ("Cal. Comm.") 552 from the mobile computing device 400 and then implement the calibration command 552 as a calibration action 557. Calibration action 557 may correspond to or be based on calibration command 552. The calibration action 557 can be performed directly by communication of the audio transmission data 525 or by communication with other audio output devices 120, 122, 124, 126 via the network interface 540. In some changes, audio loss The device 500 receives calibration related measurements and data, such as timing parameters 317, from the mobile computing device 400. In a variation, the audio output device 500 can also include a determination to include or correspond to a calibration command 552 based on measurements and data of the mobile computing device (eg, time difference of arrival for a common audio segment, timing parameters, etc.) The logic of the calibration action 557 of the volume, etc.).

Methodology

6 illustrates a method 600 for dynamically determining and implementing a channel configuration for a network-based audio system, in accordance with various embodiments. 7 illustrates a method 700 for operating an audio output device as a leader device when distributing audio content to other audio output devices on the network, in accordance with various embodiments. 8 illustrates a method 800 for calibrating the output of a plurality of audio output components on a network based on the relative position of the user, in accordance with various embodiments. FIG. 9 illustrates a method 900 for calibrating an audio output device based on a user's location, in accordance with various embodiments. 10 illustrates a method 1000 for implementing a user interface to initiate dynamic configuration of a network-based audio system. Example methods such as those provided by Figures 6-10 can be performed using components such as those described using the examples of Figures 1-5. Accordingly, reference may be made to the elements of FIGS. 1 through 5 for the purpose of describing suitable components for performing the steps or sub-steps described.

Referring to FIG. 1, a set of audio output devices 120, 122, 124, 126 (610) for a given network 101 can be identified by controller devices 110, 300. In some implementations, the audio output devices 120, 122, 124, 126 can be identified by input information from the user. In some implementations, input information 301 can be provided via a user interface 310 of controller device 110 that can be provided on mobile computing device 400. In one variation, the audio output devices 120, 122, 124, 126 connected to the network 101 can be identified in a programmatic manner using, for example, object tracking and detection techniques. For example, the audio output devices 120, 122, 124, 126 of the network 101 can be equipped with a receiver for receiving transmissions of ultrasonic sound waves. The controller device 110, 300 can transmit the ultrasonic sound waves to the individual audio output devices 120, 122, 124, 126, and the audio output devices 120, 122, 124, 126 can include programming or logic to detect ultrasonic sound waves. Ultrasonic sound waves can provide for the use of dimensional parameters based on received transmissions.

Additional configuration information (612) may also be determined for the identified audio output devices 120, 122, 124, 126, 200, 500 of the network 101. Additional configuration information may include selected device layouts (eg, 5.1 configuration, 7.1 configuration, etc.), as well as relative locations of individual audio output devices 120, 122, 124, 126, 200, 500 around the physical area of network 101. For example, the user can specify the approximate locations of the individual audio output devices 120, 122, 124, 126, 200, 500 using the virtual interface of the generic room provided by the user interface 310 of the controller device 110, 300.

Once the audio output devices 120, 122, 124, 126 are identified and other configuration information is determined, the channel configuration (620) for the audio output devices 120, 122, 124, 126 can be determined. The channel configuration may specify channel assignments for the identified audio output devices 120, 122, 124, 126 as described with other examples. In some examples, the channel configuration can be determined based on, for example, the mobile computing device 400 for implementing the controller devices 110, 300. In a variation, the channel configuration can be determined based on the audio output device 120, 122, 124 or 126 selected by the user and/or controller device 110, 300 as the leader. Still further, in another variation, the channel configuration can be determined from a plurality of components including controller devices 110, 300 or audio output devices 120, 122, 124 or 126 that operate as a leader.

According to some embodiments, when the audio output devices 120, 122, 124, 126 are in use, an event or condition that requires a dynamic or operational change to the configuration of the audio output device can be detected (630). In some implementations, the occurrence of a condition or event may correspond to the introduction of a new audio output device to network 101 (632). Alternatively, the condition or event may correspond to one of the existing audio output devices 120, 122, 124, 126 being removed or removed from the network 101 (634). Further, there may be a change in network bandwidth (636), causing some of the audio output devices 120, 122, 124, 126 to have a wider bandwidth than other audio output devices. 120, 122, 124, 126 change better or worse. As another variation, the audio content played by the various audio output devices 120, 122, 124, 126 can be changed. For example, if the audio content changes from having a relatively normal or low bit count to having a relatively high bit count, the channel configuration should be subject to change.

Still further, the network condition or event may correspond to the user moving around the area in which the audio output device 120, 122, 124, 126 is in use and present (638). As described, some embodiments provide for detecting user movement as the user moves around, and one or more calibration actions can be performed to equalize the audio output devices 120, 122, 124 on the network 101, 126 The audio experience produced. As an addition or change, a response to the user moving in the physical area of the audio output device 120, 122, 124, 126 may be: changing the channel configuration to accommodate the user's movement.

In response to detecting an event or condition, the controller device 110, 300 and/or the audio output device 120, 122, 124 or 126 of the leader can respond by changing the channel configuration (640). More specifically, in some implementations, the channel configuration can be changed to accommodate more or fewer audio output devices 120, 122, 124, 126 by changing various channel assignments (642) (added from network 101 or Reduce the case of audio output devices). Additionally, the channel configuration can be changed by changing the layout to facilitate changes (644) to, for example, the number of audio output devices 120, 122, 124, 126. Still further, the channel configuration change can be in response to the addition or deletion of a channel assignment (646).

Referring to Figure 1, the leader (710) of the audio output device 120, 122, 124 or 126 is selected. The selection of the audio output device 120, 122, 124 or 126 for the leader may also be dynamic, in that some variations provide that the audio output device for the leader may be selected and/or changed by the controller device 110, 300. As an example, the audio output device 120, 122, 124 or 126 selected as the leader may change (712) due to changes in the bandwidth available to the device, particularly as compared to other audio outputs on the network 101. Devices 120, 122, 124, 126.

According to some embodiments, some or all of the channel configuration (720) may be implemented via the audio output device 120, 122, 124 or 126 for the leader. Still further, the audio output devices 120, 122, 124 or 126 and/or controller devices 110, 300 for the leader can be combined to implement various channel configurations for all of the audio output devices 120, 122, 124, 126. The channel configuration can also be determined based on the controller devices 110, 300, and then the channel configuration is communicated to the audio output device 120, 122, 124 or 126 operating as the leader. The channel configuration may include channel assignments for each of the audio output devices 120, 122, 124, 126 as described with other examples. In some variations, the channel configuration may also include other information, such as a hypothetical layout for the audio output devices 120, 122, 124, 126.

In operation, audio content may be received on the audio output device 120, 122, 124 or 126 of the leader for distribution to other audio output devices 120, 122, 124, 126 (730) of the network 101. Upon receiving and distributing the audio content, the leader audio output device 120, 122, 124 or 126 may also output a portion (732) of the audio content assigned to its own channel.

In some variations, the audio content is received on the audio output devices 120, 122, 124, 126, and then the audio content is transmitted to other audio output devices 120, 122, 124, 126 on the network 101 in accordance with the determined channel configuration. (740). In some implementations, the audio output device 120, 122, 124 or 126 acting as the leader operates to filter the audio content for the individual channels, and then transmits the filtered audio portion to the other audio output devices 120, 122 based on the channel assignment, 124, 126 each (742). As an addition or change, all of the audio content can be sent from the audio output devices 120, 122, 124, 126 to other audio output devices 120, 122, 124, 126 of the network 101. In this implementation, the audio output devices 120, 122, 124, 126 that receive all of the audio content from the leader perform filtering at the output time, and further continue to output only (744). Further along these lines, some of the changes provide audio content to be amplified, and more specifically, the audio output of the controller device 110, 300 or the leader for the purpose of generating a structure in the audio content. The audio content to be processed on device 120, 122, 124 or 126 is output (746). The added structure can facilitate other audio output devices 120, 122, 124, 126 to perform filtering operations on all of the audio content.

As mentioned with respect to method 600, an event or condition is detected (750) of a change in the initial channel configuration and/or other selection (e.g., selection of a particular leader device or motivation implementation, etc.). As an example, an event or condition may correspond to a change in bandwidth of some or all of the audio output devices 120, 122, 124, 126, a change in output content (eg, a bit value of the content), and an audio output device from the network 101. Add or subtract, and/or move by the user sufficient to trigger the calibration action.

In response to the detected event or condition, one or more processing programs may be triggered to dynamically adjust the channel configuration and be made by the controller device 110, 300 or the audio output device 120, 122, 124 or 126 operating as the leader. Other options (760). In some implementations, the controller devices 110, 300 and/or the audio output device 120, 122, 124 or 126 of the leader can be made by adjusting the channel configuration of the respective audio output device as the output continues on the network. Response (762). Channel configuration changes may include: (i) changing the channel assignments for a given output device 120, 122, 124, 126; (ii) generating based on the addition or subtraction of the audio output devices 120, 122, 124, 126 to the network 101. Or eliminating channel assignments; and/or (iii) changing the audio output devices 120, 122 based on user input, number of audio output devices 120, 122, 124, 126 changes, or any other criteria, The selected layout of 124, 126. The channel configuration can be dynamically changed so that changes to the channel configuration are relatively smooth and do not interrupt the user's listening experience. For example, one or more changes can be made to the channel configuration, and at least one or more of the audio output devices 120, 122, 124, 126 continue to output audio content.

Other changes that may be implemented dynamically include the selection (764) of the audio output device 120, 122, 124 or 126 operating as the leader. For example, the audio output device 120, 122, 124 or 126 operating as the leader can implement mode changes to enable other audio output devices. The settings 120, 122, 124, 126 receive audio content from the controller device 110, 300 or source rather than from the leader audio output device. Likewise, another mode change can be made to select a new audio output device 120, 122, 124 or 126 as the leader based on criteria such as the amount of bandwidth available for the selected audio output device. Thus, for example, the selection of the audio output device 120, 122, 124 or 126 that acts as the leader can be dynamic and made in operation. Likewise, other options that can be dynamically made include: (i) the choice of mode of operation, such as whether any of the audio output devices 120, 122, 124, 126 can be used as a leader in the same stage of operation (ii) whether to filter or structure the audio content (eg, with or without a leader device); and/or (iii) whether to filter or expand other audio output devices 120, 122, 124, 126 prior to transmission Increase the content of the audio.

Referring to FIGS. 1-8, when audio is being output by the audio output devices 120, 122, 124, 126, the location of the user can be tracked within the network environment based on measurements made by the user's mobile computing device 400 (810). ). More specifically, the proximity computing device 400 (which may be carried by the user) may be in close proximity (812) to one or more of the audio output devices 120, 122, 124, 126 on the network 101. Based on the determined relative position of the user, one or more of the output characteristics can be calibrated to accommodate the audio output device 120, 122, 124, 126 of the user and network 101 as indicated by the user's mobile computing device. The assumption is relatively close (820). As mentioned with other examples, calibration may include controlling or otherwise adjusting the volume (822) of one or more of the audio output devices 120, 122, 124, 126. As an addition or change, the calibration may include adjusting the delay or inserting a delay into the output of the audio content from one or more of the audio output devices 120, 122, 124, 126 (824). The insertion of the delay may be based on, for example, a proximity decision between the selected audio output device 120, 122, 124, 126 and the user as compared to other devices connected to the same network 101.

Referring to FIGS. 1-9, each audio output device 120, 122, 124, 126 is triggered to transmit an acoustic identification signal to the controller device 110, 300 (eg, a mobile computing device) 400) (910). The acoustic identification signal can be an audible and encoded transmission that identifies the source of the acoustic transmission (912). In variations, the acoustic identification signal can be an inaudible and encoded transmission (914) that can be detected by a resource (e.g., a microphone) for implementing the computing device of the controller device 110, 300.

The mobile computing device 400 can perform a comparison (920) of the arrival times of the acoustic identification signals transmitted from each of the audio output devices 120, 122, 124, 126. Each acoustic identification signal can include a particular segment of the played audio content. For example, each acoustic identification signal can represent one or two frames of audio content. Each of the audio output devices 120, 122, 124, 126 can transmit an acoustic identification signal for a common portion of the audio content output on the device. The acoustic identification signal can provide a mechanism for the user's mobile computing device 400 to make measurements indicative of the position of the mobile computing device relative to one or more other audio output devices 120, 122, 124, 126.

In some implementations, the mobile computing device 400 includes software or other programming functionality to time stamp the incoming audio signal, extract the encoded identifier, and store the timestamp and identifier of the incoming audio signal for subsequent analysis. Each audio transmission can be encoded to coincide with a particular moment in the audio content. For example, a particular audio frame in the song can be selected for encoding by each audio output device 120, 122, 124, 126, and each audio output device 120, 122, 124, 126 can then output the song when the song is played. Part of the audio frame. The microphone on the mobile computing device 400 can detect the encoded audio signal from each of the audio output devices 120, 122, 124, 126, and then record the arrival time and identifier for each signal. Once the total transmission for a given time is recorded, a comparison of the arrival times can be performed. The comparison can identify changes in the arrival time of the audio output device, assuming that the sound travels about 1 在 in 1 millisecond. If the arrival time reflects a deviation greater than 1 millisecond, the arrival time indicates that the mobile computing device 400 has moved the relevant amount. More specifically, the comparison of arrival times may indicate that the user's mobile computing device 400 (on which the control devices 110, 300 are implemented) is connected to one or more of the audio output devices 120, 122, 124, 126 of the network 101. Near Pick up.

The output from one or more of the audio output devices 120, 122, 124, 126 can be controlled to calibrate the audio output from all of the audio output devices and to coordinate the user experience (930). As described, some embodiments provide a calibration action to include the following: (i) adjusting timing for individual audio output devices 120, 122, 124, 126 such that at least the time of arrival of the plurality of audio output devices is based on the user's perspective Substantially the same (932); and (ii) adjusting the volume of the individual audio output devices 120, 122, 124, 126 such that the user experiences the same volume for each of the devices regardless of the user and the particular What is the distance between the audio output devices 120, 122, 124, 126 (934).

Referring to Figures 1 through 10, a user interface 310 can be generated on the mobile computing device 400 for implementing the controller devices 110, 300 to enable a user to provide for determining channel configurations and various other dynamic decisions (e.g., operations). Some or all of the configuration inputs for the mode, the choice of the leader device, etc.).

According to various embodiments, the audio output devices 120, 122, 124, 126 (1010) of the network 101 can be located and linked. As mentioned with other examples, each audio output device 120, 122, 124, 126 may be capable of network communication, such as wireless communication (eg, such as inter-stage wireless communication provided by Wi-Fi Direct). The audio output devices 120, 122, 124, 126 can be linked regardless of the manufacturer or primary purpose. Still further, in variations, the audio output devices 120, 122, 124, 126 may be heterogeneous in terms of manufacturer, functionality, programming resources, and/or primary resources.

A user interface 310 can be generated to prompt or otherwise direct the user to provide information (1020) regarding the audio output devices 120, 122, 124, 126 connected to the network 101. For example, the number of audio output devices 120, 122, 124, 126 connected to network 101 can be specified by user input provided via user interface 310. In addition, the user can identify each of the audio output devices 120, 122, 124, 126 and further identify each of the audio output devices 120, 122, 124, 126 in the user's home or network space. The opposite part. For example, the user interface 310 that depicts the general outline of the room (eg, FIG. 11) can be provided to the user. The profile can be generic or include user-specified features (eg, additional walls, circular walls, etc.). The user can identify the particular audio output device 120, 122, 124, 126 in the user settings and then further indicate the location in the particular audio output device or the location in the home.

Once the number of audio output devices and their respective locations are substantially identified, the functionality provided by the audio output devices 120, 122, 124, 126 can trigger a channel assignment decision (1030). As described with other embodiments, the number of audio output devices 120, 122, 124, 126, the location of each audio output device, and the selected layout or configuration may serve as inputs for determining channel assignments when determining channel assignments.

Once the channel assignments and locations are determined, calibration can be performed based on the relative locations of the users (1040). The initial calibration can, for example, calibrate the arrival time and volume level of the media content output from each of the audio output devices 120, 122, 124, 126 based on the user's initial location relative to the audio output device. The user can then choose to perform the calibration periodically or repeatedly to track the user's pace in the home or space.

FIG. 11 illustrates a user interface 1100 for enabling speaker selection and assignment in accordance with various embodiments. The user interface 1100 can be generated from an application or programming component executing on the mobile computing device 400. The user interface 1100 can, for example, include input functionality including: (i) a number selection feature for enabling a user to specify the number of audio output devices 120, 122, 124, 126 to be in use 1106; and (ii) a layout selection 1109 feature for enabling a user to select a preferred layout. Additionally, the placement functionality 1108 can be provided to the user to enable the user to specify the location of the individual audio output devices 120, 122, 124, 126 within the room representation 1112. (For example, room representation 1112 can be a graphical representation of a room). The user can, for example, click on the device representation 1111 and drag the device representation 1111 onto the room representation 1112 to immediately approximate the general location and orientation of the audio output devices 120, 122, 124, 126.

Once the audio output devices 120, 122, 124, 126 are located, the user can select the calibration feature 1120 to initiate a calibration process as described in the application method 1000. The calibration feature 1120 can be triggered once to position the user relative to the audio output devices 120, 122, 124, 126. The calibration feature 1120 can correct any inaccuracies or errors that the user may have when specifying portions of the individual audio output devices 120, 122, 124, 126. Additionally, the calibration feature can be implemented in a tracking mode in which calibration is performed repeatedly to track whether the user is moving.

The illustrative embodiments are described in detail herein with reference to the accompanying drawings, and the invention It is intended that the scope of the embodiments described herein be defined by the scope of the claims and their equivalents. In addition, it is contemplated that the particular features described individually or as part of the various embodiments may be combined with other individually described features or portions of other embodiments. Therefore, the lack of a combination of descriptions should not preclude the inventors from claiming such combinations.

900‧‧‧ method

910‧‧ steps

912‧‧ steps

914‧‧‧Steps

920‧‧‧Steps

930‧‧‧Steps

932‧‧‧Steps

934‧‧‧Steps

Claims (20)

A method for providing an audio output, the method being implemented by one or more processors and comprising: triggering each of a plurality of audio output devices to generate an acoustic identification signal; executing from the plurality of audio output devices a comparison of the acoustic identification signals of each of; and controlling output from one or more of the plurality of audio output devices based on the comparison. The method of claim 1, further comprising determining, from the comparison, a relative location of a user relative to each of the plurality of audio output devices; and wherein controlling the output is based on the relative location. The method of claim 2, wherein controlling the output comprises calibrating the output from the plurality of audio output devices for the relative portion of the user. The method of claim 3, wherein calibrating the output comprises controlling, according to a timing parameter, one or more of the plurality of audio output devices to generate an audio transmission corresponding to a segment of an audio content for the plurality of audio The timing parameter of each of the one or more of the output devices is selected such that the audio transmission from each of the one or more audio output devices reaches the portion of the user at approximately the same time . The method of claim 3, wherein calibrating the output comprises adjusting an output volume of at least one of the plurality of audio output devices based on the portion of the user. The method of claim 1, wherein the acoustic identification signal is within an audible range of human hearing. The method of claim 6, wherein the acoustic identification signal encodes an identifier corresponding to one of the plurality of audio output devices. The method of claim 1, wherein the acoustic identification signal is within an inaudible range of human hearing. The method of claim 1, wherein comparing the acoustic identification signal from each of the plurality of audio output devices comprises comparing an arrival time from an audio transmission of each of the plurality of audio output devices. The method of claim 9, further comprising: using a difference in the arrival times of the audio transmissions to approximate a relative position of a user relative to each of the plurality of audio output devices. The method of claim 1, wherein the method is performed on a mobile computing device. The method of claim 1, wherein the method is performed on a combination of a mobile computing device and an audio output device operating as one of the leaders of the plurality of audio output devices. The method of claim 12, wherein controlling the output comprises selectively activating an individual audio output device based on a relative location of a user. The method of claim 1, wherein the performing the comparison is performed on a mobile computing device and controlling the output to be performed on a leader device of the plurality of audio output devices. A computing device comprising: one or more processors; a network interface; wherein the one or more processors use the network interface to interface with at least one of the first plurality of audio output devices Communicating to: trigger each of the plurality of audio output devices to generate an acoustic identification signal; perform a comparison of the acoustic identification signals from each of the plurality of audio output devices; An output from one or more of the plurality of audio output devices in the group is controlled based on the comparison. The computing device of claim 15, wherein the one or more processors: determine, from the comparison, a relative location of a user relative to each of the plurality of audio output devices; and control the Output. The computing device of claim 16, wherein the one or more processors control the output by calibrating the output from the plurality of audio output devices in the group for the relative portion of the user. The computing device of claim 17, wherein the one or more processors control one or more of the plurality of audio output devices to generate an audio transmission corresponding to a segment of an audio content by a timing parameter Calibrating the output, the one or more processors selecting timing parameters for each of the one or more audio output devices such that the audio transmission from each of the plurality of audio output devices is approximately The part of the user is reached at the same time. The computing device of claim 16, wherein the one or more processors adjust an output of at least one of the plurality of audio output devices of the plurality of audio output devices based on the relative portion of the user Calibrate the output with the volume. A non-transitory computer readable medium storing instructions that, when executed by one or more processors of a computing device, cause the computing device to perform operations comprising: triggering each of a plurality of audio output devices One for generating an acoustic identification signal; performing a comparison of the acoustic identification signals from each of the plurality of audio output devices; and controlling one or more of the plurality of audio output devices based on the comparing One of the outputs.