TWI619395B - System and method for changing a channel configuration of a set of audio output devices - Google Patents

Abstract

A set of audio output devices can be created and configured to output channel specific audio. Once established, the channel configuration can be changed and updated in response to events such as changes to user preferences or the addition or subtraction of audio output devices to the network. In some embodiments, reconfiguration can be performed immediately when audio content is being output by the audio output devices.

Description

System and method for changing one channel configuration of a group of audio output devices

There are audio systems using network-connected audio output devices (eg, speakers). In these systems, multiple connected speakers can be used to output the same content.

100‧‧‧Audio output system

101‧‧‧Internet

102‧‧‧Access Point

103‧‧‧Media Archives

105‧‧‧Media Cabinet

107‧‧‧Internet Services

109‧‧‧Content source

110‧‧‧controller device

111‧‧‧ Leader Choice

112‧‧‧Audio distribution logic

113‧‧‧Audio Content

114‧‧‧Dynamic selection logic

115‧‧‧channel configuration

116‧‧‧Channel configuration logic

117‧‧‧Configuration Scheme

118‧‧‧calibration logic

119‧‧‧ adjustment

120‧‧‧Audio output device

121‧‧‧ Channel section

122‧‧‧Audio output device

123‧‧‧Channel Assignment

124‧‧‧Audio output device

126‧‧‧Audio output device

133‧‧‧Amplified audio

200‧‧‧Audio output device

201‧‧‧ Audio Content

210‧‧‧Audio Receiver

212‧‧‧Audio Content

215‧‧‧Channel section

217‧‧‧Audio Content

219‧‧‧Amplified Stream

220‧‧‧Control logic

221‧‧‧Channel configuration data

222‧‧‧Channel Filter

226‧‧‧channel expansion

230‧‧‧Audio output resources

240‧‧‧ device interface

243‧‧‧User input

244‧‧‧Channel configuration logic

245‧‧‧Set

249‧‧‧Calibration input

250‧‧‧ Calibration control

251‧‧‧Delay Control

253‧‧‧Volume Control

300‧‧‧ controller device

301‧‧‧Enter information

306‧‧‧Acoustic input interface

309‧‧‧Group Size Information

310‧‧‧user interface

311‧‧‧device location

312‧‧‧timing analysis component

313‧‧‧Response to enquiries

314‧‧‧Content analysis component

315‧‧‧ Content related judgment

317‧‧‧timing parameters

320‧‧‧ Audio output device control logic

321‧‧‧Control Command

322‧‧‧ Delay Control

323‧‧‧Delay Order

324‧‧‧Volume Control

325‧‧‧Volume Command

329‧‧‧Configuration Library

330‧‧‧device location logic

333‧‧‧Channel configuration

337‧‧‧Configuration layout

339‧‧‧Channel Assignment

340‧‧‧Audio output interface

361‧‧‧Acoustic Reference Transmission

363‧‧‧arrival time

400‧‧‧ mobile computing device

410‧‧‧Microphone

420‧‧‧Processor

430‧‧‧ Display

431‧‧‧user interface

433‧‧‧Configuration input

440‧‧‧Memory

441‧‧‧device control instruction

443‧‧‧User Interface Command

445‧‧‧Position logic instruction

450‧‧‧ network interface

453‧‧‧Channel configuration

467‧‧‧coded signal

500‧‧‧audio output device

501‧‧‧Enter information

505‧‧‧Audio streaming

508‧‧‧Buffer

509‧‧‧Group Size Information

510‧‧‧ processor

512‧‧‧ Digital Signal Processor (DSP)

515‧‧‧Audio output data

517‧‧‧Channel layout information

525‧‧‧Audio transmission data

530‧‧‧Audio output component

535‧‧‧Audio content output

540‧‧‧Interface

550‧‧‧Memory

551‧‧‧Interface command

552‧‧‧calibration order

553‧‧‧ Leader Device Instructions

555‧‧‧ Channel Assignment

557‧‧‧Calibration action

559‧‧‧Configuration input

561‧‧‧channel selection instruction

571‧‧‧filtering logic

573‧‧‧Channel section

600‧‧‧ Method

610‧‧‧step

612‧‧‧step

620‧‧‧step

630‧‧‧step

632‧‧‧step

634‧‧‧step

636‧‧‧step

638‧‧‧step

640‧‧‧step

642‧‧‧step

644‧‧‧step

646‧‧‧step

700‧‧‧ Method

710‧‧‧step

712‧‧‧step

720‧‧‧step

730‧‧‧step

732‧‧‧step

740‧‧‧step

742‧‧‧step

744‧‧‧step

746‧‧‧step

750‧‧‧step

760‧‧‧step

762‧‧‧step

764‧‧‧step

800‧‧‧ Method

810‧‧‧step

812‧‧‧step

820‧‧‧step

822‧‧‧step

824‧‧‧step

900‧‧‧ Method

910‧‧‧step

912‧‧‧step

914‧‧‧step

920‧‧‧step

930‧‧‧step

932‧‧‧step

934‧‧‧step

1000‧‧‧ Method

1010‧‧‧step

1020‧‧‧step

1030‧‧‧ steps

1040‧‧‧step

1100‧‧‧user interface

1106‧‧‧number selection feature

1108‧‧‧Placement functionality

1109‧‧‧Layout Selection Features

1111‧‧‧ Device indication

1112‧‧‧ Room indication

1120‧‧‧ Calibration Features

FIG. 1 illustrates a network-based audio output system capable of dynamic configuration and / or calibration according to various embodiments.

FIG. 2 illustrates an audio output device that can be selected and operated as a leader device according to various embodiments.

FIG. 3 illustrates an example of a controller device for use with various embodiments.

FIG. 4 illustrates a mobile computing device in which various embodiments may be implemented.

FIG. 5 illustrates an audio output device for implementing various embodiments.

FIG. 6 illustrates a method for dynamically determining and implementing a channel configuration for a network-based audio system according to various embodiments.

FIG. 7 illustrates a method for operating an audio output device as a leader device when distributing audio content to other audio output devices on a network according to various embodiments.

FIG. 8 illustrates a method for calibrating the output of a plurality of audio output components on a network based on a user's relative position according to various embodiments.

FIG. 9 illustrates a method for calibrating an audio output device based on a user's location according to various embodiments.

FIG. 10 illustrates a method for implementing a user interface to initiate a dynamic configuration of a web-based audio system according to various embodiments.

FIG. 11 illustrates a user interface for enabling speaker selection and assignment according to various embodiments.

According to some embodiments, a set of audio output devices may be created and configured to output channel-specific audio. Once established, the channel configuration can be changed and updated in response to events such as changes to user preferences or addition or subtraction of audio output devices to the network. In some embodiments, reconfiguration can be performed in real time while audio content is output by the devices.

In some embodiments, the audio output device can be controlled such that the output of the device is calibrated to the user's location. In detail, the arrival time and / or volume of the audio can be calibrated so that the user can experience the output according to the viewpoint that it is equally separated from each audio output device, where each audio output device provides a uniform audio output.

The embodiments described herein provide a system, method, and device for outputting audio content via a network. In some embodiments, a plurality of audio output devices connected to a network to form an audio output group for receiving and outputting at least a portion of audio content originating from a source. The controller device can determine the channel configuration for the audio output group. The channel configuration may include a channel assignment for each audio output device connected to the network to form an audio output group. When audio content is being output, the controller device can respond to events or conditions by changing the channel configuration.

In some embodiments, the controller device determines the channel configuration for the audio output group. The channel configuration may include a channel assignment for each audio output device connected to the network to form an audio output group. The controller device receives audio content from a source and outputs a channel portion of the audio content based on a channel assignment of a given audio output device. For each of the other audio output devices, the controller device communicates at least another portion of the audio content to the other audio output devices. In addition, the controller changes the channel configuration and then The channel is assigned to output the channel portion of the audio content in response to an event or condition.

In some embodiments, each of the plurality of audio output devices is triggered to generate an acoustic identification signal. The controller device may perform a comparison of the acoustic identification signals from each of the plurality of audio output devices. The output from one or more audio output devices is controlled based on the comparison.

As used herein, a speaker is intended to mean an audio output device, such as a network-connected audio output device. An example of a speaker includes a dedicated device that outputs audio such as music. Another non-limiting example of a speaker includes a multi-function device, such as a mobile device or tablet, that can output video, capture and store audio content, enable user interaction, and / or perform many other actions.

Various embodiments described herein provide that methods, techniques, and actions performed by a computing device are performed programmatically or as a computer-implemented method. Programmatically means the use of code or computer-executable instructions. The steps performed programmatically may or may not be automatic.

Programming modules or components may be used to implement the various embodiments described herein. A programming module or component may include a program, subroutine, part of a program, or software or hardware component capable of performing one or more of the tasks or functions stated. As used herein, a module or component may exist on a hardware component independently of other modules or components. Alternatively, a module or component may be a common component or process of other modules, programs, or machines.

In addition, various embodiments described herein may be implemented via instructions executable by one or more processors. These instructions can be carried on a computer-readable medium. Examples of processing resources and computer-readable media that can carry and / or execute instructions for implementing embodiments of the invention are provided below using the machines shown or described in the figures. In detail, many machines shown using embodiments of the present invention include a processor and various forms of memory for holding data and instructions. Examples of computer-readable media include non-volatile memory storage devices, Such as a hard drive on a personal computer or server. Other examples of computer storage media include portable storage units such as CD or DVD units, flash or solid state memory (such as carried on many cellular phones and consumer electronic devices), and magnetic memory. Computers, terminals, and network-enabled devices (for example, mobile devices such as cellular phones) are all examples of machines and devices that utilize processors, memory, and instructions stored on computer-readable media. In addition, the embodiments can be implemented in the form of a computer program or a computer-supportable medium that can carry the program.

System specification

FIG. 1 illustrates a network-based audio output system 100 capable of dynamic configuration and / or calibration according to various embodiments. The audio output system 100 may be implemented in a local or closed network 101 such as provided by a home or local area network. The network 101 may include a plurality of connected devices, including a controller device 110 and a plurality of network-enabled audio output devices 120, 122, 124, and 126. In some variations, the network 101 includes an access point 102 for providing wireless connectivity media. As an example, each of the controller device 110 and the audio output devices 120, 122, 124, 126 may be in 802.11 (a), 802.11 (b), 802.11 (g), 802.11 (n), 802.11 (ac) or It operates similarly (collectively "Wi-Fi", "Wi-Fi network" or "802.11 protocol") under the IEEE specifications. Furthermore, in some implementations, the controller device 110 and / or some or all of the audio output devices 120, 122, 124, 126 are capable of wireless peer-to-peer communication such as provided by Wi-Fi Direct. Furthermore, some or all of the audio output devices 120, 122, 124, and 126 may be able to directly communicate with other devices on the network as peers. As an example, the individual audio output devices 120, 122, 124, and 126 may communicate using a direct wireless inter-peer communication protocol such as that provided by Wi-Fi Direct. Furthermore, in some variations, one or more audio output devices 120, 122, 124, and 126 may utilize a connected medium such as provided via an Ethernet connection or other network-based wired connection.

Audio output devices 120, 122, 124 and 126 can be connected based on user preference And located in the physical area of the network 101. The physical area of the network 101 may correspond to a residence, or alternatively to a room or space within the residence. As an example, the environment of the network 101 may correspond to the home network, where multiple speakers or other audio output devices have network connectivity for the purpose of outputting audio content selected by the user. In this context, the user can selectively position individual connected speakers around the room to enhance the user's enjoyment of the presented audio content.

In some embodiments, the audio output devices 120, 122, 124, and 126 may be heterogeneous in nature, which means that the audio output devices 120, 122, 124, and 126 may have different manufacturers, capabilities, resources, and / or purposes. For example, one or more audio output devices 120, 122, 124, and 126 may correspond to a television. For television, audio output is not the main purpose. One or more audio output devices 120, 122, 124, and 126 may also include programming or other logic to enable that audio output device to communicate with other devices on the network. Examples of this programming or logic include the ALLPLAY platform manufactured by QUALCOMM CONNECTED EXPERIENCES, which can be installed or otherwise provided on the wireless speaker via firmware. Although some examples describe audio output devices 120, 122, 124, and 126 as speakers (or dedicated audio output devices), other variations provide multi-purpose audio output devices 120, 122, 124, and 126, including televisions, desktops Computer, or other multifunctional audio output device.

The controller device 110 operates to execute application programs, software platforms, or other programming logic to communicate with and control the audio output devices 120, 122, 124, and 126. As an example, the controller device 110 may correspond to a mobile computing device, such as a multi-function cellular phone / messaging device, tablet computer, hybrid device (so-called "phablet"), or a wearable computing device.

The controller device 110 is operable to control and configure the output of audio using the audio output devices 120, 122, 124, and 126. Multiple audio can be used for the purpose of outputting audio content on multiple audio output devices 120, 122, 124, and 126 according to a dynamically selected channel configuration Distribute any one of the configurations. In some embodiments, the controller device 110 may be modally operated to select from a plurality of possible audio distribution configurations.

The controller device 110 directly or indirectly distributes the audio content ("AC") 113 to each of the plurality of audio output devices 120, 122, 124, or 126. In some implementations, the controller device 110 is the source of the disseminated audio content 113. For example, the audio content 113 may correspond to a media file ("MF") 103 accessed from a user's media cabinet 105. Depending on the implementation, the media cabinet 105 may be at the local end of the controller device 110, among multiple devices distributed on the network 101, or remote to the controller device 110. For example, some or all of the media cabinets 105 may be stored on other devices (including one or more audio output devices 120, 122, 124, or 126) or resources on the network 101, and the controller device 110 may communicate with the network 101 The other device (eg, home computer, cable converter, etc.) communicates to retrieve the media file 103 from the media cabinet 105. Further, the controller device 110 may access a web service ("NS") 107 for audio content 113, such as an online media website (e.g., PANDORA, SPOTIFY, GOOGLE PLUS, etc.). The controller device 110 may also generate audio content 113 from other content sources ("CS") 109, such as cable, satellite, or air broadcast. In addition, the controller device 110 may distribute audio content 113 originating from multimedia content presented on the device. For example, the controller device 110 may execute different applications that generate multimedia content (eg, games), and may distribute audio from these active applications as audio content 113. In other variations, the controller device 110 may access another device or resource on the network 101, such as a device that communicates with one or more audio output devices 120, 122, 124, or 126 via the access point 102. Depending on the capabilities of the respective devices, the controller device 110 may use inter-peer wireless communication (e.g., Wi-Fi Direct) to directly transmit the audio content 113 to each desired audio output device 120, 122, 124 and 126.

In some implementations, the controller device 110 implements functionality for operating an audio output device 120, 122, which is a leader of active output devices on the network 101, 124, 126 disseminate audio content 113. The controller device 110 may select an audio output device 120, 122, 124, 126 to act as a leader device. In the example of FIG. 1, the audio output device 120 selected as the leader can receive the audio content 113 from the controller device 110 (which can access the media cabinet 105, the network service 107, or the content source 109) for distribution to other Audio output devices 122, 124, 126. In a variation, the audio output device 120 may receive audio content 113 from another source (e.g., another device of the network 101) for distribution to other audio output devices 122, 124, 126.

In alternative variations or modes, the controller device 110 or the audio output device 120 operating as a leader may channel filter or amplify the audio content 113 for transmission to respective audio output devices. When filtered by a channel, the audio content 113 may be divided into a plurality of channel portions 121, and each channel portion 121 of the audio content 113 is communicated to an assigned audio output device 120, 122, 124, and 126. When amplified, the audio content 113 may be pre-structured into a channelized component, and the amplified audio ("aug.audio") 133 may be transmitted to other audio output devices 122, 124, 126, of which the amplified audio 133 is filtered to correspond to the channel section 121.

In the example of FIG. 1, the controller device 110 includes audio distribution logic 112, dynamic selection logic 114, channel configuration logic 116, and calibration logic 118. In addition, in the example of FIG. 1, one or more audio output devices 120, 122, 124, and 126 may be selected to implement the functionality of the leader, which may include components and functionality (e.g., as shown in FIG. 2). Examples described). The functionality described as being shown using the controller device 110 or the audio output device 120 selected as the leader may be in two devices (or in another device that may be replaced as the leader of the audio output device 120 Among them) are interchangeable. For example, in some variations, the controller device 110 may include functionality for implementing channel filtering or channel amplification (eg, as shown in FIG. 2). Likewise, in some variations, the audio output device 120 may operate as a leader and also include one or more components of the controller device 110, such as one of the dynamic selection logic 114, the channel configuration logic 116, or the calibration logic 118 or Many.

According to some embodiments, the controller device 110 includes channel configuration logic 116 for performing operations to determine the channel configuration 115 of the set of audio output devices 120, 122, 124, and 126. The channel configuration 115 may be determined by: (i) the number of available audio output devices 120, 122, 124, and 126; (ii) a group based on preference and / or the number of available audio output devices 120, 122, 124, and 126 State scheme 117 or layout; and / or (iii) relative positioning of each audio output device 120, 122, 124, and 126 within the space or environment of network 101. Therefore, given the relative positioning of the desired configuration scheme 117 and the audio output device, the channel configuration 115 may specify a channel assignment 123 for each audio output device 120, 122, 124, and 126. Once determined, the channel assignment 123 can be communicated to the audio output devices 122, 124, 126 as control or command data. Depending on the implementation or mode of operation, the channel assignment 123 may be communicated directly from the controller device 110 or from the audio output device 120 acting as a leader. As described using various examples, the channel configuration logic 116 can dynamically re-determine and implement the channel configuration 115 based on conditions and events that affect the usage of the audio output devices 120, 122, 124, and 126 on the network 101. .

Furthermore, in some variations, the controller device 110 may have different operation modes in order to implement an audio distribution configuration, wherein the audio distribution logic 112 directly distributes the audio content 113 to each audio output device 120, 122, 124, and 126 . The audio distribution logic 112 of the controller device 110 may communicate all or part of the stream to multiple audio output devices.

According to a change, in the alternative mode, the controller device 110 may use the dynamic selection logic 114 to select one of the plurality of audio output devices 120, 122, 124, 126 as a leader. In some variations, the decision to use a particular audio output device 120 as a leader may be made programmatically based on, for example, available resources of the controller device 110 and / or user preferences. Various criteria may be used to select one audio output device 120 as the leader of other audio output devices 122, 124, or 126 for the network 101. Among these criteria, the audio output devices 120, 122, 124, and 126 selected as the leader may be required to have a minimum set of resources, such as minimum processing power and / or establish multiple connections with other devices on the network 101 The ability to connect between peers at the same time. Alternatively, the audio output device 120 selected as the leader may have the most or best required resources or capabilities. For example, the audio output device 120 may be selected as the leader because the audio output device 120 meets the criteria for including a digital signal processor ("DSP") or because the audio output device 120 is compared to other audio output devices. It is considered to have the largest amount of available bandwidth.

In some variations, the control device 110 may communicate the leader selection 111 to the selected audio output device 120, 122, 124, or 126. In some embodiments, the controller device 110 uses, for example, dynamic selection logic 114 to programmatically make the leader selection 111.

In some implementations, the audio output device 120 receives the audio content 113 from the content source (CS) 109, and then distributes the audio content 113 as the channel portion 121 to each of the other audio output devices 122, 124, 126 of the network 101 One. The source of the audio content 113 may, for example, correspond to the controller device 110. For example, the controller device 110 may generate audio content 113 (eg, game content) and / or store a portion of the media cabinet 105 (such as a song or album cabinet), and the audio content 113 may correspond to the media from the media cabinet 105 Archive 103. Alternatively, the controller device 110 may also serve as a source for audio content retrieved from both the local network and the remote source. For example, the controller device 110 can access other media resource devices (eg, home computers, cable converters, etc.) on the network 101 in order to retrieve the media files 103 of the user's media cabinet. Furthermore, the controller device 110 can access a commercially available third-party network service 107 (eg, PANDORA, SPOTIFY, GOOGLE PLUS, etc.) for the audio content 113. In other variations, the content source 109 for the audio content 113 may be another device on the network 101, such as a device that communicates with the controller device 110 and / or the output device 120 via the wireless access point 102. Furthermore, in other variations, the source of the audio content 113 may be another content source 109 (eg, cable or air broadcast) available via the network 101.

According to some variations, the audio output device 120 processes the audio content 113 (audio data) to define a channel portion 121 from the audio content 113. Each channel section 121 can then be communicated to Corresponds to the audio output devices 122, 124, and 126. The local audio output resource can be used to play the channel portion 121 for the audio output device 120, which is consistent with the playback of the channel portion 121 of the other audio output devices 122, 124, and 126.

According to some embodiments, the channel configuration 115 may be determined dynamically and in real time based on conditions or events detected on the network 101. For example, the controller device 110 may detect specific network conditions (e.g., limited bandwidth) and then output a channel configuration 115 to include alternative group channel assignments for the respective audio output devices 120, 122, 124, and 126 123. Furthermore, the controller device 110 may receive input, or otherwise detect the addition or subtraction of the audio output devices 122, 124, or 126, so as to affect the number of the audio output devices 120, 122, 124, and 126 in use. In some cases, a change in the number of audio output devices 120, 122, 124, and 126 in use may also change the configuration scheme 117 (e.g., from 7.1 to 5.1) and / or require further changes to the channel assignment 123 in order to Adapt to different numbers of audio output devices 120, 122, 124, and 126 in use (or available) on the network 101. The ability of the controller device 110 to dynamically determine and implement the channel configuration may enable, for example, the playback of audio content from some or all of the audio output devices 120, 122, 124, and 126 to be substantial when performing one or more channel assignments 123 Continue on without interruption. In addition to dynamically determining the channel configuration 115, the controller device 110 may also dynamically select the audio output device 120 as the leader. The determination of which audio output device 120 acts as a leader may be based, for example, on the available bandwidth of each audio output device 120, 122, 124, or 126 that meets one or more of the criteria to become a leader.

As yet another example, the modal operation of the controller device 110 when distributing the audio content 113 may also be dynamically changed. For example, the controller device 110 can switch from using one audio output device 120 as a leader to directly transmitting audio content 113 (or its channel portion 121) to each audio output device 120, 122, 124, and 126. Furthermore, the choice of which audio output device 120, 122, 124, 126 acts as a leader can be dynamic based on factors such as the bandwidth available to the respective audio output devices 120, 122, 124, 126.

In some variations, the controller device 110 includes calibration logic 118. The calibration logic 118 is operable to adjust the outputs of the audio output devices 120, 122, 124, 126 to adapt to the relative position of the user in the physical space of the environment of the network 101. The calibration logic 118 is operable to accommodate a user's proximity to one or more audio output devices 120, 122, 124, and 126. The calibration logic 118 may perform operations such that the audio experienced by the user at a given location is uniform from all directions. In detail, the calibration logic 118 can implement adjustments 119 in the form of delays in the individual audio output devices 120, 122, 124, and 126, so that the audio transmission from each respective audio output device 120, 122, 124, 126 The arrival time is nearly simultaneous with respect to the user, even if the user's proximity to one audio output device 120, 122, 124, 126 may be greater than the proximity to another audio output device. Furthermore, the calibration logic 118 can implement an adjustment 119 in the form of volume adjustment for individual audio output devices 120, 122, 124, 126, so that the user has the same volume experience from each audio output device 120, 122, 124, 126 , Even when the user is closer to one audio output device than to another audio output device.

FIG. 2 illustrates an audio output device that can be selected and operated as a leader according to various embodiments. The audio output device 200 such as shown and described using the example of FIG. 2 may operate as the audio output device 120 in the example of FIG. 1. 1 to 2, in more detail, the audio output device 200 includes an audio receiver 210, control logic 220, audio output resources 230, and a device interface 240. The control logic 220 may be coupled to or include the channel filter 222 and / or the channel amplification 226.

The audio receiver 210 may receive audio content 201 from the controller device 110. Alternatively, the audio receiver 210 may receive the audio content 201 from another source, such as from an online source or from another device. The audio content 201 may be received directly or indirectly (eg, via the access point 102 or from the controller device 110).

The audio output device 200 may also receive the channel configuration data 221 (shown via the device interface 240) from the controller device 110. In a variation, the audio output device 200 includes The channel configuration logic 244 of the channel configuration data 221 is determined based on any communication from another device. The channel configuration logic 244 may determine the channel configuration data 221 from, for example, a user input 243 (such as provided by the user through interaction with a user interface of the audio output device 200). The channel configuration logic 244 may also determine the channel configuration data 221 based on a user or device setting 245 or preference.

In some implementations or modes of operation, the audio receiver 210 may communicate the entire stream of audio content (“All Streams AC”) 212 to the channel filter 222 of the control logic 220. The channel filter 222 filters the entire stream of the audio content 212 into channelized portions based on a channel assignment defined by the channel configuration data 221. Once the channel is designated from the audio content 212, the audio output resource 230 receives a channel portion 215 for the channel assigned to the audio output device 200. A portion of outgoing audio content (AC) 217 for channels assigned to other audio output devices 122, 124, 126 may be transmitted to other audio output devices via the device interface 240.

In a variation, the audio output device 200 may implement channel amplification 226. Channel amplification 226 may structure the audio content 212 into an amplified stream 219 that can be transmitted to other audio output devices 122, 124, 126 via the device interface 240. The amplified stream 219 may be filtered for an appropriate channel at the corresponding audio output device 122, 124, 126, which coincides with an output point for a particular channel output. The device interface 240 may communicate an amplified stream 219 that may be filtered for a given channel. In this manner, channel amplification 226 may provide an alternative to filtering audio content before transmission.

The device interface 240 may include programming or logic to enable the audio output device 200 to be interconnected and operable with various other devices of different kinds on the network 101. In some implementations, the device interface 240 includes an application program interface provided via, for example, ALLPLAY manufactured by QUALCOMM CONNECTED EXPERIENCES.

In some embodiments, the audio output device 200 includes functionality for triggering or implementing a calibration control 250. In some implementations, the calibration control 250 is controlled by another device, such as The controller device 110) receives a calibration input 249. In one example, the controller device 110 includes resources and logic for receiving an input indicating a change in calibration, and further includes a means for determining that it can be taken on one or more audio output devices 120, 122, 124, 126 to target users Resources and logic for calibrating audio output. As mentioned in other examples, the calibration action is used to influence the audio output experienced by the user, with the user's relative proximity to the individual audio output devices 120, 122, 124, 126 of the network 101 being specifically considered.

In some embodiments, the calibration action of the calibration control 250 may include a delay control 251. The control logic 220 can process the delay control 251 and communicate the delay control 251 to other audio output devices 122, 124, 126 via the device interface 240. Another example of the calibration action of the calibration control 250 includes a volume control 253. The control logic 220 can communicate the volume control 253 to other audio output devices via the device interface 240.

Controller device

FIG. 3 illustrates an example of a controller device 300 according to various embodiments. Referring to FIGS. 1-3, according to various embodiments, the controller device 300 (which may correspond to software) that may be implemented using software executed on a mobile computing device, such as a device carried by a person in the space or physical area of the network 101 On the controller device 110). As an example, the controller device 300 may correspond to a device such as a cellular phone / messaging device (eg, a feature phone), a tablet or hybrid device, a wearable computing device, or a laptop computer. In some embodiments, the controller device 300 operates to receive input information 301 for determining: (i) the number of audio output devices 120, 122, 124, 126 connected to the network 101; and (ii) ) The location of each audio output device 120, 122, 124, 126 relative to a given covered space within the network 101. The software implemented on the controller device 300 may correspond to, for example, an application, a set of applications, or, alternatively, an operating system level functionality. The controller device 300 may share an application framework or interface with other devices on the network. For example, various audio output devices used on the controller device 300 and the network 101 Each of 120, 122, 124, 126 may implement a media platform such as that provided by the QUALCOMM ALLPLAY media platform.

As an addition or alternative, in some embodiments, the controller device 300 operates to detect the proximity of the controller device to individual audio output devices 120, 122, 124, 126 that are operating on the network 101. Testing and processing transmission. Using this proximity information, the controller device 300 is operable to calibrate the output of one or more audio output devices 120, 122, 124, 126 on the network 101.

In some embodiments, the controller device 300 includes a user interface 310, audio output device control logic ("AOD control logic") 320, device position logic 330, and audio output interface 340. The user interface 310 may display a prompt that guides the user to provide input that identifies basic input information 301 about the audio output devices 120, 122, 124, 126 used on the network 101. For example, the user interface 310 may display a virtualized room or space in a residence, and provide features that enable the user to indicate the following information and other information: (i) audio output devices 120, 122, The number of 124, 126; and (ii) the general locations for a given audio output device 120, 122, 124, 126 that can be labeled. The user interface 310 may also be implemented to prompt the user to provide input information 301, which identifies additional information about the audio output device, such as the manufacturer, capability, or connectivity status. The user interface 310 can output device location information 311, which can identify the number of audio output devices and the relative position of the audio output devices in a space represented by the user interface 310. The device location logic 330 may receive the location information 311 and optionally generate content that may be configured on the user interface 310 to, for example, prompt the user to provide one or more additional queries 301 to respond to the query 313.

As an example, responding to the query 313 may prompt the user to provide additional input information 301 that can approximate the length or total distance between the audio output devices 120, 122, 124, and 126 on the network 101 in order to provide space in the network. The dimension of the virtual representation. Furthermore, responding to the query 313 may prompt the user to specify for different rooms in the home of the network 101 Audio output devices 120, 122, 124, 126. More generally, responding to the query 313 may prompt the user interface 310 to display content for enabling a user to define different rooms or spaces of a home covered by the network 101. In some variations, the input information 301 may prompt the user to enter information corresponding to: (i) group size information 309, which corresponds to the number of audio output devices on the network 101; and (ii) device location Information 311, which identifies the general or opposite parts of the audio output devices 120, 122, 124, 126 in the space of the network 101 (for example, in an individual room). Furthermore, although some embodiments provide a user interface 310 to prompt the user for input information 301, other embodiments provide a user interface 310 to guide the user to choose to influence one of the audio output devices 120, 122, 124, 126 or Multiple configurations, including inputs for selecting channel configuration 333.

In some embodiments, the device location logic 330 is operable to determine a set of channel configurations 333 based at least in part on the group size information 309 and device location information 311 of the individual audio output devices 120, 122, 124, 126. Channel configuration 333 may specify a speaker configuration layout ("C.Lay") 337, such as a 3, 5, 7, (or larger) surround sound field layout, or a Dolby 5.1 or 7.1 speaker layout. The channel configuration 333 for the audio output devices 120, 122, 124, 126 may include a channel assignment 339 ("Chan. Ass. 339") for individual audio output devices. In some variations, the configuration layout 337 may be based on one or more criteria, such as the number of audio output devices 120, 122, 124, 126 (e.g., with group size information 309) and / or audio output devices 120, 122, Positions 124, 126 (for example, as specified by the device location information 311). In some variations, the configuration layout 337 may be selected by default. In another variation, a selection feature may be provided to a user via the user interface 310 to make a selection of a particular configuration layout 337. The configuration library 329 can hold information about different possible configuration layouts 337, and provides for selecting one or the other based on the group size information 309 and / or device location information 311 of each audio output device 120, 122, 124, 126. Mechanism for multiple configuration layouts 337. The device position information 311 of each audio output device 120, 122, 124, 126 can also be input information 301 received through the user interface 310 and from the user. Other input (for example, an input indicating a user's preference). Channel assignments 339 may be programmed based on, for example, the configuration layout 337, group size information 309, and / or device location information 311 of the audio output devices 120, 122, 124, 126 in the space of the home.

The channel configuration 333 can be communicated to the audio output interface 340. As mentioned in other examples, the audio output interface 340 may provide an application programming interface that enables the controller device 300 to communicate with other connected devices of the network 101. For example, the audio output interface 340 may be used for wireless peer-to-peer communication, such as provided via Wi-Fi Direct media. In some variations, the audio output interface 340 communicates the channel configuration 333 to the audio output devices 120, 200 selected as the leader for a particular session on the network.

As mentioned, in some embodiments, the controller device 300 includes functionality for calibrating the outputs of the audio output devices 120, 122, 124, 126 on the network 101 based on the location of the user at a given time. As the user's location changes, the controller device 300 can implement functionality to dynamically control the output of individual audio output devices 120, 122, 124, 126 on the network 101, so that the user's audio experience is equally reflected from the individual Output from audio output device.

In some embodiments, the controller device 300 includes an acoustic input interface 306, a timing analysis component 312, and an audio output device control logic 320. The audio output device control logic 320 may include a delay (or delay) control 322 and a volume control 324. The acoustic input interface 306 may include a programming component that interfaces with a microphone of a mobile computing device for implementing the controller device 300. In detail, the acoustic input interface 306 may be configured to detect a reference acoustic reference transmission ("AREFTR") 361 from each active audio output device 120, 122, 124, 126 on the network 101. The acoustic input interface 306 may include logic to identify, for example, predetermined characteristics (such as signal patterns) of the acoustic reference transmission 361.

In some embodiments, each audio output device 120, 122, 124, 126 transmits a local unique acoustic reference transmission 361, thereby transmitting an identifier for the transmission device. take Depending on the implementation, the acoustic reference transmission 361 of each audio output device 120, 122, 124, 126 may be in the audible or inaudible range. In some embodiments, the acoustic reference transmission 361 of each audio output device 120, 122, 124, 126 is communicated in a frequency range detectable by a microphone of a mobile computing device provided with the controller device 300. In addition, each audio output device 120, 122, 124, 126 conveys a corresponding acoustic reference transmission 361, which represents a portion of the audio content (e.g., a song) output from each respective audio output device (e.g., a frame or A series of frames).

The acoustic input interface 306 may include logic for detecting an acoustic reference transmission 361 from each audio output device 120, 122, 124, 126. The acoustic input interface 306 can also compare the arrival time 363 of each acoustic reference transmission 361 in order to determine the delay or other delay between the arrival times of the acoustic reference transmissions from different audio output devices 120, 122, 124, 126 on the network 101. difference. As an example, the embodiment recognizes that the sound takes slightly less than 1 millisecond to travel 1 foot, and if the user moves a relatively small amount (for example, one foot), it may cause the user to be affected when listening to the collective from the audio output system 100 Detectable delay in the quality of experience during audio output.

The timing analysis component 312 can analyze the arrival time 363 of each acoustic reference transmission 361 in order to detect a very significant change in the arrival time 363 due to the individual audio output devices 120, 122, 124, 126. The difference in the arrival time 363 may indicate the user's location, and more specifically, the location or proximity of the user relative to the individual audio output devices 120, 122, 124, 126 of the system.

In some variations, the content-related analysis component 314 may also be implemented in combination with the timing analysis component 312. The content-related analysis component 314 can determine the content-related information based on the timing differences (as identified by the arrival time 363) of the acoustic reference transmissions 361 from different audio output devices 120, 122, 124, 126. In some variations, the content-related analysis component 314 may detect trends or events from a user's movement in cyberspace or area. For example, the content-related analysis component 314 may refer to individual audio output devices 120, 122, Known information of positions 124, 126 (which can be approximated based on input information 301 and / or based on part detection technology) in order to determine that the user has switched rooms. Therefore, one determination that can be made from the content-related analysis component 314 includes a determination to power off or power the selected audio output device 120, 122, 124, 126 based on the determined location of the user. The content-related analysis component 314 may transmit a content-related decision ("CD") 315 to the audio output device control logic 320, which may in turn supply power to the audio output devices 120, 122, 124, 126 or A control command ("CC") 321 is sent for the purpose of power failure to select their audio output device. As an example, the content related decision 315 may include locating a specific audio output device in one room or floor and locating a user's information in another room or floor of the home.

In addition, the timing analysis component 312 may generate a timing parameter ("TP") 317, which indicates a difference between the arrival times 363 of the one or more acoustic reference transmissions 361. The delay control 322 of the audio output device control logic 320 may utilize timing parameters 317 to generate a delay command ("DC") 323 for one or more audio output devices 120, 122, 124, 126. As an example, when the output provided by the acoustic input interface 306 indicates that the user has become close to one of the audio output devices 120, 122, 124, 126 and far from one of the audio output devices 120, 122, 124, 126 In the other case, a delay command 323 may be provided to the audio output device. The delay command 323 can be used to slow down or delay the output of the audio output devices 120, 122, 124, 126. The delay caused to the audio output devices 120, 122, 124, 126 may be based on the detected difference of the arrival time 363 from the far end and the acoustic reference transmission 361 of the audio output devices 120, 122, 124, 126. The delay command 323 may generate a delay that substantially equals the arrival time 363 of the immediate and remote audio output devices 120, 122, 124, 126.

Furthermore, the volume control 324 of the audio output device control logic 320 can use the timing parameter 317 to determine the adjustment of the volume of one or more output devices 120, 122, 124, 126. The purpose is to enable the user to change the volume of all audio output devices 120, 122, 124, 126 experience the same volume, regardless of whether the user can move or otherwise use another audio output device The fact that it comes close to one or more audio output devices at the cost. In some implementations, the volume control 324 may generate a volume command ("VC") 325 to cause one of: (i) the audio output device 120, 122, 124, 126 in response to the user movement Decrease the volume of the volume; and (ii) increase the volume of the remote audio output devices 120, 122, 124, 126 in response to user movement; or (iii) adjust the volume of the remote and The combination of increasing and decreasing the volume of the audio output devices 120, 122, 124, 126 is immediately followed. The selected specific volume command 325 may be based on, for example, preset settings or user preferences.

The audio output interface 340 may communicate one or more of the control command 321, the delay command 323, and / or the volume command 325 to the connected audio output devices 120, 122, 124, 126 of the network 101. In detail, the delay command 323 and / or the volume command 325 may be generated in response to the continuous polling or checking of the user part as determined from the mobile computing device of the controller device 300. In this manner, the delay command 323 and / or the volume command 325 may provide a mechanism for calibrating the output characteristics of individual audio output devices 120, 122, 124, 126 on the network 101. Calibration functionality enables users to experience audio content as equal contributions from multiple audio output devices 120, 122, 124, 126 of network 101 that are not equally spaced, among other benefits. Calibration functionality also enables users to experience audio content equally from multiple contributing audio output devices 120, 122, 124, 126, even when the user is in motion or when the user is close to one audio output device. This is also true when the measurable degree is greater than the proximity to another audio output device. Calibration functionality such as that described also enables collective audio output from different audio output devices 120, 122, 124, 126 that are generating output on the network 101 to be equalized in contribution, regardless of the manufacture of individual audio output devices , Quality, or ability.

FIG. 4 illustrates a mobile computing device in which various embodiments may be implemented. The mobile computing device 400 of FIG. 4 may be used to implement the controller devices 110, 300 such as described using the examples of FIGS. 1 and 3. The mobile computing device 400 may include a microphone 410, a processor 420, and a display 430, memory 440 and network interface 450.

Referring to FIGS. 1-4, the memory 440 may store instructions for implementing various functionalities described using, for example, the controller devices 110, 300. In some variations, the memory 440 stores a device control instruction ("Device Control Instruct.") 441, which may be executed by the processor 420 in conjunction with control and calibration functionality (eg, as described using the example of FIG. 3). The microphone 410 of the mobile computing device 400 receives an acoustic reference transmission ("AREFTR") 361 from the individual audio output devices 120, 122, 124, 126. The acoustic reference transmission 361 may be received as an encoded signal 467 (“Enc. Signal”), and may include data identifying specific audio output devices 120, 122, 124, 126 from which the acoustic reference transmission 361 originated. The processor 420 may execute device control instructions 441 to: (i) collect acoustic reference transmissions 361 from different audio output devices 120, 122, 124, 126 for a given point in time; and (ii) implement a timing analysis component 312 to determine reflected acoustics Reference is made to the timing parameter 317 of the difference between the arrival time 363 of the transmission 361.

According to some embodiments, the processor 420 may execute device control instructions 441 to determine a calibration command based at least in part on the determined timing parameter 317. In addition, the processor 420 may use the network interface 450 to communicate calibration commands to one or more audio output devices 120, 122, 124, 126 on the network 101 of the mobile computing device 400. The calibration command may include, for example, a delay command ("DC") 323, which causes a specific audio output device 120, 122, 124, 126 to selectively delay or otherwise adjust the timing of its respective output in order to calibrate the audio content. Set the arrival time of the clip to the user. As an addition or change, the calibration command may include a volume command ("VC") 325, which is based on, for example, the proximity of a user to one audio output device relative to another audio output device 120, 122, 124, 126. Increase or decrease the volume of the audio output devices 120, 122, 124, and 126.

According to some variations, the processor 420 may also execute the device control instruction 441 in order to implement the content-related analysis component 314 (as described using the example of FIG. 3) and make a content-related determination 315. Based on the content related decision 315, a control command ("CC") 321 can be communicated based on The user selectively powers on or off the audio output devices 120, 122, 124, 126 relative to the parts of the individual audio output devices. The content-related analysis component 314 may make a content-related determination 315 based on content-related information, such as information that defines the spacing, flatness, or segmentation (eg, room) of a dwelling of the network 101.

As an addition or alternative, the memory 440 may also store a user interface instruction ("UI Instruct.") 443. The processor 420 may execute user interface instructions 443 to generate a user interface (“UI”) 431 on the display 430. The user interface 431 can provide the user with prompts and other interfaces to facilitate the user to provide input information 301 about the audio output devices 120, 122, 124, 126 in use on the network 101. In detail, the input information 301 received via the user interface 431 may include a configuration input (“Config.Input”) 433, which includes: (i) group size information 309 (FIG. 3), which identifies the network 101 The number of audio output devices 120, 122, 124, 126 above; (ii) device location information 311, which includes location indications for one or more audio output devices 120, 122, 124, 126; and / or (iii) Selected or better layout. In one example, the mobile computing device 400 determines the channel configuration 453 based at least in part on a user's configuration input. The configuration input can be determined by the user's interaction with the user interface 431 provided on the display 430.

Further, the memory 440 may include a position logic instruction ("Position Logic Instruct.") 445, which when executed by the processor 420 causes the processor 420 to generate a channel configuration 453. As described using some other examples, the channel configuration 453 may include one or more of the following: (i) audio output device layout or scheme; and / or (ii) for network 101 based on the selected device layout Channel assignment of each of the audio output devices 120, 122, 124, 126. The location logic instruction 445 may determine a channel based on additional information, such as input information 301 provided from a user, and / or known information about a specific type or model of one or more audio output devices 120, 122, 124, 126. Configuration 453. For example, a user can use the user interface 431 to type information about a specific audio output device, and the ability to know about a specific audio output device can facilitate using that device as a channel for a specific location Assigned.

FIG. 5 illustrates an audio output device for implementing various embodiments. In detail, the example illustration of FIG. 5 may also operate as an audio output device 500 such as the leader device (eg, 120) described in the example of FIG. 1 as appropriate.

1 to 5, in more detail, the audio output device 500 includes a buffer 508, a processor 510, an audio output component 530, a network interface 540, and a memory 550. In a variation, the audio output device 500 includes a digital signal processor (DSP) 512. The memory 550 may store instructions for execution by the processor 510, such instructions including interface instructions 551 and / or leader device instructions 553. When operating on the network 101, the processor 510 may execute an interface instruction 551 to receive an incoming audio stream 505 at the buffer 508 via the network interface 540. In some implementations, (i) at least a portion of the audio stream 505 is directed to an audio output component 530, which generates an audio content output ("ACO") 535, and (ii) transmits at least a portion of the audio stream 505 To other audio output devices 120, 122, 124, 126. In some embodiments, the DSP 512 processes the audio stream 505 into audio output data 515, which may, for example, structure the audio stream 505 into a delineable channelized portion that can be easily filtered at the playback location. The audio output component 530 can receive audio output data 515 from the DSP 512. In a variation, the audio output component 530 receives an audio stream 505 from the buffer 508. Further, the audio output component 530 may receive the channel portion 573 of the audio stream 505 based on the channel assignment as determined by the processor 510. The audio output component 530 can transform the audio output data 515 (or the audio stream 505) into sound transmitted from the audio output device 500 to the physical space of the network 101.

In addition, as the leader, the processor 510 of the audio output device 500 may execute the leader device instruction 553 to: (i) determine the channel assignment 555 and communicate the channel assignment 555 to other audio output devices 120, 122 on the network 101, 124, 126; (ii) distribute audio stream 505 (or a portion thereof) to other audio output devices 120, 122, 124, 126; and / or (iii) implement or otherwise communicate affecting audio output in other audio outputs Device 120, The calibration action 557 generated on 122, 124, 126. In a variation, the processor 510 may execute the leader device instructions 553 to utilize and disseminate an enhanced form of the audio stream 505 from the DSP 512 (shown as audio output data 515).

The audio output device 500 may also execute the leader device instruction 553 to receive the input information 501 from the controller devices 110 and 300. The input information 501 may include group size information ("GS") 509, channel layout information ("CL") 517 (e.g., the positioning of individual audio output devices around the house according to Dolby 5.1 / 7.1, etc.), and configuration inputs ("CI") 559, and other items. The input information 501 may be received by, for example, user input provided through interaction with the user interface 310.

In some implementations, the channel assignment 555 can be determined by the controller devices 110, 300 and received by the audio output device 500 via the network interface 540. In some variations, the channel assignment 555 may be determined by a channel selection instruction 561 executed on the audio output device 500. The channel selection instruction 561 may use input information 501, which includes: (i) group size information 509, which corresponds to the number of audio output devices 120, 122, 124, 126; (ii) channel layout information 517; and (iii) The general configuration of the audio output devices 120, 122, 124, 126 is provided as a configuration input 559. The channel selection instruction 561 uses various inputs to determine the channel assignment 555 for the individual audio output devices 120, 122, 124, 126. An input for the channel selection instruction 561 may be received from, for example, the mobile computing device 400 as the controller device 110, 300 via the network interface 540.

Some embodiments provide an audio output device 500 as a leader to use a network interface 540 to disseminate audio transmission data ("ATD") 525 to other audio output devices 120, 122, 124, 126. Depending on the implementation, the audio transmission data 525 may correspond to: (i) all audio streams 505, which can be filtered by other audio output devices 120, 122, 124, 126 that receive the audio stream 505; It structured the entire audio stream 505 into a predetermined and delineable channelized portion that can be easily filtered at the playback location; and / or (iii) a separate channel portion 573, which can be based on the audio output devices 120, 122, 124, Frequency of 126 Channels are assigned individually to specific audio output devices.

In some embodiments, selecting a leader among the audio output devices 120, 122, 124, 126 may be a modal implementation, which may be implemented dynamically by the controller devices 110, 300. In the alternative mode, the audio output devices 120, 122, 124, 126 that are the leader may be, for example, the source of the audio stream, the access point 102, the mobile computing device 400 acting as the controller device 110, 300 (which may also be Acting as a source of content) or the other of the audio output devices 120, 122, 124, 126. In other variations, designating an audio output device 120, 122, 124, 126 as a leader may be subject to changes based on selection logic on the controller devices 110, 300. For example, the controller device 110, 300 may execute selection logic to change the leader in response to an event or condition, such as the presence of low frequency bandwidth at the original selected leader device.

According to some embodiments, the audio stream 505 may be received via the network interface 540 and then buffered and processed at the buffer 508. The input audio stream 505 may represent the entire stream without any channel delineation or segmentation from the larger content. The processor 510 (or DSP 512 (if used)) may execute filtering logic ("filter") 571 to generate multiple channel portions 573 of the audio stream 505. Each channel portion 573 may correspond to one of the channels of the determined channel configuration. Specifically, the audio stream 505 may be filtered into a plurality of channel sections 573, where each channel section 573 is designated for a specific channel assigned to an audio output device 120, 122, 124, 126 on the network 101 . The network interface 540 can then be used to transmit the channel portion 573 of the audio stream 505 to other audio output devices 122, 124, 126.

Regarding the calibration action, the audio output device 500 may receive a calibration command (“Cal.Comm.”) 552 from the mobile computing device 400 and then implement the calibration command 552 as a calibration action 557. The calibration action 557 may correspond to or be based on a calibration command 552. The calibration action 557 may be performed directly by the distribution of the audio transmission data 525 or by communication with other audio output devices 120, 122, 124, 126 via the network interface 540. In some variations, the audio output device 500 receives calibration-related measurements and data from the mobile computing device 400, such as timing parameters Number 317. In a variation, the audio output device 500 may also include a measurement and data (e.g., time difference of arrival, timing parameters, etc.) for a common audio segment to determine whether to include or correspond to a calibration command 552 (delay, Volume, etc.) to calibrate the logic of action 557.

Methodology

FIG. 6 illustrates a method 600 for dynamically determining and implementing a channel configuration for a network-based audio system according to various embodiments. FIG. 7 illustrates a method 700 for operating an audio output device as a leader device when distributing audio content to other audio output devices on a network, according to various embodiments. FIG. 8 illustrates a method 800 for calibrating the output of a plurality of audio output components on a network based on a relative position of a user according to various embodiments. FIG. 9 illustrates a method 900 for calibrating an audio output device based on a user's location according to various embodiments. FIG. 10 illustrates a method 1000 for implementing a user interface to initiate a dynamic configuration of a web-based audio system according to various methods. Components such as described using the examples of FIGS. 1 to 5 may be used to perform the example methods provided by FIGS. 6 to 10. Accordingly, reference may be made to the elements of FIGS. 1 to 5 for the purpose of describing suitable components for performing the described steps or sub-steps.

Referring to FIG. 1, a group of audio output devices 120, 122, 124, 126 for a given network 101 can be identified by the controller devices 110, 300 (610). In some implementations, the audio output devices 120, 122, 124, 126 can be identified by input information from a user. In some implementations, the input information 301 may be provided via a user interface 310 of the controller device 110 that may be provided on the mobile computing device 400. In a variation, for example, object tracking and detection technology may be used to programmatically identify the audio output devices 120, 122, 124, 126 connected to the network 101. For example, the audio output devices 120, 122, 124, 126 of the network 101 may be equipped with a receiver for receiving transmission of ultrasonic sound waves. The controller devices 110, 300 can transmit ultrasonic sound waves to individual audio output devices 120, 122, 124, 126, and the audio output devices 120, 122, 124, 126 can include programming or logic to Detect ultrasonic sound waves. Ultrasonic sound waves can provide use based on the dimensional parameters of the received transmission.

Additional configuration information can also be determined for the identified audio output devices 120, 122, 124, 126, 200, 500 of the network 101 (612). The additional configuration information may include the selected device layout (eg, 5.1 configuration, 7.1 configuration, etc.) and the relative positions of the individual audio output devices 120, 122, 124, 126, 200, 500 around the physical area of the network 101. For example, the user can use the virtual interface of the generic room provided through the user interface 310 of the controller device 110, 300 to specify the approximate estimated locations of the individual audio output devices 120, 122, 124, 126, 200, 500 .

Once the audio output devices 120, 122, 124, 126 are identified and other configuration information is determined, the channel configuration for the audio output devices 120, 122, 124, 126 can be determined (620). As described using other examples, the channel configuration may specify channel assignments for the identified audio output devices 120, 122, 124, 126. In some examples, the channel configuration may be determined based on, for example, the mobile computing device 400 for implementing the controller devices 110, 300. In a variation, the channel configuration may be determined based on the audio output device 120, 122, 124 or 126 selected by the user and / or the controller device 110, 300 as the leader. Furthermore, in another variation, the channel configuration may be determined based on a plurality of components including the controller device 110, 300 or the audio output device 120, 122, 124 or 126 operating as a leader.

According to some embodiments, when the audio output devices 120, 122, 124, 126 are in use, events or conditions that require dynamic or operational changes to the configuration of the audio output device can be detected (630). In some implementations, the occurrence of a condition or event may correspond to the introduction of a new audio output device to the network 101 (632). Alternatively, the condition or event may correspond to the removal or removal of one of the existing audio output devices 120, 122, 124, 126 from the network 101 (634). Furthermore, there may be a change in network bandwidth (636), which causes some audio output devices 120, 122, 124, 126 to change their bandwidth better than other audio output devices 120, 122, 124, 126 Or worse. As another variation, by various audio The audio content played by the output devices 120, 122, 124, 126 can be changed. For example, if the audio content changes from a relatively normal or low bit count to a relatively high bit count, the channel configuration should be changed.

Further, the network condition or event may correspond to a user moving around an area where the audio output devices 120, 122, 124, 126 are in use and present (638). As described, some embodiments provide that when a user moves around, the user's movement is detected, and one or more calibration actions can be performed to equalize the audio output devices 120, 122, 124 on the network 101, 126 audio experience. As an addition or change, a response to the user's movement in the physical area of the audio output device 120, 122, 124, 126 may be: change the channel configuration to suit the user's movement.

In response to detecting an event or condition, the controller device 110, 300 and / or the lead audio output device 120, 122, 124 or 126 may respond by changing the channel configuration (640). More specifically, in some implementations, the channel configuration can be changed by changing various channel assignments (642) to accommodate more or fewer audio output devices 120, 122, 124, 126 (added or Minus the audio output device). In addition, the channel configuration can be changed by changing the layout to facilitate changes in the number of audio output devices 120, 122, 124, 126, for example (644). Still further, channel configuration changes may be responsive to the addition or deletion of channel assignments (646).

Referring to FIG. 1, a leader (710) of the audio output device 120, 122, 124, or 126 is selected. The selection of the audio output device 120, 122, 124, or 126 as the leader can also be dynamic. This is due to some changes: The audio output device as the leader can be selected and / or changed by the controller devices 110, 300. As an example, the audio output device 120, 122, 124, or 126 selected as the leader may change due to a change in the bandwidth available to that device (712), especially compared to other audio outputs on the network 101 Devices 120, 122, 124, 126.

According to some embodiments, the audio output devices 120, 122, 124 or 126 implement some or all of the channel configuration (720). Furthermore, the audio output devices 120, 122, 124, or 126 and / or the controller devices 110, 300, which are the leaders, can be combined to implement various channel configurations for all audio output devices 120, 122, 124, 126. The channel configuration can also be determined based on the controller devices 110, 300, and then the channel configuration is communicated to the audio output devices 120, 122, 124, or 126 operating as the leader. As described using other examples, the channel configuration may include a channel assignment for each audio output device 120, 122, 124, 126. In some variations, the channel configuration may also include other information, such as a hypothetical layout for the audio output devices 120, 122, 124, 126.

In operation, audio content may be received on the audio output device 120, 122, 124, or 126 as a leader for distribution to other audio output devices 120, 122, 124, 126 (730) of the network 101. When receiving and distributing audio content, the leader audio output device 120, 122, 124, or 126 may also output a portion of the audio content assigned to its own channel (732).

In some variations, audio content is received on the audio output devices 120, 122, 124, 126, and then the audio content is sent to other audio output devices 120, 122, 124, 126 on the network 101 according to the determined channel configuration (740). In some implementations, the audio output device 120, 122, 124, or 126 acting as a leader operates to filter audio content for individual channels, and then sends a portion of the filtered audio to other audio output devices 120, 122, based on channel assignments. Each of 124, 126 (742). As an addition or change, the entire audio content may be sent from the audio output devices 120, 122, 124, 126 to other audio output devices 120, 122, 124, 126 of the network 101. In this implementation, the audio output devices 120, 122, 124, 126 that receive all audio content from the leader perform filtering at the output time, and at this time further continue to output only (744). Further along these lines, some changes provide audio content to be amplified, and more specifically, the controller device 110, 300 or the lead audio output device 120 for the purpose of generating structure in the audio content. , 122, 124, or 126 pending audio content (746). Added structure It can promote other audio output devices 120, 122, 124, 126 to perform filtering operations on all audio content.

As mentioned with respect to method 600, events or conditions are detected that detect a change in starting channel configuration and / or other choices (e.g., selection of a particular leader device or motivational implementation, etc.) (750). As an example, an event or condition may correspond to a change in the bandwidth of some or all of the audio output devices 120, 122, 124, 126, a change in the output content (e.g., the bit value of the content), an audio output device from Addition or subtraction, and / or user movement sufficient to trigger a calibration action.

In response to a detected event or condition, one or more processes may be triggered to dynamically adjust the channel configuration and made by the controller device 110, 300 or the audio output device 120, 122, 124 or 126 operating as the leader Other options (760). In some implementations, the controller device 110, 300, and / or the lead audio output device 120, 122, 124, or 126 can be made by adjusting the channel configuration of each audio output device while the output continues on the network Response (762). Channel configuration changes may include: (i) changing the channel assignment of a given output device 120, 122, 124, 126; (ii) adding or subtracting from the audio output device 120, 122, 124, 126 to the network 101 Generate or eliminate channel assignments; and / or (iii) change the audio output device 120, 122 based on user input, a change in the number of audio output devices 120, 122, 124, 126, or any one or more of other criteria , 124, 126 selected layout. Channel configuration can be changed dynamically, making changes to the channel configuration relatively smooth without interrupting the user's listening experience. For example, one or more changes can be made to the channel configuration, and at least one or more audio output devices 120, 122, 124, 126 continue to output audio content.

Other changes that can be implemented dynamically include the selection (764) of audio output devices 120, 122, 124, or 126 that will operate as the leader. For example, the audio output device 120, 122, 124, or 126 operating as the leader may implement a mode change such that other audio output devices 120, 122, 124, 126 are from the controller device 110, 300 or source rather than the leader Audio The output device receives audio content. Likewise, another mode change may be made to select a new audio output device 120, 122, 124, or 126 as a leader based on criteria such as the amount of bandwidth available for the selected audio output device. Thus, for example, the selection of the audio output device 120, 122, 124 or 126 as the leader can be made dynamically and in real time. Likewise, other choices that can be made dynamically include: (i) selection of operating modes, such as whether any of the audio output devices 120, 122, 124, 126 can be used as a leader in the same session Leader; (ii) whether to filter or structure the audio content (for example, with or without a leader device); and / or (iii) whether to filter or expand other audio output devices 120, 122, 124, 126 before transmission Enhance audio content.

Referring to FIG. 1 to FIG. 8, when audio is being output by the audio output devices 120, 122, 124, and 126, the location of the user in the network environment can be tracked based on measurements made by the user's mobile computing device 400 (810 ). More specifically, the relative proximity of the mobile computing device 400 (which may be carried by the user) to one or more audio output devices 120, 122, 124, 126 on the network 101 can be approximated (812). Based on the determined relative position of the user, as instructed by the user's mobile computing device, one or more output characteristics of the audio content can be calibrated to suit the user and the network 101's audio output devices 120, 122, 124, 126 The assumption is relatively close (820). As mentioned using other examples, calibration may include controlling or otherwise adjusting the volume of one or more audio output devices 120, 122, 124, 126 (822). As an addition or variation, calibration may include adjusting the delay or inserting the delay into the output of audio content from one or more audio output devices 120, 122, 124, 126 (824). The insertion of the delay may be based on, for example, a proximity determination between the selected audio output device 120, 122, 124, 126 and the user compared to other devices connected to the same network 101.

Referring to FIGS. 1 to 9, each audio output device 120, 122, 124, 126 is triggered to send an acoustic identification signal to the controller devices 110, 300 (eg, the mobile computing device 400) (910). Acoustic identification signals can be audible and encoded to identify the source of the acoustic transmission Transmission (912). In a variation, the acoustic identification signal may be an audible and encoded transmission that can be detected by a resource (eg, a microphone) for the mobile computing device implementing the controller device 110, 300 (914).

The mobile computing device 400 may perform a comparison of the arrival times of the acoustic identification signals transmitted from each of the audio output devices 120, 122, 124, 126 (920). Each acoustic identification signal may include a specific segment of the played audio content. For example, each acoustic identification signal may represent one or two frames of audio content. Each audio output device 120, 122, 124, 126 may transmit an acoustic identification signal for a common portion of the audio content output on the other device. The acoustic identification signal may provide a mechanism for the user's mobile computing device 400 to make a measurement indicating the position of the mobile computing device relative to one or more other audio output devices 120, 122, 124, 126.

In some implementations, the mobile computing device 400 includes software or other programming functionality to timestamp the incoming audio signal, extract a coded identifier, and store the timestamp and identifier of the incoming audio signal for subsequent analysis. Each audio transmission may be encoded to coincide with a particular moment in the audio content. For example, a specific audio frame in a song may be selected for each audio output device 120, 122, 124, 126 to encode, and each audio output device 120, 122, 124, 126 may then output the same when the song is played Part of the audio frame. The microphone on the mobile computing device 400 can detect the encoded audio signal from each audio output device 120, 122, 124, 126, and then record the arrival time and identifier for each signal. Once the records are used for all transmissions at a given moment, a comparison of the arrival times can be performed. This comparison identifies the change in arrival time of the audio output device, where it is assumed that the sound travels about 1 foot in 1 millisecond. If the arrival time reflects a deviation greater than 1 millisecond, the arrival time indicates that the mobile computing device 400 has moved the relevant amount. More specifically, the comparison of the arrival times may indicate that the user's mobile computing device 400 (on which the control devices 110, 300 are implemented) relative to one or more audio output devices 120, 122, 124, 126 connected to the network 101 Close.

Outputs from one or more audio output devices 120, 122, 124, 126 can be controlled to calibrate audio output from all audio output devices and coordinate user experience (930). As described, some embodiments provide a calibration action to include each of the following: (i) adjusting timing for individual audio output devices 120, 122, 124, 126 such that the arrival times of multiple audio output devices are at least based on the user's perspective Substantially the same (932); and (ii) adjusting the volume of individual audio output devices 120, 122, 124, 126 so that the user experiences the same volume for each of these devices, regardless of the user and the specific What is the distance between the audio output devices 120, 122, 124, and 126 (934).

1 to 10, a user interface 310 may be generated on the mobile computing device 400 for implementing the controller devices 110, 300, so that the user can provide a method for determining a channel configuration and various other dynamic decisions (e.g., operations Mode, choice of leader device, etc.).

According to various embodiments, the audio output devices 120, 122, 124, 126 (1010) of the network 101 can be located and linked. As mentioned using other examples, each audio output device 120, 122, 124, 126 may be capable of network communication, such as wireless communication (e.g., wireless communication between peers such as provided by Wi-Fi Direct). Audio output devices 120, 122, 124, 126 can be linked regardless of the manufacturer or main purpose. Furthermore, in a change, the audio output devices 120, 122, 124, 126 may be heterogeneous in terms of manufacturer, functionality, programming resources, and / or major resources.

The user interface 310 may be generated to prompt or otherwise guide the user to provide information about the audio output devices 120, 122, 124, 126 connected to the network 101 (1020). For example, the number of audio output devices 120, 122, 124, 126 connected to the network 101 may be specified by user input provided through the user interface 310. In addition, the user can identify each audio output device 120, 122, 124, 126, and further identify the relative locations of each audio output device 120, 122, 124, 126 in the user's home or cyberspace. For example, the user can be provided with a general outline of the room (e.g. For example, FIG. 11) user interface 310. The profile may be generic or include user-specified features (eg, additional walls, circular walls, etc.). The user can identify the specific audio output device 120, 122, 124, 126 in the user settings, and then further instruct the space or place in the house where the specific audio output device is located.

Once the number of audio output devices and their respective parts are generally identified, the functionality provided by audio output devices 120, 122, 124, 126 can trigger the determination of channel assignments (1030). As described using other embodiments, when determining channel assignments, the number of audio output devices 120, 122, 124, 126, the location of each audio output device, and the selected layout or configuration may serve as inputs for determining channel assignments.

Once the channel assignment and location is determined, a calibration can be performed based on the user's relative location (1040). The initial calibration may, for example, calibrate the arrival time and volume level of the media content output from each audio output device 120, 122, 124, 126 based on the user's initial position relative to the audio output device. The user can then choose to perform the calibration periodically or repeatedly to track the user's pace in the home or space.

FIG. 11 illustrates a user interface 1100 for enabling speaker selection and assignment according to various embodiments. A user interface 1100 may be generated from an application or programming component executing on the mobile computing device 400. The user interface 1100 may, for example, include input functionality including: (i) a number selection feature for enabling a user to specify the number of audio output devices 120, 122, 124, 126 to be used 1106; and (ii) a layout selection 1109 feature to enable a user to select a better layout. In addition, the placement functionality 1108 may be provided to the user to enable the user to specify the location of the individual audio output devices 120, 122, 124, 126 within the room representation 1112. (For example, room representation 1112 may be a graphical representation of a room). The user can, for example, click the device representation 1111 and drag the device representation 1111 to the room representation 1112 to simulate the general location and orientation of the audio output devices 120, 122, 124, 126.

Once the audio output devices 120, 122, 124, 126 are located, the user can select The calibration feature 1120 starts a calibration process such as described using the method 1000. The calibration feature 1120 may be triggered once to locate the user relative to the audio output devices 120, 122, 124, 126. The calibration feature 1120 can correct any inaccuracy or error caused by the user when designating the positions of the individual audio output devices 120, 122, 124, 126. In addition, calibration features can be implemented in tracking mode, where calibration is repeatedly performed to track whether the user is moving.

Although the illustrative embodiments have been described in detail herein with reference to the accompanying drawings, the invention encompasses changes to specific embodiments and details. It is hoped that the scope of the embodiments described herein will be defined by the scope of patent applications and their equivalents. Furthermore, it is contemplated that certain features that are individually described or described as part of various embodiments may be combined with other individually described features or portions of other embodiments. Therefore, the lack of describing combinations should not preclude the inventor's right to claim such combinations.

100‧‧‧Audio output system

101‧‧‧Internet

102‧‧‧Access Point

103‧‧‧Media Archives

105‧‧‧Media Cabinet

107‧‧‧Internet Services

109‧‧‧Content source

110‧‧‧controller device

111‧‧‧ Leader Choice

112‧‧‧Audio distribution logic

113‧‧‧Audio Content

114‧‧‧Dynamic selection logic

115‧‧‧channel configuration

116‧‧‧Channel configuration logic

117‧‧‧Configuration Scheme

118‧‧‧calibration logic

119‧‧‧ adjustment

120‧‧‧Audio output device

121‧‧‧ Channel section

122‧‧‧Audio output device

123‧‧‧Channel Assignment

124‧‧‧Audio output device

126‧‧‧Audio output device

133‧‧‧Amplified audio

Claims (17)

A method for outputting audio content via a network, the method comprising: assigning each of a plurality of audio output devices in the network to a corresponding channel; configuring each of the plurality of audio output devices Output at least a portion of the audio content based at least in part on the assigned channel; during playback of the audio content, dynamically change the channel assignments based at least in part on changes in the plurality of audio output devices; detect Measuring a bandwidth of each of the plurality of audio output devices; transmitting the audio content to a first audio output device having the highest bandwidth between the plurality of audio output devices; and enabling the first audio output The device distributes at least a portion of the audio content to the others of the plurality of audio output devices. The method of claim 1, wherein the channel assignment of each of the plurality of audio output devices is based at least in part on the number of audio output devices available in the network, each of the plurality of audio output devices in the network A relative position of one of them, or at least one of a predetermined configuration scheme. The method of claim 1, wherein the dynamic change includes: detecting the addition of a new audio output device in the network; and assigning the new audio output device to a new channel or to the plurality of audio output devices One of them is an existing channel. The method of claim 3, further comprising: reassigning one of the plurality of audio output devices to the new channel. The method of claim 1, wherein the dynamic change comprises: detecting removal or failure of one of the plurality of audio output devices; and After detecting the removal or failure of the one of the plurality of audio output devices, at least one of the plurality of audio output devices is reassigned to a different channel. The method of claim 1, wherein the dynamic change comprises: reassigning one or more of the plurality of audio output devices to a new or different channel. The method of claim 1, wherein the configuration includes: transmitting the audio content to each of the plurality of audio output devices; and instructing each of the plurality of audio output devices to filter based on the assigned channel The audio content of the part is output by a counterpart of the plurality of audio output devices. The method of claim 1, further comprising: detecting multiple changes in a position of a user; and dynamically adjusting at least one of the plurality of audio output devices based on the changes in the position of the user. One or more of the audio output characteristics. The method of claim 8, wherein the one or more audio output features include at least one of a delay or a volume of audio signals output by the at least one of the plurality of audio output devices. A system for outputting audio content via a network, the system includes: one or more processors; and a memory that stores a plurality of instructions that are executed by the one or more processors Causing the system to: assign each of the plurality of audio output devices in the network to a corresponding channel; configure each of the plurality of audio output devices to output the audio content based at least in part on the assigned channel At least part of During the playback of the audio content, dynamically changing the channel assignment based at least in part on the multiple changes of the plurality of audio output devices; detecting a bandwidth of each of the plurality of audio output devices; transmitting the audio content To the first audio output device having one of the highest bandwidth between the plurality of audio output devices; and causing the first audio output device to distribute at least a portion of the audio content to the others of the plurality of audio output devices . If the system of claim 10, wherein the channel assignment of each of the plurality of audio output devices is based at least in part on the number of audio output devices available in the network, each of the plurality of audio output devices in the network A relative position of one of them, or at least one of a predetermined configuration scheme. If the system of item 10 is requested, the execution of the instructions dynamically changing the channel assignments causes the system to: detect the addition of a new audio output device in the network; and assign the new audio output device to a new A channel or an existing channel assigned to one of the plurality of audio output devices. If the system of claim 10, wherein the execution of the instructions assigned dynamically by the channels is caused to cause the system to: detect removal or failure of one of the plurality of audio output devices; and upon detecting the plurality After the removal or failure of one of the audio output devices, at least one of the plurality of audio output devices is reassigned to a different channel. The system of claim 10, wherein the execution of the instructions dynamically changing the assignment of the channels causes the system to reassign one or more of the plurality of audio output devices to a new or different channel. If the system of claim 10, the execution of the instructions configuring each of the plurality of audio output devices causes the system to: transmit the audio content to each of the plurality of audio output devices; and The assigned channel instructs each of the plurality of audio output devices to filter the audio content of the portion to be output by a counterpart of the plurality of audio output devices. If the system of claim 10, wherein the execution of the instructions further causes the system to: detect multiple changes in a location of a user; and dynamically adjust the plurality based on the changes in the location of the user One or more audio output features of at least one of the audio output devices. A non-transitory computer-readable medium that stores instructions that, when executed by one or more processors of an audio output system, cause the system to assign each of the plurality of audio output devices in the network to A corresponding channel; each of the plurality of audio output devices configured to output at least a portion of the audio content based at least in part on the assigned channel; and during the playback of the audio content, based at least in part on the plurality of Dynamically change the channel assignments with multiple changes to the audio output device; detect one of the bandwidths of each of the plurality of audio output devices; transmit the audio content to the highest frequency between the plurality of audio output devices One of the first audio output devices; and the other that causes the first audio output device to distribute at least a portion of the audio content to the plurality of audio output devices.