JP6483922B2 - Validating audio calibration using multidimensional motion check - Google Patents

Description

Cross-reference of related applications

  This application claims priority to US patent application Ser. No. 14 / 864,506 filed Sep. 24, 2015 and US Provisional Patent Application No. 62 / 220,176 filed Sep. 17, 2015. And are hereby incorporated by reference in their entirety.

  This application relates to consumer products, and in particular, to methods, systems, products, features, services, and other elements directed to media playback and some aspects thereof.

  In 2003, Sonos Incorporated filed a patent application entitled “Method of Synchronizing Audio Playback Between Multiple Network Devices”, one of the first patent applications, and in 2005, marketed a media playback system. Until it started, the options for accessing and listening to digital audio in the outloud setting were limited. People can experience music from multiple sources via one or more network playback devices with the Sonos Wireless HiFi system. Through a software control application installed on a smartphone, tablet, or computer, people can play the music they want in any room with a network playback device. Also, for example, a controller can be used to stream different songs to each room equipped with a playback device, or multiple rooms can be grouped for synchronized playback, or synchronized in all rooms. You can listen to the same song.

  Given the growing interest in digital media, there is a need to further develop consumer accessible technologies that can further improve the listening experience.

  The features, aspects, and advantages of the techniques disclosed herein may be better understood with reference to the following description, appended claims, and accompanying drawings.

The figure which shows the structure of the example media reproduction system which can be implemented with a certain embodiment. Functional block diagram of an exemplary playback device Functional block diagram of an exemplary control device Diagram showing an example controller interface Flow diagram showing an example method for identifying error conditions FIG. 3 illustrates a user interface for an exemplary playback device calibration. FIG. 4 illustrates an exemplary playback device calibration error state user interface. Flow diagram illustrating an exemplary technique for verifying the effectiveness of microphone movement during calibration Diagram showing an example of device movement in the listening area Diagram showing an example of motion data Diagram showing an example of motion data Diagram showing a frame showing an example repetition of a periodic calibration sound Diagram showing a series of frames showing an example repetition of a periodic calibration sound Diagram showing bi-directional motion data that is relatively closely correlated Diagram showing bi-directional motion data that is relatively loosely correlated FIG. 3 illustrates a user interface for an exemplary playback device calibration. FIG. 5 illustrates another exemplary playback device calibration user interface.

  Although the drawings are intended to illustrate some exemplary embodiments, it is understood that the invention is not limited to the arrangements and instrumentality shown in the drawings.

I. Overview Embodiments described herein include, among other things, detecting one or more error conditions that may occur when calibrating one or more playback devices of a media playback system. Because calibration can address the acoustic characteristics of the environment, calibration of the playback device can improve the performance of the playback device in a given environment. Sound effects can vary from environment to environment, and some environments can adversely affect sound transmission by boosting or cutting a predetermined frequency over the frequency response of the playback device. For example, in a symphony hall, the acoustic effect is nearly perfect and has no substantial effect on the propagation of sound, but many homes or offices do not provide such ideal conditions for sound transmission.

  Some calibration procedures contemplated herein include recordings that detect and analyze sound waves (eg, one or more calibration sounds) emitted by one or more playback devices in a given listening environment. Includes devices. By analyzing the sound waves propagated within the listening environment, the media playback system compensates for how the listening environment affects the sound emitted by the playback device, and possibly the effect of the listening environment on the playback device. The method can also be determined. For example, the media playback system may determine a calibration profile that adjusts the frequency response of the playback device to compensate for environmental acoustic effects.

  Possible error conditions that may occur during calibration include insufficient movement of the recording device within the listening environment while one or more playback devices emit calibration sounds. . Since acoustic effects can vary from physical location to physical location within the listening environment, the exemplary calibration procedure contemplated herein is performed while one or more playback devices emit calibration sounds. In addition, it can be proposed to move the recording device within the listening environment. In some examples, the calibration sound may include a periodic repetition of calibration tones. This may generate “samples” that represent the acoustic effects of the environment at individual locations. Such data generated by a moving microphone may provide a more complete representation of environmental acoustic effects than by a stationary microphone. Examples of other error conditions include, among other possibilities, the level of background noise, the quality of the audio signal detected by the microphone, the distance between one or more playback devices and the recording device, or the recording device's Speed.

  During calibration, the recording device may determine whether sufficient movement has occurred in one or more (eg, vertical, horizontal and / or radial (relative to the playback device) dimensions. . A calibration where the recording device has been moved sufficiently in this dimension (perhaps assuming no other error conditions exist) may be valid. Conversely, the absence of sufficient movement in one or more of these dimensions can be invalidated. In situations where one or more error conditions are detected, the media playback system may prompt the calibration to repeat or attempt to correct the calibration, depending on the type of error condition.

  Data indicating the movement of the recording device (or in the embodiment where the microphone is separate from the microphone itself) may be generated from different sources. In some embodiments, a sensor on the recording device (or on the microphone and coupled to the recording device) may generate data indicative of the acceleration of the recording device. A camera or other type of vision-based system on the recording or playback device may generate video data that indicates the movement of the recording device within the environment. As another example, the acoustic data may indicate a radial distance from the recording device to the playback device (eg, by indicating an audio propagation delay from the playback device to the recording device or vice versa).

  In some cases, motion data indicating movement of the recording device in the two dimensions can be used to determine the movement of the recording device in the third dimension. For example, the sensor may generate motion data indicating the vertical movement of the recording device (possibly from an accelerometer that generates gravity-related data), and the acoustic data is a radius from the playback device of the recording device. Directional movement may be indicated. By cross-correlating such data, the media playback system may determine a horizontal motion parameter that represents motion in the third dimension of the recording device (ie, horizontal motion). If this horizontal motion parameter exceeds a correlation threshold (threshold indicating that the motion in the first two dimensions is not fully correlated), the media playback system will assume that sufficient horizontal movement has occurred across the environment during the calibration period. Can be guessed.

  If an error condition is identified, the calibration process may be interrupted and the media playback system may display a message indicating that the calibration process has been interrupted. In some cases, the media playback system may indicate the identified error condition that caused the calibration process to be interrupted. The media playback system may further provide suggestions on how to correct the identified error condition. For example, the message may indicate that insufficient vertical movement has occurred and that this error condition can be avoided by moving a larger amount of recording device or moving the recording device over a longer portion of the calibration period. May be shown. The media playback system may also display selectable options for restarting the calibration process or canceling the calibration process. Other examples are possible as examples.

  As indicated above, the present disclosure includes identifying one or more error conditions while calibrating one or more playback devices. In an aspect, a recording device is provided. A recording device includes a microphone, one or more processors, and an instruction executable by the one or more processors, the tangible data storage device storing therein the instructions for causing the recording device to perform an operation Including. The operation includes receiving an indication that the playback device is emitting a calibration sound in a predetermined environment during the calibration period. Operation also includes recording sound data including the emitted calibration sound via the microphone and receiving motion data indicating movement of the recording device during the emission of the calibration sound. The operation further includes determining that sufficient vertical movement of the recording device has occurred during the calibration period. The operation is based on determining that sufficient horizontal movement of the recording device has occurred during the calibration period and that sufficient movement of the recording device has occurred in the vertical and horizontal directions during the calibration period. Applying a calibration based on the detected calibration sound to the audio stage of the playback device.

  In another aspect, a method is provided. The method includes receiving an indication that one or more playback devices are emitting a calibration sound in a predetermined environment during a calibration cycle. The method also includes recording the emitted calibration sound and receiving motion data indicating movement of the control device during the calibration sound emission. The method further includes a first component of motion data indicative of vertical movement of the control device and one of the motion data indicative of each radial movement of the control device from one or more playback devices. Or identifying a plurality of second components. The method also includes a first component of motion data indicative of vertical movement of the control device and one or more of motion data indicative of each radial movement of the control device from one or more playback devices. And determining one or more horizontal motion parameters representative of the horizontal movement of the control device within the environment by cross-correlating the second component of The method determines that sufficient horizontal movement of the control device has occurred during the calibration period by determining that at least one of the horizontal motion parameters representing horizontal motion in the environment exceeds a correlation threshold. Including the steps of: The method also includes sending a message indicating that sufficient movement of the control device has occurred during the calibration period.

  In another aspect, a non-transitory computer readable medium is provided. A non-transitory computer readable medium stores instructions executable by a computer device to perform an operation. The operation includes receiving an indication that the playback device is emitting a calibration sound in a predetermined environment during the calibration period. Operation also includes recording sound data including the emitted calibration sound via the microphone and receiving motion data indicating movement of the recording device during the emission of the calibration sound. The operation further includes determining that sufficient vertical movement of the recording device has occurred during the calibration period. The operation is based on determining that sufficient horizontal movement of the recording device has occurred during the calibration period and that sufficient movement of the recording device has occurred in the vertical and horizontal directions during the calibration period. Applying a calibration based on the detected calibration sound to the audio stage of the playback device.

  In yet another aspect, a control device is provided. The control device includes one or more processors and a tangible data storage device having instructions stored therein that are executable by the one or more processors and that cause the recording device to perform an operation. . In operation, receiving motion data indicating movement of the recording device while the recording device is recording a calibration sound emitted by one or more playback devices in a given environment during the calibration period. Is included. The operation also includes determining that a sufficient vertical movement of the recording device has occurred during the calibration period and that a sufficient horizontal movement of the recording device has occurred during the calibration period. The operation further includes sending a message indicating that sufficient movement of the recording device has occurred in the vertical and horizontal directions during the calibration period.

  In certain aspects, a method is provided. The method receives motion data indicative of movement of a recording device while the recording device is recording a calibration sound emitted by one or more playback devices in a predetermined environment during a calibration period. including. The method also includes determining that a sufficient vertical movement of the recording device has occurred during the calibration period and that a sufficient horizontal movement of the recording device has occurred during the calibration period. The method further includes transmitting a message indicating that sufficient movement of the recording device has occurred in the vertical and horizontal directions during the calibration period.

  In another aspect, a non-transitory computer readable medium is provided. A non-transitory computer readable medium stores instructions executable by a computer device to perform an operation. In operation, receiving motion data indicating movement of the recording device while the recording device is recording a calibration sound emitted by one or more playback devices in a given environment during the calibration period. Is included. The operation also includes determining that a sufficient vertical movement of the recording device has occurred during the calibration period and that a sufficient horizontal movement of the recording device has occurred during the calibration period. The operation further includes sending a message indicating that sufficient movement of the recording device has occurred in the vertical and horizontal directions during the calibration period.

  Although some examples described herein refer to functions performed by any entity, such as a “user” and / or other entity, this should be understood to be for illustrative purposes only. is there. The claims should not be construed as requiring the operation of such exemplary subject matter unless explicitly required by the recitation of the claims themselves. Those skilled in the art will appreciate that the present disclosure includes other embodiments.

II. Exemplary Operating Environment FIG. 1 illustrates an exemplary configuration of a media playback system 100 that can be implemented or implemented with one or more embodiments disclosed herein. As shown, media playback system 100 is associated with an exemplary home environment having multiple rooms and spaces, eg, a master bedroom, an office, a dining room, and a living room. As shown in the example of FIG. 1, the media playback system 100 includes playback devices 102-124, control devices 126 and 128, and a wired or wireless network router 130.

  In addition, descriptions of the different components of the exemplary media playback system 100 and how the different components work to provide a media experience to the user are described in the following sections. Although the description herein generally refers to the media playback system 100, the techniques described herein are not limited to the home environment application shown in FIG. For example, the techniques described herein can be used in environments where multi-zone audio is desired, such as commercial environments such as restaurants, malls, or airports, sports multipurpose vehicles (SUVs), buses or cars. Useful in environments such as vehicles, ships, boards or airplanes.

a. Exemplary Playback Device FIG. 2 shows a functional block diagram of an exemplary playback device 200 that constitutes one or more of the playback devices 102-124 of the media playback system 100 of FIG. The playback device 200 may include a processor 202, software component 204, memory 206, audio processing component 208, audio amplifier 210, speaker 212, microphone 220, and network interface 214. The network interface 214 includes a wireless interface 216 and a wired interface 218. In some cases, the playback device 200 does not include the speaker 212, but may include a speaker interface for connecting the playback device 200 to an external speaker. In other cases, the playback device 200 does not include the speaker 212 or the audio amplifier 210, but may include an audio interface for connecting the playback device 200 to an external audio amplifier or audiovisual receiver.

  In one example, the processor 202 may be a clocked computer component configured to process input data based on instructions stored in the memory 206. The memory 206 may be a non-transitory computer readable recording medium configured to store instructions executable by the processor 202. For example, the memory 206 may be a data storage that can load one or more of the software components 204 executable by the processor 202 to perform certain functions. In one example, the function may include the playback device 200 reading audio data from an audio source or another playback device. In another example, the functionality may include the playback device 200 sending audio data to another device on the network or to a playback device. In yet another example, the functionality may include pairing the playback device 200 with one or more playback devices to create a multi-channel audio environment.

  One feature includes the playback device 200 synchronizing the playback of audio content with one or more other playback devices. While synchronizing playback, it is preferred that the listener is unaware of the delay between playback of audio content by playback device 200 and playback by one or more other playback devices. US Pat. No. 8,234,395, entitled “System and Method for Synchronizing Operation Between Multiple Independent Clock Digital Data Processing Devices”, is incorporated herein by reference, which provides audio playback between playback devices. It provides a more detailed example where synchronization is stated.

  Further, the memory 206 may be configured to store data. The data may be, for example, a playback device 200, such as a playback device 200 included as part of one or more zones and / or zone groups, an audio source accessible by the playback device 200, or a playback device 200 (or other playback). Device) and a play queue that can be associated with the device. The data may be periodically updated and stored as one or more state variables that indicate the state of the playback device 200. The memory 206 may also include data associated with the status of other devices in the media system, which allows one or more devices to share the most recent data associated with the system from time to time. You may have. Other embodiments are possible.

  Audio processing component 208 includes, among other things, one or more digital-to-analog converters (DACs), analog-to-digital converters (ADCs), audio processing components, audio enhancement components, and digital signal processors (DSPs). Also good. In some embodiments, one or more audio processing components 208 may be a subcomponent of processor 202. In some embodiments, audio content may be processed and / or deliberately modified by the audio processing component 208 to generate an audio signal. The generated audio signal is transmitted to the audio amplifier 210, amplified, and reproduced through the speaker 212. In particular, the audio amplifier 210 may include a device configured to amplify the audio signal to a level that can drive one or more speakers 212. The speaker 212 may comprise a complete speaker system including an independent transducer (eg, a “driver”) or a housing that contains one or more drivers. Some drivers provided in the speaker 212 may include, for example, a subwoofer (eg, for low frequency), a middle range driver (eg, for intermediate frequency), and / or a tweeter (for high frequency). In some cases, each transducer of one or more speakers 212 may be driven by a corresponding individual audio amplifier of audio amplifier 210. In addition to generating analog signals for playback on playback device 200, audio processing component 208 processes the audio content and transmits the audio content for playback by one or more other playback devices.

  Audio content that is processed and / or played by the playback device 200 is received via an external source, eg, an audio line-in input connection (eg, an auto-detecting 3.5 mm audio line-in connection) or the network interface 214. May be.

  The microphone 220 may include an audio sensor configured to convert the detected sound into an electrical signal. The electrical signal may be processed by audio processing component 208 and / or processor 202. The microphone 220 can be arranged in one or more orientations at one or more positions in the playback device 200. Microphone 220 may be configured to detect sound within one or more frequency ranges. In some cases, the one or more microphones 220 may be configured to detect sound within the frequency range of audio that the playback device 200 is capable of or rendering. In another case, the one or more microphones 220 may be configured to detect sound within the human audible frequency range. Other examples are also possible.

  The network interface 214 may be configured to allow data flow between the playback device 200 and one or more other devices over a data network. In this way, the playback device 200 can receive data from one or more other playback devices that communicate with the playback device, a network device in a local area network, or an audio content source on a wide area network such as, for example, the Internet. May be configured to receive audio content over the network. In one example, audio content and other signals transmitted and received by playback device 200 may be transmitted in the form of a digital packet that includes a source address based on Internet Protocol (IP) and a destination address based on IP. In such a case, the network interface 214 can appropriately receive and process data addressed to the playback device 200 by analyzing the digital packet data.

  As shown, the network interface 214 may include a wireless interface 216 and a wired interface 218. The wireless interface 216 provides a network interface function for the playback device 200 and a communication protocol (eg, wireless standards IEEE 802.11a, 802.11b, 802.11g, 802.11n, 802.11ac, 802.15, 4G mobile Other devices (eg, other playback devices, speakers, receivers, network devices, control devices in the data network associated with playback device 200) based on any of the wireless standards (standards) including communication standards, etc. And wireless communication. The wired interface 218 may provide a network interface function for the playback device 200 and may communicate with other devices via a wired connection based on a communication protocol (eg, IEEE 802.3). Although the network interface 214 shown in FIG. 2 includes both a wireless interface 216 and a wired interface 218, the network interface 214 may include only a wireless interface or only a wired interface in some embodiments. Good.

  In one example, playback device 200 and another playback device may be paired to play two separate audio components of audio content. For example, playback device 200 may be configured to play a left channel audio component while other playback devices may be configured to play a right channel audio component. This can generate or enhance the stereo effect of the audio content. Paired playback devices (also referred to as “combined playback devices”) may further play audio content in synchronization with other playback devices.

  In another example, playback device 200 may be acoustically integrated with one or more other playback devices to form a single integrated playback device (integrated playback device). The integrated playback device can be configured to differ in sound processing and reproduction compared to non-integrated playback devices or paired playback devices. This is because the integrated playback device can add a speaker for playing back audio content. For example, if the playback device 200 is designed to play audio content in the low frequency range (eg, a subwoofer), the playback device 200 will play back designed to play audio content in the full frequency range. It may be integrated with the device. In this case, the playback device for the entire frequency range may be configured to play back only the medium and high frequency components of the audio content when integrated with the low frequency playback device 200. On the other hand, the low frequency range playback device 200 plays back the low frequency component of the audio content. Further, the integrated playback device may be paired with a single playback device or yet another integrated playback device.

  As an example, currently Sonos Incorporated includes “PLAY: 1”, “PLAY: 3”, “PLAY: 5”, “PLAYBAR”, “CONNECT: AMP”, “CONNECT”, and “SUB”. I sell devices. In any other past, present, and / or future playback devices, the playback devices of the embodiments disclosed herein may be additionally or alternatively implemented and used. Further, it is understood that the playback device is not limited to the specific example shown in FIG. 2 or the provided Sonoz product. For example, the playback device may include wired or wireless headphones. In another example, the playback device may include or interact with a docking station for a personal mobile media playback device. In yet another example, the playback device may be integrated with another device or component, such as a television, luminaire, or some other device for indoor or outdoor use.

b. Exemplary Playback Zone Configuration Returning to the media playback system 100 of FIG. 1, the environment has one or more playback zones, each playback zone including one or more playback devices. The media playback system 100 is formed by one or a plurality of playback zones, and one or a plurality of zones may be added or deleted later to form the exemplary configuration shown in FIG. Each zone may be given a name based on a different room or space, eg, office, bathroom, master bedroom, bedroom, kitchen, dining room, living room, and / or balcony. In some cases, a single playback zone may include multiple rooms or spaces. In other cases, a single room or space may include multiple playback zones.

  As shown in FIG. 1, each of the balcony, dining room, kitchen, bathroom, office, and bedroom zones has one playback device, while each of the living room and master bedroom zones has multiple playback devices. Have The living room zone is where the playback devices 104, 106, 108, and 110 are either as separate playback devices, as one or more combined playback devices, as one or more integrated playback devices, or any of these In such a combination, the audio content may be played back synchronously. Similarly, in the case of a master bedroom, playback devices 122 and 124 may be configured to play audio content synchronously as separate playback devices, as combined playback devices, or as an integrated playback device. .

  In one example, one or more playback zones in the environment of FIG. 1 are playing different audio content. For example, a user can listen to hip-hop music played by the playback device 102 while grilling in a balcony zone. On the other hand, another user can listen to classical music played by the playback device 114 while preparing a meal in the kitchen zone. In another example, the playback zone may play the same audio content in synchronization with another playback zone. For example, if the user is in the office zone, the playback device 118 in the office zone may play the same music that is played on the playback device 102 on the balcony. In such a case, since the playback devices 102 and 118 are playing rock music synchronously, the user can seamlessly (or at least at least) play audio content that is played out-loud even when moving between different playback zones. It can be enjoyed almost seamlessly. Synchronization between playback zones may be performed in a manner similar to synchronization between playback devices as described in the aforementioned US Pat. No. 8,234,395.

  As described above, the zone configuration of the media playback system 100 may change dynamically, and in some embodiments, the media playback system 100 supports multiple configurations. For example, if the user physically moves one or more playback devices to or from the zone, the media playback system 100 may be reconfigured to accommodate the change. For example, if the user physically moves playback device 102 from a balcony zone to an office zone, the office zone may include both playback device 118 and playback device 102. As desired, playback devices 102 may be paired or grouped into an office zone and / or renamed via a control device, eg, control devices 126 and 128. On the other hand, if one or more playback devices are moved to a certain area in a home environment where a playback zone has not yet been set, a new playback zone may be formed in that area.

  Furthermore, the different playback zones of the media playback system 100 may be dynamically combined into zone groups or may be divided into separate playback zones. For example, the dining room zone and the kitchen zone 114 are combined into a dinner party zone group so that the playback devices 112 and 114 can play back audio content in synchronization. On the other hand, if one user wants to watch television while another user wants to listen to music in the living room space, the living room zone includes a television zone that includes the playback device 104 and a listening zone that includes the playback devices 106, 108, and 110. And may be divided into

c. Exemplary Control Device FIG. 3 shows a functional block diagram of an exemplary control device 300 that constitutes one or both of the control devices 126 and 128 of the media playback system 100. As shown, the control device 300 may include a processor 302, a memory 304, a network interface 306, a user interface 308, and a microphone 310. In an example, the control device 300 may be a control device dedicated to the media playback system 100. In another example, the control device 300 may be a network device installed with media playback system controller application software, such as iPhone®, iPad®, or any other smartphone, tablet or network device (eg, , A network computer such as a PC or Mac (registered trademark).

  The processor 302 may be configured to perform functions relating to enabling user access, control, and configuration of the media playback system 100. The memory 304 may be configured to store instructions executable by the processor 302 and perform those functions. The memory 304 may also be configured to store media playback system controller application software and other data associated with the media playback system 100 and the user.

  Microphone 310 may include an audio sensor configured to convert the detected sound into an electrical signal. The electrical signal can be processed by the processor 302. In some cases, where the control device 300 is a device that can also be used as a means for voice communication or voice recording, the one or more microphones 310 may be microphones that facilitate their functions. Good. For example, the one or more microphones 310 may be configured to detect sound within a human-generated frequency range and / or a human audible frequency range. Other examples are also possible.

  In one example, the network interface 306 may be an industry standard (eg, infrared, wireless, wired standards such as IEEE 802.3, IEEE 802.11a, 802.11b, 802.11g, 802.11n, 802.11ac, 802.15, etc. Wireless standards, 4G communication standards, etc.). In network interface 306, control device 300 may provide a means for communicating with other devices in media playback system 100. In certain examples, data and information (eg, state variables) may be communicated between the control device 300 and other devices via the network interface 306. For example, the configuration of playback zones and zone groups in the media playback system 100 may be received by the control device 300 from the playback device or another network device, or may be different by the control device 300 via the network interface 306. It may be sent to a playback device or network device. In some cases, the other network device may be another control device.

  Playback device control commands such as volume control and audio playback control may be communicated from the control device 300 to the playback device via the network interface 306. As described above, the configuration of the media playback system 100 can be changed by the user using the control device 300. Configuration changes may include adding one or more playback devices to a zone, removing one or more playback devices from a zone, adding one or more zones to a zone group, one or more Removing a zone from the zone group, forming a combined player or integrated player, dividing the combined player or integrated player into one or more playback devices, and the like. Thus, the control device 300 may be referred to as a controller, and the control device 300 may be a dedicated controller that has installed the media playback system controller application software or a network device.

  The user interface 308 of the control device 300 may be configured to allow user access and control of the media playback system 100 by providing a controller interface, such as the controller interface 400 shown in FIG. . The controller interface 400 includes a playback control area 410, a playback zone area 420, a playback status area 430, a playback queue area 440, and an audio content source area 450. The illustrated user interface 400 is merely one example of a user interface provided with a network device (and / or the control devices 126 and 128 of FIG. 1), such as the control device 300 of FIG. 3, for media playback by the user. It is accessed to control a media playback system such as system 100. Alternatively, various formats, styles, and interactive sequences may be implemented with other user interfaces on one or more network devices to provide similar control access to the media playback system.

  The playback control area 410 may include selectable icons (eg, by using a touch or a cursor). This icon allows playback devices in the selected playback zone or zone group to play or stop, fast forward, rewind, then skip, skip forward, shuffle mode on / off, repeat mode on / off, cross Turn fade mode on / off. The playback control area 410 may include another selectable icon. Another selectable icon may change other settings such as equalization settings, playback volume, and the like.

  The playback zone area 420 may include a display of playback zones within the media playback system 100. In some embodiments, a graphical display of the playback zone may be selectable. By moving additional selectable icons, playback zones within the media playback system can be managed or configured. For example, other management or configuration can be performed, such as creating a combined zone, creating a zone group, dividing a zone group, and renaming a zone group.

  For example, as shown, a “group” icon may be provided for each graphic display of the playback zone. A “group” icon in a graphical representation of a zone may be selectable to allow selection of one or more zones in the media playback system and the option to group with a zone. Once grouped, a playback device in a zone grouped with a zone is configured to play audio content in synchronization with the playback device in the zone. Similarly, a “group” icon may be provided in the graphic display of the zone group. In this case, the “Group” icon can be selected to give the option to deselect one or more zones in the zone group to remove one or more zones in the zone group from the zone group. There may be. Other interactions for grouping and ungrouping zones may be possible and implemented via a user interface, such as user interface 400. The display of the playback zone in the playback zone area 420 may be updated dynamically as the playback zone or zone group configuration is changed.

  The playback status area 430 provides a graphical representation of the currently played audio content, the previously played audio content, or the audio content scheduled to be played next in the selected playback zone or zone group. May be included. The selectable playback zones or playback groups may be visually distinguished on the user interface, for example, within playback zone area 420 and / or playback status area 430. The graphical display includes track title, artist name, album name, album year, track length, and other relevant information useful to the user when controlling the media playback system via the user interface 400. Also good.

  The playback queue area 440 may include a graphical representation of the audio content in the playback queue associated with the selected playback zone or zone group. In some embodiments, each playback zone or zone group may be associated with a playback queue that includes information corresponding to zero or more audio items played by the playback zone or playback group. For example, each audio item in the playback queue includes a UR (URI), a URL (URL), or other identifier that can be used by a playback device in a playback zone or zone group. May be. These allow audio items to be found and / or retrieved from a local audio content source or a network audio content source and played by a playback device.

  In one example, a playlist may be added to the playback queue. In this case, information corresponding to each audio item in the playlist may be added to the reproduction queue. In another example, audio items in the play queue may be saved as a playlist. In yet another example, when the playback device continues to play streaming audio content, e.g., an audio item that does not play continuously due to having a playback time, it continues to play continuously unless it stops. The play queue may be empty, or may be “unused” but filled. In another embodiment, the playback queue can include Internet radio and / or other streaming audio content items and is “in use” when a playback zone or zone group is playing those items. Can do. Other examples are possible.

  When a playback zone or zone group is “grouped” or “ungrouped”, the playback queue associated with the affected playback zone or zone group may be cleared or reassociated. May be. For example, if a first playback zone that includes a first playback queue is grouped with a second playback zone that includes a second playback queue, the formed zone group may have an associated playback queue. . The associated play queue is initially empty, or contains audio items from the first play queue (eg, when the second play zone is added to the first play zone), or (eg, the first play queue). When a zone is added to the second playback zone, it can include the audio items of the second playback queue, or combine the audio items of both the first and second playback queues. Thereafter, when the formed zone group is ungrouped, the ungrouped first playback zone may be re-associated with the previous first playback queue or may be associated with an empty new playback queue. Alternatively, it may be associated with a new play queue that includes the audio items of the play queue that were associated with the zone group before the zone group was ungrouped. Similarly, the ungrouped second playback zone may be re-associated with the previous second playback queue, may be associated with an empty new playback queue, or before the zone group is ungrouped. May be associated with a new play queue that includes an audio item of the play queue that was associated with the zone group. Other examples are possible.

  Returning to the user interface 400 of FIG. 4, the graphic display of the audio content in the play queue area 440 includes the track title, artist name, track length, and other related information associated with the audio content in the play queue. May be included. In one example, the graphical display of audio content can be moved by selecting additional selectable icons. Thereby, it is possible to manage and / or operate the reproduction queue and / or the audio content displayed in the reproduction queue. For example, the displayed audio content may be removed from the playback queue, moved to a different position in the playback queue, played immediately, or played after the currently playing audio content. Or other actions may be performed. A playback queue associated with a playback zone or zone group can be the memory of one or more playback devices in the playback zone or zone group, the memory of playback devices not in the playback zone or zone group, and / or other designations. It may be stored in the memory of the device.

  Audio content source area 450 may include a graphic representation of selectable audio content sources. In this audio content source, the audio content may be taken out and played back by the selected playback zone or zone group. Refer to the following sections for an explanation of audio content sources.

d. Exemplary Audio Content Source As previously illustrated, one or more playback devices in a zone or zone group may select multiple audio content to play (eg, based on the corresponding URI or URL of the audio content). May be configured to be retrieved from available audio content sources. In one example, audio content may be retrieved directly from a corresponding audio content source (eg, a line-in connection) by a playback device. In another example, audio content may be provided to a playback device on a network via one or more other playback devices or network devices.

  Exemplary audio content sources may include the memory of one or more playback devices in the media playback system. As the media playback system, for example, the media playback system 100 of FIG. 1, a local music library (for example, a control device, a network-compatible personal computer, or a network attached storage (NAS)) on one or more network devices, A streaming audio service that provides audio content over the Internet (eg, the cloud), or an audio source connected to a media playback system via a line-in input connection of a playback device or network device, and other possible systems. May be.

  In some embodiments, the audio content source may be periodically added to or removed from a media playback system, such as the media playback system 100 of FIG. In one example, an audio item may be indexed each time one or more audio content sources are added, removed, or updated. Audio item indexing may include scanning identifiable audio items in all folders / directories shared on the network. Here, the network is accessible by a playback device in the media playback system. Also, audio item indexing may include creating or updating an audio content database that includes metadata (eg, title, artist, album, track length, etc.) and other related information. Good. Other relevant information may include, for example, a URI or URL for finding each identifiable audio item. Other examples for managing and maintaining audio content sources are possible.

  The above description of playback devices, control devices, playback zone configurations, and media item sources provides only some exemplary operating environments in which the functions and methods described below can be implemented. The present invention is applicable to other operating environments and configurations of media playback systems, playback devices, and network devices not explicitly mentioned herein, and to implement the functions and methods. Is suitable.

III. Playback Device Calibration Example As discussed above, one or more playback devices, such as one or more of the playback devices 102-124 of FIG. 1, are configured to provide a particular audio experience. And may be calibrated to provide the audio experience regardless of the location of one or more playback devices within the playback environment. As previously mentioned, the exemplary calibration procedure contemplated herein detects and analyzes sound waves (eg, one or more calibration sounds) emitted by the playback device being calibrated. A microphone of the recording device may be included.

  A calibration interface for guiding the user through the calibration process may be provided on the network device. An exemplary interface is described in US Non-Provisional Application No. 14 / 696,014, filed Apr. 24, 2015, entitled “Speaker Calibration”, which is hereby incorporated by reference in its entirety. Incorporated as. A further exemplary interface is described in US Non-Provisional Application No. 14 / 826,873, filed Aug. 14, 2015, entitled “Speaker Calibration User Interface”, which is incorporated herein in its entirety. Also incorporated into the book as a reference. Alternatively, the calibration may be performed automatically between the network device and the playback device, and may be performed with or without interaction by the user of the network device. A network device may be a device that a user can use to control one or more playback devices. For example, the network device may be similar to the control devices 126 and 128 of FIG. 1 and the control device 300 of FIG. The calibration interface may be a component of a controller interface, such as the controller interface 400 of FIG. 4, that is provided on a network device to control one or more playback devices.

  If one or more playback devices are placed in the playback environment, the calibration interface allows one or more playback devices to recalibrate the calibration tone. Certain calibration tones can facilitate the exemplary calibration procedure contemplated herein. An exemplary calibration tone is described in U.S. Non-Provisional Patent Application No. 14 / 805,140, filed July 21, 2015, entitled “Hybrid Test Tone for Space-Available Room Audio Calibration Using A Moving Microphone”. Which is incorporated herein by reference in its entirety.

  The network device may be arranged to receive audio data related to the playback of the calibration tone by one or more playback devices. In one example, the interface may prompt the user to move the network device within the playback environment while the calibration tone is being played. For example, in certain more specific cases, the interface may instruct the user to traverse an area in the playback environment where audio playback enjoyment by one or more playback devices may typically occur. In another example, the interface may instruct the user to move the network device as close as possible to the border area opposite the playback environment, such as a room wall. In some cases, the calibration interface may provide a video describing how the user crosses the playback environment. The video may be shown to the user via the interface before the calibration tone is played or while the calibration tone is being played. Examples of microphones that move during calibration are described in US Non-Provisional Patent Application No. 14 / 481,511, filed September 9, 2014, entitled “Playback Device Calibration”. Incorporated herein by reference.

  In some examples, multiple playback devices may be calibrated simultaneously. In addition, some playback devices may include multiple playback channels (eg, tweeters and woofers, or multiple speakers configured to act as channels), which may be calibrated simultaneously. An example of a technique for facilitating calibration of multiple playback channels is U.S. Non-Provisional Patent Application No. 14/805 entitled “Concurrent Multi-Loudspeaker Calibration with a Single Measurement” filed on July 21, 2015. No. 340, which is incorporated herein by reference in its entirety.

  In one example, the calibration tone may be played for a predetermined duration, and the user may be assigned a predetermined duration for crossing an area in the playback environment. In another example, the amount of time that the calibration tone is played may be changed based on information about network device movement or path detected by the network device. For example, if a network device determines that the network device has started reversing a previously traversed path, the network device may determine that no additional measurement of calibration tones is required, And the calibration tone re-correction by one or more playback devices may be terminated.

  In a further example, the amount of time that the calibration tone is played may be changed based on the detected audio signal. For example, if the network device determines that the additional samples of the audio signal detected in the playback environment do not improve the determination of the characteristics of the playback environment, the network device determines that no additional measurement of calibration tones is required. And calibration tone recalibration by one or more playback devices may be terminated. Other examples are possible as examples.

  The predetermined duration may vary depending on the type and / or size of the playback environment. For example, prior to playing a calibration tone on one or more playback devices, the calibration interface may prompt the user to indicate the type and / or size of the playback environment. Based on input by the user, the interface may identify an appropriate predetermined duration for playing the calibration tone based on the type and / or size of the indicated playback environment. In some cases, the provided demonstration video may also vary based on the type and / or size of the indicated playback environment. In another example, the user may be instructed to move between opposing boundary areas of the playback environment. The approximate size of the playback environment may be determined based on the detected movement and / or path of the network device, so the playback time of the calibration tone is detected and / or detected. Adjustment (extension or shortening) may be made based on the path of movement of the user. For example, if it is detected that the user is still moving the network device, the playback of the calibration tone may be extended. In another example, if the user is moving the device in a direction that indicates that the playback environment is larger than previously assumed, and the user moves the device appropriately to cover the entire playback environment or a substantial portion thereof, further If it is detected that time is required, the playback time may be extended.

  While one or more playback devices are playing calibration tones, a microphone of a network device, such as microphone 310 of control device 300, can detect the audio signal. A network device processor, such as processor 302 of control device 300, may receive an audio data stream from a microphone as an audio signal is detected. The processor may then process the received audio data to determine the audio characteristics of the playback environment. For example, based on audio data, a linear frequency response associated with the playback environment may be determined.

  Next, a signal processing algorithm may be determined based on the audio characteristics. For example, the equivalent parameter may be determined such that a specific audio experience is generated when the equalization parameter is applied by one or more playback devices during playback of the audio content. In other words, a calibration profile may be applied to the playback device to supplement the acoustic properties of the environment.

IV. Example Reproducing Device-Calibration Error Condition Identification Technique As pointed out above, one or more error conditions may adversely affect the calibration effectiveness of one or more reproduction devices. In one example, one or more error conditions may be identified during calibration tone playback by one or more playback devices and during detection of an audio signal by a microphone of a network device. In some cases, calibration of one or more playback devices may occur as soon as an error condition is identified, rather than after calibration tone playback and audio signal detection over a predetermined duration is complete. It may be interrupted and / or terminated.

  FIG. 5 is a flow diagram illustrating an example implementation 500 for identifying playback device-calibration error conditions. Implementation 500 can be implemented within an operating environment that includes, for example, media playback system 100 of FIG. 1, one or more of playback devices 200 of FIG. 2, and one or more of control devices 300. Examples of new technologies are presented. In certain examples, implementation 500 may be performed in whole or in part by a computing device that communicates with a media playback system. For example, implementation 500 may be performed by one or more of control devices 126 and 128 of FIG. In such a case, one or more of control devices 126 and 128 install a software application that includes instructions executable by the processor of each control device to cause each control device to perform the functions of implementation 500. It may be.

  Implementation 500 may include one or more operations, functions, or operations as configured by one or more of blocks 502-506. Each block is shown in order, but these blocks may be performed in parallel and / or in an order different from the order described herein. Further, the number of blocks may be reduced, the number of blocks may be increased, and / or may be removed depending on the desired implementation. Further, the flowcharts illustrate examples of merely some possible implementation functions and operations of this embodiment with respect to implementation 500 and other processes and methods disclosed herein. In this regard, each block may represent a module, segment, or portion of program code that stores one or more instructions that, when executed by a processor, cause a particular logical function or step in the process to be performed. . The program code may be stored on any type of computer readable recording medium, such as a storage device including a disk or hard drive.

  Computer-readable recording media include non-transitory computer-readable recording media, such as computer-readable media that store data for a short time, such as register memory, processor cache, and random access memory (RAM). But you can. Computer readable media can be stored for long periods of time such as non-transitory media such as read only memory (ROM), optical disk, magnetic disk, compact disk read only memory (CD-ROM), etc. Secondary storage or permanent storage may be included. The computer readable medium may be any other volatile storage system or non-volatile storage system. A computer readable medium may be considered, for example, a computer readable recording medium, ie, a tangible storage device. Also, in implementation 500 and other processes and methods disclosed herein, each block may represent a circuit, which is wired to perform certain logic functions in the process.

  As shown in FIG. 5, the implementation 500 receives an audio data stream from a microphone at block 502, and at block 504, an error condition based on at least the subset of audio data is received as the subset of audio data is received. In a block 506, identifying and displaying a graphic display associated with the identified error condition on the graphic display.

a. Receiving an Audio Data Stream from a Microphone As noted above, block 502 includes receiving an audio data stream from a microphone. In one example, the microphone may be part of a network device that provides a calibration interface to guide the user through the process of calibrating one or more playback devices. In another example, the microphone may be a microphone that is external to the network device and communicatively coupled to the network device. In the description herein, physical movement of network devices may include simultaneous physical movement of microphones.

  In one example, the network device sends a message that causes the at least one playback device to play a calibration tone to at least one of the one or more playback devices before the microphone receives the audio data stream. May be. In some cases, the calibration interface may prompt the user to indicate when the user is ready to begin moving the network device within the playback environment. For example, the calibration interface may provide a selectable icon (ie, a “start calibration” icon) that the user can select on the graphic display of the network device to indicate that the user is ready.

  In response to receiving input indicating that the user is ready to begin moving the network device in the playback environment, the network device, as appropriate, at least one of the one or more playback devices. You may send a message to In some cases, at least one of the one or more playback devices may then coordinate the playback of the calibration tone by each of the one or more playback devices.

  As the calibration tone is played by one or more playback devices, the microphone can detect an audio signal that includes at least a portion of the calibration tone being played, and any ambient noise present in the playback environment. The microphone may then sample the detected audio signal and stream the resulting audio data to the network device processor as the audio signal is detected.

  Thus, the audio data stream can be received while the calibration tone is being played by one or more playback devices and while the microphone detects and samples the audio signal. Accordingly, the audio data may include (i) an audio signal component corresponding to at least a part of the calibration tone being reproduced, and (ii) a background noise component corresponding to an audio element other than the calibration tone.

  FIG. 6 shows an exemplary playback device calibration user interface 600. As shown, the user interface 600 includes a graphical display 602 that indicates that one or more playback devices in the “living room” zone are being calibrated. Referring to FIG. 1, playback devices 104, 106, 108 and 110 may be one or more playback devices that are being calibrated. The user interface 600 further includes a graphical display 604 that indicates that detection of an audio signal for calibration purposes is in progress. The graphical display 604 may also indicate the status of the audio signal recording process, such as the amount of elapsed and / or remaining of a predetermined duration for detecting a calibration tone. The graphic display 604 may also indicate the display of audio signals that have been detected so far. The user interface 600 also shows a selectable icon 606 that can be selected to end the calibration process. Those of ordinary skill in the art will recognize that the user interface 600 of FIG. 6 is for illustration purposes and other examples are possible.

b. Identifying an error condition based on at least a subset of audio data associated with receiving the subset of audio data At block 504, implementation 500 identifies an error condition based on at least the subset of audio data associated with receiving the subset of audio data. Including the steps of: In one example, the subset of audio data may be a single sample of audio data. In another example, the subset of audio data may be a plurality of audio data samples. In some cases, the step of identifying an error condition based at least on the subset of audio data identifies the error condition based on the subset of audio data and one or more preceding audio data subsets in the audio data stream. You may include that.

  In some cases, the error condition may not be statistically significant. For example, even if a noise impulse occurs during calibration, audio data indicative of the noise impulse can be automatically discarded as an outlier while processing the audio data. In such a case, the network device may determine that calibration of one or more playback devices can continue. In other cases, the error condition is statistically significant, so audio data indicating an error condition may not be discarded as an outlier. In such a case, in response to the identification of the error condition, the network device determines that the calibration of the one or more playback devices should be interrupted, and thus of the one or more playback devices A message for stopping the reproduction of the calibration tone to the at least one reproduction device may be transmitted to at least one of the above.

  In some examples, a plurality of predetermined error conditions and corresponding characteristics of the predetermined error conditions may be defined. In such a case, identifying the error condition in block 504 may include identifying the error condition from a plurality of predetermined error conditions based on identifying the corresponding characteristic. In some cases, only one error condition is identified based on at least one subset of the audio data. In other cases, multiple error conditions may be identified based on at least one subset of the audio data.

  As pointed out above, the calibration interface may prompt the user to move the network device within the playback environment while the calibration tone is being played. The calibration interface may further prompt the user to move the network device up and down within the network device. Movement of the network device while the microphone of the network device detects the calibration tone can provide a more comprehensive acoustic characteristic of the playback environment to be captured in the audio data stream. In addition, the movement of the network device across an area in the playback environment, where the enjoyment of audio playback by one or more playback devices typically occurs while the network device microphone detects a calibration tone, further The acoustic characteristics of the playback environment may be provided that is more appropriate for the usage of the playback environment during audio playback by one or more playback devices in the playback environment.

  While the network device moves, the level of the audio signal detected by the network device microphone can be expected to have some variation and a predetermined rate of variation. Thus, if a determination is made that the level of the audio signal component represented in the subset of audio data is less than a minimum threshold, an error condition that network device movement is insufficient may be identified. Alternatively, if a determination is made that the rate of variation of the level of the audio signal component represented in the subset of audio data is greater than a maximum threshold, an error condition that the network device is moving too fast can be identified.

  In one example, the network device may further include a motion sensor such as an accelerometer, among other examples. In such a case, the processor of the network device further performs calibration of the one or more playback devices, and specifically while the calibration tone is being played by the one or more playback devices. And the motion sensor may be activated while the network device is expected to be moved within the playback environment. In this example, the processor of the network device may be further configured to receive the stream of motion data. The motion data may indicate a moving range and / or moving speed of the network device in the playback environment. The moving range and moving speed of the network device may include both the lateral movement of the network device and the vertical movement of the network device within the playback environment.

  As a subset of motion data is received by the motion sensor, the processor of the network device may identify one or more error conditions based at least on the subset of motion data. Thus, an error condition of insufficient or too fast movement may alternatively or additionally be identified based on at least one subset of motion data from the motion sensor. More specifically, if the movement detected by the motion sensor is below the minimum threshold, an error message of insufficient movement is generated and / or if the movement speed detected by the motion sensor exceeds the maximum threshold, An error message is generated that says moving too fast.

  In one example, the range of movement that is considered insufficient movement may be determined based on the expected size of the listening environment. In some cases, a threshold range of travel of 1.2 meters may be determined for an average listening environment. In this case, if the range of movement detected by the motion sensor is less than 1.2 meters, an error condition of insufficient movement can be identified.

  In another example, the expected range of travel may vary depending on the type of listening environment indicated. Therefore, the threshold range of movement may change based on the type of listening environment instructed. For example, if the user indicates during the calibration process that calibration will be performed on the living room, the threshold range of movement can be 3 meters. When instructing the calibration to be performed on the living room, the user may designate the playback zone associated with the playback device being calibrated as “living room”. On the other hand, if the user indicates during the calibration process that calibration will be performed on the bathroom, the threshold range of movement can be 1 meter. Other examples are possible as examples.

  Other examples are possible for determining and / or identifying the threshold range of movement. For example, the network device and / or playback device may recover the impulse signal and estimate the size of the listening environment based on detection of the reflected signal by the network device and / or playback device. Other examples are possible as examples.

  A playback environment may include one or more playback zones, and thus may include one or more playback devices associated with one or more playback zones. Calibration of one or more playback devices is properly performed within a specific playback zone associated with one or more playback devices, rather than another playback zone or playback environment that does not include the specific playback zone. Also good. In other words, referring to FIG. 1, playback devices 122 and 124 may be appropriately calibrated for the master bedroom rather than the dining room.

  In one example, if a determination is made that the level of the audio signal component represented in the subset of audio data is gradually falling below a minimum threshold, an error condition that exceeds the threshold travel distance may be identified. In other words, the network device may be too far away from the one or more playback devices and has moved outside the appropriate playback environment for the one or more playback devices.

  Prior to playback of the calibration tone by one or more playback devices being calibrated and detection of the audio signal by the microphone, the calibration interface first determines the level of background noise in the playback environment. It may be determined whether it is suitable for calibration of one or more playback devices. In some cases, the calibration interface may provide a graphic display of the noise meter to indicate the noise level in the playback environment. If the noise level is above an appropriate level, the calibration interface prompts the user to attempt to reduce the noise level in the playback environment prior to calibrating one or more playback devices. Also good. If the noise level of the playback environment is within an appropriate level, a selectable icon that the user can select is displayed on the calibration interface to indicate that the user can move the network device at any time within the playback environment. Good. Next, selection of the selectable icon may initiate playback of the calibration tone by one or more playback devices and detection of the audio signal by the microphone of the network device.

  During playback of calibration tones by one or more playback devices and detection of audio signals by microphones of network devices, the level of background noise in the playback environment may change. In one example, an inappropriate background noise error condition can be identified if a determination is made that the level of the background noise component represented in the subset of audio data is above a maximum threshold level. In one example, such an error condition can occur if there is a burst of sound in the playback environment during detection of the audio signal by the microphone.

  In another example, if a determination is made that the ratio of the audio signal component represented in the subset of audio data to the background noise component (signal to noise ratio, or “SNR”) is below a minimum threshold, An error condition where ground noise is too high can be identified. In one example, such an error condition can occur if background noise in the playback environment is gradually increasing beyond an appropriate level.

  Different network devices may have different microphone settings. In one example, if the network device microphone is at the bottom of the network device (relative to the normal direction of operation of the network device), the calibration interface may play calibration tones with one or more playback devices, and Prior to detection of the audio signal by the microphone, the user may be prompted to turn the network device upside down so that the microphone is on top of the network device. Due to this orientation of the network device, and hence the microphone, the microphone of the network device optimally detects an audio signal that includes at least a portion of the calibration tone that is played by the one or more playback devices being calibrated. Can be properly oriented.

  In one example, an improperly oriented network device if a determination is made that the level of the audio signal component represented in the subset of audio data is substantially (or significantly) below a minimum threshold An error condition of having (and a microphone) can be identified. For example, the user may have intuitively and / or mistakenly returned the microphone to the standard operating direction of the network device, where the orientation of the microphone is one or more being calibrated. It may not be optimal for detection of an audio signal that includes at least a portion of a calibration tone that is played by a playback device. In some cases, motion data from motion sensors may also be used to determine the orientation of the network device. Thus, an error condition that the orientation of the network device is improper may alternatively or additionally be identified based on at least one subset of motion data from the motion sensor.

  In addition to improper orientation of network devices (and microphones), partially blocked microphones can also adversely affect the effectiveness of calibration of one or more playback devices using network devices. is there. In some cases, the protective and / or decorative case of the network device may block part of the microphone. In other cases, lint from clothing or other debris resulting from normal use of the network device may also block a portion of the microphone.

  In one example, if a determination is made that the audio signal component represented in the subset of audio data is substantially different from the reference audio signal, an error condition that the microphone is blocked can be identified. In some cases, the reference audio signal may represent a calibration tone. For example, the reference audio signal may be generated by superimposing a calibration tone audio signal with the frequency response of the microphone. In some cases, the substantial difference between the subset of audio data and the reference audio signal may include an audio signal that is substantially attenuated relative to the reference audio signal, represented in the audio data.

  A network device used for calibration of one or more playback devices may also be used as a communication device, so during calibration tone playback by one or more playback devices, and the microphone of the network device While detecting the audio signal, the network device may receive a message on the local area network and / or cellular network and generate a notification in the form of an audio signal and / or vibration. . Audio and / or vibration notifications can also adversely affect the effectiveness of calibration of one or more playback devices. Thus, if during a calibration tone playback and audio signal detection a determination is made that the network device has generated an audible or physical notification, a corresponding error condition can be identified.

  As pointed out above, the one or more error conditions may be determined based on a combination of received audio data and motion data. In one example, the network device may be configured to abort the calibration if 1/4 of the received audio data exhibits an SNR that is below the SNR threshold. In some cases, as discussed above, the level of background noise may be too high.

  However, in other cases, an error condition may be further identified based on motion data corresponding to these quarters of the received audio data. For example, if 1/3 of the motion data corresponding to 1/4 of the received audio data indicates a movement that exceeds a predetermined threshold, an error condition that the movement is too fast may be determined. In this case, an SNR below a threshold value can be generated from noise (wind / airflow on the microphone due to movement) that is increased by movement that is too fast.

  In another example, if the corresponding motion data shows a moving speed below the expected threshold but 1/4 of the received audio data shows a SNR below the SNR threshold, An error condition where there is too much background noise may be determined. Furthermore, in this case, if the movement of the network device in the playback environment is faster than the threshold speed of movement, but the SNR of the received audio data remains above the SNR threshold, the calibration may be allowed to continue, and Error conditions may not be identified. In other words, in this case, an error condition is not identified as long as the SNR of the received audio signal is above the SNR threshold. However, if the SNR of a portion of the received audio data (i.e., 1/4 as discussed above) is below the SNR threshold, the error condition is related to background noise or too fast movement. The determination of whether it is relevant may depend on the motion data. Other examples are possible as examples.

  The above description of error conditions is for illustrative purposes and is not intended to be limiting. One of ordinary skill in the art will recognize that other examples are possible. For example, for an error condition associated with movement of a network device, for example, if the audio data has fallen below a predetermined threshold for a relatively short time during the calibration procedure, one or more playback devices and network devices A characteristic may be determined such that there is a piece of furniture or a user in between. Such an error condition can be identified if the determined characteristic is present in at least one subset of the audio data.

  Further, the above example includes identifying one or more error conditions based on the subset of audio data while the subset of audio data is received, although those of ordinary skill in the art. For example, it will be appreciated that alternative embodiments are possible in which one or more error conditions are determined based on all received audio data after reception of the audio data is complete. Other examples are possible as examples.

c. Display of Graphical Display Associated with Identified Error Condition on Graphical Display In block 506, implementation 500 includes displaying a graphic display associated with the identified error condition on a graphic interface. FIG. 7 shows an exemplary user interface 700 for a playback device calibration error condition that may be displayed on a graphic interface once the error condition is identified. As shown, the user interface 700 includes a graphical display 702 that indicates that the displayed content on the interface 700 corresponds to one or more playback devices in the living room zone.

  User interface 700 further includes a graphical display 710 that can include a text message describing the identified error condition and / or suggestions for correcting the error condition. User interface 700 further includes selectable icons 706 and 708. Selectable icon 706 may be selected and the calibration process may be attempted again, and selectable icon 708 may be selected and the calibration process may end. As shown, the graphic display 710 may overlay some or all gray or light display versions of the graphic display 604 of the user interface 600 of FIG.

  In one example, each error condition (ie, each of a plurality of predetermined error conditions) may have a corresponding text message to be provided in the graphical display 710. For example, if the identified error condition is related to inadequate movement, the text message example is: “To get a good measurement, always move the device slowly up and down and walk across the room. Please increase your movement and try again. " In another example, if the identified error condition is related to a move that is too fast, the text message example says, “The move was a bit too fast and did not give a good measurement for tuning. Again, try moving at a slower speed. "

  In one example, if the identified error condition is related to background noise above a threshold level, the text message example says, “No good measurements for tuning. Background noise. Please try again. " In such a case, the graphical display 710 may also include a noise meter display so that the user has enough background noise level below the threshold level in the playback environment before selecting the icon 706 and retrying. The user can confirm whether or not it is reduced.

  In another example, if the identified error condition is related to a blocked microphone, the text message example should read "If the device has a case, remove it. The microphone is not blocked. Please check and try again. "

  The text message examples discussed herein are for illustrative purposes only and are not intended to be limiting. In addition, one of ordinary skill in the art will recognize that other examples are possible.

  In some examples, multiple error conditions may be identified based on at least one subset of audio data. In some cases, the most severe error condition of the plurality of error conditions may be identified, and a text message corresponding to the most severe error condition may be displayed on the graphical display 710. In another case, a subset of multiple error conditions may be identified (ie, the most severe top three error conditions), and a text message corresponding to this subset of multiple error conditions may be displayed in graphical display 710. May be. In yet another case, a text message corresponding to each of a plurality of error conditions may be displayed on the graphic display 710. Other examples are possible as examples.

IV. Examples of techniques for validating microphone movement during calibration As pointed out above, one or more error conditions can adversely affect the calibration effectiveness of one or more playback devices. There is. Such error conditions include improper movement of the microphone during calibration. Inappropriate movement may include insufficient movement in one or more dimensions, as well as excessive or insufficient movement speed.

  In one example, one or more error conditions are detected during a calibration period (ie, during playback of a calibration tone by one or more playback devices and during detection of an audio signal by a microphone of a recording device). sell. In some cases, the calibration of one or more playback devices is interrupted when an error condition is identified and / or after completion of calibration tone playback and audio signal detection over the entire calibration duration and / or Or it may be terminated.

  FIG. 8 is a flow diagram illustrating an example implementation 800 for facilitating detection of a predetermined error condition. The implementation 800 can be implemented within an operating environment that includes, for example, one or more of the media playback system 100 of FIG. 1, the playback device 200 of FIG. An example of the technology is presented. In certain examples, implementation 800 may be performed completely or partially by a computing device in communication with a media playback system. For example, implementation 800 may be performed by one or more of control devices 126 and 128 of FIG. In such a case, one or more of control devices 126 and 128 install a software application that includes instructions executable by the processor of each control device to cause each control device to perform the functions of implementation 800. It may be.

  Implementation 800 includes one or more operations, functions, or operations as indicated by one or more of blocks 802-808. Each block is shown in order, but these blocks may be executed in parallel and / or in a different order than that described herein. Also, the various blocks may be combined into fewer blocks, divided into additional blocks, and / or removed based on the desired implementation. Further, for the implementation 800 and other processes and methods disclosed herein, the flowchart illustrates the functionality and operation of just a few possible implementations of this embodiment. In this regard, each block may represent a module, segment, or portion of program code that includes one or more instructions that can be executed by the processor to perform a particular logical function or step in the process. The program code may be stored on any kind of computer readable medium, for example a storage device including a disk or hard drive.

  Computer-readable media may include non-transitory computer-readable media such as computer-readable media that store data for a short period of time, such as register memory, processor cache, and random access memory (RAM). The computer readable medium is a non-temporary storage device such as a secondary storage device or a permanent storage device such as a read only memory (ROM), an optical disk, a magnetic disk, a compact disk read only memory (CD-ROM). A typical medium may also be included. The computer readable medium may also be any other volatile or non-volatile storage system. The computer readable medium may be, for example, a computer readable storage medium or a tangible storage device. Further, for implementation 800 and other processes and methods disclosed herein, each block may represent a circuit that is wired to perform a specific logic function in the process.

a. Receiving Motion Data Indicating Microphone Movement In block 802, implementation 800 includes receiving motion data indicative of microphone movement. For example, the recording device may include a microphone and one or more sensors (eg, accelerometer, gyroscope or inertial measurement unit) that generate data indicative of movement of the recording device. The recording device may receive motion data from these sensors. Alternatively, a processing device such as a control device or playback device may receive motion data from the recording device. In some cases, the recording device may be implemented as a control device (eg, control device 300), which may also be a processing device. Still further, in some cases, a sensor on a device that is remote from the recording device (eg, a playback device) is a remote tracking such as a vision (camera), infrared, or laser tracking system that tracks the movement of the recording device. A system may be included.

  For example, in one example calibration procedure, the recording device may receive an indication that one or more playback devices are emitting a calibration sound. Such an indication, among other examples, indicates that a selectable control to initiate calibration (possibly displayed on the calibration interface) or that the playback device begins to emit a calibration sound. It may be received by a message from the playback device shown. While the calibration sound is emitted, the recording device may detect the calibration sound via the microphone and record microphone data representing the calibration sound in the data storage device.

  While the calibration sound is also emitted, the recording device can move one or more sensors (eg, accelerometer, gyroscope or inertial measurement unit) to move the microphone while the microphone detects the calibration sound. May be generated. As previously mentioned, a recording device that includes a microphone may be part of a network device that provides a calibration interface to guide the user through the process of calibrating one or more playback devices. In another example, the microphone may be a microphone external to the recording device and communicatively coupled to the recording device. The sensor may be mounted in the same device as the microphone (eg, a recording / network device) or housing (eg, a microphone housing coupled to the recording device), so that the movement detected by the sensor is the movement of the microphone. Is substantially represented. In the description herein, physical movement of the recording / network device may cause simultaneous physical movement of the microphone.

  Different sensors can generate different types of motion data. For example, an accelerometer, gyroscope or inertial measurement unit may generate data representing acceleration. Such acceleration data may include acceleration in three dimensions. In some examples, the acceleration data may indicate the user's acceleration relative to the recording device, as well as the gravitational acceleration relative to the calibration device, among other possible examples.

  The microphone can also generate motion data. For example, the propagation delay of audio from one or more playback devices being calibrated (and possibly other playback devices that are not being calibrated but are in the range of recording devices) is the radius from each playback device to the microphone. The direction distance may be indicated. Such radial distance may vary over the calibration period as the microphone (and possibly the recording device itself) moves during the calibration period.

  For example, in one example, the calibration sound emitted by a given playback device may include a chirp that repeats at regular intervals. In order to determine the distance between the microphone and a given playback device, the recording device repeats the chirp because a slight change in the chirp repeat interval can represent a changing propagation delay between the microphone and the playback device. A change in the interval may be detected. In some cases, the microphone can detect both the emitted calibration sound and one or more reflections of this calibration sound, so that the recording device can reflect the calibration sound in the listening area. An example of a calibration sound detected as having the highest sound intensity (i.e., the loudest sound) may be identified because of the accompanying loss of sound intensity.

  Within the motion data, the processing device can identify one or more components that exhibit motion in a particular dimension. For example, in the motion data, the processing device may identify a component indicative of vertical movement of the recording device, possibly from acceleration data relative to gravity, among other possible motion data. Such components may ultimately be used to confirm the validity of the movement in the vertical direction and possibly in one or more additional dimensions. As another example, in the motion data, the processing device may possibly be from audio and timing data indicating a changing propagation delay (and changing radius) between the microphone and each of the one or more playback devices, Components that indicate radial movement from the one or more playback devices by the recording device may be identified.

  Identifying the components may include integrating the received motion data to determine other types of motion data. For example, acceleration data for gravity may be integrated to determine velocity (eg, upward and downward) with respect to gravity and may be integrated to determine distance. If an example calibration procedure suggests moving the microphone up and down during the calibration period, such movement is subject to gravity (ie, subject to the microphone being moved from one calibration procedure to another). It can be approximately sinusoidal to (vertical). Conversely, if the microphone is not moved during the calibration procedure, the movement data may show a flat curve representing little vertical change over the calibration period.

  To illustrate the movement of the recording device during calibration, FIG. 9 shows the media playback system 100 of FIG. FIG. 9 shows the path 900. The recording device (eg, control device 126) may move along path 900 during calibration. As mentioned above, the control device may indicate how to perform such movement in various ways, such as by video or animation, among other examples. Although this path shows movement in the horizontal plane, movements contemplated by some example calibration procedures may cause vertical movement (eg, by moving the arm up and down while the user is holding the microphone). May be included.

  In some embodiments, the control device 126 transmits calibration signals emitted by the playback device (eg, playback device 108) to various points along the path (eg, point 902 and, among other points, / Or point 904) may be detected. Alternatively, the control device may record the calibration signal along the path. In some embodiments, the playback device plays a periodic calibration signal (or perhaps repeats the same calibration signal so that the playback device records instances of the calibration signal at different points along the path. ) Such a comparison of records may indicate how the acoustic characteristics vary from physical location to environmental location. This affects the calibration settings chosen for the playback device in that environment.

  FIG. 10A shows a graph 1000A that includes a plot 1002A. Plot 1002A represents exemplary vertical motion data in the first instance of the exemplary calibration procedure. As shown, the vertical height of the microphone changes approximately sinusoidally over time. This appears to be consistent with the user moving the microphone up and down during the first instance of the calibration procedure.

  FIG. 10B shows a graph 1000B that includes a plot 1002B. Plot 1002B represents exemplary vertical motion data in the first instance of the exemplary calibration procedure. As shown, the vertical height of the microphone is approximately the same over time. This appears to be consistent with the user keeping the microphone at a constant height during the second instance of the calibration procedure.

  In some examples, the calibration sound emitted by the playback device is periodic. For example, a given playback device may repeatedly emit calibration tones. Each period or repetition of the calibration tone may correspond to a sample representing the response of the listening area from a different location (assuming the microphone is moving). In some examples, the recording device may receive the samples in groups, which may be referred to as a frame. Each frame may correspond to a period or repetition of the calibration tone such that each frame represents the movement of the microphone while a predetermined repetition of the calibration tone was detected by the microphone.

  To illustrate a calibration sound iteration example, FIG. 11 shows an example calibration sound iteration example (eg, period or cycle). This iteration is represented as frame 1100. Frame 1100 includes a sweep signal component 1102 and a noise component 1104. The sweep signal component 1102 is shown as a downward sloping line and represents a sweep signal that falls over a frequency in the calibration range (eg, the range of frequencies at which the playback device is to be calibrated). The noise component 1104 is shown as one region and represents low frequency noise throughout the frame 1100. As shown in the figure, the sweep signal component 1102 and the noise component overlap in the transition frequency range, but this can prevent an unpleasant sound from being caused by a sudden transition between the two components. The calibration sound period 1106 is approximately 3/8 of the sound (eg, within the range of 1/4 to 1/2 second), but this covers the calibration frequency range of a single channel, depending on the implementation. It is time to do. Since the calibration sound in the frame 1100 includes a plurality of components, it may be called a hybrid calibration sound. Hybrid calibration sounds have various advantages in covering a range of calibration frequencies.

  FIG. 12 shows an example of a periodic calibration sound 1200. Five iterations (eg, periods) of the hybrid calibration sound 1100 are represented as frames 1202, 1204, 1206, 1208, and 1210. In each iteration or frame, the periodic calibration sound 1200 covers the calibration frequency range using two components (eg, a noise component and a swept signal component). During a calibration period, the recording device records these calibration frames and responds to movements that occur while frames 1202, 1204, 1206, 1208 and 1210 are emitted by the playback device and detected by the microphone. Each frame of motion data may also be received. In some examples, the recording device may receive these frames of motion data as they are generated by the sensor. Alternatively, the device may receive a sample data stream from a sensor, among other examples, or may receive motion data after a calibration period.

b. Checking the validity of microphone movement during the calibration period In block 804, the implementation 800 includes checking the validity of the movement of the microphone during the calibration period. Checking the validity of the microphone movement may include determining whether sufficient movement of the microphone has occurred during the calibration period while the playback device was emitting a calibration sound. In an example, the processing device may confirm the effectiveness of movement in one or more directions (eg, vertical, horizontal or radial). The processing device may also verify the validity of the movement by determining whether the microphone speed was within threshold limits. Other types of verification of movement effectiveness are also contemplated.

  In order to confirm the validity of the vertical movement by determining that the microphone has experienced sufficient vertical movement, the processing device determines one or more vertical movement parameters representing the movement of the microphone during the calibration period. May be. As noted above, the processing device may identify vertical components of motion data (eg, exemplary motion data represented by plots 1002A and 1002B). Such a component may identify a vertical vibration or possibly a vertical linear movement of the microphone. The processing device can infer a constant (ie, vertical motion parameter) from the identified components. Such parameters may include, among other examples, an average of vertical motion data (eg, root mean square (RMS) value of vertical vibration) or a time average of vertical linear vibration.

  The processing device can determine that sufficient vertical movement of the control device has occurred during the calibration period by determining that the vertical motion parameter exceeds the vertical motion threshold. The vertical motion threshold may be set to a value corresponding to a predetermined amount of vertical motion (ie, motion determined to be sufficient for quality audio calibration data). For example, such a threshold is an average of up and down movement within a few feet (matching a typical arm length of a person) by a microphone over a significant portion of the calibration period (eg, 75% or more). It may be set to match. As another example, the threshold may correspond to a predetermined number of vertical vibrations during the calibration period. In some embodiments, the vertical motion threshold is a feature of vertical motion in the majority of calibration periods. The processing device may also determine such parameters for other dimensions of movement, such as radial or horizontal.

  In operation, motion parameters may be determined and possibly re-determined at one or more points during or after the calibration cycle. For example, the vertical motion parameters may be updated continuously or discretely throughout the calibration period. In some embodiments, the processing device may repeatedly update the parameters upon receipt of one or more additional frames of motion data.

  In some situations, the processing device may not consider all of the calibration periods when determining vertical motion parameters (and / or other parameters that represent motion in other directions). For example, the processing device may check the validity of the vertical motion parameter during the calibration cycle because the user may not immediately start moving the microphone even if the playback device begins to emit a calibration sound. You may start at a certain time (for example, after 1/4 of the calibration period has elapsed). As another example, if the processing device determines that the microphone has sufficiently experienced movement in a given direction at some point during the calibration period, it may not consider further motion data in determining the motion parameters. As a further example, if the processing device determines that the motion cannot be valid during calibration, the processing device may abort the measurement.

  As mentioned earlier, the processing device may determine motion parameters for radial motion, which may be used by the processing device to confirm the effectiveness of the microphone radial motion relative to the playback device. Good. In an example, the processing device may determine a motion parameter that indicates a total or average change in radial distance from the microphone during the calibration period. If this parameter exceeds the threshold, the processing device may determine that sufficient radial movement of the microphone has occurred. As pointed out above, motion data indicative of the radial distance between the microphone and the playback device may be generated by measuring the propagation delay between the playback device and the microphone.

  In some examples, the processing device can confirm the effectiveness of another direction of movement (eg, horizontal movement across the listening area) without necessarily using movement data that directly represents movement in its measurement plane. . For example, the processing device may determine horizontal movement within the listening area of the recording device using movement data indicating vertical and radial movement of the recording device. In some cases, such data can be obtained relatively easily from horizontal motion data. However, calibration with sufficient movement in the horizontal plane across the listening area may be more useful than calibration without such movement.

  In order to determine one or more horizontal motion parameters representing the horizontal movement of the recording device, the processing device includes a first component of motion data indicative of the vertical movement of the control device and one of the control devices. Alternatively, the second component of the motion data indicating radial movement from a plurality of playback devices may be cross-correlated. Given significant motion in two directions, it is unlikely that motion data indicating motion in each direction is closely correlated. However, if there is significant motion in only one direction (or none in any direction), motion data indicating motion in each direction is likely to be closely correlated. Thus, relative correlated vertical and radial movements may indicate relatively little horizontal movement. Conversely, vertical and radial movement without relative correlation may indicate relatively much horizontal movement.

  In order to confirm the effectiveness of horizontal movement by cross-correlation of motion data in other dimensions, the processing device may obtain motion data suitable for cross-correlation. For example, in one example, the processing device may have continuous radial motion measurements over a calibration period (eg, discrete samples indicating each distance between the microphone and the playback device), and continuous motion measurements over the calibration period. A value (eg, a discrete sample that indicates vertical movement) is received. Alternatively, the processing device may receive measurements that overlap over at least a portion of the calibration period.

  In some examples, these measurements may be prepared to facilitate cross-correlation. For example, the measurements may be trimmed to represent the same time period (ie, the same movement but different direction). Furthermore, the measurement values may be up-sampled or down-sampled so that the number of samples in each measurement matches. Also, to further facilitate cross-correlation, the processing device may cause the measurement data set to be around the same value (eg, 0), perhaps by subtracting the average of each data set from all values in that data set. You may concentrate on. Still further, the processing device may normalize the measurement data sets relative to each other by scaling to a specific maximum value (eg, 1) for each data set. In order to account for sensor errors (eg, spikes) and other non-measurement artifacts, the data may be filtered to remove such artifacts. Cross-correlation can be further facilitated by alternative or additional processing.

  After obtaining measurements in two dimensions (eg, vertical and radial), the processing device may cross-correlate the two data sets to determine a correlation constant (ie, a horizontal motion parameter). Cross-correlation is a measure of the similarity of two series (eg, measurements) as a function of delay relative to one other. A relatively high correlation constant indicates that the data set is closely correlated. If the data set is motion data in each direction, a relatively high correlation constant indicates relatively little motion in the third dimension. Conversely, a relatively low correlation constant indicates that there is relatively much movement in the third dimension because there is not enough correlation between the data sets. In order to verify the validity of the horizontal motion, the processing device may determine whether the horizontal motion parameter exceeds a correlation threshold. The correlation threshold may be set to a value that indicates sufficient horizontal movement within the listening environment (eg, horizontal movement over a threshold distance and / or over a threshold duration).

  To show the cross-correlation, FIGS. 13A and 13B show examples of correlation graphs. FIG. 13A includes a plot 1300A showing exemplary highly correlated vertical motion data 1302A and exemplary radial motion data 1304A. In this example, the user performing the calibration process appears to have stood still (or hardly moved) while moving the recording device vertically up and down, and thus the vertical movement of the recording device Closely changing radial displacement occurs.

  FIG. 13B includes a plot 1300B showing exemplary highly correlated vertical motion data 1302B and exemplary radial motion data 1304B. In this example, the user is likely walking around the listening area while moving the recording device up and down, thus creating a more gradual correlation between vertical movement and radial displacement. In this plot, the slope of the motion average of the radial motion data 1304B is directly correlated with the horizontal movement that occurred over the calibration period.

  In some cases, the processing device may receive multiple measurements in one or more dimensions. In one example, multiple playback devices may be subjected to simultaneous calibration that can generate multiple radial measurement data sets (eg, one data set for each playback device for a microphone). The processing device cross-correlates the data in the first measurement plane (eg, vertical plane) and the plurality of data sets in the second measurement plane (eg, radial plane), thereby each of the plurality of data sets. A horizontal motion parameter (eg, a correlation constant) may be determined. To determine whether sufficient horizontal movement has occurred across the listening area, the processing device may compare the horizontal motion parameter to a threshold value, and the processing device may compare the horizontal motion parameter to a horizontal motion correlation threshold value. May be.

  Checking the validity of the microphone movement may include checking the validity of the speed of the microphone during the calibration period. Excessive velocity can interfere with calibration, possibly by creating a Doppler shift in the detected calibration sound, which causes an overlap between each iteration of the calibration tone. To confirm the validity of the speed, the processing device indicates that the motion data indicates that the speed of the control device during the calibration period did not exceed a speed threshold (eg, a specific meter limit / second) You may decide. Furthermore, movements that are too slow can still be an ideal calibration because such slow speeds contribute to insufficient movement and / or can lead to the sample representing the same physical location. Absent.

  For example, as described above, the processing device may receive motion data indicating the acceleration of the microphone during the calibration period. Given that the acceleration indicates movement relative to the environment, the processing device may integrate this acceleration to determine the velocity, which may then be converted to a scalar velocity. However, given that a given sensor is coupled to a microphone, the acceleration detected by such a sensor may not directly indicate movement in the environment. However, such acceleration data may be used to determine the velocity within the listening area.

  In one example, the processing device may receive sensor data that includes multiple data streams indicative of acceleration. For example, the processing device may receive a first data stream indicating user acceleration for the control device and a second data stream indicating gravitational acceleration for the control device. In order to determine user acceleration with respect to gravity, the processing device may determine a product (eg, a dot product) of the first data stream and the second data stream. Such a calculation generates a third data stream indicating user acceleration with respect to gravity. To facilitate the determination of the speed of the microphone during calibration, the processing device may determine an integration of the third data stream to generate a fourth data stream indicative of the three-dimensional speed of the microphone. .

  To confirm the validity of the speed, the processing device may convert the fourth data stream to a speed scalar. Such a conversion may include the processing device calculating each sample size indicative of the three-dimensional velocity of the microphone to generate a fifth data stream indicative of the scalar velocity of the microphone during the calibration period. . The processing device then validates the speed during the calibration cycle by determining that the speed data point does not exceed the speed threshold (or exceeds the duration threshold and does not exceed the speed threshold). May be.

c. Sending a message indicating that the movement of the microphone during the calibration period was valid In block 806 of FIG. 8, the implementation 800 sends a message indicating that the movement of the microphone during the calibration period was valid. Includes steps. For example, the recording device may send a message indicating that the calibration was valid to one or more playback devices being calibrated. Such messages, among other examples, indicate that sufficient movement of the control device has occurred during the calibration period, sufficient vertical movement of the control device has occurred during the calibration period, and during the calibration period. May indicate that sufficient radial movement of the control device has occurred and / or that sufficient movement of the control device has not exceeded the speed threshold.

  After the playback device emits a calibration sound during the calibration interval, the recording of the calibration sound may be analyzed to determine the calibration settings of the playback device. In some embodiments, the recording device may analyze the calibration sound itself. Alternatively, the recording device has more processing power, such as recording (or part thereof) another computing system (probably a personal computer or server (eg, a server involved in providing a cloud computing service)) To a computing system). During analysis, the recording device (or other computing system) may determine a calibration profile for the playback device. When applied to a playback device, such a calibration profile allows the playback device to achieve the desired equalization (eg, flat response), or perhaps the desired equalization (eg, for a given type of music). The acoustic properties of the environment may be supplemented to calibrate to a flat response adjusted by (equalization).

  Examples of some techniques for analyzing such records are described in US patent application Ser. No. 13 / 536,493, filed Jun. 28, 2012, entitled “System and Method for Device Playback Calibration”. , US patent application Ser. No. 14 / 216,306 entitled “Audio Settings Based On Environment” filed Mar. 17, 2014, and “Playback Device Calibration” filed Sep. 9, 2014. No. 14 / 481,511, which is hereby incorporated by reference in its entirety. In some examples, sending a message indicating that sufficient movement of the control device has occurred during the calibration period instructs the playback device to calibrate using the determined calibration profile. It may include sending a message. By sending such a calibration profile, the device may indicate that the calibration was successful (and that the movement used to determine the calibration was valid). In some cases where the validity of the movement has not been confirmed, the calibration may not be sent to the playback device.

  In some cases, a device (eg, a recording device) may indicate the status of motion validation on the graphic interface. FIG. 14 shows an exemplary playback device calibration user interface 1400 that may be displayed on the graphic interface when the validity of the microphone movement is confirmed. As shown, the user interface 1400 is a graphic indicating that the content displayed on the interface 1400 corresponds to one or more playback devices in a living room zone (eg, the living room zone of the media playback system 100). A display 1402 is included.

  The user interface 1400 further includes a graphical display 1410 that can include a message describing the identified error condition and / or suggestions for correcting the error condition. User interface 1400 further includes selectable icons 1406 and 1408. Selectable icon 1406 may be selected to repeat the calibration process again, and selectable icon 1408 may be selected to continue operation of one or more playback devices. As shown, the graphical display 1410 may overlap some or all gray or light colored display versions of the graphical display 604 of the user interface 600 of FIG.

d. Displaying Prompts to Correct Motion Referring back to FIG. 8, at block 808, implementation 800 includes displaying a prompt to correct motion. For example, the recording device may display a prompt to repeat all or part of the calibration. The recording device may also indicate how inadequate the motion and possibly how it can correct the motion (eg, by moving more or different in a given plane). Such prompts, among other examples, indicate that there was not enough movement of the control device during the calibration period, that there was not enough vertical movement of the control device during the calibration period, It may indicate that sufficient radial movement of the control device did not occur during the period and / or that sufficient movement of the control device exceeded the speed threshold.

  FIG. 15 illustrates an example user interface 1500 in a playback device calibration error condition that may be displayed on the graphic interface if the validity of the motion is not confirmed. As shown, the user interface 1500 includes a graphical display 1502 that indicates that the displayed content on the interface 1500 corresponds to one or more playback devices in the living room zone.

  The user interface 1500 further includes a graphical display 1510 that can include a message describing the identified error condition and / or a prompt to correct the error condition. User interface 1500 further includes selectable icons 1506 and 1508. A selectable icon 1506 may be selected to retry the calibration process and a selectable icon 1508 may be selected to end the calibration process. As shown, the graphic display 1510 may overlap some or all gray or light color display versions of the graphic display 604 of the user interface 600 of FIG.

  In one example, each type of movement (eg, movement or speed in various directions) may have a corresponding text message to be provided in the graphical display 1510. For example, if the identified error condition is related to movement in a horizontal plane, the text message example is: “To get a good measurement, always move the device slowly up and down and walk through the room. "Please try again with more movement over the listening area." In another example, if the identified error condition is related to a move that is too fast, the text message example says, “The move was a bit too fast and did not give a good measurement for tuning. Again, try moving at a slower speed this time. "

  The text message examples discussed herein are for illustrative purposes only and are not intended to be limiting. In addition, one of ordinary skill in the art will recognize that other examples are possible.

VI. CONCLUSION This specification discloses various exemplary systems, methods, apparatuses, products, and the like, which include firmware and / or software running on hardware, among other components. It is understood that such examples are illustrative only and should not be considered limiting. For example, some or all of these firmware, hardware, and / or software aspects or components may be exclusively hardware, exclusively software, exclusively firmware, or any of hardware, software, and / or firmware It is intended that combinations can be implemented. Thus, the examples provided are not the only way to implement those systems, methods, devices, and / or products.

  Furthermore, “embodiments” herein indicate that the particular features, structures, or characteristics described in connection with the embodiments may be included in at least one example of the invention. Although this phrase is used in various places throughout the specification, they do not all refer to the same embodiment, nor are they separate or alternative embodiments other than other embodiments. Thus, it is understood that the embodiments described herein may be combined with other embodiments by those skilled in the art, explicitly and implicitly.

  This specification is broadly illustrated with respect to exemplary environments, systems, procedures, steps, logic blocks, processing, and other symbolic representations that operate directly or indirectly on a data processing device connected to a network. It is similar to These process descriptions and representations are generally used by those skilled in the art and can most effectively convey the content of their work to others skilled in the art. Numerous specific details are provided to understand the present disclosure. However, it will be understood by one of ordinary skill in the art that certain embodiments of the present disclosure may be practiced without the specific details. In other instances, well-known methods, procedures, components, and circuits have not been described in detail in order to avoid unnecessarily obscuring the embodiments. Accordingly, the scope of the present disclosure is defined by the appended claims rather than the embodiments described above.

  One or more of the elements in at least one example may be referred to herein as software and / or firmware, when any of the appended claims simply reads to cover implementation in software and / or firmware. Is clearly defined to include a tangible, non-transitory storage medium for storing, for example, memory, DVD, CD, Blu-ray (registered trademark), and the like.

  (Feature 1) A network device including a microphone receives an instruction that one or more playback devices emit a calibration sound in a predetermined environment during a calibration cycle, and records the emitted calibration sound. And receiving movement data indicative of movement of the network device during emission of the calibration sound, from a first component of movement data indicative of vertical movement of the network device, and one or more playback devices of the network device One or more second components of the motion data indicative of each radial movement of the first and second components of the motion data indicative of the vertical movement of the network device and one of the network devices Or one of the motion data indicating each radial movement from a plurality of playback devices Or by cross-correlating with a plurality of second components to determine one or more horizontal motion parameters representative of the horizontal movement of the network device in the environment, and to represent the horizontal movement in the environment. By determining that at least one of the motion parameters exceeds the correlation threshold, it is determined that sufficient horizontal movement of the network device has occurred during the calibration period, and sufficient for the network device during the calibration period. It is configured to send a message indicating that the movement has occurred.

  (Feature 2) The network device according to Feature 1 further determines a vertical motion parameter representing an average of vertical motion data, and determines that the vertical motion parameter exceeds a vertical motion threshold, thereby calibrating the network device. Configured to determine that a sufficient vertical movement of the network device has occurred during the session period.

  (Feature 3) In the network device according to Feature 1 in combination with Feature 2, transmitting a message indicating that sufficient movement of the network device has occurred during the calibration period may be performed during the calibration period. Sending a message indicating that sufficient horizontal movement and sufficient vertical movement have occurred.

  (Feature 4) In the network device according to Feature 1 or Feature 3 combined with Feature 2, determining a vertical motion parameter that represents an average of vertical motion data is a vertical that represents an average of vertical motion data. Including repeatedly updating motion parameters based on motion data accumulated as frames of motion data indicative of network device motion during a calibration period are received.

  (Feature 5) In the network device according to any one of Features 1 to 4, receiving motion data indicating movement of the network device during a calibration cycle includes receiving sensor data indicating acceleration of the network device. Receiving microphone data indicating each radial distance from the one or more playback devices to the network device based on each propagation delay between the one or more playback devices and a microphone coupled to the network device; including.

  (Feature 6) The network device according to any one of Features 1 to 5 further determines each calibration profile for at least one of the one or more playback devices based on the recorded calibration sound. And sending a message indicating that sufficient movement of the network device has occurred during the calibration period calibrates with the determined calibration profile for the at least one playback device Sending a message instructing

  (Feature 7) Each calibration relating to at least one of one or more reproduction devices based on the recorded calibration sound in the network device according to any one of features 1 to 5 combined with feature 6 Determining the profile includes determining each calibration profile that supplements the acoustic characteristics of the predetermined environment to calibrate the playback device to calibration equalization.

  (Feature 8) The network device according to any one of features 1 to 7 is further configured to determine that the speed of the network device during the calibration period has not exceeded the speed threshold, and during the calibration period Sending a message indicating that sufficient movement of the network device has occurred includes sending a message indicating that sufficient movement of the network device has not exceeded the speed threshold.

  (Feature 9) In the network device according to any one of features 1 to 7, combined with feature 8, receiving motion data indicating movement of the network device during a calibration period indicates user acceleration relative to the network device. Receiving sensor data including a first data stream and a second data stream indicative of gravitational acceleration for the network device, and determining that the speed of the network device during the calibration period has not exceeded the speed threshold. Determining a third data stream indicative of user acceleration relative to gravity based on a first data stream indicative of user acceleration relative to the network device and a second data stream indicative of gravity acceleration relative to the network device. Determining a fourth data stream indicative of the speed of the network device during the calibration period by determining a magnitude of integration of the third data stream indicative of user acceleration relative to gravity; Determining that the data stream indicates that the speed of the network device during the calibration period has not exceeded the speed threshold.

  (Feature 10) The method shows the movement of the recording device while the recording device was recording the calibration sound emitted by the one or more playback devices in a predetermined environment during the calibration period. Receiving movement data; determining by the computer apparatus that a sufficient vertical movement of the recording device has occurred during the calibration period; and calculating by the computer apparatus a sufficient horizontal movement of the recording device during the calibration period. Transmitting a message indicating that sufficient vertical and horizontal movement of the recording device has occurred during the calibration period to the one or more playback devices by the computing device. And including.

  (Feature 11) In the method according to Feature 10, the step of determining that sufficient horizontal movement of the recording device has occurred during the calibration period includes the first component of the motion data indicating the vertical movement of the recording device; Identifying one or more second components of the motion data indicative of each radial movement of the recording device from the one or more playback devices, and indicating the vertical movement of the recording device By cross-correlating the first component of the motion data with one or more second components of the motion data indicative of each radial movement from one or more playback devices of the recording device, Determining one or more horizontal motion parameters representing the horizontal movement of the recording device in the horizontal direction and a horizontal movement parameter representing the horizontal movement in the environment. By data of at least one of determined to exceed the correlation threshold includes determining that a sufficient horizontal movement of the recording device occurs during the calibration period, the.

  (Feature 12) In the method according to Feature 10 or 11, the step of determining that a sufficient vertical movement of the recording device has occurred during the calibration period is to determine a vertical motion parameter representing an average of the vertical motion data. And determining that sufficient vertical movement of the recording device has occurred during the calibration period by determining that the vertical motion parameter exceeds a vertical motion threshold.

  (Feature 13) In the method of feature 10 or 11, in combination with feature 12, determining a vertical motion parameter that represents an average of vertical motion data is a vertical motion parameter that represents an average of vertical motion data Updating repeatedly based on motion data accumulated as motion data indicative of movement of the recording device during the calibration period is received.

  (Feature 14) The method according to any of features 10-14, further comprising determining that the speed of the recording device during the calibration period did not exceed the speed threshold, Sending a message indicating that movement has occurred includes sending a message indicating that sufficient movement of the recording device has not exceeded the speed threshold.

  (Feature 15) The method according to any one of features 10 to 13 in combination with feature 14, wherein the recording device emits a calibration sound emitted by one or more playback devices in a predetermined environment during the calibration period. The step of receiving motion data indicative of movement of the recording device during detection comprises a first data stream indicating user acceleration relative to the recording device and a second data stream indicating gravitational acceleration relative to the recording device. Receiving the data and determining that the speed of the recording device during the calibration period did not exceed the speed threshold includes a first data stream indicative of user acceleration for the recording device and a gravitational acceleration for the recording device. Based on a second data stream indicating Determining the third data stream indicative of the user acceleration relative to gravity and determining the magnitude of the integration of the third data stream indicative of the user acceleration relative to gravity to thereby determine the speed of the recording device during the calibration period. And determining that the fourth data stream indicates that the speed of the recording device during the calibration period has not exceeded the speed threshold.

  (Feature 16) The method according to any of features 10-15, comprising determining each calibration profile for at least one of the one or more playback devices based on the recorded calibration sound. And further comprising sending a message indicating that sufficient movement of the recording device has occurred during the calibration period, instructing at least one playback device to calibrate using the determined calibration profile. Sending a message.

  (Feature 17) In the method according to any one of Features 10 to 16, the computer apparatus includes a recording device.

  (Feature 18) The computer-readable medium is configured to perform the method according to any of features 10-17.

  (Feature 19) A non-transitory computer readable medium stores instructions executable by one or more processors, the instructions causing a control device to perform an action, wherein the action is (i ) Receiving an indication that one or more playback devices are emitting a calibration sound in a predetermined environment during the calibration period; and (ii) recording the emitted calibration sound and the calibration sound. Receiving motion data indicative of movement of the control device during emission; (iii) a first component of motion data indicative of vertical movement of the control device; and one or more playback devices of the control device Identifying one or more second components of the motion data indicative of each radial movement of (iv), A first component of motion data indicative of vertical movement of the device and one or more second components of motion data indicative of each radial movement from one or more playback devices of the control device; Determining one or more horizontal motion parameters representative of the horizontal movement of the control device in the environment by cross-correlating; and (v) at least one of the horizontal motion parameters representing the horizontal movement in the environment. Determining that sufficient horizontal movement of the control device has occurred during the calibration period, and (vi) sufficient movement of the control device during the calibration period. Sending a message indicating that it has occurred.

  (Feature 20) In the non-transitory computer-readable medium according to Feature 1, the operations include: (i) determining a vertical motion parameter representing an average of vertical motion data; and (ii) a vertical motion parameter is Determining that sufficient vertical movement of the control device has occurred during the calibration period by determining that the vertical motion threshold has been exceeded.

  (Feature 21) In the non-transitory computer readable medium according to Feature 2, transmitting a message indicating that sufficient movement of the control device has occurred during the calibration period is performed by the control device during the calibration period. Sending a message indicating that sufficient horizontal movement and sufficient vertical movement have occurred.

  (Feature 22) In the non-transitory computer readable medium according to Feature 2, determining the vertical motion parameter representing an average of the vertical motion data may include detecting motion data indicative of motion of the control device during the calibration period. As the frame is received, it includes repeatedly updating a vertical motion parameter representing the average of the vertical motion data based on the accumulated motion data.

  (Feature 23) In the non-transitory computer-readable medium according to Feature 1, receiving motion data indicating movement of the control device during a calibration cycle includes: (i) receiving sensor data indicating acceleration of the control device And (ii) each radial distance from the one or more playback devices to the control device based on each propagation delay between the one or more playback devices and the microphone coupled to the control device. Receiving microphone data.

  (Feature 24) In the non-transitory computer-readable medium according to Feature 1, the operations are performed for each calibration profile for at least one of the one or more playback devices based on the recorded calibration sound. And transmitting a message indicating that sufficient movement of the control device has occurred during the calibration period is performed using the determined calibration profile for the at least one playback device. Sending a message instructing the user to

  (Feature 25) In the non-transitory computer-readable medium according to Feature 6, determining each calibration profile for at least one of the one or more playback devices based on the recorded calibration sound Determining each calibration profile that supplements the acoustic characteristics of the predetermined environment to calibrate the playback device to calibration equalization.

  26. The non-transitory computer readable medium of feature 1, wherein the operation further comprises determining that the speed of the control device during the calibration period has not exceeded the speed threshold, and the calibration period Transmitting a message indicating that sufficient movement of the control device has occurred includes transmitting a message indicating that sufficient movement of the control device has not exceeded the speed threshold.

  (Feature 27) In the non-transitory computer readable medium of feature 8, receiving motion data indicative of movement of the control device during a calibration cycle comprises: a first data stream indicative of user acceleration relative to the control device; Receiving sensor data including a second data stream indicative of gravitational acceleration for the control device and determining that the speed of the control device during the calibration period did not exceed the speed threshold (i ) Determining a third data stream indicative of user acceleration relative to gravity based on a first data stream indicative of user acceleration relative to the control device and a second data stream indicative of gravity acceleration relative to the control device; ii) Third data indicating user acceleration with respect to gravity Determining a fourth data stream indicative of the speed of the control device during the calibration period by determining the magnitude of the stream integral; and (iii) controlling the fourth data stream during the calibration period. Determining that the speed of the device indicates that the speed threshold has not been exceeded.

  (Characteristic 28) The method includes: (i) the recording device while the recording device is recording a calibration sound emitted by one or more playback devices in a predetermined environment during a calibration period. Receiving motion data indicative of movement; (ii) determining by the computer apparatus that a sufficient vertical movement of the recording device has occurred during the calibration period; and (iii) determining the calibration period by the computer apparatus. Determining that sufficient horizontal movement of the recording device has occurred, and (iv) the computer device to the one or more playback devices to ensure that the recording device has sufficient vertical and horizontal orientation during the calibration period. Sending a message indicating that the movement has occurred.

  (Feature 29) In the method according to Feature 10, the step of determining that sufficient horizontal movement of the recording device has occurred during the calibration period comprises: (i) a first motion data indicative of vertical movement of the recording device; And (ii) the recording device's one or more second components of the motion data indicative of each radial movement of the recording device from the one or more playback devices; Cross-correlating a first component of motion data indicative of vertical movement and one or more second components of motion data indicative of each radial movement from one or more playback devices of the recording device Determining one or more horizontal motion parameters representative of the horizontal movement of the recording device in the environment; and (iii) the horizontal direction in the environment By at least one of the horizontal motion parameters determined to exceed the correlation threshold indicating yellow, includes determining that a sufficient horizontal movement of the recording device occurs during the calibration period, the.

  (Feature 30) In the method according to Feature 10, the step of determining that sufficient vertical movement of the recording device has occurred during the calibration period includes: (i) determining a vertical motion parameter representing an average of vertical motion data. And (ii) determining that sufficient vertical movement of the recording device has occurred during the calibration period by determining that the vertical motion parameter exceeds a vertical motion threshold.

  (Feature 31) In the method according to Feature 12, determining a vertical motion parameter representing an average of vertical motion data includes: (i) motion data indicating movement of a recording device during a calibration period is received. As a result, the vertical motion parameter representing the average of the motion data in the vertical direction is repeatedly updated based on the accumulated motion data.

  (Characteristic 32) The method according to Feature 10, further comprising the step of determining that the speed of the recording device during the calibration period has not exceeded the speed threshold, wherein sufficient movement of the recording device has occurred during the calibration period. Sending a message indicating that includes sending a message indicating that sufficient movement of the recording device has not exceeded the speed threshold.

  (Feature 33) The method according to Feature 14, wherein the recording device is moved while the recording device is detecting a calibration sound emitted by one or more playback devices in a predetermined environment during a calibration period. Receiving the motion data indicating includes receiving sensor data including a first data stream indicative of user acceleration for the recording device and a second data stream indicative of gravitational acceleration for the recording device; and calibration Determining that the speed of the recording device during the recording period did not exceed the speed threshold includes: (i) a first data stream indicating user acceleration for the recording device; and a second data stream indicating gravitational acceleration for the recording device; Based on user acceleration with respect to gravity Determining a third data stream; and (ii) determining a third data stream integral indicative of user acceleration with respect to gravity, thereby indicating a fourth recording device speed during the calibration period. And (iii) determining that the fourth data stream indicates that the speed of the recording device during the calibration period has not exceeded the speed threshold.

  (Feature 34) The method of feature 10 further comprises determining each calibration profile for at least one of the one or more playback devices based on the recorded calibration sound; and The step of sending a message indicating that sufficient movement of the recording device has occurred during the calibration period sends a message instructing at least one playback device to calibrate using the determined calibration profile. Including that.

  (Feature 35) In the method according to Feature 10, the computer apparatus includes a recording device.

  (Feature 36) A recording device includes: (i) a microphone; (ii) one or more processors; and (iii) a tangible data storage device that stores instructions executable by the one or more processors. The instruction is for causing the recording device to perform an operation, and the operation includes: (a) an instruction that the playback device emits a calibration sound in a predetermined environment during a calibration cycle. Receiving (b) recording sound data including a calibration sound to be emitted via a microphone, and receiving motion data indicating movement of the recording device during the emission of the calibration sound; ) Determining that sufficient vertical movement of the recording device has occurred during the calibration period; and (d) calibration cycle. The detected calibration based on determining that sufficient horizontal movement of the recording device occurred during (e) sufficient vertical and horizontal movement of the recording device during the calibration period. Applying a calibration based on the sound to the audio stage of the playback device.

  (Feature 37) In the recording device according to Feature 18, determining that sufficient horizontal movement of the recording device has occurred during the calibration period includes: (i) a first step of motion data indicating vertical movement of the recording device; Identifying a first component and a second component of motion data indicative of radial movement of the recording device from the playback device; and (ii) first of motion data indicative of vertical movement of the recording device. A horizontal motion parameter representing the horizontal motion of the recording device in the environment is determined by cross-correlating one component with a second component of motion data indicative of radial movement of the recording device from the playback device. And (iii) carry by determining that the horizontal motion parameter representing the horizontal motion in the environment exceeds the correlation threshold. Includes determining that a sufficient horizontal movement of the recording device occurs during configuration cycle, the.

  (Feature 38) In the recording device according to Feature 18, determining that sufficient vertical movement of the recording device has occurred during the calibration period includes: (i) determining a vertical motion parameter representing an average of motion data in the vertical direction. And (ii) determining that sufficient vertical movement of the recording device has occurred during the calibration period by determining that the vertical motion parameter exceeds a vertical motion threshold.

Claims (16)

A method for a computer device, comprising:
Receiving an indication that one or more playback devices are emitting a calibration sound in a predetermined environment during a calibration cycle;
Recording the emitted calibration sound;
Receiving movement data indicative of movement of the computer device during emission of the calibration sound;
Identifying a first component of the motion data and one or more second components of the motion data;
Wherein the first component of the motion data indicates a vertical movement of the computer device, and the one or more second components of the motion data are the one or more of the computer device. Showing each radial movement from the playback device,
One or more horizontal movements representing a horizontal movement of the computing device in the environment by cross-correlating the first component of the movement data and the one or more second components. Determining a parameter; and sufficient horizontal movement of the computing device during the calibration period by determining that at least one of the horizontal motion parameters representing horizontal motion in the environment exceeds a correlation threshold Determining that has occurred,
Including a method. Receiving, by the computer apparatus, motion data indicating movement of the recording device while the recording device was recording a calibration sound emitted by one or more playback devices in a predetermined environment during a calibration period; ,
Determining by the computer apparatus that a sufficient vertical movement of the recording device has occurred during the calibration period;
Identifying a first component of the motion data and one or more second components of the motion data;
Wherein the first component of the motion data indicates a vertical movement of the recording device, and the one or more second components of the motion data are the one or more of the recording device. Showing each radial movement from the playback device,
One or more representing a horizontal movement of the recording device in the environment by cross-correlating the first component of the motion data and the one or more second components of the motion data Determining a plurality of horizontal motion parameters;
Sufficient horizontal movement of the recording device during the calibration period by the computer apparatus determining that at least one of the horizontal motion parameters representing the horizontal motion in the environment exceeds a correlation threshold; A message indicating that sufficient movement of the recording device has occurred in the vertical and horizontal directions during the calibration period to one or more playback devices by the computing device. Sending step,
Including a method. further,
In response to a determination that sufficient horizontal movement has occurred, sending a message indicating that sufficient movement of the computing device has occurred during the calibration period;
The method of claim 1 . further,
Applying a calibration based on the detected calibration sound to the audio stage of the playback device based on a determination that sufficient vertical and horizontal movement of the recording device has occurred during the calibration period. including,
The method of claim 2 . further,
Determining a vertical motion parameter representative of an average of the motion data in the vertical direction, and determining that the vertical motion parameter exceeds a vertical motion threshold, so that a sufficient vertical of the computing device during the calibration period. Determining that a movement has occurred;
The method according to claim 1 , comprising: The step of transmitting the message indicating that sufficient movement of the computer device has occurred during the calibration cycle is that sufficient horizontal movement and sufficient vertical movement of the computer device have occurred during the calibration cycle. Including sending a message indicating
The method of claim 3. The step of determining the vertical motion parameter representative of the average of the motion data in the vertical direction includes the motion data in the vertical direction as motion data indicative of movement of the computer device during the calibration period is received. Recursively updating the vertical motion parameter representing the average of based on accumulated motion data;
The method of claim 5 . Receiving movement data indicative of movement of the computer device during the calibration period;
Receiving one or more sensor data indicative of acceleration of the computer apparatus, and the one or more reproduction devices based on respective propagation delays between the one or more reproduction devices and a microphone coupled to the computer apparatus; Receiving microphone data indicating each radial distance from the to the computer device;
including,
The method according to claim 1, 3 , 5 , 6 , 7 . Further comprising determining each calibration profile for at least one of the one or more playback devices based on the recorded calibration sound.
The step of transmitting a message indicating that sufficient movement of the computer apparatus has occurred during the calibration period is such that the at least one playback device is calibrated using the determined calibration profile. Including sending a message to order,
The method of claim 3 . Determining each calibration profile for at least one of the one or more playback devices based on the recorded calibration sound so as to calibrate the playback device to calibration equalization Determining each calibration profile to supplement the acoustic characteristics of the predetermined environment;
The method of claim 9. Further comprising determining that the speed of the computing device during the calibration period did not exceed a speed threshold;
Transmitting a message indicating that sufficient movement of the computer device has occurred during the calibration period, transmitting a message indicating that the sufficient movement of the computer device has not exceeded the speed threshold. including,
The method of claim 3. The step of receiving motion data indicative of movement of the computer device during the calibration period comprises: a first data stream indicating user acceleration for the computer device; and a second data stream indicating gravitational acceleration for the computer device; Receiving sensor data including:
Determining that the speed of the computing device during the calibration period did not exceed a speed threshold,
Determining a third data stream indicative of user acceleration relative to gravity based on the first data stream indicative of user acceleration relative to the computer device and the second data stream indicative of gravity acceleration relative to the computer device; ,
Determining a fourth data stream indicative of the speed of the computing device during the calibration period by determining a magnitude of integration of the third data stream indicative of user acceleration with respect to gravity; and Determining that the speed of the computing device during the calibration period has not exceeded the speed threshold;
12. The method of claim 11 comprising:   A computing device comprising one or more processors configured to perform the method of any of claims 1-12. further,
A recording device, and a microphone configured to record the calibration sound emitted;
The computer apparatus of claim 13, comprising at least one of:   A computer readable medium storing instructions for performing the method of any of claims 1-12.   A computer program for causing a processor to execute the method according to any one of claims 1 to 12.

Images