EP2986034A1 - Audio system equalization for portable media playback devices - Google Patents

Audio system equalization for portable media playback devices Download PDF

Info

Publication number
EP2986034A1
EP2986034A1 EP15178118.4A EP15178118A EP2986034A1 EP 2986034 A1 EP2986034 A1 EP 2986034A1 EP 15178118 A EP15178118 A EP 15178118A EP 2986034 A1 EP2986034 A1 EP 2986034A1
Authority
EP
European Patent Office
Prior art keywords
portable media
media device
playback system
listening
playback
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP15178118.4A
Other languages
German (de)
French (fr)
Other versions
EP2986034B1 (en
Inventor
Alan J. Seefeldt
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dolby Laboratories Licensing Corp
Original Assignee
Dolby Laboratories Licensing Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Dolby Laboratories Licensing Corp filed Critical Dolby Laboratories Licensing Corp
Publication of EP2986034A1 publication Critical patent/EP2986034A1/en
Application granted granted Critical
Publication of EP2986034B1 publication Critical patent/EP2986034B1/en
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • H04S7/308Electronic adaptation dependent on speaker or headphone connection
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04SSTEREOPHONIC SYSTEMS 
    • H04S7/00Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30Control circuits for electronic adaptation of the sound field
    • H04S7/301Automatic calibration of stereophonic sound system, e.g. with test microphone

Definitions

  • the present disclosure relates generally to audio signal processing and in particular to audio system equalization for portable media devices.
  • Portable media devices have become an extremely common way for playback of media.
  • Devices that playback digitally stored audio such as iPods ® and mobile phones are used for the playback of both music and audiovisual content.
  • An increasing trend for such devices is their attachment to a wide variety of reproduction devices and systems for playback of the audio.
  • a user might attach her iPod to a home theater system that include speakers, to a TV with speakers, or to a standalone docking station with speakers.
  • a user might attach her iPod to a home theater system that include speakers, to a TV with speakers, or to a standalone docking station with speakers.
  • Each of these is an example of a different playback system to which the same portable device might be attached.
  • equalization filters to be applied to audio signals directly in the portable media device to equalize for the overall system comprising the portable media device and the playback system to which it is attached for an improved listening experience. It further would be advantageous to include in the portable media device sets of equalization filters, each set applicable to a different ones of the playback systems to which the portable device might be attached to equalize for the overall system comprising the portable media device and the playback system to which it is attached. It also would be advantageous to have an end-user operated method of determining, using a portable media device, a set of equalization filters to use in the portable media device with a particular playback system to equalize for the overall system comprising the portable media device and the playback system to which it is attached.
  • Embodiments of the present invention include a method, an apparatus, a system, and logic encoded in a computer-readable storage medium to instruct a processing system to carry out the method.
  • the method includes applying corrective filtering, e.g., equalization filtering directly in a portable media device at least to correct for, e.g., equalize for the overall system comprising the portable media device and the playback system to which it is attached.
  • Some embodiments include a method of operating a portable media device.
  • the method comprises, while the portable media device is coupled to a particular playback system, playing back an audio signal on the portable media device and particular playback system combination in a particular listening arrangement while the portable media device applies a particular set of one or more corrective filters selected from a pre-stored collection of one or more sets of corrective filters or the data therefor.
  • the collection of one or more sets of corrective filters or the data therefor is pre-stored in or for the portable media device.
  • Each of one or more sets of the collection is associated with a corresponding listening arrangement and a corresponding playback system.
  • the particular set of one or more corrective filters is determined by a calibration process that includes: recording on the portable media device a sound field resulting from one or more pre-defined calibration signals being played back on the particular playback system, the recording using a microphone built in or connected to the portable media device while the microphone is at one or more listener locations of the particular listening arrangement, analyzing the recording of the sound field to determine the particular set of one or more corrective filters at least to equalize for the particular playback system, and storing the data for the particular set of one or more corrective filters in or for the portable media device for the particular playback system.
  • Some embodiments include a method of operating a portable media device, comprising recording on the portable media device a sound field resulting from one or more pre-defined calibration signals being played back on a particular playback system, the recording using a microphone built in or connected to the portable media device while the microphone is at one or more listener locations of a particular listening arrangement.
  • the method includes analyzing the recording of the sound field to determine a particular set of one or more corrective filters at least to equalize for the particular playback system, and storing the data for the particular set of one or more corrective filters in or for the portable media device for the particular playback system, such that while the portable media device is coupled to the particular playback system, an audio signal is playable on the portable media device and particular playback system combination in the particular listening arrangement while the portable media device applies the determined particular set of one or more corrective filters.
  • the storing of the data for the particular set of one or more corrective filters is into a pre-stored collection of one or more sets of corrective filters or the data therefor stored in or for the portable media device, each of one or more sets of the collection being associated with a corresponding listening arrangement and a corresponding playback system.
  • Some embodiments include a portable media device that includes a playback subsystem configured to play back a selected audio signal, and a filter subsystem coupled to the playback subsystem and configured to apply a set of one or more corrective filters to an audio signal during playback of the audio signal.
  • the portable media device further includes a coupling configured to couple the portable media device to a matching coupling included in a playback system; a user interface configured to accept input from a user; and a microphone or a coupling to a microphone.
  • the filter subsystem is configured to apply a particular set of one or more corrective filters associated with a particular playback system and particular listening arrangement during playback of an audio signal via the particular playback system when the portable media device is coupled to the particular playback system in the particular listening arrangement.
  • the particular set of one or more corrective filters is part of a collection of one or more sets of corrective filters or the data therefor pre-stored in or for the portable media device, each of one or more sets of the collection being associated with a corresponding listening arrangement and a corresponding playback system.
  • the portable media device is configured to record a sound field resulting from one or more pre-defined calibration signals being played back on the particular playback system, the recording using the microphone in or connected to the portable media device while the microphone is at one or more listener locations of the particular listening arrangement.
  • the portable media device also is configured to analyze the recording of the sound field to determine the particular set of one or more corrective filters at least to equalize for the particular playback system; and store the data for the particular set of one or more corrective filters in or for the portable media device for the particular playback system.
  • Some embodiments include a portable media device that includes: means for playing back an audio signal, means for filtering configured to apply a set of one or more corrective filters to an audio signal during playback of the audio signal by the means for playing back; means for coupling the portable media device to a playback system; means for accepting input from a user; and means for recording a sound field.
  • the means for filtering is configured to apply a particular set of one or more corrective filters associated with a particular playback system and particular listening arrangement during playback of an audio signal via the particular playback system when the portable media device is coupled by the means for coupling to the particular playback system in the particular listening arrangement.
  • the particular set of one or more corrective filters is part of a collection of one or more sets of corrective filters or the data therefor pre-stored in or for the portable media device, each of one or more sets of the collection being associated with a corresponding listening arrangement and a corresponding playback system.
  • Some versions of the portable media device further include: means for analyzing a recording of a sound field resulting from one or more pre-defined calibration signals to determine a set of one or more corrective filters; and means for storing the data for a set of one or more corrective filters.
  • the means for recording is configured to record a sound field resulting from one or more pre-defined calibration signals being played back on the particular playback system at one or more listener locations of the particular listening arrangement, the means for analyzing is configured to analyze the recording of the sound field to determine the particular set of one or more corrective filters at least to equalize for the particular playback system; and the means for storing is configured to store the data for the particular set of one or more corrective filters in or for the portable media device for the particular playback system.
  • Particular embodiments may provide all, some, or none of these aspects, features, or advantages. Particular embodiments may provide one or more other aspects, features, or advantages, one or more of which may be readily apparent to a person skilled in the art from the figures, descriptions, and claims herein.
  • FIGS. 1A and 1B each shows a simplified view of a user 141, a portable media device 121, and a playback system 103 to which the portable media device can be coupled. These are example elements of example embodiments of the invention.
  • FIG. 1A shows the elements in a calibration mode
  • FIG. 1B shows the elements in a playback mode.
  • the portable media device 121 includes a coupling 127 configured to couple the portable media device to a matching coupling included in a playback system, in this case, the playback system 103.
  • the portable media device 121 also includes a user interface 123, typically including a display device and a user input mechanism, such user input mechanism configured to accept commands from the user 141.
  • the portable media device 121 also includes a playback subsystem 128 configured to play back a selected audio signal and a filter subsystem 129 coupled to the playback subsystem and configured to apply a set of one or more corrective filters to an audio signal during playback of the audio signal.
  • the storage subsystem is configured to store data for one or more sets of corrective filters, and apply the data of a particular set to the filter subsystem.
  • the playback system 103 includes at least one loudspeaker 105-two are shown in this example playback system, and a playback module 107 that includes one or more audio amplifiers.
  • FIG. 1B illustrated one aspect of the invention, comprising normal playback of an audio signal from a media file stored in the portable media device 121 while the portable media device 121 is coupled to the playback system 103 via coupling 127 and 113 on the media device 127 and playback system 103, respectively.
  • the user 141 is at a particular listener position.
  • the particular listening environment and locations of the playback system and listener define a listening arrangement.
  • the playing back of the audio signal on the portable media device and particular playback system combination is while the portable media device 121 applies using the filter subsystem 129 a particular set of one or more corrective filters selected for this particular playback system 103 and listening arrangement from a pre-stored collection of one or more sets of corrective filters.
  • the collection of one or more sets of corrective filters e.g., in the form of data for the filters, is pre-stored in or for the portable media device 121 and listening arrangement.
  • Each set of one or more corrective filters of the collection is associated with a corresponding playback system and corresponding listening arrangement.
  • FIG. 1A illustrates another aspect of the invention: a calibration process to determine the particular set of one or more corrective filters at least to equalize for a playback system and listening arrangement, in this example the particular playback system 103.
  • the portable media device 121 either includes built in, or is connectable to at least one microphone 125.
  • the calibration process includes recording on the portable playback device 121 a sound field resulting from at least one pre-defined calibration signal 111 being played back on the particular playback system 103 while the microphone 125 is at one or more desired listener locations of the listening arrangement.
  • the calibration process includes analyzing the recording of the sound field to determine data for the particular set of one or more corrective filters at least to equalize for the particular playback system (and possibly also for the listening environment), and storing the data for the particular set of one or more corrective filters in or for the portable media device 121 for the particular playback system (and listening arrangement). Note that in some embodiments, the calibration process includes make recordings from several locations and the results averaged. Thus there may be more than one desired listening location associated with a listening arrangement.
  • the data for a collection of sets of corrective filters is pre-stored in or for the portable media device, each set of the collection associated with a corresponding playback system and listening arrangement.
  • the devices are identical to The devices.
  • the invention is not limited as to the type of portable media device.
  • the minimum requirements are the ability to play digitally stored audio, having or being able to be connected to one or more microphones, and being able to be coupled to any one of a plurality of playback systems.
  • portable media devices include, but are not limited to audio playback devices such as the Apple IPOD®, Sandisk SANSA®, Creative ZEN VISION®, Microsoft ZUNE®, and other models too numerous to list from other manufacturers.
  • Examples also include, but are not limited to cellular telephones that have audio storage and playback capability, made by virtually every manufacturer of cellular telephones, and so-called "smart" cellular telephones such as the Apple IPHONE, Google NEXUS ONE, and many others too numerous to list. Many of these are able to play back not only digitally stored audio data, but also audiovisual content, such as digitally stored video files that may include digitally stored audio data.
  • the invention also is also not limited to the type of playback system.
  • the minimum requirements are the inclusion of one or more speakers, and the ability to connect to a portable playback device, either directly by being docked thereto, by a wired connection, by a wireless connection, and via a wired or wireless network.
  • the minimum requirements also include the ability to receive at least one signal that includes at least audio content from the portable playback device while connected thereto, and to playback at least the audio of the signal.
  • the minimum requirements also include the ability to playback one or more calibration files, either stored in the playback system, loadable into a storage subsystem in the playback system, or sent to the playback system from an external calibration signal source.
  • Examples of playback systems include, but are not limited to, so called docking speakers designed to include connectors for a specific model or models of portable media devices. For example, Amazon.com, a popular shopping Website in the USA, listed on 16 March 2010 1,953 items for the search "iPod speaker” in the category electronics, and 1,295 items for the search "docking speaker.” Examples of playback systems also include, but are not limited to, home theatre systems that include home theatre receivers, some of which also include connectors for specific model or models of portable media devices, while others include common input connectors such as phono (RCA) connectors and sockets for TRS (tip, ring, sleeve) or TRRS ((tip, ring, ring, sleeve) connectors.
  • RCA phono
  • Examples of playback systems also include, but are not limited to, televisions that include or are connected to loudspeakers. Such televisions commonly include connectors for external audio. Examples also include, but are not limited to, automotive audio systems that in 2010 commonly include connectors for specific model or models of portable media devices, and/or common input connectors such as sockets for a TRS (tip, ring, sleeve) or TRRS ((tip, ring, ring, sleeve) connector.
  • TRS tip, ring, sleeve
  • TRRS ((tip, ring, ring, sleeve) connector.
  • Embodiments of the present invention are particularly useful because a particular portable media device can be connected to more than one playback system.
  • An example portable media device An example portable media device
  • FIG. 2 shows a simplified block diagram of one example embodiment of a portable media device that includes at least one feature of the present invention. It would be clear to one skilled in the art that not all the elements shown in FIG. 2 would be included in all portable media device embodiments, and further, that some portable media device may include additional elements not shown in FIG. 2 .
  • the digital elements of the portable media device 121 include elements that are coupled by a bus subsystem 241, shown purely for the sake of simplicity as a single bus. These digital elements include at least one processor 243, a storage subsystem 245, a user interface 123, at least one digital interface 231 coupled to a main connector 211, and one or more digital-to-analog converters (DACs) to convert digital information such as digitized audio signals to analog audio signals for playback via one or more audio amplifiers in an analog subsystem 225, and one or more analog-to-digital converters (ADCs) to convert an analog audio signal to a digitized analog signal.
  • the DACs and ADCs are shown with their associated interfaces as module 233.
  • the portable media device 121 also includes at least one wireless interface 249 such as, but not limited to, a wireless network interface, a Bluetooth interface, an infrared interface, or the like.
  • a wireless interface is a common Wi-fi IEEE 802.11 wireless network interface.
  • Some embodiments of the portable media device 121 also include a cellular telephone wireless network interface so that the device can act as a cellular telephone.
  • Some embodiments also include other wireless network interfaces such as a Bluetooth interface.
  • the portable media device 121 also includes a battery and associated electronics subsystem 215 coupled in one embodiment to the main connector 211.
  • the analog subsystem 225 is connected to the main connector 211 so that, for example, analog audio signals are available at the main connector 211.
  • the main connector 211 is also coupled to the bus subsystem 241 and the at least one digital interface 231 so that signals are provided to and obtainable from whatever the main connector 211 is connected to.
  • the analog subsystem 225 is coupled to a microphone 125, which in this embodiment is built in. Other embodiments are connectable to a microphone 125.
  • This embodiment also includes at least one loudspeaker 227 connected to the analog subsystem 225.
  • a set of at least one input/output connectors 213 is included so that an external set of loudspeakers, e.g., loudspeakers incorporated in headphones, can be connected and also so that different analog audio signals can be input via the analog subsystem 225.
  • the user interface 123 includes a display screen 261 operative to display information to a user, one or more buttons 264 to accept input from a user, and a keypad/keyboard 263 also to accept input from a user.
  • the display screen 261 includes a touch sensitive surface to accept input from the user, and in some such embodiments, at least some of the buttons 264 are so-called soft buttons in that they are generated by causing a particular area of the display screen 261 to display a button, possibly with a message for the user, and such that the user touching the particular area causes an input that is the same as if a hardware button is displayed.
  • a separate module is shown for keypad/keyboard 263, some or all of these elements may comprise soft buttons on the display screen 261.
  • the storage subsystem 245 includes programs in the form of executable instructions that when executed by the at least one processor 243 cause carrying out of regular functionality of the portable media device 121 and for carrying out aspects of the present invention. Some of the programs 251, for example, provide such functionality when executing as causing displaying and accepting input from buttons 264, including soft buttons displayed in the display screen 261, and in some embodiments, accepting input in the form of multi-touch gestures as are common in 2010.
  • the storage subsystem 245 also is configured to store digital content, shown in FIG. 2 as stored audiovisual (AV) content 253, but which may include only digitally stored audio.
  • the content in the stored content 253 is typically stored as compressed data files, e.g., in the case of audio as AAC or MP3 files, such as audio file 254.
  • the programs 251 also include instructions that when executed cause playback of a digitally stored audio file to form digital signals that are converted to analog form by the DACs in module 233, and amplified by at least one amplifier in the analog subsystem 225.
  • the portable media device 121 includes a playback subsystem configured to play back a selected audio signal.
  • the playback system is made up of elements of the analog subsystem 225, the DACs of module 233, and instructions within the programs 251 in the storage subsystem 245 that when executed cause playback of audio content that forms the selected audio signal.
  • the storage subsystem 245 also is configured to store a plurality of corrective filter profiles, e.g., equalization profiles 257 that include data needed to implement sets of corrective filters.
  • each corrective filter profile 258 of corrective filter profiles collection 257 provides the data needed to implement a particular set of one or more corrective filters for a particular playback system.
  • a corrective filter profile 258 provides the data needed to implement a particular set of one or more corrective filters for a particular playback system, for the sake of simplicity of language, the term (the) corrective filter profile 258 and "(the) data for a (or the) set of one or more corrective filters" will be used synonymously. Having a profile, however, is only one way of implementing a set of one or more corrective filters, hence using the same language is not intended to limit the invention to using a profile.
  • the portable media device 121 includes a filter subsystem coupled to the playback subsystem and configured to apply a set of one or more corrective filters to an audio signal during playback of a selected audio signal.
  • the storage subsystem 245 is made up of several types of storage devices, and include solid state memory and may include magnetic memory, e.g., as a hard disk. Many variations are possible as would be clear to one skilled in the art.
  • Some of the elements of portable media device 121 may be provided as part of a large integrated circuit. The functionality may be divided between more than one device. Furthermore, there may be one or more discrete components. At least one element's functionality may be provided by executing one or more programs on one or more of the at least one processor 243.
  • the one or more processors 243 may include the functionality of a DSP device, e.g., in the form of a DSP portion of an integrated circuit, or in some embodiments, in the form of a separate DSP device.
  • a general purpose processor may be used instead or in addition. Many such variations are possible. Further details on possible architectures of the portable media device 121 are not provided herein in order not to obscure the inventive aspects.
  • FIG. 3 shows a simplified block diagram of one example embodiment of a playback system 103.
  • the portable media device is connectable to more than one playback system.
  • the playback system shown is one example. It would be clear to one skilled in the art that not all the elements shown in FIG. 3 would be included in all playback system embodiments, and further, that some playback systems may include additional elements not shown in FIG. 3 .
  • the playback system of FIG. 3 includes many digital elements, including storage of digital media files, and includes interfaces to connect the playback system to a wireless network and to have a wired network connection. Many playback systems would not have such elements.
  • the playback system includes a coupling (shown as coupling 113 in FIGS. 1A and 1B ) to a portable media device such as media device 121.
  • the coupling 113 is in the form of a main connector 311 configured to connect to a portable media device, e.g., device 121.
  • the main connector 311 includes connections that accept analog audio signals from a connected portable media device.
  • Main connector 311 is connected to an analog subsystem 325 that includes one or more audio amplifiers for playback of the audio signals via a coupled set of one or more loudspeakers 105.
  • a set of at least one input/output connectors 313 is included so that different analog audio signals can be input via the analog subsystem 325.
  • the analog input connector in 313 can act as the coupling (shown as coupling 113 in FIGS. 1A and 1B ) to a portable media device instead of, or in addition to main connector 311.
  • main connector 311 a portable media device
  • some embodiments do not include such an additional input, while other embodiments do not include a main connector configured to accept analog input signals.
  • an output terminal is also included in element 313 so that an external set of loudspeakers, e.g., headphones that include loudspeakers devices can be connected.
  • control of volume, etc. is achieved via a user interface 347 that in this case includes digital elements.
  • a user interface for a playback system may of course also include one or more analog elements, such as analog volume controls.
  • the digital elements of the playback system embodiment 103 include elements that are coupled by a bus subsystem 341, shown purely for the sake of simplicity as a single bus. These digital elements include at least one processor 343, a storage subsystem 345, the user interface 347, at least one digital interface 331 coupled to a main connector 311, and one or more digital-to-analog converters (DACs) to convert digital information such as digitized audio signals from AV content stored in the storage subsystem 345 to analog audio signals for playback on the at least one loudspeaker 105 via the one or more audio amplifiers in analog subsystem 325.
  • the DACs are shown with their associated interfaces as module 333 and coupled to the analog subsystem 325.
  • the playback system 103 also includes at least one wireless interface 349 such as, but not limited to a wireless network interface, a Bluetooth interface, an infrared interface, or the like.
  • a wireless network interface is a common Wi-fi IEEE 802.11 wireless network interface.
  • the wireless network interface enables connection to a network, e.g., a home network which in turn may be connected to an external network, e.g., the Internet.
  • Some embodiments of the playback system 103 also include a Bluetooth interface, and an infrared interface configured to accept commands from a remote control device 315.
  • Some embodiments also include one or more other network interfaces 335 so that the playback system 103 can be connected to a wired network, e.g., a wired home network which in turn may be connected to an external network, e.g., the Internet.
  • a wired network e.g., a wired home network which in turn may be connected to an external network, e.g., the Internet.
  • the main connector is also coupled to a charging circuit 317 configured to supply power to charge a connected portable playback device, and to accept control signals related to the charging.
  • the main connector 311 is also coupled to the bus subsystem bus subsystem 341 and the at least one digital interface 331 so that signals are provided to and obtainable from whatever the main connector 311 is connected to.
  • the storage subsystem 345 includes programs in the form of executable instructions that when executed by the at least one processor 343 cause carrying out of regular functionality of the playback system 103.
  • the storage subsystem 345 is also configured to store digital content, shown in FIG. 3 as stored audiovisual (AV) content 353, but which may include only digitally stored audio.
  • the content in the stored content 353 is typically stored as compressed data files, e.g., in the case of audio as AAC or MP3 files, such as audio file 354.
  • a user interface 347 that is digitally driven is included.
  • the user interface 347 includes a display screen 361 operative to display information to a user, and one or more buttons and knobs 364 to accept input from a user.
  • the display screen 361 includes a touch sensitive surface to accept input from the user, and in some such embodiments, at least some of the buttons or knobs 364 are so-called soft buttons in that they are generated by causing a particular area of the display screen 361 to display a button, possibly with a message for the user, and such that the user touching the particular area causes an input that is the same as if a hardware button is displayed.
  • some of the programs 351 for example, provide such functionality when executing as causing displaying and accepting input from buttons 364, including soft buttons displayed in the display screen 361
  • the storage subsystem 345 is made up of several types of storage devices, and includes solid state memory and may include magnetic memory, e.g., as a hard disk. Many variations are possible as would be clear to one skilled in the art.
  • One aspect of embodiments of the invention is playback of one or more calibration signals by the playback system.
  • the calibration signals may be input, e.g., via an external connector, or via a wireless or wired connection.
  • calibration signals may be pre-stored in digital form in the storage subsystem.
  • the calibration signals may be obtained by connection and then stored in the storage subsystem 355 in digital form for playback. Digitally stored calibration signals are shown as calibration signals 355 in the example embodiment of FIG. 3 .
  • Some of the elements of playback system 103 may be provided as part of a large integrated circuit. The functionality may be divided between more than one device. Furthermore, there may be one or more discrete components. At least one element's functionality may be provided by executing one or more programs on one or more of the at least one processor 343. Many such variations are possible. Further details on possible architectures of the playback system 103 are not provided herein in order not to obscure the inventive aspects.
  • An inventive aspect of embodiments of the present invention is that a single portable media device may be connected to several different playback devices, or even the one device that may be listened to in different locations.
  • a single portable media device may be connected to several different playback devices, or even the one device that may be listened to in different locations.
  • the disclosed invention provides mechanisms and methods for applying corrective filtering, e.g., equalizing each of a variety of playback systems to which a portable media device might be attached by applying the corrective filtering directly in the portable media device.
  • corrective filtering e.g., equalizing each of a variety of playback systems to which a portable media device might be attached by applying the corrective filtering directly in the portable media device.
  • the invention is not limited to any particular type of corrective filtering, and equalization is an example of corrective filtering than can be applied as described herein.
  • Some embodiments include a method of operating a portable media device 121.
  • the method includes playing back an audio signal on the portable media device 121/playback system combination while the portable media device 121 is coupled to a particular playback system 103, and is in a particular listening arrangement.
  • the portable media device applies a particular set of one or more corrective filters selected from a pre-stored collection of data for at least one set of one or more corrective filters.
  • the data for the collection of one or more sets of corrective filters is pre-stored in or for the portable media device 121.
  • the data for each set of the collection is associated with a corresponding playback system (and listening arrangement).
  • the particular set of one or more corrective filters is shown as a profile 258 that includes the data needed to implement the set of filters, e.g., by running one or more programs on at least one of the one of more processors 243.
  • the term listening arrangement may cover one specific location, or may cover a range of listening locations or any listening location for the particular playback system.
  • the corrective filters may be designed for equalizing listening to a playback system having particular loudspeakers 105, and while possible being determined for one specific listener location, may be usable for a range of listening locations.
  • one may make measurements (recording) from a plurality of locations to determine a single averaged correction filter for a range of locations.
  • the term "listening arrangement" should not be taken to imply only a single listening location using the particular playback system, i.e., not applicable to other locations using the particular playback system.
  • a corrective filter determined from one or more recordings from a single location may be used for a range of locations, and secondly, in some calibration method embodiments, one can make measurements from several locations in order to determine a single set of "averages" corrective filters suitable for a range of locations.
  • FIG. 4 shows a simplified flowchart of an embodiment of a calibration method 400.
  • the method 400 includes in 403 playing back one or more pre-defined calibration signals 111 on the particular playback system 103, and , during the playback, in 405, recording on the portable playback device 121 the sound field resulting from one or more pre-defined calibration signals 111 being played back on the particular playback system 103.
  • the recording uses a microphone 125 built in or connected to the portable media device 121 while the microphone 125 is at one or more desired listener locations that are part of the listening arrangement.
  • there may be more than one location associated with a listening arrangement and the recordings may include recordings taken at more than one location.
  • the method includes in 407 analyzing the recording of the sound field to determine the particular set of one or more corrective filters at least to equalize for the particular playback system (and possibly also for the listening environment), and in 409, storing the particular set of one or more corrective filters in or for the portable media device for the particular playback system (and listening environment).
  • the storing is in the portable media device 121.
  • the storing, while possibly temporarily, is on the portable media device 121 is then or later stored remotely, e.g., on a remote storage system on a remote server, for the portable media device 121.
  • the storing being "in or for" the portable media device 121 for the particular playback system 103 (and listening environment).
  • the portable media device 121 includes a user interface that presents a 'calibrate' button in buttons 264, or some other function to enable a user to indicate to carry out the recording, analyzing, and storing of the particular set of one or more corrective filters.
  • the calibration method includes receiving on the user interface an indication from a user to carry out the recording, analyzing, and storing of the particular set of one or more corrective filters, and carrying these steps out in response to such receiving.
  • embodiments of the method provide an extremely easy-to-use, self-contained form factor for calibration.
  • a user can simply hit the 'calibrate' button in buttons 264 and hold the portable media device 121 in a listening position, e.g., in front of the playback system speakers 105.
  • the calibration signals in one embodiment are pre-stored in the portable media device portable media device 121, e.g., as calibration signals 255 in the storage subsystem 245 of the portable media device 121, and loaded into a playback system 103 for storage within the playback system.
  • the portable media device 121 is connected to the playback system by wire or wirelessly from the listening position, and the calibration signal is sent to the playback system 103 and played back while the resulting sound field is recorded for analysis to determined the particular set of one or more corrective filters for the portable media device 121 and playback system combination.
  • the calibration signal or signals are provided for playback on the playback system by some other mechanism, e.g., pre-loaded in the playback system, or provided in real time by another source.
  • the invention is not limited to any particular way of providing the calibration signal(s) to the playback system.
  • the invention is also not limited to the manner any calibration signal is provided to the playback system, e.g., digital form or as an analog signal.
  • FIG. 5 shows a simplified flowchart of a method 500 of operating a portable media device, e.g., device 121 for which or on which is stored the data for a collection of sets of corrective filters, e.g., in the form of the data for implementing the corrective filters, each set associated with a corresponding playback system (and listening arrangement).
  • a portable media device e.g., device 121 for which or on which is stored the data for a collection of sets of corrective filters, e.g., in the form of the data for implementing the corrective filters, each set associated with a corresponding playback system (and listening arrangement).
  • the method includes in 503 connecting the portable media device 121 to the particular playback system 103 in a particular listening environment.
  • the method further includes in 505 selecting (manually or automatically) the pre-stored particular set of one or more corrective filters at least to equalize for the particular playback system 103 (and possibly also for the listening environment).
  • 505 includes loading at least the selected particular set of one or more corrective filters. This might occur separately, and at a different time from the selecting.
  • 507 includes playing back an audio signal on the portable media device 121 while the portable media device 121 is connected to the particular playback system 103. The playing back includes applying the particular set of one or more corrective filters.
  • the portable media device includes a user interface 123 that includes, e.g., as buttons 264, indication to the user of one or more pre-stored sets of corrective filters.
  • the method includes the media portable device 121 receiving, e.g., via the user interface 123, an indication from a user to use a particular set of one or more corrective filters for playback.
  • Some embodiments provide for automatic selection of the set of one or more corrective filters.
  • the playback system may be configured to provide an indication to an attached portable media device, e.g., providing signals via the main connector that are indicative of the type and/or model of playback device.
  • the method 500 includes the portable media device receiving an indication from the particular playback system indicating that particular portable media device is coupled to the particular playback system.
  • Some embodiments of the portable media device are configured such that, responsive to the indication, the method includes automatically selecting the particular set of one or more corrective filters associated with the particular portable media device for playback.
  • some embodiments of the portable media devices have pre-defined sets of corrective filters that are pre-defined for particular classes of playback systems. For example, simple "docking speakers" playback systems may form a class, television receivers may form a class, home stereo receivers with connected speakers may form a class, home receivers with a connected subwoofer may form a class, automotive playback systems in an automobile may form a class, and so forth.
  • at least one of the sets of corrective filters is a default set predefined for a class of playback systems.
  • the invention is not limited to any particular type of corrective filters or how such corrective filters are implemented or specified.
  • portable media devices may have enough processing power to implement more sophisticated correcting filters than a set of multi-band equalizing filters.
  • Some possible types of corrective filters are described below. These are provided as examples only and not to limit the invention to any particular types of corrective filters.
  • Some embodiments of the set of one or more corrective filters include a set of multi-band equalizing filters.
  • the frequency range of listening is partitioned into a set of frequency bands, and each filter of the set of multi-band equalizing filters sets a relative gain for one of the frequency bands.
  • Such multi-band equalizing filters are well known in the art.
  • the number of frequency bands for any particular portable media device can be fixed, or settable, and is typically a relatively small number, e.g., 6, 9, or 12.
  • There are many ways of implementing such filters and one embodiment uses digital signal processing methods implemented by a program in programs 251 executing on the processor 243, e.g., on a DSP element.
  • applying the particular set of one or more corrective filters when the portable media device is coupled to a particular playback system includes digitally processing digital signals on at least one of the one or more processors of the portable media device.
  • the multi-band equalizing filters are implanted as a set of digital parametric filters at respective frequency bands.
  • Such parametric filters are defined by a set of parameters.
  • each set of parameters is stored as a corrective filter profile 258 of corrective filter profiles collection 257 and is usable to implement a particular set of one or more corrective filters for a particular playback system.
  • playback circuitry in the portable media device 121 implements a variable set of gain controls according to respective gain parameters for a pre-defined number of frequency bands.
  • a set of gain settings is stored as a corrective filter profile 258 of corrective filter profiles collection 257 and is usable to implement a particular set of one or more corrective filters for a particular playback system.
  • More sophisticated corrective filters are applicable to playback via a playback system that includes more than two loudspeakers, e.g., a playback system that provides surround sound as is common today in home theater receivers.
  • the correcting filters for such playback systems can include more sophisticated settings that provide relative gains to the signals generated by the portable media device 121 for the different loudspeakers 105 in the playback system.
  • a time sampled audio signal denoted is pre-processed to generate a time-varying spectrum indicating a signal level within a plurality of frequency bands (critical bands), e.g., 40 bands, each denoted by a band number, and varying over time blocks.
  • the time-varying spectrum of the audio signal may be generated in a number of ways, but advantageously the bands are spaced to simulate the frequency resolution of human hearing.
  • a quantity called an excitation signal is computed that approximates the distribution of energy along the basilar membrane of the inner ear of a human at a critical frequency band during a time block.
  • the perceptual domain excitation may be achieved efficiently by computing a running Short-Time Discrete Fourier Transform (STDFT) of the audio signal using the frequency response of a filter simulating the transmission of audio through the outer and inner ear of a human and a selected set of bandpass filters, e.g., bandpass filters chosen to mimic the critical band filtering observed along the basilar membrane in the human ear at each critical frequency band of interest.
  • STDFT Short-Time Discrete Fourier Transform
  • Example embodiments use a set of filters with a spacing of 1 ERB, resulting in a total of 40 bands.
  • audio playback may be perceptibly distorted, and often acutely distorted, as playback level is increased during playback, this distortion is oftentimes frequency dependent for a playback device.
  • One form of corrective filtering is applying multi-band compression to the audio signal prior to playback to reduce distortion and attempt to maximize playback level.
  • One simple method includes specifying a distortion threshold is specified for each frequency band of the compressor. The compressor independently applies differing gain values to each frequency band to ensure an output signal does not exceed any of the corresponding distortion thresholds.
  • An improved set of corrective filters includes timbre preservation in a multi-band compressor. Timbre preservation is achieved by determining a time-varying threshold in each of a plurality frequency bands as a function of (i) a respective fixed threshold for the frequency band and, at least in part, (ii) an audio signal level (whether digital or analog audio signal) in a second frequency band and (iii) a fixed threshold in the second frequency band. Consequently, each time-varying threshold is input signal adaptive. If a particular frequency band receives significant gain reduction due to being above its fixed threshold (or alternatively, approaching the fixed threshold), then a time-varying threshold of one or more other frequency bands are also decreased to receive some gain reduction.
  • One example embodiment of applying such timbre preserving multi-band compressor corrective filtering includes providing or determining a fixed threshold for a first frequency band, and determining a first level of an audio signal within the first frequency band.
  • the first level can be less than the fixed threshold.
  • the method further includes determining a second level of the audio signal for a second frequency band is also determined, and computing a time-varying threshold for the first frequency band using the second level.
  • the time-varying threshold us less than the fixed threshold.
  • the method includes attenuating the audio signal within the first frequency band to be equal to or less than the time-varying threshold or, alternatively, increasingly attenuating the audio signal within the first frequency band as approaching the time-varying threshold.
  • the time-varying threshold can be computed from an average difference of the audio input signal in each frequency band and its respective fixed threshold.
  • a second fixed threshold for the second frequency band can be further determined.
  • the second level of the audio signal can exceed the second fixed threshold, resulting in attenuation of the audio signal within the second frequency band to the second fixed threshold.
  • a set of corrective filters to implement such a method includes a multi-band filterbank, compression function elements, and at least one timbre preservation element.
  • Each compression function element can be dedicated to a frequency band.
  • the timbre preservation element is coupled to the multi-band filterbank and the compression function elements.
  • the timbre preservation element receives a fixed threshold for each frequency band and provides a time-varying threshold for each frequency band.
  • the time-varying threshold for a frequency band is partially determined by a level of the audio signal outside the frequency band.
  • Another form of corrective filtering applies an inverse filter to alter the playback system's loudspeaker's frequency response in an effort to match the inverse-filtered loudspeaker output to a target frequency response.
  • the methods are applied to "critical frequency bands"-frequency bands of a full frequency range that are determined in accordance with perceptually motivated considerations.
  • critical frequency bands that partition an audible frequency range have width that increases with frequency across the audible frequency range.
  • the methods use "critically banded" data, implying that that the full frequency range includes critical frequency bands, and that the data comprises subsets, each of the subsets consisting of data indicative of audio content in a different one of the critical frequency bands.
  • the target frequency response may be flat or may have some other predetermined shape.
  • the calibration method includes determining an inverse filter for a loudspeaker of the playback system.
  • the calibration includes measuring the impulse response of the loudspeaker at each of a number of different spatial locations in the listening arrangement, time-aligning and averaging the measured impulse responses to determine an averaged impulse response, and using critical frequency band smoothing to determine the inverse filter from the averaged impulse response and a target frequency response.
  • critical frequency band smoothing may be applied to the averaged impulse response and optionally also to the target frequency response during determination of the inverse filter, or may be applied to determine the target frequency response.
  • Measurement of the impulse response at multiple spatial locations can ensure that the speaker's frequency response is determined for a variety of listening locations.
  • the time-aligning of the measured impulse responses is performed using real cepstrum and minimum phase reconstruction techniques.
  • the averaged impulse response is converted to the frequency domain via the discrete Fourier transform (DFT) or another time domain-to-frequency domain transform.
  • DFT discrete Fourier transform
  • the resulting frequency components are indicative of the measured averaged impulse response.
  • These frequency components, in each of the transform bins are combined into frequency domain data in a smaller number of critical frequency bands, e.g., 20 bands or 40 bands, as for other perceptual domain processing.
  • the banding of the averaged impulse response data into critically banded data is designed to mimics the frequency resolution of the human auditory system.
  • the banding is typically performed by weighting the frequency components in the transform frequency bins by applying appropriate critical banding filters thereto and generating a frequency component for each of the critical frequency bands by summing the weighted data for the band.
  • these filters typically exhibit an approximately rounded exponential shape and are spaced uniformly on the Equivalent Rectangular Bandwidth (ERB) scale.
  • ERP Equivalent Rectangular Bandwidth
  • the spacing and overlap in frequency of the critical frequency bands provide a degree of regularization of the measured impulse response that is commensurate with the capabilities of the human auditory system.
  • Application of the critical band filters is an example of critical band smoothing (the critical band filters typically smooth out irregularities of the impulse response that are not perceptually relevant so that the determined inverse filter does not need to spend resources correcting these details).
  • Values for determining the inverse filter are determined from the target response and averaged impulse response, e.g., from smoothed versions thereof, in frequency windows, e.g., critical frequency bands.
  • the critically banded impulse response data are used to find an inverse filter which achieves a desired target response.
  • the inverse filter in order to maintain equal loudness when using the inverse filter, is preferably normalized against a reference signal, e.g., pink noise, whose spectrum is representative of common sounds.
  • inverse filter coefficients are directly calculated in the time domain.
  • the resulting inverse filter forms the set of corrective filters applied to the signal in the playback system as described herein.
  • the set of parameters for implementing a set of one or more corrective filters is stored on or for the portable media device 121 as part of a collection of sets.
  • the collection is stored in the form of a database.
  • Each entry is a set of parameters for implementing a set of one or more corrective filters for a particular playback system, and includes an indicator that the particular set of one or more corrective filters is associated with the particular playback system.
  • step 409 of FIG. 4 for such embodiments includes storing an indicator that the particular set of one or more corrective filters is associated with the particular playback system.
  • the data for the collection of one or more sets of corrective filters is stored in a storage subsystem included in the portable media device.
  • the storage subsystem 245 includes corrective filter profiles 257, and one such profile 258 is shown.
  • the data for the collection of one or more sets of corrective filters is stored remotely from the portable media device.
  • FIG. 6 shows a simplified block diagram of one arrangement according to some embodiments of the invention that include remote storage of the data for the collection of one or more sets of corrective filters.
  • the storing initially may be temporarily in the storage device in the portable media device 121, and then stored remotely, e.g., stored remotely when the portable media device is connected to a personal computer 623 which is coupled to a network 625, which can be any private or public network, even the Internet.
  • a server system 627 is also connected to the network 625.
  • the server system 627 includes one or more processors and a storage subsystem 645.
  • the storage subsystem 645 is configured to store the data for one of more collections of sets of corrective filters, each such collection being associated with a particular portable media device 121 or a particular user or both a particular user and portable media device.
  • the data for one collection 657 of one or more sets of corrective filters is shown.
  • the data for one set 658 is shown.
  • the data of the collections is in some embodiments in the form of a database.
  • the data for each set of one or more corrective filters is stored in the database as an entry we call a corrective filter profile that includes the parameters needed to implement the corrective filters.
  • the particular sets of correction filter in temporary storage in the portable media device 121 is sent for storage in the storage subsystem 645 of the server 627.
  • one or more sets of corrective filters stored in the storage subsystem 645 e.g., as corrective filter profiles, can be loaded into the portable media device 121 for use in playback.
  • a particular set of correction filters for a particular playback system can be loaded from remote storage to the portable media device 121 for use in playback while the portable media device is coupled to the particular playback system.
  • Process action 405 includes recording on the portable media device 121 the sound field resulting from playback on the playback system 103 of the calibration signal.
  • Process action 407 includes analyzing the recording to determine the particular set of one or more corrective filters at least to equalize for the particular playback system (and possibly also for the listening environment).
  • the calibration signal is made up of a sum of distinct frequency tones of known amplitudes at a pre-defined number of distinct frequencies.
  • the center frequencies are the center frequencies of the corrective filters used in the portable media device 121.
  • the center frequencies of graphic equalizers are often distributed logarithmically, e.g., in octaves. In some embodiment, the center frequencies of the components of the test signal are therefore also spread logarithmically.
  • the amplitudes of the distinct frequency components of the test signal are equal, while in other embodiments, the amplitudes vary according to the inverse of the frequency.
  • the analysis process 407 includes determining the amplitudes at the distinct frequencies of the recorded recording in order to determine the gains at the frequencies that would cause equalize the response.
  • the gains at the center frequency forms the data of the particular set of one or more corrective filters, e.g., the corrective filter profile stored for or in the portable media device 121 for the particular playback system and listening environment.
  • the calibration signal is a white noise signal, i.e., a noise signal that has the same distribution of power for all frequencies.
  • the calibration signal is a pink noise signal, i.e., a noise signal that has a distribution of power that is proportional to the reciprocal of the frequency.
  • the noise signal is generated using digital synthesis methods that use pseudorandom noise.
  • the analysis 407 includes determining the spectrum of the recorded sound field, e.g., by carrying out a discrete Fourier transform (DFT), e.g., carried out as a fast Fourier transform (FFT), using method well known to those skilled in the art.
  • DFT discrete Fourier transform
  • FFT fast Fourier transform
  • the data are determined and stored for the particular set of one or more corrective filters that modify the determined spectrum of the recorded sound field to match the target reference spectrum for the particular playback system and listening environment.
  • the recorded signal is divided into frequency bands, e.g., by a set of bandpass filters, and level measurement circuitry is used to determine signals indicative of the signal powers in the frequency bands. These data values may then be digitized, and a set of gains for the frequency bands determined as the data to store for the set of one or more corrective filters for the particular playback system and listening environment.
  • calibration signals are played back on a playback system.
  • the resulting sound field is recorded on a portable media device.
  • the recorded sound field is analyzed and a set of one or more corrective filters for the playback system is computed.
  • Data for the set of one or more corrective filters is stored on or for portable media device and associated with said playback system.
  • the stored data for a particular set can then be recalled and the particular set of one or more corrective filters applied to any audio being played from the portable media device when it is attached to the corresponding playback system.
  • embodiments of the invention include applying the equalization in the portable media device, such embodiments provide the benefits of room equalization to audio playback systems which do not contain such a feature. Also, when the portable media device contains its own microphone, some embodiments of invention provide an extremely easy-to-use, self-contained form factor for calibration. A user simply hits a calibrate button and holds the portable media device in a listening location in front of the playback system's loudspeakers.
  • wireless and its derivatives may be used to describe circuits, devices, systems, methods, techniques, communications channels, etc., that may communicate data through the use of modulated electromagnetic radiation through a non-solid medium.
  • processor may refer to any device or portion of a device that processes electronic data, e.g., from registers and/or memory to transform that electronic data into other electronic data that, e.g., may be stored in registers and/or memory.
  • a "computer” or a “computing machine” or a “computing platform” may include one or more processors.
  • a computer-readable storage medium is configured with, e.g., encoded with instructions stored therein that when executed by one or more processors of a processing system such as a digital signal processing device or subsystem that includes at least one processor element and a storage subsystem, cause carrying out a method as described herein.
  • the methodologies described herein are, in some embodiments, performable by one or more processors that accept logic, instructions encoded on one or more computer-readable media. When executed by one or more of the processors, the instructions cause carrying out at least one of the methods described herein. Any processor capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken are included. Thus, one example is a typical processing system that includes one or more processors. Each processor may include one or more of a CPU or similar element, a graphics processing unit (GPU), and/or a programmable DSP unit.
  • GPU graphics processing unit
  • the processing system further includes a storage subsystem with at least one storage medium, which may include memory embedded in a semiconductor device, or a separate memory subsystem including main RAM and/or a static RAM, and/or ROM, and also cache memory.
  • the storage subsystem may further include one or more other storage devices, such as magnetic and/or optical and/or further solid state storage devices.
  • a bus subsystem may be included for communicating between the components.
  • the processing system further may be a distributed processing system with processors coupled by a network, e.g., via network interface devices or wireless network interface devices.
  • the processing system requires a display, such a display may be included, e.g., a liquid crystal display (LCD), organic light emitting display (OLED), or a cathode ray tube (CRT) display.
  • a display e.g., a liquid crystal display (LCD), organic light emitting display (OLED), or a cathode ray tube (CRT) display.
  • the processing system also includes an input device such as one or more of an alphanumeric input unit such as a keyboard, a pointing control device such as a mouse, and so forth.
  • the term storage device, storage subsystem, or memory unit as used herein, if clear from the context and unless explicitly stated otherwise, also encompasses a storage system such as a disk drive unit.
  • the processing system in some configurations may include a sound output device, and a network interface device.
  • the storage subsystem thus includes a computer-readable storage medium that is configured with, e.g., encoded with instructions, e.g., logic, e.g., software that when executed by one or more processors, causes carrying out one of more of the method steps described herein.
  • the software may reside in a hard disk, or may also reside, completely or at least partially, within the RAM and/or within the processor during execution thereof by the computer system.
  • the memory and the processor also constitute a computer-readable medium on which are encoded instructions.
  • a computer-readable storage medium may form a computer program product, or be included in a computer program product.
  • the one or more processors operate as a standalone device or may be connected, e.g., networked to other processor(s), in a networked deployment, wherein the one or more processors may operate in the capacity of a server or of a client machine in server-client network environment, or as a peer machine in a peer-to-peer or distributed network environment.
  • the term processing system encompasses all such possibilities, unless explicitly excluded herein.
  • the one or more processors may form a personal computer (PC), a portable media device, a media playback system, a tablet PC, a set-top box (STB), a Personal Digital Assistant (PDA), a game machine, a cellular telephone, a Web appliance, a network router, a switch or a bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine.
  • PC personal computer
  • PDA Personal Digital Assistant
  • each of the methods described herein is in the form of a computer-readable storage medium configured with a set of instructions, e.g., a computer program that when executed on one or more processors, e.g., one or more processors that are part of a portable media device, cause carrying out of method steps.
  • Some embodiments are in the form of the logic itself.
  • embodiments of the present invention may be embodied as a method, an apparatus such as a special purpose apparatus, an apparatus such as a data processing system, logic, e.g., embodied in a computer-readable storage medium, or a computer-readable storage medium that is encoded with instructions, e.g., a computer-readable storage medium configured as a computer program product.
  • the computer-readable medium is configured with a set of instructions that when executed by one or more processors cause carrying out method steps. Accordingly, aspects of the present invention may take the form of a method, an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects.
  • the present invention may take the form of program logic, e.g., in a computer readable medium, e.g., a computer program on a computer-readable storage medium, or the computer readable medium configured with computer-readable program code, e.g., a computer program product.
  • While the computer readable medium is shown in an example embodiment to be a single medium, the term "medium" should be taken to include a single medium or multiple media (e.g., several memories, a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions.
  • a computer readable medium may take many forms, including but not limited to non-volatile media and volatile media.
  • Non-volatile media includes, for example, optical, magnetic disks, and magneto-optical disks.
  • Volatile media includes dynamic memory, such as main memory.
  • embodiments of the present invention are not limited to any particular implementation or programming technique and that the invention may be implemented using any appropriate techniques for implementing the functionality described herein. Furthermore, embodiments are not limited to any particular programming language or operating system.
  • an element described herein of an apparatus embodiment is an example of a means for carrying out the function performed by the element for the purpose of carrying out the invention.
  • any one of the terms comprising, comprised of or which comprises is an open term that means including at least the elements/features that follow, but not excluding others.
  • the term comprising, when used in the claims should not be interpreted as being limitative to the means or elements or steps listed thereafter.
  • the scope of the expression a device comprising A and B should not be limited to devices consisting of only elements A and B.
  • Any one of the terms including or which includes or that includes as used herein is also an open term that also means including at least the elements/features that follow the term, but not excluding others. Thus, including is synonymous with and means comprising.
  • Coupled should not be interpreted as being limitative to direct connections only.
  • the terms “coupled” and “connected,” along with their derivatives, may be used. It should be understood that these terms are not intended as synonyms for each other.
  • the scope of the expression a device A coupled to a device B should not be limited to devices or systems wherein an output of device A is directly connected to an input of device B. It means that there exists a path between an output of A and an input of B which may be a path including other devices or means.
  • Coupled may mean that two or more elements are either in direct physical or electrical contact, or that two or more elements are not in direct contact with each other but yet still co-operate or interact with each other.
  • EEEs Some enumerated example embodiments (EEEs) follow:

Abstract

A method, an apparatus, a system, and logic encoded in a computer-readable storage medium to instruct a processing system to carry out the method. The method includes applying corrective filters directly in a portable media device to correct, e.g., equalize for the overall system comprising the portable media device and the playback system to which it is attached. Also a method of determining the corrective filters by playing back one or more calibration signals on the playback system while recording the resulting sound field on the portable media device.

Description

    CROSS REFERENCE TO RELATED PATENT APPLICATIONS
  • This application claims benefit of priority to U.S. Provisional Patent Application No. 332,159 filed 6 May 2010 hereby incorporated by reference in its entirety.
  • FIELD OF THE INVENTION
  • The present disclosure relates generally to audio signal processing and in particular to audio system equalization for portable media devices.
  • BACKGROUND
  • Portable media devices have become an extremely common way for playback of media. Devices that playback digitally stored audio, such as iPods ® and mobile phones are used for the playback of both music and audiovisual content. An increasing trend for such devices is their attachment to a wide variety of reproduction devices and systems for playback of the audio. For example, a user might attach her iPod to a home theater system that include speakers, to a TV with speakers, or to a standalone docking station with speakers. Each of these is an example of a different playback system to which the same portable device might be attached.
  • Even though portable playback devices for digitally stored audio have been available for more than a decade, and portable devices for playback of digitally stored audio on disk or tape have been around for decades, there still is a need for equalization of playback of audio from such devices when connected to one of a set of possible playback systems. As examples of how long such devices have been commercially available, the RIO ® portable playback device by Diamond Multimedia, of California, was introduced in 1998 for MP3 playback. The PJB-100 Personal Jukebox by HanGo Electronics Co., Ltd. of South Korea is generally acknowledged to be the first hard-drive based device and was commercially introduced in 1999. The Apple IPOD was introduced in 2001. Each of these devices included a digital processor in order to decompress and render the digitally stored compressed audio.
  • It would be advantageous to include in a portable media device equalization filters to be applied to audio signals directly in the portable media device to equalize for the overall system comprising the portable media device and the playback system to which it is attached for an improved listening experience. It further would be advantageous to include in the portable media device sets of equalization filters, each set applicable to a different ones of the playback systems to which the portable device might be attached to equalize for the overall system comprising the portable media device and the playback system to which it is attached. It also would be advantageous to have an end-user operated method of determining, using a portable media device, a set of equalization filters to use in the portable media device with a particular playback system to equalize for the overall system comprising the portable media device and the playback system to which it is attached.
  • BRIEF DESCRIPTION OF THE DRAWINGS
    • FIGS. 1A and 1B each show a simplified view of a user, a portable media device, and a playback system to which the portable media device can be coupled, with FIG. 1A showing the elements in a calibration mode, and FIG. 1B showing the elements in a playback mode.
    • FIG. 2 shows a simplified block diagram of one example embodiment of a portable media device that includes at least one feature of the present invention.
    • FIG. 3 shows a simplified block diagram of one example embodiment of a playback system to which a portable media device is connectable, and when so connected is used in carry out a feature of the repent invention.
    • FIG. 4 shows a simplified flowchart of an embodiment of a calibration method.
    • FIG. 5 shows a simplified flowchart of a method of operating a portable media device for which or on which is stored the data for a collection of sets of corrective filters.
    • FIG. 6 shows a simplified block diagram of one arrangement according to some embodiments of the invention that include remote storage of the data for the collection of one or more sets of corrective filters.
    DESCRIPTION OF EXAMPLE EMBODIMENTS Overview
  • Embodiments of the present invention include a method, an apparatus, a system, and logic encoded in a computer-readable storage medium to instruct a processing system to carry out the method. The method includes applying corrective filtering, e.g., equalization filtering directly in a portable media device at least to correct for, e.g., equalize for the overall system comprising the portable media device and the playback system to which it is attached.
  • Some embodiments include a method of operating a portable media device. The method comprises, while the portable media device is coupled to a particular playback system, playing back an audio signal on the portable media device and particular playback system combination in a particular listening arrangement while the portable media device applies a particular set of one or more corrective filters selected from a pre-stored collection of one or more sets of corrective filters or the data therefor. The collection of one or more sets of corrective filters or the data therefor is pre-stored in or for the portable media device. Each of one or more sets of the collection is associated with a corresponding listening arrangement and a corresponding playback system. The particular set of one or more corrective filters is determined by a calibration process that includes: recording on the portable media device a sound field resulting from one or more pre-defined calibration signals being played back on the particular playback system, the recording using a microphone built in or connected to the portable media device while the microphone is at one or more listener locations of the particular listening arrangement, analyzing the recording of the sound field to determine the particular set of one or more corrective filters at least to equalize for the particular playback system, and storing the data for the particular set of one or more corrective filters in or for the portable media device for the particular playback system.
  • Some embodiments include a method of operating a portable media device, comprising recording on the portable media device a sound field resulting from one or more pre-defined calibration signals being played back on a particular playback system, the recording using a microphone built in or connected to the portable media device while the microphone is at one or more listener locations of a particular listening arrangement. The method includes analyzing the recording of the sound field to determine a particular set of one or more corrective filters at least to equalize for the particular playback system, and storing the data for the particular set of one or more corrective filters in or for the portable media device for the particular playback system, such that while the portable media device is coupled to the particular playback system, an audio signal is playable on the portable media device and particular playback system combination in the particular listening arrangement while the portable media device applies the determined particular set of one or more corrective filters.
  • In some versions, the storing of the data for the particular set of one or more corrective filters is into a pre-stored collection of one or more sets of corrective filters or the data therefor stored in or for the portable media device, each of one or more sets of the collection being associated with a corresponding listening arrangement and a corresponding playback system.
  • Some embodiments include a portable media device that includes a playback subsystem configured to play back a selected audio signal, and a filter subsystem coupled to the playback subsystem and configured to apply a set of one or more corrective filters to an audio signal during playback of the audio signal. The portable media device further includes a coupling configured to couple the portable media device to a matching coupling included in a playback system; a user interface configured to accept input from a user; and a microphone or a coupling to a microphone. The filter subsystem is configured to apply a particular set of one or more corrective filters associated with a particular playback system and particular listening arrangement during playback of an audio signal via the particular playback system when the portable media device is coupled to the particular playback system in the particular listening arrangement. The particular set of one or more corrective filters is part of a collection of one or more sets of corrective filters or the data therefor pre-stored in or for the portable media device, each of one or more sets of the collection being associated with a corresponding listening arrangement and a corresponding playback system. In some versions, the portable media device is configured to record a sound field resulting from one or more pre-defined calibration signals being played back on the particular playback system, the recording using the microphone in or connected to the portable media device while the microphone is at one or more listener locations of the particular listening arrangement. In such some versions, the portable media device also is configured to analyze the recording of the sound field to determine the particular set of one or more corrective filters at least to equalize for the particular playback system; and store the data for the particular set of one or more corrective filters in or for the portable media device for the particular playback system.
  • Some embodiments include a portable media device that includes: means for playing back an audio signal, means for filtering configured to apply a set of one or more corrective filters to an audio signal during playback of the audio signal by the means for playing back; means for coupling the portable media device to a playback system; means for accepting input from a user; and means for recording a sound field. The means for filtering is configured to apply a particular set of one or more corrective filters associated with a particular playback system and particular listening arrangement during playback of an audio signal via the particular playback system when the portable media device is coupled by the means for coupling to the particular playback system in the particular listening arrangement. The particular set of one or more corrective filters is part of a collection of one or more sets of corrective filters or the data therefor pre-stored in or for the portable media device, each of one or more sets of the collection being associated with a corresponding listening arrangement and a corresponding playback system. Some versions of the portable media device further include: means for analyzing a recording of a sound field resulting from one or more pre-defined calibration signals to determine a set of one or more corrective filters; and means for storing the data for a set of one or more corrective filters. The means for recording is configured to record a sound field resulting from one or more pre-defined calibration signals being played back on the particular playback system at one or more listener locations of the particular listening arrangement, the means for analyzing is configured to analyze the recording of the sound field to determine the particular set of one or more corrective filters at least to equalize for the particular playback system; and the means for storing is configured to store the data for the particular set of one or more corrective filters in or for the portable media device for the particular playback system.
  • Particular embodiments may provide all, some, or none of these aspects, features, or advantages. Particular embodiments may provide one or more other aspects, features, or advantages, one or more of which may be readily apparent to a person skilled in the art from the figures, descriptions, and claims herein.
  • Some Embodiments
  • FIGS. 1A and 1B each shows a simplified view of a user 141, a portable media device 121, and a playback system 103 to which the portable media device can be coupled. These are example elements of example embodiments of the invention. FIG. 1A shows the elements in a calibration mode, while FIG. 1B shows the elements in a playback mode.
  • The portable media device 121 includes a coupling 127 configured to couple the portable media device to a matching coupling included in a playback system, in this case, the playback system 103. The portable media device 121 also includes a user interface 123, typically including a display device and a user input mechanism, such user input mechanism configured to accept commands from the user 141. The portable media device 121 also includes a playback subsystem 128 configured to play back a selected audio signal and a filter subsystem 129 coupled to the playback subsystem and configured to apply a set of one or more corrective filters to an audio signal during playback of the audio signal. Other elements not shown in these drawings, but shown in more detailed drawings of the device include a processor and a storage subsystem, elements of which are included in some embodiments in the playback subsystem 128 and the filter subsystem 129. The storage subsystem is configured to store data for one or more sets of corrective filters, and apply the data of a particular set to the filter subsystem.
  • The playback system 103 includes at least one loudspeaker 105-two are shown in this example playback system, and a playback module 107 that includes one or more audio amplifiers.
  • FIG. 1B illustrated one aspect of the invention, comprising normal playback of an audio signal from a media file stored in the portable media device 121 while the portable media device 121 is coupled to the playback system 103 via coupling 127 and 113 on the media device 127 and playback system 103, respectively. The user 141 is at a particular listener position. The particular listening environment and locations of the playback system and listener define a listening arrangement. The playing back of the audio signal on the portable media device and particular playback system combination is while the portable media device 121 applies using the filter subsystem 129 a particular set of one or more corrective filters selected for this particular playback system 103 and listening arrangement from a pre-stored collection of one or more sets of corrective filters.
  • As described in more detail below, the collection of one or more sets of corrective filters, e.g., in the form of data for the filters, is pre-stored in or for the portable media device 121 and listening arrangement. Each set of one or more corrective filters of the collection is associated with a corresponding playback system and corresponding listening arrangement.
  • FIG. 1A illustrates another aspect of the invention: a calibration process to determine the particular set of one or more corrective filters at least to equalize for a playback system and listening arrangement, in this example the particular playback system 103. The portable media device 121 either includes built in, or is connectable to at least one microphone 125. The calibration process includes recording on the portable playback device 121 a sound field resulting from at least one pre-defined calibration signal 111 being played back on the particular playback system 103 while the microphone 125 is at one or more desired listener locations of the listening arrangement. The calibration process includes analyzing the recording of the sound field to determine data for the particular set of one or more corrective filters at least to equalize for the particular playback system (and possibly also for the listening environment), and storing the data for the particular set of one or more corrective filters in or for the portable media device 121 for the particular playback system (and listening arrangement). Note that in some embodiments, the calibration process includes make recordings from several locations and the results averaged. Thus there may be more than one desired listening location associated with a listening arrangement.
  • In this manner, the data for a collection of sets of corrective filters is pre-stored in or for the portable media device, each set of the collection associated with a corresponding playback system and listening arrangement.
  • The devices
  • The invention is not limited as to the type of portable media device. The minimum requirements are the ability to play digitally stored audio, having or being able to be connected to one or more microphones, and being able to be coupled to any one of a plurality of playback systems. Examples of portable media devices include, but are not limited to audio playback devices such as the Apple IPOD®, Sandisk SANSA®, Creative ZEN VISION®, Microsoft ZUNE®, and other models too numerous to list from other manufacturers. Examples also include, but are not limited to cellular telephones that have audio storage and playback capability, made by virtually every manufacturer of cellular telephones, and so-called "smart" cellular telephones such as the Apple IPHONE, Google NEXUS ONE, and many others too numerous to list. Many of these are able to play back not only digitally stored audio data, but also audiovisual content, such as digitally stored video files that may include digitally stored audio data.
  • The invention also is also not limited to the type of playback system. The minimum requirements are the inclusion of one or more speakers, and the ability to connect to a portable playback device, either directly by being docked thereto, by a wired connection, by a wireless connection, and via a wired or wireless network. The minimum requirements also include the ability to receive at least one signal that includes at least audio content from the portable playback device while connected thereto, and to playback at least the audio of the signal. The minimum requirements also include the ability to playback one or more calibration files, either stored in the playback system, loadable into a storage subsystem in the playback system, or sent to the playback system from an external calibration signal source. Examples of playback systems include, but are not limited to, so called docking speakers designed to include connectors for a specific model or models of portable media devices. For example, Amazon.com, a popular shopping Website in the USA, listed on 16 March 2010 1,953 items for the search "iPod speaker" in the category electronics, and 1,295 items for the search "docking speaker." Examples of playback systems also include, but are not limited to, home theatre systems that include home theatre receivers, some of which also include connectors for specific model or models of portable media devices, while others include common input connectors such as phono (RCA) connectors and sockets for TRS (tip, ring, sleeve) or TRRS ((tip, ring, ring, sleeve) connectors. Examples of playback systems also include, but are not limited to, televisions that include or are connected to loudspeakers. Such televisions commonly include connectors for external audio. Examples also include, but are not limited to, automotive audio systems that in 2010 commonly include connectors for specific model or models of portable media devices, and/or common input connectors such as sockets for a TRS (tip, ring, sleeve) or TRRS ((tip, ring, ring, sleeve) connector.
  • Embodiments of the present invention are particularly useful because a particular portable media device can be connected to more than one playback system.
  • An example portable media device
  • FIG. 2 shows a simplified block diagram of one example embodiment of a portable media device that includes at least one feature of the present invention. It would be clear to one skilled in the art that not all the elements shown in FIG. 2 would be included in all portable media device embodiments, and further, that some portable media device may include additional elements not shown in FIG. 2.
  • The digital elements of the portable media device 121 include elements that are coupled by a bus subsystem 241, shown purely for the sake of simplicity as a single bus. These digital elements include at least one processor 243, a storage subsystem 245, a user interface 123, at least one digital interface 231 coupled to a main connector 211, and one or more digital-to-analog converters (DACs) to convert digital information such as digitized audio signals to analog audio signals for playback via one or more audio amplifiers in an analog subsystem 225, and one or more analog-to-digital converters (ADCs) to convert an analog audio signal to a digitized analog signal. The DACs and ADCs are shown with their associated interfaces as module 233. The DACs and ADCs 233 are coupled to the analog subsystem 225. The portable media device 121 also includes at least one wireless interface 249 such as, but not limited to, a wireless network interface, a Bluetooth interface, an infrared interface, or the like. One such wireless interface is a common Wi-fi IEEE 802.11 wireless network interface. Some embodiments of the portable media device 121 also include a cellular telephone wireless network interface so that the device can act as a cellular telephone. Some embodiments also include other wireless network interfaces such as a Bluetooth interface.
  • The portable media device 121 also includes a battery and associated electronics subsystem 215 coupled in one embodiment to the main connector 211.
  • In some embodiments, the analog subsystem 225 is connected to the main connector 211 so that, for example, analog audio signals are available at the main connector 211. The main connector 211 is also coupled to the bus subsystem 241 and the at least one digital interface 231 so that signals are provided to and obtainable from whatever the main connector 211 is connected to.
  • The analog subsystem 225 is coupled to a microphone 125, which in this embodiment is built in. Other embodiments are connectable to a microphone 125. This embodiment also includes at least one loudspeaker 227 connected to the analog subsystem 225. A set of at least one input/output connectors 213 is included so that an external set of loudspeakers, e.g., loudspeakers incorporated in headphones, can be connected and also so that different analog audio signals can be input via the analog subsystem 225.
  • In some embodiments, the user interface 123 includes a display screen 261 operative to display information to a user, one or more buttons 264 to accept input from a user, and a keypad/keyboard 263 also to accept input from a user. In some embodiments, the display screen 261 includes a touch sensitive surface to accept input from the user, and in some such embodiments, at least some of the buttons 264 are so-called soft buttons in that they are generated by causing a particular area of the display screen 261 to display a button, possibly with a message for the user, and such that the user touching the particular area causes an input that is the same as if a hardware button is displayed. Similarly, while a separate module is shown for keypad/keyboard 263, some or all of these elements may comprise soft buttons on the display screen 261.
  • The storage subsystem 245 includes programs in the form of executable instructions that when executed by the at least one processor 243 cause carrying out of regular functionality of the portable media device 121 and for carrying out aspects of the present invention. Some of the programs 251, for example, provide such functionality when executing as causing displaying and accepting input from buttons 264, including soft buttons displayed in the display screen 261, and in some embodiments, accepting input in the form of multi-touch gestures as are common in 2010. The storage subsystem 245 also is configured to store digital content, shown in FIG. 2 as stored audiovisual (AV) content 253, but which may include only digitally stored audio. The content in the stored content 253 is typically stored as compressed data files, e.g., in the case of audio as AAC or MP3 files, such as audio file 254. The programs 251 also include instructions that when executed cause playback of a digitally stored audio file to form digital signals that are converted to analog form by the DACs in module 233, and amplified by at least one amplifier in the analog subsystem 225. Thus, the portable media device 121 includes a playback subsystem configured to play back a selected audio signal. In the embodiment shown, the playback system is made up of elements of the analog subsystem 225, the DACs of module 233, and instructions within the programs 251 in the storage subsystem 245 that when executed cause playback of audio content that forms the selected audio signal.
  • As will be described in more detail below, the storage subsystem 245 also is configured to store a plurality of corrective filter profiles, e.g., equalization profiles 257 that include data needed to implement sets of corrective filters. In one embodiment, each corrective filter profile 258 of corrective filter profiles collection 257 provides the data needed to implement a particular set of one or more corrective filters for a particular playback system. Because a corrective filter profile 258 provides the data needed to implement a particular set of one or more corrective filters for a particular playback system, for the sake of simplicity of language, the term (the) corrective filter profile 258 and "(the) data for a (or the) set of one or more corrective filters" will be used synonymously. Having a profile, however, is only one way of implementing a set of one or more corrective filters, hence using the same language is not intended to limit the invention to using a profile.
  • Thus, the portable media device 121 includes a filter subsystem coupled to the playback subsystem and configured to apply a set of one or more corrective filters to an audio signal during playback of a selected audio signal.
  • The storage subsystem 245 is made up of several types of storage devices, and include solid state memory and may include magnetic memory, e.g., as a hard disk. Many variations are possible as would be clear to one skilled in the art.
  • Some of the elements of portable media device 121 may be provided as part of a large integrated circuit. The functionality may be divided between more than one device. Furthermore, there may be one or more discrete components. At least one element's functionality may be provided by executing one or more programs on one or more of the at least one processor 243. The one or more processors 243 may include the functionality of a DSP device, e.g., in the form of a DSP portion of an integrated circuit, or in some embodiments, in the form of a separate DSP device. A general purpose processor may be used instead or in addition. Many such variations are possible. Further details on possible architectures of the portable media device 121 are not provided herein in order not to obscure the inventive aspects.
  • An example playback system
  • FIG. 3 shows a simplified block diagram of one example embodiment of a playback system 103. The portable media device is connectable to more than one playback system. The playback system shown is one example. It would be clear to one skilled in the art that not all the elements shown in FIG. 3 would be included in all playback system embodiments, and further, that some playback systems may include additional elements not shown in FIG. 3. For example, the playback system of FIG. 3 includes many digital elements, including storage of digital media files, and includes interfaces to connect the playback system to a wireless network and to have a wired network connection. Many playback systems would not have such elements.
  • The playback system includes a coupling (shown as coupling 113 in FIGS. 1A and 1B) to a portable media device such as media device 121. In the embodiment of FIG. 3, the coupling 113 is in the form of a main connector 311 configured to connect to a portable media device, e.g., device 121. The main connector 311 includes connections that accept analog audio signals from a connected portable media device. Main connector 311 is connected to an analog subsystem 325 that includes one or more audio amplifiers for playback of the audio signals via a coupled set of one or more loudspeakers 105.
  • A set of at least one input/output connectors 313 is included so that different analog audio signals can be input via the analog subsystem 325. Thus, the analog input connector in 313 can act as the coupling (shown as coupling 113 in FIGS. 1A and 1B) to a portable media device instead of, or in addition to main connector 311. Of course, some embodiments do not include such an additional input, while other embodiments do not include a main connector configured to accept analog input signals. In some embodiments, an output terminal is also included in element 313 so that an external set of loudspeakers, e.g., headphones that include loudspeakers devices can be connected.
  • In the embodiment shown, control of volume, etc., is achieved via a user interface 347 that in this case includes digital elements. A user interface for a playback system may of course also include one or more analog elements, such as analog volume controls.
  • The digital elements of the playback system embodiment 103 include elements that are coupled by a bus subsystem 341, shown purely for the sake of simplicity as a single bus. These digital elements include at least one processor 343, a storage subsystem 345, the user interface 347, at least one digital interface 331 coupled to a main connector 311, and one or more digital-to-analog converters (DACs) to convert digital information such as digitized audio signals from AV content stored in the storage subsystem 345 to analog audio signals for playback on the at least one loudspeaker 105 via the one or more audio amplifiers in analog subsystem 325. The DACs are shown with their associated interfaces as module 333 and coupled to the analog subsystem 325.
  • In some versions, the playback system 103 also includes at least one wireless interface 349 such as, but not limited to a wireless network interface, a Bluetooth interface, an infrared interface, or the like. One such wireless interface is a common Wi-fi IEEE 802.11 wireless network interface. The wireless network interface enables connection to a network, e.g., a home network which in turn may be connected to an external network, e.g., the Internet. Some embodiments of the playback system 103 also include a Bluetooth interface, and an infrared interface configured to accept commands from a remote control device 315.
  • Some embodiments also include one or more other network interfaces 335 so that the playback system 103 can be connected to a wired network, e.g., a wired home network which in turn may be connected to an external network, e.g., the Internet.
  • In some embodiments, the main connector is also coupled to a charging circuit 317 configured to supply power to charge a connected portable playback device, and to accept control signals related to the charging.
  • In some embodiments, the main connector 311 is also coupled to the bus subsystem bus subsystem 341 and the at least one digital interface 331 so that signals are provided to and obtainable from whatever the main connector 311 is connected to.
  • In some embodiments that include one or more processors 343 and the storage subsystem 345, the storage subsystem 345 includes programs in the form of executable instructions that when executed by the at least one processor 343 cause carrying out of regular functionality of the playback system 103. In some such embodiments, the storage subsystem 345 is also configured to store digital content, shown in FIG. 3 as stored audiovisual (AV) content 353, but which may include only digitally stored audio. The content in the stored content 353 is typically stored as compressed data files, e.g., in the case of audio as AAC or MP3 files, such as audio file 354.
  • While the present invention is not limited to such embodiments, in some embodiments, a user interface 347 that is digitally driven is included. In an example embodiment, the user interface 347 includes a display screen 361 operative to display information to a user, and one or more buttons and knobs 364 to accept input from a user. In some embodiments, the display screen 361 includes a touch sensitive surface to accept input from the user, and in some such embodiments, at least some of the buttons or knobs 364 are so-called soft buttons in that they are generated by causing a particular area of the display screen 361 to display a button, possibly with a message for the user, and such that the user touching the particular area causes an input that is the same as if a hardware button is displayed. Thus, some of the programs 351, for example, provide such functionality when executing as causing displaying and accepting input from buttons 364, including soft buttons displayed in the display screen 361
  • The storage subsystem 345 is made up of several types of storage devices, and includes solid state memory and may include magnetic memory, e.g., as a hard disk. Many variations are possible as would be clear to one skilled in the art.
  • One aspect of embodiments of the invention is playback of one or more calibration signals by the playback system. In some versions, the calibration signals may be input, e.g., via an external connector, or via a wireless or wired connection. In others, calibration signals may be pre-stored in digital form in the storage subsystem. In yet others, the calibration signals may be obtained by connection and then stored in the storage subsystem 355 in digital form for playback. Digitally stored calibration signals are shown as calibration signals 355 in the example embodiment of FIG. 3.
  • Some of the elements of playback system 103 may be provided as part of a large integrated circuit. The functionality may be divided between more than one device. Furthermore, there may be one or more discrete components. At least one element's functionality may be provided by executing one or more programs on one or more of the at least one processor 343. Many such variations are possible. Further details on possible architectures of the playback system 103 are not provided herein in order not to obscure the inventive aspects.
  • An inventive aspect of embodiments of the present invention is that a single portable media device may be connected to several different playback devices, or even the one device that may be listened to in different locations. Hence, while only one playback system example has been shown here, those of skill in the art would understand that there are many possible playback devices to which a portable media device may be connected. Some such playback devices are relatively simple, while others are more complex.
  • The disclosed invention provides mechanisms and methods for applying corrective filtering, e.g., equalizing each of a variety of playback systems to which a portable media device might be attached by applying the corrective filtering directly in the portable media device. The invention is not limited to any particular type of corrective filtering, and equalization is an example of corrective filtering than can be applied as described herein.
  • Example methods
  • Some embodiments include a method of operating a portable media device 121. The method includes playing back an audio signal on the portable media device 121/playback system combination while the portable media device 121 is coupled to a particular playback system 103, and is in a particular listening arrangement. During the playback, the portable media device applies a particular set of one or more corrective filters selected from a pre-stored collection of data for at least one set of one or more corrective filters.
  • The data for the collection of one or more sets of corrective filters is pre-stored in or for the portable media device 121. The data for each set of the collection is associated with a corresponding playback system (and listening arrangement). In the example of FIG. 2, the particular set of one or more corrective filters is shown as a profile 258 that includes the data needed to implement the set of filters, e.g., by running one or more programs on at least one of the one of more processors 243.
  • Note that the term listening arrangement may cover one specific location, or may cover a range of listening locations or any listening location for the particular playback system. For example, the corrective filters may be designed for equalizing listening to a playback system having particular loudspeakers 105, and while possible being determined for one specific listener location, may be usable for a range of listening locations. Furthermore, one may make measurements (recording) from a plurality of locations to determine a single averaged correction filter for a range of locations. Hence the term "listening arrangement" should not be taken to imply only a single listening location using the particular playback system, i.e., not applicable to other locations using the particular playback system. Firstly, a corrective filter determined from one or more recordings from a single location may be used for a range of locations, and secondly, in some calibration method embodiments, one can make measurements from several locations in order to determine a single set of "averages" corrective filters suitable for a range of locations.
  • An example calibration method
  • The particular set of one or more corrective filters is determined by a calibration process. FIG. 4 shows a simplified flowchart of an embodiment of a calibration method 400. The method 400 includes in 403 playing back one or more pre-defined calibration signals 111 on the particular playback system 103, and , during the playback, in 405, recording on the portable playback device 121 the sound field resulting from one or more pre-defined calibration signals 111 being played back on the particular playback system 103. The recording uses a microphone 125 built in or connected to the portable media device 121 while the microphone 125 is at one or more desired listener locations that are part of the listening arrangement. As noted before, there may be more than one location associated with a listening arrangement, and the recordings may include recordings taken at more than one location. The method includes in 407 analyzing the recording of the sound field to determine the particular set of one or more corrective filters at least to equalize for the particular playback system (and possibly also for the listening environment), and in 409, storing the particular set of one or more corrective filters in or for the portable media device for the particular playback system (and listening environment).
  • In one set of embodiments, the storing is in the portable media device 121. In another set of embodiments, the storing, while possibly temporarily, is on the portable media device 121, is then or later stored remotely, e.g., on a remote storage system on a remote server, for the portable media device 121. Hence the storing being "in or for" the portable media device 121 for the particular playback system 103 (and listening environment).
  • In one embodiment, the portable media device 121 includes a user interface that presents a 'calibrate' button in buttons 264, or some other function to enable a user to indicate to carry out the recording, analyzing, and storing of the particular set of one or more corrective filters. The calibration method includes receiving on the user interface an indication from a user to carry out the recording, analyzing, and storing of the particular set of one or more corrective filters, and carrying these steps out in response to such receiving.
  • Also, in some embodiments in which the portable media device 121 contains its own microphone, embodiments of the method provide an extremely easy-to-use, self-contained form factor for calibration. A user can simply hit the 'calibrate' button in buttons 264 and hold the portable media device 121 in a listening position, e.g., in front of the playback system speakers 105.
  • The calibration signals in one embodiment are pre-stored in the portable media device portable media device 121, e.g., as calibration signals 255 in the storage subsystem 245 of the portable media device 121, and loaded into a playback system 103 for storage within the playback system. In other embodiments, the portable media device 121 is connected to the playback system by wire or wirelessly from the listening position, and the calibration signal is sent to the playback system 103 and played back while the resulting sound field is recorded for analysis to determined the particular set of one or more corrective filters for the portable media device 121 and playback system combination. In yet another embodiment, the calibration signal or signals are provided for playback on the playback system by some other mechanism, e.g., pre-loaded in the playback system, or provided in real time by another source. The invention is not limited to any particular way of providing the calibration signal(s) to the playback system. The invention is also not limited to the manner any calibration signal is provided to the playback system, e.g., digital form or as an analog signal.
  • An example method of operating a portable media device,
  • FIG. 5 shows a simplified flowchart of a method 500 of operating a portable media device, e.g., device 121 for which or on which is stored the data for a collection of sets of corrective filters, e.g., in the form of the data for implementing the corrective filters, each set associated with a corresponding playback system (and listening arrangement).
  • The method includes in 503 connecting the portable media device 121 to the particular playback system 103 in a particular listening environment. The method further includes in 505 selecting (manually or automatically) the pre-stored particular set of one or more corrective filters at least to equalize for the particular playback system 103 (and possibly also for the listening environment). In the case the data for collection of sets of corrective filters is not locally stored, 505 includes loading at least the selected particular set of one or more corrective filters. This might occur separately, and at a different time from the selecting. 507 includes playing back an audio signal on the portable media device 121 while the portable media device 121 is connected to the particular playback system 103. The playing back includes applying the particular set of one or more corrective filters.
  • Selecting the set of one or more corrective filters
  • In the case of manual selection in 505, in some embodiments, the portable media device includes a user interface 123 that includes, e.g., as buttons 264, indication to the user of one or more pre-stored sets of corrective filters. The method includes the media portable device 121 receiving, e.g., via the user interface 123, an indication from a user to use a particular set of one or more corrective filters for playback.
  • Some embodiments provide for automatic selection of the set of one or more corrective filters. In some embodiments, for example, for some so-called "docking speakers" playback systems, the playback system may be configured to provide an indication to an attached portable media device, e.g., providing signals via the main connector that are indicative of the type and/or model of playback device. The method 500, in some embodiments, includes the portable media device receiving an indication from the particular playback system indicating that particular portable media device is coupled to the particular playback system. Some embodiments of the portable media device are configured such that, responsive to the indication, the method includes automatically selecting the particular set of one or more corrective filters associated with the particular portable media device for playback.
  • Furthermore, some embodiments of the portable media devices have pre-defined sets of corrective filters that are pre-defined for particular classes of playback systems. For example, simple "docking speakers" playback systems may form a class, television receivers may form a class, home stereo receivers with connected speakers may form a class, home receivers with a connected subwoofer may form a class, automotive playback systems in an automobile may form a class, and so forth. In some embodiments, at least one of the sets of corrective filters is a default set predefined for a class of playback systems.
  • Types of corrective filters
  • The invention is not limited to any particular type of corrective filters or how such corrective filters are implemented or specified. In the near future, portable media devices may have enough processing power to implement more sophisticated correcting filters than a set of multi-band equalizing filters. Some possible types of corrective filters are described below. These are provided as examples only and not to limit the invention to any particular types of corrective filters.
  • Multi-band equalizing filters
  • Some embodiments of the set of one or more corrective filters include a set of multi-band equalizing filters. The frequency range of listening is partitioned into a set of frequency bands, and each filter of the set of multi-band equalizing filters sets a relative gain for one of the frequency bands. Such multi-band equalizing filters are well known in the art. The number of frequency bands for any particular portable media device can be fixed, or settable, and is typically a relatively small number, e.g., 6, 9, or 12. There are many ways of implementing such filters, and one embodiment uses digital signal processing methods implemented by a program in programs 251 executing on the processor 243, e.g., on a DSP element. That is, applying the particular set of one or more corrective filters when the portable media device is coupled to a particular playback system includes digitally processing digital signals on at least one of the one or more processors of the portable media device. In some embodiments, the multi-band equalizing filters are implanted as a set of digital parametric filters at respective frequency bands. Such parametric filters are defined by a set of parameters. In one embodiment, each set of parameters is stored as a corrective filter profile 258 of corrective filter profiles collection 257 and is usable to implement a particular set of one or more corrective filters for a particular playback system.
  • In alternate embodiments, playback circuitry in the portable media device 121 implements a variable set of gain controls according to respective gain parameters for a pre-defined number of frequency bands. A set of gain settings is stored as a corrective filter profile 258 of corrective filter profiles collection 257 and is usable to implement a particular set of one or more corrective filters for a particular playback system.
  • Multi-channel audio
  • More sophisticated corrective filters are applicable to playback via a playback system that includes more than two loudspeakers, e.g., a playback system that provides surround sound as is common today in home theater receivers. The correcting filters for such playback systems can include more sophisticated settings that provide relative gains to the signals generated by the portable media device 121 for the different loudspeakers 105 in the playback system.
  • Perceptual domain processing
  • Recently, perceptual domain processing has been invented that takes into account the variation in the perception of audio depending on the reproduction level of the audio signal. A time sampled audio signal denoted is pre-processed to generate a time-varying spectrum indicating a signal level within a plurality of frequency bands (critical bands), e.g., 40 bands, each denoted by a band number, and varying over time blocks. The time-varying spectrum of the audio signal may be generated in a number of ways, but advantageously the bands are spaced to simulate the frequency resolution of human hearing. A quantity called an excitation signal is computed that approximates the distribution of energy along the basilar membrane of the inner ear of a human at a critical frequency band during a time block. While other transforms, such as the modified discrete cosine transform (MDCT) also may be used, the perceptual domain excitation may be achieved efficiently by computing a running Short-Time Discrete Fourier Transform (STDFT) of the audio signal using the frequency response of a filter simulating the transmission of audio through the outer and inner ear of a human and a selected set of bandpass filters, e.g., bandpass filters chosen to mimic the critical band filtering observed along the basilar membrane in the human ear at each critical frequency band of interest. Example embodiments use a set of filters with a spacing of 1 ERB, resulting in a total of 40 bands.
  • Distortion reducing multi-band compressor with timbre preservation
  • In playback devices, audio playback may be perceptibly distorted, and often acutely distorted, as playback level is increased during playback, this distortion is oftentimes frequency dependent for a playback device. One form of corrective filtering is applying multi-band compression to the audio signal prior to playback to reduce distortion and attempt to maximize playback level. One simple method includes specifying a distortion threshold is specified for each frequency band of the compressor. The compressor independently applies differing gain values to each frequency band to ensure an output signal does not exceed any of the corresponding distortion thresholds.
  • An improved set of corrective filters includes timbre preservation in a multi-band compressor. Timbre preservation is achieved by determining a time-varying threshold in each of a plurality frequency bands as a function of (i) a respective fixed threshold for the frequency band and, at least in part, (ii) an audio signal level (whether digital or analog audio signal) in a second frequency band and (iii) a fixed threshold in the second frequency band. Consequently, each time-varying threshold is input signal adaptive. If a particular frequency band receives significant gain reduction due to being above its fixed threshold (or alternatively, approaching the fixed threshold), then a time-varying threshold of one or more other frequency bands are also decreased to receive some gain reduction.
  • One example embodiment of applying such timbre preserving multi-band compressor corrective filtering includes providing or determining a fixed threshold for a first frequency band, and determining a first level of an audio signal within the first frequency band. The first level can be less than the fixed threshold. The method further includes determining a second level of the audio signal for a second frequency band is also determined, and computing a time-varying threshold for the first frequency band using the second level. The time-varying threshold us less than the fixed threshold. The method includes attenuating the audio signal within the first frequency band to be equal to or less than the time-varying threshold or, alternatively, increasingly attenuating the audio signal within the first frequency band as approaching the time-varying threshold. The time-varying threshold can be computed from an average difference of the audio input signal in each frequency band and its respective fixed threshold. Optionally, a second fixed threshold for the second frequency band can be further determined. The second level of the audio signal can exceed the second fixed threshold, resulting in attenuation of the audio signal within the second frequency band to the second fixed threshold. A set of corrective filters to implement such a method includes a multi-band filterbank, compression function elements, and at least one timbre preservation element. Each compression function element can be dedicated to a frequency band. The timbre preservation element is coupled to the multi-band filterbank and the compression function elements. The timbre preservation element receives a fixed threshold for each frequency band and provides a time-varying threshold for each frequency band. The time-varying threshold for a frequency band is partially determined by a level of the audio signal outside the frequency band.
  • For more details of such corrective filtering, see U.S. Provisional Patent Application 61/315,172 filed March 18, 2010 , titled TECHNIQUES FOR DISTORTION REDUCING MULTI-BAND COMPRESSOR WITH TIMBRE PRESERVATION, the contents of which are incorporated herein by reference, and a copy of which is attached hereto as APPENDIX A.
  • Inverse filtering to match a target response
  • Another form of corrective filtering applies an inverse filter to alter the playback system's loudspeaker's frequency response in an effort to match the inverse-filtered loudspeaker output to a target frequency response. As in perceptually based processing described above, the methods are applied to "critical frequency bands"-frequency bands of a full frequency range that are determined in accordance with perceptually motivated considerations. Typically, critical frequency bands that partition an audible frequency range have width that increases with frequency across the audible frequency range. The methods use "critically banded" data, implying that that the full frequency range includes critical frequency bands, and that the data comprises subsets, each of the subsets consisting of data indicative of audio content in a different one of the critical frequency bands.
  • The target frequency response may be flat or may have some other predetermined shape.
  • In some embodiments, the calibration method includes determining an inverse filter for a loudspeaker of the playback system. The calibration includes measuring the impulse response of the loudspeaker at each of a number of different spatial locations in the listening arrangement, time-aligning and averaging the measured impulse responses to determine an averaged impulse response, and using critical frequency band smoothing to determine the inverse filter from the averaged impulse response and a target frequency response. For example, critical frequency band smoothing may be applied to the averaged impulse response and optionally also to the target frequency response during determination of the inverse filter, or may be applied to determine the target frequency response. Measurement of the impulse response at multiple spatial locations can ensure that the speaker's frequency response is determined for a variety of listening locations. In some embodiments, the time-aligning of the measured impulse responses is performed using real cepstrum and minimum phase reconstruction techniques.
  • In some embodiments, the averaged impulse response is converted to the frequency domain via the discrete Fourier transform (DFT) or another time domain-to-frequency domain transform. The resulting frequency components are indicative of the measured averaged impulse response. These frequency components, in each of the transform bins are combined into frequency domain data in a smaller number of critical frequency bands, e.g., 20 bands or 40 bands, as for other perceptual domain processing. The banding of the averaged impulse response data into critically banded data is designed to mimics the frequency resolution of the human auditory system. The banding is typically performed by weighting the frequency components in the transform frequency bins by applying appropriate critical banding filters thereto and generating a frequency component for each of the critical frequency bands by summing the weighted data for the band. Typically, these filters exhibit an approximately rounded exponential shape and are spaced uniformly on the Equivalent Rectangular Bandwidth (ERB) scale. The spacing and overlap in frequency of the critical frequency bands provide a degree of regularization of the measured impulse response that is commensurate with the capabilities of the human auditory system. Application of the critical band filters is an example of critical band smoothing (the critical band filters typically smooth out irregularities of the impulse response that are not perceptually relevant so that the determined inverse filter does not need to spend resources correcting these details).
  • Values for determining the inverse filter are determined from the target response and averaged impulse response, e.g., from smoothed versions thereof, in frequency windows, e.g., critical frequency bands. The critically banded impulse response data are used to find an inverse filter which achieves a desired target response. In some embodiments, in order to maintain equal loudness when using the inverse filter, the inverse filter is preferably normalized against a reference signal, e.g., pink noise, whose spectrum is representative of common sounds.
  • In come embodiments, inverse filter coefficients are directly calculated in the time domain.
  • The resulting inverse filter forms the set of corrective filters applied to the signal in the playback system as described herein.
  • For more details of such corrective filtering, see International Patent Application No. PCT/US2010/020846 filed January 13, 2010 , titled METHOD FOR DETERMINING INVERSE FILTER FROM CRITICALLY BANDED IMPULSE RESPONSE DATA, the contents of which are incorporated herein by reference, and a copy of which is attached hereto as APPENDIX B.
  • Storing the data of the sets of corrective filters
  • In some embodiments, the set of parameters for implementing a set of one or more corrective filters is stored on or for the portable media device 121 as part of a collection of sets. In some embodiments, the collection is stored in the form of a database. Each entry is a set of parameters for implementing a set of one or more corrective filters for a particular playback system, and includes an indicator that the particular set of one or more corrective filters is associated with the particular playback system. Thus, step 409 of FIG. 4 for such embodiments includes storing an indicator that the particular set of one or more corrective filters is associated with the particular playback system.
  • In some embodiments, the data for the collection of one or more sets of corrective filters, e.g., the database, is stored in a storage subsystem included in the portable media device. Thus, as shown in FIG. 2, in some embodiments, the storage subsystem 245 includes corrective filter profiles 257, and one such profile 258 is shown.
  • In other embodiments, the data for the collection of one or more sets of corrective filters is stored remotely from the portable media device. FIG. 6 shows a simplified block diagram of one arrangement according to some embodiments of the invention that include remote storage of the data for the collection of one or more sets of corrective filters. During step 409, the storing initially may be temporarily in the storage device in the portable media device 121, and then stored remotely, e.g., stored remotely when the portable media device is connected to a personal computer 623 which is coupled to a network 625, which can be any private or public network, even the Internet. A server system 627 is also connected to the network 625. The server system 627 includes one or more processors and a storage subsystem 645. The storage subsystem 645 is configured to store the data for one of more collections of sets of corrective filters, each such collection being associated with a particular portable media device 121 or a particular user or both a particular user and portable media device. In the example shown, the data for one collection 657 of one or more sets of corrective filters is shown. The data for one set 658 is shown. The data of the collections is in some embodiments in the form of a database. The data for each set of one or more corrective filters is stored in the database as an entry we call a corrective filter profile that includes the parameters needed to implement the corrective filters. When the portable media device 121 is connected to the personal computer 623 connected via the network to the server 627, the particular sets of correction filter in temporary storage in the portable media device 121 is sent for storage in the storage subsystem 645 of the server 627. Similarly, when the portable media device 121 is connected to the personal computer 623 connected via the network to the server 627, one or more sets of corrective filters stored in the storage subsystem 645, e.g., as corrective filter profiles, can be loaded into the portable media device 121 for use in playback. Thus, for example, a particular set of correction filters for a particular playback system can be loaded from remote storage to the portable media device 121 for use in playback while the portable media device is coupled to the particular playback system.
  • Analysis
  • Process action 405 includes recording on the portable media device 121 the sound field resulting from playback on the playback system 103 of the calibration signal. Process action 407 includes analyzing the recording to determine the particular set of one or more corrective filters at least to equalize for the particular playback system (and possibly also for the listening environment).
  • The invention is not limited to any particular type of calibration signal(s) or any particular analysis method. In one embodiment the calibration signal is made up of a sum of distinct frequency tones of known amplitudes at a pre-defined number of distinct frequencies. In one embodiment, the center frequencies are the center frequencies of the corrective filters used in the portable media device 121. The center frequencies of graphic equalizers are often distributed logarithmically, e.g., in octaves. In some embodiment, the center frequencies of the components of the test signal are therefore also spread logarithmically. In some embodiment, the amplitudes of the distinct frequency components of the test signal are equal, while in other embodiments, the amplitudes vary according to the inverse of the frequency.
  • The analysis process 407 includes determining the amplitudes at the distinct frequencies of the recorded recording in order to determine the gains at the frequencies that would cause equalize the response. The gains at the center frequency forms the data of the particular set of one or more corrective filters, e.g., the corrective filter profile stored for or in the portable media device 121 for the particular playback system and listening environment.
  • One alternate embodiment uses a noise signal for the calibration signal. In one embodiment, the calibration signal is a white noise signal, i.e., a noise signal that has the same distribution of power for all frequencies. In another embodiment, the calibration signal is a pink noise signal, i.e., a noise signal that has a distribution of power that is proportional to the reciprocal of the frequency. In some embodiments in which a noise signal is used as the calibration signal, the noise signal is generated using digital synthesis methods that use pseudorandom noise.
  • In some embodiments in which a noise signal is used as the calibration signal, the analysis 407 includes determining the spectrum of the recorded sound field, e.g., by carrying out a discrete Fourier transform (DFT), e.g., carried out as a fast Fourier transform (FFT), using method well known to those skilled in the art.
  • From the results of the transform, and a target reference spectrum for the signals after processing by the set of one or more corrective filters, the data are determined and stored for the particular set of one or more corrective filters that modify the determined spectrum of the recorded sound field to match the target reference spectrum for the particular playback system and listening environment.
  • While digital methods have been described above for the analysis 407, in alternate embodiments, some or all of the analysis may be carried out by analog circuitry. The recorded signal is divided into frequency bands, e.g., by a set of bandpass filters, and level measurement circuitry is used to determine signals indicative of the signal powers in the frequency bands. These data values may then be digitized, and a set of gains for the frequency bands determined as the data to store for the set of one or more corrective filters for the particular playback system and listening environment.
  • Thus have been described methods and apparatuses. In some embodiments, calibration signals are played back on a playback system. Using either a built-in or attached microphone, the resulting sound field is recorded on a portable media device. The recorded sound field is analyzed and a set of one or more corrective filters for the playback system is computed. Data for the set of one or more corrective filters is stored on or for portable media device and associated with said playback system. Thus the data for a collection of sets of corrective filters is stored. The stored data for a particular set can then be recalled and the particular set of one or more corrective filters applied to any audio being played from the portable media device when it is attached to the corresponding playback system. Because embodiments of the invention include applying the equalization in the portable media device, such embodiments provide the benefits of room equalization to audio playback systems which do not contain such a feature. Also, when the portable media device contains its own microphone, some embodiments of invention provide an extremely easy-to-use, self-contained form factor for calibration. A user simply hits a calibrate button and holds the portable media device in a listening location in front of the playback system's loudspeakers.
  • In the context of this document, the term "wireless" and its derivatives may be used to describe circuits, devices, systems, methods, techniques, communications channels, etc., that may communicate data through the use of modulated electromagnetic radiation through a non-solid medium.
  • Unless specifically stated otherwise, as apparent from the following description, it is appreciated that throughout the specification discussions utilizing terms such as "processing," "computing," "calculating," "determining" or the like, refer to the action and/or processes of a computer or computing system, or similar electronic computing device, that manipulate and/or transform data represented as physical, such as electronic, quantities into other data similarly represented as physical quantities.
  • In a similar manner, the term "processor" may refer to any device or portion of a device that processes electronic data, e.g., from registers and/or memory to transform that electronic data into other electronic data that, e.g., may be stored in registers and/or memory. A "computer" or a "computing machine" or a "computing platform" may include one or more processors.
  • Note that when a method is described that includes several elements, e.g., several steps, no ordering of such elements, e.g., steps is implied, unless specifically stated.
  • In some embodiments, a computer-readable storage medium is configured with, e.g., encoded with instructions stored therein that when executed by one or more processors of a processing system such as a digital signal processing device or subsystem that includes at least one processor element and a storage subsystem, cause carrying out a method as described herein.
  • The methodologies described herein are, in some embodiments, performable by one or more processors that accept logic, instructions encoded on one or more computer-readable media. When executed by one or more of the processors, the instructions cause carrying out at least one of the methods described herein. Any processor capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken are included. Thus, one example is a typical processing system that includes one or more processors. Each processor may include one or more of a CPU or similar element, a graphics processing unit (GPU), and/or a programmable DSP unit. The processing system further includes a storage subsystem with at least one storage medium, which may include memory embedded in a semiconductor device, or a separate memory subsystem including main RAM and/or a static RAM, and/or ROM, and also cache memory. The storage subsystem may further include one or more other storage devices, such as magnetic and/or optical and/or further solid state storage devices. A bus subsystem may be included for communicating between the components. The processing system further may be a distributed processing system with processors coupled by a network, e.g., via network interface devices or wireless network interface devices. If the processing system requires a display, such a display may be included, e.g., a liquid crystal display (LCD), organic light emitting display (OLED), or a cathode ray tube (CRT) display. If manual data entry is required, the processing system also includes an input device such as one or more of an alphanumeric input unit such as a keyboard, a pointing control device such as a mouse, and so forth. The term storage device, storage subsystem, or memory unit as used herein, if clear from the context and unless explicitly stated otherwise, also encompasses a storage system such as a disk drive unit. The processing system in some configurations may include a sound output device, and a network interface device.
  • The storage subsystem thus includes a computer-readable storage medium that is configured with, e.g., encoded with instructions, e.g., logic, e.g., software that when executed by one or more processors, causes carrying out one of more of the method steps described herein. The software may reside in a hard disk, or may also reside, completely or at least partially, within the RAM and/or within the processor during execution thereof by the computer system. Thus, the memory and the processor also constitute a computer-readable medium on which are encoded instructions.
  • Furthermore, a computer-readable storage medium may form a computer program product, or be included in a computer program product.
  • In alternative embodiments, the one or more processors operate as a standalone device or may be connected, e.g., networked to other processor(s), in a networked deployment, wherein the one or more processors may operate in the capacity of a server or of a client machine in server-client network environment, or as a peer machine in a peer-to-peer or distributed network environment. The term processing system encompasses all such possibilities, unless explicitly excluded herein. The one or more processors may form a personal computer (PC), a portable media device, a media playback system, a tablet PC, a set-top box (STB), a Personal Digital Assistant (PDA), a game machine, a cellular telephone, a Web appliance, a network router, a switch or a bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine.
  • Note that while some diagram(s) only show(s) a single processor and a single storage subsystem, e.g., a single memory that stores the logic including instructions, those skilled in the art will understand that many of the components described above are included, but not explicitly shown or described in order not to obscure the inventive aspect. For example, while only a single machine is illustrated, the term "machine" shall also be taken to include any collection of machines that individually or jointly execute a set (or multiple sets) of instructions to perform any one or more of the methodologies discussed herein.
  • Thus, one embodiment of each of the methods described herein is in the form of a computer-readable storage medium configured with a set of instructions, e.g., a computer program that when executed on one or more processors, e.g., one or more processors that are part of a portable media device, cause carrying out of method steps. Some embodiments are in the form of the logic itself. Thus, as will be appreciated by those skilled in the art, embodiments of the present invention may be embodied as a method, an apparatus such as a special purpose apparatus, an apparatus such as a data processing system, logic, e.g., embodied in a computer-readable storage medium, or a computer-readable storage medium that is encoded with instructions, e.g., a computer-readable storage medium configured as a computer program product. The computer-readable medium is configured with a set of instructions that when executed by one or more processors cause carrying out method steps. Accordingly, aspects of the present invention may take the form of a method, an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present invention may take the form of program logic, e.g., in a computer readable medium, e.g., a computer program on a computer-readable storage medium, or the computer readable medium configured with computer-readable program code, e.g., a computer program product.
  • While the computer readable medium is shown in an example embodiment to be a single medium, the term "medium" should be taken to include a single medium or multiple media (e.g., several memories, a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions. A computer readable medium may take many forms, including but not limited to non-volatile media and volatile media. Non-volatile media includes, for example, optical, magnetic disks, and magneto-optical disks. Volatile media includes dynamic memory, such as main memory.
  • It will also be understood that embodiments of the present invention are not limited to any particular implementation or programming technique and that the invention may be implemented using any appropriate techniques for implementing the functionality described herein. Furthermore, embodiments are not limited to any particular programming language or operating system.
  • Reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment, but may. Furthermore, the particular features, structures or characteristics may be combined in any suitable manner, as would be apparent to one of ordinary skill skilled in the art from this disclosure, in one or more embodiments.
  • Similarly, it should be appreciated that in the above description of example embodiments of the invention, various features of the invention are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure and aiding in the understanding of one or more of the various inventive aspects. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed invention requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the claims following the DESCRIPTION OF EXAMPLE EMBODIMENTS are hereby expressly incorporated into this DESCRIPTION OF EXAMPLE EMBODIMENTS, with each claim standing on its own as a separate embodiment of this invention.
  • Furthermore, while some embodiments described herein include some but not other features included in other embodiments, combinations of features of different embodiments are meant to be within the scope of the invention, and form different embodiments, as would be understood by those skilled in the art. For example, in the following claims, any of the claimed embodiments can be used in any combination.
  • Furthermore, some of the embodiments are described herein as a method or combination of elements of a method that can be implemented by a processor of a computer system or by other means of carrying out the function. Thus, a processor with the necessary instructions for carrying out such a method or element of a method forms a means for carrying out the method or element of a method. Furthermore, an element described herein of an apparatus embodiment is an example of a means for carrying out the function performed by the element for the purpose of carrying out the invention.
  • In the description provided herein, numerous specific details are set forth. However, it is understood that embodiments of the invention may be practiced without these specific details. In other instances, well-known methods, structures and techniques have not been shown in detail in order not to obscure an understanding of this description.
  • As used herein, unless otherwise specified, the use of the ordinal adjectives "first", "second", "third", etc., to describe a common object, merely indicate that different instances of like objects are being referred to, and are not intended to imply that the objects so described must be in a given sequence, either temporally, spatially, in ranking, or in any other manner.
  • All U.S. patents, U.S. patent applications, and International (PCT) patent applications designating the United States cited herein are hereby incorporated by reference. In the case the Patent Rules or Statutes do not permit incorporation by reference of material that itself incorporates information by reference, the incorporation by reference of the material herein excludes any information incorporated by reference in such incorporated by reference material, unless such information is explicitly incorporated herein by reference.
  • Any discussion of prior art in this specification should in no way be considered an admission that such prior art is widely known, is publicly known, or forms part of the general knowledge in the field.
  • In the claims below and the description herein, any one of the terms comprising, comprised of or which comprises is an open term that means including at least the elements/features that follow, but not excluding others. Thus, the term comprising, when used in the claims, should not be interpreted as being limitative to the means or elements or steps listed thereafter. For example, the scope of the expression a device comprising A and B should not be limited to devices consisting of only elements A and B. Any one of the terms including or which includes or that includes as used herein is also an open term that also means including at least the elements/features that follow the term, but not excluding others. Thus, including is synonymous with and means comprising.
  • Similarly, it is to be noticed that the term coupled, when used in the claims, should not be interpreted as being limitative to direct connections only. The terms "coupled" and "connected," along with their derivatives, may be used. It should be understood that these terms are not intended as synonyms for each other. Thus, the scope of the expression a device A coupled to a device B should not be limited to devices or systems wherein an output of device A is directly connected to an input of device B. It means that there exists a path between an output of A and an input of B which may be a path including other devices or means. "Coupled" may mean that two or more elements are either in direct physical or electrical contact, or that two or more elements are not in direct contact with each other but yet still co-operate or interact with each other.
  • Thus, while there has been described what are believed to be the preferred embodiments of the invention, those skilled in the art will recognize that other and further modifications may be made thereto without departing from the spirit of the invention, and it is intended to claim all such changes and modifications as fall within the scope of the invention. For example, any formulas given above are merely representative of procedures that may be used. Functionality may be added or deleted from the block diagrams and operations may be interchanged among functional blocks. Steps may be added or deleted to methods described within the scope of the present invention.
  • Some enumerated example embodiments (EEEs) follow:
    • EEE 1. A method of operating a portable media device, the method comprising
      while the portable media device is coupled to a particular playback system, playing back an audio signal on the portable media device and particular playback system combination in a particular listening arrangement while the portable media device applies a particular set of one or more corrective filters selected from a pre-stored collection of one or more sets of corrective filters or the data therefor,
      wherein the collection of one or more sets of corrective filters or the data therefor is pre-stored in or for the portable media device, and each of one or more sets of the collection is associated with a corresponding listening arrangement and a corresponding playback system, and
      wherein the particular set of one or more corrective filters is determined by a calibration process that includes,
      recording on the portable media device a sound field resulting from one or more pre-defined calibration signals being played back on the particular playback system, the recording using a microphone built in or connected to the portable media device while the microphone is at one or more desired listener locations of the particular listening arrangement,
      analyzing the recording of the sound field to determine the particular set of one or more corrective filters at least to equalize for the particular playback system, and
      storing the data for the particular set of one or more corrective filters in or for the portable media device for the particular playback system.
    • EEE 2. The method as recited in EEE 1, wherein the collection of one or more sets of corrective filters or the data therefor is stored remotely from the portable media device and the particular sets of correction filter or data therefor is loaded in the portable media device for playback when or before the portable media device is coupled to the particular playback system.
    • EEE 3. The method as recited in EEE 1, wherein the collection of one or more sets of corrective filters or the data therefor is stored in a storage subsystem included in the portable media device.
    • EEE 4. The method as recited in any preceding EEE, further comprising the media portable device receiving an indication from a user to use the particular set of one or more corrective filters for playback.
    • EEE 5. The method as recited in any preceding EEE, further comprising the portable media device receiving an indication from the particular playback system indicating that particular portable media device is coupled to the particular playback system, and responsive to the indication, the portable media device automatically selecting the particular set of one or more corrective filters associated with the particular portable media device for playback.
    • EEE 6. The method as recited in any preceding EEE, wherein at least one of the sets of corrective filters is a default set predefined for a class of playback systems.
    • EEE 7. The method as recited in any preceding EEE, wherein the storing the particular set of one or more corrective filters or the data therefore in or for the portable media device for the particular playback system includes storing an indicator that the particular set of one or more corrective filters is associated with the particular playback system.
    • EEE 8. The method as recited in any preceding EEE, wherein the portable media device includes a user interface, and wherein the calibration method includes receiving on the user interface an indication from a user to carry out the recording, analyzing, and storing of the particular set of one or more corrective filters or the data therefor.
    • EEE 9. The method as recited in any preceding EEE, wherein portable media device is coupled by a network to a remote processing system, and wherein the analyzing the recording to determine the particular set includes:
      • sending the recorded sound field or data related thereto to the remote processing system,
      • determining the particular set in the remote processing system, and
      • receiving the determined particular set or the data therefor via the network from the remote processing system.
    • EEE 10. The method as recited in any one of EEEs 1 to 8, wherein the analyzing the recording to determine the particular set is carried out by one or more processors included in the portable media device.
    • EEE 11. A method of operating a portable media device, the method comprising
      recording on the portable media device a sound field resulting from one or more pre-defined calibration signals being played back on a particular playback system, the recording using a microphone built in or connected to the portable media device while the microphone is at one or more desired listener locations of a particular listening arrangement;
      analyzing the recording of the sound field to determine a particular set of one or more corrective filters at least to equalize for the particular playback system, and
      storing the data for the particular set of one or more corrective filters in or for the portable media device for the particular playback system,
      such that while the portable media device is coupled to the particular playback system, an audio signal is playable on the portable media device and particular playback system combination in the particular listening arrangement while the portable media device applies the determined particular set of one or more corrective filters.
    • EEE 12. The method as recited in EEE 11, wherein the storing of the data for the particular set of one or more corrective filters is into a pre-stored collection of one or more sets of corrective filters or the data therefor stored in or for the portable media device, each of one or more sets of the collection being associated with a corresponding listening arrangement and a corresponding playback system.
    • EEE 13. The method as recited in EEE 12, wherein at least one of the sets of corrective filters is a default set predefined for a class of playback systems.
    • EEE 14. The method as recited in any one of EEEs 11 to 12, wherein the storing of the particular set of one or more corrective filters or the data therefor is into a storage subsystem remote from the portable media device, such that the particular set of correction filter or data therefor is loaded in the portable media device when or before the portable media device is coupled to the particular playback system for playback of an audio signal.
    • EEE 15. The method as recited in any one of EEEs 11 to 12, wherein storing of the particular set of one or more corrective filters or the data therefor is in a storage subsystem included in the portable media device.
    • EEE 16. The method as recited in any one of EEEs 11 to 13, wherein the storing the particular set of one or more corrective filters or the data therefore in or for the portable media device for the particular playback system includes storing an indicator that the particular set of one or more corrective filters is associated with the particular playback system.
    • EEE 17. The method as recited in any one of EEEs 11 to 16, wherein the portable media device includes a user interface, and wherein the method further comprises receiving on the user interface an indication from a user to carry out the recording, analyzing, and storing of the particular set of one or more corrective filters or the data therefor.
    • EEE 18. The method as recited in any one of EEEs 11 to 17, wherein the portable media device is coupled by a network to a remote processing system, and wherein the analyzing the recording to determine the particular set includes:
      • sending the recorded sound field or data related thereto to the remote processing system,
      • determining the particular set in the remote processing system, and receiving the determined particular set or the data therefor via the network from the remote processing system.
    • EEE 19. The method as recited in any one of EEEs 11 to 17, wherein the analyzing the recording to determine the particular set is carried out by one or more processors included in the portable media device.
    • EEE 20. A portable media device comprising:
      • a playback subsystem configured to play back a selected audio signal;
      • a filter subsystem coupled to the playback subsystem and configured to apply a set of one or more corrective filters to an audio signal during playback of the audio signal;
      • a coupling configured to couple the portable media device to a matching coupling included in a playback system;
      • a user interface configured to accept input from a user; and
      • a microphone or a coupling to a microphone;
      • wherein the filter subsystem is configured to apply a particular set of one or more corrective filters associated with a particular playback system and particular listening arrangement during playback of an audio signal via the particular playback system when the portable media device is coupled to the particular playback system in the particular listening arrangement,
      • wherein the particular set of one or more corrective filters is part of a collection of one or more sets of corrective filters or the data therefor pre-stored in or for the portable media device, each of one or more sets of the collection being associated with a corresponding listening arrangement and a corresponding playback system.
    • EEE 21. The portable media device as recited in EEE 20, wherein the portable media device is configured to:
      • record a sound field resulting from one or more pre-defined calibration signals being played back on the particular playback system, the recording using the microphone in or
      • connected to the portable media device while the microphone is at one or more desired listener locations of the particular listening arrangement;
      • analyze the recording of the sound field to determine the particular set of one or more corrective filters at least to equalize for the particular playback system; and store the data for the particular set of one or more corrective filters in or for the portable media device for the particular playback system.
    • EEE 22. The portable media device as recited in any one of EEEs 20 to 21, further comprising:
      • at least one processor; and
      • a storage subsystem coupled to the filter subsystem and to the at least one processor,
      • wherein applying the particular set of one or more corrective filters includes digitally processing digital signals on at least one of the one or more processors.
    • EEE 23. The portable media device as recited in any one of EEEs 20 to 22, wherein the collection of one or more sets of corrective filters or the data therefor is stored remotely from the portable media device and the particular sets of correction filter or data therefor is loaded in the portable media device for playback when or before the portable media device is coupled to the particular playback system.
    • EEE 24. The portable media device as recited in EEE 22, wherein the collection of one or more sets of corrective filters or the data therefor is stored in the storage subsystem.
    • EEE 25. The portable media device as recited in any one of EEEs 20 to 24, wherein the user interface is configured to receive an indication from a user to use the particular set of one or more corrective filters for playback.
    • EEE 26. The portable media device as recited in any one of EEEs 20 to 25, wherein the portable media device is configured to receive an indication from the particular playback system indicating that the particular portable media device is coupled to the particular playback system, and responsive to the indication, to automatically select the particular set of one or more corrective filters associated with the particular portable media device for playback.
    • EEE 27. The portable media device as recited in any one of EEEs 20 to 26, wherein at least one of the sets of corrective filters is a default set predefined for a class of playback systems.
    • EEE 28. The portable media device as recited in any one of EEEs 21 to 27, wherein the storing the particular set of one or more corrective filters or the data therefore in or for the portable media device for the particular playback system includes storing an indicator that the particular set of one or more corrective filters is associated with the particular playback system.
    • EEE 29. The portable media device as recited in any one of EEEs 21 to 28, wherein the portable media device is configured to receive on the user interface an indication from a user to carry out the recording, analyzing, and storing of the particular set of one or more corrective filters or the data therefor.
    • EEE 30. The portable media device as recited in any one of EEEs 21 to 29, wherein the portable media device includes a network interface to couple the portable media device to a remote processing system via a network, and wherein the portable media device is configured, for the analyzing the recording to determine the particular set, to:
      • send the recorded sound field or data related thereto to the remote processing system such that the remote processing system can determine the particular set, and to receiving the determined particular set or the data therefor via the network from the remote processing system.
    • EEE 31. The portable media device as recited in any one of EEEs 21 and 23 to 29, further comprising:
      • at least one processor,
        wherein the analyzing the recording to determine the particular set is carried out by the at least one processor.
    • EEE 32. A portable media playback device comprising
      means for playing back an audio signal;
      means for filtering configured to apply a set of one or more corrective filters to an audio signal during playback of the audio signal by the means for playing back;
      means for coupling the portable media device to a playback system;
      means for accept input from a user; and
      means for recording a sound field;
      wherein the means for filtering is configured to apply a particular set of one or more corrective filters associated with a particular playback system and particular listening arrangement during playback of an audio signal via the particular playback system when the portable media device is coupled by the means for coupling to the particular playback system in the particular listening arrangement,
      wherein the particular set of one or more corrective filters is part of a collection of one or more sets of corrective filters or the data therefor pre-stored in or for the portable media device, each of one or more sets of the collection being associated with a corresponding listening arrangement and a corresponding playback system.
    • EEE 33. The portable media device as recited in EEE 32, further comprising:
      • means for analyzing a recording of a sound field resulting from one or more pre-defined calibration signals to determine a set of one or more corrective filters; and
      • means for storing the data for a set of one or more corrective filters,
      wherein the means for recording is configured to record a sound field resulting from one or more pre-defined calibration signals being played back on the particular playback system at one or more desired listener locations of the particular listening arrangement, the means for analyzing is configured to analyze the recording of the sound field to determine the particular set of one or more corrective filters at least to equalize for the particular playback system; and the means for storing is configured to store the data for the particular set of one or more corrective filters in or for the portable media device for the particular playback system.
    • EEE 34. The portable media device as recited in any one of EEEs 32 to 33, further comprising means for digitally processing,
      wherein the means for filtering includes digitally processing of a digital signal by the means for digitally processing.
    • EEE 35. The portable media device as recited in any one of EEEs 32 to 34, wherein the collection of one or more sets of corrective filters or the data therefor is stored remotely from the portable media device and the particular sets of correction filter or data therefor is loaded in the portable media device for playback when or before the portable media device is coupled to the particular playback system.
    • EEE 36. The portable media device as recited in EEE 34, wherein the collection of one or more sets of corrective filters or the data therefor is stored in the means for storing.
    • EEE 37. The portable media device as recited in any one of EEEs 32 to 36, wherein the means for accepting input is configured to receive an indication from a user to use the particular set of one or more corrective filters for playback.
    • EEE 38. The portable media device as recited in any one of EEEs 32 to 37, wherein the portable media device is configured to receive an indication from the particular playback system indicating that particular portable media device is coupled to the particular playback system, and responsive to the indication, to automatically select the particular set of one or more corrective filters associated with the particular portable media device for playback.
    • EEE 39. The portable media device as recited in any one of EEEs 32 to 38, wherein at least one of the sets of corrective filters is a default set predefined for a class of playback systems.
    • EEE 40. The portable media device as recited in any one of EEEs 33 to 39, wherein the storing the particular set of one or more corrective filters or the data therefore in or for the portable media device for the particular playback system includes storing an indicator that the particular set of one or more corrective filters is associated with the particular playback system.
    • EEE 41. The portable media device as recited in any one of EEEs 33 to 40, wherein the portable media device is configured to receive on the means for accepting input an indication from a user to carry out the recording, analyzing, and storing of the particular set of one or more corrective filters or the data therefor.
    • EEE 42. The portable media device as recited in any one of EEEs 33 to 41, wherein portable media device includes means for interfacing to a network to couple the portable media device to a remote processing system via a network, and wherein the portable media device is configured, for the analyzing the recording to determine the particular set, to:
      • send the recorded sound field or data related thereto to the remote processing system such that the remote processing system can determine the particular set, and receive the determined particular set or the data therefor via the network from the remote processing system.
    • EEE 43. The portable media device as recited in any one of EEEs 33 and 35 to 41, further comprising:
      • means for digitally processing,
      wherein the means for analyzing the recording to determine the particular set uses the means for digitally processing.

Claims (15)

  1. A method of operating a portable media device that includes a filter subsystem, the method comprising:
    carrying out a calibration method for a first listening arrangement in order to pre-store on or for the portable media device a first set of one or more corrective filters corresponding to the first listening arrangement, the first listening arrangement including the portable media device and a first playback system having a first input to which the output of the portable media device is coupled, the coupling being direct, by wire, wireless, or by network, the first playback system being distinct and separable from the portable media device and including a first amplifier and a first set of at least one loudspeaker, the calibration method for the first listening arrangement comprising:
    (a) recording on the portable media device a sound field resulting from one or more calibration signals of known or determinable characteristics being played back on the portable media device while the output of the portable media device is coupled either directly, by wire, wirelessly, or by network to the first input of the first playback system, the recording using a microphone built in or connected to the portable media device while the microphone is at one or more listener locations of the first listening arrangement;
    (b) analyzing the recording of the sound field to determine a first set of one or more corrective filters at least to equalize for playback from the portable media device via the first playback system in the first listening arrangement, the analysis being carried out on the portable media device or on a remote processing system coupled to the portable media device, such that the analysis does not require the separate first playback system, and
    (c) pre-storing the data for the first set of one or more corrective filters in or for the portable media device for the first listening arrangement that includes the separate first playback system.
    such that while the portable media device is coupled either directly, by wire, wirelessly, or by network to the first input of the first playback system of the first listening arrangement, and while an audio signal is played back on the portable media device via the first playback system that is distinct and separable from the portable media device in said first listening arrangement, the filter subsystem of the portable media device applies the pre-stored first set of one or more corrective filters corresponding to said each listening arrangement, in order that a listener at a listening location of said first listening arrangement listens to the audio signal after correction for the first listening arrangement without requiring the first playback system of said listening arrangement to have the capability of carrying out any corrective filtering.
  2. The method as recited in claim 1, wherein the pre-storing of the first set of one or more corrective filters or the data therefor in or for the portable media device for the first playback system in the first listening arrangement includes pre-storing an indicator that the first set of one or more corrective filters is associated with the first listening arrangement that includes the first playback system.
  3. The method as recited in any previous claim, wherein the portable media device includes a user interface, and wherein the calibration method for the first listening environment includes receiving on the user interface an indication from a user to carry out the recording, analyzing to determine, and pre-storing of the first set of one or more corrective filters or the data therefor.
  4. The method as recited in any previous claim, wherein the portable media device is coupled by a network to a remote processing system, and wherein the analyzing a recorded sound field to determine the first set includes:
    sending the recorded sound field or data related thereto to the remote processing system,
    determining the first set in the remote processing system, and
    receiving the determined first set or the data therefor via the network from the remote processing system.
  5. The method as recited in any one of claims 1 to 3, wherein the analyzing a recorded sound field to determine the first set is carried out by one or more processors included in the portable media device.
  6. The method as recited in any previous claim, wherein the first set of one or more corrective filters or the data therefor are stored in a storage subsystem included in the portable media device.
  7. The method as recited in any one of claims 1 to 5, wherein the pre-storing of the first set of one or more corrective filters or the data therefor is into a storage subsystem remote from the portable media device, such that the first set of correction filter or data therefor is loaded in the portable media device when or before the portable media device is coupled to the first playback system in the first listening arrangement for playback of an audio signal.
  8. The method as recited in any previous claim, wherein the portable media device has stored therein or therefor a plurality of sets of one or more corrective filters, including the first set, and wherein at least one of the plurality of sets of one or more corrective filters is a default set predefined for a class of listening arrangements with respective remote playback systems, such that the portable media system can play back signals with correction for any one of the class of listening arrangements without any device other than the portable media device in said any one of the class of listening arrangements required to have the capability of carrying out any corrective filtering.
  9. The method as recited in any previous claim, wherein carrying out the calibration method further comprises:
    (d) repeating the calibration method comprising steps (a) to (c) for at least a second listening arrangement, such that for each of a plurality of listening arrangements, there is pre-stored in or for the portable media device a corresponding set of one or more corrective filters, such that the portable media system can play back signals with correction for any one of the plurality of listening arrangements without any device other than the portable media device in said any one of the plurality of listening arrangements required to have the capability of carrying out any corrective filtering.
  10. The method as recited in any previous claim, further comprising:
    while the portable media device is coupled to the input of a playback system of a listening arrangement which there is pre-stored a corresponding set of one or more corrective filters, the playback system being distinct and separable from the portable media device:
    playing back a selected audio signal on the portable media device via the playback system in the listening arrangement; and
    during the playing back, applying the pre-stored set of one or more corrective filters for the listening arrangement by the filter subsystem of the portable media device,
    such that a listener at a listening location of said listening arrangement listens to the selected audio signal after correction for the listening arrangement without requiring any element of the listening arrangement other than the portable media device to have any corrective filtering capability.
  11. The method as recited in any previous claim, wherein the portable media device is part of a portable telephone device that is capable of playback of media signals including audio signals.
  12. A non-transitory computer-readable medium with instructions stored thereon that when executed by one or more processors included in a portable media device that includes a filter subsystem, cause carrying out a method of operating the portable media device, the method as recited in any previous claim.
  13. A portable media device comprising:
    a playback subsystem configured to play back a selected audio signal;
    a user interface configured to accept input from a user;
    a microphone or a coupling to a microphone;
    a filter subsystem coupled to the playback subsystem and configured to apply a first set of one or more corrective filters to the output of the playback subsystem during playback of the audio signal to generate a first filtered selected audio signal;
    means for carrying out a calibration method, including carrying out a first calibration method for a first listening arrangement in order to pre-store on or for the portable media device the first set of one or more corrective filters corresponding to the first listening arrangement, the first listening arrangement including a first playback system separate from and remote to the portable media device, the first playback system comprising a first amplifier and a first set of at least one loudspeaker; and
    a coupling configured to accept the first filtered selected audio signal from the portable media device and input the first filtered selected audio signal to a matching coupling included in the first playback system, such that a listener at a listening position in the first listening arrangement can hear the first filtered selected audio signal played back via the first playback system;
    wherein the calibration method is as recited in the method of any one of claims 1 to 9.
  14. The portable media device as recited in claim 13, further comprising:
    one or more processors; and
    a storage subsystem coupled to the filter subsystem and to at least one processor of the one or more processors,
    wherein applying the first set of one or more corrective filters includes digitally processing digital signals on at least one of the one or more processors.
  15. The portable media device as recited in any one of claims 13 to 14, comprising components to enable the portable media device to operate as a portable telephone.
EP15178118.4A 2010-05-06 2011-04-13 Audio system equalization for portable media playback devices Not-in-force EP2986034B1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US33215910P 2010-05-06 2010-05-06
EP11717394.8A EP2567554B1 (en) 2010-05-06 2011-04-13 Determination and use of corrective filters for portable media playback devices

Related Parent Applications (2)

Application Number Title Priority Date Filing Date
EP11717394.8A Division-Into EP2567554B1 (en) 2010-05-06 2011-04-13 Determination and use of corrective filters for portable media playback devices
EP11717394.8A Division EP2567554B1 (en) 2010-05-06 2011-04-13 Determination and use of corrective filters for portable media playback devices

Publications (2)

Publication Number Publication Date
EP2986034A1 true EP2986034A1 (en) 2016-02-17
EP2986034B1 EP2986034B1 (en) 2017-05-31

Family

ID=44146859

Family Applications (2)

Application Number Title Priority Date Filing Date
EP11717394.8A Not-in-force EP2567554B1 (en) 2010-05-06 2011-04-13 Determination and use of corrective filters for portable media playback devices
EP15178118.4A Not-in-force EP2986034B1 (en) 2010-05-06 2011-04-13 Audio system equalization for portable media playback devices

Family Applications Before (1)

Application Number Title Priority Date Filing Date
EP11717394.8A Not-in-force EP2567554B1 (en) 2010-05-06 2011-04-13 Determination and use of corrective filters for portable media playback devices

Country Status (6)

Country Link
EP (2) EP2567554B1 (en)
JP (3) JP2013530420A (en)
CN (1) CN102893633B (en)
ES (1) ES2632576T3 (en)
HK (1) HK1221845A1 (en)
WO (1) WO2011139502A1 (en)

Cited By (50)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018027156A1 (en) * 2016-08-05 2018-02-08 Sonos, Inc. Determining direction of networked microphone device relative to audio playback device
US11005440B2 (en) 2017-10-04 2021-05-11 Google Llc Methods and systems for automatically equalizing audio output based on room position
US11200889B2 (en) 2018-11-15 2021-12-14 Sonos, Inc. Dilated convolutions and gating for efficient keyword spotting
US11200894B2 (en) 2019-06-12 2021-12-14 Sonos, Inc. Network microphone device with command keyword eventing
US11212612B2 (en) 2016-02-22 2021-12-28 Sonos, Inc. Voice control of a media playback system
US11288039B2 (en) 2017-09-29 2022-03-29 Sonos, Inc. Media playback system with concurrent voice assistance
US11308958B2 (en) 2020-02-07 2022-04-19 Sonos, Inc. Localized wakeword verification
US11315556B2 (en) 2019-02-08 2022-04-26 Sonos, Inc. Devices, systems, and methods for distributed voice processing by transmitting sound data associated with a wake word to an appropriate device for identification
US11343614B2 (en) 2018-01-31 2022-05-24 Sonos, Inc. Device designation of playback and network microphone device arrangements
US11361756B2 (en) 2019-06-12 2022-06-14 Sonos, Inc. Conditional wake word eventing based on environment
US11405430B2 (en) 2016-02-22 2022-08-02 Sonos, Inc. Networked microphone device control
US11432030B2 (en) 2018-09-14 2022-08-30 Sonos, Inc. Networked devices, systems, and methods for associating playback devices based on sound codes
US11482224B2 (en) 2020-05-20 2022-10-25 Sonos, Inc. Command keywords with input detection windowing
US11482978B2 (en) 2018-08-28 2022-10-25 Sonos, Inc. Audio notifications
US11501773B2 (en) 2019-06-12 2022-11-15 Sonos, Inc. Network microphone device with command keyword conditioning
US11500611B2 (en) 2017-09-08 2022-11-15 Sonos, Inc. Dynamic computation of system response volume
US11513763B2 (en) 2016-02-22 2022-11-29 Sonos, Inc. Audio response playback
US11514898B2 (en) 2016-02-22 2022-11-29 Sonos, Inc. Voice control of a media playback system
US11531520B2 (en) 2016-08-05 2022-12-20 Sonos, Inc. Playback device supporting concurrent voice assistants
US11538460B2 (en) 2018-12-13 2022-12-27 Sonos, Inc. Networked microphone devices, systems, and methods of localized arbitration
US11540047B2 (en) 2018-12-20 2022-12-27 Sonos, Inc. Optimization of network microphone devices using noise classification
US11538451B2 (en) 2017-09-28 2022-12-27 Sonos, Inc. Multi-channel acoustic echo cancellation
US11545169B2 (en) 2016-06-09 2023-01-03 Sonos, Inc. Dynamic player selection for audio signal processing
US11551669B2 (en) 2019-07-31 2023-01-10 Sonos, Inc. Locally distributed keyword detection
US11557294B2 (en) 2018-12-07 2023-01-17 Sonos, Inc. Systems and methods of operating media playback systems having multiple voice assistant services
US11556306B2 (en) 2016-02-22 2023-01-17 Sonos, Inc. Voice controlled media playback system
US11563842B2 (en) 2018-08-28 2023-01-24 Sonos, Inc. Do not disturb feature for audio notifications
US11562740B2 (en) 2020-01-07 2023-01-24 Sonos, Inc. Voice verification for media playback
US11641559B2 (en) 2016-09-27 2023-05-02 Sonos, Inc. Audio playback settings for voice interaction
US11646045B2 (en) 2017-09-27 2023-05-09 Sonos, Inc. Robust short-time fourier transform acoustic echo cancellation during audio playback
US11646023B2 (en) 2019-02-08 2023-05-09 Sonos, Inc. Devices, systems, and methods for distributed voice processing
US11696074B2 (en) 2018-06-28 2023-07-04 Sonos, Inc. Systems and methods for associating playback devices with voice assistant services
US11694689B2 (en) 2020-05-20 2023-07-04 Sonos, Inc. Input detection windowing
US11698771B2 (en) 2020-08-25 2023-07-11 Sonos, Inc. Vocal guidance engines for playback devices
US11710487B2 (en) 2019-07-31 2023-07-25 Sonos, Inc. Locally distributed keyword detection
US11714600B2 (en) 2019-07-31 2023-08-01 Sonos, Inc. Noise classification for event detection
US11727919B2 (en) 2020-05-20 2023-08-15 Sonos, Inc. Memory allocation for keyword spotting engines
US11726742B2 (en) 2016-02-22 2023-08-15 Sonos, Inc. Handling of loss of pairing between networked devices
US11727936B2 (en) 2018-09-25 2023-08-15 Sonos, Inc. Voice detection optimization based on selected voice assistant service
US11727933B2 (en) 2016-10-19 2023-08-15 Sonos, Inc. Arbitration-based voice recognition
US11769505B2 (en) 2017-09-28 2023-09-26 Sonos, Inc. Echo of tone interferance cancellation using two acoustic echo cancellers
US11790911B2 (en) 2018-09-28 2023-10-17 Sonos, Inc. Systems and methods for selective wake word detection using neural network models
US11790937B2 (en) 2018-09-21 2023-10-17 Sonos, Inc. Voice detection optimization using sound metadata
US11792590B2 (en) 2018-05-25 2023-10-17 Sonos, Inc. Determining and adapting to changes in microphone performance of playback devices
US11798553B2 (en) 2019-05-03 2023-10-24 Sonos, Inc. Voice assistant persistence across multiple network microphone devices
US11797263B2 (en) 2018-05-10 2023-10-24 Sonos, Inc. Systems and methods for voice-assisted media content selection
US11862161B2 (en) 2019-10-22 2024-01-02 Sonos, Inc. VAS toggle based on device orientation
US11869503B2 (en) 2019-12-20 2024-01-09 Sonos, Inc. Offline voice control
US11899519B2 (en) 2018-10-23 2024-02-13 Sonos, Inc. Multiple stage network microphone device with reduced power consumption and processing load
US11900937B2 (en) 2017-08-07 2024-02-13 Sonos, Inc. Wake-word detection suppression

Families Citing this family (63)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8788080B1 (en) 2006-09-12 2014-07-22 Sonos, Inc. Multi-channel pairing in a media system
US9202509B2 (en) 2006-09-12 2015-12-01 Sonos, Inc. Controlling and grouping in a multi-zone media system
US8483853B1 (en) 2006-09-12 2013-07-09 Sonos, Inc. Controlling and manipulating groupings in a multi-zone media system
US11265652B2 (en) 2011-01-25 2022-03-01 Sonos, Inc. Playback device pairing
US11429343B2 (en) 2011-01-25 2022-08-30 Sonos, Inc. Stereo playback configuration and control
GB201121075D0 (en) * 2011-12-08 2012-01-18 Sontia Logic Ltd Correcting non-linear frequency response
US9661413B2 (en) 2011-12-16 2017-05-23 Avnera Corporation Acoustic layer in media device providing enhanced audio performance
US9204211B2 (en) * 2011-12-16 2015-12-01 Avnera Corporation Pad-type device case providing enhanced audio functionality and output
US9729960B1 (en) 2011-12-16 2017-08-08 Avnera Corporation Audio layer in keyboard device providing enhanced audio performance
US9998819B2 (en) 2011-12-16 2018-06-12 Avnera Corporation Audio layer in keyboard device providing enhanced audio performance
US9084058B2 (en) 2011-12-29 2015-07-14 Sonos, Inc. Sound field calibration using listener localization
US9654821B2 (en) 2011-12-30 2017-05-16 Sonos, Inc. Systems and methods for networked music playback
RU2626037C2 (en) * 2012-02-24 2017-07-21 Фраунхофер-Гезелльшафт Цур Фердерунг Дер Ангевандтен Форшунг Е.Ф. Device for audio playback by transducer, system, method (versions) and computer program
US9020161B2 (en) 2012-03-08 2015-04-28 Harman International Industries, Incorporated System for headphone equalization
US9674587B2 (en) 2012-06-26 2017-06-06 Sonos, Inc. Systems and methods for networked music playback including remote add to queue
US9106192B2 (en) 2012-06-28 2015-08-11 Sonos, Inc. System and method for device playback calibration
US9706323B2 (en) 2014-09-09 2017-07-11 Sonos, Inc. Playback device calibration
US9219460B2 (en) 2014-03-17 2015-12-22 Sonos, Inc. Audio settings based on environment
US9690539B2 (en) 2012-06-28 2017-06-27 Sonos, Inc. Speaker calibration user interface
EP2823650B1 (en) * 2012-08-29 2020-07-29 Huawei Technologies Co., Ltd. Audio rendering system
US9247363B2 (en) 2013-04-16 2016-01-26 Sonos, Inc. Playback queue transfer in a media playback system
US9501533B2 (en) 2013-04-16 2016-11-22 Sonos, Inc. Private queue for a media playback system
US9361371B2 (en) 2013-04-16 2016-06-07 Sonos, Inc. Playlist update in a media playback system
US9684484B2 (en) 2013-05-29 2017-06-20 Sonos, Inc. Playback zone silent connect
US10319389B2 (en) 2013-07-22 2019-06-11 Harman Becker Automotive Systems Gmbh Automatic timbre control
US10135413B2 (en) 2013-07-22 2018-11-20 Harman Becker Automotive Systems Gmbh Automatic timbre control
US20150095679A1 (en) 2013-09-30 2015-04-02 Sonos, Inc. Transitioning A Networked Playback Device Between Operating Modes
US9264839B2 (en) 2014-03-17 2016-02-16 Sonos, Inc. Playback device configuration based on proximity detection
US10127006B2 (en) 2014-09-09 2018-11-13 Sonos, Inc. Facilitating calibration of an audio playback device
US9952825B2 (en) 2014-09-09 2018-04-24 Sonos, Inc. Audio processing algorithms
US9891881B2 (en) 2014-09-09 2018-02-13 Sonos, Inc. Audio processing algorithm database
JP6503457B2 (en) * 2014-09-09 2019-04-17 ソノズ インコーポレイテッド Audio processing algorithm and database
US9910634B2 (en) * 2014-09-09 2018-03-06 Sonos, Inc. Microphone calibration
US9916836B2 (en) * 2015-03-23 2018-03-13 Microsoft Technology Licensing, Llc Replacing an encoded audio output signal
WO2016157388A1 (en) * 2015-03-30 2016-10-06 パイオニア株式会社 Mobile terminal, server, method for providing sound field data, and program
WO2016172593A1 (en) 2015-04-24 2016-10-27 Sonos, Inc. Playback device calibration user interfaces
US10664224B2 (en) 2015-04-24 2020-05-26 Sonos, Inc. Speaker calibration user interface
US10248376B2 (en) 2015-06-11 2019-04-02 Sonos, Inc. Multiple groupings in a playback system
US9794719B2 (en) * 2015-06-15 2017-10-17 Harman International Industries, Inc. Crowd sourced audio data for venue equalization
US9538305B2 (en) 2015-07-28 2017-01-03 Sonos, Inc. Calibration error conditions
US9913056B2 (en) 2015-08-06 2018-03-06 Dolby Laboratories Licensing Corporation System and method to enhance speakers connected to devices with microphones
KR102351368B1 (en) 2015-08-12 2022-01-14 삼성전자주식회사 Method and apparatus for outputting audio in an electronic device
CN108028985B (en) * 2015-09-17 2020-03-13 搜诺思公司 Method for computing device
US9693165B2 (en) 2015-09-17 2017-06-27 Sonos, Inc. Validation of audio calibration using multi-dimensional motion check
US9743207B1 (en) 2016-01-18 2017-08-22 Sonos, Inc. Calibration using multiple recording devices
US10003899B2 (en) 2016-01-25 2018-06-19 Sonos, Inc. Calibration with particular locations
US11106423B2 (en) 2016-01-25 2021-08-31 Sonos, Inc. Evaluating calibration of a playback device
US9991862B2 (en) * 2016-03-31 2018-06-05 Bose Corporation Audio system equalizing
US9860662B2 (en) 2016-04-01 2018-01-02 Sonos, Inc. Updating playback device configuration information based on calibration data
US9864574B2 (en) 2016-04-01 2018-01-09 Sonos, Inc. Playback device calibration based on representation spectral characteristics
US9763018B1 (en) 2016-04-12 2017-09-12 Sonos, Inc. Calibration of audio playback devices
US10547947B2 (en) * 2016-05-18 2020-01-28 Qualcomm Incorporated Device for generating audio output
US9860670B1 (en) 2016-07-15 2018-01-02 Sonos, Inc. Spectral correction using spatial calibration
WO2018013959A1 (en) * 2016-07-15 2018-01-18 Sonos, Inc. Spectral correction using spatial calibration
US9794710B1 (en) 2016-07-15 2017-10-17 Sonos, Inc. Spatial audio correction
US10372406B2 (en) 2016-07-22 2019-08-06 Sonos, Inc. Calibration interface
US10459684B2 (en) 2016-08-05 2019-10-29 Sonos, Inc. Calibration of a playback device based on an estimated frequency response
US10712997B2 (en) 2016-10-17 2020-07-14 Sonos, Inc. Room association based on name
US11039244B2 (en) 2018-06-06 2021-06-15 Dolby Laboratories Licensing Corporation Manual characterization of perceived transducer distortion
US10299061B1 (en) 2018-08-28 2019-05-21 Sonos, Inc. Playback device calibration
US11206484B2 (en) 2018-08-28 2021-12-21 Sonos, Inc. Passive speaker authentication
US10932079B2 (en) 2019-02-04 2021-02-23 Harman International Industries, Incorporated Acoustical listening area mapping and frequency correction
US10734965B1 (en) 2019-08-12 2020-08-04 Sonos, Inc. Audio calibration of a portable playback device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050254662A1 (en) * 2004-05-14 2005-11-17 Microsoft Corporation System and method for calibration of an acoustic system
EP1677573A2 (en) * 2004-12-30 2006-07-05 Harman International Industries, Incorporated Equalization system to improve the quality of bass sounds within a listening area
US20070142942A1 (en) * 2005-12-16 2007-06-21 Sony Ericsson Mobile Communications Ab Audio profiles for portable music playback device
WO2009134537A2 (en) * 2008-05-02 2009-11-05 Bose Corporation Detecting a loudspeaker configuration

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001005464A (en) * 1999-06-21 2001-01-12 Matsushita Electric Ind Co Ltd Method of controlling sound field
EP1516514A1 (en) * 2002-06-12 2005-03-23 Equtech APS Method of digital equalisation of a sound from loudspeakers in rooms and use of the method
JP2005070171A (en) * 2003-08-20 2005-03-17 Fujitsu Ten Ltd Characteristic arithmetic facility
WO2005041618A1 (en) * 2003-10-24 2005-05-06 Koninklijke Philips Electronics N.V. Adaptive sound reproduction
KR100678929B1 (en) * 2003-11-24 2007-02-07 삼성전자주식회사 Method For Playing Multi-Channel Digital Sound, And Apparatus For The Same
JP4281601B2 (en) * 2004-03-30 2009-06-17 ブラザー工業株式会社 Information communication system, communication karaoke terminal, distribution host device and program
JP2006005902A (en) * 2004-05-20 2006-01-05 Denon Ltd Amplifier and amplitude frequency characteristics adjusting method
JP2006279863A (en) * 2005-03-30 2006-10-12 Clarion Co Ltd Correction method of head-related transfer function
JP4407571B2 (en) * 2005-06-06 2010-02-03 株式会社デンソー In-vehicle system, vehicle interior sound field adjustment system, and portable terminal
JP4232775B2 (en) * 2005-11-11 2009-03-04 ソニー株式会社 Sound field correction device
US20070155332A1 (en) * 2005-12-30 2007-07-05 Burgan John M Method and mobile communication device for characterizing an audio accessory for use with the mobile communication device
JP4862448B2 (en) * 2006-03-27 2012-01-25 株式会社Jvcケンウッド Audio system, portable information processing apparatus, audio apparatus, and sound field correction method
US20100020846A1 (en) 2006-06-19 2010-01-28 Michael Kagan Irreversible Coolness Indicator
JP4466658B2 (en) * 2007-02-05 2010-05-26 ソニー株式会社 Signal processing apparatus, signal processing method, and program
JP2008227681A (en) * 2007-03-09 2008-09-25 Yamaha Corp Acoustic characteristic correction system
JP5338038B2 (en) * 2007-05-23 2013-11-13 ヤマハ株式会社 Sound field correction apparatus and karaoke apparatus
JP4955460B2 (en) * 2007-05-30 2012-06-20 京セラ株式会社 Electronics
JP2009060209A (en) * 2007-08-30 2009-03-19 Kenwood Corp Playback apparatus, program, and frequency characteristics adjustment method in the playback apparatus
JP2009164943A (en) * 2008-01-08 2009-07-23 Pioneer Electronic Corp Acoustic device, sound field correcting method, sound field correcting program and its record medium
DE102008039330A1 (en) * 2008-01-31 2009-08-13 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for calculating filter coefficients for echo cancellation

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050254662A1 (en) * 2004-05-14 2005-11-17 Microsoft Corporation System and method for calibration of an acoustic system
EP1677573A2 (en) * 2004-12-30 2006-07-05 Harman International Industries, Incorporated Equalization system to improve the quality of bass sounds within a listening area
US20070142942A1 (en) * 2005-12-16 2007-06-21 Sony Ericsson Mobile Communications Ab Audio profiles for portable music playback device
WO2009134537A2 (en) * 2008-05-02 2009-11-05 Bose Corporation Detecting a loudspeaker configuration

Cited By (61)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11750969B2 (en) 2016-02-22 2023-09-05 Sonos, Inc. Default playback device designation
US11556306B2 (en) 2016-02-22 2023-01-17 Sonos, Inc. Voice controlled media playback system
US11514898B2 (en) 2016-02-22 2022-11-29 Sonos, Inc. Voice control of a media playback system
US11212612B2 (en) 2016-02-22 2021-12-28 Sonos, Inc. Voice control of a media playback system
US11513763B2 (en) 2016-02-22 2022-11-29 Sonos, Inc. Audio response playback
US11726742B2 (en) 2016-02-22 2023-08-15 Sonos, Inc. Handling of loss of pairing between networked devices
US11863593B2 (en) 2016-02-22 2024-01-02 Sonos, Inc. Networked microphone device control
US11832068B2 (en) 2016-02-22 2023-11-28 Sonos, Inc. Music service selection
US11736860B2 (en) 2016-02-22 2023-08-22 Sonos, Inc. Voice control of a media playback system
US11405430B2 (en) 2016-02-22 2022-08-02 Sonos, Inc. Networked microphone device control
US11545169B2 (en) 2016-06-09 2023-01-03 Sonos, Inc. Dynamic player selection for audio signal processing
US11531520B2 (en) 2016-08-05 2022-12-20 Sonos, Inc. Playback device supporting concurrent voice assistants
WO2018027156A1 (en) * 2016-08-05 2018-02-08 Sonos, Inc. Determining direction of networked microphone device relative to audio playback device
US11641559B2 (en) 2016-09-27 2023-05-02 Sonos, Inc. Audio playback settings for voice interaction
US11727933B2 (en) 2016-10-19 2023-08-15 Sonos, Inc. Arbitration-based voice recognition
US11900937B2 (en) 2017-08-07 2024-02-13 Sonos, Inc. Wake-word detection suppression
US11500611B2 (en) 2017-09-08 2022-11-15 Sonos, Inc. Dynamic computation of system response volume
US11646045B2 (en) 2017-09-27 2023-05-09 Sonos, Inc. Robust short-time fourier transform acoustic echo cancellation during audio playback
US11769505B2 (en) 2017-09-28 2023-09-26 Sonos, Inc. Echo of tone interferance cancellation using two acoustic echo cancellers
US11538451B2 (en) 2017-09-28 2022-12-27 Sonos, Inc. Multi-channel acoustic echo cancellation
US11288039B2 (en) 2017-09-29 2022-03-29 Sonos, Inc. Media playback system with concurrent voice assistance
US11893308B2 (en) 2017-09-29 2024-02-06 Sonos, Inc. Media playback system with concurrent voice assistance
US11888456B2 (en) 2017-10-04 2024-01-30 Google Llc Methods and systems for automatically equalizing audio output based on room position
US11005440B2 (en) 2017-10-04 2021-05-11 Google Llc Methods and systems for automatically equalizing audio output based on room position
US11689858B2 (en) 2018-01-31 2023-06-27 Sonos, Inc. Device designation of playback and network microphone device arrangements
US11343614B2 (en) 2018-01-31 2022-05-24 Sonos, Inc. Device designation of playback and network microphone device arrangements
US11797263B2 (en) 2018-05-10 2023-10-24 Sonos, Inc. Systems and methods for voice-assisted media content selection
US11792590B2 (en) 2018-05-25 2023-10-17 Sonos, Inc. Determining and adapting to changes in microphone performance of playback devices
US11696074B2 (en) 2018-06-28 2023-07-04 Sonos, Inc. Systems and methods for associating playback devices with voice assistant services
US11482978B2 (en) 2018-08-28 2022-10-25 Sonos, Inc. Audio notifications
US11563842B2 (en) 2018-08-28 2023-01-24 Sonos, Inc. Do not disturb feature for audio notifications
US11432030B2 (en) 2018-09-14 2022-08-30 Sonos, Inc. Networked devices, systems, and methods for associating playback devices based on sound codes
US11778259B2 (en) 2018-09-14 2023-10-03 Sonos, Inc. Networked devices, systems and methods for associating playback devices based on sound codes
US11790937B2 (en) 2018-09-21 2023-10-17 Sonos, Inc. Voice detection optimization using sound metadata
US11727936B2 (en) 2018-09-25 2023-08-15 Sonos, Inc. Voice detection optimization based on selected voice assistant service
US11790911B2 (en) 2018-09-28 2023-10-17 Sonos, Inc. Systems and methods for selective wake word detection using neural network models
US11899519B2 (en) 2018-10-23 2024-02-13 Sonos, Inc. Multiple stage network microphone device with reduced power consumption and processing load
US11200889B2 (en) 2018-11-15 2021-12-14 Sonos, Inc. Dilated convolutions and gating for efficient keyword spotting
US11741948B2 (en) 2018-11-15 2023-08-29 Sonos Vox France Sas Dilated convolutions and gating for efficient keyword spotting
US11557294B2 (en) 2018-12-07 2023-01-17 Sonos, Inc. Systems and methods of operating media playback systems having multiple voice assistant services
US11538460B2 (en) 2018-12-13 2022-12-27 Sonos, Inc. Networked microphone devices, systems, and methods of localized arbitration
US11540047B2 (en) 2018-12-20 2022-12-27 Sonos, Inc. Optimization of network microphone devices using noise classification
US11646023B2 (en) 2019-02-08 2023-05-09 Sonos, Inc. Devices, systems, and methods for distributed voice processing
US11315556B2 (en) 2019-02-08 2022-04-26 Sonos, Inc. Devices, systems, and methods for distributed voice processing by transmitting sound data associated with a wake word to an appropriate device for identification
US11798553B2 (en) 2019-05-03 2023-10-24 Sonos, Inc. Voice assistant persistence across multiple network microphone devices
US11854547B2 (en) 2019-06-12 2023-12-26 Sonos, Inc. Network microphone device with command keyword eventing
US11200894B2 (en) 2019-06-12 2021-12-14 Sonos, Inc. Network microphone device with command keyword eventing
US11501773B2 (en) 2019-06-12 2022-11-15 Sonos, Inc. Network microphone device with command keyword conditioning
US11361756B2 (en) 2019-06-12 2022-06-14 Sonos, Inc. Conditional wake word eventing based on environment
US11714600B2 (en) 2019-07-31 2023-08-01 Sonos, Inc. Noise classification for event detection
US11710487B2 (en) 2019-07-31 2023-07-25 Sonos, Inc. Locally distributed keyword detection
US11551669B2 (en) 2019-07-31 2023-01-10 Sonos, Inc. Locally distributed keyword detection
US11862161B2 (en) 2019-10-22 2024-01-02 Sonos, Inc. VAS toggle based on device orientation
US11869503B2 (en) 2019-12-20 2024-01-09 Sonos, Inc. Offline voice control
US11562740B2 (en) 2020-01-07 2023-01-24 Sonos, Inc. Voice verification for media playback
US11961519B2 (en) 2020-02-07 2024-04-16 Sonos, Inc. Localized wakeword verification
US11308958B2 (en) 2020-02-07 2022-04-19 Sonos, Inc. Localized wakeword verification
US11727919B2 (en) 2020-05-20 2023-08-15 Sonos, Inc. Memory allocation for keyword spotting engines
US11694689B2 (en) 2020-05-20 2023-07-04 Sonos, Inc. Input detection windowing
US11482224B2 (en) 2020-05-20 2022-10-25 Sonos, Inc. Command keywords with input detection windowing
US11698771B2 (en) 2020-08-25 2023-07-11 Sonos, Inc. Vocal guidance engines for playback devices

Also Published As

Publication number Publication date
JP2017194703A (en) 2017-10-26
EP2567554B1 (en) 2016-03-23
CN102893633B (en) 2015-04-15
WO2011139502A1 (en) 2011-11-10
EP2986034B1 (en) 2017-05-31
JP2013530420A (en) 2013-07-25
EP2567554A1 (en) 2013-03-13
JP2015180954A (en) 2015-10-15
HK1221845A1 (en) 2017-06-09
JP6377018B2 (en) 2018-08-22
CN102893633A (en) 2013-01-23
ES2632576T3 (en) 2017-09-14

Similar Documents

Publication Publication Date Title
EP2986034B1 (en) Audio system equalization for portable media playback devices
US9307340B2 (en) Audio system equalization for portable media playback devices
US20180199144A1 (en) Systems and methods for calibrating speakers
TW201142831A (en) Adaptive environmental noise compensation for audio playback
US20120230501A1 (en) auditory test and compensation method
US10368154B2 (en) Systems, devices and methods for executing a digital audiogram
US20180098720A1 (en) A Method and Device for Conducting a Self-Administered Hearing Test
CN109274909A (en) Television sound method of adjustment, television set and storage medium
US11558697B2 (en) Method to acquire preferred dynamic range function for speech enhancement
US20190320268A1 (en) Systems, devices and methods for executing a digital audiogram
CN112954115B (en) Volume adjusting method and device, electronic equipment and storage medium
JP2020109968A (en) Customized audio processing based on user-specific audio information and hardware-specific audio information
CN108781336A (en) Hearing devices are voluntarily equipped with
CN112954563A (en) Signal processing method, electronic device, apparatus and storage medium
EP2560413A1 (en) Audio device and audio producing method
CN110248268A (en) A kind of wireless headset noise-reduction method, system and wireless headset and storage medium
US11082795B2 (en) Electronic apparatus and control method thereof
CN111782859A (en) Audio visualization method and device and storage medium
CN109286869A (en) Audio method of adjustment and equipment suitable for earphone
CN112602335A (en) Tone quality enhancement and personalization
US20130083932A1 (en) Methods and systems for measuring and reporting an energy level of a sound component within a sound mix
JP2023519596A (en) Systems and methods for enhancing audio in changing environments
CN111048107A (en) Audio processing method and device

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AC Divisional application: reference to earlier application

Ref document number: 2567554

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

17P Request for examination filed

Effective date: 20160817

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: DOLBY LABORATORIES LICENSING CORPORATION

INTG Intention to grant announced

Effective date: 20161019

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

GRAJ Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR1

GRAL Information related to payment of fee for publishing/printing deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR3

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

GRAJ Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR1

GRAL Information related to payment of fee for publishing/printing deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR3

GRAR Information related to intention to grant a patent recorded

Free format text: ORIGINAL CODE: EPIDOSNIGR71

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTC Intention to grant announced (deleted)
INTC Intention to grant announced (deleted)
GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

INTG Intention to grant announced

Effective date: 20170406

AC Divisional application: reference to earlier application

Ref document number: 2567554

Country of ref document: EP

Kind code of ref document: P

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1221845

Country of ref document: HK

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 898414

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170615

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602011038463

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2632576

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20170914

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 898414

Country of ref document: AT

Kind code of ref document: T

Effective date: 20170531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170531

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170831

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170531

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170531

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170531

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170901

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170531

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170930

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170531

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170531

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170831

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170531

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170531

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170531

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170531

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170531

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170531

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602011038463

Country of ref document: DE

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 8

26N No opposition filed

Effective date: 20180301

REG Reference to a national code

Ref country code: HK

Ref legal event code: GR

Ref document number: 1221845

Country of ref document: HK

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170531

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20180426

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20180503

Year of fee payment: 8

Ref country code: DE

Payment date: 20180427

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20180423

Year of fee payment: 8

Ref country code: FR

Payment date: 20180425

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20180427

Year of fee payment: 8

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170531

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20180430

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180413

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180430

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180430

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180413

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602011038463

Country of ref document: DE

REG Reference to a national code

Ref country code: NL

Ref legal event code: MM

Effective date: 20190501

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20190413

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190501

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191101

Ref country code: MT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180413

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190413

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190413

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20110413

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170531

Ref country code: MK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20170531

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20170531

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20200828

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190414