Classifications

• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04S—STEREOPHONIC SYSTEMS 
  • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
  • H04S7/30—Control circuits for electronic adaptation of the sound field
  • H04S7/308—Electronic adaptation dependent on speaker or headphone connection
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04S—STEREOPHONIC SYSTEMS 
  • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
  • H04S7/30—Control circuits for electronic adaptation of the sound field
  • H04S7/301—Automatic calibration of stereophonic sound system, e.g. with test microphone

Definitions

• the present disclosure relates generally to audio signal processing and in
• Portable media devices have become an extremely common way for playback of media.
• Devices that playback digitally stored audio such as iPods ® and mobile phones are used for the playback of both music and audiovisual content.
• An increasing trend for such devices is their attachment to a wide variety of reproduction devices and systems for playback of the audio.
• a user might attach her iPod to a home theater system that include speakers, to a TV with speakers, or to a standalone docking station with speakers.
• a user might attach her iPod to a home theater system that include speakers, to a TV with speakers, or to a standalone docking station with speakers.
• Each of these is an example of a different playback system to which the same portable device might be attached.
• each set of equalization filters each set applicable to a different ones of the playback systems to which the portable device might be attached to equalize for the overall system comprising the portable media device and the playback system to which it is attached. It also would be advantageous to have an end-user operated method of determining, using a portable media device, a set of equalization filters to use in the portable media device with a particular playback system to equalize for the overall system comprising the portable media device and the playback system to which it is attached.
• FIGS. 1A and IB each show a simplified view of a user, a portable media device, and a playback system to which the portable media device can be coupled, with FIG. 1A showing the elements in a calibration mode, and FIG. IB showing the elements in a playback mode.
• FIG. 2 shows a simplified block diagram of one example embodiment of a
• portable media device that includes at least one feature of the present invention.
• FIG. 3 shows a simplified block diagram of one example embodiment of a
• FIG. 4 shows a simplified flowchart of an embodiment of a calibration method.
• FIG. 5 shows a simplified flowchart of a method of operating a portable media device for which or on which is stored the data for a collection of sets of corrective filters.
• FIG. 6 shows a simplified block diagram of one arrangement according to some embodiments of the invention that include remote storage of the data for the collection of one or more sets of corrective filters.
• Embodiments of the present invention include a method, an apparatus, a system, and logic encoded in a computer-readable storage medium to instruct a processing system to carry out the method.
• the method includes applying corrective filtering, e.g., equalization filtering directly in a portable media device at least to correct for, e.g., equalize for the overall system comprising the portable media device and the playback system to which it is attached.
• Some embodiments include a method of operating a portable media device.
• the method comprises, while the portable media device is coupled to a particular playback system, playing back an audio signal on the portable media device and particular playback system combination in a particular listening arrangement while the portable media device applies a particular set of one or more corrective filters selected from a pre- stored collection of one or more sets of corrective filters or the data therefor.
• the collection of one or more sets of corrective filters or the data therefor is pre-stored in or for the portable media device.
• Each of one or more sets of the collection is associated with a corresponding listening arrangement and a corresponding playback system.
• the particular set of one or more corrective filters is determined by a calibration process that includes: recording on the portable media device a sound field resulting from one or more pre-defined calibration signals being played back on the particular playback system, the recording using a microphone built in or connected to the portable media device while the microphone is at one or more listener locations of the particular listening arrangement, analyzing the recording of the sound field to determine the particular set of one or more corrective filters at least to equalize for the particular playback system, and storing the data for the particular set of one or more corrective filters in or for the portable media device for the particular playback system.
• Some embodiments include a method of operating a portable media device
• the method includes analyzing the recording of the sound field to determine a particular set of one or more corrective filters at least to equalize for the particular playback system, and storing the data for the particular set of one or more corrective filters in or for the portable media device for the particular playback system, such that while the portable media device is coupled to the particular playback system, an audio signal is playable on the portable media device and particular playback system combination in the particular listening arrangement while the portable media device applies the determined particular set of one or more corrective filters.
• the storing of the data for the particular set of one or more corrective filters is into a pre-stored collection of one or more sets of corrective filters or the data therefor stored in or for the portable media device, each of one or more sets of the collection being associated with a corresponding listening arrangement and a corresponding playback system.
• Some embodiments include a portable media device that includes a playback subsystem configured to play back a selected audio signal, and a filter subsystem coupled to the playback subsystem and configured to apply a set of one or more corrective filters to an audio signal during playback of the audio signal.
• the portable media device further includes a coupling configured to couple the portable media device to a matching coupling included in a playback system; a user interface configured to accept input from a user; and a microphone or a coupling to a microphone.
• the filter subsystem is configured to apply a particular set of one or more corrective filters associated with a particular playback system and particular listening arrangement during playback of an audio signal via the particular playback system when the portable media device is coupled to the particular playback system in the particular listening
• the particular set of one or more corrective filters is part of a collection of one or more sets of corrective filters or the data therefor pre-stored in or for the portable media device, each of one or more sets of the collection being associated with a corresponding listening arrangement and a corresponding playback system.
• the portable media device is configured to record a sound field resulting from one or more pre-defined calibration signals being played back on the particular playback system, the recording using the microphone in or connected to the portable media device while the microphone is at one or more listener locations of the particular listening arrangement.
• the portable media device also is configured to analyze the recording of the sound field to determine the particular set of one or more corrective filters at least to equalize for the particular playback system; and store the data for the particular set of one or more corrective filters in or for the portable media device for the particular playback system.
• Some embodiments include a portable media device that includes: means for playing back an audio signal, means for filtering configured to apply a set of one or more corrective filters to an audio signal during playback of the audio signal by the means for playing back; means for coupling the portable media device to a playback system; means for accepting input from a user; and means for recording a sound field.
• the means for filtering is configured to apply a particular set of one or more corrective filters associated with a particular playback system and particular listening arrangement during playback of an audio signal via the particular playback system when the portable media device is coupled by the means for coupling to the particular playback system in the particular listening arrangement.
• the particular set of one or more corrective filters is part of a collection of one or more sets of corrective filters or the data therefor pre-stored in or for the portable media device, each of one or more sets of the collection being associated with a corresponding listening arrangement and a corresponding playback system.
• Some versions of the portable media device further include: means for analyzing a recording of a sound field resulting from one or more pre-defined calibration signals to determine a set of one or more corrective filters; and means for storing the data for a set of one or more corrective filters.
• the means for recording is configured to record a sound field resulting from one or more pre-defined calibration signals being played back on the particular playback system at one or more listener locations of the particular listening arrangement
• the means for analyzing is configured to analyze the recording of the sound field to determine the particular set of one or more corrective filters at least to equalize for the particular playback system
• the means for storing is configured to store the data for the particular set of one or more corrective filters in or for the portable media device for the particular playback system.
• Particular embodiments may provide all, some, or none of these aspects, features, or advantages. Particular embodiments may provide one or more other aspects, features, or advantages, one or more of which may be readily apparent to a person skilled in the art from the figures, descriptions, and claims herein.
• FIGS. 1A and IB each shows a simplified view of a user 141, a portable media device 121, and a playback system 103 to which the portable media device can be coupled. These are example elements of example embodiments of the invention.
• FIG. 1A shows the elements in a calibration mode
• FIG. IB shows the elements in a playback mode.
• the portable media device 121 includes a coupling 127 configured to couple the portable media device to a matching coupling included in a playback system, in this case, the playback system 103.
• the portable media device 121 also includes a user interface 123, typically including a display device and a user input mechanism, such user input mechanism configured to accept commands from the user 141.
• the portable media device 121 also includes a playback subsystem 128 configured to play back a selected audio signal and a filter subsystem 129 coupled to the playback subsystem and configured to apply a set of one or more corrective filters to an audio signal during playback of the audio signal.
• the storage subsystem is configured to store data for one or more sets of corrective filters, and apply the data of a particular set to the filter subsystem.
• the playback system 103 includes at least one loudspeaker 105— two are shown in this example playback system, and a playback module 107 that includes one or more audio amplifiers.
• FIG. IB illustrated one aspect of the invention, comprising normal playback of an audio signal from a media file stored in the portable media device 121 while the portable media device 121 is coupled to the playback system 103 via coupling 127 and 113 on the media device 127 and playback system 103, respectively.
• the user 141 is at a particular listener position.
• the particular listening environment and locations of the playback system and listener define a listening arrangement.
• the playing back of the audio signal on the portable media device and particular playback system combination is while the portable media device 121 applies using the filter subsystem 129 a particular set of one or more corrective filters selected for this particular playback system 103 and listening arrangement from a pre-stored collection of one or more sets of corrective filters.
• corrective filters e.g., in the form of data for the filters, is pre-stored in or for the portable media device 121 and listening arrangement.
• Each set of one or more corrective filters of the collection is associated with a corresponding playback system and corresponding listening arrangement.
• FIG. 1A illustrates another aspect of the invention: a calibration process to
• the portable media device 121 either includes built in, or is connectable to at least one microphone 125.
• the calibration process includes recording on the portable playback device 121 a sound field resulting from at least one pre-defined calibration signal 111 being played back on the particular playback system 103 while the microphone 125 is at one or more desired listener locations of the listening arrangement.
• the calibration process includes analyzing the recording of the sound field to determine data for the particular set of one or more corrective filters at least to equalize for the particular playback system (and possibly also for the listening environment), and storing the data for the particular set of one or more corrective filters in or for the portable media device 121 for the particular playback system (and listening arrangement). Note that in some embodiments, the calibration process includes make recordings from several locations and the results averaged. Thus there may be more than one desired listening location associated with a listening arrangement. [0025] In this manner, the data for a collection of sets of corrective filters is pre- stored in or for the portable media device, each set of the collection associated with a
• the devices are identical to The devices.
• the invention is not limited as to the type of portable media device.
• the invention is not limited as to the type of portable media device.
• portable media devices include, but are not limited to audio playback devices such as the Apple IPOD®, Sandisk SANSA®, Creative ZEN VISION®, Microsoft ZUNE®, and other models too numerous to list from other manufacturers.
• audio playback devices such as the Apple IPOD®, Sandisk SANSA®, Creative ZEN VISION®, Microsoft ZUNE®, and other models too numerous to list from other manufacturers.
• Examples also include, but are not limited to cellular telephones that have audio storage and playback capability, made by virtually every manufacturer of cellular telephones, and so-called "smart" cellular telephones such as the Apple IPHONE, Google NEXUS ONE, and many others too numerous to list. Many of these are able to play back not only digitally stored audio data, but also audiovisual content, such as digitally stored video files that may include digitally stored audio data.
• the invention also is also not limited to the type of playback system.
• the invention also is also not limited to the type of playback system.
• minimum requirements are the inclusion of one or more speakers, and the ability to connect to a portable playback device, either directly by being docked thereto, by a wired connection, by a wireless connection, and via a wired or wireless network.
• the minimum requirements also include the ability to receive at least one signal that includes at least audio content from the portable playback device while connected thereto, and to playback at least the audio of the signal.
• the minimum requirements also include the ability to playback one or more calibration files, either stored in the playback system, loadable into a storage subsystem in the playback system, or sent to the playback system from an external calibration signal source. Examples of playback systems include, but are not limited to, so called docking speakers designed to include connectors for a specific model or models of portable media devices. For example, Amazon.com, a popular shopping Website in the USA, listed on 16 March 2010 1,953 items for the search "iPod speaker" in the category electronics, and 1,295 items for the search
• Examples of playback systems also include, but are not limited to, home theatre systems that include home theatre receivers, some of which also include connectors for specific model or models of portable media devices, while others include common input connectors such as phono (RCA) connectors and sockets for TRS (tip, ring, sleeve) or TRRS ((tip, ring, ring, sleeve) connectors.
• Examples of playback systems also include, but are not limited to, televisions that include or are connected to loudspeakers. Such televisions commonly include connectors for external audio.
• Examples also include, but are not limited to, automotive audio systems that in 2010 commonly include connectors for specific model or models of portable media devices, and/or common input connectors such as sockets for a TRS (tip, ring, sleeve) or TRRS ((tip, ring, ring, sleeve) connector.
• TRS tip, ring, sleeve
• TRRS TRRS
• Embodiments of the present invention are particularly useful because a particular portable media device can be connected to more than one playback system.
• An example portable media device An example portable media device
• FIG. 2 shows a simplified block diagram of one example embodiment of a
• portable media device that includes at least one feature of the present invention. It would be clear to one skilled in the art that not all the elements shown in FIG. 2 would be included in all portable media device embodiments, and further, that some portable media device may include additional elements not shown in FIG. 2.
• the digital elements of the portable media device 121 include elements that are coupled by a bus subsystem 241, shown purely for the sake of simplicity as a single bus. These digital elements include at least one processor 243, a storage subsystem 245, a user interface 123, at least one digital interface 231 coupled to a main connector 211, and one or more digital-to-analog converters (DACs) to convert digital information such as digitized audio signals to analog audio signals for playback via one or more audio amplifiers in an analog subsystem 225, and one or more analog-to-digital converters (ADCs) to convert an analog audio signal to a digitized analog signal.
• the DACs and ADCs are shown with their associated interfaces as module 233.
• the DACs and ADCs 233 are coupled to the analog subsystem 225.
• the portable media device 121 also includes at least one wireless interface 249 such as, but not limited to, a wireless network interface, a Bluetooth interface, an infrared interface, or the like.
• a wireless network interface such as, but not limited to, a Bluetooth interface, an infrared interface, or the like.
• One such wireless interface is a common Wi-fi IEEE 802.11 wireless network interface.
• embodiments of the portable media device 121 also include a cellular telephone wireless network interface so that the device can act as a cellular telephone. Some embodiments also include other wireless network interfaces such as a Bluetooth interface.
• the portable media device 121 also includes a battery and associated electronics subsystem 215 coupled in one embodiment to the main connector 211.
• the analog subsystem 225 is connected to the main
• the main connector 211 so that, for example, analog audio signals are available at the main connector 211.
• the main connector 211 is also coupled to the bus subsystem 241 and the at least one digital interface 231 so that signals are provided to and obtainable from whatever the main connector 211 is connected to.
• the analog subsystem 225 is coupled to a microphone 125, which in this case
• This embodiment is built in. Other embodiments are connectable to a microphone 125. This embodiment also includes at least one loudspeaker 227 connected to the analog subsystem 225. A set of at least one input/output connectors 213 is included so that an external set of loudspeakers, e.g., loudspeakers incorporated in headphones, can be connected and also so that different analog audio signals can be input via the analog subsystem 225.
• loudspeakers e.g., loudspeakers incorporated in headphones
• the user interface 123 includes a display screen 261
• buttons 264 to accept input from a user
• a keypad/keyboard 263 also to accept input from a user.
• the display screen 261 includes a touch sensitive surface to accept input from the user, and in some such embodiments, at least some of the buttons 264 are so- called soft buttons in that they are generated by causing a particular area of the display screen 261 to display a button, possibly with a message for the user, and such that the user touching the particular area causes an input that is the same as if a hardware button is displayed.
• the buttons 264 are so- called soft buttons in that they are generated by causing a particular area of the display screen 261 to display a button, possibly with a message for the user, and such that the user touching the particular area causes an input that is the same as if a hardware button is displayed.
• a separate module is shown for keypad/keyboard 263, some or all of these elements may comprise soft buttons on the display screen 261.
• the storage subsystem 245 includes programs in the form of executable
• the storage subsystem 245 also is configured to store digital content, shown in FIG. 2 as stored audiovisual (AV) content 253, but which may include only digitally stored audio.
• the content in the stored content 253 is typically stored as compressed data files, e.g., in the case of audio as AAC or MP3 files, such as audio file 254.
• the programs 251 also include instructions that when executed cause playback of a digitally stored audio file to form digital signals that are converted to analog form by the DACs in module 233, and amplified by at least one amplifier in the analog subsystem 225.
• the portable media device 121 includes a playback subsystem configured to play back a selected audio signal.
• the playback system is made up of elements of the analog subsystem 225, the DACs of module 233, and instructions within the programs 251 in the storage subsystem 245 that when executed cause playback of audio content that forms the selected audio signal.
• the storage subsystem 245 also is configured to store a plurality of corrective filter profiles, e.g., equalization profiles 257 that include data needed to implement sets of corrective filters.
• each corrective filter profile 258 of corrective filter profiles collection 257 provides the data needed to implement a particular set of one or more corrective filters for a particular playback system.
• the portable media device 121 includes a filter subsystem coupled to the playback subsystem and configured to apply a set of one or more corrective filters to an audio signal during playback of a selected audio signal.
• the storage subsystem 245 is made up of several types of storage devices, and include solid state memory and may include magnetic memory, e.g., as a hard disk. Many variations are possible as would be clear to one skilled in the art.
• Some of the elements of portable media device 121 may be provided as part of a large integrated circuit. The functionality may be divided between more than one device. Furthermore, there may be one or more discrete components. At least one element's functionality may be provided by executing one or more programs on one or more of the at least one processor 243.
• the one or more processors 243 may include the functionality of a DSP device, e.g., in the form of a DSP portion of an integrated circuit, or in some embodiments, in the form of a separate DSP device.
• a general purpose processor may be used instead or in addition. Many such variations are possible. Further details on possible architectures of the portable media device 121 are not provided herein in order not to obscure the inventive aspects.
• FIG. 3 shows a simplified block diagram of one example embodiment of a
• the portable media device is connectable to more than one playback system.
• the playback system shown is one example. It would be clear to one skilled in the art that not all the elements shown in FIG. 3 would be included in all playback system embodiments, and further, that some playback systems may include additional elements not shown in FIG. 3.
• the playback system of FIG. 3 includes many digital elements, including storage of digital media files, and includes interfaces to connect the playback system to a wireless network and to have a wired network connection. Many playback systems would not have such elements.
• the playback system includes a coupling (shown as coupling 113 in FIGS. 1A and IB) to a portable media device such as media device 121.
• the coupling 113 is in the form of a main connector 311 configured to connect to a portable media device, e.g., device 121.
• the main connector 311 includes connections that accept analog audio signals from a connected portable media device.
• Main connector 311 is connected to an analog subsystem 325 that includes one or more audio amplifiers for playback of the audio signals via a coupled set of one or more
• loudspeakers 105 The loudspeakers 105.
• a set of at least one input/output connectors 313 is included so that different analog audio signals can be input via the analog subsystem 325.
• the analog input connector in 313 can act as the coupling (shown as coupling 113 in FIGS. 1A and IB) to a portable media device instead of, or in addition to main connector 311.
• main connector 311 e.g., a cordless connection
• an output terminal is also included in element 313 so that an external set of loudspeakers, e.g., headphones that include loudspeakers devices can be connected.
• control of volume, etc. is achieved via a user
• a user interface for a playback system may of course also include one or more analog elements, such as analog volume controls.
• the digital elements of the playback system embodiment 103 include elements that are coupled by a bus subsystem 341, shown purely for the sake of simplicity as a single bus. These digital elements include at least one processor 343, a storage subsystem 345, the user interface 347, at least one digital interface 331 coupled to a main connector 311, and one or more digital-to-analog converters (DACs) to convert digital information such as digitized audio signals from AV content stored in the storage subsystem 345 to analog audio signals for playback on the at least one loudspeaker 105 via the one or more audio amplifiers in analog subsystem 325.
• the DACs are shown with their associated interfaces as module 333 and coupled to the analog subsystem 325.
• the playback system 103 also includes at least one wireless interface 349 such as, but not limited to a wireless network interface, a Bluetooth interface, an infrared interface, or the like.
• a wireless network interface is a common Wi- fi IEEE 802.11 wireless network interface.
• the wireless network interface enables connection to a network, e.g., a home network which in turn may be connected to an external network, e.g., the Internet.
• Some embodiments of the playback system 103 also include a Bluetooth interface, and an infrared interface configured to accept commands from a remote control device 315.
• Some embodiments also include one or more other network interfaces 335 so that the playback system 103 can be connected to a wired network, e.g., a wired home network which in turn may be connected to an external network, e.g., the Internet.
• a wired network e.g., a wired home network which in turn may be connected to an external network, e.g., the Internet.
• the main connector is also coupled to a charging circuit 317 configured to supply power to charge a connected portable playback device, and to accept control signals related to the charging.
• the main connector 311 is also coupled to the bus
• subsystem bus subsystem 341 and the at least one digital interface 331 so that signals are provided to and obtainable from whatever the main connector 311 is connected to.
• the storage subsystem 345 includes programs in the form of executable instructions that when executed by the at least one processor 343 cause carrying out of regular functionality of the playback system 103.
• the storage subsystem 345 is also configured to store digital content, shown in FIG. 3 as stored audiovisual (AV) content 353, but which may include only digitally stored audio.
• the content in the stored content 353 is typically stored as compressed data files, e.g., in the case of audio as AAC or MP3 files, such as audio file 354.
• a user interface 347 that is digitally driven is included.
• the user interface 347 includes a display screen 361 operative to display information to a user, and one or more buttons and knobs 364 to accept input from a user.
• the display screen 361 includes a touch sensitive surface to accept input from the user, and in some such embodiments, at least some of the buttons or knobs 364 are so-called soft buttons in that they are generated by causing a particular area of the display screen 361 to display a button, possibly with a message for the user, and such that the user touching the particular area causes an input that is the same as if a hardware button is displayed.
• some of the programs 351 for example, provide such functionality when executing as causing displaying and accepting input from buttons 364, including soft buttons displayed in the display screen 361
• the storage subsystem 345 is made up of several types of storage devices, and includes solid state memory and may include magnetic memory, e.g., as a hard disk. Many variations are possible as would be clear to one skilled in the art.
• One aspect of embodiments of the invention is playback of one or more
• calibration signals by the playback system.
• the calibration signals may be input, e.g., via an external connector, or via a wireless or wired connection.
• calibration signals may be pre-stored in digital form in the storage subsystem.
• the calibration signals may be obtained by connection and then stored in the storage subsystem 355 in digital form for playback. Digitally stored calibration signals are shown as calibration signals 355 in the example embodiment of FIG. 3.
• Some of the elements of playback system 103 may be provided as part of a large integrated circuit. The functionality may be divided between more than one device. Furthermore, there may be one or more discrete components. At least one element's functionality may be provided by executing one or more programs on one or more of the at least one processor 343. Many such variations are possible. Further details on possible architectures of the playback system 103 are not provided herein in order not to obscure the inventive aspects.
• An inventive aspect of embodiments of the present invention is that a single portable media device may be connected to several different playback devices, or even the one device that may be listened to in different locations.
• a single portable media device may be connected to several different playback devices, or even the one device that may be listened to in different locations.
• the disclosed invention provides mechanisms and methods for applying
• corrective filtering e.g., equalizing each of a variety of playback systems to which a portable media device might be attached by applying the corrective filtering directly in the portable media device.
• the invention is not limited to any particular type of corrective filtering, and equalization is an example of corrective filtering than can be applied as described herein.
• Some embodiments include a method of operating a portable media device 121.
• the method includes playing back an audio signal on the portable media device
• the portable media device 121 applies a particular set of one or more corrective filters selected from a pre-stored collection of data for at least one set of one or more corrective filters.
• the data for the collection of one or more sets of corrective filters is pre-stored in or for the portable media device 121.
• the data for each set of the collection is associated with a corresponding playback system (and listening arrangement).
• the particular set of one or more corrective filters is shown as a profile 258 that includes the data needed to implement the set of filters, e.g., by running one or more programs on at least one of the one of more processors 243.
• the term listening arrangement may cover one specific location, or may cover a range of listening locations or any listening location for the particular playback system.
• the corrective filters may be designed for equalizing listening to a playback system having particular loudspeakers 105, and while possible being determined for one specific listener location, may be usable for a range of listening locations.
• one may make measurements (recording) from a plurality of locations to determine a single averaged correction filter for a range of locations.
• the term "listening arrangement" should not be taken to imply only a single listening location using the particular playback system, i.e., not applicable to other locations using the particular playback system.
• a corrective filter determined from one or more recordings from a single location may be used for a range of locations, and secondly, in some calibration method embodiments, one can make measurements from several locations in order to determine a single set of "averages" corrective filters suitable for a range of locations.
• FIG. 4 shows a simplified flowchart of an embodiment of a calibration method 400.
• the method 400 includes in 403 playing back one or more pre-defined calibration signals 111 on the particular playback system 103, and , during the playback, in 405, recording on the portable playback device 121 the sound field resulting from one or more pre-defined calibration signals 111 being played back on the particular playback system 103.
• the recording uses a microphone 125 built in or connected to the portable media device 121 while the microphone 125 is at one or more desired listener locations that are part of the listening arrangement.
• there may be more than one location associated with a listening arrangement and the recordings may include recordings taken at more than one location.
• the method includes in 407 analyzing the recording of the sound field to determine the particular set of one or more corrective filters at least to equalize for the particular playback system (and possibly also for the listening environment), and in 409, storing the particular set of one or more corrective filters in or for the portable media device for the particular playback system (and listening environment).
• the storing is in the portable media device 121.
• the storing, while possibly temporarily, is on the portable media device 121 is then or later stored remotely, e.g., on a remote storage system on a remote server, for the portable media device 121.
• the storing being "in or for" the portable media device 121 for the particular playback system 103 (and listening environment).
• the portable media device 121 includes a user interface that presents a 'calibrate' button in buttons 264, or some other function to enable a user to indicate to carry out the recording, analyzing, and storing of the particular set of one or more corrective filters.
• the calibration method includes receiving on the user interface an indication from a user to carry out the recording, analyzing, and storing of the particular set of one or more corrective filters, and carrying these steps out in response to such receiving.
• embodiments of the method provide an extremely easy-to-use, self- contained form factor for calibration. A user can simply hit the 'calibrate' button in buttons 264 and hold the portable media device 121 in a listening position, e.g., in front of the playback system speakers 105.
• the calibration signals in one embodiment are pre-stored in the portable media device portable media device 121, e.g., as calibration signals 255 in the storage subsystem 245 of the portable media device 121, and loaded into a playback system 103 for storage within the playback system.
• the portable media device 121 is connected to the playback system by wire or wirelessly from the listening position, and the calibration signal is sent to the playback system 103 and played back while the resulting sound field is recorded for analysis to determined the particular set of one or more corrective filters for the portable media device 121 and playback system combination.
• the calibration signal or signals are provided for playback on the playback system by some other mechanism, e.g., pre-loaded in the playback system, or provided in real time by another source.
• the invention is not limited to any particular way of providing the calibration signal(s) to the playback system.
• the invention is also not limited to the manner any calibration signal is provided to the playback system, e.g., digital form or as an analog signal.
• FIG. 5 shows a simplified flowchart of a method 500 of operating a portable media device, e.g., device 121 for which or on which is stored the data for a collection of sets of corrective filters, e.g., in the form of the data for implementing the corrective filters, each set associated with a corresponding playback system (and listening arrangement).
• a portable media device e.g., device 121 for which or on which is stored the data for a collection of sets of corrective filters, e.g., in the form of the data for implementing the corrective filters, each set associated with a corresponding playback system (and listening arrangement).
• the method includes in 503 connecting the portable media device 121 to the particular playback system 103 in a particular listening environment.
• the method further includes in 505 selecting (manually or automatically) the pre-stored particular set of one or more corrective filters at least to equalize for the particular playback system 103 (and possibly also for the listening environment).
• 505 includes loading at least the selected particular set of one or more corrective filters. This might occur separately, and at a different time from the selecting.
• 507 includes playing back an audio signal on the portable media device 121 while the portable media device 121 is connected to the particular playback system 103.
• the playing back includes applying the particular set of one or more corrective filters.
• the portable media device includes a user interface 123 that includes, e.g., as buttons 264, indication to the user of one or more pre-stored sets of corrective filters.
• the method includes the media portable device 121 receiving, e.g., via the user interface 123, an indication from a user to use a particular set of one or more corrective filters for playback.
• Some embodiments provide for automatic selection of the set of one or more corrective filters.
• the playback system may be configured to provide an indication to an attached portable media device, e.g., providing signals via the main connector that are indicative of the type and/or model of playback device.
• the method 500 includes the portable media device receiving an indication from the particular playback system indicating that particular portable media device is coupled to the particular playback system.
• Some embodiments of the portable media device are configured such that, responsive to the indication, the method includes automatically selecting the particular set of one or more corrective filters associated with the particular portable media device for playback.
• some embodiments of the portable media devices have pre-defined sets of corrective filters that are pre-defined for particular classes of playback systems. For example, simple "docking speakers" playback systems may form a class, television receivers may form a class, home stereo receivers with connected speakers may form a class, home receivers with a connected subwoofer may form a class, automotive playback systems in an automobile may form a class, and so forth.
• at least one of the sets of corrective filters is a default set predefined for a class of playback systems.
• the invention is not limited to any particular type of corrective filters or how such corrective filters are implemented or specified.
• portable media devices may have enough processing power to implement more sophisticated correcting filters than a set of multi-band equalizing filters.
• Some possible types of corrective filters are described below. These are provided as examples only and not to limit the invention to any particular types of corrective filters.
• Some embodiments of the set of one or more corrective filters include a set of multi-band equalizing filters.
• the frequency range of listening is partitioned into a set of frequency bands, and each filter of the set of multi-band equalizing filters sets a relative gain for one of the frequency bands.
• Such multi-band equalizing filters are well known in the art.
• the number of frequency bands for any particular portable media device can be fixed, or settable, and is typically a relatively small number, e.g., 6, 9, or 12.
• There are many ways of implementing such filters and one embodiment uses digital signal processing methods implemented by a program in programs 251 executing on the processor 243, e.g., on a DSP element.
• applying the particular set of one or more corrective filters when the portable media device is coupled to a particular playback system includes digitally processing digital signals on at least one of the one or more processors of the portable media device.
• the multi-band equalizing filters are implanted as a set of digital parametric filters at respective frequency bands.
• Such parametric filters are defined by a set of parameters.
• each set of parameters is stored as a corrective filter profile 258 of corrective filter profiles collection 257 and is usable to implement a particular set of one or more corrective filters for a particular playback system.
• playback circuitry in the portable media device 121 implements a variable set of gain controls according to respective gain parameters for a pre-defined number of frequency bands.
• a set of gain settings is stored as a corrective filter profile 258 of corrective filter profiles collection 257 and is usable to implement a particular set of one or more corrective filters for a particular playback system.
• More sophisticated corrective filters are applicable to playback via a playback system that includes more than two loudspeakers, e.g., a playback system that provides surround sound as is common today in home theater receivers.
• the correcting filters for such playback systems can include more sophisticated settings that provide relative gains to the signals generated by the portable media device 121 for the different loudspeakers 105 in the playback system.
• a time sampled audio signal denoted is pre-processed to generate a time-varying spectrum indicating a signal level within a plurality of frequency bands (critical bands), e.g., 40 bands, each denoted by a band number, and varying over time blocks.
• the time- varying spectrum of the audio signal may be generated in a number of ways, but advantageously the bands are spaced to simulate the frequency resolution of human hearing.
• a quantity called an excitation signal is computed that approximates the distribution of energy along the basilar membrane of the inner ear of a human at a critical frequency band during a time block.
• the perceptual domain excitation may be achieved efficiently by computing a running Short-Time Discrete Fourier Transform (STDFT) of the audio signal using the frequency response of a filter simulating the transmission of audio through the outer and inner ear of a human and a selected set of bandpass filters, e.g., bandpass filters chosen to mimic the critical band filtering observed along the basilar membrane in the human ear at each critical frequency band of interest.
• STDFT Short-Time Discrete Fourier Transform
• Example embodiments use a set of filters with a spacing of 1 ERB, resulting in a total of 40 bands. Distortion reducing multi-band compressor with timbre preservation
• audio playback may be perceptibly distorted, and often
• One form of corrective filtering is applying multi-band compression to the audio signal prior to playback to reduce distortion and attempt to maximize playback level.
• One simple method includes specifying a distortion threshold is specified for each frequency band of the compressor. The compressor independently applies differing gain values to each frequency band to ensure an output signal does not exceed any of the corresponding distortion thresholds.
• An improved set of corrective filters includes timbre preservation in a multi-band compressor. Timbre preservation is achieved by determining a time-varying threshold in each of a plurality frequency bands as a function of (i) a respective fixed threshold for the frequency band and, at least in part, (ii) an audio signal level (whether digital or analog audio signal) in a second frequency band and (iii) a fixed threshold in the second frequency band. Consequently, each time-varying threshold is input signal adaptive. If a particular frequency band receives significant gain reduction due to being above its fixed threshold (or alternatively, approaching the fixed threshold), then a time- varying threshold of one or more other frequency bands are also decreased to receive some gain reduction.
• compressor corrective filtering includes providing or determining a fixed threshold for a first frequency band, and determining a first level of an audio signal within the first frequency band.
• the first level can be less than the fixed threshold.
• the method further includes determining a second level of the audio signal for a second frequency band is also determined, and computing a time- varying threshold for the first frequency band using the second level.
• the time-varying threshold us less than the fixed threshold.
• the method includes attenuating the audio signal within the first frequency band to be equal to or less than the time-varying threshold or, alternatively, increasingly attenuating the audio signal within the first frequency band as approaching the time- varying threshold.
• the time-varying threshold can be computed from an average difference of the audio input signal in each frequency band and its respective fixed threshold.
• a second fixed threshold for the second frequency band can be further determined.
• the second level of the audio signal can exceed the second fixed threshold, resulting in attenuation of the audio signal within the second frequency band to the second fixed threshold.
• a set of corrective filters to implement such a method includes a multi-band filterbank, compression function elements, and at least one timbre preservation element.
• Each compression function element can be dedicated to a frequency band.
• the timbre preservation element is coupled to the multi-band filterbank and the compression function elements.
• the timbre preservation element receives a fixed threshold for each frequency band and provides a time-varying threshold for each frequency band.
• the time-varying threshold for a frequency band is partially determined by a level of the audio signal outside the frequency band.
• Another form of corrective filtering applies an inverse filter to alter the playback system's loudspeaker's frequency response in an effort to match the inverse-filtered loudspeaker output to a target frequency response.
• the methods are applied to "critical frequency bands”— frequency bands of a full frequency range that are determined in accordance with perceptually motivated considerations.
• critical frequency bands that partition an audible frequency range have width that increases with frequency across the audible frequency range.
• the methods use "critically banded" data, implying that that the full frequency range includes critical frequency bands, and that the data comprises subsets, each of the subsets consisting of data indicative of audio content in a different one of the critical frequency bands.
• the calibration method includes determining an inverse filter for a loudspeaker of the playback system.
• the calibration includes measuring the impulse response of the loudspeaker at each of a number of different spatial locations in the listening arrangement, time-aligning and averaging the measured impulse responses to determine an averaged impulse response, and using critical frequency band smoothing to determine the inverse filter from the averaged impulse response and a target frequency response.
• critical frequency band smoothing may be applied to the averaged impulse response and optionally also to the target frequency response during determination of the inverse filter, or may be applied to determine the target frequency response.
• Measurement of the impulse response at multiple spatial locations can ensure that the speaker's frequency response is determined for a variety of listening locations.
• the time-aligning of the measured impulse responses is performed using real cepstrum and minimum phase reconstruction techniques.
• the averaged impulse response is converted to the
• the resulting frequency components are indicative of the measured averaged impulse response.
• These frequency components, in each of the transform bins are combined into frequency domain data in a smaller number of critical frequency bands, e.g., 20 bands or 40 bands, as for other perceptual domain processing.
• the banding of the averaged impulse response data into critically banded data is designed to mimics the frequency resolution of the human auditory system. The banding is typically performed by weighting the frequency components in the transform frequency bins by applying appropriate critical banding filters thereto and generating a frequency component for each of the critical frequency bands by summing the weighted data for the band.
• these filters typically exhibit an approximately rounded exponential shape and are spaced uniformly on the Equivalent Rectangular Bandwidth (ERB) scale.
• ERP Equivalent Rectangular Bandwidth
• the spacing and overlap in frequency of the critical frequency bands provide a degree of regularization of the measured impulse response that is commensurate with the capabilities of the human auditory system.
• Application of the critical band filters is an example of critical band smoothing (the critical band filters typically smooth out irregularities of the impulse response that are not perceptually relevant so that the determined inverse filter does not need to spend resources correcting these details).
• Values for determining the inverse filter are determined from the target response and averaged impulse response, e.g., from smoothed versions thereof, in frequency windows, e.g., critical frequency bands.
• the critically banded impulse response data are used to find an inverse filter which achieves a desired target response.
• the inverse filter in order to maintain equal loudness when using the inverse filter, is preferably normalized against a reference signal, e.g., pink noise, whose spectrum is representative of common sounds.
• inverse filter coefficients are directly calculated in the time domain.
• the resulting inverse filter forms the set of corrective filters applied to the signal in the playback system as described herein.
• the set of parameters for implementing a set of one or more corrective filters is stored on or for the portable media device 121 as part of a collection of sets.
• the collection is stored in the form of a database.
• Each entry is a set of parameters for implementing a set of one or more corrective filters for a particular playback system, and includes an indicator that the particular set of one or more corrective filters is associated with the particular playback system.
• step 409 of FIG. 4 for such embodiments includes storing an indicator that the particular set of one or more corrective filters is associated with the particular playback system.
• the data for the collection of one or more sets of corrective filters is stored in a storage subsystem included in the portable media device.
• the storage subsystem 245 includes corrective filter profiles 257, and one such profile 258 is shown.
• the data for the collection of one or more sets of corrective filters is stored remotely from the portable media device.
• FIG. 6 shows a simplified block diagram of one arrangement according to some embodiments of the invention that include remote storage of the data for the collection of one or more sets of corrective filters.
• the storing initially may be temporarily in the storage device in the portable media device 121, and then stored remotely, e.g., stored remotely when the portable media device is connected to a personal computer 623 which is coupled to a network 625, which can be any private or public network, even the Internet.
• a server system 627 is also connected to the network 625.
• the server system 627 includes one or more processors and a storage subsystem 645.
• the storage subsystem 645 is configured to store the data for one of more collections of sets of corrective filters, each such collection being associated with a particular portable media device 121 or a particular user or both a particular user and portable media device.
• the data for one collection 657 of one or more sets of corrective filters is shown.
• the data for one set 658 is shown.
• the data of the collections is in some embodiments in the form of a database.
• the data for each set of one or more corrective filters is stored in the database as an entry we call a corrective filter profile that includes the parameters needed to implement the corrective filters.
• the particular sets of correction filter in temporary storage in the portable media device 121 is sent for storage in the storage subsystem 645 of the server 627.
• one or more sets of corrective filters stored in the storage subsystem 645 e.g., as corrective filter profiles, can be loaded into the portable media device 121 for use in playback.
• a particular set of correction filters for a particular playback system can be loaded from remote storage to the portable media device 121 for use in playback while the portable media device is coupled to the particular playback system.
• Process action 405 includes recording on the portable media device 121 the
• Process action 407 includes analyzing the recording to determine the particular set of one or more corrective filters at least to equalize for the particular playback system (and possibly also for the listening environment).
• the invention is not limited to any particular type of calibration signal(s) or any particular analysis method.
• the calibration signal is made up of a sum of distinct frequency tones of known amplitudes at a pre-defined number of distinct frequencies.
• the center frequencies are the center frequencies of the corrective filters used in the portable media device 121.
• the center frequencies of graphic equalizers are often distributed logarithmically, e.g., in octaves. In some embodiment, the center frequencies of the components of the test signal are therefore also spread logarithmically.
• the amplitudes of the distinct frequency components of the test signal are equal, while in other embodiments, the amplitudes vary according to the inverse of the frequency.
• the analysis process 407 includes determining the amplitudes at the distinct frequencies of the recorded recording in order to determine the gains at the frequencies that would cause equalize the response.
• the gains at the center frequency forms the data of the particular set of one or more corrective filters, e.g., the corrective filter profile stored for or in the portable media device 121 for the particular playback system and listening environment.
• the calibration signal is a white noise signal, i.e., a noise signal that has the same distribution of power for all frequencies.
• the calibration signal is a pink noise signal, i.e., a noise signal that has a distribution of power that is proportional to the reciprocal of the frequency.
• the noise signal is generated using digital synthesis methods that use pseudorandom noise.
• the analysis 407 includes determining the spectrum of the recorded sound field, e.g., by carrying out a discrete Fourier transform (DFT), e.g., carried out as a fast Fourier transform (FFT), using method well known to those skilled in the art.
• DFT discrete Fourier transform
• FFT fast Fourier transform
• the data are determined and stored for the particular set of one or more corrective filters that modify the determined spectrum of the recorded sound field to match the target reference spectrum for the particular playback system and listening environment.
• some or all of the analysis may be carried out by analog circuitry.
• the recorded signal is divided into frequency bands, e.g., by a set of bandpass filters, and level measurement circuitry is used to determine signals indicative of the signal powers in the frequency bands.
• These data values may then be digitized, and a set of gains for the frequency bands determined as the data to store for the set of one or more corrective filters for the particular playback system and listening environment.
• calibration signals are played back on a playback system.
• the resulting sound field is recorded on a portable media device.
• the recorded sound field is analyzed and a set of one or more corrective filters for the playback system is computed.
• Data for the set of one or more corrective filters is stored on or for portable media device and associated with said playback system.
• the stored data for a particular set can then be recalled and the particular set of one or more corrective filters applied to any audio being played from the portable media device when it is attached to the
• embodiments of the invention include applying the equalization in the portable media device, such embodiments provide the benefits of room equalization to audio playback systems which do not contain such a feature. Also, when the portable media device contains its own microphone, some embodiments of invention provide an extremely easy-to-use, self-contained form factor for calibration. A user simply hits a calibrate button and holds the portable media device in a listening location in front of the playback system's loudspeakers.
• wireless and its derivatives may be used to describe circuits, devices, systems, methods, techniques, communications channels, etc., that may communicate data through the use of modulated electromagnetic radiation through a non-solid medium.
• processor may refer to any device or portion of a device that processes electronic data, e.g., from registers and/or memory to transform that electronic data into other electronic data that, e.g., may be stored in registers and/or memory.
• a "computer” or a “computing machine” or a “computing platform” may include one or more processors.
• a computer-readable storage medium is configured with, e.g., encoded with instructions stored therein that when executed by one or more processors of a processing system such as a digital signal processing device or subsystem that includes at least one processor element and a storage subsystem, cause carrying out a method as described herein.
• the methodologies described herein are, in some embodiments, performable by one or more processors that accept logic, instructions encoded on one or more computer- readable media. When executed by one or more of the processors, the instructions cause carrying out at least one of the methods described herein. Any processor capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken are included. Thus, one example is a typical processing system that includes one or more processors. Each processor may include one or more of a CPU or similar element, a graphics processing unit (GPU), and/or a programmable DSP unit.
• GPU graphics processing unit
• the processing system further includes a storage subsystem with at least one storage medium, which may include memory embedded in a semiconductor device, or a separate memory subsystem including main RAM and/or a static RAM, and/or ROM, and also cache memory.
• the storage subsystem may further include one or more other storage devices, such as magnetic and/or optical and/or further solid state storage devices.
• a bus subsystem may be included for communicating between the components.
• the processing system further may be a distributed processing system with processors coupled by a network, e.g., via network interface devices or wireless network interface devices.
• the processing system requires a display, such a display may be included, e.g., a liquid crystal display (LCD), organic light emitting display (OLED), or a cathode ray tube (CRT) display.
• a display e.g., a liquid crystal display (LCD), organic light emitting display (OLED), or a cathode ray tube (CRT) display.
• the processing system also includes an input device such as one or more of an alphanumeric input unit such as a keyboard, a pointing control device such as a mouse, and so forth.
• the term storage device, storage subsystem, or memory unit as used herein, if clear from the context and unless explicitly stated otherwise, also encompasses a storage system such as a disk drive unit.
• the processing system in some configurations may include a sound output device, and a network interface device.
• the storage subsystem thus includes a computer-readable storage medium that is configured with, e.g., encoded with instructions, e.g., logic, e.g., software that when executed by one or more processors, causes carrying out one of more of the method steps described herein.
• the software may reside in a hard disk, or may also reside, completely or at least partially, within the RAM and/or within the processor during execution thereof by the computer system.
• the memory and the processor also constitute a computer-readable medium on which are encoded instructions.
• a computer-readable storage medium may form a computer
• the one or more processors operate as a standalone device or may be connected, e.g., networked to other processor(s), in a networked deployment, wherein the one or more processors may operate in the capacity of a server or of a client machine in server-client network environment, or as a peer machine in a peer-to-peer or distributed network environment.
• the one or more processors may form a personal computer (PC), a portable media device, a media playback system, a tablet PC, a set-top box (STB), a Personal Digital Assistant (PDA), a game machine, a cellular telephone, a Web appliance, a network router, a switch or a bridge, or any machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine.
• PC personal computer
• PDA Personal Digital Assistant
• each of the methods described herein is in the form of a computer-readable storage medium configured with a set of instructions, e.g., a computer program that when executed on one or more processors, e.g., one or more processors that are part of a portable media device, cause carrying out of method steps.
• Some embodiments are in the form of the logic itself.
• embodiments of the present invention may be embodied as a method, an apparatus such as a special purpose apparatus, an apparatus such as a data processing system, logic, e.g., embodied in a computer-readable storage medium, or a computer-readable storage medium that is encoded with instructions, e.g., a computer- readable storage medium configured as a computer program product.
• the computer- readable medium is configured with a set of instructions that when executed by one or more processors cause carrying out method steps. Accordingly, aspects of the present invention may take the form of a method, an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects.
• the present invention may take the form of program logic, e.g., in a computer readable medium, e.g., a computer program on a computer-readable storage medium, or the computer readable medium configured with computer-readable program code, e.g., a computer program product.
• While the computer readable medium is shown in an example embodiment to be a single medium, the term "medium" should be taken to include a single medium or multiple media (e.g., several memories, a centralized or distributed database, and/or associated caches and servers) that store the one or more sets of instructions.
• a computer readable medium may take many forms, including but not limited to non-volatile media and volatile media.
• Non- volatile media includes, for example, optical, magnetic disks, and magneto-optical disks.
• Volatile media includes dynamic memory, such as main memory.
• embodiments of the present invention are not limited to any particular implementation or programming technique and that the invention may be implemented using any appropriate techniques for implementing the functionality described herein. Furthermore, embodiments are not limited to any particular programming language or operating system.
• an element described herein of an apparatus embodiment is an example of a means for carrying out the function performed by the element for the purpose of carrying out the invention.
• any one of the terms comprising, comprised of or which comprises is an open term that means including at least the elements/features that follow, but not excluding others.
• the term comprising, when used in the claims should not be interpreted as being limitative to the means or elements or steps listed thereafter.
• the scope of the expression a device comprising A and B should not be limited to devices consisting of only elements A and B.
• Any one of the terms including or which includes or that includes as used herein is also an open term that also means including at least the elements/features that follow the term, but not excluding others. Thus, including is synonymous with and means comprising.
• Coupled when used in the claims, should not be interpreted as being limitative to direct connections only.
• the terms “coupled” and “connected,” along with their derivatives, may be used. It should be understood that these terms are not intended as synonyms for each other.
• the scope of the expression a device A coupled to a device B should not be limited to devices or systems wherein an output of device A is directly connected to an input of device B. It means that there exists a path between an output of A and an input of B which may be a path including other devices or means.
• Coupled may mean that two or more elements are either in direct physical or electrical contact, or that two or more elements are not in direct contact with each other but yet still co-operate or interact with each other. 20]

Landscapes

• Physics & Mathematics (AREA)
• Engineering & Computer Science (AREA)
• Acoustics & Sound (AREA)
• Signal Processing (AREA)
• Circuit For Audible Band Transducer (AREA)
• Reverberation, Karaoke And Other Acoustics (AREA)
• Signal Processing For Digital Recording And Reproducing (AREA)
• Stereophonic System (AREA)

Priority Applications (4)

Applications Claiming Priority (2)

Related Child Applications (1)

Publications (1)

Family

ID=44146859

Family Applications (1)

Country Status (6)

Cited By (44)

Families Citing this family (72)

Citations (4)

Family Cites Families (20)

• 2011
  • 2011-04-13 EP EP15178118.4A patent/EP2986034B1/en not_active Not-in-force
  • 2011-04-13 WO PCT/US2011/032332 patent/WO2011139502A1/en active Application Filing
  • 2011-04-13 JP JP2013509080A patent/JP2013530420A/ja active Pending
  • 2011-04-13 EP EP11717394.8A patent/EP2567554B1/en not_active Not-in-force
  • 2011-04-13 CN CN201180022627.1A patent/CN102893633B/zh not_active Expired - Fee Related
  • 2011-04-13 ES ES15178118.4T patent/ES2632576T3/es active Active
• 2015
  • 2015-05-26 JP JP2015106041A patent/JP6377018B2/ja not_active Expired - Fee Related
• 2016
  • 2016-08-17 HK HK16109868.2A patent/HK1221845A1/zh not_active IP Right Cessation
• 2017
  • 2017-06-23 JP JP2017122910A patent/JP2017194703A/ja not_active Ceased

Patent Citations (4)

Also Published As

Similar Documents

Legal Events