US20140294185A1 - Adaptive High Fidelity Reproduction System for Object-Based Audio - Google Patents

Adaptive High Fidelity Reproduction System for Object-Based Audio Download PDF

Info

Publication number
US20140294185A1
US20140294185A1 US14/302,693 US201414302693A US2014294185A1 US 20140294185 A1 US20140294185 A1 US 20140294185A1 US 201414302693 A US201414302693 A US 201414302693A US 2014294185 A1 US2014294185 A1 US 2014294185A1
Authority
US
United States
Prior art keywords
sonic characteristics
speakers
audio
characteristics include
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US14/302,693
Inventor
Scott C. Harris
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Dolby International AB
Original Assignee
Dolby International AB
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=32298566&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=US20140294185(A1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Dolby International AB filed Critical Dolby International AB
Priority to US14/302,693 priority Critical patent/US20140294185A1/en
Assigned to DOLBY INTERNATIONAL AB reassignment DOLBY INTERNATIONAL AB ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HARRIS, SCOTT C.
Publication of US20140294185A1 publication Critical patent/US20140294185A1/en
Priority to US14/705,786 priority patent/US20150237447A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00Circuits for transducers, loudspeakers or microphones
    • H04R3/12Circuits for transducers, loudspeakers or microphones for distributing signals to two or more loudspeakers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5061Partitioning or combining of resources
    • G06F9/5072Grid computing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00Administration; Management
    • G06Q10/08Logistics, e.g. warehousing, loading or distribution; Inventory or stock management
    • G06Q10/087Inventory or stock management, e.g. order filling, procurement or balancing against orders
    • G06Q10/0875Itemisation or classification of parts, supplies or services, e.g. bill of materials
    • GPHYSICS
    • G11INFORMATION STORAGE
    • G11BINFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R29/00Monitoring arrangements; Testing arrangements
    • H04R29/001Monitoring arrangements; Testing arrangements for loudspeakers
    • H04R29/002Loudspeaker arrays
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R5/00Stereophonic arrangements
    • H04R5/04Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F2209/00Indexing scheme relating to G06F9/00
    • G06F2209/50Indexing scheme relating to G06F9/50
    • G06F2209/501Performance criteria
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04RLOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2420/00Details of connection covered by H04R, not provided for in its groups
    • H04R2420/07Applications of wireless loudspeakers or wireless microphones

Definitions

  • High fidelity systems attempt to simulate the sound that comes from actual sound-producing objects.
  • Real music is produced when each of a plurality of different instruments, at a different location, produces its own unique sound. Each instrument also has unique sonic tuning characteristics. The real music is produced from these instruments, at different locations, producing sounds. Producing a simulation of this real music is the objective of a high fidelity music reproduction system.
  • Movies in contrast, actually have a different objective for their sound production.
  • movie sound became a format with multiple channels providing the sound output.
  • This format called surround sound, produced five or more channels of sound.
  • the channels included left and right main channels for stereo music.
  • a center channel was used for mono parts of the reproduction such as the voice.
  • left and right surround channels were provided for special effects.
  • additional channels may be provided for sound having special characteristics such as sub woofers. This sound system attempts to produce the feeling of actually being part of the action depicted by the movie.
  • the present inventor believes that an ideal musical reproduction, like real music, should produce the sound from a plurality of instruments, each coming from its own tuned source that has tuning/music reproduction characteristics that is most closely representative of the instrument.
  • the current system of stereo reproduction reproduces most, if not all, instruments, from two different sources (speakers), both of which are tuned the same.
  • each stream of audio information such as a song, may have separated parts that form that stream. In one embodiment, those parts may be tracks on the audio reproduction medium.
  • the separated parts are adaptively associated with different music reproduction hardware based on the actual characteristics of the hardware producing the music. That is, for example, the violin sounds may be produced by the speaker most closely tuned to violins. Another speaker, e.g., most closely tuned to horns, may reproduce the horns.
  • Another aspect automatically determines specific characteristics of the hardware, and forms a file indicative of those specific characteristics of the hardware.
  • the contents of that file is used to adaptively associate the content of the media, e.g., the music, with the hardware.
  • FIG. 1 shows a block diagram of the system
  • FIG. 2 shows a wired connection between amplifier and speaker
  • FIG. 3 shows a wireless connection
  • FIG. 4 shows a flowchart of operation
  • FIGS. 5A-5D show different ways of storing information for use in the present application.
  • Modern audio reproduction media may have more space for storing the data that is indicative of the audio.
  • the so-called DVD may have 100 times the storage capability of a standard CD, also known as a “Redbook” format CD.
  • Various enhanced CD formats have also been suggested which provide more data on the media and that can be used to store more information.
  • modern compression formats such as the MP3 format, allows reducing the size that is occupied by information placed on the media. Again, this has the effect of allowing the media to store more information.
  • Broadband channels are also available. For example, satellite radio channels are proposed. Broadband Internet channels have been used. In addition, audio content may also be produced over a cable and the like.
  • the present system will be described with reference to information being stored on the audio medium.
  • a plurality of tracks are provided on the medium.
  • the tracks each include information about a different aspect of the audio stream that is recorded on the medium.
  • the audio medium is shown here as being a disk, but it could be understood that any different kind of audio containing medium could be used with the system of the present invention.
  • Each track may represent a specified kind of information.
  • each track includes information about the same kind of instruments.
  • the instruments included on a single track may be of the same time, e.g. all violins, or may have the same spectral characteristics, that is all string instruments, or all producing output within a specified spectral region, or primarily within a specified spectral region.
  • Sounds may be grouped based on spectral characteristics, e.g., by using a fast Fourier transform on recorded sound from the instrument.
  • Each instrument may be characterized on the spectrum, e.g. by forming a histogram indicating that amount of energy in each spectral bucket. Alternatively, instruments or sounds which may effectively compress may be grouped together.
  • the instruments which are sufficiently similar may be grouped together as a track. This has a number of advantages in the context of the present system. First of all, it makes the information on the track more compressible by certain compression systems such as MP3, since each instrument on the track has similar characteristics. In addition, on readout, the track can be accurately reproduced by the same kind of reproduction equipment.
  • a single medium may include movie style tracks such as left, right, center, left surround and right surround, and also a subwoofer setting.
  • the left and right tracks on the medium represent the stereo information.
  • the remaining information in the tracks may represent information from different individual instruments or instrument types. This information may include separate tracks for each of voices, strings, winds, guitar, percussion, bass strings, and bass winds, with the understanding that a each different instrument may also be broken up based on its characteristics e.g. bass or treble.
  • the above has described 13 tracks for each stored item of information. It should be understood, however, that there may be fewer or more tracks, e.g. up to 20 tracks. Since each track may represent information of the specified instrument type, the information in the track may be highly compressible.
  • the medium will typically include more information that is necessary to actually playback the audio on any system.
  • the medium may include stereo left and stereo right channels.
  • 10 speakers may be provided for different instrument types, and this information includes parts of the information that is also within the left and right stereo. If the separated channels are used, the audio left and audio right information might not be used. Therefore, the audio medium may include redundant information. Adaptive decisions are made during playback indicating which speakers and or which music reproduction equipment gets which content.
  • a disk 100 includes a plurality of tracks of information.
  • the stream shown as 110
  • the medium may also include control track 105 which may be a data track including information about which tracks on the medium include which information.
  • the medium is read out by a player.
  • the contents of the medium is interpreted by the adaptive element that is either in the player, or in a controller or amplifier associated with the player.
  • the adaptive element is shown herein as 150 , and as being part of the amplifier.
  • the amplifier is connected to a plurality of different speakers or different amplified speakers.
  • Each speaker system such as 155 , has specified spectral and/or other sound producing characteristics.
  • each speaker may also be active, in the sense that it includes an electronic module associated with the speaker. That electronic module allows communication with the speaker, and may include information about the speaker's characteristics. In another embodiment, characteristics of the speakers may be obtained in a different way.
  • the characteristics of the speaker may be communicated to the memory 165 over the speaker wire using serial formats such as universal serial bus, or RS 232 for example.
  • the amplifier 150 may include a medium reading capability shown as 170 . This reading capability may read a storage medium, such as a floppy disk, memory stick, CD, or mini CD which is inserted therein. The medium includes information about the speakers, which is then read from the medium, and stored in the memory. Another way of communicating information is to obtain characteristics from a public network such as the Internet.
  • each speaker that is purchased is provided with an audio medium such as a CD or DVD. That audio medium is intended to be played in the CD player associated with the stereo. The contents of the CD are played as normal CD audio.
  • electronic information about the speakers is encoded in the CD audio. Thus, this includes a specified code that can be read by the amplifier 150 , and indicates that speaker information follows. The following information includes speaker information.
  • the main amplifier 150 includes also a processor 170 which makes adaptive decisions about which speakers will be selected to play each track or channel on the medium. This adaptive decision will be based on the specific characteristics of the speakers, and the specific characteristics of the audio. The decision is based on, of course, the specific hardware which is present in the system. More hardware, actually more speakers, in the system, will enable better sound. When fewer speakers are present, tracks will need to be combined. In the minimum configuration, only two speakers are present, and the standard stereo is played. Each time a speaker is added, it receives multiple tracks assigned to be played to it, based on its spectral characteristics. This enables the user to make purchases based on their preferences. The user who likes the sound of strings, for example, may purchase a speaker that is tuned to strings.
  • this speaker When this speaker is added to the amplifier system 150 , its characteristics are stored in memory 165 . Playing of media will thereafter assign information from the media 100 to those speakers, based on the speakers characteristics. Conversely, other speakers for horns, and other instruments may also be purchased. Each speaker is adaptively associated with the content for those speakers. Each extra speaker is assigned with sound, and that sound is hence not played by the other speakers. Therefore, more speakers allow better reproduction of the sound.
  • FIG. 2 illustrates up plug and play type operation of doing this.
  • the amplifier 250 is connected via a standard line connection to the speaker 260 .
  • the speaker 260 includes an electronics module therein 265 .
  • the module 265 communicates with a corresponding module in the amplifier, using any serial protocol but preferably Ethernet, USB, or RS 232 . Any protocol that may communicate over a 2 wire line may be used.
  • the amplifier may poll the speaker using a low voltage level signal. Since the signal is at a low voltage level, it will produce little if any sound out of the speaker.
  • the electronics module 265 within the speaker may still recognize this as control signals.
  • the speaker responds with information indicative of its individual spectral characteristics. This information is then stored in the memory 165 within the amplifier. The information may also be used in the playback mode, to determine channel allocations for the information from the media.
  • FIG. 3 shows a wireless alternative in FIG. 3 .
  • This may use wireless formats such as bluetooth, wireless LAN, or some other wireless format.
  • FIG. 3 shows a bluetooth module 310 in the speaker 300 .
  • the amplifier 350 also includes a bluetooth module shown as 355 . Again, this system may operate by polling. The speaker may respond to a poll with information indicative of the speaker's individual characteristics. This information is then stored in the memory 165 .
  • the user can purchase more speakers at any time.
  • Settings for the music are automatically determined by the characteristics of the speaker.
  • the above-described operations may operate according to the flowchart of FIG. 4 , which may run in the processor 170 .
  • the system polls all speakers. This may be carried out at each time of power on, or may be carried out only once for example on initial connection.
  • the speakers may also include the capability of determining room acoustics, in which case it may be desirable to poll the speakers at each power up, or at time intervals.
  • the system determines settings based on the polling. These settings may optionally be displayed at 410 .
  • the content of the tracks is adaptively associated with the user's individual stereo setup.
  • This “enhanced” information may be stored on the media in a number of different ways.
  • FIG. 5A shows the medium being a disk with a first portion that has normal CD stereo 500 , that can be read by any CD player, and reproduced through normal stereo equipment.
  • a second, enhanced portion of the disk 505 includes multitrack enhanced information. Since the first portion is then typical CD form, this setup will require that the medium have additional space available.
  • An advantage of this system is that the medium can be read on any standard CD player.
  • FIG. 5B shows another system in which the entire medium is stored in multitrack format.
  • the standard stereo information is interleaved with other tracks of additional information.
  • Standard CD format includes headers that are specified by the standard. These headers include information such as P and Q parts. These headers include signals that instruct a standard CD player to ignore certain parts of the data stream that is stored on the disk; those parts being reproduced only by enhanced players. For example, CDs may include capability of quad reproduction, and the enhanced information tracks could be labeled as quad, so that a standard player ignores this information.
  • FIG. 5C shows another alternative in which a dual cited disk has a first side 520 representing normal information and a second side 525 which is an enhanced disk.

Abstract

Object-based audio is adaptively associated with speakers, depending on the speaker configuration that is present. Each speaker it receives an audio assignment based on its individual spectral characteristics. As more speakers are added, content is adaptively associated with that you speaker, and taken away from the previous.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • This application is a continuation of U.S. application Ser. No. 14/165,710 filed Jan. 28, 2014, which is a continuation of U.S. application Ser. No. 12/482,450 filed Jun. 10, 2009, now U.S. Pat. No. 8,638,647 issued Jan. 28, 2014, which is a divisional of U.S. Ser. No. 11/609,396 filed Dec. 12, 2006, now U.S. Pat. No. 7,561,697 issued Jul. 14, 2009, which is a continuation application of U.S. Ser. No. 10/848,993 filed May 18, 2004, now U.S. Pat. No. 7,154,819 issued Dec. 26, 2006, which is a divisional application of U.S. Ser. No. 09/799,460 filed Mar. 5, 2001, now U.S. Pat. No. 6,738,318 issued May 18, 2004, the disclosures of each of these parent applications and their file histories in the patent office are hereby incorporated by reference, in their entirety.
  • BACKGROUND
  • High fidelity systems attempt to simulate the sound that comes from actual sound-producing objects. Real music is produced when each of a plurality of different instruments, at a different location, produces its own unique sound. Each instrument also has unique sonic tuning characteristics. The real music is produced from these instruments, at different locations, producing sounds. Producing a simulation of this real music is the objective of a high fidelity music reproduction system.
  • Movies, in contrast, actually have a different objective for their sound production. In the 1980s, movie sound became a format with multiple channels providing the sound output. This format, called surround sound, produced five or more channels of sound. The channels included left and right main channels for stereo music. A center channel was used for mono parts of the reproduction such as the voice. In addition, left and right surround channels were provided for special effects. In addition, additional channels may be provided for sound having special characteristics such as sub woofers. This sound system attempts to produce the feeling of actually being part of the action depicted by the movie.
  • SUMMARY
  • The present inventor believes that an ideal musical reproduction, like real music, should produce the sound from a plurality of instruments, each coming from its own tuned source that has tuning/music reproduction characteristics that is most closely representative of the instrument. The current system of stereo reproduction reproduces most, if not all, instruments, from two different sources (speakers), both of which are tuned the same.
  • According to the present system, information is produced for reproduction by music reproduction hardware. The information as produced has a number of separated parts. That is, each stream of audio information, such as a song, may have separated parts that form that stream. In one embodiment, those parts may be tracks on the audio reproduction medium.
  • The separated parts are adaptively associated with different music reproduction hardware based on the actual characteristics of the hardware producing the music. That is, for example, the violin sounds may be produced by the speaker most closely tuned to violins. Another speaker, e.g., most closely tuned to horns, may reproduce the horns.
  • Another aspect automatically determines specific characteristics of the hardware, and forms a file indicative of those specific characteristics of the hardware. The contents of that file is used to adaptively associate the content of the media, e.g., the music, with the hardware.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • These and other aspects of the invention will be described in detail with reference to the accompanying drawings, wherein:
  • FIG. 1 shows a block diagram of the system;
  • FIG. 2 shows a wired connection between amplifier and speaker;
  • FIG. 3 shows a wireless connection;
  • FIG. 4 shows a flowchart of operation;
  • FIGS. 5A-5D show different ways of storing information for use in the present application.
  • DETAILED DESCRIPTION
  • Modern audio reproduction media may have more space for storing the data that is indicative of the audio. For example, the so-called DVD may have 100 times the storage capability of a standard CD, also known as a “Redbook” format CD. Various enhanced CD formats have also been suggested which provide more data on the media and that can be used to store more information. In addition, modern compression formats, such as the MP3 format, allows reducing the size that is occupied by information placed on the media. Again, this has the effect of allowing the media to store more information.
  • Broadband channels are also available. For example, satellite radio channels are proposed. Broadband Internet channels have been used. In addition, audio content may also be produced over a cable and the like.
  • The present system will be described with reference to information being stored on the audio medium. A plurality of tracks are provided on the medium. The tracks each include information about a different aspect of the audio stream that is recorded on the medium. The audio medium is shown here as being a disk, but it could be understood that any different kind of audio containing medium could be used with the system of the present invention.
  • Each track may represent a specified kind of information. In one aspect, each track includes information about the same kind of instruments. The instruments included on a single track may be of the same time, e.g. all violins, or may have the same spectral characteristics, that is all string instruments, or all producing output within a specified spectral region, or primarily within a specified spectral region. Sounds may be grouped based on spectral characteristics, e.g., by using a fast Fourier transform on recorded sound from the instrument. Each instrument may be characterized on the spectrum, e.g. by forming a histogram indicating that amount of energy in each spectral bucket. Alternatively, instruments or sounds which may effectively compress may be grouped together. The instruments which are sufficiently similar may be grouped together as a track. This has a number of advantages in the context of the present system. First of all, it makes the information on the track more compressible by certain compression systems such as MP3, since each instrument on the track has similar characteristics. In addition, on readout, the track can be accurately reproduced by the same kind of reproduction equipment.
  • Multiple tracks are placed on the medium for different purposes. For example, a single medium may include movie style tracks such as left, right, center, left surround and right surround, and also a subwoofer setting. The left and right tracks on the medium represent the stereo information. The remaining information in the tracks may represent information from different individual instruments or instrument types. This information may include separate tracks for each of voices, strings, winds, guitar, percussion, bass strings, and bass winds, with the understanding that a each different instrument may also be broken up based on its characteristics e.g. bass or treble. The above has described 13 tracks for each stored item of information. It should be understood, however, that there may be fewer or more tracks, e.g. up to 20 tracks. Since each track may represent information of the specified instrument type, the information in the track may be highly compressible.
  • As can be seen from the above, the medium will typically include more information that is necessary to actually playback the audio on any system. For example, the medium may include stereo left and stereo right channels. However, on some systems, 10 speakers may be provided for different instrument types, and this information includes parts of the information that is also within the left and right stereo. If the separated channels are used, the audio left and audio right information might not be used. Therefore, the audio medium may include redundant information. Adaptive decisions are made during playback indicating which speakers and or which music reproduction equipment gets which content.
  • An embodiment is shown in FIG. 1. A disk 100 includes a plurality of tracks of information. For example, if the tracks above are used, the stream, shown as 110, may include 13 different channels. The medium may also include control track 105 which may be a data track including information about which tracks on the medium include which information.
  • The medium is read out by a player. The contents of the medium is interpreted by the adaptive element that is either in the player, or in a controller or amplifier associated with the player. The adaptive element is shown herein as 150, and as being part of the amplifier.
  • The amplifier is connected to a plurality of different speakers or different amplified speakers. Each speaker system, such as 155, has specified spectral and/or other sound producing characteristics. In an embodiment, each speaker may also be active, in the sense that it includes an electronic module associated with the speaker. That electronic module allows communication with the speaker, and may include information about the speaker's characteristics. In another embodiment, characteristics of the speakers may be obtained in a different way.
  • The characteristics of the speaker may be communicated to the memory 165 over the speaker wire using serial formats such as universal serial bus, or RS 232 for example. Alternatively, the amplifier 150 may include a medium reading capability shown as 170. This reading capability may read a storage medium, such as a floppy disk, memory stick, CD, or mini CD which is inserted therein. The medium includes information about the speakers, which is then read from the medium, and stored in the memory. Another way of communicating information is to obtain characteristics from a public network such as the Internet.
  • In another aspect, each speaker that is purchased is provided with an audio medium such as a CD or DVD. That audio medium is intended to be played in the CD player associated with the stereo. The contents of the CD are played as normal CD audio. However, electronic information about the speakers is encoded in the CD audio. Thus, this includes a specified code that can be read by the amplifier 150, and indicates that speaker information follows. The following information includes speaker information.
  • The main amplifier 150 includes also a processor 170 which makes adaptive decisions about which speakers will be selected to play each track or channel on the medium. This adaptive decision will be based on the specific characteristics of the speakers, and the specific characteristics of the audio. The decision is based on, of course, the specific hardware which is present in the system. More hardware, actually more speakers, in the system, will enable better sound. When fewer speakers are present, tracks will need to be combined. In the minimum configuration, only two speakers are present, and the standard stereo is played. Each time a speaker is added, it receives multiple tracks assigned to be played to it, based on its spectral characteristics. This enables the user to make purchases based on their preferences. The user who likes the sound of strings, for example, may purchase a speaker that is tuned to strings. When this speaker is added to the amplifier system 150, its characteristics are stored in memory 165. Playing of media will thereafter assign information from the media 100 to those speakers, based on the speakers characteristics. Conversely, other speakers for horns, and other instruments may also be purchased. Each speaker is adaptively associated with the content for those speakers. Each extra speaker is assigned with sound, and that sound is hence not played by the other speakers. Therefore, more speakers allow better reproduction of the sound.
  • Different ways of getting the information into the memory are also considered. FIG. 2 illustrates up plug and play type operation of doing this. In FIG. 2, the amplifier 250 is connected via a standard line connection to the speaker 260. The speaker 260 includes an electronics module therein 265. The module 265 communicates with a corresponding module in the amplifier, using any serial protocol but preferably Ethernet, USB, or RS 232. Any protocol that may communicate over a 2 wire line may be used. In this embodiment, the amplifier may poll the speaker using a low voltage level signal. Since the signal is at a low voltage level, it will produce little if any sound out of the speaker. However, the electronics module 265 within the speaker may still recognize this as control signals. The speaker responds with information indicative of its individual spectral characteristics. This information is then stored in the memory 165 within the amplifier. The information may also be used in the playback mode, to determine channel allocations for the information from the media.
  • A wireless alternative is shown in FIG. 3. This may use wireless formats such as bluetooth, wireless LAN, or some other wireless format. FIG. 3 shows a bluetooth module 310 in the speaker 300. The amplifier 350 also includes a bluetooth module shown as 355. Again, this system may operate by polling. The speaker may respond to a poll with information indicative of the speaker's individual characteristics. This information is then stored in the memory 165.
  • In any of these embodiments, the user can purchase more speakers at any time. Settings for the music are automatically determined by the characteristics of the speaker.
  • The above-described operations may operate according to the flowchart of FIG. 4, which may run in the processor 170.
  • At 400, the system polls all speakers. This may be carried out at each time of power on, or may be carried out only once for example on initial connection. The speakers may also include the capability of determining room acoustics, in which case it may be desirable to poll the speakers at each power up, or at time intervals.
  • At 405, the system determines settings based on the polling. These settings may optionally be displayed at 410. At 415, the content of the tracks is adaptively associated with the user's individual stereo setup.
  • The above has described the information stored on the medium. This “enhanced” information may be stored on the media in a number of different ways.
  • FIG. 5A shows the medium being a disk with a first portion that has normal CD stereo 500, that can be read by any CD player, and reproduced through normal stereo equipment. A second, enhanced portion of the disk 505 includes multitrack enhanced information. Since the first portion is then typical CD form, this setup will require that the medium have additional space available. An advantage of this system is that the medium can be read on any standard CD player.
  • FIG. 5B shows another system in which the entire medium is stored in multitrack format. In this system, the standard stereo information is interleaved with other tracks of additional information. Standard CD format includes headers that are specified by the standard. These headers include information such as P and Q parts. These headers include signals that instruct a standard CD player to ignore certain parts of the data stream that is stored on the disk; those parts being reproduced only by enhanced players. For example, CDs may include capability of quad reproduction, and the enhanced information tracks could be labeled as quad, so that a standard player ignores this information.
  • FIG. 5C shows another alternative in which a dual cited disk has a first side 520 representing normal information and a second side 525 which is an enhanced disk.
  • While the above has described the information being present on the disk, it should be understood that other forms of reproduction and obtaining of information are possible. All such forms are intended to be encompassed.
  • Other embodiments are within the disclosed invention.

Claims (17)

What is claimed is:
1. A system for reproducing object-based audio, the system comprising:
a controller for receiving an input audio signal and generating a plurality of output audio signals, wherein the input audio signal includes at least one audio object;
a plurality of speakers coupled to the controller for producing sound in response to the plurality of output audio signals; and
a memory coupled to or integrated with the controller for storing one or more sonic characteristics of the plurality of speakers,
wherein the controller determines which of the plurality of output audio signals to send to which of the plurality of speakers based at least in part on the sonic characteristics.
2. The system of claim 1 wherein the one or more sonic characteristics include power handling capabilities.
3. The system of claim 1 wherein the one or more sonic characteristics include frequency response.
4. The system of claim 1 wherein the one or more sonic characteristics include the maximum power handling.
5. The system of claim 1 wherein the one or more sonic characteristics include the amount of bass capable of being generated.
6. The system of claim 1 wherein the one or more sonic characteristics include the amount of treble capable of being generated.
7. The system of claim 1 wherein the one or more sonic characteristics include spectral characteristics.
8. The system of claim 1 wherein the at least one audio object includes an audio signal and accompanying location information.
9. A system for reproducing object-based, the system comprising:
a plurality of speakers for producing sound, wherein at least one of the plurality of speakers is dedicated to producing bass;
a processor for analyzing one or more input audio signal and generating one or more output audio signals; and
a storage coupled to or integrated with the processor for storing one or more sonic characteristics of the plurality of speakers,
wherein the controller sends output audio signals having low frequency components to the at least one of the plurality of speakers dedicated to producing bass based at least in part on the one or more sonic characteristics and wherein the one or more input audio signals includes at least one audio object.
10. The system of claim 9 wherein the one or more sonic characteristics include power handling capabilities.
10. The system of claim 9 wherein the one or more sonic characteristics include frequency response.
11. The system of claim 9 wherein the one or more sonic characteristics include the maximum power handling.
12. The system of claim 9 wherein the one or more sonic characteristics include the amount of bass capable of being generated.
13. The system of claim 9 wherein the one or more sonic characteristics include the amount of treble capable of being generated.
14. The system of claim 9 wherein the one or more sonic characteristics include spectral characteristics.
14. The system of claim 9 wherein the at least one audio object includes an audio signal and accompanying location information.
15. A method for reproducing audio, comprising:
receiving one or more input audio signals;
generating a plurality of output audio signals based on the one or more input audio signals;
storing one or more sonic characteristics of a plurality of audio reproduction equipment; and
determining which of the plurality of output audio signals to send to which of the audio reproduction equipment based at least in part on the sonic characteristics,
wherein the one or more input audio signals includes at least one audio object that comprises an audio signal and accompanying location information.
US14/302,693 2001-03-05 2014-06-12 Adaptive High Fidelity Reproduction System for Object-Based Audio Abandoned US20140294185A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US14/302,693 US20140294185A1 (en) 2001-03-05 2014-06-12 Adaptive High Fidelity Reproduction System for Object-Based Audio
US14/705,786 US20150237447A1 (en) 2001-03-05 2015-05-06 Wireless Audio Distribution System

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US09/799,460 US6738318B1 (en) 2001-03-05 2001-03-05 Audio reproduction system which adaptively assigns different sound parts to different reproduction parts
US10/848,993 US7154819B2 (en) 2001-03-05 2004-05-18 Adaptive high fidelity reproduction system
US11/609,396 US7561697B2 (en) 2001-03-05 2006-12-12 Adaptive high fidelity reproduction system
US12/482,450 US8638647B2 (en) 2001-03-05 2009-06-10 Adaptive high fidelity reproduction system
US14/165,710 US20140140541A1 (en) 2001-03-05 2014-01-28 Adaptive High Fidelity Reproduction System
US14/302,693 US20140294185A1 (en) 2001-03-05 2014-06-12 Adaptive High Fidelity Reproduction System for Object-Based Audio

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US14/165,710 Continuation US20140140541A1 (en) 2001-03-05 2014-01-28 Adaptive High Fidelity Reproduction System

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/705,786 Continuation US20150237447A1 (en) 2001-03-05 2015-05-06 Wireless Audio Distribution System

Publications (1)

Publication Number Publication Date
US20140294185A1 true US20140294185A1 (en) 2014-10-02

Family

ID=32298566

Family Applications (10)

Application Number Title Priority Date Filing Date
US09/799,460 Expired - Lifetime US6738318B1 (en) 2001-03-05 2001-03-05 Audio reproduction system which adaptively assigns different sound parts to different reproduction parts
US10/848,993 Expired - Lifetime US7154819B2 (en) 2001-03-05 2004-05-18 Adaptive high fidelity reproduction system
US11/609,396 Expired - Lifetime US7561697B2 (en) 2001-03-05 2006-12-12 Adaptive high fidelity reproduction system
US12/482,443 Expired - Lifetime US8179755B2 (en) 2001-03-05 2009-06-10 Adaptive high fidelity reproduction system
US12/482,450 Expired - Lifetime US8638647B2 (en) 2001-03-05 2009-06-10 Adaptive high fidelity reproduction system
US12/482,446 Expired - Lifetime US8363521B2 (en) 2001-03-05 2009-06-10 Adaptive high fidelity reproduction system
US12/482,451 Expired - Fee Related US8064322B2 (en) 2001-03-05 2009-06-10 Adaptive high fidelity reproduction system
US14/165,710 Abandoned US20140140541A1 (en) 2001-03-05 2014-01-28 Adaptive High Fidelity Reproduction System
US14/302,693 Abandoned US20140294185A1 (en) 2001-03-05 2014-06-12 Adaptive High Fidelity Reproduction System for Object-Based Audio
US14/705,786 Abandoned US20150237447A1 (en) 2001-03-05 2015-05-06 Wireless Audio Distribution System

Family Applications Before (8)

Application Number Title Priority Date Filing Date
US09/799,460 Expired - Lifetime US6738318B1 (en) 2001-03-05 2001-03-05 Audio reproduction system which adaptively assigns different sound parts to different reproduction parts
US10/848,993 Expired - Lifetime US7154819B2 (en) 2001-03-05 2004-05-18 Adaptive high fidelity reproduction system
US11/609,396 Expired - Lifetime US7561697B2 (en) 2001-03-05 2006-12-12 Adaptive high fidelity reproduction system
US12/482,443 Expired - Lifetime US8179755B2 (en) 2001-03-05 2009-06-10 Adaptive high fidelity reproduction system
US12/482,450 Expired - Lifetime US8638647B2 (en) 2001-03-05 2009-06-10 Adaptive high fidelity reproduction system
US12/482,446 Expired - Lifetime US8363521B2 (en) 2001-03-05 2009-06-10 Adaptive high fidelity reproduction system
US12/482,451 Expired - Fee Related US8064322B2 (en) 2001-03-05 2009-06-10 Adaptive high fidelity reproduction system
US14/165,710 Abandoned US20140140541A1 (en) 2001-03-05 2014-01-28 Adaptive High Fidelity Reproduction System

Family Applications After (1)

Application Number Title Priority Date Filing Date
US14/705,786 Abandoned US20150237447A1 (en) 2001-03-05 2015-05-06 Wireless Audio Distribution System

Country Status (1)

Country Link
US (10) US6738318B1 (en)

Families Citing this family (48)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7085387B1 (en) * 1996-11-20 2006-08-01 Metcalf Randall B Sound system and method for capturing and reproducing sounds originating from a plurality of sound sources
US6239348B1 (en) * 1999-09-10 2001-05-29 Randall B. Metcalf Sound system and method for creating a sound event based on a modeled sound field
EP1547257A4 (en) * 2002-09-30 2006-12-06 Verax Technologies Inc System and method for integral transference of acoustical events
US11294618B2 (en) 2003-07-28 2022-04-05 Sonos, Inc. Media player system
US8234395B2 (en) 2003-07-28 2012-07-31 Sonos, Inc. System and method for synchronizing operations among a plurality of independently clocked digital data processing devices
US8290603B1 (en) 2004-06-05 2012-10-16 Sonos, Inc. User interfaces for controlling and manipulating groupings in a multi-zone media system
US11650784B2 (en) 2003-07-28 2023-05-16 Sonos, Inc. Adjusting volume levels
US11106424B2 (en) 2003-07-28 2021-08-31 Sonos, Inc. Synchronizing operations among a plurality of independently clocked digital data processing devices
US11106425B2 (en) 2003-07-28 2021-08-31 Sonos, Inc. Synchronizing operations among a plurality of independently clocked digital data processing devices
US9977561B2 (en) 2004-04-01 2018-05-22 Sonos, Inc. Systems, methods, apparatus, and articles of manufacture to provide guest access
US8868698B2 (en) 2004-06-05 2014-10-21 Sonos, Inc. Establishing a secure wireless network with minimum human intervention
US8326951B1 (en) 2004-06-05 2012-12-04 Sonos, Inc. Establishing a secure wireless network with minimum human intervention
WO2006050353A2 (en) * 2004-10-28 2006-05-11 Verax Technologies Inc. A system and method for generating sound events
US8015590B2 (en) * 2004-12-30 2011-09-06 Mondo Systems, Inc. Integrated multimedia signal processing system using centralized processing of signals
US7653447B2 (en) * 2004-12-30 2010-01-26 Mondo Systems, Inc. Integrated audio video signal processing system using centralized processing of signals
US7825986B2 (en) * 2004-12-30 2010-11-02 Mondo Systems, Inc. Integrated multimedia signal processing system using centralized processing of signals and other peripheral device
US8880205B2 (en) * 2004-12-30 2014-11-04 Mondo Systems, Inc. Integrated multimedia signal processing system using centralized processing of signals
US20060206221A1 (en) * 2005-02-22 2006-09-14 Metcalf Randall B System and method for formatting multimode sound content and metadata
US9202509B2 (en) 2006-09-12 2015-12-01 Sonos, Inc. Controlling and grouping in a multi-zone media system
US8483853B1 (en) 2006-09-12 2013-07-09 Sonos, Inc. Controlling and manipulating groupings in a multi-zone media system
US8788080B1 (en) 2006-09-12 2014-07-22 Sonos, Inc. Multi-channel pairing in a media system
US20080273429A1 (en) * 2007-04-02 2008-11-06 Dayan Maurice S Cassette adapter for a vehcile
US8457770B1 (en) 2008-04-08 2013-06-04 Sprint Communications Company L.P. Ratings-based digital media distribution and reproduction for a wireless network
US20100223552A1 (en) * 2009-03-02 2010-09-02 Metcalf Randall B Playback Device For Generating Sound Events
US11265652B2 (en) 2011-01-25 2022-03-01 Sonos, Inc. Playback device pairing
US11429343B2 (en) 2011-01-25 2022-08-30 Sonos, Inc. Stereo playback configuration and control
US9560449B2 (en) 2014-01-17 2017-01-31 Sony Corporation Distributed wireless speaker system
US9288597B2 (en) 2014-01-20 2016-03-15 Sony Corporation Distributed wireless speaker system with automatic configuration determination when new speakers are added
US9866986B2 (en) 2014-01-24 2018-01-09 Sony Corporation Audio speaker system with virtual music performance
US9402145B2 (en) 2014-01-24 2016-07-26 Sony Corporation Wireless speaker system with distributed low (bass) frequency
US9369801B2 (en) 2014-01-24 2016-06-14 Sony Corporation Wireless speaker system with noise cancelation
US9426551B2 (en) 2014-01-24 2016-08-23 Sony Corporation Distributed wireless speaker system with light show
US9232335B2 (en) 2014-03-06 2016-01-05 Sony Corporation Networked speaker system with follow me
SE1451466A1 (en) * 2014-03-26 2015-09-27 Sound Dimension Ab Device for reproducing sound
US9782672B2 (en) * 2014-09-12 2017-10-10 Voyetra Turtle Beach, Inc. Gaming headset with enhanced off-screen awareness
US10248376B2 (en) 2015-06-11 2019-04-02 Sonos, Inc. Multiple groupings in a playback system
US9693168B1 (en) 2016-02-08 2017-06-27 Sony Corporation Ultrasonic speaker assembly for audio spatial effect
US9866965B2 (en) * 2016-02-08 2018-01-09 Sony Corporation Auto-configurable speaker system
US9826332B2 (en) 2016-02-09 2017-11-21 Sony Corporation Centralized wireless speaker system
US9826330B2 (en) 2016-03-14 2017-11-21 Sony Corporation Gimbal-mounted linear ultrasonic speaker assembly
US9693169B1 (en) 2016-03-16 2017-06-27 Sony Corporation Ultrasonic speaker assembly with ultrasonic room mapping
US20170310280A1 (en) * 2016-04-20 2017-10-26 Cirrus Logic International Semiconductor Ltd. Single signal-variant power supply for a plurality of amplifiers
US9794724B1 (en) 2016-07-20 2017-10-17 Sony Corporation Ultrasonic speaker assembly using variable carrier frequency to establish third dimension sound locating
US10712997B2 (en) 2016-10-17 2020-07-14 Sonos, Inc. Room association based on name
US9924286B1 (en) 2016-10-20 2018-03-20 Sony Corporation Networked speaker system with LED-based wireless communication and personal identifier
US9854362B1 (en) 2016-10-20 2017-12-26 Sony Corporation Networked speaker system with LED-based wireless communication and object detection
US10075791B2 (en) 2016-10-20 2018-09-11 Sony Corporation Networked speaker system with LED-based wireless communication and room mapping
US10623859B1 (en) 2018-10-23 2020-04-14 Sony Corporation Networked speaker system with combined power over Ethernet and audio delivery

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6385322B1 (en) * 1997-06-20 2002-05-07 D & B Audiotechnik Aktiengesellschaft Method and device for operation of a public address (acoustic irradiation) system
US6859538B1 (en) * 1999-03-17 2005-02-22 Hewlett-Packard Development Company, L.P. Plug and play compatible speakers
US7085387B1 (en) * 1996-11-20 2006-08-01 Metcalf Randall B Sound system and method for capturing and reproducing sounds originating from a plurality of sound sources

Family Cites Families (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4018448A (en) * 1973-10-15 1977-04-19 Dynell Electronics Corporation Record for the artificial reproduction of sounds
US4852176A (en) * 1986-05-12 1989-07-25 Truhe Jr Joseph V Continuous differential signal equalizer
US4823391A (en) * 1986-07-22 1989-04-18 Schwartz David M Sound reproduction system
US4852178A (en) 1987-10-02 1989-07-25 Motorola, Inc. Speaker retaining assembly
JP3295440B2 (en) * 1991-09-10 2002-06-24 パイオニア株式会社 Signal processing circuit in audio equipment
US5430802A (en) * 1992-06-24 1995-07-04 Page; Steven L. Audio speaker system
US6118876A (en) * 1995-09-07 2000-09-12 Rep Investment Limited Liability Company Surround sound speaker system for improved spatial effects
US5801694A (en) * 1995-12-04 1998-09-01 Gershen; Joseph S. Method and apparatus for interactively creating new arrangements for musical compositions
JPH1051888A (en) * 1996-05-28 1998-02-20 Sony Corp Speaker system and sound reproduction system
KR0185021B1 (en) * 1996-11-20 1999-04-15 한국전기통신공사 Auto regulating apparatus and method for multi-channel sound system
KR100268473B1 (en) * 1997-12-30 2000-10-16 윤종용 Audio output apparatus with wireless speaker
US6195435B1 (en) * 1998-05-01 2001-02-27 Ati Technologies Method and system for channel balancing and room tuning for a multichannel audio surround sound speaker system
US6665407B1 (en) 1998-09-28 2003-12-16 Creative Technology Ltd. Three channel panning system
JP4727780B2 (en) * 1999-09-03 2011-07-20 ソニー株式会社 Playback device, recording device
EP1103973A3 (en) * 1999-11-18 2002-02-06 Pioneer Corporation Apparatus for and method of recording and reproducing information
US20040223622A1 (en) * 1999-12-01 2004-11-11 Lindemann Eric Lee Digital wireless loudspeaker system
US7277767B2 (en) * 1999-12-10 2007-10-02 Srs Labs, Inc. System and method for enhanced streaming audio
US20020072816A1 (en) * 2000-12-07 2002-06-13 Yoav Shdema Audio system
US6686531B1 (en) * 2000-12-29 2004-02-03 Harmon International Industries Incorporated Music delivery, control and integration

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7085387B1 (en) * 1996-11-20 2006-08-01 Metcalf Randall B Sound system and method for capturing and reproducing sounds originating from a plurality of sound sources
US6385322B1 (en) * 1997-06-20 2002-05-07 D & B Audiotechnik Aktiengesellschaft Method and device for operation of a public address (acoustic irradiation) system
US6859538B1 (en) * 1999-03-17 2005-02-22 Hewlett-Packard Development Company, L.P. Plug and play compatible speakers

Also Published As

Publication number Publication date
US20090245523A1 (en) 2009-10-01
US8179755B2 (en) 2012-05-15
US20040213414A1 (en) 2004-10-28
US20110222692A9 (en) 2011-09-15
US7154819B2 (en) 2006-12-26
US20150237447A1 (en) 2015-08-20
US7561697B2 (en) 2009-07-14
US6738318B1 (en) 2004-05-18
US20140140541A1 (en) 2014-05-22
US20070094106A1 (en) 2007-04-26
US8363521B2 (en) 2013-01-29
US20090252001A1 (en) 2009-10-08
US20090252000A1 (en) 2009-10-08
US8638647B2 (en) 2014-01-28
US8064322B2 (en) 2011-11-22
US20090245033A1 (en) 2009-10-01

Similar Documents

Publication Publication Date Title
US6738318B1 (en) Audio reproduction system which adaptively assigns different sound parts to different reproduction parts
US5834670A (en) Karaoke apparatus, speech reproducing apparatus, and recorded medium used therefor
US7343210B2 (en) Interactive digital medium and system
US7333863B1 (en) Recording and playback control system
US20020159607A1 (en) Method for using source content information to automatically optimize audio signal
JP2000156039A (en) Multi-track recording and reproducing system and device
US20030123673A1 (en) Electronic sound equipment
US20080013430A1 (en) Method of Recording, Reproducing and Handling Audio Data in a Data Recording Medium
JPH06215482A (en) Audio information recording medium and sound field generation device using the same
JPH04306100A (en) Compact disk for sound field reproduction and sound field controller
JP4110690B2 (en) Data generation method, recording apparatus, recording medium, and reproducing apparatus
KR100813192B1 (en) Device and method for writing on an audio cd, and audio cd
JP2002109824A (en) Method for recording digital audio signal and its device
JP2001052444A (en) Acoustic reproducing
US6667950B2 (en) Non-PCM coded information on a CD audio disc
JPWO2007132627A1 (en) Music search device, music search method, music search program, and recording medium storing music search program
JPH0621097U (en) Sound source compatible playback device
KR200237558Y1 (en) the cassette tape recorder for recording computer audio signal
JP3299022B2 (en) Video playback device
JPH11232787A (en) Audio system
JPH10171478A (en) Musical sound reproducing device
JP2004206752A (en) Digital music playback audio device
JP2003162869A (en) Output level control system in audio player
KR20020022143A (en) Disc identifying method for optical disc reader/writer
JPH03296972A (en) Music information processor

Legal Events

Date Code Title Description
AS Assignment

Owner name: DOLBY INTERNATIONAL AB, NETHERLANDS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:HARRIS, SCOTT C.;REEL/FRAME:033108/0163

Effective date: 20140508

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION