EP2022263B1 - Object-based 3-dimensional audio service system using preset audio scenes - Google Patents
Object-based 3-dimensional audio service system using preset audio scenes Download PDFInfo
- Publication number
- EP2022263B1 EP2022263B1 EP07746543A EP07746543A EP2022263B1 EP 2022263 B1 EP2022263 B1 EP 2022263B1 EP 07746543 A EP07746543 A EP 07746543A EP 07746543 A EP07746543 A EP 07746543A EP 2022263 B1 EP2022263 B1 EP 2022263B1
- Authority
- EP
- European Patent Office
- Prior art keywords
- audio
- scene information
- audio signal
- preset
- contents
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000005236 sound signal Effects 0.000 claims abstract description 119
- 238000000034 method Methods 0.000 claims abstract description 25
- 238000000926 separation method Methods 0.000 claims description 2
- 238000010586 diagram Methods 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 239000000284 extract Substances 0.000 description 2
- 230000002452 interceptive effect Effects 0.000 description 2
- 239000000470 constituent Substances 0.000 description 1
- 238000013500 data storage Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04H—BROADCAST COMMUNICATION
- H04H20/00—Arrangements for broadcast or for distribution combined with broadcast
- H04H20/86—Arrangements characterised by the broadcast information itself
- H04H20/88—Stereophonic broadcast systems
- H04H20/89—Stereophonic broadcast systems using three or more audio channels, e.g. triphonic or quadraphonic
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
- H04S7/30—Control circuits for electronic adaptation of the sound field
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
- H04S2400/11—Positioning of individual sound objects, e.g. moving airplane, within a sound field
Definitions
- the present invention relates to an object-based three dimensional (3-D) audio service system using preset audio scenes and a method thereof; and, more particularly, to an object-based 3-D audio service system using preset audio scenes and a method thereof for providing an interactive service that enables a user or a viewer to directly form an audio scene using a 3-D audio related technology for providing realistic broadcasting to a user or a viewer.
- 3-D three dimensional
- Fig. 1 is a diagram illustrating a conventional audio service system.
- the conventional audio service system includes an audio service providing apparatus 10 and an audio service reproducing apparatus 20.
- the audio service providing apparatus 10 includes an audio-capture unit 11 for capturing an audio signal such as sound, an editing/mixing unit 12 for editing and mixing the captured audio signal to transmit the audio signal to an audio service reproducing apparatus 20, and a storing/transmitting unit 13 for storing the mixed audio signal and transmitting the mixed audio signal to the audio service reproducing apparatus 20.
- the audio service reproducing apparatus 20 includes a receiver 21 for receiving an audio signal transmitted from the audio service providing apparatus 10, a controller 22 for controlling the received audio signal, and a reproducer 23 for reproducing an audio signal.
- An audio signal which is provided through broadcasting services such as TV broadcasting, radio broadcasting, and Digital Multimedia Broadcasting (DMB) based on the conventional audio service system, is generally created by mixing a plurality of audio signals captured from various sound sources.
- broadcasting services such as TV broadcasting, radio broadcasting, and Digital Multimedia Broadcasting (DMB) based on the conventional audio service system
- DMB Digital Multimedia Broadcasting
- an audio signal provided through a soccer game broadcasting is created by mixing noises in a soccer stadium, yelling of a crowd, and a voice of an announcer.
- the volume of the overall audio signal Although a user or a viewer can control the volume of the overall audio signal, it is impossible to control the volume of each object such as the voice of an announcer, the yelling of a crowd, and the noises of the soccer stadium. It is because the audio signal is transmitted after a plurality of object audio signals are mixed into one audio signal in a general broadcasting service.
- a transmitter such as the audio service providing apparatus 10 independently transmits object audio signals of the sound sources without the object audio signals of the sound sources mixed to one audio signal
- a receiver such as the audio service reproducing apparatus 20 can independently control the volumes of the object audio signals of the sound sources.
- An object-based audio service denotes such an audio service that allows a user or a viewer to control each of the object audio signals at a receiver by independently transmitting the object audio signals of the sound sources through a transmitter.
- an audio signal of a soccer game broadcasting is provided based on an object-based 3-D audio service
- a user or a viewer can control each of objects, such as the noises in the soccer stadium, the yelling of the crowd, and the voices of an announcer to obtain a desired audio setting. That is, a user or a viewer can control the noise of the soccer stadium loud, the yelling of the crowd soft, and the voice of the announcer loud. Or, a viewer can control the audio signal to reproduce only the noises of the soccer stadium and the voice of an announcer without the yelling of the crowd reproduced.
- Taejin Lee et al. "An Object-based 3D Audio Broadcasting System for Interactive Services", Audio Engineering Society, Convention paper 6384, 2005, May 28-31, Barcelona, Spa in, disclose an object-based 3D audio broadcasting system.
- This system consists of an authoring tool, a streaming server, and a client.
- the authoring tool generates an MPEG-4 file, made of multiple audio objects, after adapting several kinds of acoustical effects to the audio objects.
- the streaming server generates transmission packets and sends them to the client through the Internet.
- the client reconstructs the bitstream and plays the 3D audio with a user interaction.
- the authors present the design and implementation method of an object-based 3D audio system and describe the simulation result and applications thereof.
- An embodiment of the present invention is directed to providing an object-based three dimensional (3-D) audio service system and a method thereof for enabling a user to easily and conveniently watch and listen an object-based 3-D audio service by eliminating inconvenience that requires a user to control each of object audio signals of sound sources.
- an object-based three dimensional (3-D) audio service providing apparatus using preset audio scenes including: audio input means for inputting an audio signal; preset audio scene generating means for extracting object audio signals from the audio signal inputted through the audio input means and generating more than one of 3-D audio scene information by arranging the extracted object audio signals in a 3-D space and editing features of each object; and encoding means for encoding and multiplexing the audio signal and the 3-D audio scene information for each object audio signal.
- an object-based 3-D audio service reproducing apparatus using preset audio scenes including: decoding means for de-multiplexing and decoding object-based 3-D audio contents; audio scene forming means for forming 3-D audio scene information according to one selected from a plurality of 3-D audio scene information in the de-multiplexed and decoded object-based 3-D audio contents by a user including a viewer; audio signal mixing means for controlling features of objects in an audio signal of the de-multiplexed and decoded object-based 3-D audio contents according to the formed 3-D audio scene information; and reproducing means for reproducing the audio signal with one of the features controlled.
- a method for providing an object-based 3-D audio service using preset audio scenes including the steps of: inputting an audio signal; extracting object audio signals from the inputted audio signal and generating more than one of 3-D audio scene information by arranging the extracted object audio signals in a 3-D space and editing features of each object; and encoding and multiplexing the audio signal and the 3-D audio scene information for each object audio signal.
- a method for reproducing object-based 3-D audio service using preset audio scenes including the steps of: de-multiplexing and decoding object-based 3-D audio contents; forming 3-D audio scene information according to one selected from a plurality of 3-D audio scene information in the de-multiplexed and decoded object-based 3-D audio contents by a user including a viewer; controlling features of objects in an audio signal of the de-multiplexed and decoded object-based 3-D audio contents according to the formed 3-D audio scene information; and reproducing the audio signal with one of the features controlled.
- An object-based three dimensional (3-D) audio service system and a method thereof according to the present invention provides previously generated preset audio scenes to a user or a viewer with an object-based 3-D audio service applied to all broadcasting services and multimedia services providing audio, such as digital broadcasting, radio broadcasting, Digital Multimedia Broadcasting (DMB), Internet broadcasting, digital movies, Digital Video Disk (DVD), and moving picture contents. Therefore, the object-based 3-D audio service system and a method thereof according to the present invention eliminates the inconvenience of a user to control each of object audio signals of sound sources and enables the user to easily and conveniently watch and listen the object-based 3-D audio service.
- DMB Digital Multimedia Broadcasting
- DVD Digital Video Disk
- the present invention can be applied to broadcasting services and multimedia services providing audio, such as digital broadcasting, radio broadcasting, DMB, Internet broadcasting, digital movies, DVD, and moving picture contents, and the present invention is not limited to the types of mediums for transmitting and storing object-based audio contents for broadcasting and multimedia services providing audio.
- Fig. 2 is a block diagram illustrating an object-based three-dimensional (3-D) audio service system using preset audio scenes in accordance with an embodiment of the present invention.
- the object-based 3-D audio service system includes an object-based 3-D audio service providing apparatus 30, a transmitting medium 50, and an object-based 3-D audio service reproducing apparatus 40.
- the 3-D service providing apparatus 30 receives an audio signal through various input devices, creates more than one of object-based 3-D audio scene information which can be selected by a user or a viewer, and transmits the created object-based 3-D audio scene information to the object-based 3-D audio service reproducing apparatus 40.
- the transmitting medium 50 is a medium such as a digital broadcasting network or an Internet network for connecting the object-based 3-D audio service providing apparatus 30 and the object-based 3-D audio service reproducing apparatus 40 through a network.
- the object-based 3-D audio service reproducing apparatus 40 generates more than one of 3-D audio scenes based on the object-based 3-D audio scene information transmitted from the object-based 3-D audio service providing apparatus 30.
- the object-based 3-D audio service providing apparatus 30 includes an input unit 31, a preset audio scene generator 32, an encoder 33, and a transmitter 34.
- the input unit 31 receives audio signals through various input devices.
- the preset audio scene generator 32 extracts object-based audio signals (hereinafter, object audio signals) from the audio signal received through the input unit 31, arranges the extracted object audio signals in a three dimensional space, and creates more than one of 3-D audio scene information by editing features such as a location, a size, a direction, and a sound field environment of each object.
- the encoder 33 encodes and multiplexes the audio signal inputted through the input unit 31 and the object-based 3-D audio scene information created by the preset audio scene generating unit 32 for transmitting the input audio signal and the generated preset audio scene information to the object-based 3-D audio service reproducing apparatus 40.
- the input audio signals and the generated preset audio scene information are multiplexed to a moving picture experts group 4 (MPEG-4) file format in a digital broadcasting network.
- MPEG-4 moving picture experts group 4
- the transmitter 34 transforms the multiplexed object-based audio contents including the input audio signal and the created object-based 3-D audio scene information from the encoding unit 33 to a transport format.
- the transmitter 34 transforms the multiplexed object-based audio contents to a MPEG-2 transport stream (TS) for a digital broadcasting network.
- TS MPEG-2 transport stream
- the transformed object-based audio contents including the input audio signal and the generated object-based 3-D audio scene information may be transmitted to the object-based 3-D audio reproducing apparatus 40 and may be stored in a storing medium.
- the transmitter 34 may transmit the object-based audio contents including the input audio signal and the object-based 3-D audio scene information to the object-based 3-D audio reproducing apparatus 40 through a digital broadcasting network such as a terrestrial DMB channel 50.
- a digital broadcasting network such as a terrestrial DMB channel 50.
- the preset audio scene generator 32 uses a Convolutive Blind Source Separation technique to extract object audio signals. Especially, the preset audio scene generator 32 forms more than one of object-based 3-D audio scene information by controlling a ratio of each object-based the audio scene information of each object audio signal, which is set according to the control of a user such as an editor.
- the object-based 3-D audio service reproducing apparatus 40 includes a decoder 42, an audio scene information forming unit 43, an audio signal mixer 44, and an audio signal reproducer 45.
- the decoder 42 de-multiplexes and decodes object-based audio contents including an audio signal and object-based 3-D audio scene information for reproducing.
- the audio scene information forming unit 43 provides the object-based 3-D audio scene information of the object-based 3-D audio contents, which is de-multiplexed and decoded by the decoder 42, to a user such as a viewer to select, and forms the object-based 3-D audio scene information according to the user selection.
- the audio signal mixer 44 mixes object audio signals of the audio signal of the de-multiplexed and decoded object-based 3-D audio contents from the decoder 42 by controlling features of each object, such as a location, a direction, a size, and a sound field of each object according to the object-based 3-D audio scene information formed by the audio scene information forming unit 43.
- the audio signal reproducer 45 reproduces the audio signal mixed to one object-based 3-D audio scene by the audio signal mixer 44.
- the object-based audio contents including the audio signal and the object-based 3-D audio scene information may be provided through a broadcasting service or a multimedia service such as digital broadcasting, radio broadcasting, Digital Multimedia Broadcasting (DMB), Internet broadcasting, digital movies, Digital Video Disk (DVD), and moving picture contents.
- a broadcasting service or a multimedia service such as digital broadcasting, radio broadcasting, Digital Multimedia Broadcasting (DMB), Internet broadcasting, digital movies, Digital Video Disk (DVD), and moving picture contents.
- DMB Digital Multimedia Broadcasting
- DVD Digital Video Disk
- the object-based audio contents may be received through the receiver 41 in the present embodiment, the present invention is not limited thereto. That is, the object-based audio contents may be provided through a transmission medium or a storage medium that can provide a broadcasting service or a multimedia service that provides an audio.
- the audio scene information forming unit 43 enables a user or a viewer to select features of objects such as a location, a direction, a volume, and a sound field environment of each object and forms new object-based 3-D audio scene information according to the features including a location, a direction, a volume, and a sound field environment of each object set by the user.
- a user or a viewer can control features of a 3-D audio space by changing a reverberation time of a 3-D space through controlling a volume and a delay time of an initial reflected sound through the audio scene information forming unit 43.
- the object-based 3-D audio service system using the preset audio scene according to the present embodiment previously generates object-based 3-D audio scenes that are expected to be frequently used and provides the generated object-based 3-D audio scenes as preset audio scenes to a user or a viewer. That is, the object-based 3-D audio service system according to the present embodiment enables a user or a viewer to select one of the preset audio scenes in order to make a user to conveniently watch and listen a broadcasting program with the desired audio preference.
- noises of a soccer stadium, yelling of a crowd, a voice of an announcer are defined as audio objects for a soccer game broadcasting, and the defined audio objects are transmitted independently.
- the audio objects a first audio scene having information about volume of the noises of soccer stadium, the yelling of a crowd, and the voice of an announcer set to 1:1:1, a second audio scene having information about volume of the noises of a soccer stadium, the yelling of a crowd, and the voice of an announcer set to 1:0.5:1, and an audio scene having information about volume of the noises of a soccer stadium, the yelling of a crowd, and the voice of an announcer set to 1:0:1 are transmitted as the preset audio scenes. Then, a user or a viewer selects one of the preset audio scenes to watch and listen the soccer game broadcasting with the desired audio preference.
- a user may directly control each of the audio objects if the user cannot find a desired audio scene from the provided audio scenes.
- Fig. 3 is a flowchart illustrating a method for providing an object-based 3-D audio service using preset audio scenes in accordance with an embodiment of the present invention.
- the input unit 31 of the object-based 3-D audio service providing apparatus 30 receives an object-based audio signal through various input devices at step S301.
- the preset audio scene generator 32 extracts object-based audio signals, that is, object audio signals, from the audio signal inputted through the input unit 31 at step S302. Then, the preset audio scene generator 32 generates more than one of object-based 3-D audio scene information at step S304 by arranging the extracted object audio signals in a 3-D space and editing the features of each object audio signal such as a location, a direction, a volume, and a sound field environment of the audio object at step S303.
- the encoder 33 encodes and multiplexes the audio signal inputted through the input unit 31 and the object-based 3-D audio scene information generated by the preset audio scene generator 32 at step S305. For example, the encoder 33 encodes and multiplexes the audio signal and the object-based 3-D audio scene information into MPEG-4 file format for a digital broadcasting network.
- the transmitter 34 transforms the multiplexed object-based audio contents including the audio signal and the object-based 3-D audio scene information to be proper to a transport format and transmits the transformed object-based audio contents at step S306.
- the multiplexed object-based audio contents are transformed to a MPEG-2 TS in a digital broadcasting network.
- the transmitter 34 transmits the transformed object-based audio contents including the audio signal and the object-based 3-D audio scene information to the object-based 3-D audio reproducing apparatus 40 through a digital broadcasting network such as a terrestrial DMB channel.
- the transformed object-based audio contents including the audio signal and the object-based 3-D audio scene information may be stored in a storing medium.
- Fig. 4 is a flowchart illustrating a method for reproducing an object-based 3-D audio service using preset audio scenes in accordance with an embodiment of the present invention.
- the receiver 41 of the object-based 3-D audio service reproducing apparatus 40 receives the object-based audio contents including an audio signal and object-based 3-D audio information through, for example, a digital broadcasting network such as a terrestrial DMB channel 50 or the Internet network at step S401.
- a digital broadcasting network such as a terrestrial DMB channel 50 or the Internet network at step S401.
- the receiver 41 may receive the object-based audio contents through a transmission medium that can provide a broadcasting service or a multimedia service that provides an audio. Or, the object-based audio contents may be inputted through the storing medium.
- the decoder 42 de-multiplexes and decodes the received or inputted object-based audio contents including the audio signal and the object-based 3-D audio scene information at step S402.
- the audio scene information forming unit 43 provides the object-based 3-D audio scene information of the de-multiplexed and decoded object-based 3-D audio contents to a user or a viewer to select, and forms object-based 3-D audio scene information according to the user selection at step S403.
- the audio signal mixer 44 mixes object audio signals by controlling features of objects in the audio signal of the de-multiplexed and decoded object-based 3-D audio contents, such as a location, a direction, a volume, and a sound field environment of each audio object, according to the object-based 3-D audio scene information formed by the audio scene information forming unit 43 at step S404.
- the audio signal reproducer 45 reproduces the audio signal mixed based on one of the object-based 3-D audio scenes by the audio signal mixer 44 at step S405.
- the above described method according to the present invention can be embodied as a program and stored on a computer readable recording medium.
- the computer readable recording medium is any data storage device that can store data which can be thereafter read by the computer system.
- the computer readable recording medium includes a read-only memory (ROM), a random-access memory (RAM), a CD-ROM, a floppy disk, a hard disk and an optical magnetic disk.
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Acoustics & Sound (AREA)
- Stereophonic System (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Stereo-Broadcasting Methods (AREA)
- Reverberation, Karaoke And Other Acoustics (AREA)
Abstract
Description
- The present invention relates to an object-based three dimensional (3-D) audio service system using preset audio scenes and a method thereof; and, more particularly, to an object-based 3-D audio service system using preset audio scenes and a method thereof for providing an interactive service that enables a user or a viewer to directly form an audio scene using a 3-D audio related technology for providing realistic broadcasting to a user or a viewer.
-
Fig. 1 is a diagram illustrating a conventional audio service system. - As shown in
Fig. 1 , the conventional audio service system includes an audioservice providing apparatus 10 and an audioservice reproducing apparatus 20. The audioservice providing apparatus 10 includes an audio-capture unit 11 for capturing an audio signal such as sound, an editing/mixing unit 12 for editing and mixing the captured audio signal to transmit the audio signal to an audioservice reproducing apparatus 20, and a storing/transmittingunit 13 for storing the mixed audio signal and transmitting the mixed audio signal to the audioservice reproducing apparatus 20. - The audio
service reproducing apparatus 20 includes areceiver 21 for receiving an audio signal transmitted from the audioservice providing apparatus 10, acontroller 22 for controlling the received audio signal, and a reproducer 23 for reproducing an audio signal. - An audio signal, which is provided through broadcasting services such as TV broadcasting, radio broadcasting, and Digital Multimedia Broadcasting (DMB) based on the conventional audio service system, is generally created by mixing a plurality of audio signals captured from various sound sources. For example, an audio signal provided through a soccer game broadcasting is created by mixing noises in a soccer stadium, yelling of a crowd, and a voice of an announcer.
- Although a user or a viewer can control the volume of the overall audio signal, it is impossible to control the volume of each object such as the voice of an announcer, the yelling of a crowd, and the noises of the soccer stadium. It is because the audio signal is transmitted after a plurality of object audio signals are mixed into one audio signal in a general broadcasting service.
- However, if a transmitter such as the audio
service providing apparatus 10 independently transmits object audio signals of the sound sources without the object audio signals of the sound sources mixed to one audio signal, a receiver such as the audioservice reproducing apparatus 20 can independently control the volumes of the object audio signals of the sound sources. An object-based audio service denotes such an audio service that allows a user or a viewer to control each of the object audio signals at a receiver by independently transmitting the object audio signals of the sound sources through a transmitter. - For example, if an audio signal of a soccer game broadcasting is provided based on an object-based 3-D audio service, a user or a viewer can control each of objects, such as the noises in the soccer stadium, the yelling of the crowd, and the voices of an announcer to obtain a desired audio setting. That is, a user or a viewer can control the noise of the soccer stadium loud, the yelling of the crowd soft, and the voice of the announcer loud. Or, a viewer can control the audio signal to reproduce only the noises of the soccer stadium and the voice of an announcer without the yelling of the crowd reproduced.
- Therefore, there is a great demand for developing a method for providing an object-based 3-D audio service that enables a user to control each of object audio signals of sound sources, which can be applied to all broadcasting services and multimedia services providing audio such as digital broadcasting, radio broadcasting, Digital Multimedia Broadcasting, Internet broadcasting, digital movie, DVD, moving picture contents.
- Although a conventional object-based 3-D audio system and a control method thereof was introduced in Korean Patent Publication No.
10-2004-0037437, published on May 7th 2004 - Taejin Lee et al., "An Object-based 3D Audio Broadcasting System for Interactive Services", Audio Engineering Society, Convention paper 6384, 2005, May 28-31, Barcelona, Spain, disclose an object-based 3D audio broadcasting system. This system consists of an authoring tool, a streaming server, and a client. The authoring tool generates an MPEG-4 file, made of multiple audio objects, after adapting several kinds of acoustical effects to the audio objects. The streaming server generates transmission packets and sends them to the client through the Internet. The client reconstructs the bitstream and plays the 3D audio with a user interaction. The authors present the design and implementation method of an object-based 3D audio system and describe the simulation result and applications thereof.
- An embodiment of the present invention is directed to providing an object-based three dimensional (3-D) audio service system and a method thereof for enabling a user to easily and conveniently watch and listen an object-based 3-D audio service by eliminating inconvenience that requires a user to control each of object audio signals of sound sources.
- Other objects and advantages of the present invention can be understood by the following description, and become apparent with reference to the embodiments of the present invention. Also, it is obvious to those skilled in the art of the present invention that the objects and advantages of the present invention can be realized by the means as claimed and combinations thereof.
- The present invention is defined in the independent claims. The dependent claims define embodiments thereof.
- In accordance with an embodiment , there is provided an object-based three dimensional (3-D) audio service providing apparatus using preset audio scenes, including: audio input means for inputting an audio signal; preset audio scene generating means for extracting object audio signals from the audio signal inputted through the audio input means and generating more than one of 3-D audio scene information by arranging the extracted object audio signals in a 3-D space and editing features of each object; and encoding means for encoding and multiplexing the audio signal and the 3-D audio scene information for each object audio signal.
- In accordance with another embodiment , there is provided an object-based 3-D audio service reproducing apparatus using preset audio scenes including: decoding means for de-multiplexing and decoding object-based 3-D audio contents; audio scene forming means for forming 3-D audio scene information according to one selected from a plurality of 3-D audio scene information in the de-multiplexed and decoded object-based 3-D audio contents by a user including a viewer; audio signal mixing means for controlling features of objects in an audio signal of the de-multiplexed and decoded object-based 3-D audio contents according to the formed 3-D audio scene information; and reproducing means for reproducing the audio signal with one of the features controlled.
- In accordance with another embodiment , there is provided a method for providing an object-based 3-D audio service using preset audio scenes, including the steps of: inputting an audio signal; extracting object audio signals from the inputted audio signal and generating more than one of 3-D audio scene information by arranging the extracted object audio signals in a 3-D space and editing features of each object; and encoding and multiplexing the audio signal and the 3-D audio scene information for each object audio signal.
- In accordance with another embodiment , there is provided a method for reproducing object-based 3-D audio service using preset audio scenes including the steps of: de-multiplexing and decoding object-based 3-D audio contents; forming 3-D audio scene information according to one selected from a plurality of 3-D audio scene information in the de-multiplexed and decoded object-based 3-D audio contents by a user including a viewer; controlling features of objects in an audio signal of the de-multiplexed and decoded object-based 3-D audio contents according to the formed 3-D audio scene information; and reproducing the audio signal with one of the features controlled.
- An object-based three dimensional (3-D) audio service system and a method thereof according to the present invention provides previously generated preset audio scenes to a user or a viewer with an object-based 3-D audio service applied to all broadcasting services and multimedia services providing audio, such as digital broadcasting, radio broadcasting, Digital Multimedia Broadcasting (DMB), Internet broadcasting, digital movies, Digital Video Disk (DVD), and moving picture contents. Therefore, the object-based 3-D audio service system and a method thereof according to the present invention eliminates the inconvenience of a user to control each of object audio signals of sound sources and enables the user to easily and conveniently watch and listen the object-based 3-D audio service.
- The present invention can be applied to broadcasting services and multimedia services providing audio, such as digital broadcasting, radio broadcasting, DMB, Internet broadcasting, digital movies, DVD, and moving picture contents, and the present invention is not limited to the types of mediums for transmitting and storing object-based audio contents for broadcasting and multimedia services providing audio.
-
-
Fig. 1 is a diagram illustrating a conventional audio service system. -
Fig. 2 is a block diagram illustrating an object-based three-dimensional (3-D) audio service system using preset audio scenes in accordance with an embodiment of the present invention. -
Fig. 3 is a flowchart illustrating a method for providing an object-based 3-D audio service using preset audio scenes in accordance with an embodiment of the present invention. -
Fig. 4 is a flowchart illustrating a method for reproducing an object-based 3-D audio service using preset audio scenes in accordance with the embodiment of the present invention. - The advantages, features and aspects of the invention will become apparent from the following description of the embodiments with reference to the accompanying drawings, which is set forth hereinafter.
-
Fig. 2 is a block diagram illustrating an object-based three-dimensional (3-D) audio service system using preset audio scenes in accordance with an embodiment of the present invention. - As shown in
Fig. 2 , the object-based 3-D audio service system includes an object-based 3-D audioservice providing apparatus 30, a transmittingmedium 50, and an object-based 3-D audioservice reproducing apparatus 40. The 3-Dservice providing apparatus 30 receives an audio signal through various input devices, creates more than one of object-based 3-D audio scene information which can be selected by a user or a viewer, and transmits the created object-based 3-D audio scene information to the object-based 3-D audioservice reproducing apparatus 40. The transmittingmedium 50 is a medium such as a digital broadcasting network or an Internet network for connecting the object-based 3-D audioservice providing apparatus 30 and the object-based 3-D audioservice reproducing apparatus 40 through a network. The object-based 3-D audioservice reproducing apparatus 40 generates more than one of 3-D audio scenes based on the object-based 3-D audio scene information transmitted from the object-based 3-D audioservice providing apparatus 30. - Hereinafter, the constituent elements of the object-based 3-D audio service system using preset audio scenes according to the present embodiment will be described in detail.
- The object-based 3-D audio
service providing apparatus 30 includes aninput unit 31, a presetaudio scene generator 32, anencoder 33, and atransmitter 34. Theinput unit 31 receives audio signals through various input devices. The presetaudio scene generator 32 extracts object-based audio signals (hereinafter, object audio signals) from the audio signal received through theinput unit 31, arranges the extracted object audio signals in a three dimensional space, and creates more than one of 3-D audio scene information by editing features such as a location, a size, a direction, and a sound field environment of each object. Theencoder 33 encodes and multiplexes the audio signal inputted through theinput unit 31 and the object-based 3-D audio scene information created by the preset audioscene generating unit 32 for transmitting the input audio signal and the generated preset audio scene information to the object-based 3-D audioservice reproducing apparatus 40. For example, the input audio signals and the generated preset audio scene information are multiplexed to a moving picture experts group 4 (MPEG-4) file format in a digital broadcasting network. Thetransmitter 34 transforms the multiplexed object-based audio contents including the input audio signal and the created object-based 3-D audio scene information from theencoding unit 33 to a transport format. For example, thetransmitter 34 transforms the multiplexed object-based audio contents to a MPEG-2 transport stream (TS) for a digital broadcasting network. - The transformed object-based audio contents including the input audio signal and the generated object-based 3-D audio scene information may be transmitted to the object-based 3-D
audio reproducing apparatus 40 and may be stored in a storing medium. - The
transmitter 34 may transmit the object-based audio contents including the input audio signal and the object-based 3-D audio scene information to the object-based 3-Daudio reproducing apparatus 40 through a digital broadcasting network such as aterrestrial DMB channel 50. - If the sound source of the audio signal inputted to the
input unit 31 is a mixed sound source, the presetaudio scene generator 32 uses a Convolutive Blind Source Separation technique to extract object audio signals. Especially, the presetaudio scene generator 32 forms more than one of object-based 3-D audio scene information by controlling a ratio of each object-based the audio scene information of each object audio signal, which is set according to the control of a user such as an editor. - The object-based 3-D audio
service reproducing apparatus 40 includes a decoder 42, an audio sceneinformation forming unit 43, anaudio signal mixer 44, and an audio signal reproducer 45. The decoder 42 de-multiplexes and decodes object-based audio contents including an audio signal and object-based 3-D audio scene information for reproducing. The audio sceneinformation forming unit 43 provides the object-based 3-D audio scene information of the object-based 3-D audio contents, which is de-multiplexed and decoded by the decoder 42, to a user such as a viewer to select, and forms the object-based 3-D audio scene information according to the user selection. Theaudio signal mixer 44 mixes object audio signals of the audio signal of the de-multiplexed and decoded object-based 3-D audio contents from the decoder 42 by controlling features of each object, such as a location, a direction, a size, and a sound field of each object according to the object-based 3-D audio scene information formed by the audio sceneinformation forming unit 43. Theaudio signal reproducer 45 reproduces the audio signal mixed to one object-based 3-D audio scene by theaudio signal mixer 44. - The object-based audio contents including the audio signal and the object-based 3-D audio scene information may be provided through a broadcasting service or a multimedia service such as digital broadcasting, radio broadcasting, Digital Multimedia Broadcasting (DMB), Internet broadcasting, digital movies, Digital Video Disk (DVD), and moving picture contents. Although the object-based audio contents may be received through the
receiver 41 in the present embodiment, the present invention is not limited thereto. That is, the object-based audio contents may be provided through a transmission medium or a storage medium that can provide a broadcasting service or a multimedia service that provides an audio. - The audio scene
information forming unit 43 enables a user or a viewer to select features of objects such as a location, a direction, a volume, and a sound field environment of each object and forms new object-based 3-D audio scene information according to the features including a location, a direction, a volume, and a sound field environment of each object set by the user. - A user or a viewer can control features of a 3-D audio space by changing a reverberation time of a 3-D space through controlling a volume and a delay time of an initial reflected sound through the audio scene
information forming unit 43. - That is, the object-based 3-D audio service system using the preset audio scene according to the present embodiment previously generates object-based 3-D audio scenes that are expected to be frequently used and provides the generated object-based 3-D audio scenes as preset audio scenes to a user or a viewer. That is, the object-based 3-D audio service system according to the present embodiment enables a user or a viewer to select one of the preset audio scenes in order to make a user to conveniently watch and listen a broadcasting program with the desired audio preference.
- For example, noises of a soccer stadium, yelling of a crowd, a voice of an announcer are defined as audio objects for a soccer game broadcasting, and the defined audio objects are transmitted independently. With the audio objects, a first audio scene having information about volume of the noises of soccer stadium, the yelling of a crowd, and the voice of an announcer set to 1:1:1, a second audio scene having information about volume of the noises of a soccer stadium, the yelling of a crowd, and the voice of an announcer set to 1:0.5:1, and an audio scene having information about volume of the noises of a soccer stadium, the yelling of a crowd, and the voice of an announcer set to 1:0:1 are transmitted as the preset audio scenes. Then, a user or a viewer selects one of the preset audio scenes to watch and listen the soccer game broadcasting with the desired audio preference.
- A user may directly control each of the audio objects if the user cannot find a desired audio scene from the provided audio scenes. However, it is preferable to provide a large number of preset audio scenes to a user in order to enable the user to find a desired audio scene from the provided preset audio scenes.
-
Fig. 3 is a flowchart illustrating a method for providing an object-based 3-D audio service using preset audio scenes in accordance with an embodiment of the present invention. - Referring to
Fig. 3 , theinput unit 31 of the object-based 3-D audioservice providing apparatus 30 receives an object-based audio signal through various input devices at step S301. - The preset
audio scene generator 32 extracts object-based audio signals, that is, object audio signals, from the audio signal inputted through theinput unit 31 at step S302. Then, the presetaudio scene generator 32 generates more than one of object-based 3-D audio scene information at step S304 by arranging the extracted object audio signals in a 3-D space and editing the features of each object audio signal such as a location, a direction, a volume, and a sound field environment of the audio object at step S303. Theencoder 33 encodes and multiplexes the audio signal inputted through theinput unit 31 and the object-based 3-D audio scene information generated by the presetaudio scene generator 32 at step S305. For example, theencoder 33 encodes and multiplexes the audio signal and the object-based 3-D audio scene information into MPEG-4 file format for a digital broadcasting network. - Then, the
transmitter 34 transforms the multiplexed object-based audio contents including the audio signal and the object-based 3-D audio scene information to be proper to a transport format and transmits the transformed object-based audio contents at step S306. For example, the multiplexed object-based audio contents are transformed to a MPEG-2 TS in a digital broadcasting network. - For example, the
transmitter 34 transmits the transformed object-based audio contents including the audio signal and the object-based 3-D audio scene information to the object-based 3-Daudio reproducing apparatus 40 through a digital broadcasting network such as a terrestrial DMB channel. The transformed object-based audio contents including the audio signal and the object-based 3-D audio scene information may be stored in a storing medium. -
Fig. 4 is a flowchart illustrating a method for reproducing an object-based 3-D audio service using preset audio scenes in accordance with an embodiment of the present invention. - Referring to
Fig. 4 , thereceiver 41 of the object-based 3-D audioservice reproducing apparatus 40 receives the object-based audio contents including an audio signal and object-based 3-D audio information through, for example, a digital broadcasting network such as aterrestrial DMB channel 50 or the Internet network at step S401. - The
receiver 41 may receive the object-based audio contents through a transmission medium that can provide a broadcasting service or a multimedia service that provides an audio. Or, the object-based audio contents may be inputted through the storing medium. - The decoder 42 de-multiplexes and decodes the received or inputted object-based audio contents including the audio signal and the object-based 3-D audio scene information at step S402. The audio scene
information forming unit 43 provides the object-based 3-D audio scene information of the de-multiplexed and decoded object-based 3-D audio contents to a user or a viewer to select, and forms object-based 3-D audio scene information according to the user selection at step S403. - Then, the
audio signal mixer 44 mixes object audio signals by controlling features of objects in the audio signal of the de-multiplexed and decoded object-based 3-D audio contents, such as a location, a direction, a volume, and a sound field environment of each audio object, according to the object-based 3-D audio scene information formed by the audio sceneinformation forming unit 43 at step S404. Finally, theaudio signal reproducer 45 reproduces the audio signal mixed based on one of the object-based 3-D audio scenes by theaudio signal mixer 44 at step S405. - The above described method according to the present invention can be embodied as a program and stored on a computer readable recording medium. The computer readable recording medium is any data storage device that can store data which can be thereafter read by the computer system. The computer readable recording medium includes a read-only memory (ROM), a random-access memory (RAM), a CD-ROM, a floppy disk, a hard disk and an optical magnetic disk.
- While the present invention has been described with respect to certain preferred embodiments, it will be apparent to those skilled in the art that various changes and modifications may be made without departing from the scope of the invention as defined in the following claims.
Claims (12)
- An object-based three dimensional (3-D) audio service providing apparatus (30) using preset audio scenes, comprising:audio input means (31) for inputting an audio signal;preset audio scene generating means (32) for extracting object audio signals from the audio signal inputted through the audio input means and generating more than one of 3-D audio scene information by arranging the extracted object audio signals in a 3-D space and editing features of each object based on the preset audio scenes; andencoding means (33) for encoding and multiplexing the audio signal and the 3-D audio scene information for each object audio signal,wherein the preset audio scene generating means (32) is adapted to generate more than one of the 3-D audio scene information by setting the ratios between the volumes of the object audio signals, based on audio scene information of each object audio signal, which ratios are set according to control of a user including a viewer.
- The object-based 3-D audio service providing apparatus (30) of claim 1, further comprising processing means for processing the encoded and multiplexed object-based 3-D audio contents.
- The object-based 3-D audio service providing apparatus (30) of claim 2, wherein the processing means is adapted to transmit the encoded and multiplexed object-based 3-D audio contents to an audio reproducing terminal through a digital broadcasting network.
- The object-based 3-D audio service providing apparatus (30) of claim 1, wherein the audio scene generating means (32) is adapted to extract object audio signals using a Convolutive Blind Source Separation technique when a sound source of the input audio signal is a mixed sound source.
- An object-based three dimensional (3-D) audio service reproducing apparatus (40) for reproducing object-based 3-D audio service provided by the object-based 3-D audio service providing apparatus (30) according to any one of claims 1 to 4, using preset audio scenes comprising:decoding means (42) for de-multiplexing and decoding object-based 3-D audio contents;audio scene selecting means (43) for selecting one 3-D audio scene information from a plurality of 3-D audio scene information based on the preset audio scenes in the de-multiplexed and decoded object-based 3-D audio contents by a user including a viewer; audio scene forming means for forming 3-D audio scene information according to the selected 3-D audio scene information;audio signal mixing means (44) for controlling features of objects in an audio signal of the de-multiplexed and decoded object-based 3-D audio contents according to the formed 3-D audio scene information; andreproducing means (45) for reproducing the audio signal with one of the features controlled.
- A method for providing an object-based three dimensional (3-D) audio service using preset audio scenes, comprising the steps of:inputting an audio signal;generating (S304) more than one of 3-D audio scene information by extracting object audio signals (S302) from the inputted audio signal, arranging the extracted object audio signals in a 3-D space and editing (S303) features of each object based on the preset audio scenes; andencoding and multiplexing (S305) the audio signal and the 3-D audio scene information for each object audio signal,wherein in the step of generating (S304) 3-D audio scene information, more than one of the 3-D audio scene information is generated by setting the ratios between the volumes of the object audio signals, based on audio scene information of each object audio signal, which ratios are set according to control of a user including a viewer.
- The method of claim 6, further comprising the step of:processing the encoded and multiplexed object-based 3-D audio contents.
- The method of claim 7, wherein in the step of processing the object-based 3-D audio contents, the encoded and multiplexed object-based 3-D audio contents are transmitted through a digital broadcasting network,
- A method for reproducing object-based three dimensional (3-D) audio service provided by the object-based 3-D audio service providing method according to any one of claims 6 to 8, using preset audio scenes comprising the steps of :de-multiplexing and decoding (S402) object-based 3-D audio contents;selecting (S403) one 3-D audio scene information from a plurality of 3-D audio scene information based on the preset audio scenes in the de-multiplexed and decoded object-based 3-D audio contents by a user including a viewer; forming (S403) 3-D audio scene information according to the selected 3-D audio scene information;controlling (S404) features of objects in an audio signal of the de-multiplexed and decoded object-based 3-D audio contents according to the formed 3-D audio scene information; andreproducing (S405) the audio signal with one of the features controlled.
- The method of claim 9 or apparatus (40) of claim 5, wherein in the step of forming (S403) 3-D audio scene information, 3-D audio scene information is formed according to features of each object, which are set by a user including a viewer.
- The apparatus (30; 40) of claim 1 or 5, or the method of claim 6 or 9, wherein the features include at least one among a location, a volume, a direction, and a sound field environment of each object.
- The apparatus (40) of claim 5 or the method of claim 9, wherein a feature of a 3-D audio space is controlled by changing a reverberation time of a 3-D audio space through controlling a volume and a delay time of an initial reflected sound.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP12171933.0A EP2501128B1 (en) | 2006-05-19 | 2007-05-16 | Object-based 3-dimensional audio service system using preset audio scenes |
EP11159156.6A EP2369836B1 (en) | 2006-05-19 | 2007-05-16 | Object-based 3-dimensional audio service system using preset audio scenes |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020060045184A KR100802179B1 (en) | 2005-12-08 | 2006-05-19 | Object-based 3-dimensional audio service system using preset audio scenes and its method |
PCT/KR2007/002395 WO2007136187A1 (en) | 2006-05-19 | 2007-05-16 | Object-based 3-dimensional audio service system using preset audio scenes |
Related Child Applications (4)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP11159156.6A Division EP2369836B1 (en) | 2006-05-19 | 2007-05-16 | Object-based 3-dimensional audio service system using preset audio scenes |
EP12171933.0A Division EP2501128B1 (en) | 2006-05-19 | 2007-05-16 | Object-based 3-dimensional audio service system using preset audio scenes |
EP11159156.6 Division-Into | 2011-03-22 | ||
EP12171933.0 Division-Into | 2012-06-14 |
Publications (3)
Publication Number | Publication Date |
---|---|
EP2022263A1 EP2022263A1 (en) | 2009-02-11 |
EP2022263A4 EP2022263A4 (en) | 2010-06-02 |
EP2022263B1 true EP2022263B1 (en) | 2012-08-01 |
Family
ID=40210572
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP12171933.0A Active EP2501128B1 (en) | 2006-05-19 | 2007-05-16 | Object-based 3-dimensional audio service system using preset audio scenes |
EP11159156.6A Active EP2369836B1 (en) | 2006-05-19 | 2007-05-16 | Object-based 3-dimensional audio service system using preset audio scenes |
EP07746543A Active EP2022263B1 (en) | 2006-05-19 | 2007-05-16 | Object-based 3-dimensional audio service system using preset audio scenes |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP12171933.0A Active EP2501128B1 (en) | 2006-05-19 | 2007-05-16 | Object-based 3-dimensional audio service system using preset audio scenes |
EP11159156.6A Active EP2369836B1 (en) | 2006-05-19 | 2007-05-16 | Object-based 3-dimensional audio service system using preset audio scenes |
Country Status (3)
Country | Link |
---|---|
EP (3) | EP2501128B1 (en) |
JP (2) | JP5586950B2 (en) |
WO (1) | WO2007136187A1 (en) |
Families Citing this family (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2009093867A2 (en) | 2008-01-23 | 2009-07-30 | Lg Electronics Inc. | A method and an apparatus for processing audio signal |
EP2083584B1 (en) | 2008-01-23 | 2010-09-15 | LG Electronics Inc. | A method and an apparatus for processing an audio signal |
KR100998913B1 (en) * | 2008-01-23 | 2010-12-08 | 엘지전자 주식회사 | A method and an apparatus for processing an audio signal |
EP2094032A1 (en) * | 2008-02-19 | 2009-08-26 | Deutsche Thomson OHG | Audio signal, method and apparatus for encoding or transmitting the same and method and apparatus for processing the same |
EP2111060B1 (en) * | 2008-04-16 | 2014-12-03 | LG Electronics Inc. | A method and an apparatus for processing an audio signal |
JP5406276B2 (en) * | 2008-04-16 | 2014-02-05 | エルジー エレクトロニクス インコーポレイティド | Audio signal processing method and apparatus |
KR102149019B1 (en) * | 2008-04-23 | 2020-08-28 | 한국전자통신연구원 | Method for generating and playing object-based audio contents and computer readable recordoing medium for recoding data having file format structure for object-based audio service |
KR101596504B1 (en) * | 2008-04-23 | 2016-02-23 | 한국전자통신연구원 | / method for generating and playing object-based audio contents and computer readable recordoing medium for recoding data having file format structure for object-based audio service |
US8396223B2 (en) | 2008-07-29 | 2013-03-12 | Lg Electronics Inc. | Method and an apparatus for processing an audio signal |
JP5635097B2 (en) * | 2009-08-14 | 2014-12-03 | ディーティーエス・エルエルシーDts Llc | System for adaptively streaming audio objects |
AU2011334851B2 (en) * | 2010-12-03 | 2015-01-22 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Sound acquisition via the extraction of geometrical information from direction of arrival estimates |
US9026450B2 (en) | 2011-03-09 | 2015-05-05 | Dts Llc | System for dynamically creating and rendering audio objects |
TWI701952B (en) | 2011-07-01 | 2020-08-11 | 美商杜比實驗室特許公司 | Apparatus, method and non-transitory medium for enhanced 3d audio authoring and rendering |
EP2600343A1 (en) * | 2011-12-02 | 2013-06-05 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Apparatus and method for merging geometry - based spatial audio coding streams |
WO2013181272A2 (en) | 2012-05-31 | 2013-12-05 | Dts Llc | Object-based audio system using vector base amplitude panning |
CN105264600B (en) | 2013-04-05 | 2019-06-07 | Dts有限责任公司 | Hierarchical audio coding and transmission |
WO2016052191A1 (en) * | 2014-09-30 | 2016-04-07 | ソニー株式会社 | Transmitting device, transmission method, receiving device, and receiving method |
JPWO2016171002A1 (en) * | 2015-04-24 | 2018-02-15 | ソニー株式会社 | Transmitting apparatus, transmitting method, receiving apparatus, and receiving method |
Family Cites Families (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5590207A (en) * | 1993-12-14 | 1996-12-31 | Taylor Group Of Companies, Inc. | Sound reproducing array processor system |
JP3593883B2 (en) * | 1998-05-15 | 2004-11-24 | 株式会社日立製作所 | Video stream transmission / reception system |
JP2000358294A (en) * | 1999-06-15 | 2000-12-26 | Yamaha Corp | Audio device |
JP2002236499A (en) * | 2000-12-06 | 2002-08-23 | Matsushita Electric Ind Co Ltd | Music signal compressor, music signal compander and music signal preprocessing controller |
WO2002061732A1 (en) * | 2001-01-30 | 2002-08-08 | Thomson Licensing S.A. | Geometric source separation signal processing technique |
JP2003299044A (en) * | 2002-03-29 | 2003-10-17 | Mitsubishi Electric Corp | Multimedia information transmitter-receiver, multimedia information transmitter-receiver system and service charging server |
WO2004036548A1 (en) * | 2002-10-14 | 2004-04-29 | Thomson Licensing S.A. | Method for coding and decoding the wideness of a sound source in an audio scene |
KR100542129B1 (en) * | 2002-10-28 | 2006-01-11 | 한국전자통신연구원 | Object-based three dimensional audio system and control method |
WO2004051624A2 (en) * | 2002-12-02 | 2004-06-17 | Thomson Licensing S.A. | Method for describing the composition of audio signals |
JP2005293623A (en) * | 2004-03-31 | 2005-10-20 | Clarion Co Ltd | Onboard acoustic apparatus, onboard acoustic system, and music data recording program |
-
2007
- 2007-05-16 EP EP12171933.0A patent/EP2501128B1/en active Active
- 2007-05-16 EP EP11159156.6A patent/EP2369836B1/en active Active
- 2007-05-16 EP EP07746543A patent/EP2022263B1/en active Active
- 2007-05-16 WO PCT/KR2007/002395 patent/WO2007136187A1/en active Application Filing
- 2007-05-16 JP JP2009511940A patent/JP5586950B2/en active Active
-
2013
- 2013-08-12 JP JP2013167817A patent/JP2014013400A/en active Pending
Also Published As
Publication number | Publication date |
---|---|
WO2007136187A1 (en) | 2007-11-29 |
JP5586950B2 (en) | 2014-09-10 |
EP2022263A4 (en) | 2010-06-02 |
EP2501128B1 (en) | 2014-11-12 |
EP2369836A2 (en) | 2011-09-28 |
EP2369836B1 (en) | 2014-04-23 |
WO2007136187A9 (en) | 2008-11-27 |
EP2022263A1 (en) | 2009-02-11 |
JP2014013400A (en) | 2014-01-23 |
EP2369836A3 (en) | 2011-12-14 |
EP2501128A1 (en) | 2012-09-19 |
JP2009537876A (en) | 2009-10-29 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP2022263B1 (en) | Object-based 3-dimensional audio service system using preset audio scenes | |
US8705747B2 (en) | Object-based 3-dimensional audio service system using preset audio scenes | |
RU2741738C1 (en) | System, method and permanent machine-readable data medium for generation, coding and presentation of adaptive audio signal data | |
EP2113112B1 (en) | Method for creating, editing, and reproducing multi-object audio contents files for object-based audio service, and method for creating audio presets | |
US9271101B2 (en) | System and method for transmitting/receiving object-based audio | |
KR100802179B1 (en) | Object-based 3-dimensional audio service system using preset audio scenes and its method | |
Bleidt et al. | Development of the MPEG-H TV audio system for ATSC 3.0 | |
EP1961238A1 (en) | Method for providing dmb-based 3d image service, and decoding apparatus and method for dmb-based 3d image service | |
CN103621101A (en) | Synchronization and switchover methods and systems for an adaptive audio system | |
JP2009537876A5 (en) | ||
US7606716B2 (en) | Systems and methods for multi-dialog surround audio | |
EP1776832A1 (en) | 3-dimensional digital multimedia broadcasting system | |
US20140310010A1 (en) | Apparatus for encoding and apparatus for decoding supporting scalable multichannel audio signal, and method for apparatuses performing same | |
Olivieri et al. | Scene-based audio and higher order ambisonics: A technology overview and application to next-generation audio, vr and 360 video | |
KR101114431B1 (en) | Apparatus for generationg and reproducing audio data for real time audio stream and the method thereof | |
JPH0955920A (en) | Isdb transmission device and reception device | |
KR101040086B1 (en) | Method and apparatus for generating audio and method and apparatus for reproducing audio | |
Plogsties et al. | Conveying spatial sound using MPEG-4 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20081124 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA HR MK RS |
|
A4 | Supplementary search report drawn up and despatched |
Effective date: 20100506 |
|
DAX | Request for extension of the european patent (deleted) | ||
17Q | First examination report despatched |
Effective date: 20110819 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: H04S 7/00 20060101ALI20111220BHEP Ipc: H04N 7/00 20110101AFI20111220BHEP Ipc: H04H 20/89 20080101ALI20111220BHEP |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC MT NL PL PT RO SE SI SK TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 569183 Country of ref document: AT Kind code of ref document: T Effective date: 20120815 Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602007024352 Country of ref document: DE Effective date: 20120927 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: VDEP Effective date: 20120801 |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 569183 Country of ref document: AT Kind code of ref document: T Effective date: 20120801 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D Effective date: 20120801 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120801 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120801 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120801 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120801 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121201 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120801 Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120801 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120801 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121102 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120801 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120801 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121203 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120801 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121112 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120801 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120801 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120801 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120801 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120801 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120801 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20130503 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121101 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602007024352 Country of ref document: DE Effective date: 20130503 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120801 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130531 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130531 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130516 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120801 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20120801 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130516 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20070516 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 10 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 11 |
|
REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 12 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20230420 Year of fee payment: 17 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230625 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20230420 Year of fee payment: 17 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20231206 Year of fee payment: 18 |