CA2736684C - Systems and methods for adjusting audio levels in a plurality of audio signals - Google Patents
Systems and methods for adjusting audio levels in a plurality of audio signals Download PDFInfo
- Publication number
- CA2736684C CA2736684C CA2736684A CA2736684A CA2736684C CA 2736684 C CA2736684 C CA 2736684C CA 2736684 A CA2736684 A CA 2736684A CA 2736684 A CA2736684 A CA 2736684A CA 2736684 C CA2736684 C CA 2736684C
- Authority
- CA
- Canada
- Prior art keywords
- audio
- packets
- signal
- packetized
- adjustment
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; ELECTRIC HEARING AIDS; PUBLIC ADDRESS SYSTEMS
- H04R3/00—Circuits for transducers
Landscapes
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Acoustics & Sound (AREA)
- Signal Processing (AREA)
- Circuit For Audible Band Transducer (AREA)
Abstract
Description
Background
common problem with such audio signals, which may also be referred to as audio streams, is a wide variation in the loudness levels of different portions of the audio encoded within the audio signal. When the audio signal is reproduced as audio, the resulting audible signal has correspondingly large loudness variations. In some situations, portions of an audio signal are intentionally encoded such that they are reproduced at different audio levels. In other cases, different portions of the audio signal are produced independently of one another with the result that they may be encoded to produce audio at different loudness levels.
desirable to analyze and adjust the audio levels of such audio signals in one or more audio signals such that at least some of the audio signals may be reproduced with a desirable audio level.
Summary
one or more input terminals for receiving the audio signals; an audio signal extraction block coupled to the input terminals to extract packets corresponding to the audio signals;
an audio level adjustment block coupled to the audio signal extraction block to analyze the audio levels of the audio signals and to provide audio level adjustment signals corresponding to differences in the audio levels and corresponding desired audio levels; and an audio signal re-assembly block to generate audio adjusted packets corresponding to the audio level adjustment signals.
comparing an audio levels of at least two of the audio signals to a respective desired audio level; adjusting the audio level in packets of at least one of the audio signals to provide audio adjusted packets; and combining unadjusted packets and the audio adjusted packets to form one or more output signals corresponding to the one or more input signals.
The audio level is modified by replacing the audio data in at least some packet in the audio signal.
Brief Description of the Drawings
Figure 1 is a block diagram of an example system for analyzing and adjusting audio levels of a plurality of audio signals;
Figure 2 illustrates a transport stream containing a plurality of audio signals;
Figures 3 and 4 illustrates other example systems for analyzing and adjusting audio levels of plurality of audio signals.
¨3¨
Description of Exemplary Embodiments
System 100 includes an input terminal 102, an audio signal extraction block 104, a controller 106, an audio level adjustment block 108, an audio signal re-assembly block 110 and an output terminal 112.
Some packets may also optionally include other data 126 such as video data in accordance with the standards used for each audio signal. All such streams and signals are referred to herein as audio streams or audio signals herein, regardless of the presence or type of other data present in the streams or signals.
Such gain control metadata values are typically intended to be set such that dialog in a digital audio signal is reproduced at a consistent audio level or volume level or sound pressure level from program to program and channel to channel. The gain control metadata value is combined in the converting or amplifying equipment or both with a listening volume set by a listener to produce audible sound at an audio level corresponding to both the gain control metadata value and the listening volume. In practice, different parts of a digital audio signal are frequently reproduced at widely varying levels often requiring a listener to change the gain of the amplifying equipment to maintain a desired listening volume.
are stored within the extraction block 104. Packets corresponding to each audio signal are sequentially transmitted from the extraction block 104 to adjustment block 108.
Adjustment block 108 obtains the series of packets for each audio signal and, in some embodiments, decodes the audio data from the audio signal to re-assemble at least a portion of the digital audio signal. In addition, the audio adjustment block extracts any audio gain control adjustment value in the audio signal. Adjustment block 108 analyzes the digital audio signal and any audio gain control adjustment value in the audio signal and determines if the digital audio signal is encoded at an undesirable audio level. If so, the adjustment block 108 determines an adjustment for the digital audio signal.
For other audio signals, the adjustment block may decode the encoded audio signal and then re-encode the audio signal at a different audio level based on the recorded audio level.
Typically, the determined adjustment corresponds to the packetization of each audio signal, such that the audio data or the audio metadata (or both) in each packet or of a group of packets from each audio signal may be adjusted as required such that the audio signal will be reproduced at a desired audio level. Controller 106 is coupled to adjustment block 108 to provide a desired audio level signal 152 to the adjustment block corresponding to the desired audio level or a desired audio level range.
¨ 6 -
Re-assembly block 110 modifies at least some of the packets in the input signal in accordance with the adjustment determined by the audio adjustment block. The packets 168 are then sequentially transmitted to output terminal 112. The digital audio data field128 or the audio metadata 130 for the audio signals that require adjustment are modified in the output signal in accordance with the adjustment determined by the audio adjustment block.
¨ 7 -
¨ 8 -
The individual gain adjustment blocks 250a, 250b may be time multiplexed or otherwise shared between different audio signals and will typically include or have access to data storage elements to record audio data and other data for each audio signal, including the desired audio level for that signal. In various embodiments, the adjustment block may be designed to be scalable such that additional instances of a type of gain adjustment block may be added to allow an increased number of audio signals to be processed by the adjustment block 208. Similarly, in various embodiments, a plurality of decoders may be provided to allow an increased number of audio signals to be decoded and provided to the gain adjustment blocks.
Typically, a gain adjustment block will analyze audio data from a series of packets in an audio signal to determine the adjustment required for a packet. As a result the adjustment signal 258a, 258b for a particular packet may be determined based on the plurality of packets that are sequentially before or after (or both before and after) the particular packet. The gain adjustment blocks may use a variety of techniques to determine the adjustment required. For example, a gain adjustment block may analyze audio data from moving window of packets in an audio signal. The moving window of packets may correspond to various time periods and the length of the window may be varied. In some embodiments, a gain adjustment block may apply various transforms or techniques to audio data to identify changes that require a faster or slower rate of adjustment in the audio level of the audio signal. For example, if a transition from a program portion to an advertisement portion is detected, a gain adjustment block may adjust the audio level for the signal more rapidly than during an ongoing program section. One example of a method of adjusting the gain of a signal is described in U.S.
patent application no. 11/971,300, now published as US 2008/0253586A1.
¨ 9 -
Each audio modification block 262a, 262b is coupled to one or more of the gain adjustment blocks 250a, 250b and complements the operation of the coupled gain adjustment blocks.
Reassembly block 210 also receives the respective adjustment signals 258a, 258b generated by the adjustment block 208 corresponding to at least some of the audio signals in the input signal. As input signal 220 is processed through the extraction block 204 and the adjustment block 208, the processing takes some time. The input signal 220 is received by delay block 260, which buffers the packets 222 in input signal so that the packets may be adjusted in accordance with the corresponding adjustment signal 258a, 258b.
Audio modification block 262a receives packets 222 for one or more input signals 220 from delay block 260 and corresponding adjustment signals 258a, 258b from the coupled gain adjustment block. The adjustment signals 258a generated by gain adjustment block 250a identify a packet and the adjustment required in the gain control metadata value in that packet. For each adjustment signal 258a, audio modification block 262a obtains the corresponding packet 222 from delay block 260 and modifies the gain control metadata value in the packet, thereby producing an audio adjusted packet 266.
For example, in this example, the input signal is a transport stream comprising a series of packets. Output signal 268 is also a transport stream comprising a series of corresponding packets in which the audio data, audio metadata or both have been adjusted. In this embodiment, the remaining data is not modified. In this embodiment, and transport stream data is copied from the input signal to the output signal, except as may be needed to reflect any changes in the audio data or audio metadata. In this way, the output signal essentially takes the place of the input signal, with only the audio levels of the various encoded audio signals having been varied in accordance with the desired audio levels for each audio signal. In some embodiments, the output signal may optionally be assembled with packets ordered in the same order as the input signals.
Such packets are obtained by the output signal generation block 264 and added to the output signal 268.
The audio level of each audio signal is progressively analyzed in audio level adjustment block 308. Decoder 348 extracts packets of each audio signal from buffer 342a, 342b,..., 342n by gain adjustment blocks 350a, 350b adapted to analyze the audio signal, depending on its format. The gain adjustment blocks 350a, 350b generate audio level adjustment signals 358a, 358b based on desired audio level received from controller 306 for at least some of the packets in at least some of the audio signals.
Each input signal is coupled to a delay block 360 which extracts packets from the input signals and buffers the input signals for processing by audio modification blocks 362a, 362b, which adjusts individual packets based on the corresponding audio level adjustment signals 358a, 358b. The resulting audio adjusted packets 366 are combined by the output signal generations blocks 364a, 364b into an output signal 368a, 368b at output terminals 312a, 312b. One output signal is generated for each input signal and the output signal includes a packet corresponding to each packet in the input signal such that the resulting output signal contains the same audio signals as the input signal.
¨ 12 -
¨ 13 -
Claims (25)
- one or more input terminals for receiving the transport stream comprising a plurality of packets associated with the plurality of packetized audio signals, wherein at least some of the plurality of packets comprise a gain control metadata value;
- an audio signal extraction block coupled to the one or more input terminals to extract packets corresponding to each packetized audio signal from the transport stream, the audio signal extraction block further configured to sequentially transmit at least some of the plurality of packets corresponding to each packetized audio signal to an audio level adjustment block;
- an audio level adjustment block configured to execute a sequence of steps, for at least two packetized signals contemporaneously, the steps comprising, for each of the packetized audio signals:
analyzing packets corresponding to the packetized audio signal to extract an audio level of an encoded version of the packetized audio signal, comparing the audio level to a desired audio level, the desired audio level being provided as an external signal by an external controller coupled to the audio level adjustment block, and generating an adjustment signal based on the comparison between the audio level and the desired audio level;
- wherein the steps of analyze, compare and generate are performed and - an audio signal re-assembly block configured to receive adjustment signals from the audio level adjustment block and the transport stream, the audio signal re-assembly block configured to vary the gain control metadata value of the at least some of the plurality of packets based on the corresponding adjustment signal to generate a corresponding audio adjusted packet.
- receiving the transport stream comprising a plurality of packets associated with the plurality of packetized audio signals, wherein at least some of the plurality of packets comprise a gain control metadata value;
- extracting packets corresponding to each packetized audio signal from the transport stream;
- executing a sequence of steps for at least two packetized audio signals contemporaneously, the steps comprising, for each of the packetized audio signals:
analyzing packets corresponding to the packetized audio signal to extract an audio level of an encoded version of the packetized audio signal;
comparing the audio level to a desired audio level, wherein the desired audio level is provided as an external signal by an external controller coupled to the audio level adjustment block, and generating an adjustment signal based on the comparison between the audio level and the desired audio level;
- varying the gain control metadata value of the at least some of the plurality of packets based on the corresponding adjustment signal and generating a corresponding audio adjusted packet.
- one or more input terminals for receiving the transport stream comprising a plurality of packets associated with the plurality of packetized audio signals;
- an audio signal extraction block coupled to the one or more input terminals to extract packets corresponding to each packetized audio signal from the transport stream, the audio signal extraction block further configured to sequentially transmit at least some of the packets to an audio level adjustment block;
- the audio level adjustment block configured to, for each of at least two packetized audio signals:
analyze a first subset of packets corresponding to the packetized audio signal to extract an audio level of the packetized audio signal, compare the audio level to a desired audio level, and generate an adjustment signal based on the comparison between the audio level and the desired audio level; and - an audio signal re-assembly block to adjust a second subset of packets corresponding to the packetized audio signal comprising the first subset of packets according to the adjustment signal to generate audio adjusted packets.
receiving the transport stream comprising a plurality of packets associated with the plurality of packetized audio signals;
for each of at least two packetized audio signals, - analyzing a first subset of packets corresponding to the packetized audio signal to extract an audio level of the packetized audio signal;
- comparing the audio level to a desired audio level;
- generating an adjustment signal based on the comparison between the audio level and the desired audio level; and - adjusting a second subset of packets corresponding to the packetized audio signal according to the adjustment signal to provide audio adjusted packets.
one or more input terminals for receiving the transport stream comprising a plurality of packets associated with the plurality of packetized audio signals;
an audio signal extraction block coupled to the one or more input terminals to extract packets corresponding to each packetized audio signal from the transport stream, the audio signal extraction block further configured to sequentially transmit at least some of the packets to an audio level adjustment block;
the audio level adjustment block configured to execute a sequence of steps for at least two packetized audio signals contemporaneously, the steps comprising, for each packetized audio signal:
- analyzing a first subset of packets corresponding to the packetized audio signal to extract an audio level of the packetized audio signal, - comparing the audio level of the packetized audio signal to a desired audio level, and - generating an adjustment signal based on the comparison between the audio level and the desired audio level; and an audio signal re-assembly block configured to adjust a second subset of packets corresponding to the packetized audio signal comprising the first subset of packets according to the adjustment signal to generate audio adjusted packets.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CA2736684A CA2736684C (en) | 2011-04-08 | 2011-04-08 | Systems and methods for adjusting audio levels in a plurality of audio signals |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CA2736684A CA2736684C (en) | 2011-04-08 | 2011-04-08 | Systems and methods for adjusting audio levels in a plurality of audio signals |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2736684A1 CA2736684A1 (en) | 2012-10-08 |
| CA2736684C true CA2736684C (en) | 2019-02-19 |
Family
ID=47008166
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA2736684A Active CA2736684C (en) | 2011-04-08 | 2011-04-08 | Systems and methods for adjusting audio levels in a plurality of audio signals |
Country Status (1)
| Country | Link |
|---|---|
| CA (1) | CA2736684C (en) |
-
2011
- 2011-04-08 CA CA2736684A patent/CA2736684C/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| CA2736684A1 (en) | 2012-10-08 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP6851523B2 (en) | Loudness and dynamic range optimization across different playback devices | |
| US8355909B2 (en) | Hybrid permanent/reversible dynamic range control system | |
| JP5129888B2 (en) | Transcoding method, transcoding system, and set top box | |
| US8712784B2 (en) | Encoding method and encoding device, decoding method and decoding device and transcoding method and transcoder for multi-object audio signals | |
| KR102192755B1 (en) | Audio encoder and decoder with program loudness and boundary metadata | |
| CA3162763C (en) | Decoding apparatus and method, and program | |
| US10242684B2 (en) | Systems and methods for adjusting audio levels in a plurality of audio signals | |
| JP2009500659A (en) | Audio signal encoding and decoding method and apparatus | |
| CN107112024A (en) | Encoding and decoding of audio signals | |
| US20120081604A1 (en) | Electronic apparatus | |
| JP5012859B2 (en) | Volume control device | |
| AU2009217190B2 (en) | Transporting vibro-kinetic signals in a digital cinema environment | |
| US10446160B2 (en) | Coding device and method, decoding device and method, and program | |
| CA2736684C (en) | Systems and methods for adjusting audio levels in a plurality of audio signals | |
| US20200051576A1 (en) | Signal processing apparatus, signal processing method, and program | |
| WO2021255327A1 (en) | Managing network jitter for multiple audio streams | |
| US11810581B2 (en) | Multipoint control method, apparatus and program | |
| US11949817B2 (en) | Multipoint control method, apparatus and program | |
| US11837241B2 (en) | Encoding and decoding method, decoding method, apparatuses therefor and program | |
| RU2777880C2 (en) | Optimization of volume and dynamic range through various playback devices | |
| US20220124201A1 (en) | Multipoint control method, apparatus and program | |
| JP2009192944A (en) | Audio output device and audio output method | |
| US20060080093A1 (en) | Decoder | |
| HK1261365A1 (en) | System and method for optimizing loudness and dynamic range across different playback devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request |
Effective date: 20160331 |
|
| MPN | Maintenance fee for patent paid |
Free format text: FEE DESCRIPTION TEXT: MF (PATENT, 14TH ANNIV.) - STANDARD Year of fee payment: 14 |
|
| U00 | Fee paid |
Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U00-U101 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE REQUEST RECEIVED Effective date: 20250331 |
|
| U11 | Full renewal or maintenance fee paid |
Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U11-U102 (AS PROVIDED BY THE NATIONAL OFFICE); EVENT TEXT: MAINTENANCE FEE PAYMENT PAID IN FULL Effective date: 20250331 |