RU2792944C2 - Methods, device and systems for generating, transmitting and processing immediate playback frames (ipf) - Google Patents

Abstract

FIELD: computing technology.

SUBSTANCE: technical result is achieved by decoding the encoded audio data bitstream, wherein the encoded audio data bitstream represents a sequence of audio signal sample values and contains a plurality of frames, each frame containing associated encoded audio signal sample values; removing instant play frames from the encoded audio data bitstream and a corresponding permanent digital storage medium.

EFFECT: technical result consists in enabling the processing of the instant playback frame (IPF) in the MPEG-4 Audio standard.

15 cl, 9 dwg

Description

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority to the following priority application: U.S. provisional application 62/720,680 (reference: D18080USP1), filed August 21, 2018, which is incorporated herein by reference.

FIELD OF TECHNOLOGY

The present invention generally relates to audio encoders, coding methods, audio decoders, and decoding methods, including a method for decoding an encoded audio data bitstream, wherein the encoded audio data bitstream represents a sequence of audio sample values and contains a plurality of frames, each frame contains associated encoded audio sample values, and a method for generating an encoded audio data bitstream with instant playback frames. The present invention also relates to an apparatus for generating instant play frames in an encoded audio bitstream or for removing instant play frames from an encoded audio bitstream.

Although some embodiments will be described herein with specific reference to the present invention, it should be understood that the present invention is not limited to such a field of use and may be applicable in broader contexts.

BACKGROUND OF THE INVENTION

There is currently a flaw in the MPEG-4 Audio standard as outlined in ISO/IEC 14496-3, Audiovisual Object Coding. Part 3: Audio" in the context of generating, transmitting and processing instant playback frames (IPF). The IPF provides information in a special frame, which allows the decoder to be initialized immediately, and thus perform immediate playback when switching to the data stream containing the special frame. In other words, the IPF is a frame upon receipt of which the decoder can immediately make correct samples from the first sample encoded in this IPF, since it contains all the information necessary for this. IPF thus denotes an independently decodable frame that can be decoded using information contained within itself alone.

The encoded audio signal usually comes in the form of frames or chunks of data. In the context of MPEG-4 standardized audio, frames/chunks may be known as granules, coded chunks/frames are called access units (AUs), and decoded chunks are called compound units (CUs). In transmission systems, the audio signal can only be accessed and addressed in the granularity of these encoded fragments (access blocks).

In the context of adaptive streaming, when the audio signal is switched to a different configuration (e.g., a different bit rate, such as the bit rate configured within the adaptation set in MPEG-DASH), in order to reproduce the audio samples exactly from the beginning, the decoder needs to be fed AU _n representing the corresponding time section of the audio program, and additional AU _n-1 , AU _n-2 , ...AU and configuration data preceding AU _n . Otherwise, due to different encoding configurations (eg, windowing data, SBR-related data, PS-related data), it cannot be guaranteed that the decoder will produce correct output when decoding only AU _n . Thus, the first AU _n to be decoded with the new configuration must carry the new configuration data and any preloaded data (in the form of AU _nx representing time slices before AU _n ) needed to initialize the decoder with the new configuration. This can be done by means of an instant playback frame (IPF) as defined in the MPEG-H 3D Audio standard, or in the MPEG-D USAC standard.

In view of the above, it is an object of the present invention to provide an audio decoder and a decoding method, as well as an audio encoder, an audio encoder system, an apparatus and an encoding method that can process IPF in MPEG-4 Audio.

SUMMARY OF THE INVENTION

According to a first aspect of the present invention, an audio decoder is provided for decoding an encoded audio data bitstream, wherein the encoded audio data bitstream represents a sequence of audio sample values and comprises a plurality of frames, each frame containing associated audio sample encoded values.

The audio decoder may comprise a determination unit configured to determine whether a frame of the encoded audio data bitstream is an instant playback frame that contains encoded audio sample values associated with the current frame and side information, wherein the side information may comprise encoded sample values. audio signal of a certain number of frames preceding the immediate playback frame, and the encoded values of the samples of the audio signal of the previous frames can be encoded using the same codec configuration as the current frame, and the number of previous frames corresponding to preloaded frames can correspond to the number of frames that necessary for the decoder to generate a complete signal in order to be able to output the actual audio sample values associated with the current frame each time an instant playback frame is decoded.

And, the decoder may comprise an initialization block configured to initialize the decoder if the determining block determines that the frame is an immediate playback frame, wherein the decoder initialization may include decoding the encoded audio sample values contained in the side information before decoding the encoded audio sample values. associated with the current frame, wherein the initializer may be configured to switch the audio decoder from the current codec configuration to another codec configuration if the determiner determines that the frame is an immediate playback frame, and if the audio sample values of the current frame have been encoded with using a different codec configuration, and wherein the decoder may be configured to decode the current frame using the current codec configuration and discard the side information if the determiner determines that the frame is an immediate playback frame and if the audio sample values of the current frame were encoded using current codec configuration.

In some embodiments, the side information may further comprise codec configuration information that is used to encode audio sample values associated with the current frame, and the determiner may further be configured to determine if the side information codec configuration is different from the current codec configuration. .

In some embodiments, the instant play frame may contain additional information as an extension payload, and the determiner may be configured to evaluate the extension payload of the instant play frame.

In some embodiments, the encoded audio data bitstream may be an MPEG-4 Audio bitstream.

In some embodiments, the additional information may be conveyed via an MPEG-4 Audio bitstream extension mechanism that is either a data stream element (DSE) or an extension_payload element.

In some embodiments, either a data stream element (DSE) or an extension_payload element may be located at a given position in the MPEG-4 Audio bitstream and/or may have a specific specific label indicating that the payload of a data stream element (DSE) or element extension_payload is additional information.

The extension_payload element may, for example, appear in different places in the MPEG-4 Audio bitstream syntax. Accordingly, this allows the instant playback frame functionality to be used also in MPEG-4 Audio.

In some embodiments, the extension_payload element may be within a fill element (ID_FIL).

In some embodiments, the additional information may further comprise a unique identifier, and optionally the unique identifier may be used to detect a different codec configuration.

In some embodiments, the decoder may further comprise a smooth mixing unit configured to perform smooth mixing of output sample values obtained by resetting the decoder in a previous codec configuration and output sample values obtained by decoding the encoded audio sample values associated with the current overs.

In some embodiments, the earliest frame of the number of frames contained in the side information may not be temporally differential or entropy encoded with respect to any frame prior to the earliest frame, and the immediate playback frame may not be temporally differential or entropy encoded with respect to any frame to the earliest frame of the number of frames preceding the instant playback frame, or relative to any frame before the immediate playback frame.

According to a second aspect of the present invention, there is provided a method for decoding an encoded audio bitstream, wherein the encoded audio bitstream represents a sequence of audio sample values and comprises a plurality of frames, each frame containing associated encoded audio sample values.

The method may include determining if a frame of the encoded audio data bitstream is an instant playback frame that contains encoded audio sample values associated with the current frame and side information, the side information may include encoded audio sample values of a number of frames preceding instant playback frame, wherein the encoded audio sample values of previous frames may be encoded using the same codec configuration as the immediate playback frame, wherein the number of previous frames corresponding to preloaded frames may correspond to the number of frames that the decoder needs to generate the complete signal to be able to output the actual audio sample values associated with the current frame each time an instant playback frame is decoded.

The method may further include initializing the decoder if the frame is determined to be an instant playback frame, wherein the initialization may include decoding the coded audio sample values contained in the side information before decoding the coded audio sample values associated with the current frame.

The method may further include switching the audio decoder from the current codec configuration to another codec configuration if the frame is determined to be an immediate playback frame and if the audio sample values of the immediate playback frame were encoded using a different codec configuration.

And the method may include decoding the instant playback frame using the current codec configuration and discarding additional information if the frame is determined to be an immediate playback frame and if the audio sample values of the immediate playback frame were encoded using the current codec configuration.

Configured as proposed, the method allows, for example, switching AudioObjectTypes (Audio Object Types) (AOT) as defined in ISO/IEC 14496-3, in combination with continuously generating correct output samples and without introducing periods of silence into the audio output.

In some embodiments, the side information may further comprise codec configuration information that is used to encode audio sample values associated with the current frame, the method may further include determining if the side information codec configuration is different from the current codec configuration used for encoding. audio sample values associated with frames in the bitstream prior to the immediate playback frame.

In some embodiments, the encoded audio data bitstream may be an MPEG-4 Audio bitstream.

In some embodiments, the additional information may be conveyed via the MPEG-4 Audio bitstream extension mechanism, which is either a data stream element (ID_DSE) or an extension_payload element.

In some embodiments, either the data stream element (ID_DSE) or the extension_payload element may be located at a given position in the MPEG-4 Audio bitstream and/or may have a specific specific label indicating that the payload of the data stream element (ID_DSE) or the element extension_payload is additional information.

In some embodiments, the extension_payload element may be within a fill element (ID_FIL).

In some embodiments, the additional information may further comprise a unique identifier, and optionally the unique identifier may be used to detect a different codec configuration.

In some embodiments, the encoded audio data bitstream may comprise a first number of frames encoded using a first codec configuration and a second number of frames following the first frame number and encoded using a second codec configuration, where the first frame of the second number of frames may be instant playback frame.

According to a third aspect of the present invention, an audio encoder is provided for generating an encoded audio data bitstream with instant play frames, the encoded audio data bitstream representing a sequence of audio sample values and comprising a plurality of frames, each frame containing associated encoded audio sample values.

The audio encoder may comprise a core encoder configured to encode uncompressed audio sample values associated with a plurality of frames using a predetermined codec configuration.

The audio encoder may further comprise a buffer configured to store encoded audio sample values of a number of frames preceding the current frame from a plurality of frames encoded using a given codec configuration.

And the audio encoder may comprise an embedder configured to record an immediate playback frame into a current frame of a plurality of frames, wherein the immediate playback frame may contain encoded audio sample values associated with said current frame and side information corresponding to encoded audio sample values of the number frames preceding the specified current frame.

In some embodiments, the implementation of the embedder may be further configured to include information about a given codec configuration in the additional information.

In some embodiments, the implementation of the embedder may be further configured to include additional information in the frame of immediate playback.

In some embodiments, the generated encoded audio data bitstream may be an MPEG-4 Audio bitstream.

In some embodiments, the embedder may be further configured to insert additional information into the bitstream via the MPEG-4 Audio bitstream extension mechanism, which is either a data stream element (ID_DSE) or an extension_payload element.

In some embodiments, the embedder may be further configured to place either a data stream element (ID_DSE) or an extension_payload element at a given position in the MPEG-4 Audio bitstream and/or assign a specific specific label indicating that the payload of the data stream element ( ID_DSE) or extension_payload element is additional information.

In some embodiments, the implementation of the embedder may be further configured to include the extension_payload element inside the fill element (ID_FIL).

In some embodiments, the implementation of the embedder may be further configured to include a unique identifier in the additional information, and optionally a unique identifier may communicate a given configuration of codecs.

In some embodiments, the audio encoder may be further configured to not temporally differential or entropy encode the earliest frame of the number of frames contained in the side information relative to any frame prior to the earliest frame, and the audio encoder may be further configured not to temporal differential encoding or entropy encoding of the instant playback frame with respect to any frame up to the earliest frame of the number of frames preceding the instant playback frame, or with respect to any frame before the instant playback frame.

According to a fourth aspect of the present invention, there is provided a system comprising two or more audio encoders for generating a plurality of encoded audio data bitstreams, each having immediate playback frames, each encoded audio data bitstream representing a sequence of audio sample values and comprising a plurality of frames , and each frame contains the associated encoded audio sample values.

In some embodiments, the predetermined sampling rate may be the same for each of the base encoders of the two or more audio encoders. Accordingly, oversampling and additional delay processing at the decoder can be avoided.

In some embodiments, the system may further comprise a delay equalizer for delay equalization of multiple bitstreams. Accordingly, this allows for smooth switching at the decoder by compensating for the delays of different encoders.

According to a fifth aspect of the present invention, there is provided a method for generating, by an audio encoder, an encoded audio data bitstream with instant play frames, the encoded audio data bitstream representing a sequence of audio sample values and comprising a plurality of frames, each frame containing associated encoded audio sample values. .

The method may include the step of encoding, by means of a core encoder, uncompressed audio sample values associated with a plurality of frames using a predetermined codec configuration.

The method may further include the step of storing, via a buffer of encoded audio sample values, a number of frames preceding the current frame from a plurality of frames encoded using a given codec configuration.

And the method may include the step of recording, by means of an instant playback frame embedder, into a current frame of a plurality of frames, wherein the immediate playback frame may contain encoded audio sample values associated with said current frame and additional information corresponding to the encoded audio sample values of the number of frames preceding specified current frame.

In some embodiments, the additional information may further comprise information about the specified codec configuration.

In some embodiments, the instant play frame may further comprise additional information.

In some embodiments, the generated encoded audio data bitstream may be an MPEG-4 Audio bitstream.

In some embodiments, additional information may be introduced into the bitstream by an embedder using the MPEG-4 Audio bitstream extension mechanism, which may be either a data stream element (ID_DSE) or an extension_payload element.

In some embodiments, either the data stream element (ID_DSE) or the extension_payload element can be placed by the embedder at a given position in the MPEG-4 Audio bitstream and/or it can be assigned a specific specific label indicating that the payload of the data stream element ( ID_DSE) or extension_payload element is additional information.

In some embodiments, the extension_payload element may be inserted via an embedder inside a fill element (ID_FIL).

In some embodiments, the additional information may further comprise a unique identifier, and optionally, the unique identifier may communicate a predetermined codec configuration.

In some embodiments, by an audio encoder, the earliest frame of the number of frames contained in the side information may not be temporally differentially coded or entropy encoded with respect to any frame prior to the earliest frame, and by an audio encoder, an immediate playback frame may not be temporally differentially coded. coding or entropy coding with respect to any frame up to the earliest frame of the number of frames preceding the immediate playback frame, or with respect to any frame before the immediate playback frame.

According to a sixth aspect of the present invention, there is provided an apparatus for generating instant playback frames in an encoded audio bitstream or for removing instant playback frames from an encoded audio bitstream, wherein the encoded audio bitstream represents a sequence of audio sample values and contains a plurality of frames, wherein each frame contains associated encoded audio sample values.

The apparatus may comprise a receiver configured to receive an encoded audio data bitstream, wherein the encoded audio data bitstream represents a sequence of audio sample values and comprises a plurality of frames, each frame containing associated encoded audio sample values.

And the device may contain an embedder configured to record an immediate playback frame into the current frame of a plurality of frames, wherein the immediate playback frame may contain encoded audio sample values associated with the specified current frame, and additional information corresponding to the encoded audio sample values of a certain number frames preceding the specified current frame.

Configured as proposed, the device allows immediate playback frames to be individually generated in any pre-existing encoded audio data bitstreams, i.e., prior to distribution, if desired.

In some embodiments, the apparatus may further comprise a buffer configured to store encoded audio sample values of the number of frames preceding the current frame from the plurality of frames.

In some embodiments, the implementation of the embedder may be further configured to remove additional information from the immediate playback frame corresponding to the encoded values of the audio samples of the number of frames preceding the specified current frame.

Accordingly, this allows immediate playback frames to be individually removed from the encoded audio data bitstream, for example, in the case where the audio encoder only generates immediate playback frames.

According to a seventh aspect of the present invention, a permanent digital storage medium is provided on which a computer program is stored for performing a method for decoding an encoded audio data bitstream, wherein the encoded audio data bitstream represents a sequence of audio sample values and contains a plurality of frames, each frame containing associated encoded values of audio signal samples when said computer program is executed by a computer or processor.

According to an eighth aspect of the present invention, a permanent digital storage medium is provided on which a computer program is stored for performing a method for generating, by means of an audio encoder, an encoded audio data bitstream with instant playback frames, the encoded audio data bitstream representing a sequence of audio sample values and comprising a plurality of frames, each frame containing associated encoded audio sample values when said computer program is being executed by a computer or processor.

BRIEF DESCRIPTION OF GRAPHICS

Exemplary embodiments of the present invention will be described below, by way of example only, with reference to the accompanying drawings, in which:

in fig. 1 shows an example of an instant playback frame in an MPEG-4 Audio bitstream of encoded audio data;

in fig. 2 shows an exemplary method for decoding an encoded audio data bitstream, wherein the encoded audio data bitstream represents a sequence of audio sample values and comprises a plurality of frames, each frame containing associated encoded audio sample values;

in fig. 3 shows another example of a method for decoding an encoded audio data bitstream, wherein the encoded audio data bitstream represents a sequence of audio sample values and comprises a plurality of frames, each frame containing associated encoded audio sample values;

in fig. 4 shows an exemplary audio decoder for decoding an encoded audio data bitstream, wherein the encoded audio data bitstream represents a sequence of audio sample values and comprises a plurality of frames, each frame containing associated coded audio sample values;

in fig. 5 shows an example of an audio encoder for generating an encoded audio data bitstream with random access points (immediate play frames, IPFs);

in fig. 6 shows an example of a method for generating an encoded audio data bitstream with random access points (immediate play frames, IPFs);

in fig. 7 shows an exemplary system of audio encoders for generating a plurality of encoded audio data bitstreams, each having time-synchronized random access points (immediate play frames, IPFs);

in fig. 8 shows an exemplary apparatus for generating random access points (immediate play frames, IPF) in an encoded audio bitstream or for removing random access points (immediate play frames, IPF) from an encoded audio bitstream;

in fig. 9 shows an example of an apparatus having a processor for executing a computer program stored on a permanent digital storage medium.

DETAILED DESCRIPTION

The present invention relates to the creation (encoding), transmission (bitstream) and processing (decoding) of an IPF in MPEG-4 Audio, for example in the context of a data stream containing audio standardized according to another standard, such as the MPEG-H 3D standard. audio. Hereinafter, MPEG-4 Audio bitstreams may refer to bitstreams conforming to the standard set out in ISO/IEC 14496-3, “Coding of audiovisual objects. Part 3 Audio" and all future editions, corrections and amendments to it ("hereinafter MPEG-4 Audio"). To provide IPF functionality in MPEG-4 Audio, there are several options for generating and transmitting AU and configuration data preceding AU _n in time as part of the same payload packet as used for AU _n . This is done to ensure that audio samples are correctly derived from the first sample resulting from the decoding of AU _n .

The encoded audio data bitstream may contain a sequence of audio sample values, such as payload packets. The encoded audio data bitstream may further comprise a plurality of frames. Each frame may contain associated encoded audio sample values. In other words, each payload packet may belong to a corresponding frame or AU.

In one example, an audio payload packet may conform to the following syntax, as defined in ISO/IEC 14496-3:

raw_data_block() {

while( (id = id_syn_ele ) != ID_END ){ 3 uimsbf

switch (id) {

case ID_SCE: single_channel_element(); break;

case ID_CPE: channel_pair_element(); break;

case ID_CCE: coupling_channel_element(); break;

case ID_LFE: lfe_channel_element(); break;

case ID_DSE: data_stream_element(); break;

case ID_PCE: program_config_element(); break;

case ID_FIL: fill_element();

}

}

byte_align()

}

The audio payload package described above may be compatible with current and future versions of the MPEG standard, such as the MPEG-4 Audio standard. In one embodiment, the encoded audio data bitstream may be an MPEG-4 Audio bitstream (ie, an MPEG-4 Audio standard compliant bitstream).

The encoded audio data bitstream frame may be an instant play frame (random access point, special frame) containing encoded audio sample values associated with the current frame and additional information. The side information may comprise encoded audio sample values of a number of frames preceding the instant playback frame, wherein the encoded audio sample values of previous frames may be encoded using the same codec configuration as the current frame. The number of previous frames corresponding to the preloaded frames may correspond to the number of frames that the decoder needs to generate a complete signal to be able to output the actual audio sample values associated with the current frame each time an immediate playback frame is decoded. The complete signal may, for example, be generated during start-up or restart of the decoder. The instant play frame may be, for example, the first frame after the start of the decoder.

In one embodiment, the additional information may be conveyed by an MPEG-4 bitstream extension mechanism, which may be either a data stream element (ID_DSE) or an extension_payload element. The extension_payload element may, for example, be located in different places in the MPEG-4 Audio bitstream syntax, for example, at different levels. In one embodiment, the extension_payload element may be within a fill element (ID_FIL).

The side information can thus be conveyed by the MPEG-4 Audio bitstream extension mechanism, for example based on one of the following options:

Option 1:

raw_data_block() -> case ID_DSE -> data_stream_element() -> data_stream_byte[element_instance_tag][i];

Option 2:

raw_data_block() -> case ID_FIL -> fill_element() -> extension_payload(cnt) -> switch( extension_type ) -> extension_type == EXT_DATA_ELEMENT (+ convention how to identify) or EXT_AUDIO_PRE_ROLL

Option 3:

er_raw_data_block() or er_raw_data_block_eld() -> extension_payload(cnt) -> switch( extension_type ) -> extension_type == EXT_DATA_ELEMENT (+ convention how to identify) or EXT_AUDIO_PRE_ROLL

A data flow element (reported by id_syn_ele equal to ID_DSE) or padding element (reported by id_syn_ele equal to ID_FIL), or their equivalents, as defined in ISO/IEC 14496-3 and/or future standards, may be used to carry extension payloads, which can be used to further enhance the information that is carried in such a payload packet without breaking compatibility with legacy decoders.

Thus, in the context of MPEG-4 Audio, either a data stream element (ID_DSE) or an extension_payload element, which may be within a fill element (ID_FIL), may be used to convey AU and configuration information that represent time slices up to AU _n ( i.e. additional information) in the same payload packet as AU _n (i.e. current frame, instant play frame). This can additionally be used to apply processing that allows the IPF functionality to be used also in MPEG-4 Audio. Similar to MPEG-D USAC where an extension mechanism (usacExtElement) can be used to pass the AudioPreRoll() payload, but with some differences.

In one embodiment, an extension element (eg, an extension_payload element) may be introduced into the AU, with the element type reported in the bitstream for each element and AU. In one example, the extension element may be the first element in the payload packet that precedes the first audio element.

Each audio preload element, defined below, can be identified by a universally unique identifier (UUID). The UUID field may be used for reporting by the audio encoder and detection by the audio decoder of switching stream configurations. If the UUID field has changed from the previous frame or initial state (eg, when the decoder was first started), the stream configuration may have changed and the preloaded payload must be evaluated to ensure correct decoding. If the UUID has not changed from the previous frame, the decoder may skip the audio_preroll_element() payload and proceed with normal decoding.

In one example, if no UUID is present, the decoder may compare the AudioSpecificConfig owned by audio_preroll_element() with the decoder's current configuration to detect a stream configuration switch.

The flags field is used as an 8-bit set of bits that can be used to provide additional information to the decoder. It may be information about whether smooth mixing should be applied or the type of smooth mixing (eg, linear, logarithmic). In the example below, one bit is used to report whether or not a preloaded payload or UUID is present in the bitstream.

The stream configuration must be known to the decoder before any AUs are processed. In MPEG-4 Audio, the decoder configuration is passed in the AudioSpecificConfig element. The decoder configuration and UUID are part of the preloaded payload. In addition, the preloaded payload contains a configuration dependent number of MPEG-4 Audio AUs (raw_data_block).

An immediate playback frame (IPF) in MPEG-4 may contain exactly one audio_preroll_element() payload, as described below, and one or more audio element streams (eg, single_channel_element()) defined in ISO/IEC 14496-3. The elementary streams of sound elements are associated with the current timestamp. The preloaded payload may be carried in one of the payload mechanisms of the MPEG-4 Audio extension.

In FIG. 1 shows an immediate playback frame (AU _n ) 1 containing two preloaded frames (AU _n-1 , AU _n-2 ) 2, 3, as well as the corresponding stream 4 configuration (AudioSpecificConfig) and stream identifier 5 (UUID).

An audio preload element can be determined based on the following:

audio_preroll_element() {

flags ; 8 umbsf

if((flags & 0x01) == 1)

uid ; 128 uimbsf

if((flags & 0x02) == 0) return; // No payload present

asc_size = bs_asc_size ; 8 umbsf

if(asc_size == 255)

asc_size += esc ; 8 umbsf

AudioSpecificConfig(); asc_size * 8

n_preroll_frames ; 8 umbsf

for(f = 0; f < n_preroll_frames; ++f) {

au_size = bs_au_size ; 8 umbsf

if(au_size == 255)

au_size += esc ; 8 umbsf

raw_data_block(); au_size * 8

}

}

In one example, an audio preload element (eg, audio_preroll_element()) is byte-aligned and thus can be passed without additional byte-alignment as both an extension_payload element (eg, within a padding element) and a dataflow element.

In one example, the IPF refers to the preloaded element as follows: The IPFs contain both the current AU and additional AUs (ie, the number of previous frames) that are necessary for proper decoding. Additional AUs are packed as part of the preload element, which is in turn packed in raw_data_block() (via ID_DSE or ID_FIL). Such raw_data_block may be an IPF.

The IPFs may be encoded in various ways. In one example, the preloaded frame must be independently decodable, for example, if SBR is used, an SBR header must be present. In one embodiment, audio_preroll_element() may be encapsulated in a data stream element. For example, audio_preroll_element() can be encapsulated in a data stream element based on the following syntax:

data_stream_element() {

element_instance_tag ; 4 uimsbf

data_byte_align_flag ; 1 uimsbf

cnt= count ; 8 uimsbf

if (cnt == 255)

cnt += esc_count ; 8 uimsbf

if (data_byte_align_flag)

byte_alignment();

for (i = 0; i < cnt; i++)

data_stream_byte [element_instance_tag][i]; 8 uimsbf

}

The convention can be used to identify the data stream element (ID_DSE) that audio_preroll_element() carries. In one embodiment, the ID_DSE may be located at a given position in the stream and/or may have a specific specific label indicating that the payload is an audio_preroll_element().

In another embodiment, audio_preroll_element() may be encapsulated in an extension_payload element within a padding element. For example, audio_preroll_element() can be encapsulated based on the following syntax:

fill_element() {

cnt= count ; 4 uimsbf

if (cnt == 15)

cnt += esc_count - 1; 8 uimsbf

while (cnt > 0) {

cnt -= extension_payload(cnt);

}

}

As in the previous example, a convention can be used to identify the element type of the extension_payload, for example, if an EXT_DATA_ELEMENT is passed at a specific pre-rolled position in the payload packet, then the payload is an audio_preroll_element(). Thus, in one embodiment, the extension_payload element may be located at a given position in the stream and/or may have a specific specific label indicating that the payload is an audio_preroll_element().

In one example, an extension payload in accordance with the present invention may be communicated using a new extension payload type, such as extension_type =

EXT_AUDIO_PRE_ROLL = 1010b.

extension_payload(cnt) {

extension_type ; 4 uimsbf

align=4;

switch( extension_type ) {

case EXT_AUDIO_PRE_ROLL:

// Always byte-aligned, do not modify align

audio_preroll_element();

break;

[...]

In one example, the data stream element (ID_DSE) or extension_payload element (eg, within padding element (ID_FIL)) that carries audio_preroll_element() may be introduced into the bitstream before any audio element in the same payload packet. Some examples of inputting an IPF payload this way include:

Mono : < ID_(DSE|FIL) ><ID_SCE>…<ID_END> 5.1 : < ID_(DSE|FIL )><ID_SCE><ID_CPE><ID_CPE><ID_LFE>…<ID_END>

One aspect of the present invention relates to IPF decoding. Referring to the example in FIG. 2; the decoding method may include step S101 of receiving the encoded audio data bitstream. The encoded audio data bitstream may represent a sequence of audio sample values and may comprise a plurality of frames, where each frame may contain associated encoded audio sample values.

The method may further include step S102 of determining whether the encoded audio data bitstream frame is an immediate playback frame. The instant playback frame may contain encoded audio sample values associated with the current frame and additional information. The side information may comprise encoded audio sample values of a number of frames preceding the instant play frame, wherein the encoded audio sample values of previous frames are encoded using the same codec configuration as the instant play frame. The number of previous frames corresponding to the preloaded frames may correspond to the number of frames that the decoder needs to generate a complete signal to be able to output the actual audio sample values associated with the current frame each time an immediate playback frame is decoded. The complete signal may, for example, be generated during start-up or restart of the decoder. The instant play frame may be, for example, the first frame after the start of the decoder.

And the method may include the decoder initialization step S103 if it is determined that the frame is an instant playback frame. The initialization may include decoding the encoded audio sample values contained in the side information before decoding the encoded audio sample values associated with the current frame.

Referring now to the example of FIG. 3; the audio decoder may be switched from the current codec configuration to another codec configuration if the frame is determined to be an instant playback frame and if the audio sample values of the instant playback frame were encoded using a different codec configuration. An instant playback frame may be decoded using the current codec configuration, and side information may be discarded if the frame is determined to be an immediate playback frame and if the audio sample values of the instant playback frame were encoded using the current codec configuration.

In one example, the decoding method may use elements from IPF to MPEG-D USAC decoding. Referring again to the example in Fig. 3; the decoding method can be performed exactly as follows.

• If payload is present and if uuid has changed from the previous frame (decision in block S104)

OR

• If payload is present and uuid is not present (decision in block S105)

1. Read the new flow configuration S106, i.e. AudioSpecificConfig() from audio_preroll_element()

2. Reset the decoder states and store the result in buffer S107, for example, using the "NULL" access block

▪ Store the result in a buffer (smooth mix buffer)

3. Re-configure (re-initialize) the S108 decoder

4. Decode n_preroll_frames to audio_preroll_element S109 and discard output

5. Decode the next audio element (e.g. SCE/CPE/LFE) in the bitstream and store the result in a buffer (Fade Mix Buffer B)

▪ If signaled by flags , apply S110 soft-mix between soft-mix buffer A and decoder output, and write the result to the PCM output buffer. The result of smooth mixing constitutes the composite block for that frame

▪ Otherwise write decoder output directly to PCM buffer

6. Continue with the next frame

• ELSE

1. Skip audio_preroll_element() and decode frame S111

2. Write the result to the PCM buffer S112

The decoding method may further include the following:

• If no payload is present, decode the corresponding frame and continue with the next frame

In one example, this processing may allow switching AudioObjectTypes (AOT) as defined in ISO/IEC 14496-3, in combination with continuously generating correct output samples and without introducing periods of silence into the audio output. In one example, AOTs that are switched may include AOT 2 (AAC), AOT 5 (SBR), AOT 29 (PS), and other compatible instances.

Referring now to the example in Fig. 4; one aspect of the present invention relates to an audio decoder for IPF decoding. The audio decoder 100 may include a determiner 101 . The determining unit 101 may be configured to determine whether a frame of the encoded audio data bitstream is an instant playback frame that contains encoded audio sample values associated with the current frame and side information. The side information may comprise encoded audio sample values of a number of frames preceding the immediate playback frame. The encoded audio sample values of previous frames may be encoded using the same codec configuration as the current frame. The number of previous frames corresponding to the preloaded frames may correspond to the number of frames that the decoder 100 needs to complete the signal to be able to output the actual audio sample values associated with the current frame each time an instant playback frame is decoded. The complete signal may, for example, be generated during the start or restart of the decoder 100. The instant playback frame may be, for example, the first frame after the start of the decoder 100.

And the audio decoder 100 may include an initialization block 102 . The initializer 102 may be configured to initialize the decoder 100 if the determiner 101 determines that the frame is an instant playback frame. Initialization of the decoder 100 may include decoding the encoded audio sample values contained in the side information before decoding the encoded audio sample values associated with the current frame. The initializer 102 may be further configured to switch the audio decoder 100 from the current codec configuration to another codec configuration if the determiner 101 determines that the frame is an immediate playback frame, and if the audio sample values of the current frame were encoded using a different configuration. codecs. And, the decoder 100 may be configured to decode the current frame using the current codec configuration and discard side information if the determiner 101 determines that the frame is an immediate playback frame and if the audio sample values of the current frame have been encoded using the current codec configuration .

Referring now to the example in Fig. 5; one aspect of the present invention relates to an audio encoder for generating an encoded audio data bitstream with instant play (random access points) frames, the encoded audio data bitstream representing a sequence of audio sample values and comprising a plurality of frames, each frame containing associated encoded sample values sound signal.

Audio encoder 200 may include a core encoder 202 configured to encode uncompressed audio sample values associated with multiple frames using a predetermined codec configuration. The use of a given codec configuration may, for example, include the use of a predetermined sampling rate. In one example, core encoder 202 may encode uncompressed audio samples that must be compatible with MPEG-4 Audio decoding.

Audio encoder 200 may further comprise a buffer 203 configured to store encoded audio sample values of a number of frames preceding the current frame from a plurality of frames encoded using a given codec configuration (as indicated by dashed lines).

When encoding, for example, frame N, the corresponding previous frames N-1, N-2, ... can always be buffered/stored. When instructed to write an IPF to frame N (for example, every 2 seconds to ensure dynamic switching), the stored corresponding previous frames N-1, N-2, ... can be taken and packed into the current frame N.

And, the audio encoder 200 may include an embedder 204 configured to record an immediate playback frame into a current frame of a plurality of frames, wherein the immediate playback frame may comprise encoded audio sample values associated with said current frame and side information corresponding to the encoded audio sample values. a signal of the number of frames preceding the specified current frame.

Although in the example of FIG. 5, embedder 204 is defined as part of audio encoder 200, it should be noted that alternatively or additionally, embedder 204 can also be implemented separately to record immediate play frames in any current frame of the encoded audio bitstream, or to transform the immediate play frames in the encoded audio bitstream. into "normal" frames by removing additional information from the immediate playback frames. In this case, the embedder 204 may be part of the encoder scheme, but need not be.

In one embodiment, embedder 204 may be further configured to include information about a given codec configuration in the side information. In this case, the side information may provide information about the specified codec configuration to the decoder.

In one embodiment, embedder 204 may be further configured to include additional information in an immediate play frame. Thus, the side information can be transmitted in the bitstream to the decoder.

In one embodiment, the generated encoded audio data bitstream may be an MPEG-4 Audio bitstream.

In one embodiment, embedder 204 may be further configured to insert additional information into the bitstream (eg, for transmission) via an MPEG-4 Audio bitstream extension mechanism, which may be either a data stream element (ID_DSE) or an extension_payload element.

In one embodiment, embedder 204 may be further configured to place either a data stream element (ID_DSE) or an extension_payload element at a given position in the MPEG-4 Audio bitstream and/or assign a specific specific label indicating that the payload of the data stream element (ID_DSE) or extension_payload element is additional information. The given position may correspond to the first position in the MPEG-4 Audio bitstream, i. e. always first in frames, as it may carry decoder configuration that may be required to decode frame n (FIG. 1, raw_data_block()[n]). The decoder may thus assume that if the first element in a frame is an ID_DSE or an extension_payload element (may be within an ID_FIL element), then that element carries preloaded data (previous frames, preloaded frames).

In one embodiment, embedder 204 may be further configured to include a unique identifier in the side information. Optionally, the unique identifier may communicate a given codec configuration. The given codec configuration can then be used by the decoder to decode frame n as above. Based on the unique identifier, the decoder may be able to identify additional information in the bitstream and parse the bitstream accordingly.

In one embodiment, the audio encoder 200 may be further configured to not temporally differential or entropy encode the earliest frame of the number of frames contained in the side information relative to any frame prior to the earliest frame, and the audio encoder 200 may be further configured to the possibility of not temporally differential or entropy encoding the instant playback frame with respect to any frame up to the earliest frame of the number of frames preceding the instant playback frame, or with respect to any frame before the immediate playback frame.

Referring now to the example in Fig. 6; One aspect of the present invention relates to a method for generating, by means of an audio encoder, an encoded audio data bitstream with instant playback frames (random access points), wherein the encoded audio data bitstream represents a sequence of audio sample values and contains a plurality of frames, each frame containing associated encoded values. sound signal samples.

The method may include the step of S201 encoding, by means of a core encoder, uncompressed audio sample values associated with a plurality of frames using a predetermined codec configuration. The use of a given codec configuration may, for example, include the use of a predetermined sampling rate. The method may further include the step of S202 storing, by means of a buffer of encoded audio sample values, a number of frames preceding the current frame from a plurality of frames encoded using the predetermined codec configuration.

And the method may include the step of S203 recording by the instant playback frame embedder into the current frame of the plurality of frames, wherein the immediate playback frame contains encoded audio sample values associated with said current frame and additional information corresponding to the encoded audio sample values of the number of frames preceding specified current frame.

In one embodiment, the additional information may further comprise information about a given codec configuration. The given codec configuration may be used by the decoder in the decoding method as detailed above.

In one embodiment, the instant play frame may further comprise additional information. Thus, additional information can be transmitted in the bitstream.

In one embodiment, the generated encoded audio data bitstream may be an MPEG-4 Audio bitstream.

In one embodiment, additional information may be introduced into the bitstream (eg, for transmission) by the embedder using the MPEG-4 Audio bitstream extension mechanism, which is either a data stream element (ID_DSE) or an extension_payload element. The extension_payload element may, for example, appear in different places in the MPEG-4 Audio bitstream syntax. In one embodiment, an extension_payload element may be inserted (eg, for transmission) by an embedder inside a fill element (ID_FIL).

As detailed above, in one embodiment, either the data stream element (ID_DSE) or the extension_payload element can be placed by the embedder at a given position in the MPEG-4 Audio bitstream and/or it can be assigned a specific specific label indicating that a useful the data flow element payload (ID_DSE) or extension_payload element is additional information. The given position can always be the first position in frames, as it may carry a decoder configuration that may be required to decode the current frame.

In one embodiment, the additional information may further comprise a unique identifier. Optionally, the unique identifier may communicate a given codec configuration.

In one embodiment, the earliest frame of the number of frames contained in the side information may not be temporally differential or entropy encoded by an audio encoder with respect to any frame prior to the earliest frame, and the immediate playback frame may not be temporally differential or entropy encoded. encoding by the audio encoder with respect to any frame up to the earliest frame of the number of frames preceding the immediate playback frame, or with respect to any frame before the immediate playback frame.

Referring now to the example in Fig. 7; one aspect of the present invention relates to a system comprising two or more audio encoders for generating a plurality of encoded audio data bitstreams each having instant play frames (time-synchronized random access points), each encoded audio data bitstream representing a sequence of sample values audio signal and contains a plurality of frames, and each frame contains the associated encoded values of the samples of the audio signal. Although the number of audio encoders in the system is not limited, in the example of FIG. 7 shows a system containing two audio encoders. The system may use two audio encoders in parallel on the same content, inserting instant play frames with the same cadence but having a different configuration, for example, in terms of bit rate. Each coding scheme can output its own bitstream. Both bitstreams created in this way can be stored, for example, on a web server. The client may start playing stream A (eg, at a higher bit rate). At some point in time, the client may decide to switch to Stream B at a lower bit rate and thus may request the same content but at a different bit rate. When the first segment of stream B arrives at a decoder, such a segment may always begin with an IPF (this may be communicated, for example, via an MPEG-DASH manifest file), which allows the decoder to output the correct audio from the start.

Referring now to the example in Fig. 7, two audio encoders are shown in parallel, each of the audio encoders contains a base encoder 202 (base encoder #1, base encoder #2), a buffer (not shown), and an embedder 204 (IPF input).

In one embodiment, the predetermined sampling rate may be the same for each of the base encoders 202. Otherwise, the decoder side may need to perform resampling and additional delay processing. However, core encoders 202 may be configured to operate at different frame rates (eg AAC-LC 1024; HE-AAC 2048). In addition, core encoder configurations may require different numbers of preloaded p frames. Both frame n-p and n may be required to be independently decodable, i.e. so that they can not rely on information from previous frames (for HE-AAC, they may contain an SBR header). After base encoding, IPF decoding time periods may be synchronized across different streams.

In one embodiment, the system may further comprise a delay equalizer 201 (delay #1, delay #2) to equalize the delay of multiple bit streams. For smooth switching at the decoder, it may be necessary to synchronize the decoding time periods of instant playback frames (IPFs). The delay equalization stage may delay input PCM samples (uncompressed audio sample values, input audio sample values) to compensate for different encoder/decoder delays.

Referring now to the example in Fig. 8; One aspect of the present invention relates to an apparatus for generating instant play frames (random access points) in an encoded audio bitstream or for removing instant play frames (random access points) from an encoded audio bitstream, wherein the encoded audio bitstream represents a sequence of values audio samples and comprises a plurality of frames, each frame containing associated encoded audio sample values.

The apparatus 300 may include a receiver 301 configured to receive an encoded audio bitstream, the encoded audio bitstream representing a sequence of audio sample values and comprising a plurality of frames, each frame containing associated encoded audio sample values.

And, the device 300 may include an embedder 302 configured to record an instant playback frame into a current frame of a plurality of frames, wherein the instant playback frame contains encoded audio sample values associated with said current frame and side information corresponding to encoded audio sample values of some the number of frames preceding the specified current frame. When generating the IPF, embedder 302 may operate in accordance with the principles described above in connection with FIG. 5–7. We can say that this work corresponds to the transformation of a "normal" (non-IPF) frame into IPF.

The IPF input can provide the actual copying and packaging. By separating the base encoding and IPF input, as in the above device, it is possible to store bitstreams without IPF, and only input IPF before distribution if necessary. If configured for soft switching, each IPF may contain an ASC flow configuration.

In one embodiment, apparatus 300 may further comprise a buffer configured to store encoded audio sample values of the number of frames preceding the current frame from a plurality of frames.

In one embodiment, the embedder 302 may be further configured to remove additional information from the immediate playback frame corresponding to the encoded audio sample values of the number of frames preceding the specified current frame. We can say that this corresponds to the transformation of the IPF into a "normal" frame. For example, an audio encoder may only generate IPFs, which may then be removed by the embedder, depending on the restrictions that the respective channel/service may have.

Referring now to the example in Fig. 9; aspects of the present invention may include a persistent digital storage medium that stores a computer program for performing the methods described herein when said computer program is executed by a computer or processor. In FIG. 9, for illustrative purposes, a device 400 is shown having a processor 401 that can execute the indicated computer program. Alternatively, device 400 may represent a corresponding computer.

The methods and systems described herein may be implemented as software, firmware, and/or hardware. Some components may be implemented, for example, as software running on a digital signal processor or on a microprocessor. Other components may be implemented as hardware and/or ASICs, for example. The signals encountered in the described methods and systems may be stored on media such as random access memory or optical storage media. They may be transmitted over networks such as radio networks, satellite networks, wireless networks, or wired networks such as the Internet. Typical devices using the methods, apparatus, and systems described herein are portable electronic devices or other consumer equipment that is used to store and/or render audio signals.

It should be noted that the description and drawings/figures only illustrate the principles of the proposed methods, systems and apparatuses. Those skilled in the art will be able to implement various circuits which, although not expressly described or shown herein, implement the principles of the present invention and are included within its spirit and scope. Moreover, all examples and embodiments set forth herein are expressly intended primarily for explanatory purposes to assist the reader in understanding the principles of the proposed method. In addition, all statements in this document representing the principles, aspects and embodiments of the present invention, as well as their specific examples, are intended to cover their equivalents.

Claims (46)

1. An audio decoder (100) for decoding an encoded audio data bitstream, wherein the encoded audio data bitstream represents a sequence of audio signal sample values and contains a plurality of frames, each frame containing associated encoded audio signal sample values, with the audio decoder (100) contains: a determining unit (101) configured to determine whether a frame of the encoded audio data bitstream is an immediate playback frame (1) that contains encoded audio sample values associated with the current frame and additional information, wherein the encoded audio data bitstream is an MPEG-4 Audio bitstream, with side information being conveyed by the MPEG-4 Audio bitstream spreading mechanism, which is an extension payload element of a new type of extension payload element EXT_AUDIO_PRE_ROLL, with the extension payload element located at the first position in the bitstream MPEG-4 Audio and the extension payload element is inside a fill element (ID_FIL), moreover, the additional information contains the encoded values of the samples of the audio signal of a certain number of frames preceding the frame (1) of immediate playback, and the encoded values of the samples of the audio signal of the previous frames can be encoded using the same codec configuration as the current frame, wherein the number of previous frames corresponding to the preloaded frames (2, 3) corresponds to the number of frames that the decoder needs to generate a complete signal in order to be able to output the actual audio sample values associated with the current frame each time a frame (1 ) immediate playback; And block (102) initialization, configured to initialize the decoder, if the determining block determines that the frame is a frame (1) immediate playback, wherein initializing the decoder includes decoding the encoded audio sample values contained in the side information before decoding the encoded audio sample values associated with the current frame, moreover, the initialization block (102) is configured to switch the audio decoder (100) from the current codec configuration to another codec configuration, if the determination block (101) determines that the frame is an immediate playback frame (1), and if the values of the samples of the audio signal of the current frames were encoded using a different codec configuration, and moreover, the decoder (100) is configured to decode the current frame using the current codec configuration and discard additional information, if the determination unit (101) determines that the frame is an immediate playback frame (1), and if the values of the audio signal samples of the current frame have been encoded using the current codec configuration. 2. The audio decoder (100) according to claim 1, characterized in that the additional information additionally contains information about the configuration of the codecs, which is used to encode the values of the samples of the audio signal associated with the current frame, and the determination unit (101) is additionally configured to determining if the additional information codec configuration differs from the current codec configuration, and/or wherein the immediate playback frame (1) contains additional information as an extension payload, and the determining unit (101) is configured to evaluate the extension payload of the immediate playback frame (1). 3. Audio decoder (100) according to any one of paragraphs. 1 or 2, characterized in that the extension payload element has a specific specific label indicating that the payload of the extension payload element is additional information, and/or wherein the additional information further comprises a unique identifier, and optionally the unique identifier is used to detect another codec configuration. 4. Audio decoder (100) according to any one of paragraphs. 1-3, characterized in that it additionally contains a smooth mixing unit configured to perform smooth mixing of output sample values obtained by resetting the decoder (100) in the previous codec configuration, and output sample values obtained by decoding the encoded audio sample values. signal associated with the current frame, and/or wherein the earliest frame of the number of frames contained in the side information is not temporally differential or entropy encoded with respect to any frame before the earliest frame, and wherein the immediate playback frame (1) is not temporally differential or entropy encoded with respect to any frame prior to the earliest frame of the number of frames preceding the immediate playback frame (1), or relative to any frame before the immediate playback frame (1). 5. A method for decoding an encoded audio data bitstream, wherein the encoded audio data bitstream represents a sequence of audio signal sample values and contains a plurality of frames, each frame containing associated encoded audio signal sample values, comprising: determining (S102) whether the frame of the encoded audio data bitstream is an instant playback frame that contains encoded audio sample values associated with the current frame and side information, wherein the encoded audio data bitstream is an MPEG-4 Audio bitstream, moreover, the additional information is transmitted by the MPEG-4 Audio bitstream extension mechanism, which is an extension payload element of a new type of extension payload element EXT_AUDIO_PRE_ROLL, and the extension payload element is located in the first position in the MPEG-4 Audio bitstream, and moreover, the payload element the extension load is inside the fill element (ID_FIL), moreover, the additional information contains the encoded values of the samples of the audio signal of a certain number of frames preceding the frame of immediate playback, moreover, the encoded values of the samples of the audio signal of the previous frames are encoded using the same codec configuration as the immediate playback frame, moreover, the number of previous frames corresponding to the preloaded frames corresponds to the number of frames that the decoder needs to generate a complete signal in order to be able to output the actual values of the audio samples associated with the current frame, each time an immediate playback frame is decoded; initializing (S103) a decoder if it is determined that the frame is an instant playback frame, the initialization comprising decoding coded audio sample values contained in side information before decoding coded audio sample values associated with the current frame; switching the audio decoder from the current codec configuration to another codec configuration if the frame is determined to be an instant playback frame and if the audio sample values of the instant playback frame were encoded using a different codec configuration; And decoding the instant playback frame using the current codec configuration; and discarding side information if the frame is determined to be an immediate playback frame and if the audio sample values of the immediate playback frame were encoded using the current codec configuration. 6. The method according to claim. 5, characterized in that the encoded audio data bitstream contains the first number of frames encoded using the first codec configuration, and the second number of frames following the first number of frames and encoded using the second codec configuration, and the first frame of the second number of frames is an immediate playback frame. 7. An audio encoder (200) for generating a bitstream of encoded audio data with frames (1) of immediate playback, wherein the encoded audio data bitstream represents a sequence of audio sample values and contains a plurality of frames, each frame containing associated encoded audio sample values, wherein the audio encoder (200) comprises: a base encoder (202) configured to encode uncompressed audio sample values associated with the plurality of frames using a predetermined codec configuration; a buffer (203) configured to store encoded audio sample values of a number of frames preceding the current frame from the plurality of frames encoded using the predetermined codec configuration; And embedder (204) configured to record an immediate playback frame (1) into the current frame from a plurality of frames, wherein the immediate playback frame (1) contains encoded audio sample values associated with the specified current frame and additional information corresponding to the encoded sample values the number of frames preceding the specified current frame, wherein the generated encoded audio data bitstream is an MPEG-4 Audio bitstream, and the embedder (204) is additionally configured to add additional information to the bitstream via the MPEG-4 Audio bitstream extension mechanism , which is an extension payload element of the new extension payload element type EXT_AUDIO_PRE_ROLL, placing the extension payload element in the first position in the MPEG-4 Audio bitstream, and inserting the extension payload element inside the fill element (ID_FIL). 8. The audio encoder (200) according to claim 7, characterized in that the embedder (204) is additionally configured to include information about the specified codec configuration in the side information, and/or while the embedder (204) is additionally configured to include additional information in the immediate playback frame (1). 9. Audio encoder (200) according to any one of paragraphs. 7 or 8, characterized in that the embedder (204) is further configured to assign a special specific label indicating that the payload of the extension payload element is additional information, and/or wherein the embedder (204) is additionally configured to include the unique identifier in the side information, and optionally the unique identifier communicates a predetermined codec configuration. 10. Audio encoder (200) according to any one of paragraphs. 7-9, characterized in that the audio encoder (200) is additionally configured not to subject the earliest frame of the number of frames contained in the side information to temporal differential coding or entropy coding with respect to any frame up to the earliest frame, and moreover, the audio encoder ( 200) is further configured not to time-differentially or entropy-code the immediate playback frame (1) with respect to any frame up to the earliest frame of the number of frames preceding the immediate playback frame (1) or with respect to any frame before the immediate playback frame (1). . 11. A system containing two or more audio encoders (200) according to any one of paragraphs. 7-10 to generate a plurality of encoded audio data bitstreams each having (1) immediate playback frames, each encoded audio data bitstream representing a sequence of audio sample values and containing a plurality of frames, and each frame containing associated encoded values sound signal samples. 12. The system according to claim 11, characterized in that the predetermined sampling rate is the same for each of the base encoders (202) of two or more audio encoders (200), and/or wherein the system further comprises a delay equalization block (201) for equalizing the delay of the plurality of bit streams. 13. A method for generating, by an audio encoder, an encoded audio data bitstream with instant playback frames, the encoded audio data bitstream representing a sequence of audio sample values and comprising a plurality of frames, each frame containing associated encoded audio sample values, the method comprising the following stages: encoding (S201) by the base encoder the uncompressed audio sample values associated with the plurality of frames using a predetermined codec configuration; storing (S202) by a buffer of encoded audio sample values a number of frames preceding the current frame from a plurality of frames encoded using the predetermined codec configuration; And recording (S203) by an instant playback frame embedder into a current frame of a plurality of frames, wherein the instant playback frame contains coded audio sample values associated with said current frame and side information corresponding to coded audio sample values of the number of frames preceding said current frame , wherein the generated encoded audio data bitstream is an MPEG-4 Audio bitstream, moreover, additional information is introduced into the bitstream by an embedder using the MPEG-4 Audio bitstream extension mechanism, which is an extension payload element of a new type of extension payload element EXT_AUDIO_PRE_ROLL, wherein the extension payload element is embedded by the embedder at the first position in the MPEG-4 Audio bitstream, and the extension payload element is inserted by the embedder inside the fill element (ID_FIL). 14. Device (300) for generating frames (1) for immediate playback in a bitstream of encoded audio data, wherein the encoded audio data bitstream represents a sequence of audio sample values and contains a plurality of frames, each frame containing associated encoded audio sample values, with this device (300) contains: a receiver (301) configured to receive an MPEG-4 Audio encoded audio bitstream, the encoded audio data bitstream representing a sequence of audio sample values and comprising a plurality of frames, each frame containing associated encoded audio sample values; a buffer configured to store encoded audio sample values of a number of frames preceding the current frame from the plurality of frames; And embedder (302) configured to record an immediate playback frame (1) into a current frame from a plurality of frames, wherein the immediate playback frame (1) contains encoded audio sample values associated with the specified current frame and additional information corresponding to the encoded sample values an audio signal of the number of frames preceding the specified current frame, wherein the embedder (302) is additionally configured to insert additional information into the bitstream by means of an MPEG-4 Audio bitstream extension mechanism, which is an extension payload element of a new type of extension payload element EXT_AUDIO_PRE_ROLL, placing an extension payload element at a first position in the MPEG-4 Audio bitstream, and inserting an extension payload element inside a fill element (ID_FIL). 15. A device (300) for deleting immediate playback frames (1) from an encoded audio data bitstream, wherein the encoded audio data bitstream represents a sequence of audio sample values and contains a plurality of frames, each frame containing associated encoded audio sample values, with this device (300) contains: a receiver (301) configured to receive an encoded audio data bitstream, the encoded audio data bitstream representing a sequence of audio sample values and comprising a plurality of frames, each frame containing associated encoded audio sample values; And embedder (302), configured to convert the immediate playback frame (1) into a normal frame by removing from the immediate playback frame (1) additional information corresponding to the encoded values of the audio signal samples of a certain number of frames preceding the current frame from a plurality of frames, in which was recorded frame (1) immediate playback.

Images