JP2008197199A - Audio encoder and audio decoder - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an audio encoder and an audio decoder in which, when audio is reproduced by the audio decoder, a compressed audio data itself etc. is processed, and the audio data after decoding is processed and output. <P>SOLUTION: The audio encoder includes: an encoding means 101 for outputting an encoded data by encoding the input audio data, and outputting an encoding associated data about encoding; a sound volume level output means 102 for outputting a sound volume level of the audio data by performing predetermined measurement on the audio data in a period which is determined beforehand; and an auxiliary data output means 103 for creating and outputting an auxiliary data from the sound volume level and the encoding associated data which is output from the encoding means 101. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an audio encoding device that performs digital signal processing and performs encoding, and an audio decoding device that reproduces encoded data.

  Some conventional audio encoding devices and decoding devices output music by accessing portions that are not music information (see, for example, Patent Document 1).

FIG. 13 shows the format on the CD. FIG. 14 shows a flowchart of a conventional audio decoding apparatus.
The operation of the conventional audio decoding apparatus will be described below with reference to the flowchart of FIG. 14, using FIG. 13 as a supplement.

  In FIG. 14, the audio decoding apparatus reads the data in the lead-in area (1300 in FIG. 13) and reads the TOC information of the disc (step ST1). The control code of each track is extracted from the read TOC information (step ST2), and it is determined whether the CD is a CD-DA audio disk or a CD-ROM disk (step ST3). Here, if the CD is a CD-DA audio disc, the audio decoding device performs CD audio playback processing (step ST12) based on the TOC information, and performs music playback as a normal CD player. .

  On the other hand, if it is determined that the disc is a CD-ROM disc, the audio decoding device reads the contents of the CD-ROM path table (1301 in FIG. 13) and reads the file structure as a CD-ROM (step ST4). Here, the audio decoding device confirms the read file structure, determines whether or not the compressed audio file exists from the file extension or the like (step ST5), and performs processing when the compressed audio file does not exist. Exit. If there is a compressed audio file, the audio decoding apparatus subsequently checks whether or not an information file (1303 in FIG. 13) exists from the file extension and the like (step ST6). Here, if the information file does not exist, the audio decoding device refers to the path table (1301 in FIG. 13) and extracts the compressed audio file based on the contents of the CD-ROM file system (step ST10). ), A compressed audio reproduction program is started (step ST11), and the compressed audio is reproduced.

  On the other hand, if an information file exists in step ST6, the audio decoding device reads the content (step ST7) and creates a music reproduction list (step ST8). In addition, the audio decoding apparatus extracts each file name and reproduction start address from the reproduction list (step ST9).

Note that the audio encoding device performs encoding in the format shown in FIG. 13 so that it can be reproduced by the audio decoding device.
JP 2006-114148 A

  When audio data is reproduced by such a conventional audio decoding device, the audio decoding device uses the data other than the compressed audio data output from the audio encoding device, and the audio decoding device displays the music reproduction list as described above. The user can create and display it and perform a reproduction operation while associating the title name with the audio data or the like by seeing this.

  However, data other than the compressed audio data output by the conventional audio encoding device is information such as a reproduction start address and a title name linked to the compressed audio data, and is not information used for processing the audio data itself. The audio decoding device processes the compressed audio data itself and the like, and there is a problem that audio data different from the original audio data cannot be output, that is, audio having a volume different from that of the original audio data cannot be output. .

  The present invention has been made to solve the above-described problems. When audio is played back by an audio decoding device, the compressed audio data itself is processed, and audio data different from the original audio data is processed. It is an object of the present invention to provide an audio encoding device and an audio decoding device that can be output.

  In order to solve the above problem, an audio encoding device according to claim 1 of the present invention receives audio data and outputs encoded data obtained by encoding the audio data together with auxiliary data related to the audio data. In the audio encoding device, the input audio data is encoded to output the encoded data, and encoding means for outputting encoding-related data related to encoding of the audio data; From the volume level output means for obtaining and outputting the volume level for each determined period, the volume level output from the volume level output means, and the encoding related data output from the encoding means, the volume level Auxiliary data output means for creating auxiliary data including It is.

  As a result, auxiliary data including volume level information of audio data can be output together with encoded data of audio data, and audio data can be processed using volume level information.

  An audio encoding apparatus according to claim 2 of the present invention is the audio encoding apparatus according to claim 1, wherein the predetermined period is one piece of music. .

  As a result, the auxiliary data including the volume level information of the audio data can be output together with the encoded data of the audio data, and the audio data can be processed using the volume level information, particularly in the original audio data. When there is a difference in volume level between songs, it is possible to adjust the volume level to a certain level.

  An audio encoding apparatus according to claim 3 of the present invention is the audio encoding apparatus according to claim 1, wherein the volume level output means sets the volume level to the volume of audio data in the predetermined period. It is calculated | required based on the maximum value of and the average sound volume.

  As a result, auxiliary data including volume level information detected accurately can be output together with encoded data of audio data.

  An audio decoding apparatus according to claim 4 of the present invention is an audio decoding apparatus that decodes and outputs encoded data output from the audio encoding apparatus according to claim 1, wherein the audio encoding apparatus Decoding means for decoding the encoded data output from the audio data and outputting audio data; volume level extracting means for extracting the volume level from the auxiliary data output from the audio encoding device; and the encoding Volume adjustment means for adjusting and outputting the volume of the audio data output by the means based on the volume level extracted by the volume level extraction means.

  Thereby, the amplitude of the decoded audio data can be adjusted by using the volume level information included in the auxiliary data output from the audio encoding device.

  An audio encoding device according to claim 5 of the present invention is an audio encoding device that receives audio data and outputs encoded data obtained by encoding the audio data together with auxiliary data related to the audio data. Encoding means for encoding the audio data for each frame, which is a unit of encoding, and outputting the encoded data; and encoding means for outputting encoding-related data relating to encoding of the audio data; and the audio data For each of the frames, category classification means for outputting category information indicating to which category the frame is classified, and the category information output by the category classification means, From the encoding related data output by the encoding means, the category And an auxiliary data output means for creating an auxiliary data including management information, it is characterized in.

  Thereby, auxiliary data including category information of audio data can be output together with encoded data of audio data, and audio data can be processed using category information.

  An audio encoding apparatus according to claim 6 of the present invention is the audio encoding apparatus according to claim 5, wherein the auxiliary data includes a value indicating a category and a number of consecutive frames classified into the category. It is characterized by including the information of the pair.

  As a result, the amount of data embedded in the auxiliary data can be reduced.

  An audio decoding apparatus according to claim 7 of the present invention is an audio decoding apparatus for decoding and outputting encoded data output from the audio encoding apparatus according to claim 5, wherein the audio encoding apparatus Decoding means for decoding the encoded data output from the audio data and outputting audio data; category extracting means for extracting the category information from the auxiliary data output from the audio encoding device; and the plurality of categories Among the audio data decoded based on the category specifying means for specifying a category to be controlled for audio output, the category information extracted from the auxiliary data, and the specified category output from the category specifying means. For audio output of frames belonging to the specified category It performs force control, and a audio output means for outputting, it is characterized in.

  Thereby, the audio output of the sound belonging to the predetermined category can be controlled using the category information.

  An audio decoding device according to claim 8 of the present invention is the audio decoding device according to claim 7, wherein the category specifying means specifies a category in which the audio is not output among the plurality of categories. The audio output means controls the audio data output from the decoding means so that frames belonging to the category specified by the category specifying means are not output as audio.

  Thereby, it is possible to control not to output audio belonging to a predetermined category using the category information.

  An audio decoding apparatus according to claim 9 of the present invention is an audio decoding apparatus for decoding and outputting encoded data output from the audio encoding apparatus according to claim 5, wherein the audio encoding apparatus Category extraction means for extracting the category information from the auxiliary data output from, output prohibition category specification means for specifying a category that does not output audio among the plurality of categories, the category information extracted from the auxiliary data, Based on the output prohibition category output from the output prohibition category specifying means, encoded data excluding encoded data of frames belonging to the output prohibition category among the encoded data output from the audio encoding device. And a decoding means for decoding and outputting audio data. Is shall.

  Thereby, it is possible to control not to output audio belonging to a predetermined category using the category information.

  An audio decoding device according to claim 10 of the present invention is the audio decoding device according to claim 9, which is provided at a subsequent stage of the decoding means, and outputs audio data decoded by the decoding means. According to the output of the output prohibition category designating means, further comprising an audio output means for controlling the period during which the encoded data that is not decoded by the decoding means is output to be constant, It is characterized by this.

  Thus, it is possible to perform control so that audio belonging to a predetermined category is not output using the category information, and audio output can be performed at regular intervals regardless of the number of frames that are not decoded. it can.

  An audio encoding apparatus according to claim 11 of the present invention receives audio data from a plurality of audio sound sources, and outputs encoded data obtained by encoding the audio data together with auxiliary data related to the audio data. In the encoding device, for one or more audio sound sources of the plurality of audio sound sources, a band indicating in which audio band the audio data from the audio sound source is included in the plurality of audio bands at the time of encoding Data, and encoding related data related to encoding, together with encoded data obtained by encoding audio data from the plurality of audio sound sources, encoding means for outputting, the band data output by the encoding means, The encoding-related data and the supplement containing the band data. And an auxiliary data output means for creating data, it is characterized in.

  As a result, auxiliary data including information on the band data of the audio data can be output together with the encoded data of the audio data, and the audio data can be processed using the information on the band data.

  An audio encoding device according to claim 12 of the present invention is the audio encoding device according to claim 11, wherein the encoding means performs predetermined data in the encoded data for audio data of a predetermined audio source. The encoded data is output after being encoded so as to be within the audio band.

  Thereby, audio data of a predetermined audio source can be included in a narrower band.

  An audio decoding apparatus according to claim 13 of the present invention is an audio decoding apparatus for decoding and outputting encoded data output from the audio encoding apparatus according to claim 11, wherein the audio encoding apparatus Band data extraction means for extracting the band data from the auxiliary data outputted from the sound source, sound source designation means for designating an audio sound source to control audio output among the one or more audio sound sources, and the auxiliary data Based on the extracted band data and the designated sound source output from the sound source designating means, the encoded data of the band including the audio data of the designated sound source is decoded with the amplitude of the audio data being limited. And a decoding means for outputting.

  Thereby, it is possible to arbitrarily control the audio output of any one of the plurality of audio sound sources using the band data.

  According to the present invention, the audio encoding device outputs the auxiliary data including the encoded data and the volume level of the audio data, the category for each frame of the audio data, or the data indicating the band in which the audio sound source is included. Therefore, when audio is played back by the audio decoding device, the audio data itself can be processed using the volume level included in the auxiliary data, and the decoded audio data can be processed and output. A high-value audio encoding device and audio decoding device can be provided.

(Embodiment 1)
Hereinafter, an audio encoding device and an audio decoding device according to Embodiment 1 of the present invention will be described.
FIG. 1 is a block diagram showing a configuration of an audio encoding device according to the first embodiment. In FIG. 1, 101 is an encoding unit that encodes input audio data and outputs encoded data, 102 is a volume level output unit that calculates and outputs a volume level of input audio data, and 103 is Auxiliary data output means for creating and outputting auxiliary data relating to audio data. The audio encoding device 100 includes the encoding unit 101, the volume level output unit 102, and the auxiliary data output unit 103.

  FIG. 2 is a block diagram showing the configuration of the audio decoding apparatus according to the first embodiment. In FIG. 2, 201 is a volume level extraction means for extracting a volume level from input auxiliary data and outputting a volume magnification according to the extracted volume level, 202 is a decoder for decoding encoded data and outputting audio data Decoding means 203 for controlling the volume of the audio data output from the decoding means 202 is adjusted so as to output the audio. The audio decoding apparatus 200 includes the volume level extracting unit 201, the decoding unit 201, and the volume adjusting unit 203.

  FIG. 3 is a diagram showing the format of an MPEG1-Layer II audio frame. In FIG. 3, the audio frame includes a header (header) area, an Error_check area, an audio_data area, and an ancillary_data area. The header area includes “syncword”, “ID”, “layer”, “protection_bit”, “bitrate_index”, “sampling_frequency”, “padding_bit”, “private_bit”, “mode”, “mode”, “mode”, “mode”, “mode”, “mode”, “mode”, “mode”, , “Original / copy”, “emphasis” and various data areas related to encoding.

Next, operations of the audio encoding device and the audio decoding device according to Embodiment 1 will be described.
First, the operation of the audio encoding device 100 according to the first embodiment will be described.

  As shown in FIG. 1, the audio data is input to the encoding unit 101 and the volume level output unit 102. When the audio data is input, the encoding unit 101 encodes the audio data and outputs the encoded data. Also, the encoding unit 101 outputs the encoding related data regarding the encoding at this time to the auxiliary data output unit 103. When encoding is performed in accordance with the MPEG1-LayerII rules, as shown in FIG. 3, “bitrate_index” indicating the bit rate and “mode” indicating the channel code are included in the header area of the audio frame as the encoding-related data. , “Mode_extension” indicating the band boundary is output.

  On the other hand, when the audio level is input, the volume level output means 102 obtains the peak value and average volume of the music for one song, and weights “peak value: average volume” at a ratio of “8: 2”. To find the volume level. For example, when the peak value of the measured volume is “6” and the average volume is “4”, the volume level output unit 102 calculates “5.6” obtained by 6 × 0.8 + 4 × 0.2. Output as the volume level of the music. The method for determining the volume level is not particularly limited to this method, and the peak value itself or the average volume itself may be output as the volume level. Alternatively, the volume level may be obtained by performing a predetermined calculation different from weighting the peak value and the average volume with a predetermined ratio using the peak value and the average volume as variables. The volume level output unit 102 outputs the volume level thus obtained to the auxiliary data output unit 103.

  When the auxiliary data output means 103 receives the encoding-related data from the encoding means 101 and the volume level from the volume level output means 102, the auxiliary data output means 103 converts it into a format based on MPEG1-LayerII in FIG. 3 and outputs it as auxiliary data. .

  In the first embodiment, auxiliary data is created by including volume level information in the “private_bit” portion of the header area in the MPEG1-LayerII stream. The auxiliary data output unit 103 embeds the volume level information received from the volume level output unit 102 in 2-bit “private_bit” included in the header area of the audio frame. By using 2-bit “private_bit”, for example, four levels of volume levels “0”, “1”, “2”, “3” indicated by “00”, “01”, “10”, “11” are used. Can be included in the auxiliary data. In the first embodiment, the volume level information is embedded in an area open to the user. Therefore, when decoding is performed by a conventional decoding apparatus that does not treat the data in the area as significant, the decoding is performed. Does not affect the operation. In addition, since the area originally prepared in each standard is used, the amount of bits does not increase to include volume level information.

  Through the above operation, the audio encoding device 100 according to the first embodiment outputs auxiliary data including the volume level of the audio data together with the encoded data of the audio data.

Next, the operation of the audio decoding apparatus according to the first embodiment will be described.
As shown in FIG. 2, when the auxiliary data is input, the volume level extraction unit 201 extracts information embedded in the “private_bit”, that is, volume level information.

  When the volume level extracting unit 201 extracts the volume level from the auxiliary data, the volume level extracting unit 201 outputs the volume magnification to the volume adjusting unit 203 according to the rules shown in the table of FIG. In the first embodiment, as shown in FIG. 4, when the volume level is “0”, the volume magnification is 1.1 times, and when the volume level is “1”, the volume magnification is 1 time. When “2”, the volume magnification is 0.9 times, and when the volume level is “3”, the volume magnification is 0.8 times. Note that the relationship between the volume level and the magnification of the volume is not limited to this.

  Decoding means 202 performs decoding when the encoded data is input, and outputs the decoded audio to volume control means 203.

  The volume adjusting unit 203 multiplies the audio amplitude input from the decoding unit 202 by the volume magnification corresponding to the volume level extracted by the volume level extracting unit 201 and outputs the result.

  FIG. 5 is a diagram showing how the volume adjusting means 203 of the audio decoding device according to the first embodiment changes the audio amplitude. A state in which the amplitude of audio data obtained by decoding encoded frames before and after a music boundary is adjusted is shown.

  As shown in FIG. 5, the volume level extracted from the auxiliary data by the volume level extracting means 201 is “1” in the frame #n included in the first music, and the frame # n + 1 included in the second music. Is “2”. When the volume level is “1”, the magnification of the volume is 1 as shown in FIG. 4. Therefore, the volume adjusting means 203 outputs the audio amplitude of frame # 1 after decoding by 1 and outputs the volume level. When “2” is “2”, the volume magnification is 0.9 times as shown in FIG. 4. Therefore, the volume adjusting means 203 outputs the audio amplitude of the decoded frame # n + 1 by 0.9 times.

  As a result, the amplitude of the frame # n + 1 of the second song input and decoded by the decoding unit 202 is larger than the amplitude of the frame #n of the first song, but the frame # n + 1 output from the volume adjusting unit 203 Is the same as the amplitude of frame #n. At this time, the magnification may be gradually changed even in the same frame so that the volume can be changed smoothly. In this way, when the audio data is reproduced, the volume having a difference between songs can be adjusted to a certain level based on the volume level information included in the auxiliary data output from the audio encoding device 100. In addition, it is possible to reduce a sense of incongruity due to a change in audio amplitude.

  As described above, the audio encoding device according to the first embodiment encodes input audio data and outputs encoded data, and also outputs encoding-related data related to the encoding. And volume level output means 102 for outputting the volume level of the audio data, and auxiliary data output means 103 for creating auxiliary data including volume level information from the detected volume level and the encoding related data. Thus, the auxiliary data including the volume level information of the audio data can be output together with the encoded data of the audio data, and the audio data can be processed using the volume level information.

  Also, the audio decoding apparatus according to Embodiment 1 decodes the encoded data output from the audio encoding apparatus and outputs audio data, and the volume level output from the audio encoding apparatus. The volume level extracting unit 201 for extracting the volume level from the auxiliary data including the above information and the volume of the audio data output from the decoding unit 202 are adjusted based on the volume level extracted by the volume level extracting unit 201. By providing the output volume adjusting means 203, the audio data can be processed using the volume level information extracted from the auxiliary data, and the amplitude of the decoded audio data can be adjusted.

  In the first embodiment described above, the auxiliary data output unit has described the case where the volume level information is embedded in the 2-bit “private_bit” included in the header area of the audio frame. The audio frame may be embedded in another area such as an ancillary_data area. Moreover, you may utilize the area | region where the area | region is ensured or there exists an extra as a system. For example, in the DVD-Video standard as shown in FIG. 8, each area can be used as auxiliary data as follows. That is, in the DVD-Video standard, it is managed in units of VOBU. The VOBU always includes system information called an NV_PCK pack. The NV_PCK pack includes playback control information called a PCI_PCK pack, and the last 18 bytes are not defined in the Reserved area. Therefore, this Reserved area can be used as auxiliary data. Moreover, even if it is defined in each standard, it is possible to use this as auxiliary data for an area that is not used as a system. As the auxiliary data, auxiliary data other than the encoded audio data in the SD standard or the Blu-ray standard can be used.

  In the first embodiment, encoding and decoding of audio data are performed according to the MPEG1-Layer II rules. However, the encoding and decoding rules of audio data are not limited to this.

(Embodiment 2)
Hereinafter, an audio encoding device and an audio decoding device according to Embodiment 2 of the present invention will be described.

  FIG. 6 is a block diagram showing the configuration of the audio encoding apparatus according to the second embodiment. In FIG. 6, reference numeral 601 denotes an encoding unit that encodes input audio data and outputs encoded data, 602 denotes a category classification unit that classifies input audio data into a plurality of categories, and 603 denotes audio data. Auxiliary data output means for generating and outputting auxiliary data related to The audio encoding apparatus 600 includes the encoding unit 601, the category classification unit 602, and the auxiliary data output unit 603.

  FIG. 7 is a block diagram showing the configuration of the audio decoding apparatus according to the second embodiment. In FIG. 7, reference numeral 701 denotes category extraction means for extracting and outputting category information from input auxiliary data, and reference numeral 702 denotes decoding means for decoding encoded data and outputting audio data. Reference numeral 704 denotes category designation means for designating a category to be controlled for audio output among a plurality of categories. Reference numeral 703 denotes audio output means for controlling the audio output of the audio data output from the decoding means 702 based on the category information and the output of the category specifying means 704. The audio decoding apparatus 700 is configured by including the category extracting unit 701, the decoding unit 702, the audio output unit 703, and the category specifying unit 704.

  FIG. 8 is a diagram showing a data format of the DVD-Video standard. In the DVD-Video standard, it is managed in units of VOBU. The VOBU always includes system information called an NV_PCK pack. The NV_PCK pack includes playback control information called a PCI_PCK pack, and the last 18 bytes are a Reserved (RSV) area, and the usage is not defined.

Next, operations of the audio encoding device and the audio decoding device according to the second embodiment will be described.
First, the operation of the audio encoding device 600 according to the second embodiment will be described.

  As shown in FIG. 6, when audio is input, the encoding unit 601 encodes the audio data for each frame having a predetermined time length determined according to the sampling rate, and outputs encoded data. Also, the encoding unit 601 outputs the encoding related data regarding the encoding at this time to the auxiliary data output unit 603. Even in the case of the DVD-Video standard, if the audio is MPEG1-Layer II, the encoding-related data is basically the same as that of the first embodiment, so a detailed description of the encoding-related data is omitted.

  The category classification unit 602 divides the input audio data into frames that are units of encoding of the encoding unit 601, classifies each frame into one of a plurality of categories, and the frame is classified into any category. The category information indicating whether or not is output to the auxiliary data output means 603. As a method for the category classification means 602 to know the frame breaks of the audio data, a method is used in which the category classification means 602 counts audio data samples and detects the timing at which the count value matches the number of frame samples. it can. In addition, it is also possible to know a frame break by receiving a synchronization signal indicating a frame break from the encoding means 601.

  FIG. 9 is a diagram showing an example of the correspondence between audio data frames and categories in the second embodiment. In FIG. 9, the upper row shows frame numbers, the middle row shows category values, and the lower row shows audio data. In this example, audio data including English speech and Japanese speech is classified into categories “2” for Japanese speech, category “1” for speech of a specific English word, and specific English words for each frame. Those other than English speech are classified as category “0”. As shown in the figure, frame numbers 10, 11, 21, 22, 23 are classified into category “0”, frame numbers 12, 13, 24, 25 are classified into category “1”, and frame numbers 14-20, 26 to 31 are classified into the category “2”.

  When the auxiliary data output means 603 receives the encoding related data from the encoding means 601 and the category information from the category classification means 602, the auxiliary data output means 603 converts the data into the DVD-Video standard data format of FIG. 8 and outputs it as auxiliary data.

  In the second embodiment, the PCI_PCK pack portion in the DVD_Video NV_PCK pack corresponds to the auxiliary data. Here, the auxiliary data output means 603, when assembling the PCI_PCK information of FIG. 8, sets the frame number and the category value as a set and sequentially embeds them in the RSV area based on the input category information. For example, the frame number of the frame to be classified is represented by a 4-bit signal, the category to which this frame belongs is represented by a 2-bit signal, and for each frame, the 4-bit and 2-bit signals are paired and sequentially embedded in the RSV area. . At this time, if the category value is the same for a plurality of frames continuously, the category value is not saved for each frame, but the category value is saved once, and then the frames of the same category are saved. If the number of consecutive times is stored, the category information can be compressed. Such a configuration is particularly effective when there are many consecutive frames belonging to the same category.

  The auxiliary data output means 603 outputs it when the PCI_PCK pack is completed. In the case of the DVD-Video standard, video information may be required for the PCI_PCK pack. In such a case, it is necessary to create a PCI_PCK pack including category information embedded in the RSV area from the auxiliary data output means 603. Alternatively, a part of the information may be output and a PCI_PCK pack including predetermined video information may be assembled by another means of the encoding system. In the second embodiment, the category information is embedded in an area open to the user. Therefore, when decoding is performed by a conventional decoding apparatus that does not treat the data in the area as significant, the decoding operation is performed. Has no effect. Further, since the area originally prepared in each standard is used, the bit amount does not increase to include the category information.

  Through the above-described operation, the audio encoding device 600 outputs auxiliary data including audio data category information together with audio data encoded data.

Next, the operation of the audio decoding apparatus 700 according to the second embodiment will be described.
As shown in FIG. 7, when a PCI_PCK pack is input as auxiliary data, the category extraction unit 701 extracts category information from the RSV area, and outputs the extracted category to the audio output unit 703. When the RSV area includes a continuous number of frames of the same category as the category value, the RSV area interprets it and outputs the category value for each frame to the audio output means 703. Whether the category information is stored in units of frames or the number of consecutive frames of the same category may be determined in advance between the audio encoding device and the audio decoding device, or may be repeated in consecutive numbers. You may decide the format with the selection bit of whether or not.

  The decoding unit 702 performs decoding when the encoded data is input, and outputs the decoded audio to the audio output unit 703.

  The operation of the audio output means 703 will be described using the example of FIG. In the example shown in FIG. 9, when no category for controlling the audio output is specified, the audio output means 703 displays “I am hungry.” “I am hungry.” “I eat. an apple. "I eat an apple." and the decoding means 601 outputs the audio data as decoded.

  Further, when an instruction is given to output only the category “1” from the outside, the category specifying means 704 outputs the category “0” and the category “2” to be controlled for audio output as the category specifying signal. The audio output means 703 controls the audio data of the frames belonging to the category “0” and the category “2” not to be output in accordance with the output of the category specifying means 704, and as a result, ““ hungly ”“ apple ” ", Only a specific word is output as audio.

  Further, when it is instructed not to output only the category “2” from the outside, the category specifying means 704 outputs the category “2” for controlling the audio output as a category specifying signal.

  The audio output means 703 performs control so as not to output audio data of frames belonging to the category “2” in accordance with the output of the category specifying means 704. As a result, “I am hungry.” “I eat an apple” . ”” And other parts than Japanese speech are output as audio. In this way, during language learning, it is possible to use a single encoded data such as listening to a foreign language and Japanese individually, or extracting only important words and listening.

  As described above, the audio encoding apparatus 600 according to the second embodiment encodes input audio data for each frame and outputs encoded data, and outputs encoding-related data related to the encoding. An encoding unit 601; a category classification unit 602 that classifies audio data into one of a plurality of categories for each frame; and outputs category information indicating to which category the frame is classified; and category information and code By providing auxiliary data output means 103 for generating auxiliary data including category information from the data related to encoding, auxiliary data including category information of audio data can be output together with encoded data of audio data. Audio data can be processed using information.

  Also, in the audio decoding apparatus 700 according to the second embodiment, a decoding unit 702 that decodes encoded data output from the audio encoding apparatus and outputs audio data, and a category output from the audio encoding apparatus. Category extracting means 701 for extracting the category information from auxiliary data including information, category specifying means 704 for specifying a category to be controlled for audio output among a plurality of categories, and category information extracted by the category extracting means 701 Audio output means 703 that outputs and controls the audio output of the frames belonging to the designated category based on the designated category output by the category designation means 704, so that the audio data using the category information extracted from the auxiliary data Processed It is possible to control the audio output of the audio belonging to categories.

  In the second embodiment, the case where the number of categories is three has been described. However, the present invention is not limited to this.

  Further, in the second embodiment, the case where only the data of category “1” is output or the case where the data of category “2” is not output has been described. Is also possible.

  In the second embodiment, the auxiliary data output means has described that the category information is embedded in the Reserved area of the PCI_PCK pack in the NV_PCK pack of the DVD-Video VOBU. It may be embedded in another area such as 2-bit “private_bit” included in the area.

  In the second embodiment, encoding and decoding of audio data are performed according to the MPEG1-Layer II rules, and the system is a DVD-Video standard system. However, encoding and decoding of audio data is performed. Rules and system standards are not limited to this.

(Embodiment 3)
Hereinafter, an audio encoding device and an audio decoding device according to Embodiment 3 of the present invention will be described.
In the third embodiment, the configuration of the audio encoding device is the same as that of the audio encoding device according to the second embodiment, and the configuration of the audio decoding device is different from that of the audio decoding device according to the second embodiment. is there.

  FIG. 10 is a block diagram showing the configuration of the audio decoding apparatus according to the third embodiment. Reference numeral 1001 denotes category extraction means for extracting and outputting category information from input auxiliary data. Reference numeral 1004 denotes output inhibition category designation means for designating a category for which audio output is to be prohibited among a plurality of categories. Reference numeral 1002 denotes decoding means for decoding the encoded data based on the category information and the output of the output prohibition category specifying means 1004 and outputting audio data. Reference numeral 1003 denotes the audio output of the audio data output from the decoding means 1002. Audio output means to control. The audio decoding apparatus 1000 includes the category extracting unit 1001, the decoding unit 1002, the audio output unit 1003, and the output prohibited category specifying unit 1004.

Next, the operation of the audio decoding apparatus 1000 according to the third embodiment will be described using the example of FIG.
The category extraction unit 1001 operates in the same manner as the category extraction unit 701 of the second embodiment, and thus description thereof is omitted.

Decoding means 1002 operates as follows in response to an instruction from the outside.
First, when nothing is specified from the outside, the output prohibition category specifying unit 1004 does not output a category for prohibiting audio output, and the decoding unit 1002 is all the same as the encoding unit 601 of the second embodiment. Are decoded and the decoded audio is output to the audio output means 1003.

  When an instruction is given to output only the category “1” from the outside, the output prohibition category designating unit 1004 outputs the category “0” and the category “2” that are intended to prohibit the audio output as the category designation signal. The decoding unit 1002 obtains the number of frames per second from “sampling_frequency” in the header area of the audio frame shown in FIG. 3 according to the output of the output prohibition category specifying unit 1004, and calculates the transfer rate per second from “bitrate_index”. . Then, the number of bits per frame is obtained from both. When the number of bits per frame is obtained, the encoded data is skipped up to the obtained number of bits without decoding. For example, when it is instructed to output only category 1 from the outside, as shown in FIG. 9, category 0 frames 10 and 11, category 2 frames 14 to 20, category 0 frames 21 to 23, The frames 26 to 31 of category 2 are not decoded and the encoded data is skipped.

  As a method of skipping encoded data, in addition to the above-described method, a method of skipping data until the “syncword” pattern in the header area of the audio frame shown in FIG. 3 appears for the number of skipped frames may be used. Good. As a result, audio data obtained by decoding the encoded data of the frames 12, 13, 24, and 25 is output from the decoding unit 1002, and the audio output unit 1003 outputs the decoded audio data as audio.

  Here, if the number of frames to be skipped without decoding is different, it is conceivable that the interval of output of audio data to the audio output means 1003 becomes non-uniform. In the third embodiment, the audio output means 1003 has a period in which the encoded data that is not decoded by the decoding means 1002 is output according to the output prohibited category of the output prohibited category specifying means 1004. Control to be constant. Such control is performed, for example, by accumulating the output data of the decoding unit 1002 for a predetermined time in a buffer memory or the like, excluding a period corresponding to a portion not decoded by the decoding unit 1002. This can be done by outputting data sequentially.

  As described above, in the audio decoding apparatus 1000 according to the third embodiment, the category extraction unit 1001 that extracts the category information from the auxiliary data output from the audio encoding apparatus, and the category that does not output audio among a plurality of categories is designated. Output prohibition category designation means 1004, category information extracted by the category extraction means 1001, and output of the output prohibition category designation means 1004, among the encoded data output from the audio encoding device, output prohibition category designation Decoding the encoded data output from the audio encoding device by decoding the encoded data excluding the encoded data of the frame belonging to the category output from the means 1004 and outputting the audio data When outputting the category information There, it is possible to control the audio output of the audio belonging to a predetermined category.

  In the third embodiment, the case where the number of categories is three has been described. However, the present invention is not limited to this.

  In the third embodiment, the auxiliary data output unit has described that the category information is embedded in the Reserved area of the PCI_PCK pack in the NV_PCK pack of the DVD-Video VOBU. It may be embedded in another area such as 2-bit “private_bit” included in the area.

  In the third embodiment, encoding and decoding of audio data are performed according to the MPEG1-Layer II rules, but the encoding and decoding rules of audio data are not limited to this.

(Embodiment 4)
Hereinafter, an audio encoding device and an audio decoding device according to Embodiment 4 of the present invention will be described.

  FIG. 11 is a block diagram showing a configuration of an audio encoding device according to Embodiment 4 of the present invention. In FIG. 11, reference numeral 1101 denotes an encoding unit that encodes audio data from a plurality of audio sound sources and outputs encoded data, and 1102 denotes audio data based on band data output from the encoding unit 1101 and encoding-related data. Auxiliary data output means for creating and outputting auxiliary data related to data. The audio encoding device 1100 includes the encoding unit 1101 and the auxiliary data output unit 1102.

  FIG. 12 is a block diagram showing the configuration of the audio decoding apparatus according to Embodiment 4 of the present invention. In FIG. 12, reference numeral 1201 denotes band data extraction means for extracting band data from input auxiliary data, and 1202 denotes decoding means for decoding input encoded data. Reference numeral 1203 denotes sound source designating means for designating an audio sound source to be controlled for audio output among a plurality of audio sound sources. An audio decoding device 1200 is configured including the band data extracting unit 1201, the decoding unit 1202, and the sound source specifying unit 1203.

Next, operations of the audio encoding device and the audio decoding device according to the fourth embodiment will be described.
First, the operation of the audio encoding device 1100 according to the fourth embodiment will be described. In the fourth embodiment, it is assumed that audio data of a musical instrument sound source and audio data of a sound source are input to the encoding unit 1101. Note that the input of the audio source to the encoding unit 1101 is not limited to two inputs, and is not limited to a musical instrument and voice. For example, it can be assumed that the input to the encoding unit 1101 is three inputs, and three audio sources such as one piano, one violin, and one applause are input.

  In the case of MPEG1-LayerII, when encoding, the audio band can be divided into 32 bands from 0 to 31 as “sb (subband)”. In the fourth embodiment, it is assumed that “sb” from 2 to 8 is used for encoding the audio data of the sound source. The encoding means 1101 outputs the encoded data, and further, audio of “sb” 2 to 8 among a plurality of audio bands “sb” 0 to 31 when the audio data of the sound source is encoded. Band data indicating that the data is included in the band. 2 to 8 of “sb” are output to the auxiliary data output means 1102 as band data.

  In the audio encoding device according to the fourth embodiment, the bands of “sb” 2 and 8 are reduced and the amplitude of the encoded data of “sb” 3 and 4 is increased when encoding audio data of a sound source. It is also possible to perform processing such as. Thereby, the audio data of the sound source can be included in a narrower band. Here, both ends of the audio source band are reduced in order to reduce the band of the audio source specified by the encoding means, but this is not limited to this, and it is reduced only at one end side of the audio source band. You may make it do. Further, when the band of the audio sound source designated at the time of encoding is reduced in this way, correction can be performed in another band.

  The auxiliary data output unit 1102 stores the band data sequentially input to the RSV area when the PCI_PCK information of FIG. 8 is assembled. The auxiliary data output unit 1102 outputs auxiliary data when the PCI_PCK pack is completed. As in the second embodiment, the auxiliary data output unit 1102 outputs a part of information necessary for creating the PCI_PCK pack including information on the band data to be embedded in the RSV area, and is determined by another unit of the encoding system. The PCI_PCK pack may be assembled including the video information. In the fourth embodiment, since band data is embedded in an area open to the user, when decoding is performed by a conventional decoding apparatus that does not treat the data in the area as significant, the decoding operation is performed. Has no effect. Further, since the area originally prepared in each standard is used, the amount of bits does not increase to include band data.

  Through the above operation, audio encoding apparatus 1100 according to the fourth embodiment outputs auxiliary data including band data of audio data together with encoded data of audio data.

  Next, the operation of the audio decoding apparatus 1200 according to the fourth embodiment will be described. As shown in FIG. 12, the band data extracting unit 1201 extracts band data from the auxiliary data and outputs the band data to the decoding unit 1202. When no audio sound source to be controlled for audio output is designated, the decoding unit 1202 decodes the encoded data of all the audio bands “sb” as they are, and outputs the decoded audio.

  If an audio sound source to be controlled externally is designated, the sound source designating unit 1203 outputs a sound source designation signal for designating the audio sound source to be controlled for audio output. The decoding unit 1202 encodes the audio band “sb” in which the audio sound source specified by the sound source specifying signal indicated by the band data received from the band data extracting unit 1201 is included according to the output of the sound source specifying unit 1203. Is decoded with its amplitude limited to half, otherwise it is decoded normally. Here, the decoding unit 1202 halves the amplitude of the band including the designated sound source indicated by the band data, but is not limited to this, and may be zero or other values. By controlling the output of audio data of the sound source in this way, audio data with sound can be output as karaoke.

  As described above, in the audio encoding device 1100 according to the fourth embodiment, for one or more audio sound sources of the plurality of audio sound sources, the audio data of the audio sound source is encoded among a plurality of audio bands. Encoding means 1101 for outputting band data indicating which audio band is included, and encoding-related data related to encoding, together with encoded data obtained by encoding audio data from a plurality of audio sound sources, and encoding means Auxiliary data output means 1102 for generating and outputting auxiliary data from the band data output from 1101 and encoding-related data is provided, thereby encoding auxiliary data including information on band data of audio data into audio data. Can be output together with data, bandwidth data information It allows the processing of audio data used.

  Also, in the audio decoding apparatus 1200 according to the fourth embodiment, band data extraction means 1201 for extracting band data from auxiliary data output from the audio encoding apparatus, and an audio source for controlling the audio output are designated. Based on the band data extracted by the sound source designating unit 1203, the band data extracting unit 1201, and the output of the sound source designating unit 1203, the encoded data of the band including the audio data of the audio sound source designated by the sound source designating unit 1203 Is decoded and output by limiting the amplitude of the audio data, and the audio data is processed using the band data information extracted from the auxiliary data, and the audio of the decoded audio data The output can be controlled.

  In the fourth embodiment, the auxiliary data output unit has described that the category information is embedded in the Reserved area of the PCI_PCK pack in the NV_PCK pack of the DVD-Video VOBU. It may be embedded in another area such as 2-bit “private_bit” included in the area.

  In the fourth embodiment, encoding and decoding of audio data are performed according to the MPEG1-Layer II rule, but the encoding and decoding rules of audio data are not limited to this.

  Also, any two or three of the audio encoding device according to the first embodiment, the audio encoding device according to the second or third embodiment, and the audio encoding device according to the fourth embodiment are combined. The audio decoding device according to the first embodiment, the audio decoding device according to the second embodiment, and the audio decoding device according to the fourth embodiment are also possible. It is also possible to adopt a configuration combining the above.

  According to the present invention, an audio encoding apparatus outputs auxiliary data including data indicating a volume level of audio data, a category for each frame of audio data, or a band in which an audio sound source is included, together with encoded data. In the encoding apparatus, the audio data itself is processed using the information included in the auxiliary data, and the decoded audio data can be processed and output. This is useful in providing a decoding device.

1 is a block diagram showing a configuration of an audio encoding device according to a first exemplary embodiment of the present invention. It is a block diagram which shows the structure of the audio decoding apparatus concerning Embodiment 1 of this invention. It is a figure which shows the format of MPEG1-LayerII standard. It is a figure which shows the volume level of the volume level extraction means of the audio decoding apparatus concerning Embodiment 1 of this invention. It is a figure which shows that the volume control means of the audio decoding apparatus concerning Embodiment 1 of this invention changes the amplitude of an audio. It is a block diagram which shows the structure of the audio coding apparatus concerning Embodiment 2 of this invention. It is a block diagram which shows the structure of the audio decoding apparatus concerning Embodiment 2 of this invention. It is a figure which shows the format of DVD-Video specification. It is a figure which shows the category of the category classification | category means of the audio coding apparatus concerning Embodiment 2 of this invention. It is a block diagram which shows the structure of the audio decoding apparatus concerning Embodiment 3 of this invention. It is a block diagram which shows the structure of the audio coding apparatus concerning Embodiment 4 of this invention. It is a block diagram which shows the structure of the audio decoding apparatus concerning Embodiment 4 of this invention. It is a figure which shows the format on CD. It is a figure which shows the flowchart of the conventional audio decoding apparatus.

Explanation of symbols

101 Coding means 102 Volume level output means 103 Auxiliary data output means 201 Volume level extraction means 202 Decoding means 203 Volume adjustment means 601 Encoding means 602 Category classification means 603 Auxiliary data output means 701 Category extraction means 702 Decoding means 703 Audio Output means 1001 Category extraction means 1002 Decoding means 1003 Audio output means 1101 Encoding means 1102 Auxiliary data output means 1201 Band data extraction means 1202 Decoding means

Claims (13)

In an audio encoding device that receives audio data and outputs encoded data obtained by encoding the audio data together with auxiliary data related to the audio data,
Encoding means for encoding input audio data and outputting the encoded data, and outputting encoding related data relating to encoding of the audio data;
Volume level output means for obtaining and outputting a volume level for each predetermined period of the audio data;
Auxiliary data output means for creating auxiliary data including the volume level from the volume level output by the volume level output means and the encoding related data output by the encoding means,
An audio encoding device. The audio encoding device according to claim 1, wherein
The predetermined period is one song.
An audio encoding device. The audio encoding device according to claim 1, wherein
The volume level output means obtains the volume level based on a maximum value of the volume of audio data in the predetermined period and an average volume.
An audio encoding device. An audio decoding device for decoding and outputting encoded data output from the audio encoding device according to claim 1,
Decoding means for decoding the encoded data output from the audio encoding device and outputting audio data;
Volume level extraction means for extracting the volume level from the auxiliary data output from the audio encoding device;
Volume adjustment means for adjusting and outputting the volume of the audio data output by the encoding means based on the volume level extracted by the volume level extraction means,
An audio decoding device characterized by that. In an audio encoding device that receives audio data and outputs encoded data obtained by encoding the audio data together with auxiliary data related to the audio data,
Encoding means for encoding input audio data for each frame as a unit of encoding and outputting the encoded data, and outputting encoding related data relating to encoding of the audio data;
Category classification means for classifying the audio data into any one of a plurality of categories for each frame and outputting category information indicating in which category the frame is classified;
Auxiliary data output means for creating auxiliary data including the category information from the category information output by the category classification means and the encoding-related data output by the encoding means,
An audio encoding device. The audio encoding device according to claim 5, wherein
The auxiliary data is
It includes information on a pair of a value indicating a category and the number of consecutive frames classified into the category.
An audio encoding device. An audio decoding device for decoding and outputting encoded data output from the audio encoding device according to claim 5,
Decoding means for decoding the encoded data output from the audio encoding device and outputting audio data;
Category extraction means for extracting the category information from the auxiliary data output from the audio encoding device;
Category designating means for designating a category for controlling audio output among the plurality of categories;
Based on the category information extracted from the auxiliary data and the specified category output from the category specifying means, the decoded audio data is output-controlled for audio output of frames belonging to the specified category. Audio output means for performing and outputting,
An audio decoding device characterized by that. The audio decoding device according to claim 7, wherein
The category designating unit designates a category that does not output audio among the plurality of categories,
The audio output means controls the audio data output by the decoding means not to output audio belonging to a category specified by the category specifying means;
An audio decoding device characterized by that. An audio decoding device for decoding and outputting encoded data output from the audio encoding device according to claim 5,
Category extraction means for extracting the category information from the auxiliary data output from the audio encoding device;
Output prohibition category designation means for designating a category that does not output audio among the plurality of categories;
Based on the category information extracted from the auxiliary data and an output prohibition category output from the output prohibition category designating unit, frames belonging to the output prohibition category among the encoded data output from the audio encoding device Decoding means for decoding the encoded data excluding the encoded data and outputting audio data,
An audio decoding device characterized by that. The audio decoding device according to claim 9, wherein
The output of audio data decoded by the decoding means is provided as the encoded data that is not decoded by the decoding means according to the output of the output prohibition category specifying means. Audio output means for controlling the period during which the data is output to be constant,
An audio decoding device characterized by that. In an audio encoding device that receives audio data from a plurality of audio sources and outputs encoded data obtained by encoding the audio data together with auxiliary data related to the audio data,
Band data indicating in which audio band of the plurality of audio bands the audio data from the audio sound source is included in one or more audio sound sources of the plurality of audio sound sources, and encoding Encoding means for outputting the encoding-related data with the encoded data obtained by encoding the audio data from the plurality of audio sound sources;
Auxiliary data output means for creating auxiliary data including the band data from the band data output by the encoding means and the encoding-related data,
An audio encoding device. The audio encoding device according to claim 11, wherein
The encoding means encodes audio data of a predetermined audio sound source after being limited so as to be within a predetermined audio band in the encoded data, and outputs the encoded data.
An audio encoding device. An audio decoding device for decoding and outputting encoded data output from the audio encoding device according to claim 11,
Band data extraction means for extracting the band data from the auxiliary data output from the audio encoding device;
Sound source designating means for designating an audio sound source to be controlled for audio output among the one or more audio sound sources;
Based on the band data extracted from the auxiliary data and the designated sound source output from the sound source designating means, the encoded data of the band including the audio data of the designated sound source is limited in amplitude of the audio data. Decoding means for decoding and outputting,
An audio decoding device characterized by that.

Images