JPH10285046A - Information signal processor, information signal recorder and information signal reproducing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information signal processor in which an information signal is processed while keeping the feature of the information signal. SOLUTION: A psychological audibility analysis/signal compression means 1 applies psychological audible analysis to an audio signal included in a received information signal and compresses the frequency band to output an audibility analysis signal and a coded audio signal. A feature extract means 2 extracts an audio feature component used for processing of the information signal based on the audibility analysis signal. A psychological visual analysis/signal compression means 3 applies psychological visual analysis to a video signal included in the received information signal and compresses the frequency band to output a video analysis signal and a coded video signal. A characteristics extract means 4 extracts a video feature component used for processing of the information signal based on the video analysis signal. An information recording means 5 records the coded audio signal to a recording medium 6 by using the audio feature component for an identification signal and records the coded video signal to the recording medium 6 by using the video feature component for an identification signal.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to an information signal processing device,
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information signal recording device and an information signal reproducing device, and more particularly to an information signal processing device for processing an input information signal, an information signal recording device for recording an information signal, and an information signal reproducing device for reproducing an information signal recorded on a recording medium. About.

[0002]

2. Description of the Related Art MPEG (Moving Picture Experts Grou)
Due to the recommendations in p), the technology for compressing information signals with a large amount of data, such as video signals and audio signals, has recently been remarkably developed, and the convenience of information signal processors for consumer use has been improved. doing.

[0003] A compressed information signal can be recorded on a large-capacity recording medium such as an optical disk or a hard disk.
For example, if a video signal and an audio signal compressed by MPEG2 using psycho-visual analysis are to be stored in a DVD which is an optical disk having the same diameter as a CD (Compact Disk), the quality of one movie is equivalent to that of a current television broadcast. , The information signal of 133 minutes.

[0004]

However, there are various types of information signals handled at present. For example, if you want to change the compression and processing methods for music programs and news programs, or specially process only certain human voices,
There is a demand for performing processing utilizing characteristics of each information signal.

[0005] The present invention has been made in view of the above points, and provides an information signal processing apparatus capable of performing a process utilizing an advantage of an information signal including an audio signal and a video signal. The purpose is to:

It is another object of the present invention to provide an information signal processing device capable of recording an information signal including an audio signal and a video signal on a recording medium by utilizing its features.

Still another object of the present invention is to provide an information signal recording apparatus which records an information signal together with its characteristics so that special reproduction can be performed by a simple operation. Another object of the present invention is to provide an information signal reproducing apparatus capable of performing a special reproduction with a simple operation from a recording medium in which an information signal and its characteristics are recorded together.

[0008]

According to the present invention, in order to solve the above-mentioned problems, in an information signal processing device for processing an input information signal, a speech signal included in the information signal is subjected to psychological auditory analysis, and auditory analysis is performed. An information signal processing device is provided, comprising: a psychoacoustic analysis unit that outputs a signal; and a feature extraction unit that extracts a speech feature component used for processing the information signal from the auditory analysis signal.

[0009] When processing an input information signal in such an information signal processing device, the psychological auditory analysis means performs psychological auditory analysis of a voice signal included in the information signal and outputs an auditory analysis signal. The feature extracting means extracts a speech feature component used for processing the information signal from the auditory analysis signal. Therefore, when processing the information signal, processing using the extracted audio feature component can be performed.

According to the present invention, in order to solve the above-mentioned problems, in an information signal processing apparatus for processing an input information signal, a video signal included in the information signal is subjected to psycho-visual analysis and a visual analysis signal is output. An information signal processing device is provided, comprising: psycho-visual analysis means; and feature extraction means for extracting a video feature component used for processing the information signal from the visual analysis signal.

When processing an input information signal in such an information signal processing apparatus, the psycho-visual analysis means performs a psycho-visual analysis of a video signal included in the information signal and outputs a visual analysis signal. The feature extracting unit extracts a video feature component used for processing the information signal from the visual analysis signal. Therefore, when processing the information signal, processing using the extracted video feature component can be performed.

According to the present invention, in order to solve the above-mentioned problems, in an information signal processing apparatus for processing an input information signal, a speech signal included in the information signal is psychoacoustically analyzed and band-compressed, and an auditory analysis signal is obtained. A psychoacoustic analysis / signal compression unit for outputting an encoded audio signal, a feature extraction unit for extracting a speech feature component used for processing the information signal from the auditory analysis signal, and the speech feature component as an identification signal. An information signal processing device comprising: an information recording unit that records an encoded audio signal on a recording medium.

When processing an input information signal in such an information signal processing apparatus, the psychological auditory analysis / signal compression means analyzes the audio signal included in the information signal by psychological auditory analysis, compresses the band, and performs audio-visual analysis. An analysis signal and an encoded audio signal are output. The feature extracting means extracts a speech feature component used for processing the information signal from the auditory analysis signal. And
The information recording means records an encoded audio signal on a recording medium using the audio feature component as an identification signal. Therefore, when the information signal is recorded on the recording medium, the extracted audio feature component can be used.

According to another aspect of the present invention, there is provided an information signal processing apparatus for processing an input information signal, comprising: psycho-visually analyzing a video signal included in the information signal; A psycho-visual analysis / signal compression unit that outputs a signal and an encoded video signal, a feature extraction unit that extracts a video feature component used for processing the information signal from the visual analysis signal, and the video feature component as an identification signal. And an information recording means for recording the encoded video signal on a recording medium.

When processing an input information signal in such an information signal processing apparatus, the psycho-visual analysis / signal compression means psycho-visually analyzes the video signal included in the information signal, compresses the band, and performs visual compression. An analysis signal and an encoded video signal are output. The feature extracting unit extracts a video feature component used for processing the information signal from the visual analysis signal. And
The information recording means records an encoded video signal on a recording medium using the video feature component as an identification signal. Therefore, when recording the information signal on the recording medium, the extracted video feature component can be used.

Further, according to the present invention, in order to solve the above-mentioned problems, in an information signal recording apparatus for recording an information signal,
An information signal recording apparatus, wherein an audio feature component extracted from an auditory analysis signal obtained by psychoacoustic analysis of an audio signal included in the information signal is multiplexed as the identification signal in the information signal. Is provided.

When an information signal is recorded by such an information signal recording device, the information signal includes a speech feature component extracted from a hearing analysis signal obtained by psychoacoustic analysis of a speech signal included in the information signal. Multiplexed as an identification signal.
Therefore, at the time of reproduction, if the identification signal is separated and used, a special reproduction can be performed by a simple operation.

According to another aspect of the present invention, there is provided an information signal recording apparatus for recording an information signal, wherein the information signal includes a visual signal obtained by psycho-visually analyzing a video signal included in the information signal. An information signal recording device is provided, wherein a video feature component extracted from an analysis signal is multiplexed as an identification signal.

When an information signal is recorded by such an information signal recording device, the information signal includes a video feature component extracted from a visual analysis signal obtained by psycho-visually analyzing a video signal included in the information signal. Multiplexed as an identification signal.
Therefore, at the time of reproduction, this identification signal is known and if this is used, a special reproduction can be performed by a simple operation.

According to another aspect of the present invention, there is provided an information signal reproducing apparatus for reproducing an information signal recorded on a recording medium, comprising: a separating means for separating a multiplexed identification signal from the information signal. When the audio special reproduction mode is designated, a reproduction unit that reproduces the information signal in the audio special reproduction mode based on the audio identification signal extracted from the auditory analysis signal among the identification signals,
An information signal reproducing device characterized by having:

When an information signal recorded on a recording medium is reproduced by such an information signal reproducing apparatus, the separating means includes:
The multiplexed identification signal is separated from the information signal.
Further, when the audio special reproduction mode is designated, the reproducing means reproduces the information signal in the audio special reproduction mode based on the identification signal extracted from the auditory analysis signal among the identification signals. Therefore, special reproduction can be performed by a simple operation from a recording medium in which an information signal and its characteristics are recorded together.

According to another aspect of the present invention, there is provided an information signal reproducing apparatus for reproducing an information signal recorded on a recording medium, comprising: separating means for separating a multiplexed identification signal from the information signal; When the video special playback mode is designated, a playback unit that plays back the information signal in the video special playback mode based on the identification signal extracted from the visual analysis signal among the identification signals. An information signal reproducing device is provided.

When an information signal recorded on a recording medium is reproduced by such an information signal reproducing apparatus, the separating means includes:
The multiplexed identification signal is separated from the information signal.
When the video special reproduction mode is designated, the reproducing means reproduces the information signal in the video special reproduction mode based on the identification signal extracted from the visual analysis signal among the identification signals. Therefore, special reproduction can be performed by a simple operation from a recording medium in which an information signal and its characteristics are recorded together.

[0024]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a diagram showing a principle configuration of an information signal processing device of the present invention.

In the information signal processing apparatus of the present invention, the speech signal included in the input information signal is subjected to psychological auditory analysis by the psychological auditory analysis / signal compression means 1 and band-compressed. Output a signal. Here, the audio signal is compressed using, for example, a method of deleting an audio signal having a frequency lower than the audible limit. Feature extraction means 2
Extracts a speech feature component used for processing of an information signal from an auditory analysis signal.

The video signal included in the input information signal is psycho-visually analyzed and band-compressed by the psycho-visual analysis / signal compression means 3 to output a visual analysis signal and an encoded video signal. Here, for example, luminance information Y and color difference information Cb, Cr included in a horizontal line (scanning line) of the image
And the ratio of the three components from “4: 4: 4” to “4: 2:
The video signal is compressed by using a method such as 2). Humans are not as sensitive to color as luminance. The feature extracting unit 4 extracts a video feature component used for processing the information signal from the visual analysis signal. Then, the information recording means 5 records the encoded audio signal on the recording medium 6 using the audio feature component as the identification signal and the encoded video signal using the video feature component as the identification signal.

Therefore, in the information signal processing device of the present invention, when recording the information signal on the recording medium 6, it is possible to use the characteristic components of the audio signal and the video signal included in the information signal. FIG. 2 is a block diagram showing an embodiment in which the information signal processing device of the information signal processing system according to the present invention is applied to a case where an audio signal is recorded on an optical disc in the MPEG audio layer 1. Here, only the part related to the audio signal is described. The correspondence between FIG. 1 and FIG. 2 will be described later.

The information signal processing device 10 has an A / D (Analog /
Digital) conversion unit 11, analysis filter bank 12, F
FT (Fast Fourier Transform) section 13, scale factor calculation section 14, masking threshold calculation section 1
5, a bit allocation unit 16, a quantizer 17, a feature extraction unit 18, an ID generation unit 19, a bit stream formation unit 20, an ECC addition unit 21, a modulation unit 22, an optical pickup 23, It comprises a system controller 24 and a disk drive servo unit 25, and records information signals on the optical disk 30.

An audio signal (analog signal) input to the information signal processing device 10 is converted into a digital signal by an A / D converter 11, and is analyzed by an analysis filter bank 12 and an FFT.
Input to the unit 13. In the analysis filter bank 12, the input digital signal is divided into 32 sub-bands and output. At this time, aliasing (aliasing noise) is eliminated using a filter called a polyphase filter bank. The FFT unit 13 performs fast Fourier transform on the input signal and analyzes the frequency component. The analysis result is output to the masking threshold calculator 15.
And the feature extraction unit 18. The scale factor calculator 14 calculates the scale factor of the divided digital signal, and notifies the masking threshold calculator 15 and the bit stream forming unit 20 of the calculated scale factor.

The masking threshold calculator 15 stores data indicating the relationship between the frequency and the minimum audible limit in advance. Here, the frequency component input from the FFT unit 13 is collated with this data in consideration of the scale factor, and a masking threshold (threshold) is calculated. The bit allocation unit 16 sets bit allocation so that quantization noise generated by quantization is lower than the masking threshold for each subband, and outputs the result to the quantizer 17 and the bit stream forming unit 20. . The quantizer 17 quantizes the digital signal divided into 32 sub-bands according to the input bit allocation, and inputs the generated audio data to the bit stream forming unit 20.

The feature extraction unit 18 holds a speech discrimination signal in advance. In accordance with an instruction from the system controller 24, the feature extracting unit 18 extracts the feature of the input frequency component based on the voice discrimination signal, and inputs the feature to the ID generating unit 19. The feature extracting unit 18 will be described later in more detail. The ID generation unit 19 generates an identification signal ID (Identification) from the characteristics of the input signal, and inputs this to the bit stream formation unit 20.

As described above, the quantized audio data for 32 sub-bands, the scale factor and bit allocation for each sub-band, and the ID are input to the bit stream forming unit 20. Bit stream forming unit 2
In the case of 0, all of these data are multiplexed to form a bit stream, which is input to the ECC adding unit 21. Then, the ECC is added by the ECC adding unit 21 and the modulation unit 2
The bit stream modulated for recording on the optical disk at 2 is transmitted to the optical disk 30 via the optical pickup 23.
Will be recorded. Further, the system controller 24 inputs a feature extraction instruction to the feature extraction unit 18 and a drive signal to the disk drive servo unit 25 to drive the optical disk 30, and operates the information signal processing device 10. Take control.

The analysis filter bank 1 shown in FIG.
2, FFT unit 13, scale factor calculation unit 14, masking threshold calculation unit 15, bit allocation unit 16,
The quantizer 17 corresponds to the psychological auditory analysis / signal compression means 1 shown in FIG. 1. The feature extraction unit 18 shown in FIG. 2 corresponds to the feature extraction unit 2 shown in FIG.
Then, the ID generation unit 19 and the bit stream formation unit 2
0, an ECC adding unit 21, a modulating unit 22, an optical pickup 23, a system controller 24, and a disk drive servo unit 25 correspond to the information recording unit 5 shown in FIG. The optical disk 30 shown in FIG. 2 corresponds to the recording medium 6 shown in FIG.

Here, the feature extracting unit 18 will be described in more detail. FIG. 3 is a block diagram showing an internal configuration of the feature extracting unit 18 shown in FIG. In the figure, a feature extraction unit 18 includes a spectrum average value calculation unit 18a that calculates a spectrum average value from frequency components, a voice determination signal setting unit 18b that sets a stored voice determination signal as a comparison reference, and a spectrum average value. And a level comparison unit 18c that compares the comparison result with the comparison reference.

Assuming that the input audio signal is the sound of a broadcast program or the like, there are usually a silent section and a sound section. Voiced sections can be classified into human voice sections and music sections. As for the discrimination between human voice signals and music signals, as described in the technical report of the Institute of Television Engineers of Japan, "Video browsing interface using sound information (1995.2.3)",
This is possible by detecting the spectral envelope of the audio signal and determining its characteristics. However, when detecting a spectral envelope, cepstrum processing is required. Since this processing is complicated, in the present invention, a spectrum average value is calculated from the frequency components of the audio signal divided for each predetermined section, and this value is compared with a preset audio determination signal.
Whether the predetermined section is a silent section or a human voice section,
It is determined whether it is a music section.

That is, first, the spectrum average value calculation unit 1
In step 8a, the frequency component input from the FFT unit 13 is divided into predetermined sections, a spectrum average value M in the predetermined section is calculated by equation (1), and output to the level comparison unit 18c.

[0037]

M = (1 / N) Σ | i | (1) Here, the cumulative addition is performed in a predetermined section, N is the number of sample data in the section, and i is the spectrum level.

Various sound judgment signals are stored in the sound judgment signal setting section 18b in accordance with the genre (type) of the sound signal. Then, in response to an instruction from the system controller 24, a sound determination signal having a level corresponding to the genre of the input sound signal is output to the level comparing unit 18c as a comparison reference. The level comparison unit 18c compares the input spectrum average value with a comparison reference, and outputs the comparison result to the ID generation unit 19. The ID generation unit 19 generates an ID from the input comparison result.

FIG. 4 is a diagram showing a correspondence table used when an ID is generated from the comparison result in the ID generation unit 19 shown in FIG. When the audio signal is classified into three types as shown in the correspondence table 19a, the ID is generated as a 2-bit signal.

The correspondence table used for ID generation may be other than the correspondence table 19a. When recording not only audio signals but also video signals as information signals on an optical disk, a multiplexer is further provided after the bit stream forming unit 20 of the information signal processing device 10 shown in FIG. It may be multiplexed into a bit stream. In this case, the feature is also extracted from the video signal, and the ID is extracted.
It can be used for generation.

Further, in the above description, the ID is multiplexed by the bit stream forming unit 20. However, the bit stream forming unit 20 multiplexes only the audio data, the scale factor, and the bit allocation. A multiplexer may be provided at a stage subsequent to the stream forming unit 20, and multiplexing may be performed here.

Although the above description has been made assuming that the audio determination signal is selectively used in accordance with the genre of the audio signal, the system controller 24 designates that only a section having a specific feature is to be recorded. By doing so, it is also possible to reduce the amount of information stored in the storage medium. Only a sound section may be recorded.

FIG. 5 is a block diagram showing an embodiment in which the information signal reproducing apparatus according to the present invention is applied to a case where an audio signal is reproduced from an optical disc on the layer 1 of MPEG audio. Here, only the part related to the audio signal is described.

The information signal reproducing device 40 includes an optical pickup 41, a demodulation unit 42, an ECC processing unit 43, a bit stream separation unit 44, an inverse quantizer 45, an ID detection unit 46, a system controller 47, , A disk drive servo unit 48, a synthesis filter bank 49, and a D / A (D
and an information signal from the optical disc 30.

In the information signal reproducing device 40, the optical pickup 41 reproduces the bit stream recorded on the optical disk 30. The reproduced bit stream is sent to the demodulation unit 4
The ECC processing unit 43 removes the demodulated and added ECC in the ECC processing unit 43, and then the bit stream separation unit 44
Is output to The bit stream separation unit 44 separates audio data, bit allocation, scale factor, and ID from the input bit stream. Then, the audio data, the bit allocation, and the scale factor are converted into the inverse quantizer 45.
The ID is output to the ID detection unit 46.

The inverse quantizer 45 inversely quantizes the audio data based on the input bit allocation and scale factor, generates a digital signal for 32 subbands, and outputs the digital signal to the synthesis filter bank 49. . The synthesis filter bank 49 synthesizes the input digital signals of 32 subbands and outputs the synthesized digital signals to the D / A converter 50. Then, the D / A converter 50 converts the input digital signal into an analog signal to generate an audio signal, and outputs the audio signal.

The system controller 47 receives an instruction for special reproduction such as digest reproduction for the audio data being reproduced. Since the ID indicating the characteristic of the audio data being reproduced is input from the ID detection unit 46, the operation of the disk drive servo unit 48 is controlled based on the received special reproduction instruction and the characteristic of the audio data. Output a drive signal to perform special reproduction.

When reproducing not only an audio signal but also a video signal as an information signal from an optical disk, a demultiplexer may be further provided in a stage preceding the bit stream separation unit 44, and the video signal may be separated there. In this case, an ID indicating the characteristics of the video signal can be used for special reproduction.

Also, in the above description, the ID is separated by the bit stream separation unit 44. However, a demultiplexer is provided before the bit stream separation unit 44, and only the ID is separated first and the ID detection unit is separated. 46 may be output.

As described above, the information signal reproducing apparatus of the present invention is applied to the MPEG audio layer 1 using an optical disc as a recording medium, and a recording medium in which an audio feature component is multiplexed with a band-compressed audio signal and recorded is recorded. The reproduction facilitates the processing when the special reproduction is instructed.

FIGS. 2 to 5 show an example in which the information signal processing device and the information signal reproducing device of the present invention are applied to layer 1 of MPEG audio. However, layer 2 and layer 3 and also MPEG2 audio are described. The present invention is applicable. Also, the present invention is not limited to MPEG audio, but also ATRAC (Adaptive Transform Acoustic Coding).
1, ATRAC2, Dolby AC-3 and PASC
(Precision Adaptive Subband Coding) and the like can be applied to various high-efficiency encoding processes that employ psychoacoustic encoding techniques.

FIG. 6 is a block diagram showing an embodiment in which the information signal processing device of the present invention is applied to the encoding unit of ATRAC1. In the figure, an encoding unit 60 includes a frequency conversion unit 61, a bit allocation unit 62, a quantizer 63,
The system includes a system controller 64, an ID generation unit 65, and a bit stream forming unit 66, and encodes an input digital audio signal to form and output a bit stream.

Here, the bit allocating section 62 performs the same processing as the bit allocating section 16 shown in FIG.
Description is omitted. The quantizer 63 performs the same processing as the quantizer 17 shown in FIG. 2, and the bit stream forming unit 66 performs the same processing as the bit stream forming unit 20 shown in FIG.

FIG. 7 is a block diagram showing an internal configuration of frequency conversion section 61 shown in FIG. In the figure, the frequency conversion unit 61 includes analysis filters 61a and 61c, a delay circuit 61b, a block size determination unit 61d, and an MDCT (M
odified Discrete Cosine Transform) calculation units 61e, 6
1f, 61g and feature extraction units 61h, 61j, 61k
And is composed of

When the digital audio signal is input, the analysis filter 61a analyzes the digital audio signal and outputs a signal of 11 to 22 kHz to the delay circuit 61b and outputs a signal of 0 to 11 kHz to the analysis filter 61c. The delay circuit 61b holds the input signal for a predetermined period of time, and then
Output to The analysis filter 61c further analyzes the input signal and converts the signal of 5.5 to 11 kHz into an MDCT signal.
The signal of 0 to 5.5 kHz is output to the operation unit 61f to the MDCT operation unit 61g. Note that the block size determination unit 61d acquires all the signals output to the MDCT calculation units 61e, 61f, and 61g and determines the block size.

MDCT operation units 61e, 61f, 61g
Respectively perform a modified discrete cosine transform of an input signal to extract a frequency component, and a bit allocation unit 62 shown in FIG.
And output to the quantizer 63. And the feature extraction unit 61
Each of h, 61j, and 61k extracts a feature of each subband according to an instruction from the system controller 64, and outputs the extracted feature to the ID generation unit 65, similarly to the feature extraction unit 18 illustrated in FIG.

FIG. 8 shows the ID generator 65 shown in FIGS.
FIG. 5 is a diagram showing a correspondence table used when an ID is generated by the. Here, as shown in the correspondence table 65a, the ID
Is generated as a 4-bit signal. When a bit stream formed by multiplexing the IDs generated in this way is recorded on a recording medium, when reproducing an audio signal from the recording medium, only the ID <0001> is detected and the female having a high frequency component is detected. Special reproduction, such as reproduction of only the audio portion of, can be performed. The correspondence table used for ID generation may be other than the correspondence table 65a.

FIG. 9 is a block diagram showing an embodiment in which the information signal processing device of the present invention is applied to the encoding unit of ATRAC2. In the figure, an encoding unit 70 includes a frequency conversion unit 71, an audio component extraction unit 72, a spectrum encoding unit 73, an audio component encoding unit 74, a system controller 75, an ID generation unit 76, and a bit stream formation unit. And a unit 77, which encodes the input digital audio signal to form and output a bit stream.

Here, the frequency converter 71 analyzes the input digital audio signal, converts the frequency, and outputs the same, similarly to the frequency converter 61 shown in FIG. However, FIG.
In ATRAC1, the audio signal is decomposed into three sub-bands and frequency conversion is performed. In ATRAC2, the audio signal is decomposed into four sub-bands and frequency conversion is performed.

The audio component extracting section 72 extracts and outputs an audio component from the input frequency component. The spectrum coding unit 73 codes the spectrum of the input audio component. The audio component encoding unit 74 encodes the input audio component.

An instruction relating to feature extraction is input from the system controller 75 to the frequency converter 71. Here, when generating the ID, the ID generation unit 76 may include a feature extraction unit (not shown) for all four subbands. In addition, since the spectral components tend to be included more in the low band than in the high band, a feature extraction unit may be provided only for two subbands of the low band component.

FIG. 10 is a block diagram showing an embodiment in which the information signal processing device of the present invention is applied to the coding section of Dolby AC-3. In the figure, the encoding unit 80
The frequency domain conversion unit 81 and the quasi-instantaneous companding PCM (Pulse C
ode Modulation) Encoding unit 82 and mantissa quantization unit 83
, A bit allocation unit 84, a system controller 85
, A feature extraction unit 86, an ID generation unit 87, and a bit stream forming unit 88, which encode the input digital audio signal to form and output a bit stream.

Here, the frequency domain conversion section 81 converts the input digital audio signal into the frequency domain and outputs a conversion coefficient. The quasi-instantaneous companding PCM encoding unit 82 performs quasi-instantaneous companding PCM encoding on the input transform coefficients, and outputs the exponent to the bit allocation unit 83 and the mantissa to the mantissa quantization unit 84. ,Output. The bit allocation unit 83 determines bit allocation based on the input exponent, and notifies the mantissa quantization unit 84 and the bit stream forming unit 88 of this. The mantissa quantization unit 84 quantizes the input mantissa using the bit allocation notified from the bit allocation unit 83,
Output.

An instruction relating to feature extraction is input from the system controller 85 to the frequency domain conversion section 81.
The feature extraction unit 86 extracts features of the input audio signal based on the instruction, and outputs the extracted features. ID generation unit 87
Generates an ID from the characteristics of the input audio signal and outputs it, and the bit stream forming unit 88 multiplexes the bit allocation, the quantized data, and the ID to form and output a bit stream.

FIG. 11 is a block diagram showing an embodiment in which the information signal processing device of the present invention is applied to a PASC encoder. In the figure, the encoding unit 90 includes an analysis filter 91, a scale factor calculation unit 92, a standardization unit 93, a bit allocation unit 94, a quantization unit 95, a system controller 96, a feature extraction unit 97, an ID It is composed of a generating unit 98 and a bit stream forming unit 99, and encodes an input digital audio signal to form and output a bit stream.

Here, the analysis filter 91 analyzes the input digital audio signal into a plurality of sub-bands and outputs the result. The scale factor calculation unit 92 calculates a scale factor from the input analyzed speech signal and calculates the scale factor.
3 and the bit stream forming unit 99 are notified. The standardization unit 93 standardizes the input analyzed audio signal with the notified scale factor and outputs the result. The bit allocation unit 94 sets bit allocation from the input analyzed audio signal, and sets the quantization unit 95 and the bit stream forming unit 9.
Notify 9. The quantization unit 95 quantizes the standardized audio signal with the notified bit allocation, and outputs this.

An instruction regarding feature extraction is input from the system controller 96. The feature extracting unit 97 extracts the feature of the audio signal from the analysis filter 91 according to the instruction, and outputs the feature. The ID generator 98 generates and outputs an ID from the characteristics of the input audio signal. The bit stream forming unit 99 multiplexes the scale factor, the quantized audio signal, the bit allocation, and the ID,
Form a bitstream and output it.

As described above, the present invention can be applied to various high-efficiency encoding processes employing the psychoacoustic encoding technique, and facilitates special reproduction of the encoded information signal. When a video signal is included in the information signal, features can be extracted from the video signal and used for ID generation.

FIG. 12 is a block diagram showing an embodiment in which the information signal processing apparatus of the present invention is applied to an MPEG2 encoding section. In the figure, an encoding unit 100 includes a subtractor 101 and a DCT (Discrete Cosine Transform) unit 1
02, an encoding control unit 103, a quantization unit 104, an inverse quantization unit 105, an inverse DCT unit 106, a bidirectional motion compensation unit 107, a feature extraction unit 108, and an ID generation unit 109
And encodes the input digital video signal and outputs it.

The input digital video signal has the standard MP
Encoding is performed based on EG2, and the encoding control unit 103 instructs the feature extraction unit 108 to extract features. And
The feature extraction unit 108 extracts features of the video signal from the DCT unit 102 based on an instruction from the encoding control unit 103,
Output. Further, the ID generation unit 109 generates and outputs an ID from the characteristics of the input video signal.

Therefore, the processing for specially decoding the image signal coded here is facilitated. For example, when an image having many edge portions is to be reproduced in a digest form, a portion having a high DCT high level may be extracted and reproduced using the ID as a clue.

The present invention can be applied to image compression techniques other than MPEG, and can be applied to encoding processing using orthogonal wavelet transform, such as comparing each level component of wavelet transform with a predetermined value. In this way, the feature extraction of the video signal is possible.

As described above, according to the present invention, an ID is generated based on each characteristic component extracted from an audio signal or a video signal in the process of encoding an information signal, and the ID is multiplexed with the encoded information signal. Record. Therefore, when the information signal is specially reproduced, the ID signal separated from the information signal can be used as a key to easily process the information signal.

In the above description, the case where the audio signal is processed and the case where the video signal is processed are described separately. However, the characteristics of the audio signal and the characteristics of the video signal are set so that the special reproduction can be performed for both the audio and the video. May be extracted and multiplexed.

In the above description, the case where an information signal is recorded on an optical disk is described. However, the present invention can be applied to a case where an information signal is recorded on a recording medium such as a memory card or a hard disk.

[0076]

As described above, in the information processing apparatus of the present invention, the audio feature component and the visual analysis signal obtained in the process of encoding the audio signal and the video signal included in the information signal are used to obtain the audio feature component and the audio analysis component. The image feature component is extracted and used for processing the information signal. Thereby, processing according to the characteristics of the audio signal and the video signal can be performed.

Further, in the information signal processing device of the present invention, the audio feature component and the video feature component are extracted from the auditory analysis signal and the visual analysis signal obtained in the process of encoding the audio signal and the video signal included in the information signal. Then, when recording the compressed information signal, the information signal is multiplexed and used as an identification signal. This simplifies the process when special reproduction of the information signal is specified.

Further, in the information signal recording apparatus of the present invention, the information signal and the identification signal generated from the characteristics of the audio signal and the video signal included in the information signal are multiplexed and recorded. This simplifies the process when special reproduction of the information signal is specified.

Further, in the information signal reproducing apparatus of the present invention, the identification signal generated from the characteristics of the audio information and the video signal included in the recorded information signal is separated, and reproduction is performed based on the identification signal. The configuration was adopted. This simplifies the process when special reproduction of the information signal is specified.

[Brief description of the drawings]

FIG. 1 is a diagram showing a principle configuration of an information signal processing device of the present invention.

FIG. 2 shows an information signal processing apparatus according to the present invention,
FIG. 2 is a block diagram showing an embodiment when applied to a case where an audio signal is recorded in PEG audio layer 1.

FIG. 3 is a block diagram illustrating an internal configuration of a feature extracting unit illustrated in FIG. 2;

FIG. 4 is a diagram showing an ID from a comparison result in the ID generation unit shown in FIG. 2;
FIG. 7 is a diagram showing a correspondence table used when is generated.

FIG. 5 is a block diagram showing an embodiment in which the information signal reproducing apparatus according to the present invention is applied to a case where an audio signal is reproduced from an optical disc in MPEG audio layer 1;

FIG. 6 is a block diagram illustrating an embodiment in which the information signal processing device of the present invention is applied to an encoding unit of ATRAC1.

FIG. 7 is a block diagram illustrating an internal configuration of a frequency conversion unit illustrated in FIG. 6;

FIG. 8 is a diagram showing a correspondence table used when an ID is generated by the ID generation unit shown in FIGS.

FIG. 9 is a block diagram illustrating an embodiment in which the information signal processing device of the present invention is applied to the encoding unit of ATRAC2.

FIG. 10 is a block diagram illustrating an embodiment in which the information signal processing device of the present invention is applied to an encoding unit of Dolby AC-3.

FIG. 11 is a block diagram illustrating an embodiment in which the information signal processing device of the present invention is applied to a PASC encoding unit.

FIG. 12 is a block diagram illustrating an embodiment in which the information signal processing device of the present invention is applied to an MPEG2 encoding unit.

[Explanation of symbols]

1 ... Psychological hearing analysis / signal compression means, 2 ... Feature extraction means, 3 ... Psychovisual analysis / signal compression means, 4 ... Feature extraction means, 5 ... Information recording means.

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁶ Identification code FI H04N 5/91 H04N 5/91 C 7/24 7/13 Z

Claims (14)

[Claims] 1. An information signal processing device for processing an input information signal, comprising: a psychoacoustic analysis section for analyzing a speech signal included in the information signal and outputting a hearing analysis signal; An information signal processing apparatus comprising: a feature extraction unit configured to extract a speech feature component used for processing the information signal. 2. The information signal processing device according to claim 1, further comprising information recording means for recording the information signal on a recording medium using the audio feature component as an identification signal. 3. An information signal processing device for processing an input information signal, comprising: a psychoacoustic analysis of a speech signal included in the information signal, band-compression analysis, and output of a hearing analysis signal and an encoded speech signal. Analysis / signal compression means; feature extraction means for extracting a speech feature component used for processing the information signal from the auditory analysis signal; and recording the encoded speech signal on a recording medium using the speech feature component as an identification signal. An information signal processing device comprising: 4. The psychoacoustic analysis / signal compression unit includes: a dividing unit that divides the information signal into a plurality of subbands; and converts at least one of the divided information signals into an audio signal included in the information signal. 4. The information signal processing device according to claim 3, further comprising: a band compression unit that performs psychoacoustic analysis to perform band compression, and outputs an auditory analysis signal and an encoded voice signal. 5. An information signal processing device for processing an input information signal, comprising: a psycho-visual analysis unit that performs a psycho-visual analysis of a video signal included in the information signal, and outputs a visual analysis signal; An information signal processing apparatus, comprising: a feature extracting unit that extracts a video feature component used for processing the information signal. 6. The information signal processing apparatus according to claim 5, further comprising information recording means for recording the information signal on a recording medium using the video feature component as an identification signal. 7. An information signal processing apparatus for processing an input information signal, comprising: psycho-visually analyzing a video signal included in the information signal, compressing a band, and outputting a visual analysis signal and an encoded video signal. Analysis / signal compression means; feature extraction means for extracting a video feature component used for processing the information signal from the visual analysis signal; and recording the encoded video signal on a recording medium using the video feature component as an identification signal. An information signal processing device comprising: 8. The psycho-visual analysis / signal compression unit includes: a dividing unit that divides the information signal into a plurality of sub-bands; and converts at least one of the divided information signals into a video signal included in the information signal. 8. The information signal processing device according to claim 7, further comprising: a band compression section that performs psycho-visual analysis to perform band compression, and outputs a visual analysis signal and an encoded video signal. 9. An information signal recording apparatus for recording an information signal, wherein the information signal includes a speech feature component extracted from a hearing analysis signal obtained by psychoacoustic analysis of a speech signal included in the information signal. An information signal recording device multiplexed as an identification signal. 10. The information signal recording device according to claim 9, wherein the information signal recording device is an optical disk. 11. An information signal recording apparatus for recording an information signal, wherein the information signal includes a video feature component extracted from a visual analysis signal obtained by psycho-visually analyzing a video signal included in the information signal. An information signal recording device multiplexed as an identification signal. 12. The information signal recording device according to claim 11, wherein said information signal recording device is an optical disk. 13. An information signal reproducing apparatus for reproducing an information signal recorded on a recording medium, comprising: separating means for separating a multiplexed identification signal from the information signal; An information signal reproducing apparatus, comprising: reproducing means for reproducing the information signal in the audio special reproduction mode based on an identification signal extracted from a hearing analysis signal among the identification signals. 14. An information signal reproducing apparatus for reproducing an information signal recorded on a recording medium, comprising: separating means for separating a multiplexed identification signal from the information signal; An information signal reproducing apparatus, comprising: reproducing means for reproducing the information signal in the video special reproduction mode based on an identification signal extracted from a visual analysis signal among the identification signals.