JP2000078574A - Video and audio reproducing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display and output text data in voice by decoding plural data differing in encoding system and outputting them on the same screen or from the same speaker. SOLUTION: A video decoder selection part 2 decides the encoding system of an input bit stream and various bit streams are decoded as video data so as to select proper decoders 4 to 7 and decodes video and plural video data are mixed and displayed on the screen of a display device 9. AN audio decoder selection part 3 decides the encoding system of the bit stream and various bit streams are decoded as audio data so as to select proper decoders 10 to 12 and decode a sound; and those plural audio data are mixed and outputted from the speaker of an audio reproducing device 14. Input text data are processed into a character image by a text image generation part 16 or into a voice by an audio generation part 17 and then displayed on the screen or outputted by the speaker.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video / audio reproducing apparatus for reproducing a video and audio by decoding a bit stream coded by a coding method represented by MPEG (high efficiency coding).

[0002]

2. Description of the Related Art A conventional video / audio reproducing apparatus has a configuration as shown in FIG. In FIG. 5, for example, when a bit stream input unit 41 inputs and holds a bit stream obtained by receiving a digital broadcast, for example,
The G1 decoder 42 decodes and decodes the stored bit stream, and sends it to the display device 43. The display device 43 displays the decrypted data on a screen.

However, a video / audio reproducing apparatus integrated with a conventional decoder as described above is an MPEG / Audio reproducing apparatus which can encode only a bit stream encoded by the MPEG1 system.
Since only one data coder 42 is provided, only data (bit stream) encoded by one type of system (here, the MPEG1 system) can be decoded, and data encoded by a plurality of different systems can be temporarily decoded. Even if it could be decoded, the display device 43 could not show it on the same screen.

[0004] The reason is that coded data basically needs information such as the size of a screen. However, if data coded by a plurality of types of methods is to be displayed on the same screen, This is because there is no data for designating where on the screen each piece of data is to be displayed or its display ratio. Also, even when decoding a plurality of different data coded by one type and trying to display them on the same screen, display is impossible with the conventional video / audio reproducing apparatus for the same reason as described above. Met.

Further, even when the input data is text data, it is impossible to display the text on the display device 43 described above.

[0006]

As described above, in the conventional video / audio reproducing apparatus, different images are mixed by applying an appropriate coefficient to each other, or images are displayed by assigning priorities to different images. I couldn't. For this reason, data encoded by different methods cannot be displayed on the same screen, and different data encoded by the same method cannot be displayed on the same screen.

[0007] In addition, it is possible to solve the above-mentioned problem that a plurality of video data encoded by different methods or a plurality of different video data encoded by the same method cannot be displayed on the same screen. However, there is a problem that even if the text data can be displayed on the same screen, the text data cannot be displayed on the screen. Further, the above-mentioned problem similarly exists for audio data, and there is a problem that a plurality of audio data encoded in different systems or a plurality of different audio data encoded in the same system cannot be output from the same speaker. there were. In addition, there is a problem that the above-mentioned text data cannot be converted into voice and combined with other audio signals, or cannot be selectively reproduced.

SUMMARY OF THE INVENTION The present invention has been made to solve the above-described conventional problems, and an object of the present invention is to store a plurality of different data encoded by the same method or a plurality of data encoded by different methods. The same screen or can be decoded and reproduced and output from the same speaker, and furthermore, text data can be displayed on the screen, and the text data is converted to speech and combined with other audio signals, Another object of the present invention is to provide a video / audio reproducing apparatus capable of selectively reproducing the same.

[0009]

Means for Solving the Problems In order to achieve the above object, a first aspect of the present invention is characterized by a judging means for judging an encoding system of an input video bit stream, and a code judging by the judging means. Decoding means for decoding the video bit stream to obtain video data in accordance with the encoding scheme, mixing means for mixing a plurality of video data obtained by the decoding means, and video data mixed by the mixing means. Display means for displaying on a screen.

According to the first aspect of the present invention, it is determined which system the input bit stream is coded by, and a dedicated decoder for video decoding the coded data of the determined coding system is used. Thus, the bit stream is decoded to obtain video data. This allows
Video data encoded by various different encoding methods is decoded. In this way, the plurality of decoded video data are mixed so that they can be displayed on the same screen, and thus various different encoded data are displayed on the same screen as images.

A second aspect of the present invention is characterized in that the decoding means determines a plurality of decoders for respectively decoding video bit streams coded by various coding schemes and a coding scheme of a video bit stream to be decoded. Selecting means for decoding the bit stream by a corresponding decoder among the plurality of decoders.

According to the second aspect, the encoding method of the video bit stream to be decoded is determined,
Decoded by the corresponding dedicated decoder.

According to a third aspect of the present invention, the mixing means includes mixing coefficient information for specifying a mixing ratio when the level of each video data is the same, and mixing position information for specifying a position on a screen when each video data is displayed. Alternatively, the plurality of video data is mixed based on part or all of the display layer priority information that specifies a layer on which each video data is displayed.

A fourth feature of the present invention is that a data creating means for creating character image data from input text data is provided, and the created character image data is displayed by the display means via the mixing means. It is in.

According to the fourth aspect, character image data is created from input text data, and this is mixed with other video data or displayed alone on the screen.

According to a fifth aspect of the present invention, there is provided a judging means for judging an encoding system of an inputted audio bit stream, and decoding the audio bit stream in accordance with the encoding system judged by the judging unit. Decoding means for obtaining audio data; mixing means for mixing a plurality of audio data obtained by the decoding means; and audio output means for outputting the audio data mixed by the mixing means from the same speaker. It is in.

According to the fifth aspect, it is determined in which system the input bit stream is coded, and a dedicated decoder for voice decoding the coded data of the determined coding system is used. Thus, the bit stream is decoded to obtain audio data. This allows
Audio data encoded in various different encoding schemes is decoded. In this way, the plurality of decoded audio data are mixed so that they can be output from the same speaker, so that various different encoded audio data are output from the same speaker.

According to a sixth aspect of the present invention, the decoding means discriminates a plurality of decoders for respectively decoding audio bit streams encoded by various encoding schemes and an encoding scheme of an audio bit stream to be decoded, and Selecting means for decoding the bit stream by a corresponding decoder among the plurality of decoders.

According to the sixth aspect, the encoding method of the audio bit stream to be decoded is determined,
Decoded by the corresponding dedicated decoder.

According to a seventh aspect of the present invention, the mixing means includes mixing coefficient information for specifying a mixing ratio when each audio data is reproduced on the same channel, selection information for specifying which audio data is to be selected, or each audio data. The plurality of video data are mixed based on part or all of the pitch information that specifies the data pitch.

According to an eighth aspect of the present invention, there is provided a data conversion means for converting input text data into voice data,
The audio data obtained by the conversion is output from the speaker by the audio output means via the mixing means.

According to the eighth aspect, the input text data is converted into audio data, which is mixed with other audio data or reproduced alone and output from the speaker.

According to a ninth aspect of the present invention, a first judging means for judging an encoding system of an input video bit stream, and the video corresponding to the encoding system judged by the first judging unit. First decoding means for decoding a bit stream to obtain video data, first mixing means for mixing a plurality of video data obtained by the first decoding means, and mixing by the first mixing means. A first display unit for displaying the video data on the screen, a second determination unit for determining an encoding system of an input audio bit stream, and a method corresponding to the encoding system determined by the second determination unit. Second decoding means for decoding the audio bit stream to obtain audio data, and a plurality of audio data obtained by the second decoding means. A second mixing means for mixing, in that a second sound output means for outputting the mixed voice and sound data from the same speaker by the second mixing means.

A tenth aspect of the present invention is characterized in that a data creating means for creating character image data from input text data is provided, and the created character image data is converted to the first character data via the first mixing means. In the display means.

An eleventh aspect of the present invention is characterized in that data conversion means for converting input text data into audio data is provided, and the audio data obtained by the conversion is converted to the second data via the second mixing means. And outputting from the speaker by the audio output means.

[0026]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a block diagram showing an embodiment of the video / audio reproducing apparatus according to the present invention. The video / audio reproducing apparatus includes a bit stream input unit 1 including a buffer for inputting and temporarily storing a bit stream, and a video decoder selecting unit for determining a coding method of the input bit stream and selecting a video decoder. 2. an audio decoder selecting unit 3 for determining an encoding system of a bit stream and selecting an audio decoder;
MPEG1 decoder 4, M that decodes and decodes a bit stream encoded in one system as video data
An MPEG2 decoder 5 that decodes and decodes a bit stream encoded by the PEG2 system as video data, an MPEG4 decoder 6 that decodes and decodes a bitstream encoded by the MPEG4 system as video data, and other predetermined Decoder (eg, a JPEG decoder) 7 that decodes and decodes a bit stream encoded according to the video method as video data, a text input unit 15 that inputs text data, and a text image that creates corresponding character image data from the text data Creating unit 16, a plurality of decoders 4 to 7, and an image mixing device 8 for mixing the decoded video data and the character image data output from the text image creating unit 16, a video (or a character image) mixed by the image mixing device 8 Draw data Display device 9 to display in, MPEG1
MPEG1 audio decoder 10 that decodes and decodes a bit stream encoded by the MPEG2 system as audio data, and MPEG that decodes and decodes a bitstream encoded by the MPEG2 system as audio data.
(2) an audio decoder 11, another XXX audio decoder 12 for decoding and decoding a bit stream encoded by a certain predetermined method as audio data, a text-to-speech device unit 17 for converting text data to audio data, a plurality of decoders It has an audio mixing switch device 13 for mixing audio data output from the 10 to 12 and the text-to-speech device unit 17, and an audio reproducing device 14 for outputting audio data mixed by the audio mixing switch device 13.

FIG. 2 is a block diagram showing a detailed example of the video decoder selecting section 2 shown in FIG. The video decoder selection unit 2 determines that the input bit stream is MPEG1
MPEG1 stream determination unit 21 that determines whether or not the input bit stream is encoded in the
MPEG for judging whether or not encoded by EG2 method
A two-stream determining unit 22 that determines whether or not the input bit stream has been encoded by the MPEG4 system;
PEG4 stream determination unit 23, which determines whether or not the input bit stream has been encoded by some other predetermined method XXX7. A trim determining unit 24 and a decoder selecting unit 25 for selecting a decoder to be used based on the determination results of the determining units 21 to 24 are provided. The decoder selecting section 25 has a function of selecting a decoder to be used according to an instruction from the outside.

FIG. 3 is a block diagram showing a detailed configuration example of the image mixing apparatus 8 described above. The image mixing device 8 includes a coordinate conversion size changing unit 81 for converting the coordinates and size of the input video data 1, a coordinate conversion size changing unit 82 for converting the coordinates and size of the input video data 2, and the coordinates and size of the input video data n. , A frame buffer 84 for holding input image data 1 whose coordinates and size have been converted, a frame buffer 85 for holding input video data 2 whose coordinates and size have been converted, and converting the coordinates and size. A frame buffer 86 for holding input video data n, a text image frame buffer 89 for holding character image data, an overlay mixing control unit 87 for mixing data of these frame buffers 84, 85, 86, 89, an overlay mixing control unit 87 Digital mixed by And a D / A converter unit 88 for converting the over data into analog data.

FIG. 4 is a block diagram showing a detailed configuration example of the audio mixing switch device 13 described above. The audio mixing switch device 13 includes a sampling filter 131 for sampling the input audio data 1, a sampling filter 132 for sampling the input audio data 2, a sampling filter 133 for sampling the input audio data n, and an audio for text data. Sampling filter-136 for sampling data,
Sampling filters-131, 132, 133, 13
6 and a D / A converter 135 for converting the digital audio data mixed by the mixing switch 134 into analog audio data.
have.

Next, the operation of this embodiment will be described. A bit stream or the like obtained by receiving a digital broadcast or the like is input to the bit stream input unit 1 and held in an internal buffer. The video decoder selecting unit 2 converts the bit stream held in the bit stream input unit 1 into
The MPEG1 stream judging unit 21 to the XXX stream judging unit 24 analyze and determine the encoding method of the bit stream. The decoder selection unit 25 determines and selects a decoder for decoding the bit stream based on the determination results of the MPEG1 stream determination units 21 to the XXX stream determination unit 24.

The MPEG1 stream determination unit 21
The encoding method of the bit stream is, for example, MPEG1
Is determined, the decoder selection unit 25 outputs
One decoder 4 is selected and the bit stream is sent to the MPEG1 decoder 4. The same applies to bit streams encoded by other methods. The input bit stream is decoded by a dedicated decoder corresponding to each encoding method, and sent to the image mixing device 8.

At this time, if the encoding method of the bit stream input in advance by an external instruction is known,
As shown in FIG. 2, the external determination input signal (video decoder selection) 100 has priority, and the decoder selection unit 25 selects a decoder for decoding the bit stream according to an external instruction.

On the other hand, the text data input from the text input unit 15 becomes character image data by the text image creation unit 16 and is sent to the image mixing device 8.

The image mixing device 8 includes the decoders 4 to
The input data 1, 2,..., N are converted based on an external coordinate conversion / size change instruction 200, and the data whose coordinates and size have been converted are stored in the respective frame buffers 84, 85,. I do. The size conversion / coordinate conversion designation signal 200 may be present in the broadcast stream if it is a broadcast, but if it is present, it is detected by the preceding decoder. In addition, the user may instruct to display at an arbitrary position.

The image mixing device 8 stores the character image data from the text image creating section 16 in the text image frame buffer 89.

Each of the frame buffers 84, 85... 8
The outputs of 6 and 89 are output by the overlay mixing control section 87 at the final display frequency for each pixel based on an external display priority, display layer priority information, and an instruction signal 300 such as a mixing coefficient of each frame buffer. After the value of the last pixel is determined, the data is converted into analog data by the D / A converter 88. The display priority, the display layer priority, and the mixing coefficient designation 300 may be in the broadcast stream, but may be arbitrarily designated by the user. The display device 9 displays the data output from the image mixing device 8 on a screen such as a CRT.

Here, the text image frame buffer 8
9 works differently from other frame buffers. In the text image frame buffer 89, the text portion is an image created by the specified font type or color, and the portion other than the text portion basically has no image. If there is no image, for example, set the pixel value to 0
(Zero) is different from a pixel value of 0 (zero).

When the value of the pixel is 0 (zero) at the time of mixing,
Although used as a value of 0 (zero), 0 (zero) without an image is treated as transparent, and mixing does not affect the result. That is, the value of the image portion representing the character affects the pixel value of the other frame by mixing, but the value of 0 (zero) of the text image frame buffer 89 is not used to determine the value of the pixel. That is.

On the other hand, the audio decoder selecting unit 3 analyzes the bit stream held in the bit stream input unit 1 and determines the encoding method of the bit stream. The audio decoder selecting unit 3 determines from the result of the determination
An audio decoder dedicated to audio decoding the bit stream is selected from among the MPEG1 audio decoder 10 to the XXX audio decoder 12, and the bit stream is sent to the selected audio decoder.

On the other hand, the text data input from the text input unit 15 is input to the text-to-speech conversion unit 17, converted into corresponding voice data, and then input to the voice mixing switch device 13.

MPEG1 audio decoders 10 to XX
The X audio decoder 12 decodes the audio data sent from the audio decoder selection unit 3 and decodes the audio data into audio data, and outputs the obtained decoded audio data to the audio mixing switch device 13. The audio mixing switch device 13 converts the audio data 1, 2,... N input from the respective decoders into pitch information 400 from the outside.
Sampling filter -1 based on the pitch indicated by
Samples are performed at the same pitch by 31, 132, and 133, and all are converted into audio data of the same pitch, and then output to the mixing changeover switch unit 134.

The audio mixing switch device 13 is
The voice data sent from the text-to-speech device unit 17 is sampled at the same pitch as the above by the sampling filter 136 based on the pitch indicated by the external pitch information 400, converted into voice data, and then mixed. Output to the changeover switch unit 134. That is, the audio data transmitted from the text-to-speech apparatus unit 17 is treated in the same manner as the audio data transmitted from each of the decoders 10 to 12.

The mixing changeover switch unit 134 mixes various input audio data based on a specified mixing coefficient and a channel selection instruction signal 500,
The signal is converted into an analog signal by the D / A converter 135 and output to the audio reproducing device 14. The audio reproducing device 14 outputs the input audio signal from the same speaker.

According to the present embodiment, bit streams coded by different coding systems are decoded by dedicated decoders corresponding to the respective coding systems, and each decoded data is decoded on the same screen or common screen. By mixing the data so that the data can be output from a speaker, data encoded by different methods can be displayed on the same screen. Also, since video data and audio data can be mixed, different video data encoded in the same system can be decoded and displayed on the same screen. Therefore, different screens can be mixed by applying an appropriate coefficient to the images, or the different screens can be displayed with priorities. Similarly, audio data encoded in different systems or different audio data encoded in the same system can be output as audio from the same speaker without any discomfort.

As a result, each channel of the digital broadcast can be simultaneously displayed in an arbitrary arrangement on the screen, and each broadcast station can construct a display environment on the terminal side only by sending a small program guide. It is also possible to create various streams without editing the streams themselves.
One stream can be viewed on the same screen as if it is being played, or can be heard on the same speaker.

At this time, the input text data is converted into character image data by the text image creation unit 16 and can be mixed with other video data. Therefore, the text data can be used alone or together with other video data on the same screen. Can be displayed.

Further, the input text data is converted into voice data by the text-to-speech conversion unit 17 and can be mixed with other voice data, so that the voice of the text data can be used alone or mixed with other voice data. And output from the same speaker.

[0048]

As described above in detail, according to the video / audio reproducing apparatus of the present invention, it is possible to decode a plurality of different data encoded in the same system or a plurality of data encoded in different systems. Can be reproduced and output from the same screen or the same speaker. In addition, the text data can be displayed on the screen, and the text data can be converted to speech and combined with other audio signals, or selected and reproduced.

[Brief description of the drawings]

FIG. 1 is a block diagram showing an embodiment of a video / audio reproducing apparatus according to the present invention.

FIG. 2 is a block diagram illustrating a detailed example of a video decoder selection unit illustrated in FIG. 1;

FIG. 3 is a block diagram illustrating a detailed configuration example of the image mixing device illustrated in FIG. 1;

FIG. 4 is a block diagram showing a detailed configuration example of the audio mixing device shown in FIG. 1;

FIG. 5 is a block diagram showing a schematic configuration example of a conventional video / audio reproduction device.

[Explanation of symbols]

 1 bit stream input unit 2 video decoder selection unit 3 audio decoder selection unit 4 MPEG1 decoder 5 MPEG2 decoder 6 MPEG3 decoder 7 XXX decoder 8 image mixing device 9 display device 10 MPEG1 audio decoder 11 MPEG2 audio decoder 12 XXX audio decoder 13 audio mixing switch Device 14 Audio playback device 15 Text input unit 16 Text image creation unit 17 Text speech conversion unit 21 MPEG1 stream determination unit 22 MPEG2 stream determination unit 23 MPEG4 stream determination unit 24 XXX stream determination unit 25 Decoder selection unit 81-83 Coordinate conversion size Change section 84-86 Frame buffer 87 Overlay mixing control section 88 D / A conversion section 89 Strike image frame buffer

Claims (11)

[Claims] 1. A judging means for judging a coding method of an input video bit stream, and a decoding means for decoding the video bit stream to obtain video data corresponding to the coding method judged by the judging means. And a mixing means for mixing the plurality of pieces of video data obtained by the decoding means, and a display means for displaying the video data mixed by the mixing means on a screen. 2. A decoding device comprising: a plurality of decoders for respectively decoding video bit streams encoded by various encoding systems; and a plurality of decoders for judging an encoding system of a video bit stream to be decoded. 2. A video reproducing apparatus according to claim 1, further comprising: selecting means for decoding the bit stream by a corresponding one of the following. 3. The mixing means includes: mixing coefficient information for specifying a mixing ratio when the level of each video data is the same; mixing position information for specifying a position on a screen when each video data is displayed; The video reproduction according to claim 1 or 2, wherein the plurality of video data are mixed based on a part or all of the display layer priority information that specifies a layer for displaying the video data. apparatus. 4. A data creating means for creating character image data from input text data, wherein the created character image data is displayed by the display means via the mixing means. Item 3. The video reproducing apparatus according to Item 1. 5. A determination means for determining an encoding method of an input audio bit stream, and a decoding means for decoding the audio bit stream to obtain audio data in accordance with the encoding method determined by the determination means. Audio reproduction comprising: mixing means for mixing a plurality of audio data obtained by the decoding means; and audio output means for outputting the audio data mixed by the mixing means from the same speaker. apparatus. 6. The decoding means decodes audio bitstreams encoded by various encoding methods, respectively, and the plurality of decoders discriminates an encoding method of an audio bitstream to be decoded. 6. An audio reproducing apparatus according to claim 5, further comprising: selecting means for decoding the bit stream by a corresponding one of the decoders. 7. The mixing means includes: mixing coefficient information for specifying a mixing ratio when each audio data is reproduced on the same channel; selection information for specifying which audio data is to be selected; 7. The audio reproducing apparatus according to claim 5, wherein the plurality of pieces of video data are mixed based on a part or all of pieces of pitch information specifying a pitch. 8. A data conversion means for converting input text data into audio data, wherein the audio data obtained by the conversion is output from the speaker by the audio output means via the mixing means. The audio reproducing device according to claim 5, wherein 9. A first judging means for judging an encoding system of an input video bit stream, and decoding the video bit stream in accordance with the encoding system judged by the first judging unit. First decoding means for obtaining video data; first mixing means for mixing a plurality of video data obtained by the first decoding means; and video data mixed by the first mixing means on a screen. First display means for displaying, second determining means for determining an encoding method of an input audio bit stream, and the audio bit stream corresponding to the encoding method determined by the second determining means. Second decoding means for decoding the audio data to obtain audio data, and mixing the plurality of audio data obtained by the second decoding means. A video and audio reproducing apparatus comprising: a second mixing unit; and a second audio output unit that outputs audio data mixed by the second mixing unit from the same speaker. 10. A data creating means for creating character image data from input text data, wherein the created character image data is displayed by the first display means via the first mixing means. 10. The video / audio reproduction device according to claim 9, wherein: 11. A data conversion means for converting input text data into voice data, wherein the voice data obtained by the conversion is converted by the second voice output means via the second mixing means. 10. An output from a speaker.
0. The video / audio reproduction device according to 0