KR100265238B1 - Multi angle picture simultaneous reproducer - Google Patents

Abstract

PURPOSE: A synchronous player of multi-angle video data is provided to select desired pictures easily with enjoying multi-angle video data by separating program streams of the multi-angle video data into each angle video data and playing back the video signals. CONSTITUTION: A fast player(21) reads all angle data by playing back the data at higher velocity than reference velocity for playing back a single angle data. A channel data processor(22) processes the read data into specific data form. An angle data separator(23) separates the data into each angle video data based on start position data of the multi-angle video data. A decoder(24) decodes the separated angle data into each video data. A video output unit(25) outputs each angle video data at the same time. The video output unit includes a presentation buffer for saving each decoded video data temporarily, and an NTSC/PAL(National Television System Committee/Phase Alternation by Line) encoder for converting the video signals into NTSC or PAL video data. Therefore, a user selects desired pictures easily with watching all angle video data.

Description

Multi-angle video playback device

BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a multi-angle video simultaneous playback apparatus for separating and playing back multi-angle video recorded in an MPEG-2 Program Stream. Relates to a device.

Recently, according to the development of digital data compression technology, researches that allow a viewer to select and view an image of a desired angle from the captured images have been conducted at various angles in the fields of digital broadcasting or digital multi-functional disc (DVD). Digital multi-functional disc (DVD) playback system adopting MPEG-2 standard is called 'Multi-Angle Playback' and supports up to nine images captured from different angles. 1 shows a program stream of data compressed to MPEG-2 standard capable of multi-angle playback. Images captured at multiple angles are separately recorded with information about the start position of the multiple angle image so that the images for each angle can be reproduced separately. The information about this start position is called data search information (DSI). The data retrieval information includes various information such as double speed as well as retrieval information for multiple angles such as the starting position of the multi-angle, the image number of the currently selected multi-angle, the number of different angles that can be selected, and the selectability. Also, the images for each angle have their respective indexes, and during reproduction, only images captured at the same angle are selected by this index, and they are reproduced in a continuous image in association. And images of unselected angles are skipped. As shown in Fig. 1, the conventional multi-angle video reproducing apparatus reproduces an image of angle-1 according to a recognition signal generated at a portion capable of multiple angles during reproduction, and skips the angle-2 to the angle-N next time. An angle-1 image is played and displayed on the screen as a continuous image. At the same time, the number of the currently selected angle, the number of selectable angles, and whether the selection is possible are displayed on the OSD (On Screen Display) screen. This allows the user to select different angle images.

However, the conventional multi-angle video reproducing apparatus is configured to enjoy only one image captured at a specific angle at any time. In other words, conventionally, even when a multi-angle image is provided, only an image corresponding to only one angle can be viewed at a time, and the number of selectables and selectables of different angles can be known on the OSD screen. The problem is that the contents cannot be known without directly selecting and playing the contents.

Accordingly, an object of the present invention for solving this problem is to receive a program stream of an image captured at multiple angles, separate them into respective angle image data, decode them into separate image signals, and synchronize and reproduce them at the same time. It is to provide a multi-angle video simultaneous playback device that allows you to easily select the desired scene while watching the video at the same time.

1 is a conceptual diagram illustrating an MPEG-2 program stream in a general multi-angle video.

2 is a block diagram showing each configuration of a multi-angle video playback apparatus according to the present invention.

3 is a detailed configuration diagram of an image output unit for synthesizing and outputting a plurality of angle images into one screen;

4 is a conceptual diagram illustrating a method of configuring a composite screen displayed in a multi-angle video simultaneous playback apparatus of the present invention.

* Explanation of symbols for main parts of the drawings

21: high speed playback unit 22: channel data processing unit

23: angle data separation unit 24: decoding unit

25: image output unit 26: control unit

31: Presentation buffer 32: Low pass filter

33: downsampler 34: frame buffer

35: NTSC / PAL encoder

In order to achieve the above object, the multi-angle video simultaneous playback apparatus of the present invention is an apparatus for simultaneously playing back images of each angle separately from a signal in which images captured in a multi-angle are multiplexed and recorded. An angle data separation unit for receiving images captured at multiple angles and separating a plurality of angle data into respective continuous angle data based on the start and end position information thereof, and image data for each separated angle. Decoder to receive and decode the input, and the image output unit for receiving the image for each angle decoded by the decoder to have the same playback time for each frame unit, and to process the signal and output on the screen at the same time and In order to simultaneously reproduce a plurality of decoded images from the decoder, the output of the decoder is controlled, and each preset It is provided with a control unit for controlling the output image.

On the other hand, the multi-angle video simultaneous playback apparatus of the present invention is a device for separating and simultaneously playing back images for each angle from a digital multi-functional disc (DVD) on which multiple-angle videos are multiplexed and recorded, A high speed reproducing unit for reproducing all angle data within a predetermined time at a higher speed than the reference speed when reproducing only one angle data, and receiving the data from the high speed reproducing unit described above and processing the data into a predetermined data type to separate the aforementioned angle data. It further comprises a channel data processing unit for outputting to the negative.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

2 is a block diagram showing each configuration of a multi-angle video playback apparatus according to an embodiment of the present invention. The apparatus of FIG. 2 reproduces at a higher speed than a reference speed when only one angle data is reproduced from a recording medium on which a program stream as shown in FIG. 1 is recorded, and reads all angle data within a predetermined time. The part 21 is provided. The output terminal of the high speed playback section 21 is connected to a channel data processing section 22 for processing the read data in the form of predetermined data. An output terminal of the channel data processor 22 is connected to an angle data separator 23 that receives the above-described data and separates the images for each angle based on the start position information of the multi-angle image. An output terminal of the angle data separator 23 is connected to a decoder 24 that receives each of the separated angle data and decodes each of the image data. The output terminal of the decoder 24 is connected to the image output unit 25 for simultaneously outputting the image for each angle decoded by the decoder 24 described above. The image output unit 25 inputs a presentation buffer 31 which temporarily stores and outputs each image decoded by the decoder 24 described above, and inputs image signals stored in the presentation buffer 31 described above. And an NTSC / PAL encoder 35 which converts the image into an NTSC or PAL image and outputs the image to a display device. On the other hand, the apparatus of FIG. 2 according to the present invention includes a control unit 26 for controlling each component for simultaneous reproduction of a multi-angle image.

3 is a detailed configuration diagram of an image output unit 25 for synthesizing and outputting a plurality of decoded angle images into one screen. The image output unit 25 includes a presentation buffer 31 for temporarily storing the images decoded by the decoder 24 described above. The presentation buffer 31 is connected to a low pass filter 32 that receives the decoded images and outputs them through a pass band corresponding to a predetermined downsampling ratio. The low pass filter 32 is connected with a down sampler 33 which receives data output through the low pass filter 32 and downsamples at a predetermined ratio. The downsampler 33 is connected to a frame buffer 34 that receives and stores a plurality of downsampled image data and outputs the same playback time for each frame unit of the image. The frame buffer 34 is connected to an NTSC / PAL encoder 35 which receives image data synchronized in units of frames and converts the image data into NTSC or PAL images. 2 to 3 having such a configuration will be described in more detail with reference to FIG.

First, in FIG. 2, the high speed playback section 21 reads out data at high speed from a recording medium such as a DVD in which a program stream conforming to the MPEG-2 standard is recorded. At this time, the data playback speed of the high speed playback section 21 should be the speed multiplied by the number of angular images to be played at the same time by the reference playback speed (26.16Mbps based on the channel data rate and 1l.08NIbps based on the user data rate) of the existing DVD player. do. The MPEG-2 standard adopted for DVD supports the recording of up to nine multi-angle images. For example, if you want to simultaneously reproduce multi-angle images captured from nine angles, the high-speed playback unit of the present invention plays back. The speed should be 9 times faster than the speed of a conventional DVD player, so that all multi-angle data can be played continuously. Data continuously reproduced from the recording medium is input to the channel data processing unit 22 and output through the EFM Plus demodulation and error correction process. In this case, the output data is a data stream in which the video / audio signal and the DSI information, which are user data, are not separated and multiplexed. The angle data separator 23 receives the above-described data stream and separates the multiplexed angle data into respective consecutive angle data based on the start position information of the DSI. Each of the separated angle data is input to the decoder 24 and decoded into the original video / audio signal from the data compressed by the MPEG-2 standard. In this case, the decoder 24 may be configured in various ways. The decoder 24 may be configured of a plurality of decoders corresponding to each angle data, or may be configured of one decoder capable of fast time division processing. In the case of using a plurality of decoders, it is necessary to synchronize the time information since each decoder must reproduce the same information at the same time. One way to solve this problem is to consist of one main decoder that supplies system time, and a plurality of subordinate decoders that operate in a subordinate manner. In case of using one decoder capable of fast time division processing, the presentation time code (PTC) is taken from only one angular image information, and the image data for one angle in GOP (Group Of Pictures) unit is obtained. After decoding, after decoding the image data of the next angle and sequentially decoding all the image data, synchronization can be solved by decoding the image data corresponding to the next GOP with respect to the image data of the first angle.

The video data decoded by the plurality of decoders or one fast time division decoder is stored in the designated presentation buffer 31 of the video output unit 25. At this time, the presentation buffer 31 is stored to have the same playback time for the frame unit of the image. Image data stored in the above-described buffer may be output in various ways according to the reference time information and the situation set by the user. First, only one selected angle image is output. Second, a plurality of angle images are synthesized and output on one screen. Third, a plurality of designated angle images are simultaneously output through each independent image output unit 25. The first and second cases are displayed through one image display apparatus, and the third case is displayed through the display apparatus corresponding to the number of angular images.

Meanwhile, in the second case described above, that is, when a plurality of angular images are synthesized and output on one screen, as illustrated in FIG. 3, the image output unit 25 includes a low pass filter 32 and a downsampler 33. ) And a frame buffer 34. In addition, one composite screen can be configured as shown in FIG. First, referring to the configuration of the image output unit 25, the image decoded by the MPEG-2 standard in the decoder 24 described above is stored in the presentation buffer 31 is input to the low pass filter (32). The low pass filter 32 is a low pass filter using an anti-aliasing filter to remove noise caused by aliasing. The low pass filter 32 includes a passband corresponding to a predetermined downsampling ratio described below. Have The video signal band-limited to the desired passband through the low pass filter 32 is input to a down-sampler 33 and downsampled at a predetermined clock ratio. For example, when the downsampling ratio is 1/2, 720 samples are reduced to 360 samples for the horizontal, and 480 samples are reduced to 240 samples for the vertical. Each of the downsampled angular image signals is stored at a predetermined position of the frame buffer 34 and then output at once when synchronized. The output video signal is input to the NTSC / PAL encoder 35, converted into NTSC or PAL video, and then output to the display device.

The downsampling ratio described above depends on how one composite screen is constructed. As shown in a to f of FIG. 4, since the MPEG-2 standard adopted for DVD supports multiple angles of up to nine, in order to synthesize and display such multiple angle images on one screen, 1,2,4 It is effective to construct a composite screen of 6, 9 divisions. Accordingly, the number of screen divisions and the downsampling ratio also vary according to how many multi-angle images are output on the screen. For example, a four-segmented composite screen has a downsampling ratio of 1/2 each of its width and length, and a six-segmented composite screen has a downsampling ratio of 1/3 and a half of its height. 1/3 each length. This composition screen composition method can be configured as a multi-angle image menu.

So far, the playback of the multi-angle video has been described, but the DVD standard has not only a 'synchronous angle playback mode' having the same audio information for one event, but also an 'asynchronous angle' for which the audio information can be different for each multi-angle video. 'Playback Mode' supports multi-angle video data up to 8 languages simultaneously. In case of 'Asynchronous angle playback mode', one screen is mainly set to play another screen, but when outputting one synthesized video, the user can select the voice or automatically play the voice of the first angle. In the case of outputting the video signal to each display device, the audio signal may be output as separate independent audio. Accordingly, the apparatus of FIG. 2, which is an embodiment of the multi-angle video simultaneous playback apparatus of the present invention, further includes a system layer decoder (not shown), an audio decoder (not shown), and an audio output unit (not shown). It is possible to reproduce each multiplexed voice simultaneously with the image. In a general case, in the MPEG-2 program stream input to the angle data separator 23 of FIG. 2, an audio / video signal (A / V signal) is multiplexed and the A / V signal separated into respective angle data. Is separated into a video and an audio signal by a system layer decoder (not shown) of the decoder 24. Each of the video and audio decoders (not shown) received therein decodes the original video / audio signal from data compressed by MPEG-2 standard by one fast time division decoder or a plurality of decoders. The decoded signals are output to the monitor and the speaker through the image output unit 25 and the audio output unit (not shown), so that not only the multi-angle video but also the audio can be reproduced simultaneously. In this case, a plurality of users who use different languages have the advantage of simultaneously viewing the same image in different languages.

As described above, the present invention separates and decodes the multiplexed and recorded angle images, respectively, and simultaneously reproduces and outputs them to a plurality of display apparatuses, or simultaneously reproduces and outputs the image screens synthesized by one display apparatus to view images of all angles simultaneously. It provides the effect that the user can easily select the desired screen.

Claims (12)

(Correction) An apparatus for simultaneously separating and reproducing images for each angle from a signal in which images captured at a multi-angle are multiplexed and recorded, wherein the images captured at the multi-angle are input, and An angle data separator that separates a plurality of angle data into respective consecutive angle data based on the start and end position information; A decoder which receives and decodes the image data for each of the separated angles; An image output unit for receiving images for each of the angles decoded by the decoder and storing them to have the same playback time for each frame unit, and processing the signals and outputting the same on the screen simultaneously; And a controller configured to control an output of the decoder to simultaneously reproduce a plurality of images decoded from the decoder, and to control an image outputted at a predetermined angle. (Correction) The method according to claim 1, wherein all angle data is continuously generated within a predetermined time at a higher speed than a reference speed when only one angle data is reproduced from a digital multifunctional disc (DVD) in which multiple angle images are multiplexed and recorded. And a channel data processing unit which receives data reproduced continuously from the high speed playback unit and processes the signal in the form of original data and outputs the signal to the angle data separating unit. Synchronous playback device. 3. The apparatus of claim 2, wherein the reproduction speed of the high speed playback unit is equal to the number of multiple angle images to be reproduced simultaneously multiplied by a reference speed when only one angle data is reproduced. The apparatus of claim 1 or 2, wherein the decoding unit comprises a plurality of decoders which individually decode the images of the input angles. The apparatus of claim 4, wherein the plurality of decoders comprise a main decoder applying a system time for synchronization, and a plurality of subordinate decoders which operate in a dependent manner. The simultaneous decoding of the multi-angle image according to claim 1 or 2, wherein the decoding unit comprises one decoder which receives the images of the separated angles and decodes a plurality of image data by fast time division processing. Playback device. The simultaneous playback of multi-angle video according to claim 6, wherein the decoder decodes a unit of pictures (GOP) using a presentation time code taken from only one angle picture for synchronization. Device. The apparatus of claim 1 or 2, wherein the image output unit displays a plurality of images corresponding to respective angles as independent image signals. 10. The apparatus of claim 8, wherein the image output unit receives a presentation buffer for temporarily storing images for each angle decoded by the decoder, and converts the image signals stored in the presentation buffer into NTSC or PAL images. And an NTSC / PAL encoder for outputting to a display device. The apparatus of claim 1 or 2, wherein the image output unit converts and displays a plurality of images corresponding to respective angles into one synthesized image. 11. The image output device according to claim 10, wherein the image output unit comprises: a presentation buffer for temporarily storing images for each angle decoded by the decoder; A low pass filter that receives the images output from the presentation buffer and outputs them through a pass band corresponding to a predetermined downsampling ratio; A downsampler for downsampling the data output from the low pass filter at a predetermined clock rate; A frame buffer which receives the downsampled video signal and synchronizes the data in a frame unit; And an NTSC / PAL encoder which receives the video signals output from the frame buffer and converts them into NTSC / PAL images and outputs them to a display device. The apparatus of claim 1 or 2, wherein the decoder can be used for supporting multi-voice.

Images