KR20120019751A - Real-time three dimension formating module for ultra high-definition image and system using thereof - Google Patents

Abstract

PURPOSE: A real time 3D formatting module for a high quality image and a real time 3d formatting system using the same are provided to enable an encoder/decoder unit to code an image without separate data processing for a 3D format, thereby minimizing delay. CONSTITUTION: A 3D input channel unit(100) receives an UHD(Ultra High Definition) image as raw data corresponding to four HD image frames. A pre-processing unit(200) selectively receives an individual HD image according to a 3D format and checks whether each piece of raw data is synchronized. The pre-processing unit provides raw data for a 3D image by arranging the received raw data. An encoder/decoder unit(300) encodes and decodes the raw data for a 3D image. A high speed storage medium(400) stores the 3D image.

Description

Real-time three dimension formating module for ultra high-definition image and system using

The present invention relates to a real-time 3D formatting module for an ultra-high definition image and a real-time 3D formatting system using the same, and more particularly, an image corresponding to a left and right eye by receiving an image signal of an ultra high definition corresponding to an ultra high definition (UHD). The present invention relates to a 3D formatting module for ultra-high definition video that supports various 3D video formats and a real-time 3D formatting system using the same to provide frames per second for smooth viewing by minimizing delays generated during signal synchronization and preprocessing. .

Currently, the video technology is spreading from analog SD (Standard-Definition) to digital HD (Hi-Definition), and this digital video system is easy to adjust clarity, saturation, and brightness, so that the image of image quality is closer to reality. To provide.

In addition, the development of hardware supporting various compression techniques and image transmission technologies for processing the digital image facilitates the spread of HD image and accelerates the development of the image higher than the HD. Full HD, which is higher than HD currently provided, supports 1920 × 1080 resolution and is composed of 2 million pixels to provide a substantially higher quality image than the HD.

On the other hand, the recent imaging technology is growing one step further to the Ultra High-Definition (UHD) beyond the Full HD, the UHD that supports ultra high resolution and ultra high resolution is in the spotlight as the next generation media environment. The UHD supports 4K (3840 × 2160) and 8K (7680 × 4320) resolutions and up to 22.2 channels of surround audio. Such UHD provides 4 times clearer picture quality than 4K UHD picture compared to the HD, and 8K UHD provides 16 times more clear picture quality than the HD picture.

In addition, in providing the UHD video in real time, not only a simple video signal is provided but also an audio signal, the conventional HD requires a transmission rate of 3.7 Mbps to support 5.1 channels. In this case, up to 22.2 channels are supported, and accordingly, the transmission rate is required to be 48.8Mbps.

In order to provide the image produced in the UHD, the image content produced in the UHD is divided into four HD images to form one image frame in the case of 4K UHD, as shown in Figure 1, 8K In the case of 16 HD images are divided and produced. That is, four input devices supporting HD are required to produce 4K UHD video, and 16 HD supporting input devices are required to support 8K UHD.

The hardware currently provided for processing the UHD image includes an input interface 2 for receiving an HD image through four channels from an external input device as shown in FIG. 2, and for storing the four HD images. Synchronize the four HD images received with the plurality of storage media 4 connected in a RAID manner, and store the four HD images as UHD images on the storage medium or output them from the storage medium 4. The main processor 1 may be configured to output the four HD images as UHD images through the interface 3. Such hardware can support real-time storage and output of raw data consisting of UHD video.

However, in the implementation of three-dimensional (3D) image, which is an active next generation imaging technology, the preprocessing configuration for pre-processing the HD image and converting the HD image into the 3D format should be further included. Due to the delay that occurs in such a preprocessing configuration, it is difficult for the raw data to be output at the frame rate per second.

In addition, the pre-processing configuration for the current 3D image is provided for most of the two-dimensional image, the depth of the control by comparing the image of the left eye and the right eye without considering that one frame is input in a distributed state, Since the main function is to interpolate the pixel difference between the left and right eyes, a new preprocessing scheme optimized for the 3D format is required.

Therefore, in order to support 3D UHD video, an optimized preprocessing configuration corresponding to the 3D format, and the preprocessed video must be coded immediately in real time by the encoder / decoder to enable real-time 3D video viewing Hardware design that minimizes delay and load of decoder section is required.

In addition, in the case of 8K UHD, which has a higher resolution than 4K UHD video, the main processor should be able to control 4 times the amount of transmission required for 4K UHD video, and occurs when formatting 8K UHD video in converting to 3D video. Since the delay takes more load than the throughput, a hardware configuration is required to properly handle the delay.

The present invention includes a hardware configuration for minimizing delay that occurs when converting an ultra high definition image to a 3D image format, so that output and storage of an ultra high definition 3D image can be performed in real time, thereby allowing a smooth 3D image through an external output device. The purpose is to maintain the frame rate per second possible.

In addition, the present invention is to format the ultra-high definition image into a 3D image, to configure a separate input channel unit for receiving the left eye image and the right eye image, and to convert to various 3D image formats, Its purpose is to ensure autonomy.

In addition, the present invention supports an efficient 3D formatting process for the raw data of the ultra-high definition image, and reduces the capacity of the 3D image while maintaining UHD quality, thereby reducing the hardware load on storage and output, and at the same time, accurate synchronization. The purpose is to make the process work.

The real-time 3D formatting module for ultra-high definition images according to the present invention for achieving the above object is composed of a first channel portion corresponding to the left eye and a second channel portion corresponding to the right eye, and the four UHD images through each channel portion. 3D input channel unit for dividing and receiving the raw data (law data) corresponding to the HD image frame, and individual HD video provided by each channel unit of the 3D input channel unit according to a predetermined 3D format to selectively receive according to the 3D format While checking the synchronization for each raw data, the pre-processing unit for providing the raw data for the 3D image by arranging the selectively received raw data according to the 3D format, and the raw data for the 3D image arranged through the pre-processing unit An encoder / decoder for encoding or decoding in a set manner, and storing and providing 3D video encoded through the encoder / decoder. It includes in the storage medium.

The UHD output unit may further output a 3D UHD image to an external output device, wherein the encoder / decoder unit outputs the 3D image raw data through the UHD output unit or decodes an encoded 3D image from a high speed storage medium. It can be output through the UHD output unit.

In addition, the high speed storage medium includes an E-IDE hard disk drive (HDD) or a solid state disk (SSD).

On the other hand, the pre-processing unit is a synchronization unit for providing a clock signal for synchronization, a format setting unit for setting one of one or more 3D formats according to the external control or setting the 3D format, and each channel unit based on the clock signal of the synchronization unit Arrange the UHD image frames of the left and right eyes while synchronizing the raw data provided, and acquire left and right eye images for changing the reception method for the raw data provided from the respective channel units according to the 3D format of the format setting unit. And a formatting unit for arranging the raw data constituting the synchronized left and right UHD image frames provided by the left and right eye image acquisition units according to the 3D format of the format setting unit and converting the raw data into 3D image raw data.

In this case, when the 3D format is a format for viewing through glasses, the left and right eye image acquisition units alternately receive raw data provided by each channel unit in UHD image frame units, and synchronize from the left and right eye image acquisition units. The interpolation unit may further include an interpolation unit configured to receive raw data constituting the UHD image frame of the left eye and the right eye, and interpolate a difference in pixels or lines between the raw data constituting the UHD image frame of the left eye and the right eye. Raw data constituting the interpolated UHD image frames of the left eye and the right eye may be arranged horizontally or vertically according to the 3D format and converted into raw data for the 3D image.

The display apparatus may further include a buffer unit connected to one of the first channel unit and the second channel unit when the 3D format is a format for viewing through glasses. And arrange the first UHD image frame after receiving the raw data directly from any one of the second channel units, and constructing the second UHD image frame after receiving the raw data provided from the buffer unit. The raw data constituting the first UHD image frame and the second UHD image frame may be synchronized based on the clock signal of the synchronization unit and the time information of the raw data.

In addition, when the 3D format preset in the format setting unit is a lenticular method, the left and right eye image acquisition units receive raw data in units of UHD frames from the respective channel units to form third and fourth UHD image frames. A 3D frame extracting unit for extracting raw data included in array units having a predetermined interval for each of the raw data constituting the synchronized third and fourth UHD image frames; And an interpolation unit interpolating adjacent pixels or lines among the raw data constituting the 4 UHD image frame, wherein the formatting unit is further configured to generate the raw data constituting the third and fourth UHD image frames interpolated from the interpolation unit. It may further comprise a formatting unit for combining to generate the raw data for the 3D image.

In addition, the format setting unit may activate at least one of the buffer unit, interpolation unit, and 3D frame extracting unit according to the 3D format of the format setting unit.

The encoder / decoder may be stored in the fast storage medium through a storage method including at least one of the interleaved, non-interleaved, screen size, storage location of audio information, or video compression format.

The real-time 3D formatting system using a real-time 3D formatting module for ultra-high definition images according to the present invention for achieving the above object comprises a plurality of modules connected to the LAN to configure a network, each module comprises the LAN It includes a network interface card (NIC) that supports network connection with other modules and a plurality of channel parts corresponding to the left and right eyes, and receives 4K UHD video as raw data divided into a plurality of HD video through each channel part. A 3D input channel unit, a synchronization unit generating a synchronization clock signal, and individual HD images provided by each channel unit of the 3D input channel unit according to a 3D format set according to external control or input, according to the 3D format While checking the synchronization for each raw data, and arranges the screening received raw data according to the 3D format for 3D video A pre-processing unit for providing raw data, and a high-speed storage medium for storing the raw data for 3D images provided by the pre-processing unit, wherein the raw data for 3D image is stored in the high-speed storage medium of each module in units of 4K UHD video frames. The method further includes an integrated coding unit which extracts the raw data and arranges or outputs the raw data to form 8K UHD image frames of the left and right eyes, and then codes or outputs the raw data.

In this case, the preprocessor may set the master or slave of the module, the preprocessor of the module set as the master of the module determines the synchronization time point to control the preprocessing of the other module set as the slave through the NIC, in each module You can synchronize the raw data you receive.

In addition, the preprocessor set as a master among the modules may transmit information about the 3D format to the preprocessor of the module set as slaves through the NIC, and the preprocessor arranges the synchronized raw data according to the received 3D format. The generated raw data for 3D image may be stored in the high speed storage medium.

The real-time 3D formatting module for ultra-high definition images and the real-time 3D formatting system using the same correspond to left and right eyes so as to optimize raw data for a plurality of divided HD images constituting the ultra-high definition images to various 3D formats. A separate channel unit is configured and each channel unit is alternately provided to sequentially provide left and right eye image frames, and the raw data is arranged to form a frame of an ultra-high definition image before performing a conventional two-dimensional preprocessing. In this way, the preprocessing process can be configured to a minimum for 3D video, which allows the encoder / decoder to perform video coding in real time without separate data processing for the 3D format, thereby minimizing delay and reducing load, thereby achieving ultra-high quality video. Real-time 3D image storage and 3D image implementation It has the effect of ensuring the viewer.

In addition, the present invention can provide an optimal configuration for processing the corresponding 3D format by adaptively varying the preprocessing configuration according to various 3D formats, thereby minimizing the delay according to the preprocessing of the 3D image in real time output and image quality It is effective in preventing a decrease.

In addition, the present invention supports a variety of 3D formats to ensure compatibility with the external device that outputs the 3D to watch the video in a variety of 3D format, and can reduce the 3D processing load of the external device 3D processing of the external device There is an effect that can maximize the efficiency.

In addition, the present invention can perform 3D image processing in real time even for images of 8K UHD or more simply by simply adding modules corresponding to the number of divided HD images according to the resolution of the ultra-high definition image, thereby providing a large-capacity ultra-high definition image. It is also possible to cope with the image, thereby providing a convenient expandability.

In addition, the present invention can not only perform efficient 3D formatting using only a portion of the raw data of the ultra-high definition image, but also reduce the hardware load on storage and output by reducing the capacity of the 3D image while maintaining UHD quality. At the same time, accurate synchronization is performed to ensure smooth viewing of 3D images.

1 is a diagram illustrating a production process of a UHD image.
2 is a block diagram of a conventional UHD real-time input and output system.
3 is a block diagram of a real-time 3D formatting module for ultra-high definition images according to the present invention.
4 is a detailed configuration diagram of a real-time 3D formatting module for ultra-high definition images according to the present invention.
FIG. 5 is a diagram illustrating an embodiment of real-time 3D formatting according to a 3D format corresponding to glasses support scheme of a real-time 3D formatting module for ultra-high definition images according to the present invention; FIG.
FIG. 6 is a diagram illustrating another embodiment of real-time 3D formatting according to 3D format corresponding to glasses supporting method of real-time 3D formatting module for ultra-high definition images according to the present invention. FIG.
FIG. 7 illustrates an embodiment of real-time 3D formatting according to a 3D format corresponding to an autostereoscopic support scheme of a real-time 3D formatting module for ultra-high definition images according to the present invention. FIG.
8 is a diagram illustrating a configuration of a real-time 3D formatting system using a real-time 3D formatting module for ultra-high definition images according to the present invention.
9 is a diagram illustrating an embodiment according to master and slave configuration of a real-time 3D formatting system using a real-time 3D formatting module for ultra-high definition images according to the present invention.

According to an embodiment of the present invention, in order to easily convert an ultra high definition (UHD) image into raw data for a plurality of HD image frames and convert the ultra high definition (UHD) image into an ultra high definition 3D image, the preprocessing unit of the module 3D The present invention proposes a real-time 3D formatting module for ultra-high-definition video that guarantees the output of real-time 3D video by greatly reducing the time and load for encoding the 3D video by the encoder / decoder.

In addition, the present invention is connected to a plurality of the real-time 3D formatting module to transmit and exchange the synchronization information and information about the 3D format between each module by the ultra-high resolution that can be easily 3D image processing even for 8K UHD or higher image We propose a real-time 3D formatting system using real-time 3D formatting module for video.

In addition, the real-time 3D formatting module for ultra-high definition images according to the present invention can be applied by varying the 3D format according to the external control or setting, and adaptively change the configuration of the module according to the set 3D format. It is possible to produce images in various 3D formats through a single module by selectively arranging raw data to correspond to a 3D format such as a 3D format requiring glasses for 3D viewing or a 3D format such as a glasses-free lenticular.

Based on the above, the detailed configuration of the present invention will be described with reference to the drawings.

3 is a block diagram showing the configuration of a real-time 3D formatting module for an ultra-high definition image according to the present invention. As shown, a 3D input channel unit for dividing and receiving 4K UHD images of left and right eyes into four HD images, respectively. A preprocessing unit 200 for processing data input from the 3D input channel unit 100 according to a 3D format, and encoding the data processed in the 3D format according to a predetermined coding scheme to generate a 3D image. The encoder / decoder 300 to generate and the fast storage medium 400 for storing the coded 3D image.

In this case, the HD image is input through the 3D input channel unit 100 as raw data, and the preprocessor 200 receives the raw data from the 3D input channel unit 100 in a 3D format. Since the array is processed in units of frames so as to correspond to, the encoder / decoder unit 300 receives the original 3D image raw data array processed according to the 3D format provided from the preprocessor, and performs coding. The encoder / decoder unit 300 may reduce the load on the 3D processing and quickly code the 3D image. Therefore, through such a preprocessing process, even a very high definition image can be easily and quickly converted into a 3D image, thereby ensuring real-time 3D image output. That is, the encoder / decoder unit 300 may decode the 3D image stored in the high speed storage medium 400 and output the decoded 3D image to an external output device through a UHD output unit adjacent to the 3D input channel unit 100 in real time.

In addition, the encoder / decoder 300 may include the interleaved, non-interleaved, screen size consideration, audio storage location, or video compression format. ) Or output to an external device through the UHD output unit.

Meanwhile, the 3D input channel unit 100 and the UHD output unit may support optical input / output, including a connector that may be connected to an optical cable, and the high speed storage medium 400 may be an E-IDE type hard disk drive (HDD) or the like. It may include a solid state disk (SSD).

The detailed configuration of the real-time 3D formatting module for the ultra-high definition image according to the present invention will be described with reference to FIG.

Since the module requires both UHD images of the left eye and the right eye photographed at the same time point for the same object in order to generate a 3D image of the UHD, the 3D input channel unit 100 includes four HDs forming the UHD images of the left eye. The first channel unit 110 for receiving the raw data for the image, and the second channel unit 120 for receiving the raw data for the four HD images constituting the UHD image of the right eye.

In this case, the first channel unit 110 and the second channel unit 120 are divided for convenience of description of the present invention, and the first channel unit 110 and the second channel unit 120 described below are left eye and The right eye may be configured to be interchanged with each other, and individual HD channels included in each channel unit may be configured by mutually changing positions in the 3D input channel unit 100.

In addition, in order to sequentially process the raw data provided by the first channel unit 110 or the second channel unit 120 alternately, the 3D input channel unit 100 and the preprocessor 200 The buffer unit 130 may be connected between the buffer unit 130 and the buffer unit 130 may temporarily store raw data for the HD image provided from the first channel unit 110 or the second channel unit 120. have.

Accordingly, the preprocessor 200 receives and processes the raw data for one of the first channel unit 110 or the second channel unit 120, and then temporarily stores the first data from the buffer unit 130. The raw data of the other of the channel unit 110 or the second channel unit 120 is received and processed sequentially, so that both the left and right eye images of the same object at the same time point can be obtained.

In this case, the preprocessor 200 may include the left and right eye image acquisition unit 210, the format setting unit 220, the synchronization unit 230, the 3D frame extractor 250, the interpolator 260, and the formatting as illustrated. The unit 240 may be configured.

First, the format setting unit 220 may be set by changing the 3D format according to an external control or input, the format setting unit 220 is the 3D frame extractor 250, the interpolator according to the set 3D format 260 and whether the buffer 130 is activated may be determined.

That is, the format setting unit 220 may set the 3D format for the 3D format for viewing through glasses, such as polarized light or shutter glasses, and for the case of supporting auto glasses such as lenticular. 220 determines whether to activate the components of the preprocessor 200 and the buffer unit 130 according to each 3D format to be processed through the components of the optimized module, thereby satisfying real-time and high quality 3D video can be output.

An embodiment in which the components of the module are optimized to correspond to the 3D format as described above will be described in detail with reference to FIGS. 5 to 7 with reference to the configuration of FIG. 4.

As described above, the 3D format is divided into a glasses support method and a glasses-free support format, and each format method is a first case stored in the fast storage medium 400 without requiring a real time output and a real time output is required. It may be divided into the second case.

First, the first case of the 3D format of the eyeglass support method shown in FIG. 5 is not required to be real-time, and may be set to store in the fast storage medium, and the encoder / decoder unit 300 may later The 3D image stored in the high speed storage medium 400 may be loaded and output through the UHD output unit 310.

When the first case of the eyeglass support method is set in the format setting unit 220, the format setting unit may activate the interpolation unit 260 and control the first case in the left and right eye image acquisition unit 210. Providing a signal, and the left and right eye image acquisition unit 210 sequentially connects to each channel unit of the 3D input channel unit 100 based on the received control signal for the first case of the glasses supporting method. Alternately, raw data corresponding to the left and right eyes may be received at regular time intervals.

Therefore, the left and right eye image acquisition unit 210 receives the raw data for the plurality of HD images corresponding to the left eye from the first channel unit 110 and arranges the raw data to form a UHD image frame of the left eye. After receiving the raw data for the HD image corresponding to the right eye from the second channel unit 120, the raw data may be arranged to form a UHD image frame of the right eye. Then, the left and right eye image acquisition unit 210 alternately repeats the above-described processing by the first channel unit 110, and as described above, the first channel unit 110 and the second channel unit 120 The raw data is received and processed while crossing each frame of UHD video.

In this case, as shown in the figure, the left and right eye image acquisition units 210 alternately receive each channel unit to receive raw data, and thus, the UHD image corresponding to the viewpoint n of the UHD image frame corresponding to the left eye and the right eye. A difference occurs at the time point n + 1 of the frame.

Accordingly, the left and right eye image acquisition unit 210 determines a synchronization time point based on the time information of the HD image first received among the first or second channel units 110 and 120, and the clock of the synchronization unit 230 is determined. The UHD image frame corresponding to the first channel unit 110 and the UHD image frame corresponding to the second channel unit 120 may be paired and synchronized based on the signal.

In this case, the left and right eye image acquisition unit 210 may generate index information based on the clock signal of the synchronization unit 230, and is disposed later together with the raw data of the paired UHD image frame. Can be provided to the element.

Then, when the left and right eye image acquisition unit 210 arranges the raw data in the pair of UHD image frames constituting the 3D image, the left and right eye image acquisition unit 210 alternately alternates the raw data from each channel unit corresponding to the left and right eyes. Receive and arrange and synchronize a pair of UHD video frames.

The operation of the left and right eye image acquisition unit 210 is 30 f each frame of the raw data constituting the UHD image frame input through the first channel unit 110 and the second channel unit 120 In the case of / s, 15 f / s are input by receiving raw data alternately at intervals of one frame for each channel part, but 30 f / s is input to all channel parts, so that the 3D input channel part 100 is received. You can keep the same frame rate per second as

In other words, the method of alternately providing the image of the left eye and the right eye like the shutter glass method and the method of processing the image by the real-time 3D formatting module according to the present invention are the same, and there is no deterioration in the frame rate and the image quality.

Meanwhile, the left and right eye image acquisition unit 210 may sequentially provide raw data for UHD image frames of left and right eyes arranged sequentially to the interpolator 260 activated by the format setting unit 220. have.

In this case, the interpolation unit 260 compensates for the difference in image change generated between UHD image frames of the left and right eyes according to the alternate reception of each channel unit of the left and right eye image acquisition units 210.

In other words, the interpolation unit 260 compares the arranged data values of the preceding UHD image frame with the arranged data values of the following UHD image frame in units of UHD image frames, and if the distortion difference is equal to or more than a predetermined line or pixel, the preceding input. The distortion difference may be compensated for by interpolating pixels or lines of a trailing input UHD frame based on the received UHD frame. In addition, through the interpolation as described above, the interpolator 260 may not only control the depth, but also interpolate color change values such as saturation, brightness, and luminance, thereby reducing the difference between the preceding and following UHD image frames. You can also compensate.

Thereafter, the formatting unit 240 sequentially receives raw data arranged in units of UHD image frames from the interpolation unit 260 and corresponds to left and right eyes according to the 3D format set in the format setting unit 220. UHD frames are arranged horizontally or vertically and converted into raw data for 3D image frames of a continuous glasses support method. In this case, the formatting unit 240 may classify a pair of UHD video frames synchronized in pairs based on the index information transmitted together with the raw data, and arrange a pair of UHD video frames in a 3D format to determine a frame of a 3D video. It can be configured as raw data.

In addition, the formatting unit 240 provides raw data arranged to correspond to the frame of the 3D image to the encoder / decoder 300, and the encoder / decoder unit 300 provides the raw for the frame of the 3D image. Data may be encoded using a predetermined coding scheme and stored in the high speed storage medium in real time, and may be immediately output to an external output device through the UHD output unit 310 in the case of real time broadcasting.

FIG. 6 is a diagram illustrating a second case in which real time processing such as broadcasting is required among glasses support methods through the external control or input.

When the second case is set in the format setting unit, the format setting unit 220 may activate the buffer unit 130.

The buffer unit 130 is connected to any one channel between the left and right eye image acquisition unit and the first channel unit 110 and the second channel unit 120 of the 3D input channel unit for the HD image provided by After temporarily storing a plurality of raw data, the raw data may be temporarily stored according to a request of the left and right eye image acquisition unit 210. In the following description, FIG. 5 illustrates a case in which the second channel unit is connected to the second channel unit, but it may be connected to the first channel unit.

First, the left and right eye image acquisition unit 210 may receive the raw data for the plurality of HD images corresponding to the left eye from the first channel unit 110 and then sort the raw data for the UHD image frame. As described above.

At this time, the left and right eye image acquisition unit 210 processes raw data for a plurality of HD image frames corresponding to the left eye, and at the same time, the buffer unit 130 moves from the second channel unit 120 to the right eye. The raw data of the corresponding plurality of HD video frames is received and temporarily stored.

Subsequently, when the left and right eye image acquisition unit 210 completes the processing of the raw data corresponding to the left eye, the raw data corresponding to the right eye is received from the buffer unit 130 and UHD like the raw data of the left eye. Arrange as raw data for video frames.

Meanwhile, in the process of arranging UHD image frames of the right eye corresponding to the left eye, raw data of a plurality of HD image frames corresponding to the left eye and the right eye at n + 1 view are provided from the 3D input channel unit 100. Since the left and right eye image acquisition unit 210 is arranging the raw data of the UHD image frame corresponding to the right eye, the data provided at n + 1 time point is ignored, and the buffer unit 130 also at the n + 1 time point. The data provided through the 3D input channel unit 100 is ignored.

Therefore, the left and right eye image acquisition unit 210 acquires and processes an image of n + 2 time point from the first channel unit 110 when the raw data arrangement for the UHD image frame at n time point is completed, and the buffer unit 130 may also temporarily store the raw data corresponding to the right eye at n + 2 and provide the left and right eye image acquisition units. That is, the left and right eye image acquisition unit 210 obtains raw data from each channel unit at a time interval of one frame.

In this second case, the method of arranging the raw data to correspond to the UHD image frame of the left and right eye image acquisition unit 210 may acquire the raw data of the left and right eyes photographed at the same time. The same processing of the interpolation unit 260 is not required. In addition, since it is the same time point, the left and right eye image acquisition unit 210 may arrange the raw data by synchronizing based on the time information included in the raw data of each HD image transmitted from each channel unit. The raw data of the UHD image frame may also be synchronized based on the time information so as to correspond to.

Then, the left and right eye image acquisition unit 210 sequentially transmits the raw data for the UHD image frame to the formatting unit 240, the formatting unit 240 of the left and right eyes based on the time information The UHD image frame is arranged as raw data for the 3D image frame according to the 3D format set in the format setting unit 220 as in the first case.

Subsequently, the encoder / decoder 300 receives and processes the raw data of the 3D image in the same manner as in the first case, but acquires the image of the left and right eyes at the same time in the second case. Since the processing process of the interpolation unit 260 can be excluded, the delay according to the preprocessing process of the preprocessor 200 can be minimized so that the 3D image can be output in real time.

FIG. 7 illustrates a case in which a 3D format corresponding to an autostereoscopic method, such as a lenticular method, is set in the format setting unit 220, and the format setting unit 220 performs the buffer according to the 3D format for the autostereoscopic method. The unit 130, the 3D frame extractor 250, and the interpolator 260 may be activated.

In this case, the left and right eye image acquisition unit 210 acquires raw data sequentially from the first channel unit 110 and the buffer unit 130, as in the second case, and UHD images corresponding to the left and right eyes, respectively. Arrange the raw data to form a frame. At this time, as described above, it is obvious that the first channel unit 110 is connected to the buffer unit 130 so that raw data corresponding to the right eye may be first received and processed.

Thereafter, the left and right eye image acquisition unit 210 provides the 3D frame extraction unit 250 with raw data of the UHD image frame corresponding to the left and right eyes as in the second case.

The 3D frame extractor 250 extracts a part of the raw data of the UHD image frame according to a predetermined line or pixel for the UHD image frame of the left eye and the right eye, respectively, based on the setting of the format setting unit 220. . In this case, the 3D frame extractor 250 when the pair of UHD image frames corresponding to the left eye and the right eye combine to form one 3D image frame to correspond to the lenticular method which is a 3D format. The raw data of the UHD image frames of the left and right eyes may be extracted at predetermined array intervals such that the raw data of the UHD image frames of the left and right eyes may be alternately arranged in a horizontal or vertical array.

Thereafter, the interpolator 260 obtains the raw data extracted from the 3D frame extractor 250 and then selects overlapping or boundary pixels or line values among the raw data for the UHD image data of the left and right eyes. Compensate for the difference so that high quality images can be obtained.

In this case, the left and right eye image acquisition unit 210 may acquire an image alternately without the buffer unit 130 as in the 3D format of the first case of the eyeglass support scheme, but using the reception method of the second case. When the left and right eye image acquisition unit 210 receives the raw data as in case 1, the interpolator 260 not only detects the difference generated between the 3D frame extractor 250 but also the difference between the left and right eye frames. The delay due to interpolation is too long to compensate for the dual processing process, which is not suitable for the rapid processing and real-time support of the preprocessing unit, which is the object of the present invention. It is preferable to reduce the processing load of 260.

In addition, since some of the raw data of the left eye and the right eye are extracted at predetermined intervals, it is difficult to determine the standard, which may complicate the processing of the interpolator 260. It is preferable to use the same reception method as the case.

Meanwhile, the interpolator 260 transmits the interpolated UHD image frames of the left eye and the right eye to the formatting unit 240.

Subsequently, the formatting unit 240 may extract raw data of the UHD image frame of the left eye and the extracted UHD image frame of the right eye, based on the time information of the UHD image frames of the left and right eyes received from the interpolator 260. The raw data may be arranged to form a 3D image frame according to the autostereoscopic support method set in the format setting unit 220.

Thereafter, the formatting unit 240 provides the encoder / decoder unit 300 with raw data for the 3D image frame as described above, and the encoder / decoder unit 300 provides the raw data for the 3D image frame. Data may be coded and stored in the fast storage medium 400 or output through the UHD output unit 310. Like the second case, the 3D format of the glasses-free assisting method may support real-time output by minimizing interpolation of the interpolator 260.

Meanwhile, although the above-described real-time 3D formatting module for ultra-high definition images has been described based on 4K UHD, the real-time 3D formatting system for ultra-high definition images according to the present invention interconnected after configuring a plurality of the real-time 3D formatting modules is 8K. Similarly to the above-mentioned 3D formatting of 4K UHD video, the UHD video quality or higher can be processed.

8, the real-time 3D formatting module 10 may be configured in four, and each real-time 3D formatting module 10 may be a network interface card (NIC) to process 8K UHD video. It may further include a NIC, to be connected to an external network such as a LAN through the NIC to control signal exchange between the real-time 3D formatting module.

In this case, each of the real-time 3D formatting module 10 may be directly connected to a storage medium except for the configuration of the encoder / decoder, and the integrated coding unit 20 corresponding to the encoder / decoder is connected to the LAN. Four real-time 3D formatting modules 10 may be connected.

Accordingly, the preprocessor included in each of the plurality of real-time 3D formatting modules 10 may store raw data for a 3D image frame in the fast storage medium according to a predetermined 3D format as described above. ) Acquires only the portion corresponding to the left eye frame of the raw data array of the 3D image frame from each module 10 through the LAN to arrange four raw data of the 4K UHD image frame to correspond to the 8K UHD image frame of the left eye. After coding, it may be output to the outside or stored in a separate fast storage means 30.

In this case, the high speed storage means 40 may include an E-IDE type hard disk drive (HDD) or a solid state disk (SSD) like the high speed storage medium.

Thereafter, the integrated coding unit 20 obtains a right eye frame portion paired with the left eye of the 3D image frame from each module 10 through a LAN to correspond to 8K UHD image frames of the right eye as described above. Arrange and code the raw data for the 4K UHD image frame of the 4K UHD image frame after the 8K UHD image frame of the left eye, or store it in the fast storage means 30 to output a 3D image to the output unit 40 or the high speed storage. May be stored in the means 30.

At this time, each module 10 may synchronize the frame and the 3D format set in the format setting unit by exchanging control signals with other modules through the NIC.

That is, one of the modules 10 may be set as a master, and the preprocessor included in the master module may be set to integrate and manage the preprocessors of the remaining modules corresponding to the slaves based on a user input.

9, FIG. 9 is a diagram illustrating a synchronization process according to master and slave settings of a real-time 3D formatting system using a real-time 3D formatting module for ultra-high definition images according to the present invention. The module will split and process it into four 4K UHD.

In this case, even if the video signal reception time of the module 1 corresponding to the master is delayed compared to other modules, since the input / output module 1 is a module corresponding to the master, the preprocessor of the module 1 may arbitrarily determine the synchronization time.

Accordingly, the module 1 determines the synchronization time point as n, and transmits it to the modules 2, 3, and 4 corresponding to the slaves through the LAN connected with the NIC as a control signal. In this case, the preprocessor of the module 1 may transmit information about the 3D format set in the format setting unit of the module 1 in the control signal to match the 3D format.

Meanwhile, the preprocessors of the modules 2, 3, and 4 receive the control signal through the NIC connected to the LAN, and then arrange the raw data of the 4K UHD image frames of the left and right eyes based on the control signal to generate the 3D video frame. When converting to the raw data, the synchronization time point is set to n, and the raw data of the 4K UHD video frame is arranged and converted into the raw data of the 3D video frame so as to correspond to the 3D format of the master module 1.

Thereafter, the raw data inputted to each module also periodically transmits a control signal for synchronization time and 3D format to slave modules 2, 3, and 4 via the NIC and LAN, sequentially in stream form. Can be stored in a high speed storage medium included in the module.

Meanwhile, the integrated coding unit divides the raw data array of the 3D image frame stored in each module into 4K UHD image frame units and selectively extracts and codes 4K UHD image frames of the left and right eyes, thereby encoding 8K UHD for each of the left and right eyes. An image frame is generated and output.

As such, when four or more real-time 3D formatting modules are configured, not only the above-described 8K UHD image but also the ultra-high definition image therein may be easily supported to output the 3D image.

10: real time 3D formatting module 20: integrated coding unit
30: fast storage means 40: output unit
100: 3D input channel unit 110: first channel unit
120: second channel unit 130: buffer unit
200: preprocessor 210: left and right eye image acquisition unit
220: format setting unit 230: synchronization unit
240: formatting unit 250: 3D frame extraction unit
260: interpolation unit 300: encoder / decoder unit
310: UHD output unit 400: storage medium

Claims (12)

A 3D input channel section comprising a first channel section corresponding to the left eye and a second channel section corresponding to the right eye, which divides and receives UHD video into law data corresponding to four HD video frames through each channel section. ;
In accordance with a predetermined 3D format, the individual HD image provided by each channel unit of the 3D input channel unit is selectively received according to the 3D format, and the synchronization with each raw data is checked, and the selectively received raw data according to the 3D format is checked. A preprocessing unit arranged to provide raw data for a 3D image;
An encoder / decoder for encoding or decoding raw data for 3D video arranged through the preprocessor in a predetermined manner; And
High speed storage medium for storing and providing 3D video encoded by the encoder / decoder
Real time 3D formatting module for ultra-high definition images comprising a.
The method according to claim 1,
It further includes a UHD output unit for outputting a 3D UHD image to an external output device,
The encoder / decoder outputs the raw data for the 3D image through the UHD output unit, or decodes an encoded 3D image from a high speed storage medium and outputs the encoded 3D image through the UHD output unit. module.
The method according to claim 1,
The high speed storage medium includes an E-IDE type hard disk drive (HDD) or a solid state disk (SSD).
The method according to claim 1,
The preprocessing unit
A synchronization unit for providing a clock signal for synchronization;
A format setting unit in which the 3D format sets one of one or more 3D formats according to external control or setting;
Arrange the UHD image frames of the left and right eyes while synchronizing the raw data provided by the respective channel units based on the clock signal of the synchronizer, and the raw data provided from each channel unit according to the 3D format of the format setting unit. Left and right eye image acquisition unit for changing the reception method for; And
Formatting unit for converting the raw data constituting the synchronized left and right UHD image frames provided by the left and right eye image acquisition unit according to the 3D format of the format setting unit to convert the raw data for the 3D image
Real-time 3D formatting module for ultra-high definition images, including.
The method of claim 4,
When the 3D format is a format for watching through glasses
The left and right eye image acquisition unit alternately receives raw data provided by each channel unit in units of UHD image frames,
An interpolation unit for receiving the raw data constituting the synchronized UHD image frames of the left and right eyes from the left and right eye image acquisition units, and interpolating a difference in pixels or lines between the raw data constituting the UHD image frames of the left and right eyes Including more,
The formatting unit arranges the interpolated raw data constituting the UHD image frames of the left eye and the right eye horizontally or vertically according to the 3D format and converts the raw data into the raw data for the 3D image. Formatting module.
The method of claim 4,
When the 3D format is a format for watching through glasses
Further comprising a buffer connected to any one of the first channel portion and the second channel portion,
The left and right eye image acquisition unit directly receives raw data from any one of the first channel unit and the second channel unit, arranges to configure a first UHD image frame, and receives raw data provided from the buffer unit. A second UHD video frame, and synchronizing the raw data constituting the first UHD video frame and the second UHD video frame based on a clock signal of the synchronization unit and time information of the raw data. Real-time 3D formatting module for high quality images.
The method of claim 4,
When the 3D format preset in the format setting unit is a lenticular method
The left and right eye image acquisition unit generates raw data constituting third and fourth UHD image frames by receiving raw data in units of UHD frames from the respective channel units.
A 3D frame extracting unit configured to extract raw data included in array units having a predetermined interval for each of the raw data constituting the synchronized third and fourth UHD image frames; And
An interpolation unit further interpolates pixels or lines that are adjacent to each other among the raw data constituting the extracted third and fourth UHD image frames.
The formatting unit combines the raw data constituting the third and fourth UHD image frames interpolated from the interpolation unit to generate the raw data for the 3D image.
Real time 3D formatting module for ultra-high definition images, further comprising.
The method according to any one of claims 5 to 7,
And the format setting unit activates at least one of the buffer unit, interpolation unit, and 3D frame extracting unit according to the 3D format of the format setting unit.
The method according to claim 1,
The encoder / decoder may store the interleaved, non-interleaved, screen size, storage location of audio information, or a video compression format in at least one of the high speed storage media. Real-time 3D formatting module for ultra high definition images.
Includes a plurality of modules connected via a LAN to form a network,
Each module above
A network interface card (NIC) supporting a network connection with another module through the LAN;
A 3D input channel unit including a plurality of channel units corresponding to the left eye and the right eye, and receiving 4K UHD images as raw data divided into a plurality of HD images through each channel unit;
A synchronization unit for generating a synchronization clock signal;
In accordance with the 3D format set according to an external control or input, the individual HD image provided by each channel unit of the 3D input channel unit is selectively received according to the 3D format, and the synchronization with each raw data is checked, and according to the 3D format, A preprocessor configured to arrange the received raw data to provide raw data for a 3D image;
High-speed storage medium for storing the raw data for the 3D image provided by the preprocessor
Including,
An integrated coding unit which extracts the raw data in units of 4K UHD video frames from the 3D video raw data stored in the high-speed storage media of each module, arranges the raw data to form 8K UHD video frames of the left and right eyes, and then codes or outputs the raw data.
Real-time 3D formatting system using a real-time 3D formatting module for ultra-high definition images further comprising.
The method according to claim 10,
The preprocessor may set the master or slave of the module,
The preprocessor of the module set as the master among the modules determines a synchronization time point and controls the preprocessing of other modules set as slaves through the NIC to synchronize the raw data received by each module. Real-time 3D formatting system using real-time 3D formatting module.
The method of claim 11,
The preprocessor set as a master among the modules may transmit the information about the 3D format to the preprocessor of the module set as the slave through the NIC, and the preprocessor is generated by arranging the synchronized raw data according to the received 3D format. Real-time 3D formatting system using a real-time 3D formatting module for ultra-high definition images, characterized in that the raw data for the 3D image is stored in the high-speed storage medium.

Images