KR101660910B1 - Apparatus and method for processing image data - Google Patents

Abstract

The present invention relates to an image data processing apparatus and method for generating stereoscopic image data from plane spirituality data.
To this end, the broadcasting signal of the monoscopic image data received through the broadcasting network is copied to generate the left monoscopic image data and the right monoscopic image data. And inputting one or two pieces of declination data corresponding to at least one image frame among a plurality of image frames constituting the received monoscopic image data, The phase of one or all of the image frames of at least one of the left image frames constituting the monoscopic image data and the right image frames of the right image frames constituting the right monoscopic image data . The left image frame and the right image frame in which the phases are shifted are stored in different recording areas, and the stored left and right image frames are synthesized to generate stereoscopic image data.

Description

[0001] APPARATUS AND METHOD FOR PROCESSING IMAGE DATA [0002]

The present invention relates to an image data processing apparatus and method, and more particularly, to an image data processing apparatus and method for generating stereoscopic image data.

The development of video and broadcasting technology has been transformed from monoscopic image service, which is a flat image, to stereoscopic image service, which is a stereoscopic image. In order to provide the stereoscopic image service, the image data is generally produced as a stereoscopic image. That is, the same subject is photographed at different viewpoints to produce a stereoscopic image including a left image and a right image.

The stereoscopic image by the above-described method has a good image quality such as a three-dimensional image, but requires about twice the amount of data as compared with the monoscopic image. Therefore, in order to provide a monoscopic image service at the same time as monochrome image data, it is necessary to transmit monoscopic image data in addition to the amount of transmission data as much as that for a stereoscopic image service.

In addition, in order to produce a stereoscopic image, a large amount of manufacturing cost is required as compared with the case of producing a monoscopic image, which is a stumbling block to the use of the stereoscopic image service.

Therefore, in consideration of the above-mentioned points, there is a desperate need to provide a method for providing stereoscopic image service while maximizing overload due to transmission data at low cost.

The present invention proposes an apparatus and method for converting a monoscopic image received through a broadcasting network into a stereoscopic image.

In addition, the present invention proposes an apparatus and method for converting a monoscopic image received through a broadcasting network to stereoscopic images using declination data.

Further, the present invention replicates the left and right monoscopic image data from the monoscopic image data received through the broadcasting network, and uses the declination data to determine the phase of at least one monoscopic image data among the left and right monoscopic image data And generating a stereoscopic image by moving the image data.

Further, the present invention replicates the upper and lower monoscopic image data from the monoscopic image data received through the broadcasting network, and uses the declination data to determine the phase of at least one of the upper and lower monoscopic image data, And generating a stereoscopic image by moving the image data.

Also, the present invention proposes a video data conversion apparatus and method for setting deconvolution data to be used for converting a monoscopic video received through a broadcasting network into a stereoscopic video in consideration of characteristics of video data.

The present invention also provides a video data conversion apparatus and method for receiving deconvolution data to be used for converting a monoscopic video received through a broadcasting network into a stereoscopic video through a broadcasting network together with monoscopic video data.

According to another aspect of the present invention, there is provided an apparatus and method for generating a stereoscopic image by generating a duplicate image frame for each image frame constituting monoscopic image data received through a broadcasting network and then applying different declining angles to each of the two image frames to generate a stereoscopic image. And method.

In the present invention, a left image frame and a right frame generated for each image frame constituting the monoscopic image data received through the broadcasting network are moved using different declination data, and then synthesized into one image frame to generate a stereoscopic image An image data conversion apparatus and method for generating an image frame of data.

The image data conversion apparatus for converting the monoscopic image data into the stereoscopic image data according to the embodiment of the present invention replicates the broadcast signal of the monoscopic image data received through the broadcasting network to generate the first monoscopic image data and the second monoscopic image data, A monocropic image data generating unit that generates monoscopic image data based on the received monocropy image data and generates monoscopic image data based on the input monochrome image data; Or at least one of the first image frame of the first image frames constituting the first monoscopic image data and the second image frames constituting the second monoscopic image data based on the two declination data, The phase of one or all image frames of the second image frame of < RTI ID = 0.0 > A recording medium for storing a first image frame and a second image frame output from the shift unit in different recording areas, and a first image frame and a second image frame stored in the recording medium, And a synthesizer for generating image data,
Wherein the declination data includes left declination data for the first image data and right declination data for the second image data or upper declination data for the first image data and lower declination data for the second image data And the left / right declination angle data or the upper / lower angle declination angle data are provided through the broadcasting network together with the monoscopic image data.

The image data conversion method for converting monoscopic image data into stereoscopic image data according to an embodiment of the present invention includes the steps of reproducing the monoscopic image data received through the broadcasting network by replicating the broadcasting signal of the monoscopic image data, 2 monoscopic image data; inputting one or two deconvolution data corresponding to at least one image frame among a plurality of image frames constituting the received monoscopic image data; Or at least one of the first image frame of the first image frames constituting the first monoscopic image data and the second image frames constituting the second monoscopic image data based on the two declination data, The phase of one or all image frames of the second image frame of Storing the first image frame and the second image frame output by the phase shifting process, and generating stereoscopic image data by synthesizing the stored first image frame and the second image frame ≪ / RTI >
Here, the declination data may include left declination data for the first image data and right declination data for the second image data, or may include upper declination data for the first image data and lower declination data for the second image data, And the left / right declination angle data or the upper / lower angle declination angle data is provided through the broadcasting network together with the monoscopic image data.

In the embodiment of the present invention, it is possible to reduce the data transmission amount of the broadcasting network by converting the monoscopic image into the stereoscopic image using the declination data in the reception apparatus of the broadcasting data. In addition, the consumer can view the stereoscopic image without purchasing a separate receiving device to view the stereoscopic image.

Meanwhile, various other effects will be directly or implicitly disclosed in the detailed description according to the embodiment of the present invention to be described later.

1 is a block diagram illustrating a configuration of a video data conversion apparatus according to an embodiment of the present invention;
FIG. 2 illustrates a control flow for converting a monoscopic image into a stereoscopic image according to an embodiment of the present invention; FIG.
FIG. 3 is a diagram showing changes in the frame structure of 2D data and 3D data within a predetermined interval (1 second) according to an embodiment of the present invention; FIG.
FIG. 4 illustrates a left image frame and a right image frame generated through phase correction according to an embodiment of the present invention; FIG.
5 is a diagram illustrating an upper image frame and a lower image frame generated through phase correction according to an embodiment of the present invention;

In the following description of the present invention, a detailed description of known functions and configurations incorporated herein will be omitted when it may make the subject matter of the present invention rather unclear. The following terms are defined in consideration of the functions of the present invention, and these may be changed according to the intention of the user, the operator, or the like. Therefore, the definition should be based on the contents throughout this specification.

In an embodiment of the present invention to be described later, a video data conversion apparatus and method for providing a method of converting monoscopic video data to stereoscopic video data using declination data will be proposed.

For this purpose, the definition of declination data and a method for providing the declination data will be described in detail. Then, the monoscopic image data is copied to generate a plurality of monoscopic image data, and the phases of the plurality of monoscopic image data are changed to different angles. That is, the deconvolution data is used to generate image data at different viewpoints from the monoscopic image data. Then, the stereoscopic image data is synthesized by combining the image data at the different viewpoints and reproduced, thereby allowing the viewer to view the 3D image.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. It is to be noted that, in the drawings for describing the present invention, the same constituent elements are denoted by the same reference numerals and signs as possible even if they are shown in different drawings.

1 shows a configuration of a video data conversion apparatus according to an embodiment of the present invention. Here, the image data conversion device is a device for converting monoscopic image data into stereoscopic image data.

Referring to FIG. 1, the receiving unit 110 receives monoscopic image data from outside, that is, 2D image data, and outputs the input monoscopic image data through a predetermined processing operation.

For example, when the image data conversion apparatus proposed in the present invention is implemented in a television (TV) or a set-top box (STB), the receiver 110 may include a tuner and can be a tuner. At this time, the monoscopic image data received by the receiving unit 110 means a stream of video frames. Normally, in the case of monoscopic image data, there are 24 image frames within one second.

As another example, when the monoscopic image data is provided from an external image reproducing apparatus or a recording apparatus, the receiving unit 110 may be an interface apparatus capable of sharing information with an external apparatus.

The copying unit 120 receives the monoscopic image data transmitted through the receiving unit 110 and replicates the monoscopic image data input from the receiving unit 110 to generate two monoscopic image data. At this time, it is assumed that the two monoscopic image data generated by the copying unit 120 are basically completely the same. That is, when naming the two monoscopic image data as the left monoscopic image data and the right monoscopic image data or the upper monoscopic image data and the lower monoscopic image data, the left monoscopic image data and the right monoscopic image data or the upper mono-scopic image data, It is assumed that the scopic image data and the lower monoscopic image data are completely the same in units of image frames.

For convenience of explanation, the left monoscopic image data or the upper monoscopic image data will be referred to as a first monoscopic image data, and the right monoscopic image data or the lower monoscopic image data will be referred to as a second monoscopic image data do.

Accordingly, the copying unit 120 may perform the copying in units of image frames constituting the monoscopic image data input from the receiving unit 110. The original image frame is output as a first monoscopic image frame, and the duplicated image frame is output as a second monoscopic image frame. But the reverse is also possible.

The use of the terms first monoscopic image frame and second monoscopic image frame here will be used in the future for the left monoscopic image frame to generate the left image frame of the stereoscopic image data, And will be used to generate the right image frame of the stereoscopic image data. And the upper monoscopic image frame will be used to generate the upper image frame of the stereoscopic image data and the lower monoscopic image frame will be used to generate the lower image frame of the stereoscopic image data.

The receiving unit 110 may output the received monoscopic image data in units of image frames or a group of image frames corresponding to a predetermined number of image frames. This is for the purpose of quickly reproducing the monoscopic image data by the copying unit 120. [

The shifting unit 130 sequentially receives the first monoscopic image frame and the second monoscopic image frame from the copying unit 120. Of course, the first monoscopic image frame and the second monoscopic image frame may be input into the first monoscopic image frame group and the second monoscopic image frame group, which are a predetermined number of bundles. And may be input as first monoscopic image data composed of the first monoscopic image frames and second monoscopic image data composed of the second monoscopic image frames. In this case, the shifting unit 130 may extract the first monoscopic image frame and the second monoscopic image frame from the first monoscopic image data and the second monoscopic image data, and process the extracted first monoscopic image frame and the second monoscopic image frame.

The shifting unit 130 corrects at least one of the first monoscopic image frame and the second monoscopic image frame. At this time, the correction for the at least one image frame is to correct the phase of the target image frame. The phase can be corrected by shifting the target image frame to the left or right by a predetermined distance or by shifting the target image frame upward or downward by a predetermined distance. At this time, shifting the phase of the target image frame corresponds to shifting the position of each pixel constituting the target image frame. Moving the position may move the coordinate where the pixel is located to another coordinate.

In the embodiment of the present invention, declination data provided from the outside is used to correct the phase. That is, the declination angle data is used as information for determining the distance for moving the target image frame to the left or right or moving the target image frame to the upper or lower side.

For example, if the target image frame to be corrected is the first monoscopic image frame, the declination data is information for shifting (or -) shifting the first monoscopic image frame to the left or the upper side. Also, if the target image frame to be corrected for the phase is the second monoscopic image frame, the declination data is information for shifting (or shifting) the corresponding second monoscopic image frame to the right or the lower side.

However, if the phase correction is applied to both the first monoscopic image frame and the second monoscopic image frame, the declination data shifts (-) the corresponding first monoscopic image frame to the left or the upper side, (+) Shift of the second monoscopic image frame to the right or the lower side. That is, the declination data may be one or two according to the target image frame for compensating the phase.

Unlike the example described above, the declination data is information for shifting (-) the first monoscopic image frame to the left or the upper side according to the operation of the system, and the second monoscopic image frame is displayed on the right or lower side (+) Shift of the data to be transmitted.

Accordingly, the shifting unit 130 moves the phase of the first monoscopic image frame, the second monoscopic image frame, or the first and second monoscopic image frames according to declination data provided from the outside .

FIG. 4 shows an example of a left image frame and a right image frame generated from a monoscopic image frame according to an embodiment of the present invention.

4, the phase of the monoscopic image frame a is shifted to the left to generate the left image frame b, the phase of the monoscopic image frame a is shifted to the right, (c). That is, the left image frame is generated by moving the viewpoint corresponding to the monoscopic image frame to the left. Then, the right image frame is generated by moving the view corresponding to the monoscopic image frame to the right side.

FIG. 5 shows an example of an upper image frame and a lower image frame generated from a monoscopic image frame according to an embodiment of the present invention.

5, the phase of the monoscopic image frame a is shifted upward to generate the upper image frame b, the phase of the monoscopic image frame a is shifted to the lower side, (c). The upper image frame is generated by moving the viewpoint corresponding to the monoscopic image frame upward. Then, the lower image frame is generated by moving the viewpoint corresponding to the monoscopic image frame downward.

On the other hand, the declination angle data can be changed in a predetermined cycle. For example, the declination angle data may be changed for each image frame to be phase-corrected or may be changed to a predetermined image frame group unit (for example, 24 frames existing within one second). Preferably, the declination data is changed as the characteristics of the image by the monoscopic image data are changed. This is because it is possible to obtain an improved characteristic of the stereoscopic image by changing the angle of declination between the left image and the right image or between the upper image and the lower image according to the characteristics of the image such as the motion speed and depth of the screen.

The declination data may be provided from a supplier of the monoscopic image data through a broadcasting network or may be provided from a separate memory table storing optimal declination data predicted for each image characteristic. The memory table may be provided not only in an internal memory but also in an apparatus connectable to an external input terminal such as a USB or a LAN port.

Assuming that the declination angle data is provided from a separate memory table, it is necessary to provide a configuration for analyzing the image characteristics of the monoscopic image frame to be corrected. And a configuration for acquiring declination data corresponding to the analyzed characteristic of the image from the memory table. A separate configuration for performing the corresponding function may be additionally provided or the corresponding function may be additionally performed in the receiving unit 110 or the copying unit 120 or the shifting unit 130. [

The shift unit 130 may include two shift units, that is, a first shift unit and a second shift unit. The first shifting unit shifts the phase of one of the first monoscopic image frame and the second monoscopic image frame using declination angle data. And the second shifting unit shifts the phase of the remaining one of the first monoscopic image frame and the second monoscopic image frame using the declination angle data.

The operations of the first and second shift units constituting the shift unit 130 may be restricted depending on the types of image frames to be phase-corrected. For example, when only the phase of the first monoscopic image frame is desired to be corrected, only the first shift section is operated, and when only the phase of the second monoscopic image frame is to be corrected, only the second shift section is operated.

The shift unit 130 outputs the first image frame and the second image frame, which are phase-corrected by the declination data. As described above, at least one of the first image frame and the second image frame output by the shifting unit 130 may be phase-corrected.

The storage medium 140 may store most of the information that can be stored in the memory. The first image frame and the second image frame output from the shift unit 130 are separately stored. At least one of the first image frame and the second image frame output from the shift unit 130 is a phase-corrected image frame.

Accordingly, the storage medium 140 allocates the first recording area and the second recording area as separate recording areas for accumulating the first image frame and the second image frame output from the shifter 130 . In the first recording area, first image frames outputted from the shifting unit 130 are accumulated and stored, and second image frames outputted from the shifting unit 130 are accumulated and stored in the second recording area .

The storage medium 140 sequentially outputs the stored first and second image frames. At this time, the first image frame and the second image frame are synchronously outputted from the storage medium 140. [ The storage medium 140 deletes the first image frame and the second image frame from which the output image has been output.

The combining unit 150 combines the first image frame and the second image frame output from the recording medium 140 to generate one stereoscopic image frame for the stereoscopic image. The method of generating one stereoscopic image frame by combining the first image frame and the second image frame may be variously provided.

For example, a stereoscopic image frame can be generated by arranging the first image frame and the second image frame at an intersection in a predetermined period (for one second). In this case, the number of stereoscopic image frames (for example, 48) in a predetermined period (1 second) corresponds to twice the number of monoscopic image frames (for example, 24) as shown in FIG. Therefore, at the same time, the reproduction speed by the stereoscopic image frame should be twice as fast as the reproduction speed of the monoscopic image frame. That is, it is necessary to be able to reproduce 48 video frames in a predetermined interval (1 second).

As another example, a method of generating a stereoscopic image frame by superposing the synchronized first and second image frames into one image frame may be provided. In this case, the number of newly generated stereoscopic image frames is equal to the number of monoscopic image frames corresponding to the original. However, in the stereoscopic image frame, the image by the monoscopic image frame is not preserved.

The stereoscopic image frame output by the synthesizer 150 is transmitted to a display device such as a television and reproduced so as to be viewable by a viewer. Viewers can view 3D images by using special glasses or special filters as needed.

FIG. 2 shows a control flow for converting a monoscopic image into a stereoscopic image according to an embodiment of the present invention.

Referring to FIG. 2, the apparatus for converting image data receives monoscopic image data from a broadcasting network or an external apparatus in operation 210.

Upon receipt of the monoscopic image data, the image data conversion apparatus determines in step 212 whether image data conversion is requested. The image data conversion request may be directly performed by a viewer or may be determined by providing declination data necessary for image data conversion. If the data conversion request is not received by the viewer even if the declination data exists, the image data conversion device regards that the conversion request is not accepted.

However, the image data conversion apparatus performs conversion processing on the image data when the declination data exists, and when the data conversion request is not accepted by the viewer, the image data conversion apparatus does not output the image data generated as a result of the data conversion operation It is possible. That is, the present invention can be proposed as a method for promptly providing the converted stereoscopic image at the request of the viewer.

If it is determined that a conversion request has been received, the image data conversion apparatus generates first monoscopic image data and second monoscopic image data through copying of the received monoscopic image data in step 214. [ The first monoscopic image data and the second monoscopic image data may be generated by copying in units of image frames constituting the received monoscopic image data.

Then, the image data conversion apparatus performs a procedure for generating a first image frame (steps 216 and 218) and a procedure for generating a second image frame (steps 220 and 222) separately. According to an embodiment of the present invention, declination data is required to perform the above two procedures, and the process of receiving the declination data is omitted in FIG. However, a process of receiving the declination angle data together with the monoscopic image data or acquiring the declination angle data from a separate memory table is indispensable, and the process can be performed in any process before actual image data conversion is performed.

First, in step 216, the image data conversion apparatus corrects the phase of the first monoscopic image frame using the angle of declination set by the declination data previously provided. That is, the coordinates of the pixels constituting the first monoscopic image frame are shifted to the coordinates determined in consideration of the set angle. Accordingly, the screen according to the first monoscopic image frame will move to the left or right as a whole through step 216. [

In step 218, the image data conversion apparatus stores the first image frame. The first image frame corresponds to the left monoscopic image frame or the upper monoscopic image frame in which the phase correction is performed in step 216. [

Next, in step 220, the image data conversion apparatus corrects the phase of the second monoscopic image frame using the angle of declination set by the declination data previously provided. That is, the coordinates of the pixels constituting the second monoscopic image frame are shifted to the coordinates determined in consideration of the set declination angle. Accordingly, the screen according to the second monoscopic image frame will be moved to the left or right as a whole through step 220.

In step 222, the image data conversion apparatus stores the second image frame. Here, the second image frame corresponds to the right mono-scopic image frame or the lower mono-scopic image frame in which the phase correction is performed in step 220. [

However, both the procedure for generating the first video frame and the procedure for generating the second video frame need not necessarily be performed. In other words, it may be performed only for an image frame requiring phase shift by declination. For example, if phase correction is required for only the first monoscopic image frame, only steps 216 and 218 may be performed, and steps 220 and 222 may not be performed.

In step 224, the image frame converter generates a stereoscopic image frame by combining the first and second image frames stored in steps 218 and 222, respectively. The method of generating the stereoscopic image frame may include a method of arranging the left / right image frame or the upper / lower image frame at an intersection and a method of superimposing the left / right image frame or the upper / lower image frame.

The generated stereoscopic image frame is provided to a display device so that a 3D image can be reproduced.

If it is determined that the request to convert the image data is not accepted, the image data conversion apparatus outputs the received monoscopic image data as it is in step 226. [ Therefore, the viewer views the 2D image.

The operation not specifically disclosed in the description with reference to FIG. 2 can be applied to the operation according to the configuration of the image data conversion apparatus shown in FIG.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments, but is capable of various modifications within the scope of the invention. Therefore, the scope of the present invention should not be limited by the illustrated embodiments, but should be determined by the scope of the appended claims and equivalents thereof.

Claims (16)

An image data conversion apparatus for converting monoscopic image data into stereoscopic image data,
A duplicating unit for duplicating the broadcast signal of the monoscopic image data received through the broadcasting network to generate first monoscopic image data and second monoscopic image data,
Wherein one or two pieces of declination data corresponding to at least one image frame among a plurality of image frames constituting the received monoscopic image data are inputted and the first and second declination data Wherein at least one of the first image frames of the first image frames constituting the monoscopic image data and the second image frames of the second image frames constituting the second monoscopic image data, A shift section for shifting the phase of the phase shifter,
A recording medium storing a first image frame and a second image frame output from the shift unit in different recording areas,
And a synthesizer for synthesizing the first image frame and the second image frame stored in the recording medium to generate stereoscopic image data,
Wherein the declination data includes left declination data for the first image data and right declination data for the second image data or upper declination data for the first image data and lower declination data for the second image data and,
Wherein the left / right declination angle data or the upper / lower angle declination data is provided through the broadcast network together with the monoscopic image data. delete delete delete The method according to claim 1,
And a declination angle data table for storing the left / right declination angle data or the upper / lower declination angle data according to the image characteristics of the image frame constituting the monoscopic image data,
Wherein the left / right declination data or the upper / lower declination angle data corresponding to the plurality of image frames constituting the received monoscopic image data is provided from the declination angle data table to the shift unit. The apparatus according to claim 1,
A first shifting unit for shifting the phase of at least one first image frame among the first image frames constituting the first monoscopic image data by the left or upper declining angle data;
And a second shifting unit for shifting the phase of at least one second image frame among the second image frames constituting the second monoscopic image data by the right or lower declination angle data. 7. The image processing apparatus according to claim 6,
The first image frame and the second image frame are arranged at an intersection within one second to generate stereoscopic image data composed of image frames twice as many as the number of image frames constituting the received monoscopic image data Wherein the video data conversion device is a video data conversion device. 7. The image processing apparatus according to claim 6,
At the same time, the first image frame and the second image frame are overlapped with one image frame to generate stereoscopic image data composed of the same number of composite frames as the number of image frames constituting the received monoscopic image data And a video data conversion unit for converting the video data into video data. A video data conversion method for converting monoscopic video data into stereoscopic video data,
Generating first monoscopic image data and second monoscopic image data by replicating a broadcast signal of monoscopic image data received through a broadcasting network,
Wherein one or two pieces of declination data corresponding to at least one image frame among a plurality of image frames constituting the received monoscopic image data are inputted and the first and second declination data Wherein at least one of the first image frames of the first image frames constituting the monoscopic image data and the second image frames of the second image frames constituting the second monoscopic image data, Moving the phase of the phase-
Storing a first image frame and a second image frame output by the phase shifting process;
And generating stereoscopic image data by synthesizing the stored first image frame and the second image frame,
Here, the declination data may include left declination data for the first image data and right declination data for the second image data, or may include upper declination data for the first image data and lower declination data for the second image data, Including,
Wherein the left / right declination angle data or the upper / lower angle declination angle data is provided through the broadcasting network together with the monoscopic image data. delete delete delete 10. The method of claim 9,
The method of claim 1, further comprising: storing left / right declination data or upper / lower declination angle data in a declination angle data table according to an image characteristic of an image frame constituting monoscopic image data; And outputting the left / right declination angle data or the upper / lower declination angle data from the declination angle data table. 10. The method of claim 9,
Moving the phase of at least one first image frame among the first image frames constituting the first monoscopic image data by the left or upper declination angle data;
And shifting the phase of at least one second image frame among the second image frames constituting the second monoscopic image data by the right or lower declination angle data. 15. The method of claim 14, wherein the step of generating the stereoscopic image data comprises:
The first image frame and the second image frame are arranged at an intersection within one second to generate stereoscopic image data composed of image frames twice as many as the number of image frames constituting the received monoscopic image data And converting the image data into an image data. 15. The method of claim 14, wherein the step of generating the stereoscopic image data comprises:
At the same time, the first image frame and the second image frame are superimposed as one image frame to generate stereoscopic image data composed of the same number of composite frames as the number of image frames constituting the received monoscopic image data And converting the image data into an image data.

Images