KR101433082B1 - Video conversing and reproducing method to provide medium feeling of two-dimensional video and three-dimensional video - Google Patents

Video conversing and reproducing method to provide medium feeling of two-dimensional video and three-dimensional video Download PDF

Info

Publication number
KR101433082B1
KR101433082B1 KR1020130091906A KR20130091906A KR101433082B1 KR 101433082 B1 KR101433082 B1 KR 101433082B1 KR 1020130091906 A KR1020130091906 A KR 1020130091906A KR 20130091906 A KR20130091906 A KR 20130091906A KR 101433082 B1 KR101433082 B1 KR 101433082B1
Authority
KR
South Korea
Prior art keywords
image
data
frame
video
converted
Prior art date
Application number
KR1020130091906A
Other languages
Korean (ko)
Inventor
최재혁
Original Assignee
주식회사 고글텍
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 주식회사 고글텍 filed Critical 주식회사 고글텍
Priority to KR1020130091906A priority Critical patent/KR101433082B1/en
Application granted granted Critical
Publication of KR101433082B1 publication Critical patent/KR101433082B1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/332Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30Image reproducers
    • H04N13/356Image reproducers having separate monoscopic and stereoscopic modes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106Processing image signals
    • H04N13/139Format conversion, e.g. of frame-rate or size
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/76Television signal recording

Abstract

Disclosed is a conversion and reproduction method to provide an intermediate impression of a two-dimensional image and a three-dimensional image. The method is a method executed by a computing device which reduces a size of each image frame (Fi) of source image data, which is a conversion target, into half. A converted image frame (Fi′) is formed by juxtaposing the half-sized image frame (Fi/2) from side to side. Converted image data composed of converted image frames (Fi′) is reproduced in an image reproducing device. The left-half image (Fi/2) of the converted image frame (Fi′) is allowed to be only displayed to one side of the left eye or the right eye of a user, and the right-half image is allowed to be only displayed to the other side of the left eye or the right eye of the user.

Description

Technical Field [0001] The present invention relates to a video converting and reproducing method for providing a medium-sized feeling between a two-dimensional image and a three-dimensional image,
[0001] The present invention relates to image processing, and more particularly, to a method and apparatus for image signal conversion and reproduction capable of reducing visual fatigue or psychological anxiety due to viewing of a complete three-dimensional image by providing a three- ≪ / RTI >
After the stereoscopic movie 'Avatar' was released, people's interest in stereoscopic video explosively increased. The market for stereoscopic images has also grown greatly. TVs and monitors capable of viewing stereoscopic images (3D images) have also been introduced, and related stereoscopic techniques have also been developed.
A person can feel the stereoscopic effect because he uses the parallax of a person with a distance of about 65mm. That is, the three-dimensional feeling is felt because the left eye and the right eye respectively see different two-dimensional images having a difference corresponding to the binocular parallax. When these two images are transmitted to the brain through the retina, Perception of depth, perception of feeling, and perception of volume. Therefore, in order to display a stereoscopic image, two different images having at least binocular parallax are required. The stereoscopic image contents for the 3D display can be produced by the two-lens-lens shooting method which simultaneously photographs two cameras 65 mm wide to have a binocular disparity. There is also a method to show the same effect as the 2-lens lens shooting method by converting the image content of one eye view shot with a camera with one eye lens through hardware and software calculation.
However, stereoscopic images have been widely popular right after the success of the movie avatar, but recently, stereoscopic image consumers have been hesitant to purchase their stereoscopic images. The popularity of stereoscopic images has become somewhat faded because one of the reasons is that the unit price of the viewing device is high while the stereoscopic image content is insufficient. But a more fundamental reason is that watching stereoscopic video can cause discomfort to people and even adversely affect their health.
Those who watched stereoscopic images are known to feel visual fatigue and psychological instability. Visual fatigue and instability associated with viewing 3D images include eyestrain, eyes feel heavy, double vision, dry eyes, heavy head, headache, , Shoulder stiffness, shoulder pain, back pain, nausea, giddiness, and headache. According to statistics, approximately 12% of people can not see stereoscopic images because of various medical conditions, and about 30% of people have very poor stereoscopic vision and are not good at depth perception. For those people, there is little or no concentration effect on stereoscopic images. Because of these points, there are surprisingly many consumers who are reluctant to stereoscopic images.
Many people who have watched stereoscopic images experience eye fatigue and dizziness, and there is strong suspicion that the continuous viewing of 3D stereoscopic images does not have harmful effects on the human body. In order to activate 3D stereoscopic industry, it is very important to establish stability standards for 3D display and contents by studying this problem. The visual psychological fatigue of the stereoscopic image is not clearly identified, but generally the discrepancy of the focal distance and the convergence angle of the two eyes, the unnatural image, the discrepancy of the motion parallax, . These factors are related to the errors of stereoscopic image reproduction system including erroneous shooting of stereoscopic image and wrong display, but they are understood to be closely related to the inherent properties of stereoscopic image itself. In stereoscopic images, excessive extrusion and speed feeling of a moving object is felt, and if the image includes a lot of colorful colors and complicated patterns, the part adds a stereoscopic effect and leaves a residual image of a pattern and color bodies. If you watch these images for a long time, visual fatigue such as dizziness and psychological anxiety are caused.
Several techniques have been proposed to minimize the dizziness phenomenon when viewing stereoscopic images. For example, a technique for correcting an error of a stereoscopic image generated due to a difference in ability of a photographer during stereoscopic image production (Korean Patent Laid-Open Publication No. 10-2012-0064560, entitled " Stereoscopic Image Production System And a method thereof) are known. This prior art has found that there are various factors such as a geometrical error between left and right images, a color error, an afterimage of an image, an object which is visible only to one image, and the like, We present a stereoscopic correction technique that can be minimized. However, this technique focuses on error correction at the shooting stage, which is not a fundamental solution to the problem.
After all, it is not good for everyone to make the images look stereoscopic. A fundamental solution to the various health problems caused by viewing stereoscopic images can be to minimize or eliminate stereoscopic effects.
On the other hand, even if the same image is displayed, the impression of the viewer varies depending on the size of the screen on which the image is displayed. It is hard to feel the inspiration of the movie through the large screen of the movie theater through a small screen such as a computer monitor or a smart phone. This is because there is a difference in the size of the screen that the user sees. If you can enlarge a small size screen and see the image much larger than the actual size of the screen, you can meet the demands of users. As video content viewing through computer monitors has become more common, video content and TV viewing using smartphones are becoming more common due to the explosion of smartphone users. The above requirements can be said to be stronger when viewing images through a smartphone or a computer monitor having a relatively small screen size.
There is a need for a solution that allows the image to be viewed larger than the actual image. However, the solution needs to be a third method, not a method of using a stereoscopic image that causes discomfort such as dizziness or the like.
The present invention provides a stereoscopic effect, a perspective feeling, a real sense and a sense of reality of a middle level between a 3D image providing a perfect three-dimensional feeling and a 2D image providing no three-dimensional feeling, And an image conversion and playback method for preventing psychological anxiety from occurring.
Another object of the present invention is to provide an image conversion and playback method capable of viewing an image generated by the above method much more than an actual image.
According to an aspect of the present invention, there is provided an image conversion apparatus for sequentially converting each source image frame (Fi) of source image data into a corresponding target image frame (Fi '), (Fi '), wherein the conversion into the corresponding target image frame (Fi') of each source image frame (Fi ') comprises transforming the number of pixels of the source image frame (Fi / 2) is reduced by halving in the horizontal direction and the vertical direction, and the same reduced image frame (Fi / 2) is duplicated by duplicating the reduced image frame (Fi / 2) ≪ / RTI > and an image frame Fi '; A second step of the image converting unit providing the converted image data to an image reproducing unit; (Fi / 2) of the same two image frames (Fi / 2) constituting each target image frame (Fi ') are reproduced on the screen by the target image frames (Fi' By displaying the image on the left half and the right half of the display screen, the same two reduced image frames (Fi / 2) constituting each target image frame Fi 'are displayed as a stereoscope including two lenses And a third step of allowing the viewer of the video content to be separately viewed on the left and right eyes of the viewer of the video content to be viewed.
In the method, the reduction image frame Fi / 2 is generated from the source image frame Fi by combining pixel data in odd-numbered rows and columns in pixel data of each source image frame Fi and pixel data in even- By taking only one of the pixel data in the rows and columns and discarding the remaining pixel data.
In the method, the image display in the third step is performed in a smart phone or a tablet computer, and the two lenses of the stereoscopic image are images of the two identical reduced image frames (Fi / 2) The magnification of the magnified image is such that the magnitude of the magnified image is larger than the magnification of the magnified image.
In the above method, the first step, the second step, and the third step may be performed in an image reproducing apparatus of an image content consumer including both the image converting unit and the image reproducing unit.
In the above method, the first step and the second step are performed by an image providing system on the side of an image content provider having the image converting unit, and the third step is performed on the side of the image content consumer having the image reproducing unit Or may be performed by an image reproducing apparatus. In this case, when the image converting unit performs the second step, the converted image data is transmitted to the image reproducing unit by a streaming method or a broadcast method.
In the second step, the image providing system may provide the source image data when providing the converted image data to the image reproducing apparatus. In this case, the third step is performed when the image content consumer selects the latter of the source image data and the converted image data in the image reproducing apparatus and instructs reproduction.
According to the image converting and reproducing method of the present invention, the viewing feeling of the reproduced image is a feeling of a medium degree between a three-dimensional image for making a full three-dimensional image feel and a two-dimensional image having no three-dimensional image at all. Therefore, stereoscopic images such as visual fatigue and psychological anxiety are much less adverse to viewing stereoscopic images than stereoscopic stereoscopic images.
In addition, when the stereoscopic image is reproduced in the stereoscopic mode and the stereoscopic image having the magnification is observed, the reproduced image can be enlarged and viewed significantly. This has the effect of offsetting the disadvantages of a video player such as a smart phone having a small screen size.
1 is a diagram schematically illustrating an image conversion concept according to the present invention,
Fig. 2 briefly illustrates the means for processing such an image transformation concept,
Figure 3 schematically illustrates the configuration of a video content provider system 300 required to process video conversions in accordance with the present invention,
4 is a flowchart of a processing procedure of an application program in which an image transformation algorithm according to the present invention is implemented,
5 schematically shows the configuration of the image reproducing apparatus 500 of the content consumer,
6 is a flowchart illustrating a method of reproducing an image according to the present invention at an image content consumer side when providing the original image and the image converted according to the present invention at the image content provider side,
7 is a flowchart schematically showing a processing procedure of an application program for processing video conversion when video data is provided in the form of a live broadcast signal,
FIG. 8 is a view for explaining an enlargement of a screen according to a lens focal length of a stereoscopic lens when viewing a converted image according to the present invention with a stereoscopic image.
Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings.
The image processing method proposed by the present invention is to convert an original image into a new frame on a frame-by-frame basis. Fig. 1 schematically shows the image conversion according to the present invention, and Fig. 2 shows the means for performing the image conversion processing.
The original image frame 100 to be converted is a digital image having a number of pixels a and b each having a width and a length of pixels. First, the image conversion unit 200 receives an original image, performs an image conversion process, and outputs the converted image. In the image conversion process, first, the original image is read in units of frames, and a reduced image 110 is generated in which the number of horizontal pixels and the number of vertical pixels of each image frame 100 are reduced by half. Then, the reduced image 110 is duplicated twice to create a new image frame 120 in which the two reduced images 110 are juxtaposed on the left and right sides. The image frame 120 is a converted image frame 120 according to the image processing method of the present invention.
The user will see the converted video frame 120. However, both the left eye and the right eye look at half of each of the video frames (120), not the whole. For example, the left eye sees the image 110 in the left half of the left image frame 120 and the right eye sees the image 110 in the right half. The left and right eyes see the same image. This is in contrast to general 3D stereoscopic images. In a typical 3D stereoscopic image, the images of the left eye and the right eye are not the same, and the non-identical images viewed from different angles (one image is distorted compared to the other image). The human brain recognizes the depth of the image (difference in depth) due to differences in the images received from both eyes. In order to feel the stereoscopic effect of the image, it is necessary to show the image with a difference in both eyes, and also the image which is different according to the distance of the object. In the case of the present invention, since the two images entering the left eye and the right eye are the same, a stereoscopic feeling similar to a normal 3D stereoscopic image is not displayed. On the other hand, if the same two images are magnified and viewed separately through the two eyes, the feeling of a cooling sensation of the image is felt together with the sense of depth and the stereoscopic effect by the unilateral factors.
In addition, by using the techniques used for viewing the stereoscopic image, the converted image according to the present invention can be viewed with higher quality. This will be described later.
Such a video conversion operation may be performed before the video content is transmitted in the system of the video content providing side (e.g., broadcasting station, YouTube, etc.) or before the video content received by the user side apparatus consuming the video content is reproduced.
First, conversion from the video content provider system will be described.
3 schematically illustrates the configuration of a video content provider system 300 required to process video conversions in accordance with the present invention. The system 300 may include a data store 310 or a camera 320 as a content source. A CPU 330 and a memory 340 for performing image data conversion processing, and an input / output device serving as a user interface 350.
Apart from these hardware resources, an application program and a user interface program in which the image transformation algorithm described below is implemented are also required. The flowchart of FIG. 4 is a flow chart schematically showing an execution procedure of this program.
For example, the source image to be converted is stored in the data storage 210 in the form of a file. The CPU 330 executes a video conversion program to generate a converted video (target video). Prior to the image conversion processing, the number of pixels of the target screen frame, that is, the resolution, is first determined (step S10). Examples of standard resolution are 1080p (1920x1080 pixels), 720p (1280x720 pixels), 480p (640x480 pixels), and so on. If the screen resolution of the source image is, for example, 1080p (1920x1080 pixels), the screen resolution for creating the target screen frame is also set to 1920x1080. The CPU 330 reserves a buffer memory space of this size.
The CPU 330 reads the source image file from the data storage 310 (step S12). The video files may be files compressed according to a predetermined compression standard such as MP4, avi, wmv, mkv, and the like. If the compressed image file is such a compressed image file, the image file is decompressed using a decoding tool of the standard (step S14). For example, 30 frames per second.
Now, the image conversion processing according to the present invention is performed with the decoded image data. To this end, each screen frame Fi (100) of the decoded image data is first reduced by half (S16). The method of reducing each screen frame Fi 100 in half is to reduce the number of pixels in the horizontal direction and the number of pixels in the vertical direction of each screen frame Fi 100 by half, for example. That is, for example, all the odd-numbered pixels are removed in the horizontal direction and the vertical direction of each screen frame Fi 100 and the odd-numbered pixels are eliminated in the horizontal direction and the vertical direction, It is a new constitution of the screen. The reduced screen Fi / 2 110 is a screen in which the number of pixels in the horizontal direction and the vertical direction is reduced by half and the area is reduced by 1/4, respectively, as compared with the original screen. According to the above example, the number of pixels of the reduced screen Fi / 2 (110) is 960x540.
When the reduced image Fi / 2 110 is prepared for each screen frame, the reduced image Fi / 2 110 is displayed on the transformed image area of the memory 340 as shown in FIG. 1 (c) (Step S18). In step S18, a new screen frame Fi '120 is created. A new screen frame Fi '120 formed by combining two reduced frames of the original image frame is a target screen frame to be obtained through conversion of the present invention.
The converted target screen frames Fi '120 are encoded in a desired file format (MP4, avi, wmv, mkv, etc.) in consideration of storage efficiency and transmission efficiency, and then stored in the data storage 310 step).
In step S22, the converted image file stored in the data store 310 is provided to the image reproducing apparatus of the content consumer in response to a request of the content consumer at a necessary time or at a required time. The converted image file may be provided by a transmission method such as a streaming method, a broadcasting method, a download method, or the like.
On the other hand, an image relayed in real time by a television broadcasting station may be subjected to the above conversion process prior to wireless transmission, and then the converted image may be transmitted as a broadcast signal such as a terrestrial broadcast, cable broadcast, or DMB broadcast. In this case, the source of the conversion target image is not the data storage 310 but the camera device 320. [ That is, the image frame generated by the camera device 320 is provided to the CPU 330 in real time. The CPU 330 converts the image frame provided by the camera device 320 into a half-reduced image for each frame through the processes of steps S16 and S18 described above, and then transforms the image frame into a combined image frame by horizontally juxtaposing it. Then, the converted video frames are collected and compression-encoded in accordance with the transmission format of the broadcast signal, and transmitted by the broadcasting method.
The video content provider can provide the same image to the content consumer in two forms. That is, one is image data converted into a new screen frame (Fi ') juxtaposed with two left and right same frame frames, and the other is original image data that has not been converted. The content consumer can then have a choice of images for both.
When the content consumer receives the image data composed of the new screen frame Fi ', the image data may be reproduced according to any one of the known stereoscopic image display methods. Fig. 5 schematically shows a configuration of a video playback device 500 of a content consumer capable of doing so.
The image reproducing apparatus 500 includes a communication unit 510 for receiving image data provided by an external image providing system (e.g., a broadcasting system or a streaming server system), an overall control and communication unit 510 for the image reproducing apparatus 500, A CPU 530 and a memory 540 for performing processing such as decoding the image data transmitted through the input / output unit and, if necessary, processing the image data according to a desired stereoscopic image reproduction method, a data storage space (for example, a hard disk or a flash memory) A user interface 550 that allows a user to make a command and confirm a result of the processing, including a storage unit 520 functioning as a storage unit for storing the original image and a converted image, a CPU 530, A video driver 530 for converting the video data into a display driving signal and providing the same to a display, It comprises a display 570, such as.
The flowchart of FIG. 6 shows a method of reproducing an image according to the present invention at the image content consumer side when providing the original image at the image content provider side and the image converted according to the present invention.
The content consumer can select one of the original image and the converted image through the user interface 550. [ Here, it is assumed that the converted image is selected. The image selection information is provided to the CPU 530 (step S30). Only when the converted image is selected, the processing described below is performed. If an original image is selected, the original image is reproduced by a normal reproduction method without performing the processing of FIG. 6 described below.
The CPU 530 receiving the image selection information from the user interface 550 requests the content providing system to provide the converted image through the receiving unit 510 and provide the image in step S32. However, this step may be omitted depending on the transmission method of the image contents. For example, when the content provider transmits the original image and the converted image at a time in a broadcast manner, the user's request procedure is omitted, and only the converted image of the received image is selectively used. Alternatively, if the content provider side provides the image content in response to the request of the content consumer, such a request will be required.
When the contents provider system voluntarily transmits the converted image data in response to a request from the content consumer, the communication unit 510 receives the converted image data and transmits the converted image data to the CPU 530. If the storage of the image data is allowed, the CPU 530 may store the image data in the form of a file in the storage unit 520 and perform a playback process described below at a necessary time. If the transmitted image is a live broadcast image, the communication unit 510 performs demodulation processing and then provides the demodulated result to the CPU 530. [ In the case where the video data is a video provided in a streaming manner or a live broadcast video, the CPU 530 performs the following process for real time reproduction of the video data stream while receiving the video data stream.
First, the CPU 530 temporarily stores the converted video data stream provided through the communication unit 510 in the buffer memory (step S34). The converted image data is read by predetermined units and decoded (step S36). The CPU 530 further processes each decoded image frame Fi 'in accordance with the desired stereoscopic image reproduction method (viewing method) and the display 570 specification (step S38). Then, the processed image data is provided to the video driver 560 (step S40). The video driver 560 drives the display 570 as a driving signal for driving the display 570 based on the image data provided by the CPU 530. An image is displayed on the display 570 according to a desired stereoscopic image reproduction method.
The content consumer sees the image being played on display 570. The reproduced image should be a video that matches the stereoscopic viewing method used by the consumer. Conventional stereoscopic viewing methods (reproduction methods) can be roughly classified into spectacles and non-stereoscopic methods. The spectacle viewing method (reproducing method) includes a stereoscopic method, a head mounted display (HMD) method, an anaglyph method, a polarizing method, a time division shuttering glass method Are known. There are Parallax Barrier method, Lenticular method, and the like in the viewing method (reproduction method) of no-viewing. These spectacular viewing methods and non-observing viewing methods commonly require different left-eye images and right-eye images artificially imparted with a difference in optical angle in order to allow stereoscopic effect on the reproduced image It is a point.
On the other hand, the present invention is fundamentally different from the conventional stereoscopic image reproducing method in that the left eye image and the right eye image are the same. That is, in the present invention, the left image and the right image constituting each frame Fi 'of the converted image are used as a left eye image and a right eye image. The present invention is different from the first embodiment in that a video frame Fi 'transformed by the above-described conversion method is used as a source image for reproduction.
In the stereoscopic method, left and right images are arranged in succession on the left and right sides, and two images on the left and right sides are separately formed on two eyes through two lenses, thereby making the stereoscopic feeling feel. This stereoscopic system can be applied to the present invention. In this case, the left image and the right image of the converted image frame Fi 'are displayed on the left half and right half of the display 570, respectively, or on the right half and left half, respectively. Then, the content consumer wears the stereoscopic image of the display image in which the two lenses are juxtaposed with the left eye and the right eye so that the left half image of the display 570 is viewed in the left eye and the right half image is viewed in the right eye. In other words, the left eye and the right eye both see the same two images without a difference in wide angle.
delete
delete
In the case of the present invention, since two images having no difference in the wide angle are viewed, the stereoscopic effect is not felt to the same extent as in the conventional stereoscopic viewing method. However, it is not the same feeling (simple two-dimensional feeling) when seeing a "one" image common to the left eye and right eye. Since the present invention sees 'two' identical images separately in the left eye and the right eye, the viewing feeling is the middle degree between the three-dimensional feeling and the simple two-dimensional feeling. It seems to be a screen that feels very comfortable and real feeling and feeling of durability to the extent that visual fatigue or psychological anxiety felt in full stereoscopic image hardly occurs, and even refreshing feeling.
Particularly, when two stereoscopic images having two lenses juxtaposed on the left and right are worn and two images displayed on the display 570 are viewed, the effect of enlarging the image according to the magnification of the lens can also be obtained. This is particularly effective when viewing the image on a smart phone having a small size of the display 570. When two stereoscopic images are displayed on the left and right sides of the screen while the stereoscopic image is displayed on the left and right eyes, respectively, the magnitude of the image the user feels is enlarged according to the focal length of the lens. 8 is a schematic diagram of a smart phone (Samsung Electronics Galaxy S4 model) having a screen size of 11 cm x 6.5 cm in width and a screen size of 150 cm in front of a lens of a stereoscopic lens. In the case of four lens focal lengths of 6 cm, 12 cm, 18 cm, and 24 cm, the size of the screen viewed through the stereoscope is schematically shown. According to FIG. 8, in the case of a lens having a focal length of 6 cm, there is an effect that an image having a width of about 277.24 cm is displayed on a virtual screen separated by 1.5 m. In other words, a TV having a screen size of 277 cm has the same effect as that of the user (without wearing a stereoscope) at a distance of 1.5 meters. In the case of the present invention, however, since the two images are arranged in a side-by-side form and are halved, the image is enlarged to a size of 138.62 cm. Since the half of the actual horizontal size of the smart phone is 5.5cm, it has an effect of magnifying it about 25 times. In other words, when a converted image according to the present invention is reproduced in a stereoscopic manner on a smartphone having the above-mentioned size (diagonal 5-inch screen) and the user wears a stereoscopic image made of two lenses having a focal length of 6 cm, Has the same effect as looking at the top of a 125-inch screen that is 25-times magnified in front of 1.5 meters.
When the lens focal length of the stereoscopic lens becomes longer, the effect of enlarging the screen is reduced. For example, when the focal length of the lens is 24 cm, it is like viewing a screen with 72.66 cm in width on a virtual screen 1.5 meters ahead. In this case, the screen enlargement ratio is approximately 6.5 times (72/11), and the user recognizes the 36-inch TV as being the same size as that of the naked eye at a distance of 1.5 meters.
The following table summarizes the differences between the reproduced image, the conventional stereoscopic image and the simple two-dimensional image according to the present invention described above.
division Conventional stereoscopic images The video of the present invention Simple 2D image
Source video Left eye and right eye two images (non-identical images) Two images for left eye and right eye without the difference of wide angle (same image) One image without distinction between left eye and right eye
How to Watch Left-eye and right-eye images are shown in left eye and right eye, respectively. Left-eye and right-eye images are shown in left eye and right eye, respectively. See a picture of both left and right eyes
Feeling of sight Three-dimensional feeling Middle feeling of three-dimensional and two-dimensional feeling Two dimensional sense
Etc If you watch with a magnifying lens, you can zoom in on a small display image
Next, a case in which a user who consumes the image carries out the operation of creating the converted image frame Fi 'will be described. As the means for the image conversion work, for example, the image reproducing apparatus 500 having the hardware resources as shown in FIG. 5 is sufficient. An application program configured to execute the image conversion processing algorithm is also needed. For example, the application program can be executed in a smart phone, a tablet PC, a general PC, or the like to convert an image. The application program may be preferably embodied as a part of a video reproduction player.
The image data to be converted may be stored in a file form in the storage unit 520 or may be image data streamed in real time from an external content providing system or image data contained in a broadcast signal transmitted from an external broadcasting system. In any case, it is not much different from creating a converted image on the content provider side. That is, the basic concept is that the original source image frame is reduced in half and juxtaposed right and left to create a new image frame.
First, consider the case where video data is provided in the form of a live broadcast signal. Fig. 7 is a flowchart schematically showing an execution procedure of an application program for processing image conversion in this case.
The image provided by the external broadcasting system is a general digital image. The content consumer can select whether to view the original untransformed image or the converted image according to the present invention. This option may be exercised through the user interface 550 (step S50). When it is selected to view the converted image, the CPU 530 performs the image conversion processing described below.
Specifically, the image data received in the form of a broadcast signal will be provided to the CPU 530 through the communication unit 510. Since the video data is usually encoded according to a specific compression standard, the CPU 530 decodes the received video data (step S52). Then, each screen frame Fi of the decoded image data is reduced to a half size (step S54). Then, each reduced frame frame Fi / 2 is copied twice and juxtaposed left and right to form a new image frame Fi ' (Step S56).
The CPU 530 performs necessary processing according to the stereoscopic image reproduction method of sequentially converting the converted image frames Fi 'and applying the converted image frames (S58). Then, the processed screen frames are collected and provided to the video driver 560. Then, the video driver 560 processes the screen frames to be displayed on the display 570 (step S60).
If it is permitted, the CPU 530 may collect the new image frames Fi 'obtained in step S46 and store the new image frames Fi' in the form of a file in the storage unit 520, and may read and play the stored file later when necessary.
Next, the conventional image files stored in the storage unit 520 may be converted into a converted image file according to the present invention. That is, the CPU 530 reads the source image file to be converted in the storage unit 520, sequentially performs the decoding of step 42, the image reduction of step 44, and the juxtaposition of the reduced image of step 46, And processes the screen frame Fi into a converted video frame Fi '. Subsequently, steps S48 and S50 are performed to reproduce in parallel with the conversion, or the converted frames Fi 'are collected and stored in the storage unit 520 in the form of a file, and playback is performed if necessary.
As described above, according to the present invention, the conversion of the video frame is performed in advance in the content provider system, and the converted video content is provided to the content consumer, or the conversion process of the video frame is performed on the content consumer side. In any case, the pre-processing or post-processing of the transformation resulting from the difference in the conversion environment or condition may be slightly different, but the core algorithm of image conversion is substantially the same. Alternatively, a method of planting the image transformation algorithm in an operating system program may be possible. That is, it is possible to provide a user with a choice of screen division, and divide the screen into two left and right screens according to the user's selection, so that all the images to be reproduced are simultaneously displayed on the divided two screens.
100: When the object to be converted is a video frame (Fi)
110: Image frame reduced to half size (Fi / 2)
120: converted image frame (Fi ') 200: image conversion unit
300: Video Content Provider System 310: Data Store
320: camera 330, 530: CPU
340, 540: memory 350, 550: user interface
500: image reproducing device 510:
520: Storage unit 560: Video driver
570: Display

Claims (11)

  1. The image converting unit sequentially converts the source image frames Fi of the source image data into the corresponding target image frames Fi 'to sequentially generate transformed image data composed of the target image frames Fi' Wherein conversion of each source image frame Fi into a corresponding target image frame Fi 'is performed by reducing the number of pixels of the source image frame Fi to half in both the horizontal and vertical directions, / 2) and composing the corresponding target image frame (Fi ') by duplicating the reduced image frame (Fi / 2) and combining the same two reduced image frames (Fi / 2);
    A second step of the image converting unit providing the converted image data to an image reproducing unit; And
    The image reproducing unit reproduces the target image frames Fi 'of the provided converted image data on the screen, and displays the same two thumbnail image frames Fi / 2 that constitute each target image frame Fi' Are displayed on the left half and the right half of the display screen, respectively, so that the same two reduced image frames (Fi / 2) constituting each target image frame Fi 'are displayed as stereoscopes including two lenses And a third step of allowing the image content consumer to separately view the left and right images of the image content consumer.
  2. The method as claimed in claim 1, wherein making the reduced image frame (Fi / 2) from the source image frame (Fi) is performed by dividing the pixel data in odd-numbered rows and columns in pixel data of each source image frame (Fi) And the remaining pixel data is discarded. The method of claim 1,
  3. delete
  4. 2. The method of claim 1, wherein the image display in the third step is performed by a smart phone or a tablet computer, and the two lenses of the stereoscopic image are images of the two identical reduced image frames (Fi / 2) And the magnitude of the magnified image is larger than the magnification of the magnified image. The image data conversion and playback method according to claim 1,
  5. delete
  6. The method according to claim 1, characterized in that the first step, the second step, and the third step are performed in an image reproducing device on an image content consumer side having both the image converting section and the image reproducing section Data conversion and playback method.
  7. delete
  8. 2. The method according to claim 1, wherein the first step and the second step are performed by an image providing system on the side of an image content provider having the image converting unit, And the image data is reproduced by the image reproducing apparatus.
  9. 9. The image processing method according to claim 8, wherein, when the image converting unit performs the second step, the converted image data is transmitted to the image reproducing unit by a streaming method or a broadcast method. Playback method.
  10.  The method of claim 9, wherein in the second step, the image providing system provides the converted image data to the image reproducing device together with the source image data.
  11. The method as claimed in claim 10, wherein the third step is performed when the video content consumer selects the latter of the source video data and the converted video data to instruct the video content consumer to play back the video data. Playback method.
KR1020130091906A 2013-08-02 2013-08-02 Video conversing and reproducing method to provide medium feeling of two-dimensional video and three-dimensional video KR101433082B1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
KR1020130091906A KR101433082B1 (en) 2013-08-02 2013-08-02 Video conversing and reproducing method to provide medium feeling of two-dimensional video and three-dimensional video

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020130091906A KR101433082B1 (en) 2013-08-02 2013-08-02 Video conversing and reproducing method to provide medium feeling of two-dimensional video and three-dimensional video
PCT/KR2014/007190 WO2015016691A1 (en) 2013-08-02 2014-08-04 Method for converting and reproducing image for providing moderate three-dimensional effect between two-dimensional image and three-dimensional image

Publications (1)

Publication Number Publication Date
KR101433082B1 true KR101433082B1 (en) 2014-08-25

Family

ID=51751089

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020130091906A KR101433082B1 (en) 2013-08-02 2013-08-02 Video conversing and reproducing method to provide medium feeling of two-dimensional video and three-dimensional video

Country Status (2)

Country Link
KR (1) KR101433082B1 (en)
WO (1) WO2015016691A1 (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104914581B (en) * 2015-06-29 2018-05-22 爱侣健康科技有限公司 A kind of video glass for facilitating control

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20030001758A (en) * 2001-06-27 2003-01-08 한국전자통신연구원 Apparatus and Method for stereoscopic video coding/decoding with motion and disparity compensated prediction
KR20070089305A (en) * 2006-02-28 2007-08-31 주식회사 서울테크밸리 Method for transmission of stereoscopic image
JP2009232249A (en) 2008-03-24 2009-10-08 Toshiba Corp Stereoscopic video display apparatus, stereoscopic video display method and liquid crystal display
JP2012099905A (en) 2010-10-29 2012-05-24 Sharp Corp Three-dimentional video reproduction device

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20100135032A (en) * 2009-06-16 2010-12-24 삼성전자주식회사 Conversion device for two dimensional image to three dimensional image and method thereof
KR101699740B1 (en) * 2010-04-14 2017-01-25 엘지전자 주식회사 Image Display Device of 2D/3D convertible display and Operating Method for the same
KR20120133571A (en) * 2011-05-31 2012-12-11 삼성전자주식회사 Imformation processing apparatus, implementation method thereof, and computer-readable storage medium thereof
JP2013033172A (en) * 2011-08-03 2013-02-14 Panasonic Corp Stereoscopic display device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20030001758A (en) * 2001-06-27 2003-01-08 한국전자통신연구원 Apparatus and Method for stereoscopic video coding/decoding with motion and disparity compensated prediction
KR20070089305A (en) * 2006-02-28 2007-08-31 주식회사 서울테크밸리 Method for transmission of stereoscopic image
JP2009232249A (en) 2008-03-24 2009-10-08 Toshiba Corp Stereoscopic video display apparatus, stereoscopic video display method and liquid crystal display
JP2012099905A (en) 2010-10-29 2012-05-24 Sharp Corp Three-dimentional video reproduction device

Also Published As

Publication number Publication date
WO2015016691A1 (en) 2015-02-05

Similar Documents

Publication Publication Date Title
JP5663617B2 (en) Stereo image sequence encoding method and decoding method
JP4295711B2 (en) Image conversion and encoding technology
US8913108B2 (en) Method of processing parallax information comprised in a signal
KR20140030111A (en) Pseudo-3d forced perspective methods and devices
KR101686168B1 (en) Method for constituting stereoscopic moving picture file
KR20110108551A (en) An apparatus and method for transmitting/receiving multi-view stereoscopic video
KR101433082B1 (en) Video conversing and reproducing method to provide medium feeling of two-dimensional video and three-dimensional video
KR101674688B1 (en) A method for displaying a stereoscopic image and stereoscopic image playing device
JP2013534772A (en) How to configure stereoscopic video files
KR20120004586A (en) A digital broadcast receiver and a method for processing a 3-dimensional effect in the digital broadcast receiver
JP2014175813A (en) Stereoscopic video display method and device
CN111684517A (en) Viewer adjusted stereoscopic image display
Robitza 3d vision: Technologies and applications
CN102780905A (en) Method for color correction of 3D (three-dimensional) video
CN107547889A (en) A kind of method and device that three-dimensional video-frequency is carried out based on instant messaging
Bayatpour The Evaluation of Selected Parameters that Affect Motion Artifacts in Stereoscopic Video
WO2019041035A1 (en) Viewer-adjusted stereoscopic image display
Boisson et al. Disparity profiles in 3DV applications: overcoming the issue of heterogeneous viewing conditions in stereoscopic delivery

Legal Events

Date Code Title Description
GRNT Written decision to grant
FPAY Annual fee payment

Payment date: 20171026

Year of fee payment: 4

LAPS Lapse due to unpaid annual fee