KR101088035B1 - Control apparatus for displaying the 3D moving pictures - Google Patents

Abstract

An object of the present invention is to feel a three-dimensional feeling while alleviating side effects, such as headaches, nausea or dizziness caused by watching 3D stereoscopic video, especially when watching a video. According to an aspect of the present invention, there is provided a data source providing unit providing a data source synchronized with a video and the video and including variable filtering information of a video for controlling fatigue that a viewer may feel while watching the video; A data decoder configured to decode data of the data source, a video decoder to decode a video of the data source, an audio decoder to decode audio of the data source, and the data source in which filtering is set according to the variable filtering information. A variable filter for filtering the video for a corresponding section of the video output unit, a video output unit for outputting the video filtered by the variable filter, and an audio output unit for outputting audio from the audio decoder; And a user interface for receiving a command of using or not using the variable filter and providing a command to the variable filter.

Description

Control apparatus for displaying the 3D moving pictures}

The present invention relates to a video display control device to alleviate the fatigue and physical side effects that viewers may feel when watching a video, especially 3D video, and more particularly, by using a variable filter synchronized with time in 3D video. The present invention relates to a video display control device that can alleviate fatigue.

Recently, interest in 3D stereoscopic movies has exploded in the field of film and broadcasting.

Although there are many factors that make a person feel three-dimensional, parallax between both eyes is the most important factor to make three-dimensional feeling. As such, the technologies developed to allow a user to feel a stereoscopic sense of an image through binocular disparity are a stereoscopic stereoscopic technique and a multi-view stereoscopic technique.

Currently, the technology mainly used for 3D stereoscopic video is a binocular stereoscopic technology, and the binocular stereoscopic technology is divided into a glasses method and a glasses-free method depending on whether a user needs to wear special glasses. Glasses methods include polarized glasses and shuttered glasses. The glasses-free method includes a lenticular method using a film having a fine vertical wrinkle and a Parallax Barrier method using a vertical blocking line.

The process of feeling a three-dimensional effect of a person is described as follows with reference to FIG.

All eyes with two eyes have a slightly different image perceived by each eye because the eye is located on both sides of the nose (Retinal Image Disparity), but one can see this as different visual stimuli reaching the retina of both eyes (Retinal Corresponding) This is because the brain processes the points to recognize them as one. When the object O is present, the image of O is captured in the macula F, the retinal corresponding points of the eye, respectively. However, the F perceived by each eye is recognized as the virtual visual axis F ". This is called Common Visual Direction, which is the common visual axis we feel. A is farther away than O but is located in the same Common Visual Direction F". . Looking at O, A enters the retinal counterpart at a nose, a side of F. We recognize that a is behind O. Conversely, because B is closer than O, it enters the retinal counterpart at b, the ear of F, and we recognize that b is ahead of O. In this way, when an object forms images of both eyes' Responding Retinal Points at the same time, we recognize the object as one and perceive it as a single vision and have a common vision.

This phenomenon of perceiving things in three dimensions with the ability to know depth is called stereopsis. For stereoscopic vision, there is an image seen with the left eye and an image seen with the right eye, and a process of recognizing it as one in the head is necessary. This neurological process of making the image of the retina from both eyes into a single image is called sensory fusion. However, in order to fuse, the image seen to the left and the image to the right must be somewhat similar, and if an image that is completely absent is seen in both eyes, it will appear as two (Diplopia), overlap (Superimposition), or two The images appear alternate (Retinal Rivalry), or only one image (Suppression), which causes visual fatigue in the brain.

Also, when stereoscopic 2D video is transformed into 3D video in 3D space, the amount of information that the human brain needs to process is much more than simply combining the left and right images. There is a study that amplified by as much as 7 times or more. This means that the quality of the image also feels much better. When such a huge amount of video information leads to a rapid screen change, viewers who watch stereoscopic movies may accumulate visual fatigue due to overload of sensory fusion, and may complain of headaches with dizziness and nausea.

 In particular, when viewing a poorly produced 3D stereoscopic video or watching a 3D stereoscopic video about a moving and complex scene, the viewer may feel headache, nausea or dizziness, and may not feel the stereoscopic sense of the watched scene.

On the other hand, the degree of sequelae that occurs when viewing 3D stereoscopic images varies greatly from person to person. For example, those who are familiar with complex images have no or little sequelae, and those who do not have a great deal of sequelae tend to be large.

This sequelae does not only occur when watching 3D stereoscopic video, but may also occur when watching traditional 2D video. For example, a user may feel dizzy or headache when watching a video recorded by a hand-held technique.

It is not possible to change the movement speed of the character or the movement of the camera to shoot the 3D content that has already been produced, but it is possible to control the complexity of the image that a subject can feel subjectively.

An object of the present invention is to feel a three-dimensional feeling while alleviating side effects, such as headaches, nausea or dizziness caused by watching 3D stereoscopic video, especially when watching a video.

In order to solve the above object, the present invention provides a video display method and a display apparatus for controlling the complexity of an image such that a person cannot subject to fatigue, and allowing a user to select whether to control the complexity of the image. do.

According to the present invention can reduce the physical side effects such as headache, nausea, dizziness, etc. that may occur to viewers when watching a video of a moving or complex scene, if the viewer wants to selectively select the original video instead of the converted video It can make you watch.

1 is a conceptual diagram illustrating a process of recognizing a stereoscopic image by a person
2 is a diagram showing the configuration of an apparatus according to an embodiment of the present invention;
3 shows a first filtering method;
4 shows a second filtering method;
5 is a view showing a remote controller (remote control) operated in conjunction with the device of the present invention.
6 and 7 are flowcharts illustrating the method according to the invention.
8 illustrates a method of adjusting the filtering of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

  2 shows a configuration of a display apparatus according to an embodiment of the present invention.

The data source provider 10 provides video, audio, and other data. For example, in the case of terrestrial digital broadcasting, the data source provider 10 includes an RF receiver including an antenna, a tuner, and the like, and a demultiplexer that separates a video, audio, and other data from digital data output from the RF receiver. In the case of satellite digital broadcasting, the data source provider 10 includes a front end for receiving satellite broadcasting and a demultiplexer that separates a video, audio, and other data from digital data output from the front end. When using a medium that stores a video such as a Blu-ray disc, the data source providing unit 10 separates the video, audio, and other data from the disc reader, the digital data, which reads the information recorded on the disc, and reads the digital data. It provides a demultiplexer. The storage medium in which the data source is pre-recorded may be any one of DVD, Blu-ray, hard disk, and SSD at present, but may be a storage medium that will be developed in the future.

In addition, the data source provider 10 may be designed to receive data in any one manner, or may be designed to receive data in various ways.

The video decoder 30 decodes and reconstructs the video in the encoding state. For example, the video decoder 30 reconstructs the original video by decoding with the H.264 decoding method for the video in the H.264 encoded state.

The audio decoder 40 decodes and reconstructs the audio signal in the encoding state. For example, in the case of an AC-3 encoded audio signal, the audio decoder 40 decodes the Ac-3 decoding scheme to reconstruct the original audio signal.

The data decoder 20 decodes subtitle data other than audio and video data, and other data such as EPG data. The data decoder 20 extracts the variable filter information included in the other data and provides it to the variable filter 50.

The variable filter information is information synchronized with a video in time and has time code information common to the video. The time code information may be a standard defined by a society of motion picture and television engineers (SMPTE). The variable filter information may be information authored by the creator of the video during post-production of the video, or may be information separately authored by a third party other than the video producer to control viewing fatigue of the video. In the former case, the video and variable filter information are stored together in the medium containing the video (for example, Blu-ray Disc). In the latter case, the variable filter information is not stored in the medium containing the video. The variable filter information can be obtained through a separate path such as downloading to the Internet.

The variable filter 50 filters the video decoded by the video decoder 30 according to the variable filter information from the data decoder 20.

  The filtering method may include adjusting the resolution, adjusting the color resolution, adjusting the frame rate, and the like.

3 shows a filtering method of a method of reducing frame resolution. That is, the filtering method reduces the frame resolution of a selected section (eg f3, f4, f5, f6) among a series of film frames.

4 illustrates a filtering method of controlling the complexity of an image by deleting some selected frames f4 and f6 from a series of film frames and duplicating and replacing the frames f3 and f5 instead.

 The filtering frame section may be selected in advance by the user selecting a sensitive portion while continuing the Mac of the video flow in the entire video. By filtering some frames of the video as described above, the visual fatigue caused by the viewer's continuous 3D stereoscopic video recognition can be alleviated.

As described above, when the user views the video filtered according to the variable filter information, the fatigue felt by the viewer may be reduced. However, there are times when viewers want to watch the original unfiltered video. If the user wants to watch the original video, the user interface 80 may determine whether to use the variable filter.

When a command to use the variable filter is input from the user interface 80, the variable filter 50 performs a filtering operation on the video, but does not perform a filtering operation on the video when the non-use command is input.

Meanwhile, the device user may adjust the intensity filtered by the variable filter. In this case, the command for using the variable filter may include a command for adjusting the strength of the filtering. According to the intensity adjustment command of the variable filter, the variable filter 50 reduces or enhances the strength of filtering obtained from the variable filter information.

On the other hand, in addition to the filtering method for the frame of the entire screen as described above as a method for reducing the fatigue of the viewer, there is a filtering method of the resolution control method for each variable area (variabl area).

As the screen becomes larger, the viewing angle becomes larger. Therefore, the eye's focus moves quickly to observe the objects on the screen without a break, which causes eye fatigue.

In order to solve this problem, another embodiment of the present invention is a method of partially adjusting the resolution of the screen without reducing the resolution of the entire screen in order to minimize eye focus movement. In other words, it is a method of artificially adjusting the focus of the eye so that the eye is always focused on the 3D object by processing only the object of the screen that should be centered on the 3D stereoscopic image in 3D and implementing the area that is not necessary at the 2D level. By using this method, it is possible to maximize the effect of 3D stereoscopic image on the rapidly changing screen while minimizing eye fatigue of the viewer.

The variable filter information as described above is provided by the data decoder 20, and the image output from the video decoder according to the information is filtered by the variable filter 50 and output to the video output unit 60. In addition, the audio output unit 70 outputs audio.

As described above, when the user views the video filtered according to the variable filter information, the fatigue felt by the viewer may be reduced. As with the previous embodiment, there are times when a viewer wants to watch the original unfiltered video. If the user wants to watch the original video, the user interface 80 may determine whether to use the variable filter.

When a command to use the variable filter is input from the user interface 80, the variable filter 50 performs a filtering operation on the video, but does not perform a filtering operation on the video when the non-use command is input.

Fig. 5 shows that the device user can readjust the degree of complexity control of the previously authored image using a remote controller (so-called remote controller). For example, if you turn on the variable resolution on / off switch on the remote control, the filtering is performed step by step and the resolution of each area or the entire screen is adjusted. Using a switch such as a jog shuttle, you can adjust the variable resolution step by step. When you use the "+" switch for the highest resolution, you can view 3D stereoscopic images at the highest resolution of the display device. When the resolution is lowered to the lowest, you can see 2D video at the lowest resolution. In the meantime, the stereoscopic images are filtered at a variable resolution adapted to the complexity of the variable region (or full screen) of the authored display screen. In addition to the remote control, there may be a variable resolution on / off switch and a level up / down switch in a display device such as a TV that operates in conjunction with the remote control.

Since the configuration in the display device such as a far-infrared receiver to operate in conjunction with such a remote controller (remote control) is a well-known technique, description thereof is omitted.

Meanwhile, although the variable filter information is described as being output from the data decoder 20 in FIG. 2, this is exemplary and it is also possible to obtain the variable filter information from the video output from the video decoder 30. For example, when variable filter information is included in each frame of a video by a watermark technique, it may be extracted and provided to the variable filter.

6 is a flowchart illustrating a display process according to an embodiment of the present invention.

The display device receives a data source including a video and variable filtering information (S10). The video and the variable filtering information may be input through a broadcasting medium, may be input through a storage medium, or may be input through a communication medium such as a wired or wireless internet. In addition, the video may be input through a storage medium, and the variable filtering information may be input through a communication medium. The input video may be a video compressed in a lossy or lossless manner, or may be an uncompressed video.

After receiving the data source including the video and the variable filtering information, the display device filters the video of the section in which the filter is set (S20). It may be a part or the entire section of the video of the filtering section. Also, the video may be divided into a plurality of filtering sections, and the filtering type may be different for each section. The type of filtering may be divided according to the filtering method and may be divided according to the filtering strength. The strength of the filtering determines the degree of filtering for a given filtering scheme. For example, reducing the resolution to 90% or 80% depends on the strength of the filtering.

The display device outputs the filtered video (S30).

Such a method of filtering unconditionally according to the variable filtering information may be applied to a display device viewed by several people, such as a theater, or may be applied to a home television.

7 is a flowchart illustrating a display process according to another embodiment of the present invention.

The display device receives a data source including a video and variable filtering information (S10). The display apparatus checks whether a user command for the variable filter is input from the intermediate user interface displaying the video (S120), and checks whether the current state is a state using the variable filter (S130).

When the user command is using a variable filter, the display device filters the video of the section in which the filtering is set (S140) and outputs the filtered video (S150). The instruction to use the variable filter may include instructions to readjust the strength of the filtering.

If the user command is not using the variable filter, the display device outputs a video without filtering (S160).

The video is divided into a first section, a second section, and a third section according to the variable filtering information. The first section outputs the resolution at 100%, the second section outputs the resolution at 90%, and the third section. When the section is set to output the resolution at 100%, when the user command is not used in the variable filter, the first to third sections all output the resolution at 100%. When the user command is using a variable filter, the first section outputs the resolution at 100%, the second section outputs the resolution at 90%, and the third section outputs the resolution at 100%.

In addition, when the user command readjusts the strength of the filter by 0.5 times, the first section outputs the resolution at 100%, the second section outputs the resolution at 95%, and the third section outputs the resolution at 100%. When the user command readjusts the strength of the filter twice, the first section outputs the resolution at 100%, the second section outputs the resolution at 80%, and the third section outputs the resolution at 100%.

Referring to FIG. 8, there are 10 video frames before filtering.

The filtering section by the variable filtering information is from the third to the sixth frames f3 to f6. The variable filter reduces the resolution as shown in FIG. 10 for the filtering interval. Reducing the resolution for a frame (or video) may actually mean lowering the resolution, but lowering the resolution and then changing back to the original resolution (downsampling and upsampling to the original resolution). You may. In the latter case, the frames f3 to f6 in the filtering section are low pass filtered to smoothly change the image. On the other hand, although it may be subjected to two filtering processes of downsampling and upsampling, it is also possible to reduce the resolution by using a single filter having an effect equivalent to when downsampling and upsampling.

If the user command includes a value for adjusting the strength of the filtering, the filtering resolution may be resized. For example, if the original video frame is 1920 * 1080 and the user command is input to reduce the strength of the filtering even if the video of the filtering interval is set to 1280 * 720 by the variable filtering information, the setting is 1366 * 768. You can filter.

In the description of FIG. 8, the resolution is reduced, but it is also possible to reduce the resolution of the chrominance while maintaining the luminance.

For example, the filtering section of the 4: 4: 4 format video may be changed to 4: 2: 2 or 4: 2: 0 format. Of course, instead of changing the color format, a histogram reverse equalization of the color is possible. Histogram inverse equalization, as opposed to histogram equalization, serves to reduce the degree of change in color values.

In addition to adjusting the resolution or color resolution, the frame rate can be adjusted. For example, the portion described above with reference to FIG. 4 is a method of adjusting the frame rate.

The description according to the embodiment is only illustrated to help understand the concept of the invention and the scope of the invention should be construed by the claims that follow.

10: data source provider 20: data decoder
30: video decoder 40: audio decoder
50: variable filter 60: video output unit
70: audio output unit 80: user interface

Claims (11)

In the 3D video display device,
The resolution of the 3D video is variably changed on the timeline on which the 3D video is displayed in order to control the fatigue that is synchronized with the 3D video and the 3D video and that viewers may feel while watching the 3D video. A data source providing unit providing a data source including variable filtering information for variably changing a frame rate;
A data decoder for decoding data of the data source;
A video decoder for decoding a video of the data source;
An audio decoder for decoding audio of the data source;
A variable filter for filtering the 3D video for a corresponding section of the data source for which filtering is set according to the variable filtering information;
Video output unit for outputting the 3D video filtered by the variable filter;
An audio output unit for outputting audio from the audio decoder; And
And a user interface for receiving a command of whether or not the variable filter is used and providing a command to the variable filter. delete delete The method of claim 1,
The 3D video display device, characterized in that the command for using the variable filter includes adjusting the strength of the filtering. delete delete The method according to claim 1 or 4,
And a remote controller (remote control) configured to operate in conjunction with the 3D video display device and to switch the on / off of the variable filtering operation and a variable switch to variably or step-by-step the resolution of the screen. 3D video display device.

delete delete delete delete

Images