KR20090037373A - Method and apparatus for reducing fatigue resulting from three dimensional display, and method and apparatus for generating data stream for low-fatigue three dimensional images - Google Patents

Abstract

A method and an apparatus for reducing fatigue when watching a three dimensional image, and a method and an apparatus for generating a low-fatigue three dimensional image data stream are provided to generate a three dimensional image data stream including low-fatigue parameter information which reduces fatigue. A low fatigue degree parameter information obtaining unit(110) obtains low fatigue degree parameter information with regard to a frame interval. A variable vector information obtaining unit(130) obtains variable vector information of a three dimensional image inputted from the low fatigue degree parameter information obtaining unit. The variable vector information obtaining unit outputs variable vector information to a variable adjusting unit(140). A variable limit value determining unit receives lower fatigue parameter information from the low fatigue degree parameter information obtaining unit. The variable limit value determining unit determines a variable limit value which is the maximum limit value and the minimum limit value of a variable with regard to the three dimensional image. A variable adjusting unit receives a variable limit value from the variable limit value determining unit.

Description

Method and apparatus for reducing fatigue caused by watching 3D images, and method and apparatus for generating fatigue fatigue 3D image data stream for low-fatigue three dimensional images}

The present invention relates to a method and apparatus for reducing fatigue that may occur when viewing a 3D image. Specifically, the present invention relates to a method for reducing fatigue by adjusting the variation so that the range of the variation vector of the 3D image does not cause fatigue to the viewer. A method and apparatus and a method and apparatus for generating a three-dimensional image data stream comprising low fatigue degree parameter information for reducing fatigue.

As high-performance display devices are developed and a high-speed communication environment is supported, commercialization of a 3-dimensional display system is expected. However, the fatigue felt by the user when viewing the 3D image is pointed out as the biggest problem.

Since the depth of the image is artificially created to express the stereoscopic effect of the 3D stereoscopic image, even if the same image depth is felt by the user comfortably, the phenomenon of dizziness and eye fatigue may appear differently depending on the observer. have.

Therefore, when the user observes the 3D image, if the image depth does not match the user, the user may feel dizzy or tired of the eyes. When viewing 3D stereoscopic images, the overall fatigue level felt by the user may appear in various forms as well as visual fatigue as well as physiological fatigue such as dizziness and vomiting.

This problem is a major factor that impedes the expansion of the base of the three-dimensional image display.

The problem to be solved by the present invention is to reduce the fatigue by measuring the threshold value of the variation that can cause fatigue when watching the 3D image, by adjusting the variation so that the range of the variation vector of the 3D image does not exceed the threshold of the variation It is to let.

In addition, an object of the present invention is to generate a three-dimensional image data stream including low fatigue degree parameter information for reducing fatigue that may be caused when viewing the three-dimensional image.

In order to achieve the above object, the method for reducing viewing fatigue of a 3D image according to an embodiment of the present invention, low fatigue diagram parameter information for a frame section including at least one frame of the received 3D image Obtaining; Obtaining disparity vector information for each frame of the 3D image; Determining a variation threshold that is a minimum threshold and a maximum threshold of the variation for the 3D image; And comparing the determined disparity threshold value with the acquired disparity vector information to adjust the disparity of the 3D image.

The disparity vector information acquiring step may include extracting the disparity vector information from the low fatigue diagram parameter, wherein the disparity vector information includes a minimum value of the disparity vector for the frame section and a disparity vector for the frame section. Contains the maximum value of.

In the obtaining of the disparity vector information according to another embodiment, performing a disparity estimation method on the received 3D image to determine a minimum value of the disparity vector for the frame section and a maximum value of the disparity vector for the frame section. It includes.

In one embodiment, the determining of the threshold of transition may include determining a viewing distance and an eye distance; Determining a binocular disparity angle using the viewing distance and the eye distance; Determining a pixel size value of the display device using at least one of a horizontal size of a display device, a vertical size of the display device, and a resolution of the display device; And determining the minimum and maximum threshold values of the variation using at least one of the binocular disparity angle, the pixel size value of the display device, the eye distance, and the viewing distance.

In one embodiment, the determining of the threshold of transition includes extracting, from the low-fatigue parameter, at least one of a horizontal size of the display device and a vertical size of the display device as the viewing distance.

In the step of determining the variation threshold according to another embodiment, the extracted viewing distance is different from the actual viewing distance, and the pixel size value of the display device determined using the horizontal size of the extracted display device and the vertical size of the extracted display device. If it is different from the pixel size value of the actual display device, the binocular disparity angle, the maximum limit value and the minimum limit value of the variation are determined using the pixel size value of the actual display device.

In one embodiment, the step of adjusting the variation includes comparing the threshold range of the variation with the obtained variation vector range, wherein the threshold range of the variation is a range between the minimum and maximum threshold values of the variation, and the variation The vector range is characterized in that it is a range between the minimum and maximum values of the obtained disparity vector.

The disparity adjusting step of the exemplary embodiment may further include setting the three-dimensional image by N pixels in a direction opposite to the predetermined direction when the range of the disparity vector is shifted by N pixels in a predetermined direction. Moving in parallel.

In the step of adjusting the variation of another embodiment, when the size of the range of the variation vector is greater than the size of the threshold range of the variation, the size of the range of the variation vector is less than or equal to the size of the threshold range of the variation. And reducing the size of the 3D image by a ratio k when the ratio to be reduced to is k.

The low fatigue diagram parameter information according to an embodiment is extracted from the ISO based media file format when the 3D image data stream is an ISO based media file format.

In another embodiment, the ISO-based media file format includes a moov box, a mdat box, and a meta box, and the low fatigue diagram parameter information for disparity control including the disparity vector information includes a lower level box of the meta box, Extracted from at least one of a lower level box of the moov box, a lower level box of a trak box that is a lower level of the moov box, a lower level box of the trak box, and a lower level box of a meta box that is a lower level of the trak box. .

In one embodiment, a method for reducing fatigue of watching 3D images includes: in a service server providing the 3D image, the 3D image reproduction information including size information of a display device for the 3D image set by the service server; Searching for; And selecting the 3D image when the size information of the 3D image display apparatus set by the service server and the size of the actual 3D image display apparatus to reproduce the 3D image are the same as the search result. Include.

According to an embodiment of the present disclosure, when the size information of the 3D image display apparatus set by the service server and the size of the actual 3D image display apparatus to reproduce the 3D image are different, the low fatigue degree parameter information acquiring step is obtained. The method may further include obtaining fatigue reduction operation information indicating whether the viewing fatigue reduction operation can be performed from the low fatigue degree parameter information, wherein the step of determining the threshold value may include viewing fatigue degree based on the fatigue reduction operation information. When it is confirmed that the reduction operation can be performed, the shift threshold value is determined, and when the viewing fatigue level reduction method of the 3D image is confirmed that the viewing fatigue reduction operation cannot be performed by the fatigue reduction operation information, The display device outputs a warning message to display the 3D image. The method may further include checking whether to play.

In order to achieve the above object, the apparatus for reducing viewing fatigue of a 3D image according to an embodiment of the present invention may provide low fatigue degree parameter information for a frame section including at least one frame of the received 3D image. A low fatigue degree parameter information obtaining unit; A disparity vector information obtaining unit obtaining disparity vector information for each frame of the 3D image; A variation threshold determination unit configured to determine a variation threshold which is a minimum threshold and a maximum threshold of the variation of the 3D image; And a variation controller configured to adjust the variation of the 3D image by comparing the determined variation threshold value with the obtained variation vector information.

In order to achieve the object to be solved, a method for generating a low-fatigue three-dimensional image data stream according to an embodiment of the present invention, the step of determining the disparity vector by performing a disparity estimation for the frame of the three-dimensional image ; Recording the 3D image data in a payload region of the 3D image data stream; And a horizontal size of the display device, a vertical size of the display device, a viewing distance, and the determined variation as a parameter for a frame section including at least one frame of the 3D image in a header area of the 3D image data stream. And recording the low fatigue degree parameter including at least one of the information about the vector and the fatigue reduction task information indicating whether the fatigue reduction task can be performed.

In the low-fatigue parameter recording step of the present embodiment, the information on the determined disparity vector includes a disparity minimum value which is the minimum value of the disparity vector for the frame interval among the determined disparity vector and a maximum value of the disparity vector for the frame interval. It includes at least one of the maximum value.

In the low fatigue diagram parameter recording step, when the 3D image data stream is an ISO based media file format, the low fatigue diagram parameter information is recorded in the ISO based media file format.

In the low fatigue diagram parameter recording step of another embodiment, the ISO-based media file format includes a moov box, a mdat box, and a meta box, and a lower level box of the meta box, a lower level box of the moov box, and the moov box. The low fatigue degree parameter information is recorded in at least one of a lower level box of a trak box, a lower level box of the trak box, and a lower level box of a meta box, which is a lower level of the trak box.

In order to achieve the object to be solved, the apparatus for generating a low-fatigue three-dimensional image data stream according to an embodiment of the present invention, the disparity to determine the disparity vector by performing the disparity estimation for the frame of the three-dimensional image Vector determination unit; A 3D image data recorder for recording the 3D image data in a payload region of the 3D image data stream; And a horizontal size of the display device, a vertical size of the display device, a viewing distance, and the determined variation as a parameter for a frame section including at least one frame of the 3D image in a header area of the 3D image data stream. And a low fatigue diagram parameter recording unit for recording the low fatigue diagram parameter including at least one of information about a vector and fatigue reduction task information indicating whether or not the viewing fatigue reduction task can be performed.

The present invention includes a computer-readable recording medium having recorded thereon a program for implementing a method for reducing viewing fatigue of a 3D image according to an embodiment of the present invention.

The present invention also includes a computer readable recording medium having recorded thereon a program for implementing a method for generating a low fatigue three-dimensional image data stream according to an embodiment of the present invention.

Fatigue reduction method and apparatus that occurs when viewing the three-dimensional image of the present invention, considering the viewing distance, the distance between eyes, the size and resolution of the dislay device, the threshold value of the variation that can cause fatigue when viewing the three-dimensional image By measuring and adjusting the variation so that the range of the disparity vector of the three-dimensional image does not exceed the threshold of the variation, fatigue is reduced.

In addition, the low-fatigue parameter information for each 3D image may be represented in detail through the low-fatigue parameter individually set in units of frame sections in consideration of time.

In addition, the method and apparatus for generating a low fatigue three-dimensional image data stream of the present invention, the header region of the three-dimensional image data stream, by including the low fatigue degree parameter information for reducing the fatigue that can be caused when viewing the three-dimensional image is effective As a result, fatigue can be reduced. Therefore, the 3D image can be viewed for a long time.

1 is a block diagram of an apparatus for reducing viewing fatigue of a 3D image according to an exemplary embodiment of the present invention.

The viewing fatigue reduction apparatus 100 for a 3D image according to an exemplary embodiment of the present invention includes a low fatigue degree parameter information obtaining unit 110, a variation vector information obtaining unit 120, a variation limit determining unit 130, and a variation control. The unit 140 is included.

The low fatigue degree parameter information obtaining unit 110 obtains low fatigue degree parameter information for a frame section including at least one or more frames of the received 3D image, and converts the low fatigue degree parameter information into the variation vector information obtaining unit 120 and Output to the threshold value determination unit 130.

In the present invention, the low fatigue degree parameter refers to a parameter used or helpful in predicting the degree of fatigue occurrence when viewing 3D image content. In the present invention, the display size of the terminal, the viewing distance, the maximum and minimum values of the variation in the content are defined as low fatigue diagram parameters.

The low fatigue diagram parameter information according to an embodiment of the present invention may be individually set for each frame section including at least one frame. Therefore, when the frame period includes all the frames, the same low fatigue parameter information is applied to all the frames, but other low fatigue parameter information may be applied to some frames.

The disparity vector information obtaining unit 120 obtains the disparity vector information of the 3D image from the low fatigue diagram parameter information input from the low fatigue diagram parameter information obtaining unit 110 and the received 3D image, and converts the disparity vector information into the disparity vector information. Output to the adjusting unit 140.

The variation vector information acquisition unit 120 according to an embodiment extracts the variation vector information from the low fatigue diagram parameter. The disparity vector information includes a minimum value of the disparity vector for the frame section and a maximum value of the disparity vector for the frame section. When the same low fatigue degree parameter is applied to all frame sections, one embodiment of the disparity vector information may include an average value of minimum and maximum values of the disparity vector of all the frames.

The disparity vector information acquirer 120 of another embodiment may perform a disparity estimation technique on the received 3D image to determine a minimum value of the variation for the frame section and a maximum value of the variation for the frame section. When the same low fatigue degree parameter is applied to all frame sections, one embodiment of the disparity vector information may include an average value of minimum and maximum values of the disparity vector of all the frames.

The variation limit determination unit 130 receives the low fatigue diagram parameter information from the low fatigue degree parameter information obtaining unit 110, determines a variation limit value which is a minimum limit value and a maximum limit value of the variation for the 3D image, and determines the variation value of the determined variation limit value. Output to the adjusting unit 140.

The variation limit determiner 130 according to an exemplary embodiment determines a viewing distance and an eye distance, and determines a binocular disparity angle using the viewing distance and the eye distance. In addition, the variation limit determiner 130 according to an exemplary embodiment determines the pixel size value of the display device using at least one of the horizontal size of the display device, the vertical size of the display device, and the resolution of the display device. The variation threshold determiner 130 according to an exemplary embodiment determines the minimum and maximum threshold values of the variation using at least one of binocular disparity angle, eye distance and viewing distance, and pixel size values of the display device. A method for determining a variation threshold corresponding to the minimum and maximum threshold values of the variation will be described later with reference to FIG. 3.

The variation limit determiner 130 according to an exemplary embodiment extracts at least one of a viewing distance, a horizontal size of the display device, and a vertical size of the display device from the low fatigue diagram parameter.

The variation threshold determination unit 130 according to another embodiment may have a extracted viewing distance different from an actual viewing distance, and a pixel size value of the display device determined by using the horizontal size of the extracted display device and the vertical size of the extracted display device. When the pixel size value of the actual display device is different from the pixel size value of the actual display device, the binocular disparity angle, the maximum limit value and the minimum limit value of the variation may be determined.

The variation controller 140 receives the variation threshold value from the variation threshold determiner 130, compares the variation threshold value with the variation vector information, and adjusts the variation of the 3D image.

One embodiment of the variation control unit 140 compares the threshold range of the variation with the average range of the variation vector. The threshold range of variation represents a range between the minimum and maximum threshold values of the variation, and the average range of the variation vectors represents a range between the average of the minimum and maximum values of the obtained variation vectors.

According to an exemplary embodiment of the variation controller 140, when a range of variation thresholds and a mean vector range of the variation vector are compared, the range of variation thresholds is three-dimensional image when the range of the average value of the variation vectors deviates by N pixels in a predetermined direction. Is translated by N pixels in the opposite direction to the predetermined direction.

In addition, according to one embodiment of the variation control unit 140, when the size of the average range of the variation vector is larger than the size of the threshold range of the variation, the size of the average range of the variation vector is reduced to a size less than or equal to the size of the threshold range of the variation. When the ratio is k, the size of the 3D image is reduced by the ratio k.

In an embodiment of the viewing fatigue reduction apparatus 100, when the 3D image data stream is an ISO based media file format, a low fatigue degree parameter is extracted from the ISO based media file format.

In another embodiment, when the 3D image data stream is an ISO based media file format, the ISO based media file format includes a moov box, an mdat box, and a meta box. The low fatigue diagram parameter information for disparity control including disparity vector information includes a lower level box of a meta box, a lower level box of a moov box, a lower level box of a trak box that is a lower level of a moov box, a lower level box of a trak box, and It may be extracted from at least one of the lower level boxes of the meta box, which is the lower level of the trak box.

2 is a block diagram of a low-fatigue three-dimensional image data stream generating apparatus according to an embodiment of the present invention.

The apparatus for generating 3D image data stream 200 according to an embodiment of the present invention includes a disparity vector determiner 210, a 3D image data recorder 220, and a low fatigue diagram parameter recorder 230.

The disparity vector determiner 210 determines the disparity vector by performing disparity estimation on the 3D image. The variation estimation technique used in the present invention is a conventional variation estimation technique, which is not described herein.

The 3D image data recorder 220 records the 3D image data in a payload region of the 3D image data stream.

The low fatigue parameter recording unit 230 is a parameter for a frame section including at least one frame of the 3D image in the header area of the 3D image data stream, and includes a horizontal size of the display device, a vertical size of the display device, The low fatigue diagram parameter including at least one of a viewing distance and information on the determined disparity vector is recorded.

According to an embodiment of the low fatigue parameter recording unit 230, when the 3D image data stream is an ISO based media file format, the low fatigue diagram parameter information may be recorded in the ISO based media file format.

According to another embodiment of the low fatigue diagram parameter recording unit 230, when the 3D image data stream is an ISO based media file format, the ISO based media file format includes a moov box, an mdat box, and a meta box. Multi-view camera parameter information includes the lower level box of the meta box, the lower level box of the moov box, the lower level box of the trak box, which is the lower level of the moov box, the lower level box of the trak box, and the lower level of the meta box, which is lower level of the trak box. It can be recorded in at least one of the level boxes.

3 illustrates a method of calculating the maximum and minimum thresholds of variation.

Referring to FIG. 3, the operation method of the variation limit determination unit 130 is described in detail.

Since fatigue may occur when viewing 3D stereoscopic images, the safety standard proposed by the Japanese 3D consortium suggested that the range of the disparity angle due to screen variation should be within ± 1 °. The parallax angle means the difference between the control angle α and the runaway angles β and γ. Therefore, in one embodiment of the present invention, the range of the parallax angle is ± 1 °.

Since the variation due to the parallax angle is expressed in units of pixels on the display screen 300, the threshold range of the variation is determined by the pixel size of the display screen 300, and the pixel size is determined by the size and resolution of the display screen 300. Is determined. In addition, in order to know the audio visual angle, the viewing distance 310 and the eye distance 320 are required. That is, the adjustment angle α 330 can be obtained by trigonometric methods using the viewing distance and the distance between eyes. The runaway angle β 340 and the runaway angle γ 350 for setting the parallax angle to ± 1 ° are set to be different from the adjustment angle α 330 by -1 ° and + 1 °, respectively.

Hereinafter, for example, a process of calculating a threshold of variation is described in detail.

If the display screen 300 has a resolution of 320 × 240 at a size of 2.5 inches, the pixel size of the display screen 300 is 0.159 millimeters. In general, the viewing distance 310 from the display screen 300 to the viewer is 300 millimeters (mm), and the distance 320 between the viewer's eyes is set to 65 millimeters (mm). Using the triangulation method using the viewing distance 310 and the eye distance 320, the adjustment angle α 330 is 12.37 °. Accordingly, the runaway angle β 340 is 11.37 ° and the runaway angle γ 350 is 13.37 °.

According to the trigonometric method using the distance between the eyes, the variation 345 generated by the congestion angle β 340 is 5.73 millimeters, and the variation 355 generated by the congestion angle γ 350 is 5.32 millimeters. When the variations 345 and 355 are expressed in units of pixels, the threshold of the variation is determined to be +36 pixels and -33 pixels.

In another embodiment, when the size of the display screen 300 is 3.5 inches, since the pixel size of the display screen 300 is 0.219 millimeters, the threshold of variation in pixels on a 2.5 inch display screen is 26 pixels, -24 Determined in pixels.

If the same three-dimensional content is displayed by calculating the threshold of the above-described variation, it is confirmed that the threshold of the variation may change if the size of the three-dimensional display screen changes. In a small three-dimensional display screen, even if the variation of the three-dimensional content is large, fatigue occurs when viewing, but in the case of a large display screen, even the same content may have a large fatigue.

Accordingly, in one embodiment of the present invention, it is assumed that a content producer provides display information optimized for the content when the 3D content is produced. This allows the user to search for content in the service server and select an image with less viewing fatigue.

Also, if the optimum size of the content to be played by the user and the size of the terminal is different, if there is a device or a recording medium for performing the fatigue reduction method, the method is performed, and if not, a warning message is displayed to ask the user whether to play. .

4 shows the distribution of ideal disparity vectors.

The minimum value 450 and the maximum value 460 of the disparity vector of the 3D image fall within a range between the minimum limit 410 of the disparity and the maximum limit 420 of the disparity, and the range size 470 of the disparity vector. The range of disparity vectors is ideal if is not greater than the magnitude 430 of the threshold range of mutations. In this case, no post-treatment is required to control the mutation.

In an embodiment of the present invention, in order to obtain a disparity vector, disparity vector information is extracted from header information of a received 3D image data stream. Another embodiment directly determines a disparity vector by performing a disparity estimation technique on the received 3D image.

5A shows the case where the distribution of the disparity vectors is biased in the positive direction.

5A shows that while the range size 530 of the disparity vector is not greater than the size 430 of the threshold range of variation, the minimum value 510 of the variation vector falls within the threshold range of variation (between 410 and 420) but Shows a case where the maximum value 520 of the deviation vector deviates from the threshold range of the variation (between 410 and 420) and the range of the variation vector is shifted by N pixels in the positive direction relative to the threshold range of the variation.

One embodiment of the present invention includes the range of the disparity vector in the negative direction so that the minimum value 510 of the disparity vector and the maximum value 520 of the disparity vector are included in the threshold range of variation (410 and 420). Shift by N pixels to adjust the shift to the adjusted minimum value 550 and the adjusted maximum value 560 of the disparity vector.

FIG. 5B shows a method of controlling variation when the distribution of the variation vector is biased in the positive direction.

According to an embodiment of the shift control unit 140, the shift vectors of the left view image 570 and the right view image 575 of the 3D image are N pixels in the positive direction compared to the threshold range of the shift. Since this is a bias, the shift is adjusted by moving the two images by N pixels in the negative direction. Accordingly, the shift control unit 140 moves the left view image 570 and the right view image 575 in the negative (-) direction, so that the left view image 580 and the right view image whose shift is adjusted, respectively. (585) can be generated.

6A shows the case where the distribution of the disparity vectors is biased in the negative direction.

6A shows that while the range size 630 of the variation vector is not greater than the size range 430 of the threshold range of variation, the minimum value 610 of the variation vector falls within the threshold range of variation (between 410 and 420), but the variation vector. Shows a case where the maximum value 620 is outside the threshold range of variation (between 410 and 420) and the range of the disparity vector is N pixels away in the negative direction relative to the threshold range of variation.

One embodiment of the present invention includes the range of the disparity vector in the positive direction so that the minimum value 610 of the disparity vector and the maximum value 620 of the disparity vector are included in the threshold range of variation (410 and 420). Shift by N pixels to adjust the shift to the adjusted minimum 650 and the adjusted maximum 660 of the disparity vector.

FIG. 6B shows a method of adjusting the shift when the distribution of the shift vector is biased in the negative direction.

According to an embodiment of the shift adjuster 140, the shift vectors of the left view image 670 and the right view image 675 of the 3D image are N pixels in the negative direction, compared to the threshold range of the shift. Since this is a biased case, the shift is adjusted by moving the two images by N pixels in the positive direction. Accordingly, the shift controller 140 moves the left view image 670 and the right view image 675 in the positive (+) direction, so that the left view image 680 and the right view image of which the variation is adjusted, respectively. (685).

7A illustrates the case where the magnitude of the range of the disparity vector is larger than the magnitude of the range of the disparity threshold.

7A shows that while the range size 730 of the disparity vector is greater than the size 430 of the threshold range of variation, the minimum value 710 of the variation vector does not fall within the threshold range of variation (between 410 and 420) of the variation vector. The maximum value 720 also illustrates a case that is outside the threshold range of variation (between 410 and 420).

In this case, the method of parallel shifting the disparity vectors does not allow the disparity vector range (between 710 and 720) to fall within the disparity threshold range (between 410 and 420). One embodiment of the invention adjusts the variation by reducing the magnitude 730 of the variation vector range so as not to be greater than the magnitude 430 of the variation threshold range.

That is, when the magnitude 730 of the disparity vector range is a and the size 770 of the adjusted disparity vector range is reduced, the magnitude 730 of the disparity vector range is reduced to a: b, so that the minimum value (710) of the disparity vector is reduced. And the variation is adjusted such that the maximum value 720 of the disparity vector is the adjusted disparity vector minimum value 750 and the adjusted disparity vector maximum value 760.

FIG. 7B illustrates a method of adjusting the variation when the magnitude of the range of the disparity vector is larger than the magnitude of the range of the disparity threshold.

According to an exemplary embodiment of the shift adjusting unit 140, since the variation vector range of the left view image 780 and the right view image 785 of the 3D image is larger than the threshold range of the variation, the variation is reduced by reducing the two images. Adjust the variation so that the vector range is less than the threshold range for the variation. Accordingly, the shift control unit 140 reduces the left view image 780 and the right view image 785 to a: b, so that the left view image 790 and the right view image 795 of which the shift is adjusted, respectively. Can be generated.

8 illustrates an International Standards Organization (ISO) based media file format.

Referring to FIG. 8, a basic structure of an international standardization organization (ISO) based media file format will be described. ISO file box 800 includes moov box 810 and mdat box 820.

The moov box 810 contains basic header information for video trak or audio trak information, and the mdat box 820 contains substantial video data or audio data. One embodiment of the mdat box 820 includes video or audio frames in interleaved time-ordered order.

9 illustrates a box list of an International Standards Organization (ISO) based media file format according to an embodiment of the present invention.

ftyp box 910 indicates file type and compatibility and includes information about the major type (major_brand) of the file. One embodiment of the present invention is set to "ssav" to indicate that the file is a three-dimensional stereo image. Where ssav stands for stereoscopic audio-video (AV).

The moov box 920 is space for all metadata of timed resources. As described above with reference to FIG. 8, the moov box includes header information or metadata for real media data included in the mdat box 930.

The mdat box 930 is a space for media data, as described above with reference to FIG. 8.

The meta box 940 is also a space for metadata other than the moov box 920. One embodiment of the present invention includes a saif (Safety Information) box 950 at a lower level of the meta box 940 as a space for low fatigue diagram parameters for the 3D image.

The trak box, which is a lower level of the moov box 920, is the space for each independent track or stream for the main AV data or auxiliary data. Another embodiment of the present invention includes the saif box 950 at a lower level of another meta box below the trak box 670 as space for low fatigue diagram parameter information for the 3D image.

Although not shown in FIG. 9, the space for the low-fatigue parameter information for the three-dimensional image includes a lower level box of a meta box, a lower level box of a moov box, a lower level box of a trak box that is a lower level of a moov box, and trak. It may be located in at least one of a lower level box of a box and a lower level box of a meta box, which is a lower level of a trak box.

Accordingly, the embodiment of the disparity vector information acquisition unit 120 obtains disparity vector information from the low-fatigue parameter extracted from the saif box described above with reference to FIG. 9. In addition, the low fatigue diagram parameter recording unit 230 records the low fatigue diagram parameter in the snmi box of the header area of the ISO-based media file format.

10 illustrates a structure of a 3D low fatigue diagram parameter according to an embodiment of the present invention.

3DParams 1010 represents a low fatigue diagram parameter for a 3D image.

The OptimalDisplayHorizontalSize 1020 indicates a horizontal size of an optimal display screen for the provided 3D image data.

OptimalDisplayVerticalSize 1025 represents the vertical size of an optimal display screen for the provided 3D image data.

OptimalViewDistance 1030 represents an optimal viewing distance for the provided 3D image data.

MinDisparity 1040 represents the minimum value of the disparity vector for the frame section of the 3D image.

MaxDisparity 1050 represents the maximum value of the disparity vector for the frame section of the 3D image.

As described above with reference to FIG. 3, the variation threshold determination unit 130 determines the variation threshold using an optimal viewing distance and an optimal display screen size for the 3D image, and changes the viewing distance or the display screen size. In this case, the variation threshold may be adaptively determined through trigonometry using an optimal viewing distance or an optimal display screen size.

According to an embodiment of the variation controller 140, when the variation vector information is obtained from the low-fatigue parameter, the MinDisparity 1040 may be set to the minimum value of the variation vector, and the MaxDisparity 1050 may be set to the maximum value of the variation vector. have.

FIG. 11A illustrates a method for representing a 3D low fatigue diagram parameter in an International Standards Organization (ISO) based media file format according to an embodiment of the present invention.

The expression description Syntax of the low-fatigue parameter shown in FIG. 11A is, in one embodiment described above with reference to FIG. 9, in a saif box 950 for a three-dimensional multiview camera parameter. Corresponding. In the ISO-based media file format, it is not mandatory to have a parameter even in low fatigue (Mandatory: No), and the amount of the parameter is 0 or 1 (Quantity: Zero or one). The definition of each variable is the same as described above in FIG. 10.

An embodiment of the low fatigue degree parameter illustrated in FIG. 11A is an example of a case in which all frames of an image data stream are used as frame sections, and the low fatigue degree parameter 1110 is set identically for all frames.

FIG. 11B illustrates a method of expressing a 3D low fatigue diagram parameter in an International Standards Organization (ISO) based media file format according to another embodiment of the present invention.

The low fatigue diagram parameter of an embodiment of the present invention is variably set according to the time axis, and as an example, the embodiment of FIG. 9B illustrates a case in which the low fatigue diagram parameter is individually set for each frame section including at least one frame. .

The low fatigue diagram parameter is individually defined for each frame section through the for statement 1120. That is, for each frame section, the identification information (ES_ID) 1130 of the current elementary stream, the start frame position information (offset 1140) in the current elementary stream, and the number of frames (length, 1150) in the current frame section are defined. The frame information about the current elementary stream and the current frame section is set, and an individual low fatigue parameter 1160 is set for each frame section.

12 is a flowchart of a method for reducing viewing fatigue of a 3D image according to an embodiment of the present invention.

In operation 1210, low-fatigue parameter information for a frame section including at least one frame of the received 3D image is obtained.

In operation 1220, disparity vector information of each frame of the 3D image is obtained.

In an embodiment of the present invention, disparity vector information may be extracted from a low-fatigue parameter, and disparity vector information may be directly obtained by performing disparity estimation on a 3D image.

In step 1230, the variation threshold, which is the minimum and maximum threshold of variation for the 3D image, is determined.

In one embodiment of the present invention, the variation limit is determined by a triangulation method using a viewing distance, an eye distance, a horizontal size of a display screen, a vertical size, a resolution, and the like.

In operation 1240, the variation of the 3D image is adjusted by comparing the disparity threshold and the disparity vector information.

In one embodiment of the present invention, when the size of the variation vector range is smaller than the size of the variation threshold range and the variation vector range is out of the variation threshold range, the variation is adjusted through parallel movement.

In another embodiment, if the magnitude of the disparity vector range is greater than the magnitude of the disparity threshold range, the disparity is adjusted by reducing the image.

Further, in an embodiment of the present invention, in the service server for providing the 3D image, the 3D image reproduction information including the size information of the display device for the 3D image set by the service server is retrieved. As a result of the search, when the size information of the 3D image display apparatus set by the service server and the size of the actual 3D image display apparatus to reproduce the 3D image are the same, the 3D image is selected.

If the size information of the 3D image display apparatus set by the service server side and the size of the actual 3D image display apparatus to reproduce the 3D image are different from each other, whether viewing fatigue can be reduced from low fatigue degree parameter information. Fatigue reduction task information indicating whether or not is obtained.

If the fatigue reduction operation information confirms that the viewing fatigue reduction operation can be performed, the operation for determining the variation threshold is performed. On the other hand, if it is confirmed that the fatigue reduction task cannot be performed by the fatigue reduction task information, the display apparatus outputs a warning message and checks whether or not the corresponding 3D image is reproduced.

13 is a flowchart of a method for generating a low-fatigue three-dimensional image data stream according to an embodiment of the present invention.

In operation 1310, the disparity vector is determined by performing disparity estimation on the frame of the 3D image.

In operation 1320, 3D image data is recorded in a payload region of the 3D image data stream.

In operation 1330, as a parameter for a frame section including at least one frame of the 3D image in the header area of the 3D image data stream, the horizontal size of the display device, the vertical size of the display device, the viewing distance, and the determined variation vector may be used. The low fatigue diagram parameter including at least one of the information about the user information and the fatigue reduction task information indicating whether or not the fatigue reduction task can be performed is recorded.

In one embodiment, the information about the variation vector includes at least one of a variation minimum value that is an average of minimum values of the variation vectors for all frames among the variation vectors and a variation maximum value that is an average of maximum values of the variation vectors for all frames. .

Meanwhile, the above-described embodiments of the present invention can be written as a program that can be executed in a computer, and can be implemented in a general-purpose digital computer that operates the program using a computer-readable recording medium. The computer-readable recording medium may be a magnetic storage medium (for example, a ROM, a floppy disk, a hard disk, etc.), an optical reading medium (for example, a CD-ROM, a DVD, etc.) and a carrier wave (for example, the Internet). Storage medium).

So far I looked at the center of the preferred embodiment for the present invention. Those skilled in the art will appreciate that the present invention can be implemented in a modified form without departing from the essential features of the present invention. Therefore, the disclosed embodiments should be considered in descriptive sense only and not for purposes of limitation. The scope of the present invention is shown in the claims rather than the foregoing description, and all differences within the scope will be construed as being included in the present invention.

1 is a block diagram of an apparatus for reducing viewing fatigue of a 3D image according to an exemplary embodiment of the present invention.

2 is a block diagram of a low-fatigue three-dimensional image data stream generating apparatus according to an embodiment of the present invention.

3 illustrates a method of calculating the maximum and minimum thresholds of variation.

4 shows the distribution of ideal disparity vectors.

5A shows the case where the distribution of the disparity vectors is biased in the positive direction.

FIG. 5B shows a method of controlling variation when the distribution of the variation vector is biased in the positive direction.

6A shows the case where the distribution of the disparity vectors is biased in the negative direction.

FIG. 6B shows a method of adjusting the shift when the distribution of the shift vector is biased in the negative direction.

7A illustrates the case where the magnitude of the range of the disparity vector is larger than the magnitude of the range of the disparity threshold.

FIG. 7B illustrates a method of adjusting the variation when the magnitude of the range of the disparity vector is larger than the magnitude of the range of the disparity threshold.

8 illustrates an International Standards Organization (ISO) based media file format.

9 illustrates a box list of an International Standards Organization (ISO) based media file format according to an embodiment of the present invention.

10 illustrates a structure of a 3D low fatigue diagram parameter according to an embodiment of the present invention.

FIG. 11A illustrates a method for representing a 3D low fatigue diagram parameter in an International Standards Organization (ISO) based media file format according to an embodiment of the present invention.

FIG. 11B illustrates a method of expressing a 3D low fatigue diagram parameter in an International Standards Organization (ISO) based media file format according to another embodiment of the present invention.

12 is a flowchart of a method for reducing viewing fatigue of a 3D image according to an embodiment of the present invention.

13 is a flowchart of a method for generating a low-fatigue three-dimensional image data stream according to an embodiment of the present invention.

Claims (3)

In the method for generating a stereoscopic video bitstream, Inserting low-fatigue parameter information for a frame section including at least one frame of a stereoscopic image into the image bitstream; And Inserting the stereoscopic video data into the video bitstream; The low fatigue diagram parameter includes at least one of horizontal size information and vertical size information of a display device preset for the stereoscopic image, viewing distance information, and information on a disparity vector for the stereoscopic image, and the stereoscopic image. Stereoscopic video bitstream generation method characterized in that it is used to play. The method of claim 1, The information on the disparity vector, at least one of the maximum value information and the minimum value information of the disparity vector value between the left view image and the right view image of the stereoscopic image, characterized in that the method. The method of claim 1, wherein the video bitstream generation method comprises: When the video bitstream is an ISO (International Standardization Organization) based media file format, inserting a low-fatigue parameter about the three-dimensional image into at least one box in the video bitstream, and at least one of the video bitstream And inserting the 3D image data into a box.

Images