WO2017003054A1 - Method for displaying 3d image and device for same - Google Patents

Abstract

Disclosed is a device according to one embodiment of the present invention, comprising a camera which captures images of the eyes of a user watching a 3D video, and a control unit which obtains features of the user's eyes from the captured images of the user's eyes, determines the level of fatigue of the user's eyes on the basis of the obtained features of the user's eyes, and adjusts the parallax of the 3D video according to the level of fatigue of the user's eyes.

Description

Method for displaying 3D image and apparatus for same

The present disclosure relates to three-dimensional (3D) display technology, and more specifically, to devices and methods for adjusting 3D display effects.

With the rapid development of electronic and 3D display technologies, various electronic devices supporting 3D video playback have entered the daily life of users. This allows users to watch 3D video even if they do not go to the cinema. In addition, the stereoscopic depth effect of 3D video provides an enhanced visual experience. Currently, research on 3D display technology has become one of the research trends in the field of display.

The principle of 3D display technology is to create a binocular parallax by providing two images that are slightly different for each of the right and left eyes, creating a 3D stereoscopic effect on the brain. For example, the position of the first object 10 in the left eye image may be different from the position of the first object 20 in the right eye image. Throughout the specification, the left eye image may mean an image provided to the left eye, and the right eye image may mean an image provided to the right eye.

Parallax may refer to a difference in position of the same object in the left eye image and the right eye image. That is, parallax may mean a difference between a position on the left retina and a position on the right retina of the same object. For example, when the same object forms an image at a position of 4 mm to the left of the center of the left eye (Fovea) and an image is formed at a position of 3 mm to the left of the center of the right eye, the parallax of the object may be 1 mm. In addition, the parallax may mean a difference between positions in the left eye image and the right eye image of the same object.

In stereoscopic display systems based on display screens, the greater the parallax, the more pronounced the out-of-screen and in-screen effects of the object are. The out-of-screen effect may refer to a three-dimensional effect that the object feels as if it sticks out of the screen, and the in-screen effect may refer to a three-dimensional feeling that the object feels as if it enters the screen.

Specifically, the parallax may be divided into a negative parallax, a positive parallax, and a zero parallax according to a difference in the position of the same object in the left eye image and the right eye image.

Some embodiments may provide an apparatus and method for adjusting the parallax of 3D video based on the degree of eye fatigue of a user.

1 shows an example for each of a negative parallax, a positive parallax and a zero parallax in 3D display technology.

2 shows a diagram that adjusts the 3D display effect according to the current degree of fatigue of the user, in accordance with some embodiments of the present disclosure.

3 shows a block diagram of a device, in accordance with some embodiments of the present disclosure.

4 shows a flowchart illustrating a method for adjusting a 3D display effect, in accordance with some embodiments of the present disclosure.

5 shows a flowchart illustrating a method for adjusting a 3D display effect, in accordance with some other embodiments of the present disclosure.

6 is a diagram illustrating an example of adjusting a parallax parameter according to some embodiments of the present disclosure.

7 shows a flowchart illustrating a method for adjusting a 3D display effect according to some other embodiments of the present disclosure.

8 is a diagram illustrating an example of adjusting a parallax parameter according to another embodiment of the present disclosure.

9 illustrates an example of adjusting parallax parameters based on a focusing feature of the eye of the human body when the scene changes, in accordance with some embodiments of the present disclosure.

10 shows a flowchart illustrating a method for adjusting 3D display effects, in accordance with some other embodiments of the present disclosure.

11 illustrates an example of a user interface for adjusting 3D display effects, in accordance with some embodiments of the present disclosure.

12 is a block diagram of a device, in accordance with some embodiments of the present disclosure.

13 is a block diagram of a device, according to some other embodiments of the present disclosure.

As a technical means for achieving the above-described technical problem, a first aspect of the present disclosure is to obtain a feature of the user's eyes from the camera for photographing the eyes of the user watching the 3D video, and the image of the user's eyes taken The device may include a controller configured to determine a degree of eye fatigue of the user based on the acquired eye characteristics, and to adjust a parallax of the 3D video according to the degree of eye fatigue of the user.

Further, the control unit is a parallax that is the difference between the average parallax between the left-eye image and the right-eye image of the 3D video, the maximum value of the negative parallax, the maximum value of the positive parallax, and the maximum value of the negative parallax and the maximum value of the positive parallax By adjusting at least one of the ranges, the parallax of the 3D video can be adjusted.

The eye feature of the user may include at least one of a blinking frequency, eye closing time, a change in binocular focus, and a binocular convergence angle.

The controller may adjust the parallax of the 3D video when the determined degree of eye fatigue is greater than or equal to the first threshold.

The controller may determine whether or not the parallax of the 3D video is greater than or equal to the second threshold value, and if the parallax of the 3D video is greater than or equal to the second threshold value, the controller controls the parallax of the 3D video to be less than the second threshold value. I can adjust it.

The controller may adjust the parallax of the 3D video by adjusting the rate of change of parallax between the frames of the 3D video.

The controller may determine a difference in parallax between the nth frame and the n-1th frame of the 3D video, and, if the difference in parallax is greater than or equal to the third threshold, such that the difference in parallax becomes less than the third threshold, By adjusting the parallax of the nth frame, the rate of change of parallax between the frames of the 3D video can be adjusted.

In addition, the controller may adjust the rate of change of parallax between frames of the 3D video by increasing the parallax of the nth frame so that the parallax difference is less than the third threshold.

The device may further include an output unit, and the controller may control the output unit to output the 3D video whose parallax is adjusted to the user.

In addition, the device may display, on the output unit, a notification window indicating that the parallax of the 3D video has been adjusted.

Further, a second aspect of the present disclosure provides a method of photographing a user's eye watching a 3D video, acquiring a feature of the user's eye from an image of the captured user's eye, and based on the acquired eye feature. Determining a degree of fatigue of an eye, and adjusting the parallax of the 3D video according to the degree of fatigue of the user's eye.

In addition, the step of adjusting the parallax of the 3D video according to the degree of fatigue of the user, the average parallax between the left-eye image and the right-eye image of the 3D video, the maximum value of the negative parallax, the maximum value of the positive parallax and negative And adjusting at least one of a parallax range that is a difference between the maximum value of the parallax and the maximum value of the positive parallax.

In addition, adjusting the parallax of the 3D video according to the degree of fatigue of the user may include adjusting the parallax of the 3D video when the determined degree of fatigue of the user is greater than or equal to a first threshold.

In addition, the step of adjusting the parallax of the 3D video according to the degree of fatigue of the user, determines whether the parallax of the 3D video is greater than or equal to the second threshold, and if the parallax of the 3D video is greater than or equal to the second threshold, the 3D video Adjusting the parallax of the 3D video such that the parallax of is less than the second threshold.

In addition, adjusting the parallax of the 3D video according to the degree of fatigue of the user may include adjusting the parallax of the 3D video by adjusting a rate of change of parallax between frames of the 3D video.

In addition, by adjusting the rate of change of parallax between frames of the 3D video, adjusting the parallax of the 3D video includes determining a difference in parallax between the nth frame and the n-1th frame of the 3D video, And adjusting the disparity of the n-th frame to adjust the rate of change of the parallax between frames of the 3D video so that if the difference is greater than or equal to the third threshold, the disparity is less than the third threshold.

In addition, adjusting the parallax of the nth frame such that the difference in parallax is less than the third threshold increases the parallax of the nth frame so that the parallax difference is less than the third threshold, thereby increasing the 3D video. And adjusting the rate of change of parallax between frames.

The method of adjusting the 3D display effect may further include outputting the parallax adjusted 3D video to the user.

Also, the method of adjusting the 3D display effect may further include displaying a notification window indicating that the parallax of the 3D video has been adjusted.

Terms used herein will be briefly described and the present invention will be described in detail.

The terms used in the present invention have been selected as widely used general terms as possible in consideration of the functions in the present invention, but this may vary according to the intention or precedent of the person skilled in the art, the emergence of new technologies and the like. In addition, in certain cases, there is also a term arbitrarily selected by the applicant, in which case the meaning will be described in detail in the description of the invention. Therefore, the terms used in the present invention should be defined based on the meanings of the terms and the contents throughout the present invention, rather than the names of the simple terms.

When any part of the specification is to "include" any component, this means that it may further include other components, except to exclude other components unless otherwise stated. In addition, the terms "... unit", "module", etc. described in the specification mean a unit for processing at least one function or operation, which may be implemented in hardware or software or a combination of hardware and software. .

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

In related fields, a method of improving the comfort level of a user's eyes by reducing parallax produces a satisfactory 3D stereoscopic display effect while enhancing the comfort level when watching 3D video, while the effect of the image is similar to that of a 2D display. Can be done.

To this end, in accordance with some embodiments of the present disclosure, when viewing 3D video, the parallax parameters of the 3D video may be adjusted based on the degree of fatigue of the user's eyes in order to improve the level of comfort. By adjusting the parallax parameter of the 3D video based on the degree of eye fatigue of the user, it is possible to maximize the stereoscopic display effect of the 3D video while reducing the eye fatigue of the user.

1 shows an example for each of a negative parallax, a positive parallax and a zero parallax in 3D display technology. As shown in FIG. 1A, the object 40 may have a negative parallax, and the object 40 having a negative parallax may feel as if it is located in front of the screen. As shown in FIG. 1B, the object 40 may have positive parallax, and the object 40 having positive parallax may feel as if it is located behind the screen. As shown in FIG. 1C, the object 40 may have a parallax of zero, and the object 40 having a parallax of zero may be perceived as being displayed on the screen, that is, any perception from the image. Without the depth effect present, it may feel as if the object 40 is displayed as a typical 2D display effect. In general, compared with positive parallax, negative parallax can provide a more pronounced stereoscopic effect. In the case of positive parallax or negative parallax, a stereo effect with a larger parallax value may appear more pronounced than a stereo effect with a smaller parallax value.

The larger the parallax, the deeper perception the user can feel, but the greater the parallax, the greater the discomfort and eye fatigue of the user, which is likely to increase the burden on the user's eyes. According to Panum's law, the user's eyes have a limited ability to merge two parallax images into a single image. That is, when the parallax is greater than any value, the user can see two images instead of one image. In another aspect, when viewing an object, both eyes must focus on the object so that the user combines the different images seen by both eyes into one stereoscopic image through the Fusion function of the brain. The angle formed between the lines of sight from the two eyes to the focus point 30 may be referred to as a convergence angle.

As shown in (a) and (b) of FIG. 1, the object 40 having a negative parallax shown in (a) of FIG. 1 is an object having a positive parallax shown in (b) of FIG. Compared with 40, it has a larger convergence angle. In physiology, eye fatigue is likely to occur when looking at objects with large convergence angles (ie when looking at objects at close range). Thus, compared with objects with positive parallax, objects with negative parallax have an improved stereoscopic effect, but can more easily cause eye fatigue.

In general, in the related art, processing techniques for reducing parallax of an object in stereoscopic video are designed such that both positive parallax and negative parallax are limited to some extent. Reduced parallax may mean closer to zero parallax to form a smaller convergence angle, and may make the effect of the image feel closer to 2D reproduction. Accordingly, the comfort level of the eye is improved while the 3D stereoscopic display effect of the image can be sacrificed. Reduction of the 3D stereoscopic display effect of an image may make the effect of the image feel closer to 2D reproduction. For this reason, when improving stereoscopic viewing comfort by reducing parallax, the stereoscopic feeling of the user can be significantly reduced.

In addition, large parallax or large convergence angles within any range may not immediately affect eye fatigue and comfort levels. Similarly, a user may feel eye discomfort only after viewing a book or computer display for a long time. Therefore, even in the same parallax 3D reproduction, the degree of feeling of fatigue may vary depending on the viewing time or the state of the eyes of the user.

In conclusion, in existing methods for adjusting the 3D stereoscopic display effect, it is difficult to ensure the stereoscopic display effect of the 3D video while ensuring the healthy use of the user's eyes.

2 shows a diagram that adjusts the 3D display effect according to the current degree of fatigue of the user, in accordance with some embodiments of the present disclosure.

As shown in FIG. 2, for example, when the 3D video 230 is viewed by the user, the user's head image is captured by the image capturing device 210 to parse the eye image 220 of the user. For example, it may be photographed by a camera, and face recognition may be performed based on a computer vision library (eg, Opencv library). Also, a feature of the eye of the user may be obtained from the eye image 220 of the user. After the eye feature is obtained, based on the acquired eye feature, the degree of fatigue of the user's current eye may be determined, and based on the current degree of fatigue of the user, the parallax parameter of the 3D video 230 may be adjusted. Can be. Accordingly, the level of comfort may be improved when watching the 3D video 230. In this way, the 3D display effect can be automatically adjusted based on the current degree of eye fatigue of the user. Therefore, while ensuring the 3D display effect, the inconvenience of the user's eyes caused when watching the 3D video 230 can be effectively reduced.

3 illustrates a block diagram of a device 1000, in accordance with some embodiments of the present disclosure.

According to FIG. 3, the device 1000 may include an eye feature acquirer 60, an eye fatigue degree determiner 70, and a parallax adjuster 80. Configurations of the device 1000 may include general purpose hardware processors such as image sensors, digital signal processors (DSPs) and field programmable gate arrays (FPGAs), or special purpose chips such as dedicated chips to perform specific functions. It may be implemented by a hardware processor or entirely in software through computer programs such as individual modules in an application for adjusting the 3D display effect installed in the device 1000.

Also, the eye feature acquisition unit 60, the eye fatigue degree determination unit 70, and the parallax adjustment unit 80 may be implemented by executing software such as a computer program by hardware. In this case, the eye feature acquisition unit 60, the eye fatigue degree determination unit 70, and the parallax adjustment unit 80 may be implemented as one controller (not shown). In addition, the eye feature acquirer 60 and the eye fatigue degree determiner 70 may be implemented as one controller (not shown), and the parallax adjusting unit 80 may be implemented as a separate image processor (not shown). In the device 1000 described above, the eye feature acquisition unit 60 is used to acquire the eye feature of the user when the user watches the 3D video.

In detail, when the user watches a 3D video, the eye feature acquirer 60 may control the image capturing device to capture the user's head image. After the user's head image is obtained, the eye feature acquirer 60 may detect the user's head from the recognized face area. Face recognition may be performed from the user's head image based on a computer vision library to parse the eye image. In addition, the eye feature acquirer 60 may extract a feature of the eye of the user from the acquired eye image.

For example, the eye feature acquirer 60 may include blinking frequency, eye-closed time, and binocular focus as eye features from an eye image of the user photographed when the user watches a 3D video. At least one of the change in the binocular focus points and the binocular convergence angle may be extracted.

The eye fatigue degree determiner 70 may determine the degree of fatigue of the current eye of the user according to the acquired eye characteristics. For example, the degree of eye fatigue may be a value indicating a degree of fatigue of a current eye of a user based on a dynamically determined eye characteristic.

For example, the eye fatigue degree determining unit 70 may determine that the eye fatigue of the user is greater as the number of times of blinking of the eyes per unit time increases.

Also, for example, the eye fatigue degree determiner 70 may determine that eye fatigue information is large when the user's closing time increases.

In addition, for example, when the eye feature acquired by the eye feature acquisition unit 60 is a change in the binocular focus of the user, the eye fatigue degree determining unit 70 is based on the change in the binocular focus of the user, Can be used to comprehensively analyze the current eye fatigue. For example, it may be determined that the more frequent the change of binocular focus per unit time, the greater the degree of eye fatigue of the user.

For example, when the binocular convergence angle is greater than or equal to the threshold, the eye fatigue degree determining unit 70 may determine that the eye fatigue of the user is greater as the binocular convergence angle becomes larger.

The parallax adjustment unit 80 may adjust the parallax parameter of the 3D video according to the current degree of eye fatigue of the user. The parallax parameter may mean an average parallax, a maximum value of a negative parallax, a maximum value of a positive parallax, or a parallax range of each pixel pair between a left eye image and a right eye image of three videos. As described above, the parallax may mean a difference between positions of the same object in the left eye image and the right eye image.

Accordingly, in order to obtain a parallax parameter of the 3D video, a pixel in the right eye image corresponding to each pixel in the left eye image, that is, a pixel in the right eye image matching each pixel in the left eye image, is detected and matched. An image matching method may be performed in which a parallax (ie, a difference in displacement) between pixels to be obtained is obtained. Pixels in the right-eye image corresponding to pixels in the left-eye image and pixels in the left-eye image may mean pixels in the left-eye image and pixels in the right-eye image representing one point in the same object.

As the parallax of each pixel in the 3D video is obtained, an average parallax or a parallax range consisting of a maximum parallax and a minimum parallax may be obtained. By adjusting the average parallax or parallax range, the eye fatigue of the user can be reduced. The average parallax may mean an average of parallaxes between matching pixels in one frame, and the parallax range may be a maximum of positive parallaxes and a maximum of negative parallaxes among parallaxes between matching pixels in one frame. It can mean the difference between the values.

In detail, after the user's current eye fatigue degree is determined by the eye fatigue degree determining unit 70, the parallax adjusting unit 80 may determine whether the user's current eye fatigue degree is greater than or equal to an eye fatigue threshold. The eye fatigue threshold may be a preset threshold used to determine whether the user feels tired. By way of example, by comparing the current eye fatigue level of the user with an eye fatigue threshold, it may be determined whether the 3D display effect should be adjusted. For example, the parallax adjustment unit 80 may not adjust the parallax parameter of the 3D video when the user's current eye fatigue is less than the eye fatigue threshold.

On the other hand, the parallax adjustment unit 80 may adjust the parallax parameter of the 3D video in an appropriate manner when the user's current eye fatigue is more than the eye fatigue threshold. For example, when the current eye fatigue level of the user is greater than or equal to the eye fatigue threshold, the parallax adjusting unit 80 determines whether or not the parallax parameter of the 3D video is greater than or equal to the parallax parameter threshold, and the parallax parameter of the 3D video is determined. When more than the parallax parameter threshold, the parallax parameter of the 3D video may be adjusted such that the parallax parameter of the 3D video is within the parallax parameter threshold. The parallax parameter threshold may be predetermined and may be dynamically determined according to the current degree of eye fatigue of the user.

For example, the parallax parameter threshold may be a predetermined average parallax, parallax range or inherent average parallax, or may be a parallax range corresponding to the current degree of eye fatigue of a user. Specifically, an appropriate parallax parameter adjusting function may be selected according to a preset condition, and the parallax parameter may be adjusted within a parallax parameter threshold according to the parallax parameter adjusting function. In the parallax parameter adjusting function, may denote a parallax parameter of the 3D video after adjustment, may denote a degree of fatigue of the user's current eye, and may denote a parallax parameter of the 3D video before adjustment. In the parallax parameter adjustment function, the parallax parameter threshold may be a reduction function of the degree of fatigue of the user's current eye. That is, the parallax parameter threshold of the 3D video may decrease as the degree of fatigue of the current eye of the user increases.

On the other hand, according to the visual characteristic of the eye of the human body focusing when looking at an object, the processing technique for adjusting the parallax is not only a method of reducing the average parallax or parallax range, but also caused by the human eye continuously changing the parallax. It may be a method of guaranteeing a smooth change of the parallax to prevent the feeling of discomfort.

The parallax adjustment unit 80 also determines whether the difference between the parallax parameter of the current frame of the 3D video and the parallax parameter of the previous frame is greater than or equal to the parallax variation threshold, and the difference between the parallax parameter of the current frame and the previous frame is greater than or equal to the parallax variation threshold. When the parallax parameter of the current frame and the previous frame is within the parallax variation threshold, the parallax parameter of the current frame of the 3D video may be adjusted.

The parallax variation threshold may be predetermined and may be dynamically determined according to the current degree of eye fatigue of the user. For example, the parallax change threshold is a predetermined threshold used to measure a mean parallax or a change in the parallax range, or used to measure a change in the parallax range corresponding to the average parallax or the current degree of eye fatigue of a user. May be a unique threshold value. In detail, an appropriate parallax parameter adjusting function may be selected according to preset conditions, and the parallax parameter of the current frame of the 3D video may be set so that the difference in the parallax parameter between the current frame and the previous frame is within a parallax variation threshold. Can be adjusted accordingly. In the parallax parameter adjusting function, may denote a parallax parameter of the 3D video after being adjusted, may denote a degree of fatigue of the current eye of the user, and may denote a parallax parameter of the 3D video before being adjusted. In the parallax parameter adjustment function, the parallax variation threshold may be a decreasing function of the degree of fatigue of the user's current eye. That is, the parallax variation threshold of the 3D video may decrease as the degree of fatigue of the current eye of the user increases.

As another example, when the current degree of eye fatigue of the user is greater than or equal to the eye fatigue threshold, the parallax adjusting unit 80 may also adjust the parallax according to the visual characteristics of the eye of the human body focusing when viewing an object. The parallax adjustment unit 80 determines whether the difference between the parallax parameter of the current frame of the 3D video and the parallax parameter of the previous frame is greater than or equal to the parallax variation threshold value, and when the difference between the parallax parameter of the current frame and the previous frame is greater than or equal to the parallax variation threshold value, The parallax parameter of the current frame of the 3D video may be adjusted such that the parallax parameter difference between the current frame and the previous frame is within the parallax variation threshold.

The device 1000 illustrated in FIG. 3 may further include an output unit (not shown) for outputting 3D video to the user according to the adjusted parallax parameter as an additional configuration. By way of example, the output can be a display device (eg, a display).

In the above method, in order to achieve the technical effect of the 3D image display according to the physiological characteristics of the eye of the human body, the 3D display effect can be adjusted according to the degree of fatigue of the user's current eye at an appropriate moment, and thus the eye fatigue of the user. At the same time, the stereoscopic display effect of 3D video can be maximized.

4 shows a flowchart illustrating a method for adjusting a 3D display effect, in accordance with some embodiments of the present disclosure.

The method for adjusting the 3D display effect may be implemented by the device 1000 disclosed in FIG. 3, or may be implemented entirely in software through an application for adjusting the 3D display effect.

Referring to FIG. 4, in operation S410, when a user views a 3D video, a feature of an eye of the user may be acquired.

Specifically, when the user watches the 3D video, the head image of the user may be photographed by the image capturing device, and after the head image of the user is obtained, computer vision for parsing the user's eye image from the recognized face area Face recognition may be performed from the user's head image based on the library. In addition, the eye feature of the user may be extracted from the acquired eye image.

For example, at least one of a blinking frequency, eye closing time, a change in binocular focus, and a binocular convergence angle may be extracted from the eye image of the user photographed when the user watches the 3D video.

In operation S420, the degree of fatigue of the current eye of the user may be determined according to the acquired eye characteristics. For example, the degree of eye fatigue may be a value indicating the degree of fatigue of the user's current eye based on the dynamically determined eye characteristics. For example, when the eye feature acquired in step S410 is a change in the binocular focus of the user, a value representing the current degree of fatigue of the user may be comprehensively analyzed based on the change in the binocular focus of the user.

In step S430, the parallax parameter of the 3D video may be adjusted according to the current degree of eye fatigue of the user. The parallax parameter may refer to an average parallax or parallax range of each pixel pair between the left eye image and the right eye image of 3 video. As described above, the parallax may mean a difference between positions of the same object in the left eye image and the right eye image. Accordingly, in order to obtain a parallax parameter of the 3D video, a pixel in the right eye image corresponding to each pixel in the left eye image, that is, a pixel in the right eye image matching each pixel in the left eye image, is detected and matched. An image matching method may be performed in which a parallax (ie, a difference in displacement) between pixels to be obtained is obtained.

As the parallax of each pixel in the 3D video is obtained, a parallax range consisting of the average parallax or the maximum parallax and the minimum parallax of the 3D video may be obtained. By adjusting the average parallax or parallax range, the eye fatigue of the user can be reduced.

Specifically, the parallax parameter of the 3D video may be adjusted in a suitable manner based on the degree of fatigue of the user's current eye. An example of adjusting the display image of 3D video will be described in detail with reference to FIGS. 5-9.

5 shows a flowchart illustrating a method for adjusting a 3D display effect, in accordance with some other embodiments of the present disclosure.

Referring to FIG. 5, since steps S510 and S520 are similar to steps S410 and S420 illustrated in FIG. 4, descriptions of steps S510 and S520 of FIG. 5 will be omitted.

In operation S530, it may be determined whether the current degree of eye fatigue of the user is greater than or equal to an eye fatigue threshold. The eye fatigue threshold may be a preset threshold used to determine whether the user feels tired. . Specifically, by comparing the current degree of fatigue of the user with the eye fatigue threshold, it may be determined whether the 3D display effect should be adjusted.

Specifically, when the current eye fatigue level of the user is below the eye fatigue threshold, the parallax parameter of the 3D video may not be adjusted. Accordingly, in step S560, it may be determined whether 3D video reproduction is stopped. When playback of the 3D video is not stopped, the method returns to step S510 where the eye features of the user when the user watches the 3D video can be acquired.

On the other hand, when the degree of fatigue of the user's current eye is greater than or equal to the eye fatigue threshold, in step S540, it may be determined whether or not the parallax parameter of the 3D video is greater than or equal to the parallax parameter threshold. By way of example, the parallax parameter threshold may be predetermined and may be dynamically determined according to the current degree of eye fatigue of the user. For example, the parallax parameter threshold may be a predetermined average parallax, parallax range or inherent average parallax, or may be a parallax range corresponding to the current degree of eye fatigue of a user.

When the parallax parameter is greater than or equal to the parallax parameter threshold, in step S550, the parallax parameter of the 3D video may be adjusted to be within the parallax parameter threshold.

Subsequently, an example of adjusting the parallax parameter when the parallax parameter is greater than or equal to the parallax parameter threshold will be described with reference to FIG. 6. For example, the parallax parameter may in particular be a parallax range of 3D video, so the parallax parameter threshold may mean an acceptable parallax range.

Specifically, referring to FIGS. 6A and 6B, the lighter color portion corresponds to the parallax value within the parallax parameter threshold 610, and the darker color portion corresponds to the parallax value greater than or equal to the parallax parameter threshold 610. It can correspond to. In FIG. 6, "X" may mean an exemplary value among parallaxes between matching pixels in one frame. . The leftmost pixel 643 is the pixel having the maximum value of negative parallax in one frame, and the rightmost pixel 645 is the pixel having the maximum value of positive parallax in one frame. have.

Specifically, as illustrated in FIG. 6A, the interval 630 between dashed lines may mean a parallax range of 3D video in one frame. As shown in FIG. 6A, some pixels 641, 643, 645 having parallaxes above the parallax parameter threshold may be adjusted such that the parallax becomes less than or equal to the parallax parameter threshold.

In addition, as illustrated in FIG. 6B, the parallax range 630 may be reduced to be located within the parallax parameter threshold 610 to alleviate eye fatigue of the user. An appropriate parallax parameter adjustment function may be selected and the parallax parameter of the 3D video may be adjusted (decreased) within the parallax parameter threshold according to the parallax parameter adjustment function. In the parallax parameter adjusting function, may denote a parallax parameter of the 3D video after adjustment, may denote a degree of fatigue of the user's current eye, and may denote a parallax parameter of the 3D video before adjustment. In the parallax parameter adjustment function, the parallax parameter threshold may be a reduction function of the degree of fatigue of the user's current eye. That is, the parallax parameter threshold of the 3D video may decrease as the degree of fatigue of the current eye of the user increases. Through such adjustment, the parallax range 630 of the 3D video may be indicated by dashed lines, as shown in FIG. That is, pixels 641, 643, and 645 above the parallax parameter threshold may be adjusted within the parallax parameter threshold 610, thus reducing the degree of fatigue of the user's eyes.

After the parallax parameter of the 3D video is adjusted, in step S560, it may be determined whether 3D video reproduction is stopped. When the 3D video playback is not stopped, the method may return to step S510.

In addition, the visual feature of the eye of the human body focusing when looking at the object is that the eye of the human body must focus on the object. In everyday life, the human eye can see most of the scene with the focus fixed. The focus can be changed when the user wants to see an object at a different distance. For example, when reading, the human eye's focus can always stay on a book page, and when watching a typical 2D video, the human's eye's focus can always stay on the display panel. In this case, the eye of the human body does not need to adjust the focal length (focal length) to a considerable extent, so that the fatigue of the eye is not caused by the change of focus. However, when watching 3D stereoscopic video, because the scene is constantly changing, virtual subjects are changed to different depths, so the focal length can be constantly changing. To see the object clearly in the video, the eye must perform the focusing adjustment. Thus, while watching 3D video, such adjustments are forced, which can cause eye muscle fatigue.

Due to physical limitations, when the human eye cannot keep up with the frequency of video parallax, the human body cannot see the image clearly and feel dizzy and uncomfortable. In this case, the method of improving the viewing comfort level by reducing the parallax parameter to some extent in order to reduce the stereoscopic effect has the disadvantage of making the user feel uncomfortable with the constantly changing parallax. For this reason, according to some embodiments of the present disclosure, the parallax parameter may be adjusted according to the visual characteristics of the eye of the human body focusing when viewing the object, so as to ensure a gentle change in the parallax, so that the human eye You may not feel uncomfortable with the constantly changing parallax. Hereinafter, when the current eye fatigue level of the user is above the eye fatigue threshold, an example in which parallax parameters are adjusted according to the visual characteristics of the eye of the human body focusing when viewing an object will be described in detail with reference to FIGS. 7 to 9. Will be.

7 shows a flowchart illustrating a method for adjusting a 3D display effect according to some other embodiments of the present disclosure.

Referring to FIG. 7, steps S710 and S720 are similar to steps S410 and S420 illustrated in FIG. 4, and thus descriptions of steps S710 and S720 of FIG. 7 will be omitted.

In step S730, it may be determined whether the current degree of eye fatigue of the user is greater than or equal to an eye fatigue threshold. The eye fatigue threshold may be a preset threshold used to determine whether the user feels tired. Specifically, by comparing the current degree of fatigue of the user with the eye fatigue threshold, it may be determined whether the 3D display effect should be adjusted.

Specifically, when the current eye fatigue level of the user is below the eye fatigue threshold, the parallax parameter of the 3D video may not be adjusted. Accordingly, in step S760, it may be determined whether 3D video reproduction is stopped. When playback of the 3D video is not stopped, the method may return to step S710 to continue to acquire the features of the user's eyes when the user watches the 3D video.

On the other hand, when the degree of fatigue of the user's current eye is greater than or equal to the eye fatigue threshold, in step S740, it may be determined whether the difference between the parallax parameter of the current frame of the 3D video and the parallax parameter of the previous frame is greater than or equal to the parallax variation threshold. By way of example, the parallax change threshold may be predetermined and may be dynamically determined according to the current degree of eye fatigue of the user. For example, the parallax variation threshold is a predetermined threshold used to measure the average parallax or variation in the parallax range, or inherent for measuring a variation in the average parallax or parallax range corresponding to the current degree of eye fatigue of the user. May be a predetermined threshold of.

When the difference between the parallax parameter of the current frame of the 3D video and the parallax parameter of the previous frame is greater than or equal to the parallax variation threshold, in step S750, the parallax parameter of the current frame of the 3D video is determined by the parallax parameter of the current frame of the 3D video and the previous frame. The difference between the parallax parameters may be adjusted to be within the parallax variation threshold.

In the following, an example of adjusting the parallax parameter when the parallax parameter change between the current frame and the previous frame is equal to or greater than the parallax variation threshold will be shown in relation to FIG. 8. For example, the parallax parameter may be an average parallax of an image frame of 3D video, whereby the parallax variation threshold may mean an allowable change in the average parallax between adjacent frame images. FIG. 8A may be a graph illustrating an average parallax of each frame with respect to successive frames. In addition, FIG. 8A may be a graph showing a maximum value of negative parallax among parallaxes of each frame. In addition, FIG. 8A may be a graph showing a maximum value of positive parallaxes among parallaxes of each frame. In addition, FIG. 8A may be a graph illustrating a parallax range of each frame.

Specifically, two types of parallax parameter changes can be defined, positive parallax changes and negative parallax changes. With respect to the positive parallax change, the value obtained by subtracting the parallax parameter of the previous frame from the parallax parameter of the current frame may have a positive value. That is, the parallax parameter of the current frame may be larger than the parallax parameter of the previous frame. For example, the positive parallax change can be obtained by subtracting the parallax parameter of frame 4 from the parallax parameter of frame 5 of FIG. On the other hand, in relation to the negative parallax change, the value obtained by subtracting the parallax parameter of the previous frame from the parallax parameter of the current frame may have a negative value. That is, the parallax parameter of the current frame may be smaller than the parallax parameter of the previous frame. For example, the negative parallax change can be obtained by subtracting the parallax parameter of frame 7 from the parallax parameter of frame 8 of FIG.

To ensure a smooth change in the parallax parameter, regardless of whether the current frame has a positive or negative parallax change, when the parallax parameter change between the current frame and the previous frame is above the parallax variation threshold, Parallax parameters can be adjusted.

Referring to FIG. 8A, frames 1 to 4 form a continuous and gentle negative parallax variation (ie, when the parallax variation is less than the parallax variation threshold). Thus, it may not be necessary to perform parallax parameter adjustment. However, since the positive parallax change obtained by subtracting the parallax parameter of frame 4 from the parallax parameter of frame 5 is greater than or equal to the parallax variation threshold, in order to alleviate the fatigue of the user's eyes, parallax parameter of frame 5 and parallax of frame 4 It is necessary to reduce the parallax parameter of frame 5 so that the difference between the parameters is within the parallax variation threshold.

An appropriate parallax parameter adjustment function may be selected, and the parallax parameter of frame 5 of 3D video may be adjusted according to the parallax parameter adjustment function such that a difference from the parallax parameter of frame 4 is within a parallax variation threshold. In the parallax parameter adjusting function, may denote a parallax parameter of the 3D video after being adjusted, may denote a degree of fatigue of the current eye of the user, and may denote a parallax parameter of the 3D video before being adjusted. In the parallax parameter adjustment function, the parallax variation threshold may be a decreasing function of the degree of fatigue of the user's current eye. That is, the parallax variation threshold of the 3D video may decrease as the degree of fatigue of the current eye of the user increases.

Through such adjustment, the parallax parameter of frame 5 of the 3D video can be reduced as shown in FIG. 8 (b). That is, the parallax parameter change between the frames 5 and 4 may be adjusted within the parallax variation threshold. In addition, because Frame 6 and Frame 7 are relatively large compared to the adjusted image frame (i.e., because the change in Frame 6 and Frame 7 is above the parallax variation threshold), as shown in Fig. 8B, In order to obtain the frames 6 and 7 that have been made, the parallax parameter of frame 6 and the parallax parameter of frame 7 can be adjusted in the same way.

On the other hand, referring to Figures 8 (a) and (b), since the difference obtained by subtracting the adjusted parallax parameter of frame 7 from the parallax parameter of frame 8 is greater than or equal to the parallax variation threshold, user's eye fatigue is alleviated. To do this, it is necessary to increase the parallax parameter of frame 8 such that the difference between the parallax parameter of frame 8 and the parallax parameter of frame 7 is within the parallax variation threshold. Accordingly, similar to the above method, the parallax parameter of frame 8 may be adjusted (increased) according to the parallax parameter adjusting function such that the difference between the parallax parameter of frame 8 and the parallax parameter of frame 7 is within a parallax variation threshold. .

In addition, since the frames 9 to 11 form a continuous and relatively large change in negative parallax (that is, because the parallax change is greater than or equal to the parallax variation threshold), the frames 9 to 11 are shown in Fig. 8B. As shown, in order to obtain adjusted individual image frames, it may be adjusted in a similar manner to frame 8. As shown in the method, gentle changes in parallax parameters can be ensured, thus reducing the degree of eye strain of the user.

In the following, in connection with a more specific example, a method will be disclosed in which the parallax parameters are adjusted according to the focusing characteristics of the eye of the human body when the scene changes.

As described above, because the depth of objects in the 3D video is constantly changing, the parallax parameters not only change, but also make the user feel uncomfortable due to the frequently changed focusing. Such depth change may occur in the same scene, or may occur when the scene changes.

9 illustrates an example of adjusting parallax parameters based on a focusing feature of the eye of the human body when the scene changes, in accordance with some embodiments of the present disclosure. Referring to (a) to (c) of FIG. 9, a scene change may occur in a 3D video image, and a round object in the image may be changed into a rectangular object. For clarity, the same object in the left eye and right eye images has been represented in different shades. Light colored objects may mean an image for the left eye, and dark colored objects may mean an image for the right eye. As shown in Figs. 9A and 9B, there is a relatively large amount of parallax in the image shown in Fig. 9A, and a relatively small amount in the image shown in Fig. 9B. There is a parallax of. Thus, it can be seen that for a current frame, a relatively large negative parallax variation is obtained by subtracting a relatively large positive parallax of the previous frame from a relatively small positive parallax of the current frame. When the negative parallax change is greater than or equal to the parallax variation threshold, it is necessary to adjust the parallax parameter.

For example, in this specific example, the adjustment may be performed by decreasing or increasing the parallax parameter of the current frame. The adjusted image frame is shown in Fig. 9C. As shown in Fig. 9C, the adjusted frame image has a relatively large amount of parallax compared to Fig. 9B, so that the adjusted positive parallax of the current frame is the positive parallax of the previous frame. It can be relatively close to, and the parallax parameter change of the current frame can be within the parallax variation threshold.

Referring back to FIG. 7, after the parallax parameter of the 3D video is adjusted, in step S760, it may be determined whether 3D video playback is stopped. When the 3D video playback is not stopped, the method may return to step S710.

Through the above process, the parallax variation forcing the eye to change the focal length can be reduced according to the visual characteristics of the eye of the human body focusing when viewing the object. Thus, smoothness of parallax can be ensured while playing back 3D video. Accordingly, in order to improve the level of visual comfort of the user, the reproduction of the 3D video can ensure a 3D visual effect and at the same time highly follow the physiological characteristics of the human eye.

In addition, the two methods described above can be combined in order to obtain a better adjustment effect.

10 shows a flowchart illustrating a method for adjusting 3D display effects, in accordance with some other embodiments of the present disclosure.

Referring to FIG. 10, steps S1010 and S1020 are similar to steps S410 and S420 illustrated in FIG. 4, and thus descriptions of steps S1010 and S1020 of FIG. 10 will be omitted.

In operation S1030, it may be determined whether the current degree of eye fatigue of the user is greater than or equal to an eye fatigue threshold. The eye fatigue threshold may be a preset threshold used to determine whether the user feels tired. Specifically, by comparing the current degree of fatigue of the user with the eye fatigue threshold, it may be determined whether the 3D display effect should be adjusted.

Specifically, when the current eye fatigue level of the user is below the eye fatigue threshold, the parallax parameter of the 3D video may not be adjusted. Accordingly, in step S1080, it may be determined whether 3D video reproduction is stopped. When the 3D video playback is not stopped, the method may return to step S1010 to continue to acquire the features of the user's eyes when the user watches the 3D video.

On the other hand, when the degree of fatigue of the user's current eye is greater than or equal to the eye fatigue threshold, in step S1040, it may be determined whether or not the parallax parameter of the 3D video is greater than or equal to the parallax parameter threshold. By way of example, the parallax parameter threshold may be predetermined and may be dynamically determined according to the current degree of eye fatigue of the user. For example, the parallax parameter threshold may be a predetermined average parallax, parallax range or inherent average parallax, or may be a parallax range corresponding to the current degree of eye fatigue of a user.

When the parallax parameter is greater than or equal to the parallax parameter threshold, in step S1050, the parallax parameter of the 3D video may be adjusted to be within the parallax parameter threshold.

Preferably, furthermore, in step S1060, it may be determined whether the difference between the parallax parameter of the current frame of the 3D video and the parallax parameter of the previous frame is greater than or equal to the parallax variation threshold. By way of example, the parallax change threshold may be predetermined and may be dynamically determined according to the current degree of eye fatigue of the user. For example, the parallax variation threshold is a predetermined threshold used to measure the average parallax or variation in the parallax range, or inherent for measuring a variation in the average parallax or parallax range corresponding to the current degree of eye fatigue of the user. May be a predetermined threshold of.

When the difference between the parallax parameter of the current frame of the 3D video and the parallax parameter of the previous frame is greater than or equal to the parallax change threshold, in step S1070, the parallax parameter of the current frame of the 3D video is determined by the parallax parameter of the current frame of the 3D video and the previous frame. The difference between the parallax parameters may be adjusted to be within the parallax variation threshold.

After the parallax parameter of the 3D video is adjusted, in step S1080, it may be determined whether 3D video reproduction is stopped. When the 3D video playback is not stopped, the method may return to step S1010.

As described above, in the device 1000 and the method, the 3D display effect may be adjusted according to the current degree of eye fatigue of the user at an appropriate moment, thereby reducing the user's eye fatigue and at the same time reducing the stereoscopic display effect of the 3D video. I can guarantee it. Accordingly, the technical effects of the 3D image display may be obtained while following the physiological characteristics of the human eye.

11 illustrates an example of a user interface for adjusting 3D display effects, in accordance with some embodiments of the present disclosure.

Referring to FIG. 11, the device 1000 may automatically perform parallax adjustment on 3D video and then display a notification window 1120 indicating that parallax adjustment is completed.

The notification window 1120 may include a confirmation button 1122, a fixed button 1124, and a cancel button 1126.

In response to receiving a user input of selecting the confirmation button 1122, the device 1000 may delete the notification window. According to an embodiment, the device 1000 may automatically delete the notification window when a preset time elapses.

Upon receiving a user input of selecting the fixed button 1124, the device 1000 may continuously adjust the parallax of the 3D video based on the current parallax parameter threshold regardless of the degree of eye fatigue of the user.

Upon receiving a user input of selecting the cancel button 1126, the 3D video that has been adjusted can be returned to its pre-adjusted state.

12 and 13 are block diagrams of a device 1000 according to some embodiments.

As illustrated in FIG. 12, the device 1000 according to some embodiments may include a user input unit 1100, an output unit 1200, a controller 1300, and a communication unit 1500. However, not all of the components illustrated in FIG. 12 are essential components of the device 1000. The device 1000 may be implemented by more components than the components illustrated in FIG. 12, and the device 1000 may be implemented by fewer components than the components illustrated in FIG. 12.

For example, as illustrated in FIG. 13, the device 1000 according to some embodiments may include a sensing unit 1400 in addition to the user input unit 1100, the output unit 1200, the control unit 1300, and the communication unit 1500. ) May further include an A / V input unit 1600 and a memory 1700.

The camera 1610 may be attached to the device 1000 to capture a face image including the user's eyes, and may be attached to the user's glasses (not shown) for viewing 3D video to capture the user's eye image.

The user input unit 1100 means a means for a user to input data for controlling the device 1000. For example, the user input unit 1100 includes a key pad, a dome switch, a touch pad (contact capacitive type, pressure resistive layer type, infrared sensing type, surface ultrasonic conduction type, and integral type). Tension measurement method, piezo effect method, etc.), a jog wheel, a jog switch, and the like, but are not limited thereto.

The user input unit 1100 may receive a user input for adjusting parallax of 3D video.

The output unit 1200 may output an audio signal, a video signal, or a vibration signal, and the output unit 1200 may include a display unit 1210, an audio output unit 1220, and a vibration motor 1230. have.

The display unit 1210 displays and outputs information processed by the device 1000. For example, the display unit 1210 may display 3D video. In addition, the display unit 1210 may display a notification window notifying that the parallax of the 3D video is adjusted.

Meanwhile, when the display unit 1210 and the touch pad form a layer structure and are configured as a touch screen, the display unit 1210 may be used as an input device in addition to the output device. The display unit 1210 may include a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a three-dimensional display. 3D display, an electrophoretic display. In addition, the device 1000 may include two or more display units 1210 according to an implementation form of the device 1000. In this case, the two or more display units 1210 may be disposed to face each other using a hinge.

The sound output unit 1220 outputs audio data received from the communication unit 1500 or stored in the memory 1700. In addition, the sound output unit 1220 outputs a sound signal related to a function (for example, a call signal reception sound, a message reception sound, and a notification sound) performed by the device 1000. The sound output unit 1220 may include a speaker, a buzzer, and the like.

The vibration motor 1230 may output a vibration signal. For example, the vibration motor 1230 may output a vibration signal corresponding to the output of audio data or video data (eg, a call signal reception sound, a message reception sound, etc.). In addition, the vibration motor 1230 may output a vibration signal when a touch is input to the touch screen.

The controller 1300 generally controls the overall operation of the device 1000. For example, the controller 1300 executes programs stored in the memory 1700, such that the user input unit 1100, the output unit 1200, the sensing unit 1400, the communication unit 1500, and the A / V input unit 1600 are provided. ) Can be controlled overall.

For example, the controller 1300 obtains a feature of the user's eyes from the image of the user's eyes, determines the current eye fatigue level of the user based on the acquired eye feature, and the user's current eye fatigue. You can adjust the parallax of 3D video according to the degree.

For example, the controller 1300 may adjust the parallax of the 3D video by adjusting the rate of change of parallax between the frames of the 3D video. In this case, the controller 1300 determines whether the difference in the parallax between the current frame and the previous frame of the 3D video is greater than or equal to the parallax variation threshold, and when the difference in the parallax is greater than or equal to the parallax variation threshold, the difference in the parallax is parallax variation. By adjusting the parallax of the current frame to be within the threshold, it is possible to adjust the rate of change of parallax between the current frame and the previous frame of the 3D video.

In addition, the controller 1300 may determine whether the user's current eye fatigue level is greater than or equal to the eye fatigue threshold value, and when the user's current eye fatigue level is greater than or equal to the eye fatigue threshold value, the controller 1300 may adjust the parallax of the 3D video.

The controller 1300 may determine whether the parallax of the 3D video is greater than or equal to the threshold when the degree of fatigue of the user is greater than or equal to the eye fatigue threshold. The parallax of the 3D video may be adjusted such that the parallax is within a threshold.

In addition, the controller 1300 may dynamically determine the parallax variation threshold value according to the current eye fatigue level of the user. In addition, the controller 1300 may dynamically determine the parallax parameter threshold according to the current degree of eye fatigue of the user.

For example, when the current degree of eye fatigue is large, the controller 1300 may lower the parallax variation threshold or parallax parameter threshold. The controller 1300 may adjust the parallax of the 3D video based on the lowered parallax variation threshold or parallax parameter threshold.

The sensing unit 1400 may detect a state of the device 1000 or a state around the device 1000 and transmit the detected information to the controller 1300.

The sensing unit 1400 may include a geomagnetic sensor 1410, an acceleration sensor 1420, a temperature / humidity sensor 1430, an infrared sensor 1440, a gyroscope sensor 1450, and a position sensor. (Eg, GPS) 1460, barometric pressure sensor 1470, proximity sensor 1480, and RGB sensor (illuminance sensor) 1490, but are not limited thereto. Since functions of the respective sensors can be intuitively deduced by those skilled in the art from the names, detailed descriptions thereof will be omitted.

The communication unit 1500 may include one or more components that allow communication between the device 1000 and another device (not shown) or the device 1000 and a server (not shown). For example, the communicator 1500 may include a short range communicator 1510, a mobile communicator 1520, and a broadcast receiver 1530.

The short-range wireless communication unit 1510 includes a Bluetooth communication unit, a Bluetooth low energy (BLE) communication unit, a near field communication unit, a WLAN (Wi-Fi) communication unit, a Zigbee communication unit, an infrared ray ( IrDA (Infrared Data Association) communication unit, WFD (Wi-Fi Direct) communication unit, UWB (ultra wideband) communication unit, Ant + communication unit and the like, but may not be limited thereto.

The mobile communication unit 1520 transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to transmission and reception of a voice call signal, a video call call signal, or a text / multimedia message.

The broadcast receiving unit 1530 receives a broadcast signal and / or broadcast related information from the outside through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. According to an implementation example, the device 1000 may not include the broadcast receiver 1530.

The A / V input unit 1600 is for inputting an audio signal or a video signal, and may include a camera 1610 and a microphone 1620. The camera 1610 may obtain an image frame such as a still image or a moving image through an image sensor in a video call mode or a photographing mode. The image captured by the image sensor may be processed by the controller 1300 or a separate image processor (not shown).

The image frame processed by the camera 1610 may be stored in the memory 1700 or transmitted to the outside through the communication unit 1500. Two or more cameras 1610 may be provided according to the configuration aspect of the terminal.

The microphone 1620 receives an external sound signal and processes the external sound signal into electrical voice data. For example, the microphone 1620 may receive an acoustic signal from an external device or speaker. The microphone 1620 may use various noise removing algorithms for removing noise generated in the process of receiving an external sound signal.

The memory 1700 may store a program for processing and controlling the controller 1300, and may store data input to or output from the device 1000.

The memory 1700 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM Random Access Memory (RAM) Static Random Access Memory (SRAM), Read-Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Programmable Read-Only Memory (PROM), Magnetic Memory, Magnetic Disk It may include at least one type of storage medium of the optical disk.

Programs stored in the memory 1700 may be classified into a plurality of modules according to their functions. For example, the programs stored in the memory 1700 may be classified into a UI module 1710, a touch screen module 1720, a notification module 1730, and the like. .

The UI module 1710 may provide a specialized UI, GUI, or the like that is linked with the device 1000 for each application. The touch screen module 1720 may detect a touch gesture on a user's touch screen and transmit information about the touch gesture to the controller 1300. The touch screen module 1720 according to some embodiments may recognize and analyze a touch code. The touch screen module 1720 may be configured as separate hardware including a controller.

Various sensors may be provided inside or near the touch screen to detect a touch or proximity touch of the touch screen. An example of a sensor for sensing a touch of a touch screen is a tactile sensor. The tactile sensor refers to a sensor that senses the contact of a specific object to the extent that a person feels or more. The tactile sensor may sense various information such as the roughness of the contact surface, the rigidity of the contact object, the temperature of the contact point, and the like.

In addition, an example of a sensor for sensing a touch of a touch screen is a proximity sensor.

The proximity sensor refers to a sensor that detects the presence or absence of an object approaching a predetermined detection surface or an object present in the vicinity without using a mechanical contact by using an electromagnetic force or infrared rays. Examples of the proximity sensor include a transmission photoelectric sensor, a direct reflection photoelectric sensor, a mirror reflection photoelectric sensor, a high frequency oscillation proximity sensor, a capacitive proximity sensor, a magnetic proximity sensor, and an infrared proximity sensor. The user's touch gesture may include tap, touch and hold, double tap, drag, pan, flick, drag and drop, and swipe.

The notification module 1730 may generate a signal for notifying occurrence of an event of the device 1000. Examples of events occurring in the device 1000 include call signal reception, message reception, key signal input, and schedule notification. The notification module 1730 may output a notification signal in the form of a video signal through the display unit 1210, may output the notification signal in the form of an audio signal through the sound output unit 1220, and the vibration motor 1230. Through the notification signal may be output in the form of a vibration signal.

One embodiment of the present invention can also be implemented in the form of a recording medium containing instructions executable by a computer, such as a program module executed by the computer. Computer readable media can be any available media that can be accessed by a computer and includes both volatile and nonvolatile media, removable and non-removable media. In addition, computer readable media may include both computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Communication media typically includes computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave, or other transmission mechanism, and includes any information delivery media.

The present disclosure has been described and described in detail with respect to some embodiments, which can be understood by a person skilled in the same art as the present disclosure, without departing from the meaning and scope of the present disclosure as defined by the following claims. Various changes may be made in the form and details of the disclosure.

The terms used in the present invention have been selected as widely used general terms as possible in consideration of the functions in the present invention, but this may vary according to the intention or precedent of the person skilled in the art, the emergence of new technologies and the like. In addition, in certain cases, there is also a term arbitrarily selected by the applicant, in which case the meaning will be described in detail in the description of the invention. Therefore, the terms used in the present invention should be defined based on the meanings of the terms and the contents throughout the present invention, rather than the names of the simple terms.

When any part of the specification is to "include" any component, this means that it may further include other components, except to exclude other components unless otherwise stated. In addition, the terms "... unit", "module", etc. described in the specification mean a unit for processing at least one function or operation, which may be implemented in hardware or software or a combination of hardware and software. .

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

Claims (20)

1. An imaging unit for capturing eyes of a user who views 3D video; And

   Acquire a feature of the eye of the user from the image of the eye of the user, and determine the degree of fatigue of the user based on the acquired eye characteristic, the 3D according to the degree of eye fatigue of the user And a control unit for adjusting parallax of video.
2. The method of claim 1,

   The control unit,

   At least one of a parallax range that is an average parallax between a left eye image and a right eye image of the 3D video, a maximum value of a negative parallax, a maximum value of a positive parallax, and a difference between a maximum value of the negative parallax and a maximum value of the positive parallax Adjusting the parallax of the 3D video by adjusting one.
3. The method of claim 1,

   Characteristics of the eyes of the user,

   At least one of a blinking frequency, eye closing time, a change in binocular focus, and a binocular convergence angle.
4. The method of claim 1,

   The control unit,

   And adjust the parallax of the 3D video if the determined eye fatigue is above a first threshold.
5. The method of claim 1,

   The control unit,

   It is determined whether or not the parallax of the 3D video is greater than or equal to a second threshold, and if the parallax of the 3D video is greater than or equal to the second threshold, the parallax of the 3D video is less than the second threshold. To adjust the device.
6. The method of claim 1,

   The control unit,

   And adjusting the parallax of the 3D video by adjusting a rate of change of parallax between the frames of the 3D video.
7. The method of claim 6,

   The control unit,

   Determine a difference in parallax between the nth frame and the n-1th frame of the 3D video, and if the difference in parallax is greater than or equal to a third threshold, such that the difference in parallax is less than the third threshold, And adjusting the rate of change of parallax between frames of the 3D video by adjusting the parallax of the nth frame.
8. The method of claim 7, wherein

   The control unit,

   And adjusting the rate of change of parallax between frames of the 3D video by increasing the parallax of the nth frame such that the difference in parallax is less than the third threshold.
9. The method of claim 1,

   The device,

   Further including an output unit,

   The control unit,

   And control the output to output the parallax adjusted 3D video to the user.
10. The method of claim 9,

    The device,

    And displaying a notification window on the output unit informing that the parallax of the 3D video has been adjusted.
11. Photographing the eyes of the user watching the 3D video;

    Acquiring a feature of the user's eye from the captured image of the user's eye;

    Determining a degree of eye fatigue of the user based on the acquired eye characteristics; And

    Adjusting the parallax of the 3D video according to the degree of fatigue of the user's eyes.
12. The method of claim 11,

    Adjusting the parallax of the 3D video according to the degree of eye fatigue of the user,

    At least one of a parallax range that is an average parallax between a left eye image and a right eye image of the 3D video, a maximum value of a negative parallax, a maximum value of a positive parallax, and a difference between a maximum value of the negative parallax and a maximum value of the positive parallax Adjusting one.
13. The method of claim 11,

    Characteristics of the eyes of the user,

    At least one of a blinking frequency, eye closing time, a change in binocular focus, and a binocular convergence angle.
14. The method of claim 11,

    Adjusting the parallax of the 3D video according to the degree of eye fatigue of the user,

    Adjusting the parallax of the 3D video when the determined degree of eye fatigue of the user is greater than or equal to a first threshold.
15. The method of claim 11,

    Adjusting the parallax of the 3D video according to the degree of eye fatigue of the user,

    It is determined whether or not the parallax of the 3D video is greater than or equal to a second threshold, and if the parallax of the 3D video is greater than or equal to the second threshold, the parallax of the 3D video is less than the second threshold. Adjusting the method.
16. The method of claim 11,

    Adjusting the parallax of the 3D video according to the degree of eye fatigue of the user,

    Adjusting the parallax of the 3D video by adjusting a rate of change of parallax between frames of the 3D video.
17. The method of claim 16,

    Adjusting the parallax of the 3D video by adjusting the rate of change of parallax between the frames of the 3D video,

    Determine the difference in parallax between the nth frame and the n-1th frame of the 3D video, and if the difference in parallax is greater than or equal to a third threshold, such that the difference in parallax is less than the third threshold, Adjusting the rate of change of parallax between frames of the 3D video by adjusting the parallax of the nth frame.
18. The method of claim 17,

    Adjusting the parallax of the n-th frame so that the difference in parallax is less than the third threshold,

    Adjusting the rate of change of parallax between frames of the 3D video by increasing the parallax of the nth frame such that the difference in parallax is less than the third threshold.
19. The method of claim 11,

    The method for adjusting the 3D display effect,

    Outputting the parallax adjusted 3D video to the user.
20. The method of claim 19,

    The method for adjusting the 3D display effect,

    And displaying a notification window informing that the parallax of the 3D video has been adjusted.

Images