KR102306775B1 - Method and apparatus for displaying a 3-dimensional image adapting user interaction information - Google Patents

Abstract

According to the present disclosure, a method and apparatus for reproducing a stereoscopic image are disclosed. A stereoscopic image reproducing method according to an embodiment of the present disclosure includes the steps of outputting at least one image including a plurality of sub-images and forming a focus by a combination of the plurality of sub-images; A process of confirming user interaction information for a viewing user; a process of correcting the focus by controlling the plurality of sub-images included in the at least one image based on the user interaction information; and outputting the at least one image.

Description

Method and apparatus for playing a stereoscopic image by reflecting user interaction information

The present disclosure relates to a method and apparatus for displaying a stereoscopic image, and more particularly, to a method and apparatus for controlling a stereoscopic image by reflecting user interaction.

Various visual factors influence the process of human perception of 3D stereoscopic vision. Representative examples are: Since humans have eyes on the left and right, binocular disparity information is generated from the image of the external world to be observed, and the brain recognizes it as a single 3D stereoscopic image. The principle of three-dimensional perception by binocular disparity is being applied to a popular 3D stereoscopic display device. The display device outputs images to be input to both eyes of the user, and the user can watch 3D stereoscopic image content by wearing a device (eg, 3D stereoscopic glasses) that separates left and right images corresponding to each eye.

Research on various display devices to which such three-dimensional image technology can be applied is being conducted. In particular, by fusion with virtual reality/augmented reality/mixed reality technologies, the development of a three-dimensional image display device in the form of a wearable display has become difficult. is being actively pursued.

Adjusting the direction or focus of a scene or object included in a stereoscopic image according to a user's action, that is, a user's movement or movement, is essential to maximize the sense of reality of a stereoscopic image.

However, in order to adjust the output of a stereoscopic image in response to a user's behavior, an operation such as reconstructing image data according to the user's behavior must be processed, so there is a problem in that a lot of data processing or calculation is required.

An object of the present disclosure is to provide a method and apparatus capable of efficiently composing and reproducing an image reflecting a user's interaction.

Another technical problem of the present disclosure is to provide a method and apparatus capable of implementing a stereoscopic image reflecting user interaction while minimizing data processing or arithmetic processing.

The technical problems to be achieved in the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by those of ordinary skill in the art to which the present disclosure belongs from the description below. will be able

According to an aspect of the present disclosure, a method for reproducing a stereoscopic image may be provided. The method includes a process of outputting at least one image including a plurality of sub-images and forming a focus by a combination of the plurality of sub-images, and checking user interaction information for a user viewing the at least one image a process of correcting the focus by controlling the plurality of sub-images included in the at least one image based on the user interaction information, and outputting the focus-corrected image. may include

According to another aspect of the present disclosure, a stereoscopic image reproducing apparatus may be provided. The device includes a stereoscopic image display unit for outputting a stereoscopic image including at least one image that forms a focus by a combination of a plurality of sub-images, and a user who checks user interaction information for a user who views the stereoscopic image It may include an interaction information confirmation unit, and a focus control unit for correcting the focus by controlling the plurality of sub-images based on the user interaction information.

The features briefly summarized above with respect to the present disclosure are merely exemplary aspects of the detailed description of the present disclosure that follows, and do not limit the scope of the present disclosure.

According to the present disclosure, a method and apparatus for efficiently configuring and reproducing an image reflecting a user's interaction may be provided.

Also, according to the present disclosure, a method and apparatus capable of implementing a stereoscopic image reflecting a user's interaction while minimizing data processing or arithmetic processing may be provided.

Effects obtainable in the present disclosure are not limited to the above-mentioned effects, and other effects not mentioned may be clearly understood by those of ordinary skill in the art to which the present disclosure belongs from the description below. will be.

1 is a block diagram illustrating a configuration of a stereoscopic image reproducing apparatus according to an embodiment of the present disclosure.
2 is a diagram illustrating a stereoscopic image output method output by a display unit provided in a stereoscopic image reproducing apparatus according to an embodiment of the present disclosure.
FIG. 3 is a diagram illustrating image information constituting the stereoscopic image output in FIG. 2 .
FIG. 4 is a diagram illustrating a stereoscopic image combined by a plurality of sub-images of FIG. 3 .
5 is a diagram illustrating an operation of a focus control unit included in a stereoscopic image reproducing apparatus according to an embodiment of the present disclosure.
6 is a diagram illustrating a stereoscopic image output by a stereoscopic image reproducing apparatus according to an embodiment of the present disclosure.
7 is a flowchart illustrating a sequence of a method for reproducing a stereoscopic image according to an embodiment of the present disclosure.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings so that those of ordinary skill in the art to which the present disclosure pertains can easily implement them. However, the present disclosure may be implemented in several different forms and is not limited to the embodiments described herein.

In describing an embodiment of the present disclosure, if it is determined that a detailed description of a well-known configuration or function may obscure the gist of the present disclosure, a detailed description thereof will be omitted. And, in the drawings, parts not related to the description of the present disclosure are omitted, and similar reference numerals are attached to similar parts.

In the present disclosure, when it is said that a component is "connected", "coupled" or "connected" with another component, it is not only a direct connection relationship, but also an indirect connection relationship in which another component exists in the middle. may also include. In addition, when a component is said to "include" or "have" another component, it means that another component may be further included without excluding other components unless otherwise stated. .

In the present disclosure, terms such as first, second, etc. are used only for the purpose of distinguishing one component from another, and do not limit the order or importance between the components unless otherwise specified. Accordingly, within the scope of the present disclosure, a first component in one embodiment may be referred to as a second component in another embodiment, and similarly, a second component in one embodiment is referred to as a first component in another embodiment. can also be called

In the present disclosure, components that are distinguished from each other are for clearly explaining each characteristic, and do not necessarily mean that the components are separated. That is, a plurality of components may be integrated to form one hardware or software unit, or one component may be distributed to form a plurality of hardware or software units. Therefore, even if not separately mentioned, such integrated or distributed embodiments are also included in the scope of the present disclosure.

In the present disclosure, components described in various embodiments do not necessarily mean essential components, and some may be optional components. Accordingly, an embodiment composed of a subset of components described in an embodiment is also included in the scope of the present disclosure. In addition, embodiments including other components in addition to components described in various embodiments are also included in the scope of the present disclosure.

Terms used in the examples of the present disclosure are defined as follows.

The user interaction information is information used to control the focus of a stereoscopic image, and includes information indicating a direction in which the user's gaze looks and an area in which the user's gaze looks.

The stereoscopic image includes a plurality of sub-images in consideration of parallax and parallax in a horizontal or vertical direction. Accordingly, each of the plurality of sub-images has different horizontal or vertical parallax and parallax.

Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings.`

1 is a block diagram illustrating a configuration of a stereoscopic image reproducing apparatus according to an embodiment of the present disclosure.

Referring to FIG. 1 , a stereoscopic image reproducing apparatus according to an embodiment of the present disclosure may include a display unit 11 , a user interaction information check unit 13 , and a focus control unit 15 .

The display unit 11 may include a display panel that outputs the received stereoscopic image data. In particular, the display unit 11 includes two display panels on the left and right to display a three-dimensional image, a parallax barrier for separating parallax, a lenticular lens, a micro lens, and optical rotation. You can use circles, etc.

FIG. 2 is a diagram illustrating a stereoscopic image output method output by a display unit provided in a stereoscopic image reproducing apparatus according to an embodiment of the present disclosure, and FIG. 3 shows image information constituting the stereoscopic image output in FIG. It is an illustrative drawing.

Referring to FIG. 2 , the display unit 11 includes a left eye display panel 110L and a right eye display panel 110R corresponding to the left eye and the right eye, respectively, and the left eye and right eye display panel 110L and the right eye display panel ( A left eye lens 112L and a right eye lens 112R respectively provided between 110R may be provided.

With this structure, the left image 200L output from the left eye display panel 110L is provided to the user's left eye through the left eye lens 112L, and the right image 200R output from the right eye display panel 110R is It may be provided to the user's right eye through the right eye lens 112R. Here, the left eye lens 112L and the right eye lens 112R have focal lengths 120L and 120R, respectively, between the left eye display panel 110L and the right eye display panel 110R and the left eye lens 112L and the right eye lens 112R. (130L, 130R) may be provided to be set larger than the distance.

According to this configuration, the user may recognize that the left image 200L and the right image 200R are formed on a virtual image plane 150 .

Furthermore, the left image 200L and the right image 200R may include at least one object, wherein the at least one object forms a predetermined disparity between the left image 200L and the right image 200R. can do. As such, the at least one object may be recognized relatively closer than the virtual surface 150 due to the disparity between the left image 200L and the right image 200R.

The above-described method of implementing a stereoscopic image by parallax in the left image 200L and the right image 200R is a method of providing a stereoscopic image based on a single view. Furthermore, for a multi-view image, the left eye display panel 110L and the right eye display panel 110R may each include at least one parallax barrier, and a multi-view stereoscopic image through the parallax barrier. can be implemented.

In the above-described embodiment, the horizontal disparity was exemplified through disparity and motion parallax in the left image 200L and the right image 200R, but in a light-field In order to express full-parallax, an image capable of reflecting the parallax in the vertical direction is required.

Accordingly, each of the left image 200L and the right image 200R may include a sub-image capable of providing parallax in horizontal and vertical directions.

Referring to FIG. 3 illustrating image information constituting a stereoscopic image, the stereoscopic image may include a plurality of sub-images 301 , 302 , 303 , and 304 . The plurality of sub-images is based on parallax in horizontal and vertical directions constituting the image. The number of sub-images included in the stereoscopic image may correspond to a product of the number of views in the horizontal direction and the number of views in the vertical direction.

For example, the stereoscopic image may include an epipolar plane image (EPI) image.

In FIG. 3 , the X-axis and the Y-axis represent horizontal and vertical resolutions. For example, when the View axis indicates a horizontal viewpoint, X indicates horizontal resolution, Y indicates mathematical resolution, and when the View axis indicates a vertical viewpoint, X indicates vertical resolution, and Y axis indicates horizontal resolution.

Also, at least one object may be included in the stereoscopic image, and the at least one object may have different parallaxes D1, D2, and D3 between the plurality of sub-images 301, 302, 303, and 304. have.

FIG. 4 is a diagram illustrating a stereoscopic image 400 combined by a plurality of sub-images 301 , 302 , 303 , and 304 of FIG. 3 .

The plurality of sub-images 301 , 302 , 303 , and 304 may include a first object 410 and a second object 420 . The first object 410 includes the plurality of sub-images 301 , 302 , 303 and 304 are provided at the same position without disparity, and the second object 420 may be provided with predetermined disparities D1, D2, and D3 in the plurality of sub-images 301, 302, 303, and 304. . Accordingly, in the stereoscopic image 400 , the region where the first object 410 is present may be presented as a focused gaze point, and the region where the second object 420 is present may be presented as an out-of-focus region. can

Meanwhile, the user interaction information check unit 13 may check the user interaction information.

In an embodiment of the present disclosure, the user interaction information is information used to control the focus of a stereoscopic image, and may include information indicating a direction in which the user's gaze looks and an area in which the user's gaze looks. can

The user interaction information may include information indicating the position of the user's head and the direction of the user's head.

In addition, the user interaction information may include information indicating the location of the user's pupil, the size of the pupil, and the direction of the pupil.

The display unit 11 may include a head mounted display (HMD), which is a personal terminal, and the user interaction information check unit 13 includes a motion sensor capable of confirming movement in a three-axis direction, and a motion sensor detected from the motion sensor. It may include a motion checker for checking information indicating a direction in which the user's gaze looks, and an area in which the user's gaze looks, based on the sensor data.

As another example, the display unit 11 may include a display device having a predetermined size. In this case, the user interaction information check unit 13 detects a user's specific area (eg, head area) from a camera for photographing a user looking at the display unit 11 and an image photographed from the camera, and A movement confirmation unit may be provided to detect the movement of the region and confirm the direction in which the user's gaze looks and the region in which the user's gaze looks. The motion checker may detect a region in which the user's eye (or pupil) is located, and detect the size and direction of the pupil.

The focus control unit 15 detects a sub-image of a viewpoint corresponding to the user interaction information confirmed by the user interaction information check unit 13 . Then, the focus controller 15 controls the output of the sub-image to control the focus of the stereoscopic image output through the display unit 11 .

For example, the focus control unit 15 may detect a sub-image of a viewpoint corresponding to a direction in which the user's gaze looks, which is confirmed by the user interaction information check unit 13 , and an area in which the user's gaze looks. The sub-image may include at least one sub-image to be output as a left image and at least one sub-image to be output as a right image. As described above, by controlling the output positions of the at least one sub-image included in the left image and the at least one sub-image included in the right image, the focus of at least one object included in the stereoscopic image may be adjusted. In this case, the focus controller 15 controls the main viewpoints of the sub-image included in the left image and the sub-image included in the right image, or controls the parallax between the sub-image included in the left image and the sub-image included in the right image. By controlling it, the focus of at least one object included in the stereoscopic image may be adjusted.

5 is a diagram illustrating an operation of a focus control unit included in a stereoscopic image reproducing apparatus according to an embodiment of the present disclosure.

The focus controller 15 includes a plurality of sub-images 510L-1, 510L-2, 510L-3, ... 510L-n, n=a positive integer included in the left image included in the stereoscopic image, and the right image. From the plurality of sub-images 510R-1, 510R-2, 510R-3, ... 510R-n provided in A sub-image of a viewpoint corresponding to the region viewed by the user's gaze, for example, the sub-images 510L-1, 510L-2, and 510L-3 included in the left image, and a plurality of sub-images included in the right image (510R-1, 510R-2, 510R-3) can be detected. In addition, the focus controller 15 includes the sub-images 510L-1, 510L-2, and 510L-3 included in the left image and the plurality of sub-images 510R-1, 510R-2, 510R- included in the right image. In 3), each line may be shifted so that the area corresponding to the gaze point is aligned in the vertical direction.

The focus controller 15 includes the sub-images 510L-1, 510L-2, and 510L-3 provided in the left image in which the gaze point is moved and aligned, and the plurality of sub-images 510R-1 and 510R- provided in the right image. 2, 510R-3) can be output.

As described above, the sub-images 510L-1, 510L-2, and 510L-3 included in the left image in which the gaze point is moved and aligned, and the plurality of sub-images 510R-1, 510R-2, and 510R included in the right image -3), the focus of the object included in the stereoscopic image may be adjusted (refer to FIG. 6).

Additionally, the focus controller 15 includes the sub-images 510L-1, 510L-2, and 510L-3 provided in the left image in which the gaze point is moved and aligned, and the plurality of sub-images 510R-1 provided in the right image. At least one sub-image 510L-1', 510L-2', 510L-3', 510R-1', 510R-2', 510R-3'). In addition, the focus controller 15 may process filtering on at least one sub-image of the virtual view.

In addition, the focus controller 15 reflects the direction in which the user's gaze looks and the region in which the user's gaze looks, and the sub-images 510L-1 and 510L-2 provided in the left image in which the gaze point is moved and aligned. , 510L-3) and a plurality of sub-images 510R-1, 510R-2, and 510R-3 included in the right image may be cropped or combined to reconstruct the sub-image.

Furthermore, the focus controller 15 may reconstruct the sub-image by cropping or adding the interpolated and filtered sub-images.

7 is a flowchart illustrating a sequence of a method for reproducing a stereoscopic image according to an embodiment of the present disclosure.

The stereoscopic image reproducing method according to an embodiment of the present disclosure may be performed by the above-described stereoscopic image reproducing apparatus. A stereoscopic image reproducing apparatus includes two left and right display panels that separate parallax to display a three-dimensional image, a parallax barrier, a lenticular lens, a micro lens, and a linear light source. may include the device used

Referring to FIG. 7 , the stereoscopic image reproducing apparatus may check and output stereoscopic image data (S701). The stereoscopic image may include at least one sub-image.

The stereoscopic image may include a sub-image necessary to provide parallax in horizontal and vertical directions. Furthermore, the stereoscopic image may include a left image provided to the user's left eye and a right image provided to the user's right eye, and each of the left image and the right image may include a sub-image.

In such an environment, the stereoscopic image reproducing apparatus may check the sub-images required to output the stereoscopic image. Since the plurality of sub-images is based on parallax in the horizontal and vertical directions constituting the image, the number of sub-images included in the stereoscopic image may correspond to the product of the number of views in the horizontal direction and the number of views in the vertical direction. .

For example, the stereoscopic image may be exemplified as shown in FIGS. 3 and 4 . At least one object may be included in the stereoscopic image, and the at least one object may have different disparities D1 , D2 , and D3 between the plurality of sub images 301 , 302 , 303 , and 304 . The focus of the object included in the stereoscopic image 400 may be controlled by the parallax of the sub-images 301 , 302 , 303 , and 304 . For example, the plurality of sub-images 301 , 302 , 303 , and 304 may include a first object 410 and a second object 420 . The first object 410 includes the plurality of sub-images 301 , 302 , 303 , and 304 are provided at the same position without disparity, and the second object 420 may be provided with predetermined disparities D1 , D2 , and D3 in the plurality of sub-images 301 , 302 , 303 , and 304 . can Accordingly, in the stereoscopic image 400 , the region where the first object 410 is present may be presented as a focused gaze point, and the region where the second object 420 is present may be presented as an out-of-focus region. can

Meanwhile, in step S702, the stereoscopic image reproducing apparatus may check user interaction information.

In an embodiment of the present disclosure, the user interaction information is information used to control the focus of a stereoscopic image, and may include information indicating a direction in which the user's gaze looks and an area in which the user's gaze looks. can

The user interaction information may include information indicating the position of the user's head and the direction of the user's head.

In addition, the user interaction information may include information indicating the location of the user's pupil, the size of the pupil, and the direction of the pupil.

The stereoscopic image reproducing apparatus may be provided in the form of a head mounted display (HMD), which is a personal terminal, and may include a motion sensor capable of confirming movement in a three-axis direction. Accordingly, the stereoscopic image reproducing apparatus may identify information indicating a direction in which the user's gaze looks and an area in which the user's gaze looks based on the sensor data detected from the motion sensor.

As another example, the stereoscopic image reproducing apparatus may include a display apparatus having a predetermined size. In this case, the stereoscopic image reproducing apparatus detects a specific area (eg, head area) of the user from a camera photographing the user, an image captured by the camera, and detects the movement of the specific area, so that the user's gaze Information indicating a viewing direction and an area viewed by the user's gaze may be checked. Furthermore, the stereoscopic image reproducing apparatus may detect a region in which the user's eye (or pupil) is located from the image captured by the camera, and detect the size and direction of the pupil.

Next, the stereoscopic image reproducing apparatus detects a sub-image of a viewpoint corresponding to the user interaction information (S703), and reconstructs the sub-image according to the user interaction information (S704).

Specifically, the stereoscopic image reproducing apparatus may detect a sub-image of a viewpoint corresponding to the confirmed direction in which the user's gaze looks and the region in which the user's gaze looks. The sub-image may include at least one sub-image to be output as a left image and at least one sub-image to be output as a right image. In this way, the sub-image may be reconstructed by controlling an output position, output size, arrangement, etc. of at least one sub-image included in the left image and at least one sub-image included in the right image.

As described above, by reconstructing the sub-image in step S704, the focus of at least one object included in the stereoscopic image may be adjusted.

Referring to FIG. 5 , the operations of steps S703 and S704 are illustrated in more detail.

The stereoscopic image reproducing apparatus includes a plurality of sub-images 510L-1, 510L-2, 510L-3, ... 510L-n included in the left image included in the stereoscopic image, and a plurality of sub-images included in the right image. From (510R-1, 510R-2, 510R-3, ... 510R-n), a sub-image of a viewpoint corresponding to the user interaction information, for example, sub-images 510L-1, 510L included in the left image -2, 510L-3) and a plurality of sub-images 510R-1, 510R-2, and 510R-3 included in the right image may be detected.

The stereoscopic image reproducing apparatus uses the sub-images 510L-1, 510L-2, and 510L-3 included in the left image and the plurality of sub-images 510R-1, 510R-2, and 510R-3 included in the right image. A sub-image in which each line is shifted may be reconstructed so that the region corresponding to the gaze point is aligned in the vertical direction.

In addition, the stereoscopic image reproducing apparatus includes sub-images 510L-1, 510L-2, and 510L-3 included in the left image in which the gaze point is moved and aligned, and a plurality of sub-images 510R-1 and 510R included in the right image. -2, 510R-3), at least one sub-image of a virtual view may be generated, and the sub-image may be reconstructed by filtering the generated sub-image.

In addition, the stereoscopic image reproducing apparatus reflects the direction in which the user's gaze looks and the region in which the user's gaze looks, and the sub-images 510L-1, 510L-2, 510L-3, and 510R in which the gaze point is moved and aligned. -1, 510R-2, 510R-3) are cropped or combined to reconstruct a sub-image, or a sub-image generated through interpolation and filtering of at least one sub-image with respect to a virtual viewpoint is cropped Alternatively, the sub-image may be reconstructed by cropping or adding.

In step S705, a stereoscopic image including the sub-image reconstructed through the above-described operation may be output.

In this way, by reflecting the user interaction information to reconstruct a sub-image, and to construct and output a three-dimensional image including the reconstructed sub-image, the focus of an object included in the image is adjusted or the output area of the image is adjusted. can

According to the present disclosure, it is possible to provide a stereoscopic image capable of continuous parallax and variable focus through relatively small computational processing in a device for displaying a stereoscopic image, particularly, a personal sensory display device such as an HMD, and furthermore, It is possible to provide a virtual reality service with a high immersion effect and low viewing fatigue.

Example methods of the present disclosure are expressed as a series of operations for clarity of description, but this is not intended to limit the order in which the steps are performed, and if necessary, each step may be performed simultaneously or in a different order. In order to implement the method according to the present disclosure, other steps may be included in addition to the illustrated steps, steps may be excluded from some steps, and/or other steps may be included except for some steps.

Various embodiments of the present disclosure do not list all possible combinations, but are intended to describe representative aspects of the present disclosure, and the details described in various embodiments may be applied independently or in combination of two or more.

In addition, various embodiments of the present disclosure may be implemented by hardware, firmware, software, or a combination thereof. For implementation by hardware, one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), general purpose It may be implemented by a processor (general processor), a controller, a microcontroller, a microprocessor, and the like.

The scope of the present disclosure includes software or machine-executable instructions (eg, operating system, application, firmware, program, etc.) that cause an operation according to the method of various embodiments to be executed on a device or computer, and such software or and non-transitory computer-readable media in which instructions and the like are stored and executed on a device or computer.

Claims (14)

outputting at least one image including a plurality of sub-images and forming a focus by a combination of the plurality of sub-images;
A process of confirming user interaction information for a user who views the at least one image;
controlling the plurality of sub-images included in the at least one image based on the user interaction information to correct the focus;
and outputting the at least one stereoscopic image in which the focus is corrected,
The at least one stereoscopic image includes a left image output from the left eye display panel and a right image output from the right eye display panel, and the left image includes a first object and a second object, and includes a plurality of left images having different parallaxes. and a sub-image, wherein the right image includes a plurality of right sub-images including the first object and the second object, but having the different parallaxes,
The process of outputting the at least one stereoscopic image includes:
The at least one stereoscopic image is output through a stereoscopic image reproducing apparatus including a left-eye display panel and a right-eye display panel, wherein the left sub-image and the right sub-image are the at least one stereoscopic image focused on the first object. including the process of outputting
The process of correcting the focus is
and correcting the focus of the plurality of left sub-images and the plurality of right sub-images to the second object.
According to claim 1,
The process of checking user interaction information is,
and confirming a direction in which the user's gaze is looking and a range of an area in which the user's gaze is looking.
According to claim 1,
The process of checking user interaction information is,
The process of confirming the position of the user's head and information indicating the direction of the user's head;
A method for reproducing a stereoscopic image, the method comprising: checking the user's head position, the user's gaze direction corresponding to information indicating the user's head direction, and the range of the user's gaze viewing area; .
According to claim 1,
The process of checking user interaction information is,
a process of confirming information indicating the location of the user's pupil, the size of the pupil, and the direction of the pupil;
A stereoscopic method comprising the step of confirming a direction in which the user's gaze is looking corresponding to information indicating the location of the user's pupil, the size of the pupil, and the direction of the pupil, and the range of the area in which the user's gaze is looking How to play video.
3. The method of claim 2,
The process of correcting the focus information of the at least one image,
The process of confirming the relationship between the user's gaze and the object provided in the sub-image;
detecting the sub-image corresponding to a direction in which the user's gaze is looking and a range of an area in which the user's gaze is looking;
adjusting the sub-image according to the direction in which the user's gaze is looking and the area in which the user's gaze is looking;
and constructing the at least one image including the adjusted sub-image.
3. The method of claim 2,
The process of correcting the focus information of the at least one image,
The sub-image corresponding to the range of the user's gaze direction and the user's gaze area is detected, and the sub-image is detected in accordance with the user's gaze direction and the user's gaze area. cutting out a partial region included in the detected sub-image;
and constructing the at least one image including a partial region included in the sub-image.
delete A stereoscopic image display unit including a left-eye display panel and a right-eye display panel, and outputting a stereoscopic image including at least one stereoscopic image forming a focus by a combination of a plurality of sub-images;
a user interaction information confirmation unit for confirming user interaction information for a user who views the stereoscopic image;
And a focus control unit for correcting the focus by controlling the plurality of sub-images based on the user interaction information,
The at least one stereoscopic image includes a left image output from the left eye display panel and a right image output from the right eye display panel, and the left image includes a first object and a second object, and includes a plurality of left images having different parallaxes. and a sub-image, wherein the right image includes a plurality of right sub-images including the first object and the second object, but having the different parallaxes,
The focus control unit,
The output of the at least one stereoscopic image including the left sub-image and the right sub-image focused on the first object, and the focus of the plurality of left sub-images and the plurality of right sub-images based on the user interaction information A stereoscopic image reproducing apparatus for controlling the in accordance with the second object.
9. The method of claim 8,
The user interaction information confirmation unit,
A stereoscopic image reproducing apparatus, characterized in that the user's eye gaze direction and the range of the user's gaze gaze region as the user interaction information is confirmed.
9. The method of claim 8,
The user interaction information confirmation unit,
Check the location of the user's head and information indicating the direction of the user's head,
The stereoscopic image reproducing apparatus according to claim 1, wherein the user's head position, the user's gaze direction corresponding to the information indicating the user's head direction, and the user's gaze area are checked.
9. The method of claim 8,
The user interaction information confirmation unit,
Check information indicating the location of the user's pupil, the size of the pupil, and the direction of the pupil,
Stereoscopic characterized in that the user's eye gaze direction corresponding to information indicating the location of the user's pupil, the size of the pupil, and the direction of the pupil, and the range of the user's gaze gaze range video playback device.
10. The method of claim 9,
The focus control unit,
Check the relationship between the user's gaze and the object provided in the sub-image,
detecting the sub-image corresponding to a direction in which the user's gaze looks, and a range of an area in which the user's gaze looks,
adjusting the sub-image according to a direction in which the user's gaze looks and an area in which the user's gaze looks,
and composing the at least one image including the adjusted sub-image.
10. The method of claim 9,
The focus control unit,
The sub-image corresponding to the range of the user's gaze direction and the user's gaze area is detected, and the sub-image is detected in accordance with the user's gaze direction and the user's gaze area. cropping a partial region included in the detected sub-image,
and composing the at least one image including a partial region included in the sub-image.
delete

Images