JP2012253447A - Display device, display system, display device control method, control program, and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a user whose eyes are inclined with a stereoscopic effect similar to that is provided when the eyes are positioned horizontally, in a display device based on a frame sequential system.SOLUTION: A display device is provided with an inclination acquisition part 62 and an image generating part 63. The inclination acquisition part 62 acquires an inclination angle of 3D spectacles 2 with respect to the horizontal plane. The image generating part 63 reconfigures a left-eye image or a right-eye image such that a parallax to provide the user when the user stereoscopically views the image with the 3D spectacles 2 with the inclination angle acquired by the inclination acquisition part 62 may coincide with a parallax to provide the user when the user stereoscopically views the image with the 3D spectacles 2 with an inclination angle of zero, and the image generating part 63 causes a right-eye image for inclined-time and a left-eye image for inclined-time which are generated as the result of the reconfiguration, to be displayed.

Description

  The present invention relates to a display device or the like that enables stereoscopic viewing by synchronizing the switching timing between a right-eye image and a left-eye image and the opening and closing timings of left and right shutters of stereoscopic glasses.

  In recent years, display devices capable of viewing video in three dimensions (3D) have attracted attention. A number of display methods that allow a user to stereoscopically view with such a device have been proposed. In televisions for general homes, a method in which a user wears stereoscopic glasses (3D glasses) equipped with a liquid crystal shutter (generally “frame sequential”). In the following, this is referred to as “FS method”, which is abbreviated as “FS method”.

  Here, the FS method will be described with reference to FIG. FIG. 12 is a diagram schematically showing a state in which a right-eye image and a left-eye image are alternately displayed in a conventional 3D display device based on the FS method.

  As illustrated, in the FS system, the right-eye image and the left-eye image are alternately displayed on the assumption that the user views the 3D glasses in a horizontal state. For this reason, the position of the object in the right-eye image and the position of the object in the left-eye image are shifted in the horizontal direction as illustrated. This shift is parallax, and a stereoscopic effect can be obtained by this parallax.

  Next, the relationship between the parallax and the right-eye image and the left-eye image will be described with reference to FIG. FIGS. 13A and 13B are diagrams for explaining the relationship between the parallax and the image for the right eye and the image for the left eye. FIGS. 13A and 13B illustrate the three-dimensional effect in the depth direction with respect to the display surface. ) Shows a relationship when a stereoscopic effect is given in the front direction with respect to the display surface.

  As shown in (a) and (b) of the figure, when a stereoscopic effect (depth feeling) is given in the depth direction with respect to the display surface, the object in the image is recognized as being on the back side of the display surface. The position of the object in the right-eye image is shifted to the right, and the position of the object in the left-eye image is shifted to the left and displayed.

  More specifically, in the right-eye image, the object is displayed at a position where a line segment connecting the right eye of the user and the position for recognizing the object (the back side of the display surface) intersects the display surface. In the left-eye image, the user The object is displayed at a position where a line segment connecting the left eye and the position where the object is recognized intersects the display surface.

  For this reason, the stereoscopic effect in the depth direction is larger (the position for recognizing the object is far from the user) in FIG. 10A, compared to FIG. 7B, the parallax (the position of the object in the right-eye image and the left eye). The amount of deviation from the position of the object in the image) increases.

  On the other hand, as shown in FIG. 5C, when a stereoscopic effect (protruding feeling) is given in the front direction with respect to the display surface, the image for the right eye is used to make the user recognize that the object is in front of the display surface. The position of the object is shifted to the left, and the position of the object in the left-eye image is shifted to the right and displayed. That is, the display positions of the objects included in the right-eye image and the left-eye image are interchanged as compared with the cases of FIGS. In the case of (c) in the figure, as in the cases of (a) and (b) in the figure, the parallax increases as the stereoscopic effect increases (the position where the object is recognized is closer to the user).

  With the spread of such display devices capable of viewing video in 3D, various technologies have been proposed. For example, the following Patent Document 1 discloses an invention that allows a pseudo stereoscopic image to be viewed easily and at low cost using a normal two-dimensional image signal. According to the present invention, the two-dimensional video signal is divided and converted into two video signals that are shifted only in the horizontal direction so that the two-dimensional video signal can be seen at a position separated by the eye width (the width of the left and right eyes). Can be a stereoscopic image.

  Here, in the above-described conventional 3D display device, when viewing both 3D images, when both eyes (and 3D glasses) are not aligned horizontally due to the user tilting his / her neck, etc. There arises a problem that the three-dimensional effect cannot be obtained.

  As described above, in the FS method, the object position in the right-eye image and the left-eye image is determined according to the position of the right eye and the left eye of the user, and a predetermined stereoscopic effect is generated. This is because in the state where both eyes are tilted, this positional relationship is lost and appropriate parallax cannot be obtained.

  Therefore, techniques for solving such problems have also been proposed. For example, the following Patent Document 2 discloses a technique related to a stereoscopic image display apparatus that controls a stereoscopic display to be interrupted so as not to cause fatigue when a user views a stereoscopic image in a posture in which fatigue is likely to occur. Has been. Specifically, the amount of inclination of the face of the user wearing 3D glasses is detected to determine whether or not both eyes are aligned horizontally. If it is determined that the eyes are not aligned horizontally, a stereoscopic display is displayed. Interrupt.

  Patent Document 3 below discloses an invention relating to polarized glasses for stereoscopic image observation that allows a displayed image to be viewed stereoscopically even when the user's head is tilted. According to this invention, there is no need to interrupt the stereoscopic display as in the invention described in Patent Document 2, and even if the eyes are not aligned horizontally due to the tilt of the user's head, Stereoscopic viewing is possible because the polarizing lens provided is rotatable.

  Alternatively, in Patent Document 4 below, when a user moves a stereoscopic image display device, an image is displayed from a desired viewpoint by simultaneously controlling movement of three axes such as left and right and rotation around the three axes. There is disclosed a stereoscopic image display device that can achieve portability. According to the present invention, when a stereoscopic image is displayed, the stereoscopic image can be displayed from a direction desired to be viewed using motion parallax.

JP-A-8-205201 (released on August 9, 1996) JP 2001-296501 A (released on October 26, 2001) Japanese Patent Laid-Open No. 7-230060 (published August 29, 1995) JP 2007-47294 A (published February 22, 2007)

  However, in the above-described conventional technology, in the display device based on the FS method, when a user tilts his / her neck and the eyes are not aligned horizontally, the stereoscopic effect when both eyes are aligned horizontally is obtained. The problem that viewing cannot be continued while maintaining cannot be solved.

  That is, in the invention described in Patent Document 2 described above, since the stereoscopic display is interrupted when the head is tilted, the user always has a stiff attitude in which both eyes are fixed horizontally in order to continue viewing the stereoscopic video. Forced to watch in In addition, the invention described in Patent Document 3 solves the above-mentioned problem by devising the glasses as hardware in a method of wearing glasses equipped with a polarizing lens, and is applied to the FS method. I can't. The inventions described in Patent Documents 1 and 4 are not intended to solve the above problems.

  The present invention has been made in view of the above-described problems, and the purpose of the present invention is to provide a display device based on the FS system in which both eyes are in a state where both eyes are inclined by tilting the neck. It is to provide a display device or the like that can give the same three-dimensional effect as a horizontally arranged state.

  In order to solve the above problems, the display device of the present invention alternately displays a right-eye image to be visually recognized by the right eye and a left-eye image to be visually recognized by the left eye, and the left and right of the stereoscopic glasses. A display device that allows a user to view stereoscopically by synchronizing opening and closing of the shutter with the alternate display, wherein the glasses acquire the inclination angle with respect to the horizontal plane of the glasses, and the glasses with the inclination angle acquired by the inclination acquisition means. The left-eye image or the left-eye image so that the parallax given to the user stereoscopically matches the parallax given to the user stereoscopically viewed with the glasses whose tilt angle is zero. An image generating means for generating and displaying a right-eye image for tilting and a left-eye image for tilting reconstructed from the right-eye image is provided.

  Further, in order to solve the above-described problem, the display device control method of the present invention alternately displays a right-eye image to be visually recognized by the right eye and a left-eye image to be visually recognized by the left eye, and for stereoscopic viewing. A display device control method for causing a user to stereoscopically view the opening and closing of the left and right shutters of the glasses in synchronism with the alternate display, wherein the inclination acquisition step acquires the inclination angle of the glasses with respect to the horizontal plane, and the inclination acquisition step The parallax given to the user who stereoscopically views with the glasses having the inclination angle acquired in step 5 matches the parallax given to the user stereoscopically viewed with the glasses whose tilt angle is zero in the right-eye image and the left-eye image. And an image generation step for generating and displaying the right-eye image for tilting and the left-eye image for tilting reconstructed from the left-eye image or the right-eye image. It is characterized in Mukoto.

  According to said structure, the inclination | tilt angle with respect to the horizontal surface of the spectacles for stereoscopic vision is acquired. Then, the left-eye image or the right-eye image is set so that the parallax given to the user stereoscopically viewed with the glasses having the tilt angle of zero matches the parallax given to the user stereoscopically viewed with the glasses having the acquired tilt angle. The reconstructed right eye image for tilting and the left eye image for tilting are generated and displayed.

  Therefore, according to the above configuration, the stereoscopic effect similar to the state in which the inclination angle of the glasses is zero, that is, both eyes are aligned horizontally, for a user whose eyes are inclined by tilting the neck or the like. Can be given.

  Note that the parallax may be matched for the entire region of the image, or the parallax may be matched for a part of the region. In the case where the parallax is matched with respect to a part of the area, the stereoscopic effect about the area can be maintained.

  In addition, the right-eye image for tilting and the left-eye image for tilting are generated based on either the left-eye image or the right-eye image, but it is arbitrary which image is generated from which image. is there. For example, both the right eye image for tilting and the left eye image for tilting may be generated based on the left eye image, or the left eye image for tilting may be generated based on the left eye image to generate the right eye image. The right eye image for tilting may be generated based on the above.

  The display device includes a point R on the right-eye image and a point L on the left-eye image that are recognized as the same point when the right-eye image and the left-eye image are stereoscopically viewed. Parallax data acquiring means for acquiring parallax data indicating parallax, wherein the image generating means sets R ′ as a point corresponding to the point R in the right eye image for tilting, and the image in the left eye image for tilting When the point corresponding to the point L is L ′, the parallax between the point R ′ and the point L ′ matches the parallax indicated by the parallax data, and the point R ′ and the point L ′ are connected on the display surface. The point R or the point L is moved so that the angle formed by the line segment and the horizontal plane coincides with the inclination angle acquired by the inclination acquisition means, and the right eye image for inclination and the left eye for inclination It is preferable to generate an image for use.

  According to said structure, the parallax data which show the parallax of the point R on the image for right eyes, and the point L on the image for left eyes are acquired. The parallax between the point R ′ on the tilt right eye image and the point L ′ on the tilt left eye image respectively corresponding to the point R and the point L matches the parallax indicated by the parallax data, and The point R or the point L is moved so that the angle formed by the line connecting the point R ′ and the point L ′ on the display surface and the horizontal plane coincides with the inclination angle acquired by the inclination acquisition means. Then, an image for right eye for tilting and an image for left eye for tilting are generated.

  That is, according to the above configuration, when the user's eyes are not aligned horizontally, the right-eye image for tilting when the point R ′ and the point L ′ are tilted at the same tilt as the tilt of both eyes and The left eye image for tilting is displayed. The parallax between these points is the same as the parallax between the points R and L of the original right-eye image and left-eye image.

  Therefore, according to said structure, the same three-dimensional effect as the state where both eyes were located horizontally can be given with respect to the user whose both eyes inclined by tilting the neck etc.

  The right-eye image for tilting and the left-eye image for tilting may be obtained by reconstructing the positions of all the points R and L in the right-eye image and the left-eye image, or some points. The position of (for example, a point included in a partial area in the image) may be reconstructed.

  In addition, the image generation unit may include the point R or the point L included in the same parallax region for at least one of the same parallax regions that are the collection of the points R or L with the same parallax indicated by the parallax data. It is preferable to generate the tilted right eye image and the tilted left eye image by moving.

  According to the above configuration, the right-eye image for tilting and the left-eye image for tilting are generated by moving the point R or the point L in the same parallax region. Therefore, it is possible to give the same stereoscopic effect to a user who has both eyes tilted by tilting his / her head in the same parallax region, as in the case where both eyes are aligned horizontally. Note that the same parallax region is a collection of points with the same parallax, and thus is recognized as the same region when viewed stereoscopically.

  Moreover, it is preferable that the said parallax data acquisition means produces | generates the distance of the horizontal direction of the said point R and the said point L on a display surface as parallax data which shows the parallax of the said point R and the point L. FIG.

  According to the above configuration, the horizontal distance between the point R and the point L is generated as the parallax data indicating the parallax between the point R and the point L. Therefore, even for content that does not include the parallax data, A three-dimensional display corresponding to the inclination can be performed.

  Further, the image generation means generates the right eye image for tilting by moving the point R or the point L in the vertical direction or the horizontal direction on the right eye image or the left eye image. It is preferable that the left eye image for tilting is generated by moving R or the point L in the horizontal direction or the vertical direction.

  According to the above configuration, by moving the point R or the point L in the horizontal direction and the vertical direction, the tilt right eye image and the tilt left eye image are generated. In addition, it is possible to generate an image for the right eye for tilting and an image for the left eye for tilting.

  When the point R or the point L is moved in the vertical direction and the right eye image for tilting is generated, the point R or the point L is moved in the horizontal direction to generate the left eye image for tilting. Similarly, when the left eye image for tilting is generated by moving the point R or the point L in the vertical direction, the right eye image for tilting is generated by moving the point R or the point L in the horizontal direction. .

  Further, when the inclination angle acquired by the inclination acquisition means is θ and the parallax of the corresponding point is d, the vertical movement amount of the point R or the point L can be expressed as d × sin θ, and the horizontal movement amount is It can be expressed as d × cos θ.

  Further, in order to solve the above problems, the display system of the present invention alternately displays a right-eye image to be visually recognized with the right eye and a left-eye image to be visually recognized with the left eye, A display system comprising: a display device that allows a user to view stereoscopically by synchronizing the opening and closing of left and right shutters with the alternate display; the glasses; and a measuring device that measures an inclination angle of the glasses with respect to a horizontal plane. The apparatus includes, from the measurement apparatus, an inclination acquisition unit that acquires an inclination angle of the glasses with respect to a horizontal plane, and a parallax that is given to a user who stereoscopically views the glasses with the inclination angle acquired by the inclination acquisition unit, and the right-eye image and The left-eye image or the right-eye image is set so that the left-eye image matches a parallax given to a user who stereoscopically views with the glasses having the tilt angle of zero. Is characterized in that it comprises an image generating means for generating and displaying the reconstructed inclined right eye image and the left eye image for at tilt time was the.

  According to said structure, a measuring apparatus measures the inclination angle with respect to the horizontal surface of the spectacles for stereoscopic vision. Then, the display device uses the tilt angle acquired from the measurement device to give parallax to the user who stereoscopically views with the glasses with the tilt angle of zero and to the user stereoscopically viewed with the glasses with the acquired tilt angle. The right eye image for tilting and the left eye image for tilting generated by reconstructing the image for the left eye or the image for the right eye so as to match the parallax are generated and displayed.

  Therefore, according to the above configuration, the measurement device detects that the user's eyes are tilted by tilting the neck and the like, and the display device is similar to the state where the eyes are aligned horizontally. A stereoscopic effect can be given to the user.

  In addition, the said measuring apparatus may be integrated in the display apparatus or the spectacles for stereoscopic vision, and may be attached with respect to these. Further, the display device and the stereoscopic glasses may be provided independently.

  The display device may be realized by a computer. In this case, a control program for causing the display device to be realized by the computer by causing the computer to operate as each unit of the display device, and recording the program. Such computer-readable recording media also fall within the scope of the present invention.

  As described above, the display device of the present invention has a tilt acquisition unit that acquires the tilt angle of the glasses with respect to the horizontal plane, and the parallax that is given to the user who stereoscopically views the glasses with the tilt angle acquired by the tilt acquisition unit is for the right eye. The right-eye image for tilting when the left-eye image or the right-eye image is reconstructed so that the image and the left-eye image match the parallax given to the user who stereoscopically views with the glasses whose tilt angle is zero, and And an image generation means for generating and displaying a left eye image for tilting.

  Further, according to the control method of the display device of the present invention, the inclination acquisition step for acquiring the inclination angle of the glasses with respect to the horizontal plane, and the parallax given to the user who stereoscopically views the glasses with the inclination angle acquired in the inclination acquisition step are for the right eye. The right-eye image for tilting when the left-eye image or the right-eye image is reconstructed so that the image and the left-eye image match the parallax given to the user who stereoscopically views with the glasses whose tilt angle is zero, and And an image generation step of generating and displaying an image for left eye for tilting.

  In the display system of the present invention, the display device obtains an inclination acquisition unit that acquires an inclination angle of the glasses with respect to the horizontal plane from the measurement device, and a parallax that is given to a user who stereoscopically views the glasses with the inclination angle acquired by the inclination acquisition unit. However, when the image for the right eye and the image for the left eye match the parallax given to the user viewing stereoscopically with the glasses having the inclination angle of zero, the image for the left eye or the image for the right eye is reconstructed. And an image generating means for generating and displaying a right-eye image and a left-eye image for tilting.

  Therefore, there is an effect that it is possible to give the same stereoscopic effect to the user in which both eyes are inclined with respect to the horizontal plane by tilting the neck or the like in a state where both eyes are aligned horizontally.

It is a block diagram showing the principal part structure of the display system which is one Embodiment of this invention. In the said display system, a mode that the user's both eyes inclined was represented typically. An image for the right eye, an image for the left eye, and an image obtained by superimposing these images are shown. FIG. 3 schematically illustrates a series of image generation processes performed by an image generation unit of a display device included in the display system. It is a figure explaining the specific method of a movement amount and a movement direction about the 3D image from which a stereoscopic effect is obtained in the depth direction with respect to a display surface, and the figure (a) shows the example of a rotational movement, The figure (b) Shows an example of translation. It is a figure explaining the specific method of a movement amount and a movement direction about 3D image with which a three-dimensional effect is obtained in the near direction with respect to a display surface, The figure (a) shows the example of rotational movement, The figure (b) Shows an example of translation. It is a figure which shows the specific example of the moving direction and moving amount which the said image generation part specifies, when 3D glasses contained in the said display system incline 30 degrees to the right upward, The figure (a) is three-dimensionally in the depth direction. An example in which a 3D image that provides a feeling is an object is shown, and FIG. 5B shows an example in which a 3D image that provides a stereoscopic effect in the front direction is an object. It is a figure which shows the specific example of the moving direction and moving amount which the image production | generation part 63 specifies when the said 3D glasses incline 45 degrees to the right, The figure (a) is 3D in which a three-dimensional effect is obtained in the depth direction. An example in which an image is a target is shown, and FIG. 9B shows an example in which a 3D image that provides a stereoscopic effect in the front direction is a target. It is a figure which shows the specific example of the moving direction and moving amount which the image production | generation part 63 specifies when the said 3D glasses incline 60 degrees to the right upward, The figure (a) is 3D in which a three-dimensional effect is obtained in the depth direction. An example in which an image is a target is shown, and FIG. 9B shows an example in which a 3D image that provides a stereoscopic effect in the front direction is a target. It is a flowchart which shows an example of the process which the said display apparatus performs. It is a flowchart which shows an example of the image generation process which the said image generation part performs. It is the figure which represented typically a mode that the image for right eyes and the image for left eyes were displayed alternately in the conventional 3D display apparatus based on FS system. It is a figure explaining the relationship between parallax, the image for right eyes, and the image for left eyes, The figure (a) and (b) show the three-dimensional effect in the depth direction with respect to a display surface, The figure (c) is a display surface. The relationship when a three-dimensional feeling is given to the near side is shown.

  Hereinafter, embodiments of the present invention will be described in detail with reference to FIGS.

〔Overview〕
An overview of the display device according to the present embodiment will be described with reference to FIG. FIG. 2 schematically shows a state where both eyes of the user are tilted in a display system (including a display device and 3D glasses) according to an embodiment of the present invention.

  The display device according to the present embodiment is a display device that displays a 3D image by the FS method. That is, the display device alternately outputs a right-eye image and a left-eye image for stereoscopic viewing to the display unit, and transmits a shutter synchronization signal to the 3D glasses. In accordance with this signal, the 3D glasses open and close the right-eye shutter and the left-eye shutter so as to synchronize with the alternate display of the right-eye image and the left-eye image. Accordingly, the user can visually recognize the right-eye image with only the right eye and the left-eye image with only the left eye, and can obtain a stereoscopic effect.

  Here, in the display system according to the present embodiment, the sensor included in the 3D glasses measures the inclination angle of the 3D glasses from the horizontal plane, and transmits this to the display device. Thereby, the display device can specify whether or not the 3D glasses are in a horizontal state, and how much the 3D glasses are inclined when the 3D glasses are not in a horizontal state.

  The tilt angle is the tilt angle from the state in which the lens surface of the 3D glasses is parallel to the display surface of the display device, and the right eye lens and the left eye lens are horizontally aligned. The inclination angle is indicated by θ. However, when −90 ° ≦ θ ≦ + 90 ° and θ = 0, the right eye lens and the left eye lens are horizontally aligned, and when θ = −90 °, the left eye lens is located above (right above) the right eye lens. When θ = + 90 °, the right eye lens is positioned above (directly above) the left eye lens. That is, when θ is negative, the 3D glasses are tilted downward, and when θ is positive, the 3D glasses are tilted upward.

  The display device is a right-eye image in which each object included in the image is shifted so that the same parallax as in the horizontal state is maintained when the 3D glasses are not in a horizontal state and the tilt is equal to or greater than a certain level. And an image for the left eye (an image for the right eye for tilting and an image for the left eye for tilting) are generated and displayed.

  Therefore, even when the user's eyes are tilted, for example, by tilting the neck during viewing of the 3D image, the 3D image can be viewed with the same stereoscopic effect as when both eyes are horizontal. .

  Although the details will be described below, the display device generates parallax data indicating the parallax of each object included in the image from the amount of shift between the original right-eye image and the left-eye image. Then, from the original right-eye image or the original left-eye image, the generated parallax data, and the detected tilt angle θ, the right-eye image and the left eye that can be viewed three-dimensionally correctly even when the user's eyes are tilted A new image is generated.

[Configuration of display system]
The configuration of the display system according to the present embodiment will be described with reference to FIG. FIG. 1 is a block diagram showing a main configuration of the display system. As illustrated, the display system 100 includes a display device 1, 3D glasses (stereoscopic glasses) 2, and an image storage unit 3.

  The display device 1 includes a control unit 4 and a display unit 5, and the control unit 4 includes an image processing unit 6 and a display control unit 7. Further, the image processing unit 6 includes a parallax data generation unit (parallax data acquisition unit) 61, an inclination acquisition unit (tilt acquisition unit) 62, and an image generation unit (image generation unit) 63.

  The 3D glasses 2 include a right-eye shutter 21, a left-eye shutter 22, a shutter control unit 23, and an inclination detection unit (measuring device) 24.

  In the present embodiment, it is assumed that the display device 1 is a so-called 3D television. However, a portion not directly related to the present invention, for example, a portion that receives a television image or a television program is recorded. Parts etc. are omitted. Hereinafter, the display device 1 (the control unit 4, the display unit 5, the parallax data generation unit 61, the inclination acquisition unit 62, the image generation unit 63, the display control unit 7), the 3D glasses 2 (the right eye shutter 21 and the left eye shutter 22, The functions of the respective components will be described in the order of the shutter control unit 23, the inclination detection unit 24), and the image storage unit 3.

(Display device 1)
The display device 1 is a display device that can display a 3D image. As described above, in this embodiment, a 3D image is displayed by the FS method.

  The control unit 4 performs processing for operating the display device 1 as described below. The display unit 5 is a device that displays an image, and can be configured by a liquid crystal display, for example.

  The image processing unit 6 reads the right-eye image and the left-eye image stored in the image storage unit 3, and outputs the read image to the display control unit 7. Also, the necessity of image generation is determined from the inclination θ acquired by the inclination acquisition unit 62.

  The parallax data generation unit 61 is a parallax representing a parallax between a portion on the right-eye image and a portion on the left-eye image that is recognized as the same portion when stereoscopically viewed using the right-eye image and the left-eye image. Get the data. Specifically, the parallax data generation unit 61 acquires the parallax data from the image storage unit 3 when the parallax data is stored in the image storage unit 3, and from the image storage unit 3 when the parallax data is not stored. Parallax data is generated from the read right-eye image and left-eye image. The method for generating parallax data will be described in detail later.

  The inclination acquisition unit 62 acquires the inclination of the 3D glasses 2. Specifically, the tilt angle θ (see FIG. 2) of the 3D glasses 2 is acquired by receiving a measurement value from the tilt detection unit 24 provided in the 3D glasses 2. Note that the tilt acquisition unit 62 only needs to be able to acquire data indicating the tilt of the 3D glasses 2. For example, the tilt obtained from the analysis result of the image obtained by photographing the user with a camera provided in the display device 1 or the like. A corner may be acquired. In addition, the inclination acquisition unit 62 may perform such analysis. In other words, the device for measuring the tilt angle is not limited to the tilt detection unit 24 of the 3D glasses 2, and the tilt acquisition unit 62 may have a function as a device for measuring the tilt angle. You may provide the other apparatus which has.

  The image generation unit 63 uses the inclination angle θ input from the inclination acquisition unit 62 and the parallax data generated by the parallax data generation unit 61 to obtain the inclination of θ from the original right-eye image or the original left-eye image. A new right-eye image and left-eye image corresponding to the above are generated. The image generation method by the image generation unit 63 will be described in detail later.

  The display control unit 7 performs control for stereoscopic display. Specifically, the display control unit 7 alternately outputs the right-eye image and the left-eye image generated by the image generation unit 63 to the display unit 5 at predetermined intervals, and outputs a shutter synchronization signal to the 3D glasses 2. Is sent to the shutter control unit 23 included.

(3D glasses 2)
The 3D glasses 2 are devices worn by the user when viewing a stereoscopic image output to the display unit 5. Here, the display device 1 and the 3D glasses 2 are configured to be communicable via wire or wirelessly. Thus, a shutter synchronization signal transmitted from the display control unit 7 to the shutter control unit 23 can be received, and a tilt measurement value can be transmitted from the tilt detection unit 24 to the tilt acquisition unit 62. . As long as such information can be transmitted and received, the communication mode is not limited, and wireless communication based on, for example, IrDA may be used. Further, the reception of the synchronization signal and the transmission of the measured value of the inclination may be performed by different communication means.

  The right-eye shutter 21 and the left-eye shutter 22 open and close in accordance with the control of the shutter control unit 23 to alternately block the user's right eye and left eye fields of view. Accordingly, the user can visually recognize the right-eye image only with the right eye and the left-eye image only with the left eye.

  The shutter control unit 23 opens and closes the right eye shutter 21 and the left eye shutter 22 in accordance with a shutter synchronization signal received from the display control unit 7. As a result, the switching between the right-eye image and the left-eye image in the display device 1 and the opening and closing of the right-eye shutter 21 and the left-eye shutter 22 are synchronized, and the right-eye image is visually recognized by the right eye and the left-eye image is visually recognized by the left eye. .

  The tilt detection unit 24 measures the tilt angle of the 3D glasses 2 and transmits an angle θ that is a measured value to the tilt acquisition unit 62. The inclination detection unit 24 may be anything that can measure the rotation angle, and may be built in the 3D glasses 2 or may be externally attached. In the present embodiment, an example in which a gyro sensor is applied as the inclination detection unit 24 will be described.

  Note that, as described above, −90 ° ≦ θ ≦ + 90 °, and when θ = 0, the right eye lens and the left eye lens are horizontally aligned, and when θ = −90 °, the left eye lens is above the right eye lens ( When θ = + 90 °, the right eye lens is positioned above (right above) the left eye lens. Of course, the data transmitted by the inclination detection unit 24 can identify the inclination angle of the 3D glasses 2 with respect to the horizontal plane of the 3D glasses 2 and whether the 3D glasses 2 are inclined upward or downward. However, it is not limited to this.

(Image storage unit 3)
The image storage unit 3 is a non-volatile storage device that stores a right-eye image and a left-eye image to be displayed, and can be configured by, for example, a semiconductor memory, a hard disk, a DVD, or the like.

  In the present embodiment, the image storage unit 3 is shown in FIG. 1 as a configuration that is an external storage device connected to the outside of the display device 1 by wire or wirelessly. It may be realized as a built-in device. The display device 1 reads the right-eye image and the left-eye image stored in the image storage unit 3, processes them, and displays them on the display unit 5. However, the data acquisition method is limited to this. Absent. For example, these may be received from a television broadcast wave or may be received via a communication network such as the Internet.

[Generation of parallax data]
Generation of parallax data by the parallax data generation unit 61 will be described with reference to FIG. FIG. 3 shows a right-eye image, a left-eye image read from the image storage unit 3, and an image obtained by superimposing these images. As shown in the figure, the left-eye image and the right-eye image each include two circles, of which the upper circle indicates an object on the display surface and the lower circle is behind the display surface. Indicates an object.

  By superimposing these left-eye image and right-eye image, it can be seen that the upper circle is not displaced, while the lower circle is displaced in the horizontal direction. This is because parallax is given to an object behind the display surface and no parallax is given to an object on the display surface. And this deviation | shift amount has shown the magnitude | size of parallax (refer FIG. 13).

  Therefore, by calculating the amount of deviation between the position of the object in the right-eye image and the position of the object in the left-eye image, the parallax for the object can be specified. Specifically, a point R (dot) in the right-eye image and a point L in the left-eye image corresponding to this point (the point R and the point L are recognized as the same point when viewed stereoscopically) Then, the horizontal distance between the point R and the point L on the display surface can be specified as the parallax between the point R and the point L. Then, by performing such processing for each dot constituting the image, it is possible to generate parallax data (parallax map) indicating the parallax of each object (region having the same parallax) in the image.

  The correspondence between the object in the right-eye image and the object in the left-eye image can be specified by processing such as pattern matching and feature point extraction. The parallax can be calculated from the dots in the object specified in this way.

  Further, the direction of the shift is reversed between the case where the stereoscopic effect is given in the depth direction with respect to the display surface and the case where the stereoscopic effect is given in the front direction (see FIG. 13). For this reason, it is possible to uniquely determine in which direction the stereoscopic effect appears from the direction of deviation.

  Here, the parallax when the point R is located on the right side of the point L on the display surface is indicated by a positive value. On the other hand, the parallax when the point R is located on the left side with respect to the point L is indicated by a negative value. In other words, the parallax when giving a stereoscopic effect in the depth direction is indicated by a positive value, and the parallax value when giving a stereoscopic effect in the front direction is indicated by a negative value. It is possible to specify whether to give a three-dimensional effect in the front direction. Of course, the method of specifying whether to provide a stereoscopic effect in the depth direction or a stereoscopic effect in the near direction is not limited to this method. For example, this may be specified by including in the parallax data information indicating whether the image has a stereoscopic effect in the depth direction or an image with a stereoscopic effect in the front direction.

  For example, when the image includes polygon information (information on the solid coordinates), an image corresponding to the user's viewpoint may be generated using the polygon information. In this case, the user's viewpoint position is specified from the tilt angle, and the image is reconstructed so that the coordinates visible from the viewpoint position are displayed.

[Image Generation Processing by Image Generation Unit 63]
Next, image generation processing by the image generation unit 63 will be described with reference to FIG. FIG. 4 schematically shows a series of image generation processes performed by the image generation unit 63. In the figure, a left-eye image and a right-eye image from which an appropriate parallax can be obtained when both eyes are tilted are obtained from a left-eye image (original image) from which an appropriate parallax is obtained when both eyes are horizontal and parallax data. An example of generation is shown. The left-eye image shown in FIG. 4 is different from the left-eye image shown in FIG.

  In the generated left-eye image and right-eye image, the position of each object is indicated by a solid line, and the position of each object in the original image is indicated by a dotted line. In the parallax data, the parallax of each object is indicated by color coding (the darker the color, the smaller the parallax). That is, an object indicated by a small circle has a smaller parallax than an object indicated by a great circle.

  As illustrated, in the generated left-eye image, the position of the object has moved downward relative to the original left-eye image. In the generated right-eye image, the position of the object is moved to the left with respect to the original left-eye image. By moving the position of the object in this manner (inclining the parallax direction), it is possible to give a feeling of depth similar to the original image even when the user's eyes are inclined.

  Further, in the generated left-eye image and right-eye image, the amount of movement differs for each object. Specifically, the amount of movement of the object indicated by the great circle (large parallax) is larger than that of the object indicated by the small circle (small parallax). Although details will be described later, this is because a larger amount of movement is specified for an object having a larger parallax. Thus, by specifying the amount of movement corresponding to the parallax for each object, a natural stereoscopic effect can be given to the user as compared with the case where the image is simply rotated.

[How to specify the amount and direction of movement]
Next, a method for specifying the movement amount and the movement direction using the parallax data and the inclination angle θ will be described with reference to FIGS. 5 and 6. Note that the amount of movement and the direction of movement differ between an image that gives a stereoscopic effect in the depth direction relative to the display surface and an image that gives a stereoscopic effect in the front direction. In the following, an image that provides a stereoscopic effect in the depth direction will be described first, and then an image that provides a stereoscopic effect in the near direction will be described.

(About 3D images that give a stereoscopic effect in the depth direction with respect to the display surface)
FIG. 5 is a diagram for explaining a method for specifying a movement amount and a movement direction for a 3D image having a stereoscopic effect in the depth direction with respect to the display surface. FIG. 5A shows an example of rotational movement. FIG. (B) shows an example of parallel movement.

  In the figure, a point in the left-eye image constituting the normal 3D image is L, a point in the right-eye image corresponding to L is R, and a distance between L and R (that is, parallax) is d. Moreover, since it is a 3D image in which a stereoscopic effect is obtained in the depth direction with respect to the display surface, R is positioned on the right side with respect to L (see FIGS. 13A and 13B). Note that L and R are recognized as the same point by a user who views stereoscopically.

  In the figure, a point corresponding to L in the generated left-eye image is L ′, and a point corresponding to R in the generated right-eye image is R ′. The inclination angle of the 3D glasses 2 is θ (see FIG. 2).

  In order to maintain the parallax d when the 3D glasses 2 are inclined at an angle θ, as shown in FIG. 5A, a line segment connecting L and R (hereinafter referred to as a line segment L-R) is used. The positions of L and R when rotated by θ with the point A on the line segment as a fulcrum may be the positions of R ′ and L ′, respectively. As described above, the movement amounts and movement directions of R and L can be specified from the parallax d and the angle θ, and the positions of R ′ and L ′ can be specified.

  Further, as shown in FIG. 5B, the positions of R ′ and L ′ can also be specified by moving R and L in the vertical direction or the horizontal direction. In the example of FIG. 5B, L is moved downward in the vertical direction to L ′, and R is moved to the left in the horizontal direction to be R ′.

  It should be noted that such positions of R ′ and L ′ are defined as a line segment connecting R ′ and L ′ (hereinafter referred to as line segment L′-R ′) in the example of FIG. It can be specified by moving downward in the vertical direction until it intersects with the minute LR, and moving leftward in the horizontal direction until L ′ intersects the perpendicular of the line segment LR passing through L.

  Further, as illustrated, the distance between L and L ′ can be expressed as d × sin θ, and the distance between R and R ′ can be expressed as d−d × cos θ = d × (1−cos θ). That is, the position where L is moved vertically downward by d × sin θ can be identified as the position of L ′, and the position where R is moved leftward in the horizontal direction by d × (1-cos θ) is the position of R ′. It can be specified as a position.

  As can be seen from the figure, a new left-eye image and right-eye image can be generated from either the left-eye image or the right-eye image. That is, when a new left-eye image and right-eye image are generated from the left-eye image, the position where the point L is moved to the right in the horizontal direction by d × cos θ can be specified as the position of R ′. Similarly, when a new left-eye image and right-eye image are generated from the right-eye image, the position where the point R is moved left by d in the horizontal direction and d × sin θ is moved downward in the vertical direction by L ′. Can be identified as That is, the movement amount is larger at the point with the larger parallax than the point with the smaller parallax (the movement amount increases in direct proportion to the parallax).

  Also in the example of FIG. 5B, as in the example of FIG. 5A, the distance between R ′ and L ′ is d, and the angle formed by the line segment R′-L ′ and the line segment RL. Is θ, the user wearing the 3D glasses 2 tilted at the angle θ can obtain the parallax d.

  5B shows an example in which the position of R ′ and L ′ is specified by moving the line segment R′-L ′ downward in the vertical direction in the example of FIG. It may be moved upward in the direction. In this case, the line segment R′-L ′ is moved upward in the vertical direction until L ′ intersects with the line segment LR, and horizontally moved rightward until R ′ intersects with the perpendicular of the line segment LR passing through R. By moving, the positions of R ′ and L ′ are specified.

  That is, in this case, compared to the example of FIG. 5B, the moving direction and moving amount of the points L and R are reversed, and the position where R is moved vertically by d × sin θ is the position of R ′. , L is moved to the right in the horizontal direction by d × (1−cos θ) as the position of L ′.

(About 3D images that give a three-dimensional effect in the forward direction with respect to the display surface)
FIG. 6 is a diagram for explaining a method for specifying a movement amount and a movement direction for a 3D image in which a stereoscopic effect is obtained in the forward direction with respect to the display surface. FIG. 6A shows an example of rotational movement. FIG. (B) shows an example of parallel movement.

  The calculation method of the movement amount and the movement direction for the 3D image in which a stereoscopic effect is obtained in the forward direction with respect to the display surface is that R is positioned on the left side with respect to L (see FIG. 13C). Otherwise, it is similar to the example of FIG.

  That is, in order to maintain the parallax d when the 3D glasses 2 are inclined at the angle θ, as shown in FIG. 6A, the line segment LR is set to θ with the point A on the line segment as a fulcrum. The positions of L and R when rotated only by the distance may be the positions of R ′ and L ′, respectively.

  Further, as shown in FIG. 6B, the positions of R ′ and L ′ can also be specified by moving R and L in the vertical direction or the horizontal direction. In the example of FIG. 6B, L is moved upward in the vertical direction to L ′, and R is moved to the right in the horizontal direction to be R ′. As illustrated, the distance between L and L ′ can be expressed as d × sin θ, and the distance between R and R ′ can be expressed as d−d × cos θ = d × (1−cos θ).

  Also in this example, the position where L is moved leftward by d × cos θ in the horizontal direction is specified as the position R ′, and the position where L is moved vertically upward by d × sin θ is specified as the position L ′. be able to. That is, a new left-eye image and right-eye image can be generated from only the left-eye image.

  Further, the positions of R ′ and L ′ can be specified by moving the line segment R′-L ′ downward in the vertical direction. In this case, the position where R is moved vertically downward by d × sin θ is the position of R ′, and the position where L is moved leftward in the horizontal direction by d × (1−cos θ) is the position of L ′.

(Processing executed by image generation unit 63)
The image generation unit 63 generates a new left-eye image and right-eye image from the left-eye image by a method of moving in the vertical direction or the horizontal direction as shown in FIGS. 5B and 6B. . This will be specifically described below.

  First, the image generation unit 63 specifies the moving direction from the parallax data and the angle θ. Specifically, it is determined whether the image has a stereoscopic effect in the depth direction based on the sign of the parallax indicated by the parallax data or an image with a stereoscopic effect in the front direction. Further, it is determined whether the 3D glasses 2 are inclined upward or downward from the sign of the angle θ.

  The direction of movement is specified based on whether the image has a stereoscopic effect in the depth direction, or an image with a stereoscopic effect in the forward direction, and whether the image is tilted upward or downward. To do.

  For example, if the image has a stereoscopic effect in the depth direction and is tilted upward, it is specified that the object in the original left-eye image is moved downward in the vertical direction in the new left-eye image. In the new right-eye image, it is specified that the object in the original left-eye image is moved leftward in the horizontal direction (see FIG. 5B).

  Next, the image generation unit 63 calculates the movement amount of each object in the original left eye image for each of the new left eye image and right eye image. Specifically, a continuous area (identical parallax area) that is a collection of points with the same parallax, identified from the parallax data, is identified as one object. Further, the movement amount of each dot included in the region in the new left-eye image is calculated by the equation d × sin θ, and the movement amount in the new right-eye image is calculated by the equation d × cos θ. Then, this process is performed for each identified object.

  Finally, the image generation unit 63 moves each object in the original left-eye image (dots in the image constituting the object) by the specified movement amount in the specified direction, thereby creating a new left-eye image. An image and a right eye image are generated.

  The parallax given to the user wearing the 3D glasses 2 in which the left-eye image and the right-eye image generated in this way are inclined at an angle θ is the same as the original left-eye image and right-eye image in 3D glasses with θ = 0. This matches the parallax given to the user wearing 2.

  That is, the image generation unit 63 causes the original left eye so that the parallax given to the user stereoscopically viewed with the 3D glasses 2 with the inclination angle θ matches the parallax given to the user stereoscopically viewed with the 3D glasses 2 with θ being zero. A new right-eye image and left-eye image are generated by reconstructing the image for use. Thereby, the user can view a stereoscopic image with the same parallax whether the head is tilted or not.

  In the new left-eye image and right-eye image, when an object is superimposed, drawing is performed in order from the object on the back side so that the object in front is visually recognized. The near object is an object with a small parallax when a stereoscopic effect is given in the depth direction with respect to the display surface, and an object with a large parallax when a stereoscopic effect is given in the near direction. When a portion that is not displayed in the original left-eye image and right-eye image is displayed due to the displacement of the object position, the portion may be supplemented by image processing such as interpolation.

(Specific example of calculation performed by image generation unit 63)
Subsequently, a specific example of the calculation performed by the image generation unit 63 will be described with reference to FIGS. In these drawings, as in the example of FIGS. 5 and 6, the point in the original left-eye image is L, and the point in the original right-eye image corresponding to L is R. Further, the distance between L and R, that is, the parallax d = 10 (dots) in the original 3D image, the point corresponding to L in the new left-eye image is L ′, and the point corresponding to R in the new right-eye image is R '.

(Specific example when θ is 30 °)
FIG. 7 is a diagram illustrating a specific example of the moving direction and the moving amount specified by the image generating unit 63 when the 3D glasses 2 are inclined 30 ° upward (θ = 30 °). Shows an example in which a 3D image with a stereoscopic effect is obtained in the depth direction, and FIG. 6B shows an example in which a 3D image with a stereoscopic effect is obtained in the front direction.

  In the example of FIG. 7A, since the original left-eye image and right-eye image are 3D images that provide a stereoscopic effect in the depth direction, R is positioned on the right side with respect to L. Further, the 3D glasses 2 are inclined upward. Therefore, the positions of L ′ and R ′ are specified so that R ′ is positioned on the right side with respect to L ′ and the line segment L′-R ′ is inclined upward. That is, the position of L ′ is specified as a position where L is moved downward in the vertical direction, and the position of R ′ is specified as a position where L is moved rightward in the horizontal direction.

  Further, since θ = 30 ° and d = 10, the position of L ′ is specified as a position obtained by moving L by 10 × sin 30 ° = 5 downward in the vertical direction. Similarly, the position of R ′ is specified as a position where L is moved to the right in the horizontal direction by 10 × cos 30 ° ≈8.7. Here, since it is assumed that the movement is performed in dot units, values after the decimal point are rounded off. That is, if it is calculated as 8.7 in the above, 9 dots are moved.

  Of course, a new right-eye image may be generated from the original right-eye image, and in this case, a position where R is moved 10-10 × cos 30 ° ≈1.3≈1 in the horizontal direction leftward, What is necessary is just to specify as a position of R '.

  On the other hand, in the example of FIG. 5B, the original left-eye image and right-eye image are 3D images that provide a stereoscopic effect in the front direction, and therefore R is positioned on the left side with respect to L. Further, the 3D glasses 2 are inclined upward. Therefore, the positions of L ′ and R ′ are specified so that R ′ is positioned on the left side with respect to L ′ and the line segment L′-R ′ is inclined upward. That is, the position of L ′ is specified as a position where L is moved vertically upward, and the position of R ′ is specified as a position where L is moved leftward in the horizontal direction.

  Further, since θ = 30 ° and d = 10, the position of L ′ is specified as a position obtained by moving L by 10 × sin 30 ° = 5 upward in the vertical direction. Similarly, the position of R ′ is specified as a position where L is moved leftward in the horizontal direction by 10 × cos 30 ° ≈8.7≈9. Even in this case, a new right-eye image may be generated from the original right-eye image, as in the example of FIG.

(Specific example when θ is 45 °)
FIG. 8 is a diagram showing a specific example of the moving direction and the moving amount specified by the image generating unit 63 when the 3D glasses 2 are inclined 45 ° upward (θ = 45 °). Shows an example in which a 3D image with a stereoscopic effect is obtained in the depth direction, and FIG. 6B shows an example in which a 3D image with a stereoscopic effect is obtained in the front direction.

  In the example of FIG. 8A, the position of L ′ is specified as a position where L is moved downward by 10 × sin 45 ° ≈7 in the vertical direction. Similarly, the position of R ′ is specified as a position obtained by moving L by 10 × cos 45 ° ≈7 to the right in the horizontal direction.

  On the other hand, in the example of FIG. 5B, the position of L ′ is specified as the position where L is moved upward by 10 × sin 45 ° ≈7 in the vertical direction. Similarly, the position of R ′ is specified as a position where L is moved leftward in the horizontal direction by 10 × cos 45 ° ≈7.

(Specific example when θ is 60 °)
FIG. 9 is a diagram showing a specific example of the moving direction and moving amount specified by the image generating unit 63 when the 3D glasses 2 are tilted 60 ° upward (θ = 60 °). Shows an example in which a 3D image with a stereoscopic effect is obtained in the depth direction, and FIG. 6B shows an example in which a 3D image with a stereoscopic effect is obtained in the front direction.

  In the example of FIG. 9A, the position of L ′ is specified as a position where L is moved downward by 10 × sin 60 ° ≈9 in the vertical direction. Similarly, the position of R ′ is specified as a position where L is moved to the right in the horizontal direction by 10 × cos 60 ° = 5.

  On the other hand, in the example of FIG. 5B, the position of L ′ is specified as the position where L is moved upward by 10 × sin 60 ° ≈9 in the vertical direction. Similarly, the position of R ′ is specified as a position obtained by moving L by 10 × cos 60 ° = 5 leftward in the horizontal direction.

[Processing executed by display device 1]
A flow of processing executed by the display device 1 will be described with reference to FIG. FIG. 10 is a flowchart illustrating an example of processing executed by the display device 1.

  First, the image processing unit 6 reads a right-eye image and a left-eye image (a normal 3D image in which appropriate parallax can be obtained when both eyes are horizontal) from the image storage unit 3 (S1), and displays both images as a display control unit. 7 to display in 3D. In other words, the display control unit 7 that has received the input of both images alternately outputs them to the display unit 5 at predetermined time intervals, and transmits a synchronization signal to the 3D glasses 2. In response to this, the display unit 5 alternately displays the image (S2), and the 3D glasses 2 open and close the shutter in synchronization with the alternate display of the image.

  Next, the inclination acquisition unit 62 acquires the inclination angle θ measured by the inclination detection unit 24 of the 3D glasses 2 and transmitted to the display device 1 (S3, inclination acquisition step), and outputs this to the image processing unit 6. To do. The image processing unit 6 that has received the inclination angle θ determines whether or not to generate an image (S4). Specifically, when θ is compared with a predetermined threshold value, it is determined that an image is generated when θ is equal to or greater than the threshold value, and is not generated when θ is less than the threshold value. To do. Note that, as the threshold value is smaller, fine control according to the inclination is performed. However, since the processing load increases, the threshold value may be set in consideration of the performance of the display device 1 and the like.

  If it is determined that no image is to be generated (NO in S4), the process returns to S2 to continue displaying a normal 3D image. If there is no read 3D image, the process returns to S1 and is read.

  On the other hand, when it is determined that an image is to be generated (YES in S4), the image processing unit 6 outputs the inclination angle θ to the image generation unit 63. The image generation unit 63 that has received the tilt angle θ requests parallax data from the parallax data generation unit 61, and the parallax data generation unit 61 that has received this request checks whether parallax data is stored in the image storage unit 3. (S5).

  Here, when the parallax data is stored (S5), the parallax data generation unit 61 reads the stored parallax data and outputs it to the image generation unit 63, and the process proceeds to S8. In addition, when the parallax data is memorize | stored for the speed-up of a process, you may read this into the parallax data generation part 61 or the image generation part 63 previously.

  On the other hand, when parallax data is not stored (NO in S5), the parallax data generation unit 61 determines whether to generate parallax data (S6). Note that whether or not to generate parallax data is set in advance by the user. That is, when the user is set to generate parallax data, the parallax data generation unit 61 determines to generate parallax data. On the other hand, if it is set not to generate, it is determined not to generate.

  Here, if it is determined not to be generated (NO in S6), the process returns to S2. At this time, the user may be prompted to view the 3D glasses 2 in a horizontal state by, for example, notifying the user that the 3D glasses 2 (both eyes of the user) are tilted with an image or sound. .

  On the other hand, when it is determined to generate parallax data (YES in S6), the parallax data generation unit 61 generates parallax data from the input right-eye image and left-eye image (S7), and sends this to the image generation unit 63. Output.

  In S8, the image generation unit 63 performs image generation processing. As a result, the right eye image and the left eye are newly generated from the parallax data input from the parallax data generation unit 61, the inclination θ input from the inclination acquisition unit 62, and the left eye image read out by the image processing unit 6. A production image is generated and output to the display control unit 7.

  Then, the display control unit 7 displays the right-eye image and the left-eye image input from the image generation unit 63 based on the FS method (S9). This post-processing returns to S3, and the inclination is acquired again.

  In the above example, disparity data is generated from the input right-eye image and left-eye image, and a new right-eye image and left-eye image are generated from the left-eye image. Absent. The image used for generating the parallax data may be an image of a frame before the image used for generating a new right-eye image and left-eye image. This is because the parallax hardly changes from frame to frame. Further, when generating parallax data from an image of the previous frame, it is possible to generate parallax data at an earlier timing than when generating parallax data from an image used for generating parallax data. For this reason, it is also possible to reduce the time until new right-eye images and left-eye images are generated.

[Flow of image generation processing]
Next, the flow of image generation processing executed by the image generation unit 63 in S8 of FIG. 10 will be described based on FIG. FIG. 11 is a flowchart illustrating an example of image generation processing executed by the image generation unit 63.

  First, the image generation unit 63 specifies the moving direction from the parallax data and the angle θ (S10). As described above, the moving direction is an image in which a stereoscopic effect appears in the depth direction, or an image in which a stereoscopic effect appears in the forward direction, or the 3D glasses 2 are inclined upward or downward. It is specified according to whether or not.

  Next, the image generation unit 63 calculates the amount of movement of an object (a continuous region having the same parallax) in the original left-eye image for each of the new left-eye image and right-eye image (S11). As described above, the amount of movement in the vertical direction is expressed by the equation d × sin θ, and the amount of movement in the horizontal direction is expressed by the equation d × cos θ.

  Subsequently, the image generation unit 63 confirms whether or not the movement amount has been specified (S12). Here, when the movement amount of all the objects (all areas in the left-eye image) is specified, it may be determined that the movement amount has been specified, or some objects (for example, the parallax is more than a certain value) When the movement amount of only a large object is specified, it may be determined that the specification of the movement amount has been completed. If it is determined that the identification has not been completed (NO in S12), the process returns to S10.

  On the other hand, if it is determined that the identification has been completed (YES in S12), the image generation unit 63 identifies each object (dots in the image constituting the object) in the original left-eye image in the direction identified in S10. The 3D image (new left-eye image and right-eye image) in which the object is moved is generated by moving the object by the movement amount specified in S11 (S13, image generation step). Then, the image generation unit 63 outputs the generated 3D image to the display control unit 7, thereby ending the image generation process.

[Effect of display device 1]
As described above, according to the display device 1, the inclination of the 3D glasses 2 is detected, and the right-eye image and the left-eye image that can be correctly viewed stereoscopically by the user viewing with this inclination are generated and displayed. That is, the tilt of both eyes is used as feedback information, and a 3D image is reconstructed and displayed based on the feedback information.

  Therefore, even when both eyes are not in a horizontal state due to, for example, tilting the neck, the user can view a natural 3D image as in the horizontal state. Thereby, since the restriction | limiting of the attitude | position at the time of a user viewing / listening is eased, 3D image | video can be enjoyed with a more free attitude | position than before.

  In the above embodiment, an example has been described in which each object in the original left-eye image is moved to generate a new left-eye image and right-eye image. However, the original left-eye image is moved to a new one. The left-eye image and the right-eye image may be used. For example, in the example of FIG. 7A, the original left-eye image is moved 5 dots downward in the vertical direction to make a new left-eye image, and the original left-eye image is moved 9 dots to the right in the horizontal direction to make a new one. A right-eye image may be used.

  Thereby, compared with the case where a position is specified for each object in the original image for the left eye, an image corresponding to the tilt can be displayed with a simple process. However, since the parallax for each object is uniformed, the parallax in the image can be uniformed as a matter of course. preferable.

[Example of software implementation]
Finally, each block of the display device 1, particularly the control unit 4, may be realized in hardware by a logic circuit formed on an integrated circuit (IC chip), or using a CPU (Central Processing Unit). It may be realized by software.

  In the latter case, the display device 1 includes a CPU that executes instructions of a program that realizes each function, a ROM (Read Only Memory) that stores the program, a RAM (Random Access Memory) that expands the program, the program, and various types of programs. A storage device (recording medium) such as a memory for storing data is provided. An object of the present invention is to provide a recording medium in which a program code (execution format program, intermediate code program, source program) of a control program of the display device 1 which is software that realizes the above-described functions is recorded so as to be readable by a computer. This can also be achieved by supplying the display device 1 and reading and executing the program code recorded on the recording medium by the computer (or CPU or MPU).

  Examples of the recording medium include tapes such as magnetic tapes and cassette tapes, magnetic disks such as floppy (registered trademark) disks / hard disks, and disks including optical disks such as CD-ROM / MO / MD / DVD / CD-R. IC cards (including memory cards) / optical cards, semiconductor memories such as mask ROM / EPROM / EEPROM / flash ROM, PLD (Programmable logic device), FPGA (Field Programmable Gate Array), etc. Logic circuits can be used.

  The display device 1 may be configured to be connectable to a communication network, and the program code may be supplied via the communication network. The communication network is not particularly limited as long as it can transmit the program code. For example, the Internet, intranet, extranet, LAN, ISDN, VAN, CATV communication network, virtual private network, telephone line network, mobile communication network, satellite communication network, and the like can be used. The transmission medium constituting the communication network may be any medium that can transmit the program code, and is not limited to a specific configuration or type. For example, even with wired lines such as IEEE 1394, USB, power line carrier, cable TV line, telephone line, ADSL (Asymmetric Digital Subscriber Line) line, infrared rays such as IrDA and remote control, Bluetooth (registered trademark), IEEE 802.11 wireless, HDR ( It can also be used by radio such as High Data Rate (NFC), Near Field Communication (NFC), Digital Living Network Alliance (DLNA), mobile phone network, satellite line, and digital terrestrial network. The present invention can also be realized in the form of a computer data signal embedded in a carrier wave in which the program code is embodied by electronic transmission.

  INDUSTRIAL APPLICABILITY The present invention can be used for a display device that enables stereoscopic viewing by synchronizing the opening and closing of the left and right shutters of stereoscopic glasses and switching between the right-eye video and the left-eye video.

1 Display 2 3D glasses (stereoscopic glasses)
21 Shutter for right eye 22 Shutter for left eye 24 Tilt detector (measuring device)
61 Parallax data generation unit (parallax data acquisition means)
62 Inclination acquisition unit (inclination acquisition means)
63 Image generation unit (image generation means)
100 display system

Claims (9)

The right-eye image to be visually recognized by the right eye and the left-eye image to be visually recognized by the left eye are alternately displayed, and the opening / closing of the left and right shutters of the stereoscopic glasses is synchronized with the alternate display, so that the user can A display device,
An inclination acquisition means for acquiring an inclination angle of the glasses with respect to a horizontal plane;
The parallax given to the user stereoscopically viewed with the glasses having the inclination angle acquired by the inclination acquisition means is the parallax given to the user stereoscopically viewed with the glasses whose inclination angle is zero in the right-eye image and the left-eye image. The left eye image or the right eye image for tilting and the image generating means for generating and displaying the left eye image for tilting so as to coincide with the left eye image. apparatus. Obtain parallax data indicating parallax between the point R on the right-eye image and the point L on the left-eye image, which are recognized as the same point when the right-eye image and the left-eye image are stereoscopically viewed Parallax data acquisition means for
When the point corresponding to the point R in the right-eye image for tilt is R ′ and the point corresponding to the point L in the left-eye image for tilt is L ′, The parallax between R ′ and point L ′ coincides with the parallax indicated by the parallax data, and the angle between the line segment connecting point R ′ and point L ′ on the display surface and the horizontal plane is determined by the inclination acquisition means. The point R or the point L is moved so as to coincide with the acquired inclination angle, and the right eye image for tilting and the left eye image for tilting are generated. Display device.   The image generation unit moves the point R or the point L included in the same parallax region with respect to at least one of the same parallax region that is a collection of the point R or the point L with the same parallax indicated by the parallax data. The display device according to claim 2, wherein the right-eye image for tilting and the left-eye image for tilting are generated.   3. The parallax data acquisition unit generates a horizontal distance between the point R and the point L on the display surface as parallax data indicating the parallax between the point R and the point L. Or the display apparatus of 3.   The image generation means generates the right-eye image for tilting by moving the point R or the point L in the vertical direction or the horizontal direction on the right-eye image or the left-eye image. 5. The display device according to claim 2, wherein the left eye image for tilting is generated by moving the point L in a horizontal direction or a vertical direction. 6. The right-eye image to be visually recognized by the right eye and the left-eye image to be visually recognized by the left eye are alternately displayed, and the opening / closing of the left and right shutters of the stereoscopic glasses is synchronized with the alternate display, so that the user can A display system comprising: a display device; the glasses; and a measuring device that measures an inclination angle of the glasses with respect to a horizontal plane,
The display device
An inclination acquisition means for acquiring an inclination angle of the glasses with respect to a horizontal plane from the measuring device;
The parallax given to the user stereoscopically viewed with the glasses having the inclination angle acquired by the inclination acquisition means is the parallax given to the user stereoscopically viewed with the glasses whose inclination angle is zero in the right-eye image and the left-eye image. Image generation means for generating and displaying the right-eye image for tilting and the left-eye image for tilting reconstructed from the left-eye image or the right-eye image so as to match Display system. The right-eye image to be visually recognized by the right eye and the left-eye image to be visually recognized by the left eye are alternately displayed, and the opening / closing of the left and right shutters of the stereoscopic glasses is synchronized with the alternate display, so that the user can A method of controlling a display device,
An inclination acquisition step for acquiring an inclination angle of the glasses with respect to a horizontal plane;
The parallax given to the user who stereoscopically views the glasses with the inclination angle acquired in the inclination acquisition step is the parallax given to the user stereoscopically viewed with the glasses whose inclination angle is zero in the right-eye image and the left-eye image. An image generation step of generating and displaying the right-eye image for tilting and the left-eye image for tilting reconstructed from the left-eye image or the right-eye image so as to match Control method of the device.   A control program for operating the display device according to any one of claims 1 to 5, wherein the control program causes a computer to function as each of the means.   A computer-readable recording medium on which the control program according to claim 8 is recorded.

Images