JP2009278456A - Video display device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To solve the following problem: it is difficult, in a conventional three-dimensional (three-dimensional) video display device, to intuitively obtain the shape of an object being displayed. <P>SOLUTION: A video display device includes a three-dimensional display section 101 for displaying a three-dimensional video image and a two-dimensional display section for displaying a 2D video image (102 shown in the figure is a 2D display and input section also used as an input section) and is configured to display, on the 2D display section, information related to a three-dimensional image being displayed on the three-dimensional display section 101. The image information related to the three-dimensional image to be displayed on the three-dimensional display section 101 is image information containing at least one of a front view, a plane view, side view and a transparent projection view of the three-dimensional image related to a predetermined viewpoint position. Furthermore, a viewpoint estimation section is provided for estimating a viewpoint position of a user, and the image information is generated on the basis of the viewpoint position estimated by the viewpoint estimation section. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a video display device that displays a stereoscopic video.

  As a video display device capable of displaying a stereoscopic video, there is a technique described in Patent Document 1. The technique described in Patent Document 1 is based on the principle of integral photography, and allows a user to perceive a stereoscopic image without requiring special glasses or training.

  Moreover, there exists a technique of patent documents 2-4 as a table-type display of a two-dimensional display. The technology described in Patent Document 2 includes a user position detection unit, controls the orientation of an image displayed on the video display surface based on the detected user position, and a plurality of users individually open a window, Data input and other operations can be performed. The technique described in Patent Document 3 captures information such as conference contents written with a pen on a video display surface together with image information displayed on the video display surface, and stores it in a personal computer or the like. Yes, the technique described in Patent Document 4 uses a touch panel specification for the display unit.

JP 2006-133455 A JP 2000-163179 A Japanese Patent No. 3643907 JP 2001-75733 A

  With the technique described in Patent Document 1, it is difficult to intuitively grasp the shape of the displayed stereoscopic image. Features that help to perceive binocular parallax, such as shape irregularities and textures, although there are individual differences due to physical factors such as distance between left and right eyes or visual acuity, and factors such as spatial recognition ability This is particularly noticeable when there is not enough. Similar problems exist for general stereoscopic video display devices.

  An object of the present invention is to provide a video display device that makes it easier for a user to grasp an object shape more intuitively.

  In order to solve the above-described problem, the video display device of the present invention includes a stereoscopic display unit that displays a stereoscopic image and a two-dimensional display unit that displays a two-dimensional image, and the stereoscopic display unit includes the stereoscopic display unit. Information about the displayed stereoscopic image is displayed.

  According to the present invention, more information useful for grasping the shape of an object is presented to the user in an easy-to-understand manner, thereby making it easier for the user to grasp the shape of the object more intuitively than in the related art.

  Examples of the present invention will be described in detail below.

  The first embodiment of the present invention will be described below with reference to FIGS. The present embodiment is an example suitable for application to, for example, a portable electronic device for editing a three-dimensional electronic pictorial book or three-dimensional data.

  FIG. 1 is an external view of a video display device 100 according to the present embodiment. A user who holds the video display device 100 has a stereoscopic display unit 101 on the left hand side and a two-dimensional display input unit 102 on the right hand side. It is a figure at the time of assuming that.

  The three-dimensional display unit 101 allows a desired three-dimensional image based on given three-dimensional shape information or a three-dimensional image close to the desired three-dimensional image to be viewed from a plurality of viewpoint positions. It is an autostereoscopic display of an integral photography system (also called “integral imaging system”) having an array. The specific embodiment of the stereoscopic display unit 101 is not limited to this, and may be, for example, an integral photography type autostereoscopic display including a lenticular lens, or a holographic display. The display may be a light reproduction type display other than the integral photography method, or may be an autostereoscopic display based on a principle different from the light ray reproduction method, such as a parallax barrier method.

  The two-dimensional display input unit 102 performs information display on the two-dimensional screen and information input on the two-dimensional screen, and includes a two-dimensional display unit 102a and a command input unit 102b. A specific example of the two-dimensional display input unit 102 is, for example, a touch panel display.

  The two-dimensional display unit 102a is configured to display information related to the three-dimensional image displayed on the three-dimensional display unit 101. From the command input unit 102b, for example, a screen of the two-dimensional display unit 102a through a pen-type interface. Configure so that the upper position can be specified. With such a configuration, drawing of a line drawing on a two-dimensional screen, movement of a slider on a slide bar displayed on the two-dimensional screen, pressing of a button displayed on the two-dimensional screen, Etc. can be input.

  The imaging unit 103a and the distance image acquisition unit 103b constitute a viewpoint information acquisition unit 103 that acquires information for estimating the viewpoint position of the user who uses the video display device 100, and the existence range of the user's viewpoint position. It is installed in a position and posture that can acquire information in the space area assumed at the time of design. The space area is defined as a space area relative to the video display device 100. A specific example of the imaging unit 103a is, for example, a digital camera, and a specific example of the distance image acquisition unit 103b is, for example, a TOF (time of flight) type distance image sensor.

  The video display device 100 includes a second sensor connection unit 104b in addition to a first sensor connection unit 104a (not shown) to which the photographing unit 103a and the distance image acquisition unit 103b are connected. The first sensor installation unit 104a and the second sensor installation unit 104b are positioned to face each other with the stereoscopic display unit 101 and the two-dimensional display input unit 102 interposed therebetween, and the imaging unit 103a and the distance image acquisition unit. 103b is paired and can be connected to either the first sensor connection unit 104a or the second sensor connection unit 104b. Note that information regarding which of the first sensor connection unit 104a and the second sensor connection unit 104b is connected to the pair of the imaging unit 103a and the distance image acquisition unit 103b is automatically detected using a known technique. The detection result is sequentially stored as sensor connection information 304 in a storage unit 202 described later.

  Note that the external appearance of the video display device 100 also includes a power switch (not shown).

  FIG. 2 is a configuration diagram of the video display device 100 of the present embodiment. The video display apparatus 100 according to the present embodiment includes an arithmetic processing unit 201, a storage unit 202, an inclination detection unit 203, a stereoscopic display unit 101, a two-dimensional display unit 102a, a command input unit 102b, and a viewpoint information acquisition unit 103. The

  The arithmetic processing unit 201 uses the program and data stored in the storage unit 202 to process the command input from the command input unit 102b while using the storage unit 202 as appropriate. is there.

  The storage unit 202 stores, in addition to programs and data described later (FIG. 3), intermediate data temporarily generated during the processing performed by the arithmetic processing unit 201. For example, a combination of a RAM and a hard disk, Flash memory.

  The tilt detection unit 203 detects the tilt of the stereoscopic display unit 101 and is, for example, a three-axis acceleration sensor. The tilt detection unit 203 includes an x-axis of the local coordinate system of the stereoscopic display unit 101, an x-axis of the tilt detection unit 203, a y-axis of the local coordinate system of the stereoscopic display unit 101, and a y-axis of the tilt detection unit 203, and the stereoscopic display unit 101. The z axis of the local coordinate system and the z axis of the inclination detection unit 203 are installed in the same direction. Specifically, the inclination information detected by the inclination detection unit 203 includes an angle α formed by the x axis with the horizontal plane, an angle β formed by the y axis with the horizontal plane, and an angle γ formed by the z axis with the vertical axis. Then, it is sequentially stored in the storage unit 202 as tilt information 310 to be described later. In this embodiment, the signs of α and β are positive when they are upward from the horizontal plane, and the vertical axis direction is positive when they are vertically upward. Also, a method for calculating the tilt information (α, β, γ) from the gravity acceleration detection value of each axis obtained by the exemplified three-axis acceleration sensor is known.

  FIG. 3 is a diagram illustrating programs and data stored in the storage unit 202 of this embodiment. Note that the intermediate data temporarily generated during the processing performed by the arithmetic processing unit 201 is omitted in FIG. FIG. 4 is a diagram showing how to adopt the local coordinate system of this embodiment.

  The video display program 300 generates a video to be displayed on the stereoscopic display unit 101 and the two-dimensional display unit 102a based on a state that can change from moment to moment, and controls to display the video on the stereoscopic display unit 101 and the two-dimensional display unit 102a. It is a program that performs. Details of the processing of the video display program 300 will be described later (FIG. 6).

  The selected object information 301 is information set based on a command input from the command input unit 102b, and among the plurality of objects stored as the object information 315, which object is displayed as the stereoscopic display unit 101 and the two-dimensional display unit. 102a is information indicating whether to display in 102a.

  The display type information 302 is information set based on the command input from the command input unit 102b. This is information that defines the content of information displayed on the two-dimensional display unit 102a, and a possible value is one of “additional information”, “front view”, “plan view”, “side view”, and “perspective view”. .

  Here, the “front view” is an image obtained by orthogonally projecting the stereoscopic image displayed on the stereoscopic display unit 101 onto the yz plane of the local coordinate system (described later) based on the viewpoint position. An image obtained by orthogonally projecting a stereoscopic image displayed on the stereoscopic display unit 101 onto an xy plane of a local coordinate system (described later) based on the viewpoint position, and a “side view” is displayed on the stereoscopic display unit 101. This is an image obtained by orthogonally projecting a three-dimensional image onto an xz plane of a local coordinate system (described later) based on the viewpoint position. Also, the “perspective projection view” is an image obtained by mapping a stereoscopic image displayed on the stereoscopic display unit 101 by perspective projection based on the viewpoint position indicated by the display viewpoint information 307 and the display parameter 309. is there. A specific method for generating each image will be described later (FIG. 10).

  The display magnification information 303 is information for performing two-dimensional enlargement / reduction of an image displayed on the two-dimensional display unit 102a, and is a non-negative scalar value representing an enlargement ratio.

  The sensor connection information 304 is information indicating whether the pair of the imaging unit 103a and the distance image acquisition unit 103b is currently connected to the first sensor connection unit 104a or the second sensor connection unit 104b.

  The viewpoint tracking mode information 305 is information set based on the command input from the command input unit 102b. This is information that defines what viewpoint position is used as the viewpoint position for generating information to be displayed on the two-dimensional display unit 102a, and a possible value is “always following” that uses the viewpoint position of the current user. "Spot tracking" using the user's viewpoint position when a predetermined command is input from the command input unit 102b, "Fixing viewpoint" using a viewpoint position given in advance as a design value of the video display device 100 One of them.

  The reference plane selection information 306 is information set based on the command input from the command input unit 102b. This is information that defines a reference plane for generating a stereoscopic image to be displayed on the stereoscopic display unit 101. Possible values are the z-axis direction of the local coordinate system of an object displayed as a stereoscopic image, and the local area of the stereoscopic display unit 101. Whichever of “stereoscopic display surface” that matches the z-axis direction of the coordinate system (described later) and “horizontal plane” that matches the z-axis direction of the local coordinate system of the object displayed as a stereoscopic image with the direction of the vertical axis Or one.

  The display viewpoint information 307 is information on the viewpoint position used when generating an image to be displayed on the two-dimensional display unit 102a. The coordinate values of the display viewpoint information 307 are based on a local coordinate system (described later) of the stereoscopic display unit 101. As the display viewpoint information 307, either the viewpoint position estimated by the viewpoint position estimation process described later (FIG. 11) or the viewpoint position defined in the standard viewpoint information 308 is stored.

  The standard viewpoint information 308 is viewpoint position information used when the user's viewpoint position is not followed, and is given in advance as a design value of the video display device 100 assuming an average user. The coordinate values of the standard viewpoint information 308 are stored based on the local coordinate system (described later) of the stereoscopic display unit 101.

  The image generation parameter 309 is a set of parameters for generating a stereoscopic video to be displayed on the stereoscopic display unit 101 and a video to be displayed on the two-dimensional display unit 102a using a known technique. This is information for defining the light rays that the pixels are responsible for, and the pixels of the two-dimensional display unit 102a. Regarding the stereoscopic display unit 101, for example, information such as viewing angle, lens arrangement, pixel arrangement, and the like. For the two-dimensional display unit 102 a, for example, the local coordinate system of the stereoscopic display unit 101 and the two-dimensional display input unit 102. Although it is a scale conversion factor (that is, a value of “k” described later) with respect to the local coordinate system, it is not limited to these.

  The local coordinate system of the stereoscopic display unit 101 is determined as an xyz coordinate system as indicated by 401 in FIG. That is, the center of the rectangular image display area is set as the origin, the x axis and the y axis are arranged on the image display surface so that the y axis is parallel to the bottom of the rectangle, and the positive direction of the y axis is displayed in two dimensions. It is determined as a three-dimensional, right-handed orthogonal coordinate system in which the input unit 102 is arranged and the positive z-axis direction is the side on which the video display surface of the stereoscopic display unit 101 can be viewed.

  The local coordinate system of the two-dimensional display input unit 102 is determined as an xy coordinate system as indicated by 402 in FIG. That is, the center of the rectangular image display area is set as the origin, the x axis and the y axis are arranged on the image display surface so that the x axis is parallel to the bottom of the rectangle, and the negative direction of the x axis is the stereoscopic display unit. The two-dimensional orthogonal coordinate system is defined such that the side on which 101 is arranged and the positive direction of the y-axis is the direction from the center of the rectangle to the base.

  The tilt information 310 stored in the storage unit 202 is tilt information (α, β, γ) of the stereoscopic display unit 101 detected by the tilt detection unit 203 and is sequentially updated by the tilt detection unit 203.

  The coordinate inversion information 311 is displayed and input in the two-dimensional display input unit 102 based on the local coordinate system of the two-dimensional display input unit 102 described above, or the local coordinate system of the two-dimensional display input unit 102 described above is used. This is information specifying whether or not to use a coordinate system rotated by 180 degrees around the origin of the coordinate system (hereinafter referred to as “inverted coordinate system”), and the possible values are based on the local coordinate system. One of the “coordinate inversion” and the “coordinate inversion” based on the inversion coordinate system.

  Similar to the local coordinate system of the stereoscopic display unit 101, the local coordinate system of the object displayed as a stereoscopic image on the stereoscopic display unit 101 is configured as a three-dimensional and right-handed orthogonal coordinate system, and z of the local coordinate system of the object is displayed. The axial direction is configured to coincide with the z-axis direction in the local coordinate system of the stereoscopic display unit 101. The stereoscopic image rotation information 312 is information that defines how much an object is rotated and displayed around the z axis of the local coordinate system of the object when the object is displayed as a stereoscopic image. When N is an integer value, rotation of (D + 360 × N) degrees represents the same action as rotation of (D) degrees. Therefore, as the stereoscopic image rotation information 312, the value of “N” is used. After the adjustment, the value is set to a value not less than 0 degrees and less than 360 degrees (such adjustment is hereinafter referred to as “standardization”), and then the value is stored. The counterclockwise direction is a positive value.

  The viewpoint position reference basis vector information 313 is information on basis vectors forming an orthogonal basis of a local coordinate system that changes depending on the display viewpoint information 307. The description using mathematical formulas is as follows. First, the z-axis direction

Determined by Here, v is a vector representing the three-dimensional viewpoint position defined by the display viewpoint information 307, and o is a vector representing the three-dimensional position of the gazing point. Intuitively, the viewpoint position is the so-called eye position, and the gazing point is the position where the eye is looking. The position of the gazing point is not actually measured, but a given value is used. Different values may be set for each object to be displayed, or may be fixed to the coordinate origin of the local coordinate system of the stereoscopic display unit 101, for example. That is, the z-axis is an axis from the display viewpoint position to the gazing point position. Note that ez is a direction vector in the z-axis direction.

  Next, the direction of the x-axis and y-axis

Or

Determined by [Expression 2] is used when the z-axis direction is not parallel to the z-axis direction of the local coordinate system of the stereoscopic display unit 101, and [Expression 3] is used when they are parallel. That is, in the normal case, using [Equation 2], the x-axis is “an axis in a direction perpendicular to the plane stretched by the z-axis and the z-axis of the local coordinate system of the stereoscopic display unit 101”, and the y-axis is “ However, if the z-axis direction is parallel to the z-axis direction of the local coordinate system of the stereoscopic display unit 101, the plane cannot be determined. As an exception, the x-axis and the y-axis are determined using [Equation 3] so that the plane remains unchanged before and after the display viewpoint information 307 is changed. Here, ex and ey are direction vectors in the x-axis direction and the y-axis direction, respectively. By defining each direction vector as described above, {ex, ey, ez} forms a three-dimensional orthonormal basis.

  Next, basis vectors {Ex, Ey, Ez} used to generate an image to be actually displayed on the two-dimensional display unit 102a are obtained.

Generate with In other words, the orthogonal basis {ex, ey, ez} is obtained by absorbing the difference in scale between the local coordinate system of the stereoscopic display unit 101 and the local coordinate system of the two-dimensional display input unit 102. Ex, Ey, Ez}. The scale conversion factor k is a scalar constant, is calculated based on a design value in advance, and is stored as an image generation parameter 309.

  When the display type information 302 is “perspective projection”, the coordinate value of the three-dimensional position vector t in the local coordinate system of the stereoscopic display unit 101, the coordinate value (x, y) on the two-dimensional display unit 102a, and The relationship between

become that way. Here, s is an enlargement ratio stored in the storage unit 202 as the display magnification information 303. (X, y, h) is an unknown number.

Calculate as follows. The coordinates of the right side of [Equation 5] when (x, y) is given are hereinafter referred to as “a three-dimensional space position corresponding to (x, y)”.

  On the other hand, when the display type information 302 is any one of “front view”, “plan view”, and “side view”, the coordinate value of the three-dimensional position vector t in the local coordinate system of the stereoscopic display unit 101 is displayed.

After performing the coordinate transformation as described above and making the projection direction parallel to the axis, the orthographic projection process is performed.

  The expression of each vector in the description of [Equation 1] to [Equation 7] is an expression based on the local coordinate system of the stereoscopic display unit 101. As the viewpoint position reference basis vector information 313, {ex, ey, ez} and {Ex, Ey, Ez} determined as described above are stored.

  The design information 314 of the viewpoint information acquisition unit includes a half line projected from the position on the image data to the position in each of the captured image data captured by the imaging unit 103a and the distance image data acquired by the distance image acquisition unit 103b. This is information for calculation. The expression of the half line is based on the local coordinate system of the stereoscopic display unit 101. For both the imaging unit 103a and the distance image acquisition unit 103b, it is only necessary to store the position of the projection center that is the starting point position of the half line and the direction vector for each pixel. In this case, in addition to the position of the projection center, the coordinates of the origin of the projection plane and the two base vectors extending the projection plane are stored in an expression based on the local coordinate system of the three-dimensional display unit 101. The direction vector corresponding to the pixel may be obtained by calculation each time. For example, in the case of FIG. 5, the position of the projection center 501 and the coordinates of the origin of the projection plane 502 in the local coordinate system of the stereoscopic display unit 101 for the imaging unit 103a represented by the pinhole model, By storing the two basis vectors extending the projection plane 502, the position 503 on the projection plane corresponding to the position can be obtained from the position on the captured image data, that is, the two-dimensional position. Further, the direction vector can be calculated as a vector representing the direction of the half line 504 passing through the position 503 with the projection center 501 as a starting point. The same applies to the distance image acquisition unit 103b in that it is sufficient to store parameters used for calculating the direction vector.

  The object information 315 includes a set of three-dimensional shape information 315a, additional information 315b, and display three-dimensional information 315c related to one or more objects.

  The three-dimensional shape information 315a is information for determining the three-dimensional shape of the object, and is, for example, a polygon model having vertex, side, and surface information. Vertex information is configured to include information on the number of vertices included in the model and the three-dimensional coordinates of each vertex, and information on the sides includes information on the number of sides included in the model, It is configured to include information for identifying the vertices at both ends, and as surface information, information on the number of surfaces included in the model, information for identifying the vertices constituting each surface, and sides constituting each surface It comprises so that the information to identify and the information of the texture stuck on each surface may be provided. The information specifying the vertices constituting each surface is stored in order counterclockwise based on the outward normal direction of each surface. The three-dimensional coordinates of each vertex are values based on the local coordinate system of the object, and a value that is suitable for being displayed as a stereoscopic image on the stereoscopic display unit 101 is set.

  The additional information 315b is information such as the name and thumbnail image of the object, annotations and dimensions related to the characteristics of each part, and is information that can be mixed with drawing information and character information.

  The display stereoscopic information 315c is information in which the reference plane selection information 306 and the stereoscopic image rotation information 312 are reflected on the object shape information 315a, and only the three-dimensional coordinates of each vertex are different from the stereoscopic shape information 315a. Information. The three-dimensional coordinates of each vertex are expressed using the local coordinate system of the stereoscopic display unit 101 as a reference.

  FIG. 6 is a flowchart of the video display process of this embodiment. The video display process according to the present embodiment is a process that is started when the power of the video display device 100 is turned on and continues to be executed by the arithmetic processing unit 201 until the power of the video display device 100 is turned off.

  When the video display process is started, first, an object selection process is performed in step S601. In the object selection processing in step S601, the object displayed on the stereoscopic display unit 101 and the two-dimensional display unit 102a is selected from the object information 315 stored in the storage unit 202, and the identification information of the object is selected as the selected object. This is a process of storing the information 301 in the storage unit 202. Specifically, for example, a list of selectable objects is presented to the user by displaying a list of object names and thumbnail images included in the object information 315 on the two-dimensional display unit 102a, and a command input The selection result of the user input from the unit 102b may be stored as the selected object information 301.

  Next, display update processing is performed in step S602. The display update process in step S602 is a process of updating the video displayed on the stereoscopic display unit 101 and the video displayed on the two-dimensional display unit 102a based on data stored in the storage unit 202. Details of the display update processing in step S602 will be described later (FIG. 10).

  Next, in step S603, it is determined whether a command has been input. If it is determined in step S603 that the new command input is “present”, the process proceeds to step S604. On the other hand, if it is determined that the new command input is “none”, the process returns to the display update process in step S602 and continues.

  The processing in step S604 is processing for determining whether or not the input command is a setting change command. If the input command is a setting change command, the process proceeds to step S605, and after performing a setting change process described later (FIG. 7), the process returns to the display update process in step S602 and continues the process. On the other hand, if the input command is not a setting change command, the process proceeds to step S606. The setting change command is more specifically a stereoscopic image rotation command, a display type change command, a display magnification change command, a tracking mode change command, or a reference plane change command.

  The processing in step S606 is processing for determining whether or not the input command is a shape change command. If the input command is a shape change command, the process advances to step S607 to perform a shape change process described later (FIG. 8), and then returns to the display update process in step S602 to continue the process. On the other hand, if the input command is not a shape change command, the process proceeds to step S608.

  The process in step S608 is a process for determining whether or not the input command is an object selection command. If the input command is an object selection command, the process returns to the object selection process in step S601 to continue the process. If the input command is not an object selection command, the process returns to the display update process in step S602. Continue processing.

  FIG. 7 is a flowchart of the setting change process of this embodiment.

  When the setting change process is started, first, in step S701, it is determined whether or not the input setting change command is a stereoscopic image rotation command in more detail. When the input setting change command is a stereoscopic image rotation command, the stereoscopic image rotation process in step S706 is performed, and then the setting change process is terminated. On the other hand, if the input setting change command is not a stereoscopic image rotation command, the process proceeds to step S702.

  The process of step S702 is a process of determining whether or not the input setting change command is a display type change command in more detail. If the input setting change command is a display type change command, the display type change process in step S707 is performed, and then the setting change process ends. On the other hand, if the input setting change command is not a display type change command, the process proceeds to step S703.

  The processing in step S703 is processing for determining whether or not the input setting change command is a display magnification change command in more detail. If the input setting change command is a display magnification change command, after performing the display magnification changing process in step S708, the setting changing process is terminated. On the other hand, if the input setting change command is not a display magnification change command, the process proceeds to step S704.

  The process of step S704 is a process of determining whether or not the input setting change command is a follow-up mode change command in more detail. If the input setting change command is a follow-up mode change command, after performing the follow-up mode change process in step S709, the setting change process ends. On the other hand, if the input setting change command is not a follow-up mode change command, the process proceeds to step S705.

  The process of step S705 is a process of determining whether or not the input setting change command is a reference plane change command in more detail. If the input setting change command is a reference plane change command, the reference plane change process in step S710 is performed, and then the setting change process is terminated. On the other hand, if the input setting change command is not a reference plane change command, the setting change process is terminated as it is.

  The stereoscopic image rotation process in step S706 is a process of updating the stereoscopic image rotation information 312 stored in the storage unit 202 based on information input from the command input unit 102b. Specifically, a slide bar pops up along the lower side in the video display area of the two-dimensional display unit 102a, and the amount of rotation is changed by changing the position of the slider on the slide bar from the command input unit 102b. input. The amount of rotation represents the center of the slide bar as the origin. When the slider is in the center of the slide bar, it represents “0 degree rotation”. As the slider moves from the center of the slide bar to the right, the amount of counterclockwise rotation is linear. When the slider reaches the right end of the slide bar, it represents “360 ° counterclockwise rotation”. Note that when the slider moves to the left from the center of the slide bar, it is the same as when the slider moves to the right, except that the direction of rotation is clockwise. The update of the stereoscopic image rotation information 312 refers to the value currently stored as the stereoscopic image rotation information 312. In the case of counterclockwise rotation, the input value (absolute value) is added to the referenced value, and the clockwise rotation is performed. In this case, the input value (absolute value) is subtracted from the referenced value and stored in the storage unit 202 as the stereoscopic image rotation information 312. The calculation result is stored in the storage unit 202 after being standardized. After the calculation result is stored in the storage unit 202, the stereoscopic image rotation process is terminated. Note that the pop-up display disappears after the rotation amount is input.

  The display type change process in step S707 is a process of updating the display type information 302 based on information input from the command input unit 102b. Specifically, a selection button of five choices of “additional information”, “front view”, “plan view”, “side view”, and “perspective projection view” along the lower side in the video display area of the two-dimensional display unit 102a. Is displayed in a pop-up, and one of the selection buttons is selected from the command input unit 102b, thereby inputting a display type to be selected. After inputting the display type to be selected, the display type information 302 is updated according to the input display type, and the display type changing process is terminated. Note that the pop-up display is deleted after the display type is selected.

  The display magnification change process in step S708 is a process of updating the display magnification information 303 or the coordinate inversion information 311 based on the information input from the command input unit 102b. Specifically, a slide bar and selection buttons for “right-handed” and “left-handed” are pop-up displayed along the lower side in the video display area of the two-dimensional display unit 102a, and the slide The display magnification is input by changing the position of the slider on the bar from the command input unit 102b, or the presence / absence of coordinate inversion is input by selecting one of the selection buttons from the command input unit 102b. As for the display magnification, when the left end of the slide bar is the origin and the slider is at the left end of the slide bar, “0x” is displayed. As the slider moves from the left end of the slide bar to the right, the magnification increases linearly. It is configured to represent a predetermined maximum magnification when it reaches the right end of the slide bar. In addition, regarding the presence or absence of coordinate reversal, if “for right-handed” is selected, “no coordinate reversal” is entered, and if “for left-handed” is selected, “coordinate reversal” is entered. To do. When the display magnification is inputted, the value of the display magnification information 303 is set to the inputted display magnification, and the display magnification changing process is ended. When the presence / absence of coordinate inversion is input, the value of the coordinate inversion information 311 is updated according to the input presence / absence of coordinate inversion, and the display magnification changing process is terminated. Note that the pop-up display is erased after the display magnification is input or after the up / down inversion is input.

  The tracking mode change process in step S709 is a process of updating the viewpoint tracking mode information 305 based on information input from the command input unit 102b. Specifically, a selection button of three choices of “always follow”, “spot follow”, and “fixed viewpoint” is pop-up displayed along the lower side in the image display area of the two-dimensional display unit 102a, and the selection button By selecting one of them from the command input unit 102b, the viewpoint follow-up mode to be selected is input. After inputting the viewpoint tracking mode to be selected, the viewpoint tracking mode information 305 is updated according to the input viewpoint tracking mode, then the display viewpoint information 307 is updated, and the viewpoint tracking mode changing process is terminated. The display viewpoint information 307 is updated by performing the viewpoint position estimation process described later (FIG. 11) when the selected viewpoint tracking mode is “always following” or “spot following”. When the viewpoint follow-up mode is “fixed viewpoint”, the standard viewpoint information 308 is copied to the display viewpoint information 307. Note that the pop-up display disappears after the viewpoint tracking mode is selected.

  The reference plane change process in step S710 is a process for updating the reference plane selection information 306 based on the information input from the command input unit 102b. Specifically, an alternative selection button of “stereoscopic display surface” and “horizontal plane” is pop-up displayed along the lower side in the video display area of the two-dimensional display unit 102a, and one of the selection buttons is displayed. Is selected from the command input unit 102b, thereby inputting a reference plane to be selected. After inputting the reference plane to be selected, the reference plane selection information 306 is updated according to the input reference plane, and the reference plane changing process is terminated. Note that the pop-up display is deleted after the reference plane is selected.

  Note that the pop-up display in steps S706 to S710 described above and information input using the command input unit 102b are referred to the coordinate inversion information 311 stored in the storage unit 202, and the two-dimensional display input unit 102 An appropriate one of the local coordinate system and the inverted coordinate system is used as a reference coordinate system to perform display and input processing.

  FIG. 8 is a flowchart of the shape change process of this embodiment. In the shape change process of the present embodiment, on the image displayed on the two-dimensional display unit 102a, a vertex to be moved is selected by the command input unit 102b, and subsequently, the position to which the vertex is moved is similarly determined. This is a process of changing the three-dimensional shape information 315a by designating using the command input unit 102b on the image displayed on the two-dimensional display unit 102a. In addition, although the case where only one point on the stereoscopic image is moved will be described, the embodiment of the present invention is not limited to this.

  When the shape change process is started, first, in step S801, it is determined whether or not the value of the display type information 302 currently stored in the storage unit 202 is “additional information”. If the value of the display type information 302 is “additional information”, the shape change process is terminated. On the other hand, if the value of the display type information 302 is not “additional information”, the process proceeds to step S802.

  The process of step S802 is a process of determining whether or not the value of the display type information 302 currently stored in the storage unit 202 is “perspective projection view”. If the value of the display type information 302 is “perspective projection”, the process proceeds to the perspective projection target point selection process in step S803, and the value of the display type information 302 is not “perspective projection”. Advances to the orthogonal projection target point selection processing in step S805.

  The perspective projection point of interest selection processing in step S803 is moved based on the input of the position on the video display area of the two-dimensional display unit 102a (hereinafter referred to as “selected position”) made from the command input unit 102b. This is the process of selecting the desired vertex. At this time, “the selected position does not necessarily coincide with one of the vertices currently drawn on the two-dimensional display unit 102a among the vertices stored as the display stereoscopic information 315c. Under the premise that “”, one of the most likely vertices is selected. Specifically, since the half line corresponding to the selected position can be calculated by referring to the display viewpoint information 307, the image generation parameter 309, and the viewpoint position reference basis vector information 313, the display solid information 315c is obtained. Of the stored vertices, the distance to the half line is calculated for all the vertices currently drawn on the two-dimensional display unit 102a, and the vertex having the smallest distance is selected.

  For example, in the case of FIG. 9, first, the projection position 902 defined by the display viewpoint position 901, the image generation parameter 309, and the viewpoint position reference basis vector information 313 corresponds to the selected position on the projection plane 902. A half-line 904 corresponding to the selected position is calculated from the position 903, and then the object currently displayed on the two-dimensional display unit 102a (an image of the object on the projection plane 902 is displayed in the image 905) is displayed. The vertex 907 having the minimum distance from the half line 904 may be selected with reference to the stereoscopic information (the solid represented by the stereoscopic information for display is indicated by the solid 906).

  The distance is calculated by assuming that the viewpoint position obtained by referring to the display viewpoint information 307 is v, the direction vector of the half line is d, and the position of the vertex for which the distance is to be calculated is p, the position of p A vector of perpendiculars down to a half line

Therefore, this length can be obtained. At this time, when the sign of the inner product is negative, it means that the perpendicular foot is not on the half line, and is excluded from the selection target. Note that v, d, and p are three-dimensional vectors, and d is normalized to a length of 1. On the other hand, whether or not each vertex is currently drawn on the two-dimensional display unit 102a is determined by, for example, generating a depth buffer related to the viewpoint position obtained by referring to the display viewpoint information 307, and This may be done by comparing the depth value of and the depth value of each vertex. After selecting a vertex, the process proceeds to step S804.

  The perspective projection change destination calculation process in step S804 is based on the input of the position on the video display area of the two-dimensional display unit 102a (hereinafter referred to as “designated position”) made by the command input unit 102b. This is a process for calculating the position to move the vertex selected in step (b). Specifically, since a half line corresponding to the specified position can be calculated by referring to the display viewpoint information 307 and the image generation parameter 309, 3 of the vertices selected in step S803 on the half line. The three-dimensional position closest to the three-dimensional position is calculated as the destination three-dimensional position. More specifically, when the viewpoint position obtained by referring to the display viewpoint information 307 is v, the direction vector of the half line is d, and the position of the vertex selected in step S803 is p,

The position represented by is the change destination position. Note that v, d, and p are three-dimensional vectors, and d is normalized to a length of 1. After calculating the change destination position, the process proceeds to the local shape changing process in step S807.

  The orthographic point-of-interest selection processing in step S805 is the same as the processing in step S803 except that the projection method is not orthogonal projection but orthographic projection. The premise that “the selected position does not necessarily coincide with any one of the vertices currently drawn on the two-dimensional display unit 102a among the vertices stored as the display stereoscopic information 315c”. In order to select one of the most likely vertices, two-dimensional for all the vertices currently drawn on the two-dimensional display unit 102a among the vertices stored as the display stereoscopic information 315c. The distance to the selected position is calculated on the local coordinate system of the display input unit 102, and the vertex having the smallest distance is selected. Whether or not each vertex is currently drawn on the two-dimensional display unit 102a is determined by, for example, generating a depth buffer for the projection direction and comparing the depth value on the depth buffer with the depth value of each vertex. It can be done with. After selecting the vertex, the process proceeds to step S806.

  The orthographic change destination calculation process in step S806 is the same as the process in step S804 except that the projection method is not orthogonal projection but orthographic projection. When the projection method is orthographic projection, the designated three-dimensional position is projected onto a plane that includes the selected vertex and is perpendicular to the projection direction, and sets the changed three-dimensional position. For example, when the position of the vertex selected in step S805 is p, the direction vector of the projection direction is d, and the three-dimensional space position corresponding to the designated position input from the command input unit 102b is v,

The position represented by is the change destination position. Note that v, d, and p are three-dimensional vectors, and d is normalized to a length of 1. After calculating the change destination position, the process proceeds to the local shape changing process in step S807.

  The local shape changing process of step S807 is a three-dimensional shape related to the object specified by the selected object information 301 based on the vertex selected in step S803 or step S805 and the change destination position calculated in step S804 or step S806. This is a process for changing the information 315a. Specifically, after updating the coordinate value relating to the selected vertex of the display stereoscopic information 315c to the calculated change destination position, reverse mapping of conversion (described later) that generates the display stereoscopic information 315c from the solid shape information 315a The three-dimensional shape information 315a may be generated from the three-dimensional information for display 315c using coordinate conversion corresponding to the above. More specifically, when the value of the reference plane selection information 306 is “stereoscopic display surface”, the coordinate value (x, y, z) after conversion from the coordinate value (X, Y, Z) before conversion is changed.

Calculated by However, [Equation 11] is an example when the value of the stereoscopic image rotation information 312 is θ. On the other hand, when the value of the reference plane selection information 306 is “horizontal plane”, the coordinate value (x, y, z) after conversion is converted from the coordinate value (X, Y, Z) before conversion.

Calculated by However, [Equation 12] is an example when the value of the stereoscopic image rotation information 312 is θ and the value of the inclination information 310 is (α, β, γ). After calculating the coordinate values after conversion with respect to the coordinate values of all the vertices of the display stereoscopic information 315c, the conversion result is stored as the solid shape information 315a, and the local shape changing process in step S807 is ended.

  After the local shape change process in step S807 ends, the shape change process ends.

FIG. 10 is a flowchart of the display update process of this embodiment.
When the display update process is started, first, display three-dimensional information generation processing is performed in step S1001. The display stereoscopic information generation processing in step S1001 is performed based on the reference plane selection information 306, the tilt information 310, and the stereoscopic image rotation information 312 from the stereoscopic shape information 315a related to the object specified by the selected object information 301. This is processing for generating stereoscopic information for display 315c, which is information of a stereoscopic image actually displayed by the unit 101. Specifically, coordinate conversion by a rotation matrix is performed on the three-dimensional coordinates of each vertex included in the solid shape information 315a related to the object specified by the selected object information 301.

  First, when the value of the reference plane selection information 306 is “stereoscopic display plane”, processing for reflecting the stereoscopic image rotation information 312 is performed. Specifically, when the value of the stereoscopic image rotation information 312 is θ, the coordinate value (X, Y, Z) after conversion is converted from the coordinate value (x, y, z) before conversion.

Calculated by After the calculation, the conversion result is stored as display stereoscopic information 315c, and the display stereoscopic information generation process is terminated.

  On the other hand, when the value of the reference plane selection information 306 is “horizontal plane”, it is necessary to further perform coordinate conversion for matching the z-axis direction of the displayed stereoscopic image with the vertical direction. For example, if the right-hand side of the stereoscopic display unit 101 is tilted so as to be higher, the z-axis of the local coordinate system of the object is tilted to the left-hand side when displayed as it is, so that in the local coordinate system of the stereoscopic display unit 101 It is necessary to make the selected object tilted to the right a display solid. Therefore, when the value of the inclination information 310 is (α, β, γ), the coordinate value (X, Y, Z) after conversion is converted from the coordinate value (x, y, z) before conversion.

Calculated by After the calculation, the conversion result is stored as display stereoscopic information 315c, and the display stereoscopic information generation process is terminated.

  The stereoscopic image generation / display process in step S1002 is a process of determining a pixel value such that a desired stereoscopic image can be viewed on the stereoscopic display unit 101. Based on the display stereoscopic information 315c and the image generation parameter 309, a known technique may be used.

  The process of step S1003 is a process of determining whether or not the value of the display type information 302 currently stored in the storage unit 202 is “additional information”. If the value of the display type information 302 is “additional information”, the display update processing is terminated after performing the additional information display processing in step S1004. On the other hand, if the value of the display type information 302 is not “additional information”, the process proceeds to step S1005.

  In the additional information display process in step S1004, the coordinate system to be used as a reference is determined with reference to the coordinate inversion information 311 stored in the storage unit 202, and the current information in the additional information 315b is determined based on the reference coordinate system. This is a process of displaying information corresponding to the selected object on the two-dimensional display unit 102a, and can be easily implemented.

  The process of step S1005 is a process of determining whether or not the value of the viewpoint tracking mode information 305 stored in the storage unit 202 is “always following”. When the value of the viewpoint tracking mode information 305 is “always following”, the viewpoint position estimation process in step S1006 is performed, and then the process proceeds to the two-dimensional image generation process in step S1007. On the other hand, if the value of the viewpoint follow-up mode information 305 is not “always follow”, the process proceeds to the two-dimensional image generation process in step S1007.

  The viewpoint position estimation process in step S <b> 1006 is a process for estimating the current user viewpoint position with reference to the local coordinate system of the stereoscopic display unit 101 and updating the display viewpoint information 307. Details of the viewpoint position estimation processing in step S1006 will be described later (FIG. 11).

  The two-dimensional image generation process in step S1007 is a process for determining the pixel value of each pixel so that a desired image can be obtained by the two-dimensional display unit 102a. With respect to the object specified by the selected object information 301, a known technique is used based on the display type information 302, the display magnification information 303, the display viewpoint information 307, the image generation parameter 309, and the display stereoscopic information 315c. Just do it. In the case of orthographic projection, that is, when the value of the display type information 302 is any one of “front view”, “plan view”, and “side view”, the axes perpendicular to the projected plane (the z axis, y axis, and x axis, respectively) Projection is performed in a direction from the negative side of the axis) toward the positive side, but the direction may be selected using the command input unit 102b.

  In the two-dimensional image display processing in step S1008, a coordinate system is determined by referring to the coordinate inversion information 311 stored in the storage unit 202 for the two-dimensional image generated in step S1007, and used as the reference. This is a process of displaying on the two-dimensional display unit 102a based on the coordinate system.

After the two-dimensional image display process in step S1008, the display update process ends.
FIG. 11 is a flowchart of the viewpoint position estimation process of the present embodiment. The viewpoint position estimation process is a process of estimating the user's viewpoint position or an approximate value of the user's viewpoint position based on the information acquired from the viewpoint information acquisition unit 103.

  When the viewpoint position estimation processing is started, first, viewpoint information acquisition processing is performed in step S1101. The viewpoint information acquisition process of step S1101 is a process of acquiring the captured image data by the imaging unit 103a and acquiring the distance image data by the distance image acquiring unit 103b after performing the validity check process. The validity check process refers to the sensor connection information 304 and the coordinate inversion information 311. In the case of “no coordinate inversion”, the pair of the imaging unit 103a and the distance image acquisition unit 103b is connected to the first sensor connection unit 104a. In the case of “with coordinate reversal”, this is a process of confirming that the pair of the imaging unit 103a and the distance image acquisition unit 103b is connected to the second sensor connection unit 104b. In the case of “no coordinate reversal”, the pair of the imaging unit 103a and the distance image acquisition unit 103b is not connected to the first sensor connection unit 104a, or in the case of “coordinate reversal”, the imaging unit 103a and the distance image acquisition. When the pair of the unit 103b is not connected to the second sensor connection unit 104b, the two-dimensional display unit 102a displays that the pair of the photographing unit 103a and the distance image acquisition unit 103b is connected to the correct sensor connection unit. Until the camera connection information 304 confirms that the pair of the imaging unit 103a and the distance image acquisition unit 103b is connected to the correct sensor connection unit, the apparatus waits while periodically checking the value of the sensor connection information 304.

  In step S1102, face detection processing is performed. The face detection process in step S1102 is a process for detecting a face area using a known technique on the captured image data acquired in step S1101. When a plurality of areas are detected as face areas, only the area where the nearest face is expected to be detected, that is, only one area having the largest number of pixels is detected as a desired face area.

  Next, in step S1103, an existence direction calculation process is performed. The existence direction calculation process in step S1103 is a process of calculating a half line in which the center position of the user's face can exist as an approximate value of the user's viewpoint position. Specifically, the barycentric position may be calculated from the face area detected in step S1102, and the corresponding half line may be obtained by referring to the design information 314 of the viewpoint information acquisition unit stored in the storage unit 202.

  Next, intersection calculation processing is performed in step S1104. The intersection calculation process of step S1104 is a process of calculating the three-dimensional coordinates of the intersection of the curved surface defined by the distance image data acquired in step S1101 and the half line calculated in step S1103. Specifically, the following processing may be performed. For a triangular mesh generated by dividing each unit cell on the distance image data into two diagonal lines, the vertices of each triangular polygon correspond to the positions of the vertices based on the distance data corresponding to the vertices. Move to an appropriate position on the half line to generate a curved surface as a set of multiple triangular polygons. After that, by calculating the intersection point between each triangular polygon constituting the generated curved surface and the half line calculated in step S1103, the target intersection coordinate is calculated. When there are a plurality of triangular polygons having an intersection with the half line, the coordinate value of the intersection closest to the projection center position of the photographing unit 103a is adopted, and the triangular polygon having the intersection with the half line is obtained. If not, the coordinate value defined by the standard viewpoint information 308 is adopted.

  The calculated coordinate value of the intersection is stored in the storage unit 202 as display viewpoint information 307, and the viewpoint position reference basis vector information 313 is updated using the display viewpoint information 307, and then the intersection calculation processing in step S1104 is terminated. .

  The processing in steps S1103 and S1104 is intuitively described as shown in FIG. That is, first, in step S1103, the position 1201 of the projection center of the photographing unit 103a is set as a starting point, and the position 1203 on the projection surface 1202 of the photographing unit 103a corresponding to the center of gravity of the face area detected on the photographed image data is passed. Such a half line 1204 is calculated. Next, in step S1104, the intersection of the curved line 1206, which is a set of triangular polygons, generated based on the distance image data acquired by the distance image acquisition unit 103b with the position 1205 as the projection center, and the half line 1204. The coordinate value 1207 is calculated and stored in the storage unit 202 as display viewpoint information 307.

  Note that a known technique may be used as a method of generating a curved surface as a set of triangular polygons from distance image data, and a method of adopting a diagonal line in only one direction or an angle between surfaces is adopted. In addition to the method of determining the diagonal line, for example, a smoother curved surface may be generated by a technique called subdivision.

After the intersection calculation process in step S1104 ends, the viewpoint position estimation process ends.
As described above, according to the present embodiment, image information such as a plan view and a perspective projection diagram regarding a stereoscopic image displayed on the stereoscopic display unit, or additional information such as annotations and dimensions for each part is appropriately displayed in two dimensions. Since it is configured to display on the screen, it is possible to assist the user to intuitively grasp the object shape. Furthermore, with respect to the image information, since the information is considered in consideration of an assumed user viewpoint position or a user viewpoint position estimated based on measurement, the user must intuitively grasp the object shape. Making it easier.

  In addition, since the viewpoint position is estimated based on the captured image generated by the photographing unit, the user's viewpoint position can be easily estimated even when the range of the user's viewpoint position can be wide. .

  Further, in this embodiment, since the change related to the shape of the stereoscopic image displayed on the stereoscopic display unit is performed by changing the information displayed on the two-dimensional display unit, for example, a force feedback function is provided. Compared to an apparatus that directly changes a stereoscopic image using a pen-type interface, a change closer to the user's change intention can be made to the stereoscopic image more easily.

  In this embodiment, since the two-dimensional display unit and the command input unit are combined to form a touch panel display, a comparison with a two-dimensional image obtained by mapping a stereoscopic image displayed on the stereoscopic display unit by a predetermined method is visually recognized. The command can be input from the command input unit while performing the operation. Therefore, for example, if the configuration is provided with a command that can draw an image on the two-dimensional input display unit without changing the object shape, the user can intuitively view the three-dimensional image displayed on the three-dimensional display unit on the two-dimensional display unit. The video display device of the present invention can also be provided as a device useful for fostering a user's stereoscopic sense.

  Further, in this embodiment, since it is configured to be able to set whether or not the 2D image is rotated 180 degrees and displayed, the stereoscopic image is not obstructed even when the user is right-handed or left-handed. Command input operation can be performed in the dimension display input section. In other words, the video display device of the present embodiment includes a reverse display setting unit that sets whether or not to perform reverse display. When the reverse display is set, the video displayed on the two-dimensional display unit 102a is displayed in reverse. The image displayed on the two-dimensional display unit 102a when it is set to none is formed so as to be rotated 180 degrees with respect to a predetermined point (for example, the origin of the local coordinate system 402 of the two-dimensional display input unit 102). Has been.

  Further, in the present embodiment, when the perspective projection diagram is displayed on the two-dimensional display unit 102 a, a value corresponding to the so-called “focal length” is changed based on the display viewpoint information 307 regarding the generation. It was. As a result, the size of the perspective projection of the stereoscopic image displayed on the two-dimensional display unit 102a is approximately the same regardless of whether the viewpoint position of the user is close to the stereoscopic display unit 101 or away from the stereoscopic display unit 101. Thus, auxiliary information for understanding the shape can be presented to the user as more suitable information. That is, the angle of view when generating a two-dimensional image by perspective projection when the user's viewpoint position is close to the stereoscopic display unit 101, and the perspective projection when the user's viewpoint position is far from the stereoscopic display unit 101. This is equivalent to making it wider than the angle of view when generating a two-dimensional image. In addition, embodiment of this invention is not restricted to this, It cannot be overemphasized that it may show to a user as auxiliary information also including the perspective to a stereo image by making a focal distance into a fixed value. Such a change is easy.

  Further, in this embodiment, when the reference plane is a horizontal plane, the stereoscopic image displayed on the stereoscopic display unit is moved up and down regardless of the inclination of the stereoscopic display unit based on the inclination of the video display device detected by the inclination detection unit. For example, when the present invention is applied to a portable electronic device, the video display device shakes when used while walking, or the video display device is tilted while on a train. Even when it must be used, since a stereoscopic image can be stably presented to the user, it is possible to assist the user to intuitively grasp the object shape.

  In the present embodiment, the two-dimensional display unit 102a and the command input unit 102b are integrated and configured as a touch panel display, but the embodiment of the present invention is not limited to this. The command input unit 102b only needs to be configured to allow command input on the video display area of the two-dimensional display unit 102a, and the two-dimensional display unit 102a and the command input unit 102b are integrated to form a touch panel. Instead of configuring as a display, for example, it may be configured as an optical sensor built-in system liquid crystal display, or, for example, a configuration in which the two-dimensional display unit 102a and the command input unit 102b are separated, and the command input unit 102b includes a keyboard and A mouse may be used. When a keyboard is used as the command input unit 102b, for example, the object selection process in step S601 is performed by character input, that is, an object having a name equal to the name input as a character string from the command input unit 102b is selected. For example, the rotation amount in the stereoscopic image rotation process in step S706 is set based on the numerical value input from the command input unit 102b. It can also be. Similarly, for example, the display magnification in the display magnification change process in step S708 can be set based on numerical input from the command input unit 102b. Further, as the command input unit 102b, an information input mechanism such as a button or a dial may be provided separately. For example, it may be configured to have a separate button for “set the viewpoint tracking mode to“ spot tracking ”and perform viewpoint position estimation processing” or a dial that can change the display magnification. Good.

  Further, in this embodiment, the image information displayed on the two-dimensional display unit 102a is handled with texture, but the embodiment of the present invention is not limited to this, and for example, “wire frame display” Two types of display methods of “texture display” may be switched according to an input from the command input unit 102b.

  In this embodiment, the viewpoint information acquisition unit 103 includes a photographing unit 103a and a distance image acquisition unit 103b, and the viewpoint position is estimated based on the viewpoint information acquired by the viewpoint information acquisition unit 103 in the viewpoint position estimation process. However, the embodiment of the present invention is not limited to this. For example, it may be configured such that two photographing units provided with circular fisheye lenses are installed at different positions and the viewpoint position is estimated from the principles of face recognition and stereo vision using them as viewpoint information acquisition units. In the case of using an imaging unit equipped with a circular fisheye lens, the imaging unit is displayed on the stereoscopic display unit 101 by installing the imaging unit so that the entire region having a positive z coordinate in the local coordinate system of the stereoscopic display unit 101 can be imaged. Image information can be acquired for almost the entire range where the viewpoint position of the user viewing the video can exist. Further, the tilt detection unit 203 may be configured to also serve as the viewpoint information acquisition unit 103. For example, when the inclination (α, β, γ) detected by the inclination detection unit 203 is (0, 0, 0), the user's viewpoint position coincides with the spatial position defined by the standard viewpoint information 308, and the stereoscopic display Assuming that the relationship between the position of the origin of the local coordinate system of the unit 101 and the viewpoint position of the user does not change, the stereoscopic detection unit 203 detects the representation of the user's viewpoint position in the local coordinate system of the stereoscopic display unit 101. The calculation may be performed in consideration of the influence of the tilt of the display unit 101. This calculation is coordinate conversion by a three-dimensional rotation matrix and is easy.

  When a device capable of acquiring a spatially sufficient range of information is used as the viewpoint information acquisition unit 103, the viewpoint information acquisition unit 103 is located near the center of the video display device 100 so as not to disturb the user's view. You may make it install in. With such a configuration, it is not necessary to provide a plurality of sensor connection units, the apparatus configuration can be simplified, and the viewpoint information acquisition unit 103 can be used regardless of the presence or absence of video inversion display on the two-dimensional display unit. There is an effect that it is not necessary to move the installation position.

  In this embodiment, the user's viewpoint position is estimated using the face recognition technology from the image captured by the image capturing unit 103a. However, the embodiment of the present invention is not limited to this. Various viewpoint position estimation techniques can be used. For example, a wearing tool provided with a highly retroreflective optical reflection marker may be provided as a wearing tool to be worn by the user, and the viewpoint position of the user wearing the wearing tool may be estimated by acquiring the marker position. . The technique for acquiring the position of the highly retroreflective optical reflection marker is a known technique used in, for example, a motion capture system.

  In this embodiment, the object information 315 is stored in the storage unit 202. However, the embodiment of the present invention is not limited to this. For example, the video display device 100 may be configured to connect to an external database each time the power is turned on, or may have a network interface and search and acquire information on the Internet using the name of the object as a keyword. It is good. In addition, the video display device 100 includes an interface that can exchange information with a removable external medium such as a compact flash card or a CD-ROM, and the object information 315 is stored using the removable medium. You may make it supply. In any case, if the display stereoscopic information 315c cannot be written, the display stereoscopic information 315c may be stored in the storage unit 202.

  In this embodiment, the rotation of the stereoscopic image is limited to the rotation around the z-axis of the local coordinate system of the object, and the rotation amount is directly input. Is not limited to this. For example, the rotation amount of the object is stored in the storage unit 202 as a rotation matrix, and the rotation matrix and the rotation amount are input and the rotation matrix is updated. Can be displayed as In addition, for example, a “rotate right” button and a “rotate left” button are provided, and a unit rotation amount is given as a design value. When the button is pressed, the unit is moved in a direction corresponding to each button. The stereoscopic image rotation information 312 may be updated so that the stereoscopic image is rotated by the amount of rotation.

  In the present embodiment, the reverse display on the two-dimensional display unit 102a with respect to the stereoscopic display unit 101 is performed in the display update process of FIG. 10, but the embodiment of the present invention is not limited to this. For example, the stereoscopic display unit 101 and the two-dimensional display input unit 102 can be physically separated from each other on the right side of the stereoscopic display unit 101, the left side, and the right side of the two-dimensional display input unit 102, respectively. It is good also as a structure provided with the connection part which can send / receive a signal. In such a configuration, when the connection portions on the right side of the stereoscopic display unit 101 and the left side of the two-dimensional display input unit 102 are connected to each other, there is no inversion display, and the right side of the stereoscopic display unit 101 2 and the right side of the two-dimensional display input unit 102 are connected to each other, the two-dimensional display input unit 102 itself is relatively rotated 180 degrees. It is possible to make a state with reverse display without necessity.

  In the present embodiment, only the selected object is drawn in the drawing of the side view and the plan view. In addition, the viewpoint position stored in the storage unit 202 as the display viewpoint information 307 is added. May be drawn. By doing in this way, a user can grasp a situation more intuitively.

  Further, in this embodiment, the three-dimensional shape information 315a is assumed to be a polygon model, and the shape changing process has been described for changing the coordinate value of only one selected vertex, but the embodiment of the present invention is limited to this. It is not a thing. For example, the shape of the object may be modeled using a NURBS curved surface, and the shape changing process may be performed by changing the position of the control point. In addition, for example, energy based on the displacement before and after the shape change of each vertex (the higher the displacement, the higher the energy) and energy based on the change in the distance between adjacent vertices before and after the shape deformation (the higher the distance, the higher the energy ) And the coordinate function of a plurality of vertices may be changed so as to reduce the value of the energy function.

  In the present embodiment, the example in which the shape deformation process is performed as the content to be changed on the object information 315 using the two-dimensional display input unit 102 has been described. However, the embodiment of the present invention is not limited thereto. For example, the 3D display unit 101 displays the texture by redrawing the texture using the 2D display input unit 102 and using the texture to update the content of the texture included in the 3D shape information 315a. A “coloring picture” of a stereoscopic image can be realized. At this time, the content of the texture is updated only for the region that is “visible” from the viewpoint position specified by the display viewpoint information 307, but this visibility determination is the same as described in FIG. 8, for example. In addition, a depth buffer corresponding to the value of the display type information 302 is generated, and for the polygons forming each surface, the viewpoint position and the maximum depth value corresponding to the region included in the visual volume defined by the polygons The minimum value of the depth value of the vertex of the polygon is compared, and a surface where the minimum value is smaller is left as a candidate, and thereafter, intersection determination of a plurality of remaining surfaces as candidates is performed. Thus, the area actually visible can be calculated.

  Hereinafter, a second embodiment of the present invention will be described with reference to FIG. This embodiment is a suitable example when it is desired to view many parts of a stereoscopic image at the same time in order to grasp the overall shape of the stereoscopic image. In addition, the same code | symbol was attached | subjected about the part similar to Example 1, and description was abbreviate | omitted.

  FIG. 13 is an external view of a video display device 1300 according to the present embodiment. The video display apparatus 1300 according to the present embodiment adds a second stereoscopic display unit 1301 to the video display apparatus 100 according to the first embodiment, and converts the stereoscopic image displayed on the stereoscopic display unit 1301 into a stereoscopic image displayed on the stereoscopic display unit 101. On the other hand, it is configured to rotate 90 degrees counterclockwise. Specifically, the orientation of the stereoscopic image displayed on the stereoscopic display unit 1301 is rotated 90 degrees counterclockwise around the z axis of the coordinate system for displaying the stereoscopic image. Display to be equal to the orientation.

  With such a configuration, for example, when the front and left side of the stereoscopic image are viewed by the user in the stereoscopic display unit 101, the left side and the back side of the stereoscopic image are displayed to the user in the stereoscopic display unit 1301. Since it will be viewed, more clues for grasping the shape can be presented to the user at the same time, and the user can be more intuitively grasped the shape of the stereoscopic image.

  Note that, for example, areas for selecting a stereoscopic image to be processed are provided in the lower left part and the lower right part of the video display area of the two-dimensional display unit 102a, and have been described with reference to FIGS. Regarding processing related to the two-dimensional display input unit 102 in processing, when the lower left area is pointed by a pen-type interface as the command input unit 102b, processing is performed on a stereoscopic image displayed on the stereoscopic display unit 101. On the other hand, when the area in the lower right part is pointed by the pen-type interface, the stereoscopic image displayed on the stereoscopic display unit 1301 may be processed. Any processing can be performed in the same manner as in the first embodiment by simple coordinate transformation.

  In the end, the present embodiment includes a plurality of stereoscopic display units that display stereoscopic images related to the same object, and the stereoscopic display unit 1301 is different from the stereoscopic image displayed on the stereoscopic display unit 101 at a predetermined viewpoint position. This is a video display device configured to allow viewing of a stereoscopic image in a direction, and a stereoscopic image in a direction different from the stereoscopic image displayed in another stereoscopic display unit is displayed on each stereoscopic display unit. It is a video display device.

  Hereinafter, a third embodiment of the present invention will be described with reference to FIG. This embodiment is an example suitable for a case where a plurality of users collaborate using a table type video display device, for example. In addition, the same code | symbol was attached | subjected about the part similar to Example 1-2, and description was abbreviate | omitted.

  FIG. 14 is a plan view of the video display device 1400 of the present embodiment. The video display device 1400 of the present embodiment is a table-type video display device, and is assumed to be used by four users 1441 to 1444 for viewing the same object.

  The video display apparatus 1400 is configured to include stereoscopic display units 1401 to 1404, two-dimensional display input units 1411 to 1414, viewpoint position acquisition units 1421 to 1424, and rotation angle input rings 1431 to 1434.

  The shapes of the video display areas of the stereoscopic display units 1401 to 1404 are circular, and rotation angle input rings 1431 to 1434 are arranged around each of the stereoscopic display units 1401 to 1404 so as not to disturb the user's field of view. Each rotation angle input ring 1431 to 1434 can be rotated both in the clockwise direction and in the counterclockwise direction, detects the rotation direction and the rotation amount, and inputs a command as information corresponding to the stereoscopic image rotation command. Configure to be able to.

  The stereoscopic display units 1401 to 1404 have their image display surfaces arranged on the same horizontal plane, and the direction of the z coordinate of each local coordinate system of the stereoscopic display units 1401 to 1404 is set to the normal direction of the horizontal plane, that is, vertically upward. To match. That is, in this embodiment, the reference plane for generating a stereoscopic image to be displayed on the stereoscopic display unit 101 is the same plane for both “stereoscopic display plane” and “horizontal plane”. The reference plane described in the first embodiment is used. The process regarding is omitted.

  The direction of the stereoscopic image displayed on the stereoscopic display unit 1402 is an orientation obtained by rotating the stereoscopic image displayed on the stereoscopic display unit 1401 by 90 degrees counterclockwise around the z axis of the local coordinate system of the stereoscopic display unit 1401. As described above, the orientation of the stereoscopic image displayed on the stereoscopic display unit 1403 is obtained by rotating the stereoscopic image displayed on the stereoscopic display unit 1402 by 90 degrees counterclockwise around the z axis of the local coordinate system of the stereoscopic display unit 1402. The orientation of the stereoscopic image displayed on the stereoscopic display unit 1404 is set so that the stereoscopic image displayed on the stereoscopic display unit 1403 is 90 counterclockwise around the z axis of the local coordinate system of the stereoscopic display unit 1403. The direction of the stereoscopic image displayed on the stereoscopic display unit 1401 is counterclockwise around the z-axis of the local coordinate system of the stereoscopic display unit 1404 so that the orientation of the stereoscopic image displayed on the stereoscopic display unit 1401 Rotate around 90 degrees As the orientation, respectively, are displayed.

  The information displayed on the two-dimensional display input unit 1411 includes the stereoscopic image displayed on the stereoscopic display unit 1401 or the stereoscopic image displayed on the stereoscopic display unit 1402 and the viewpoint of the user 1441 acquired by the viewpoint position acquisition unit 1421. Information generated on the basis of the position and displayed on the two-dimensional display input unit 1412 includes a stereoscopic image displayed on the stereoscopic display unit 1402 or a stereoscopic image displayed on the stereoscopic display unit 1403; Information generated on the basis of the viewpoint position of the user 1442 acquired by the viewpoint position acquisition unit 1422 and displayed on the two-dimensional display input unit 1413 is a stereoscopic image or a stereoscopic image displayed on the stereoscopic display unit 1403. It is generated based on the stereoscopic image displayed on the display unit 1404 and the viewpoint position of the user 1443 acquired by the viewpoint position acquisition unit 1423. Thus, the information displayed on the two-dimensional display input unit 1414 includes the stereoscopic image displayed on the stereoscopic display unit 1404 or the stereoscopic image displayed on the stereoscopic display unit 1401 and the user 1444 acquired by the viewpoint position acquisition unit 1424. Is generated based on the viewpoint position.

  Since the stereoscopic images displayed on the stereoscopic display units 1401 to 1404 are to be viewed by a plurality of users at the same time, among the processes described in the first embodiment, exclusive control is performed for the processes related to the stereoscopic image. To do. As a specific exclusive control method, among the command inputs from the two-dimensional display input units 1411 to 1414 and the rotation angle input rings 1431 to 1434, only one command input is accepted at the same time for processing. To do. More specifically, exclusive control of command input is performed for the object selection process S601, the shape change process S607, and the stereoscopic image rotation process S706.

  As described above, according to the present embodiment, since one stereoscopic display unit can be shared by a plurality of users, a plurality of clues for grasping the shape of the same stereoscopic image can be efficiently obtained compared to the case of the second embodiment. Can be presented to other users.

  In addition, since the table-type video display device includes a plurality of stereoscopic display units, and each user views a stereoscopic image using a stereoscopic display unit near him, the stereoscopic display unit is located near the center of the table. Compared to the case where all users use a stereoscopic display unit near the center to view a stereoscopic image, the spatial area that each stereoscopic display unit is responsible for can be designed to be narrow. As a result, the spatial density of the light rays to be reproduced can be increased, so that a stereoscopic image that is easier to grasp the shape can be provided to the user.

  In addition, since the shape of the video display area of the stereoscopic display unit is circular, and the command input regarding the rotation of the stereoscopic image can be performed from the rotation input ring, the stereoscopic image can be obtained by a user's intuitive and simple method. Can be rotated, and it can support that a user concentrates on grasping the shape of a solid image.

  In this embodiment, the table having a square shape has a configuration in which a three-dimensional display unit is provided at a portion corresponding to each vertex and a two-dimensional display input unit is provided at a portion corresponding to each side. A form is not restricted to this, For example, generally, the same arrangement | positioning can be performed and implemented with respect to the table of a polygonal shape. For example, when the shape is a regular N-gon, the direction of the stereoscopic image displayed on each stereoscopic display unit is changed to the direction of the stereoscopic image displayed on the left adjacent stereoscopic display unit of each stereoscopic display unit. Each of the three-dimensional display units may be displayed so as to be rotated in a counterclockwise (360 / N) degree around the z axis of the local coordinate system.

  After all, the present embodiment includes a plurality of stereoscopic display units that display stereoscopic images related to the same object, so that the video displayed on the first stereoscopic display unit and the video displayed on the second stereoscopic display unit can be viewed. The video viewed when viewing the first stereoscopic display unit from the first viewpoint position is made equal to the video viewed when viewing the second stereoscopic display unit from the second viewpoint position. Each of the three-dimensional display units is a video display device that is displayed so that the same video can be viewed when viewed from each corresponding viewpoint position.

  Further, for example, when the position where the user views the video is limited due to the installation on the wall or the like, the video display device 1500 whose plan view is shown in FIG. 15 is shared by a plurality of users. It may be configured to include both one or more three-dimensional display units and one or more three-dimensional display units that are assumed to be viewed by a single user (hereinafter referred to as a “variation example”). 15, the same reference numerals as those in FIG. 14 denote the same elements as those in FIG. 14.

  A video display device 1500 according to the present modification includes three stereoscopic display units 1401 to 1403 that display stereoscopic video related to the same object, and two two-dimensional display input units 1411 to 1412 that display two-dimensional video. The display input unit 1411 includes image information related to the viewpoint position of the user 1441 of the stereoscopic image displayed on the stereoscopic display unit 1401 and image information related to the viewpoint position of the user 1441 of the stereoscopic image displayed on the stereoscopic display unit 1402. Any one or both of them are displayed, and the two-dimensional display input unit 1412 displays image information related to the viewpoint position of the user 1442 of the stereoscopic image displayed on the stereoscopic display unit 1402, and the stereoscopic display. One or both of the image information related to the viewpoint position of the user 1442 of the stereoscopic image displayed in the unit 1403 is displayed. A video display device have been made to.

  In this embodiment, the rotation direction input amount is detected by rotating the rotation angle input ring arranged around the circular video display area. However, the embodiment of the present invention is not limited to this. It is not a thing. For example, the rotation direction and the rotation amount are detected by detecting the movement of the finger touching the rotation angle input ring by a known method such as a capacitance method without moving the rotation angle input ring itself. Alternatively, the rotation direction and the rotation amount may be detected by rotating a disk-shaped dial disposed at a position different from the video display area. In any case, since the rotation can be expressed by an arcuate movement, the user can rotate the stereoscopic image by a more intuitive and simple method.

  In the first and second embodiments, similarly to the third embodiment, the rotation direction and the rotation amount are detected by a three-dimensional display unit having a circular shape or a rotation angle input ring arranged around a circular image display region. It may be.

  As described above, the essence of the present invention is that the user can intuitively grasp the object shape by easily presenting more information useful for grasping the object shape to the user. It goes without saying that the features described in each of the embodiments may be used in appropriate combination according to the application, and the configuration described in each of the embodiments may be variously modified within the scope not departing from the spirit of the invention. It goes without saying that it can be done. For example, the display stereoscopic information 315c may be generated only when there is a change related to the stereoscopic image displayed on the stereoscopic display unit, and is not necessarily generated every time the display update process is performed. As for the coordinate values included in the three-dimensional shape information 315a, a value of a size based on a predetermined reference is set regardless of the specifications of the three-dimensional display unit 101, and the display three-dimensional information 315c is changed from the three-dimensional shape information 315a. In the process of generating and the process of updating the 3D shape information 315a from the display 3D information 315c, the scale conversion between the local coordinate system of the object and the local coordinate system of the 3D display unit 101 may be performed. . In that case, the same object information can be used for a plurality of video display devices having different specifications.

1 is an external view of a video display device according to Embodiment 1. FIG. 1 is a configuration diagram of a video display device according to Embodiment 1. FIG. FIG. 3 is a diagram illustrating a program and data stored in a storage unit according to the first embodiment. FIG. 3 is a diagram illustrating how to take a local coordinate system according to the first embodiment. Explanatory drawing of the design information 314 of the viewpoint information acquisition part of Example 1. FIG. FIG. 3 is a flowchart of video display processing according to the first embodiment. FIG. 3 is a flowchart of setting change processing according to the first embodiment. FIG. 3 is a flowchart of shape change processing according to the first embodiment. FIG. 6 is an explanatory diagram of perspective projection focus point selection processing according to the first embodiment. FIG. 3 is a flowchart of display update processing according to the first embodiment. FIG. 3 is a flowchart of viewpoint position estimation processing according to the first embodiment. Explanatory drawing of the viewpoint position estimation process of Example 1. FIG. FIG. 6 is an external view of a video display device according to a second embodiment. FIG. 6 is a plan view of a video display device according to a third embodiment. FIG. 9 is a plan view showing a second usage pattern of the video display device according to the third embodiment.

Explanation of symbols

100 ... Video display device,
101 ... 3D display unit,
102 ... 2D display input unit,
103a ... photographing part,
103b ... Distance image acquisition unit,
104b ... sensor connection part,
401 ... Local coordinate system of the stereoscopic display unit,
402 ... A local coordinate system of the two-dimensional display input unit,
501... The projection center of the imaging unit,
502... The projection surface of the imaging unit,
503: a position on the projection surface corresponding to a position on the captured image data,
504 ... a half line corresponding to the position on the captured image data,
901 ... Viewpoint position for display,
902 ... Projection plane,
903 ... a position on the projection surface corresponding to the selected position,
904... A straight line corresponding to the selected position,
905 ... an image on the projection surface of the solid represented by the stereoscopic information for display,
906: a solid represented by display stereoscopic information;
907... Vertex having the minimum distance from the half line among the vertices of the solid,
1201... The projection center of the imaging unit,
1202 ... Projection plane of the photographing unit,
1203 ... Position of the center of gravity of the face area on the projection plane,
1204... A half line passing through the center of gravity of the face area starting from the projection center,
1205 ... The projection center of the distance image acquisition unit,
1206 ... a curved surface generated based on the distance image data,
1207: intersection of half line and curved surface,
1300 ... Video display device,
1301 ... 3D display unit,
1400... Video display device,
1401, 1402, 1403, 1404... 3D display unit,
1411, 1412, 1413, 1414... 2D display input unit,
1421, 1422, 1423, 1424 ... viewpoint position acquisition unit,
1431, 1432, 1433, 1434 ... rotation angle input ring,
1441, 1442, 1443, 1444 ... user,
1500: Image display device.

Claims (18)

A 3D display unit for displaying a 3D image and a 2D display unit for displaying a 2D image;
The two-dimensional display unit is configured to display information regarding a stereoscopic image displayed on the stereoscopic display unit.
A video display device characterized by the above.   The video display apparatus according to claim 1, wherein the information about the stereoscopic image is image information. The image information includes at least one of a front view, a plan view, a side view, and a perspective view of the stereoscopic image related to a predetermined viewpoint position;
The video display device according to claim 2, wherein: A viewpoint estimation unit for estimating the viewpoint position of the user;
The image information is generated based on the viewpoint position estimated by the viewpoint estimation unit;
The video display device according to claim 2, wherein: The image information is a perspective projection view of the stereoscopic image related to the viewpoint position estimated by the viewpoint estimation unit,
The perspective view of the stereoscopic image is generated based on an angle of view based on a viewpoint position estimated by the viewpoint estimation unit;
The video display device according to claim 4, wherein: In the image information, the viewpoint position estimated by the viewpoint estimation unit is drawn,
The video display device according to claim 4, wherein: The viewpoint estimation unit includes a photographing unit, and estimates a user's viewpoint position based on image data captured by the photographing unit;
The video display device according to claim 4, wherein: The photographing unit includes a fisheye lens;
The video display device according to claim 7, wherein: A command input unit for inputting a change command with respect to the image information displayed on the two-dimensional display unit;
Based on the change command, a data update unit that updates information of the stereoscopic image displayed on the stereoscopic display unit;
The video display device according to claim 2, further comprising: The command input unit is configured to input a change command on the video display area of the two-dimensional display unit;
The video display device according to claim 9, wherein: It has a reverse display setting part that sets the presence or absence of reverse display,
The image displayed on the two-dimensional display unit when the reverse display is set is rotated 180 degrees with respect to a predetermined point from the image displayed on the two-dimensional display unit when the reverse display is set. What is supposed to be
The video display device according to claim 9, wherein: The three-dimensional display unit and the two-dimensional display unit are configured to be separable so as to be integrated with each other in two combined forms.
The relationship between the stereoscopic display unit and the two-dimensional display unit when combined in the first combined form is the relationship between the stereoscopic display unit and the two-dimensional display unit when combined in the second combined form. The two-dimensional display unit is rotated 180 degrees with respect to a predetermined point.
The video display device according to claim 9, wherein: A plurality of 3D display units for displaying 3D images related to the same object,
The second stereoscopic display unit is configured so that a stereoscopic image in a direction different from the stereoscopic image displayed on the first stereoscopic display unit at a predetermined viewpoint position can be viewed,
A video display device characterized by the above. A table-type image display device,
A plurality of 3D display units for displaying 3D images related to the same object,
The video that is viewed when the first stereoscopic display unit is viewed from the first viewpoint position is equal to the video that is viewed when the second stereoscopic display unit is viewed from the second viewpoint position. ,
A video display device characterized by the above. Three stereoscopic display units for displaying a stereoscopic image related to the same object, and two two-dimensional display units for displaying a two-dimensional image,
The first two-dimensional display unit includes image information relating to a first viewpoint position of the stereoscopic image displayed on the first stereoscopic display unit, and the first information of the stereoscopic image displayed on the second stereoscopic display unit. One or both of the image information related to one viewpoint position is displayed,
The second two-dimensional display unit includes image information relating to the second viewpoint position of the stereoscopic image displayed on the second stereoscopic display unit, and the stereoscopic image displayed on the third stereoscopic display unit. One or both of the image information related to the second viewpoint position is displayed,
A video display device characterized by the above. A stereoscopic display unit that displays a stereoscopic image; and an inclination detection unit that detects a three-dimensional inclination of the stereoscopic display unit;
The stereoscopic image displayed on the stereoscopic display unit is configured such that the vertical direction is constant regardless of the inclination of the stereoscopic display unit, based on the inclination detected by the inclination detection unit,
A video display device characterized by the above. A stereoscopic display unit in which the shape of the video display area for displaying the stereoscopic video is circular;
A ring-shaped rotation angle input unit arranged around the video display area;
Changing the direction of the stereoscopic image displayed on the stereoscopic display unit based on the rotation angle input from the rotation angle input unit;
A video display device characterized by the above. The stereoscopic display unit is a light-reproducing autostereoscopic display;
The video display device according to claim 1.

Images