JP3939444B2 - Video display device - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention uses a virtual reality (VR) technology to display a moving image.EquipmentRelated.
[0002]
[Prior art]
Virtual reality technology that displays virtual space is mainly used in flight simulators for aircraft pilot training and landscape simulation for city planning, etc., and can be displayed while moving in the virtual space, which is the desired scenery projected. Yes.
[0003]
Here, the virtual space is assumed to be a space represented by three axes of X, Y, and Z as shown in FIG. 21 in the memory of the computer, and various objects are arranged in the space. An image projected from the camera 1 is output to a screen, a display or the like and can be presented to the operator. Further, the viewpoint position and the line-of-sight direction are controlled by the operation of the operator. The viewpoint position is the position of the camera 1, and the line-of-sight direction is the direction of the camera 1.
[0004]
For example, by operating a joystick as a control stick, a flight simulator displays an image of a virtual space showing a scene outside the window corresponding to the position and posture of the aircraft in front of the operator, as if the aircraft is being operated Give the operator a sense of sensory information. In this case, the viewpoint position moves forward in conjunction with the operation of the control stick, and the traveling direction of the scene image outside the window that matches the line-of-sight direction changes.
[0005]
Similarly, the landscape simulator displays an image of the landscape corresponding to the position of the car in front of the operator by operating the mouse, and gives the operator sensory information as if viewing the city landscape. This also changes the direction of landscape movement in conjunction with mouse operation.
[0006]
[Problems to be solved by the invention]
However, the virtual reality technology as described above has the following inconvenience when it is desired to simulate a field of view other than a vehicle such as moving while appreciating a painting in a museum.
[0007]
For example, when a person looks at a painting and walks, at least his eyes are directed toward the painting and move parallel to the wall on which the painting is displayed. On the other hand, in each of the simulators described above, the viewpoint moves only in a direction parallel or perpendicular to the direction of the line of sight, and the viewing video advances. That is, the conventional virtual reality technology can simulate the progress along the line-of-sight direction, but cannot simulate the movement in which the line-of-sight direction and the direction of travel are different.
[0008]
For this reason, even if a system for viewing paintings using conventional virtual reality technology is produced, for example, when moving the viewpoint toward the next painting along the wall, (1) it rotates to face the destination. It is necessary to perform complicated operations such as (2) reversing to face the painting and (3) repeating (1) and (2) at a short distance in order to finely adjust the viewing position. In addition, since this operation is performed for each painting (for each large spot in the painting, the operator cannot concentrate on viewing the painting). Such a complicated operation also occurs when trying to view each painting at an optimal position.
[0009]
Furthermore, the input device for operation has a structure that is not very suitable for the purpose of moving within the viewing image. For example, a joystick is large and difficult to handle easily. A mouse is excellent as an input device for a two-dimensional operation, but lacks a function to control a three-dimensional movement.
[0010]
The present invention has been made in consideration of the above circumstances, and provides a video display device that can move the viewpoint in a direction different from the line-of-sight direction when viewing an object in a virtual space, and can improve the ease of operation. For the purpose.
[0012]
Another object of the present invention is to,An input device that is small and easy to operate and can realize functions suitable for three-dimensional motion controlDisplay device usingIs to provide.
[0013]
  The invention corresponding to claim 1 is an image display device for displaying an image in a visual field along a visual line direction from a viewpoint position in a virtual space based on an input signal, and when there is a wall in the image, Translation function and the wallLeft / right / up / down parallelWhen an input signal that specifies the direction of movement is received,Set measurement points on the top, bottom, left, and right of the viewpoint position, and extend the line parallel to the line of sight from each measurement point to find the intersection of each line and the wallThe inclination of the line-of-sight direction and the wall that intersects the line-of-sight direction is calculated, and based on the obtained inclination, the line-of-sight direction intersects the wall and the wallleft-right up-downParallel to the wall specified by the input signalLeft / right / up / down parallelMove the viewpoint position in the direction of movementRealization of translationAn image display device comprising a parallel movement calculating means.
[0014]
  According to a second aspect of the present invention, there is provided an input device used in the video display device according to the first aspect, whereinLeft / right / up / down parallelDirection signal indicating the direction of movementWith a given input signalCombinationOf a predetermined input command consisting ofAn image display device including an input device including a function designating unit for inputting a predetermined input signal.
[0015]
Further, the invention for claim 3 is:The video display device according to claim 2, wherein the input device has a size that can be held by an operator with both hands, a direction key that can be operated with the left hand, and a button that can be operated with the right hand. PreparationThis is a video display device characterized by that.
[0016]
  (Function)
Accordingly, the invention corresponding to claims 1 and 2 has taken the above-described means, so that the parallel movement calculating meansInsideWhen there is a wall in the parallel movement function and the wallParallel to the left, right, up and downWhen an input signal that specifies the direction of movement is received,Set measurement points on the top, bottom, left, and right of the viewpoint position, and extend the line parallel to the line of sight from each measurement point to find the intersection of each line and the wallCalculate the inclination between the line-of-sight direction and the wall that intersects this line-of-sight direction.InBased on the wall with the line-of-sight direction intersecting the wallleft-right up-downParallel to the wall specified by the input signalLeft / right / up / down parallelMove the viewpoint position in the direction of movementRealization of translationSo the target of the virtual spaceAdmirationand when,Keeping the distance to the object at any fixed distanceThe viewpoint can be moved in a direction different from the line-of-sight direction, and the ease of operation can be improved.
[0019]
And claims3In the invention corresponding to the function specifying unit,A signal that specifies the translation functionCombination with direction signal indicating moving directionSetSince the predetermined input signal to be used is input, the command can be input by combining the direction signal and the predetermined input signal, so that the size can be reduced and the predetermined input signal is used., Of 2Since it has an effect, the ease of operation can be improved and it is suitable for three-dimensional motion control. That is, it is small and easy to operate, and a function suitable for three-dimensional motion control can be realized.
[0020]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a schematic diagram showing an appearance of a video display device according to an embodiment of the present invention, and FIG. 2 is a schematic diagram showing a configuration of the video display device. In this video display device, the operation content of the portable small input device 10 includes an input signal conversion unit 20, an image generation calculation unit 30, frame memories 41 to 43, and D / A converters 51 to 53. And reflected in the virtual space image on the screen 80 via the three projectors 71 to 73 on the ceiling, and unlike the conventional configuration, the viewpoint is easily moved in the indoor virtual space image. It has become.
[0021]
Although not shown, a chair for sitting the operator is provided below the projectors 71 to 73 toward the screen 80. This chair may have multiple legs arranged for the audience or may be omitted. The operator may operate the input device 10 from a place other than the chair.
[0022]
Hereinafter, an indoor virtual space image will be described by taking as an example an art museum in which a plurality of paintings are arranged on a wall surface and a ceiling surface.
Here, the input device 10 has a size that allows the operator to hold it with both hands, similar to the operation switch of the home video game machine, and has four cross-shaped keys U (upper) that can be operated with the left hand. ), D (bottom), L (left), R (right) and a direction key K and four buttons a to d that can be operated with the right hand, and each key U, D, L, R or each Various signals (K, a to d) can be input to the computer 60 by a single pressing operation of the buttons a to d or a combination pressing operation. Here, the direction key K may be composed of eight direction keys (upper left, lower left, upper right, and lower right are added), but the drawing and description are complicated even though the operation is essentially the same. Therefore, for convenience of explanation, four-direction keys U, D, L, and R are taken as an example here.
[0023]
In the present embodiment, a signal from the input device 10 and an input command of the conversion result are identified by indicating a direction key or a button in parentheses. For example, (U, b) means a pressing operation of the key U and the button b, and (d2 times) means a double click of the button d. Further, (K) means a pressing operation of any of the direction keys U, D, R, and L, and (a to d) means a pressing operation of any of the buttons a to d. However, the arbitrary combination (K, a to d) basically means a combination of any one of the direction keys U, D, R, and L and any one of the buttons a to d. This includes a case where any of the buttons a to d is not operated (meaning any operation).
[0024]
The computer 60 includes an input signal conversion unit 20, an image generation calculation unit 30, three frame memories 41 to 43, and three D / A converters 51 to 53. Note that the frame memories 41 to 43, the D / A converters 51 to 53, and the projectors 71 to 73 have the same signal system with the same one's sign.
[0025]
The input signal conversion unit 20 converts various signals (K, a to d) input from the input device 10 into input commands (K, a to d) having corresponding contents, and the input commands (K, a to It has an interface function of inputting d) to the image generation calculation unit 30.
[0026]
The image generation calculation unit 30 generates image data (RGB) indicating a virtual space image based on the input command (K, ad) input from the input signal conversion unit 10, and this image data is displayed on a large screen. In order to display, the image data has a function of dividing the image data into three areas of the left area, the central area, and the right area, substantially dividing the image data into three areas and sending them individually to the three frame memories 41 to 43.
[0027]
Specifically, the image generation calculation unit 30 includes, in addition to a well-known basic function unit (not shown) for displaying a virtual space image, a painting specification table 31, an viewing angle table 32, a painting arrangement table 33, an viewing order table. 34, a parallel movement calculation unit 35, an ornamental angle movement calculation unit 36, and a painting movement calculation unit 37.
[0028]
The basic function unit has a memory in which image data for creating a virtual space image is stored, and based on an input command (K) or (a or c) received from the input signal conversion unit 20, a world coordinate system, An embodiment of a known virtual space video display technique in which image processing of a virtual space image using a body coordinate system, a viewpoint coordinate system, and a screen coordinate system is executed and the obtained image signal is given to the frame memories 41 to 43 It is. Details of the virtual space video display technology are introduced in, for example, a document of “J. D. Foley / A. Van Dam, translated by Tomomi Imamiya: Computer Graphics, Japan Computer Association”. Further, the image processing of the basic function includes the above-described advance and retreat along the line-of-sight direction and rotation in any direction on the spot (swing).
[0029]
The picture specifying table 31 is readable by the viewing angle movement calculation unit 36, and is used for specifying a picture of interest as shown in FIG. The combination of the position and the painting of interest is set. Here, the picture of interest is set to be the picture displayed in the center of the screen 80.
[0030]
The viewing angle table 32 can be read out by the viewing angle movement calculation unit 36 and the painting movement calculation unit 37. As shown in FIG. 4, the viewpoint position (x, y, z) and line of sight optimal for viewing for each painting p. A viewing angle consisting of directions (θ, φ, ρ) is set. If desired, in addition to the viewing angle, audio data for playing BGM or narration, and brightness suitable for viewing are displayed. Brightness data to be set can be set for each picture or each group of pictures. The viewpoint position in the viewing angle table 32 is set in the world coordinate system of the virtual space VS.
[0031]
The painting arrangement table 33 can be read out by the painting movement calculation unit 37. As shown in FIG. 5, for each painting, the input movement direction and the identification information of the destination painting arranged in the movement direction are displayed. Is set. In the figure, for example, L · U indicates that the two keys L and U of the input device 10 are simultaneously pressed and the upper right direction is designated.
[0032]
The viewing order table 34 can be read out by the painting movement calculation unit 37, and for viewing each painting in the group in a predetermined order for each of a plurality of paintings included in an arbitrary group, as shown in FIG. Watching order data is set. Note that the predetermined order can be arbitrarily set based on, for example, the spatial arrangement of the pictures and the intention to produce.
[0033]
The parallel movement calculator 35 receives from the input signal converter 20.Specify the movement direction and parallel movement functionBased on the input command (K, b), the inclination of the line-of-sight direction and the wall intersecting in the line-of-sight direction is calculated, and the obtained inclination isBased on the direction of the line of sightParallel to the wallAnd in the movement direction specified by the input commandImage processing is executed so as to move the viewpoint position, and the obtained image data is divided into approximately three parts and given to the frame memories 41 to 43.
[0034]
Based on the input command (d2 times) received from the input signal conversion unit 20, the viewing angle movement calculation unit 36 refers to the painting identification table 31 to identify the painting currently focused on, and refers to the viewing angle table 32. Then, the viewing angle of the specified picture is read out, image processing is executed so as to smoothly move the current viewpoint to the read viewing angle, and the obtained image data is divided into approximately three parts to be stored in the frame memories 41 to 43. To give. In addition, as a technique for smoothly moving, for example, a method of calculating a spline curve that smoothly connects both the viewing angle and the current viewpoint position, and moving the viewpoint along the obtained spline curve. It can be used. Details of the calculation method of the curve that smoothly connects the two points are introduced in, for example, the literature of “JD Foley / A. Van Dam, translated by Tomomi Imamiya: Computer Graphics, Japan Computer Association”. Yes.
[0035]
The painting movement calculation unit 37 refers to the painting arrangement table 33 based on the input command (K, d) received from the input signal conversion unit 20 when the viewpoint is at the viewing angle, and the viewing angle of the painting in the input direction. The image data obtained by executing the image processing so as to move the viewpoint is divided into approximately three parts and given to the frame memories 41 to 43.
[0036]
In addition, when the viewpoint is at the viewing angle, the painting movement calculation unit 37 refers to the viewing order table 34 based on the input command (d1 time) received from the input signal conversion unit 20, and the viewing angle in a predetermined next painting The image data obtained by executing the image processing so as to move the viewpoint is divided into approximately three parts and given to the frame memories 41 to 43.
[0037]
The frame memories 41 to 43 are for sequentially supplying image data to the projectors 71 to 73 via the D / A converters 51 to 53, respectively.
The D / A converters 51 to 53 D / A convert the image data obtained from the frame memories 41 to 43 and give the obtained image signals to the projectors 71 to 73, respectively.
[0038]
The projectors 71 to 73 are for projecting images on the screen 80 based on image signals obtained from the D / A converters 51 to 53 in the computer 60.
[0039]
The screen 80 is disposed opposite to the projectors 71 to 73. Here, the screen 80 is a reflective type having a concave shape similar to that of a skin portion cut out from a sphere having a radius of 3 meters within a range of 40 degrees vertically and 150 degrees horizontally. Is.
[0040]
Next, the operation of the three-dimensional image display apparatus configured as described above will be described in the order of movement by basic functions, movement in parallel with the wall, movement to the viewing angle, and movement between pictures.
(Movement with basic functions)
Now, as shown in FIG. 7, a virtual space VS representing an art museum in which pictures p1,... Are arranged is displayed, and it is assumed that each picture p1,. Here, as a result of the operator's operation of the input device 10, the basic function unit of the image generation calculation unit 20 executes well-known image processing and changes the viewpoint position and line-of-sight direction of the camera 1 as shown in FIG. 8. The 3D video moving in the virtual space VS can be displayed on the screen 80. For example, as shown in FIG. 8, when any one of the direction keys U, D, L, and R is pressed, the camera 1 rotates and the line-of-sight direction changes. Further, when the button a is pressed, the camera 1 moves forward in the line of sight, and when the button c is pressed, the button c moves backward in the direction opposite to the line of sight.
[0041]
With this basic function, it is possible to move in the virtual space VS as is well known, but in addition to this, in the apparatus of the present invention, in order to facilitate the operation of moving while viewing the paintings p1,. Various movement functions designated by the buttons b and d as the function designation part are added as follows.
(Move parallel to the wall)
Normally, when a person views a picture at a museum, he or she walks along the wall (moving in parallel with the wall) while looking at the wall on which the picture is displayed, and wraps around to the optimal viewpoint position of the picture of interest. Then, look carefully at the picture along the optimal viewing direction (move to the viewing angle).
[0042]
The device of the present invention realizes such a movement operation in a virtual space. Furthermore, in the virtual space, unlike the real world, it is possible to move in the vertical direction of the space as well.
[0043]
First, the operation | movement which moves in parallel with a wall is demonstrated using the flowchart of FIG. Specifically, as shown in FIGS. 10 and 11, the camera 1 is oriented along the wall W in a direction different from the line-of-sight direction, that is, parallel to the wall W while maintaining a constant distance from the wall W. The case of moving will be described. Now, the parallel movement calculation unit 35 in the image generation calculation unit 30 determines whether or not there is an input command (K, b) from the input signal conversion unit 20 (ST1), and waits when there is no input command. Here, it is assumed that an input command (R, b) is received through the input signal conversion unit 20 by the pressing operation of the direction key R and the button b by the operator. As shown in FIG. 12, the input command (R, b) is a parallel translation in the left direction with respect to the wall W, and the input command (U, b) is a parallel translation in the upward direction with respect to the wall W. It is. As shown in FIG. 13, the parallel movement calculation unit 35 sets measurement points L1 to L4 on the top, bottom, left and right of the viewpoint of the camera 1, and extends lines Lm1 to Lm4 from each measurement point L1 to L4 in parallel to the line of sight. Then, intersections M1 to M4 between the lines Lm1 to Lm4 and the wall W are obtained (ST2). When the coordinates of the intersection points M1 to M4 are respectively obtained as [x1, y1, z1] to [x4, y4, z4], subsequently, the inclination of the wall W is set to [x2-x4, y2-y4, z2- z4] and [x1-x3, y1-y3, z1-z3] in the vertical direction (ST3).
[0044]
Here, the parallel movement calculation unit 35 performs image processing to move the camera 1 to the left along the direction of the inclination of the wall W, and gives the obtained image data to the frame memories 41 to 43. As shown in FIG. 11, the viewpoint can be moved to the left parallel to the wall W while viewing the pictures p1, p2,... On the screen 80 (ST4). Note that this parallel movement is not limited to the left, but can be realized in accordance with the input of the direction key K for each of the left, right, up and down directions. Moreover, the parallel movement calculating part 35 implement | achieves the parallel movement along the shape of the wall W by repeating step ST2-ST4 sequentially, determining the presence or absence of input command (K, b) (ST5). When the input command (K, b) disappears, the movement is stopped. In general, it is difficult to move in a direction different from the line of sight in the virtual space, but in this embodiment, the wall W can be easily viewed while viewing the pictures p1,. In parallel with the virtual space VS.
(Moving to the viewing angle)
Next, the operation of turning around the desired viewing angle from an arbitrary place will be described with reference to the flowchart of FIG.
Now, the viewing angle movement calculation unit 36 in the image generation calculation unit 30 determines whether or not there is an input command (b2 times) from the input signal conversion unit 20 (ST11), and waits when there is no input command. Here, it is assumed that an input command (b2 times) is received through the input signal conversion unit 20 by a double click operation of the button d by the operator. As a result, the viewing angle movement calculation unit 36 identifies the painting pi of interest by referring to the painting identification table 31 based on the current line-of-sight direction and viewpoint position as shown in FIG. 15 (ST12). (ST13) The viewing angle of the specified picture pi is read with reference to the viewing angle table 32 (ST14). Thereafter, as shown in FIG. 16, based on the viewing angle Api and the current viewpoint position S1, a spline curve Ls is calculated as a moving path that smoothly connects the two (ST15), and the obtained spline curve is obtained. Image processing is executed so as to move the viewpoint to the viewing angle along Ls (ST16).
[0045]
In the same manner as described above, the obtained image data is divided into approximately three parts and given to each of the frame memories 41 to 43, so that a virtual view showing a field of view when naturally wrapping around from the arbitrary point to the viewing angle of the picture of interest is shown. A spatial image can be displayed on the screen 80. In step ST16, when there is another input during the movement until reaching the viewing angle, the movement is immediately stopped and the movement management is returned to the operator.
[0046]
In addition, after reaching the viewing angle, the user can watch the picture from the position pulled backward by pushing the button c, or can go forward by pushing the button a and watch the picture from a close position. Further, the above-described parallel movement may be performed at a close position, and the details of the picture may be viewed in every corner as shown in FIG. As described above, when the viewpoint moves while looking at the picture p1,... In the virtual space VS, when it is desired to watch a picture pi carefully, the picture pi is optimally viewed in steps ST11 to ST16. You can see by angle. Supplementally, conventionally, in the virtual space, a complicated operation for controlling the viewpoint position and the line-of-sight direction is required for the operation of going around the front of a certain surface. However, in the present embodiment, the wraparound operation to the front can be easily performed by the functions shown in steps ST11 to ST16.
[0047]
Similarly, conventionally, an operation for matching the viewpoint position and the line-of-sight direction with a viewing angle of a certain picture is extremely difficult unless a skilled operator is employed. However, in this embodiment, since the viewing angle is registered for each picture in advance, a desired picture can be viewed from the viewing angle by an extremely easy operation of double-clicking the button d. Since the movement is not instantaneous but continuous, the confusion of the operator can be prevented in advance. In addition, since the movement does not pass through the shortest distance but passes through the spline curve, the operator feels as if he / she naturally wraps around the front of the picture, similar to the appreciation of an actual painting, thereby improving the realism. Further, since the wraparound is naturally performed, it is possible to prevent the occurrence of discomfort such as dizziness due to a sudden movement through the shortest distance. In addition, since it is executed by a special operation such as double-clicking the button d, execution (malfunction) due to an erroneous operation such as accidentally touching the button d can be prevented.
[0048]
Furthermore, since the picture specifying table 31 is used when specifying a picture, the picture of interest can be easily specified. That is, the picture identification table 31 is a structure in which several pictures of interest to some extent from the line-of-sight direction are narrowed down, and the pictures of interest are identified from these pictures according to the viewpoint position. It is not necessary to quickly identify the painting.
(Moving between paintings)
Next, the operation of moving from the viewing angle of one painting to the viewing angle of another painting will be described using the flowchart of FIG.
Now, the picture movement calculation unit 37 in the image generation calculation unit 30 determines whether or not there is an input command (K, d) from the input signal conversion unit 20 (ST21), and waits when there is no input command. Here, an input command (L, d) corresponding to the movement to the right picture in each direction shown in FIG. 19 is pressed via the input signal conversion unit 20 by pressing the direction key K and the button d by the operator. Suppose you received it. Thereby, the painting movement calculation unit 37 identifies the designated rightward painting pi by referring to the painting arrangement table 33 (ST22), and refers to the viewing angle table 32 to view the identified painting pi. Read the angle. Thereafter, based on the right viewing angle and the current viewing angle, image processing is executed to move the viewpoint to the right viewing angle (ST23).
[0049]
In the same manner as described above, the obtained image data is divided into substantially three parts and given to each of the frame memories 41 to 43, so that the virtual space image showing the field of view when moving from the viewing angle of one picture to the viewing angle of another picture. Can be displayed on the screen 80.
[0050]
The movement between the pictures can be performed in a predetermined order as will be described with reference to FIG. That is, the painting movement calculation unit 37 in the image generation calculation unit 30 determines whether or not there is an input command (d1 time) from the input signal conversion unit 20 (ST31), and waits when there is no input command. Then, it is assumed that an input command (d1 time) is received through the input signal conversion unit 20 by the click operation of the button d by the operator. Accordingly, the painting movement calculation unit 37 refers to the viewing order table 34 (ST32), identifies the painting pi in the predetermined next viewing order, and refers to the viewing angle table 32 to determine the identified painting pi. Read the viewing angle. Thereafter, based on the viewing angle of the next painting and the current viewing angle, image processing is executed so as to move the viewpoint to the viewing angle of the next painting (ST33).
[0051]
In the same manner as described above, the obtained image data is divided into approximately three parts and given to the frame memories 41 to 43, thereby moving from one viewing angle to the next viewing angle according to a predetermined viewing order. A virtual space image showing the field of view at the time can be displayed on the screen 80. Further, when it is desired to review the previous picture, for example, by clicking the button b, the previous picture is identified with reference to the viewing order table 34, and the viewpoint is returned to the viewing angle of the previous picture. In this way, by using the viewing angle that the video display device has in advance, it is possible to move from one viewing angle to another viewing angle, which is a simple operation, and to view many pictures from the optimal viewing angle. Can do.
[0052]
As described above, according to the present embodiment, when the parallel movement calculation unit 35 receives a predetermined input command (K, b) when there is a wall W in the virtual space image, the line-of-sight direction intersects the line-of-sight direction. Since the image processing is performed so as to move the viewpoint position in parallel with the wall W along the obtained inclination, the inclination with the wall W is calculated, so when viewing an object in the virtual space, it is different from the line-of-sight direction The viewpoint can be moved in the direction, and the ease of operation can be improved.
[0053]
  In addition, the viewing angle movement calculation unit 36 receives a predetermined input command (d2 times), based on the current viewpoint position and line-of-sight direction, the painting pi currently focused on is identified with reference to the painting identification table 31 and the identified painting pi with reference to the viewing angle table 32. Since the image processing is executed so as to move the current viewpoint position and line-of-sight direction to this viewing angle, when viewing an object in the virtual space, the viewpoint can be moved to a position suitable for viewing, The ease of operation can be improved.
[0054]
Furthermore, when the current viewpoint position and line-of-sight direction are at the viewing angle, the painting movement calculation unit 37 issues an input command (K, d) including a direction signal (K) indicating a movement direction and a predetermined input signal (d). Upon receipt, the painting pi in the moving direction is identified with reference to the painting arrangement table 33, the viewing angle of the identified painting pi is read with reference to the viewing angle table 32, and the current viewpoint position and line of sight up to this viewing angle. Since image processing is performed so as to move the direction, when viewing an object in the virtual space, the viewpoint can be moved to a position suitable for viewing in a direction different from the line-of-sight direction, which improves the ease of operation. it can.
[0055]
Furthermore, since the buttons b and d as the function designating unit input a predetermined input signal used alone or in combination with a direction signal indicating the moving direction, a command can be input by combining the direction signal and the predetermined input signal. Therefore, the input device 10 can be reduced in size, and the above-described effects can be obtained by a predetermined input signal, so that the ease of operation can be improved and it is suitable for three-dimensional motion control. That is, an input device that is small and easy to operate and has a function suitable for three-dimensional motion control can be realized.
(Modification)
In the above-described embodiment, a case has been described in which a picture of interest is specified using the picture specifying table 31 with respect to the virtual space image on the screen 80. An effect similar to that of the present invention can be obtained even when a display is used and a known gaze detection device is used in place of the picture specification table 31 to specify a picture of interest from the state of the operator's eyes. Furthermore, even if attention is paid to the painting in the corner of the video, the painting can be specified.
[0056]
In the above embodiment, the case where the spline curve is calculated at the time of moving to the viewing angle has been described. However, the present invention is not limited to this, and the present invention may be configured to calculate an arbitrary curve other than the spline curve by an arbitrary method. The same effect can be obtained by carrying out similarly.
[0057]
In the above embodiment, it has been described that audio data may be registered in the viewing angle table 32. However, the present invention is not limited to this, and a spatial region in the vicinity of a painting (can be defined by a range of viewpoint positions and a range of gaze directions) And audio data may be registered as a pair, and the audio data may be changed for each picture of interest even if there is a viewpoint position other than the viewing angle. Also, a configuration may be adopted in which narration is registered for the viewing angle, and BGM is registered for a spatial region near the painting other than the viewing angle. Alternatively, narration, BGM, or voice off may be switched by a predetermined operation.
[0058]
Furthermore, in the above-described embodiment, the case of viewing art museum paintings has been described. However, the present invention is not limited to this, and content related to movement near a wall having a target of interest (usually indoor movement in general, Thus, the present invention can be similarly implemented to obtain the same effect.
[0059]
For example, for art classes, museums, education (science (moving in the laboratory), art (moving in temples and chapels with artistic value), history (moving in buildings with historical value), etc. ), Training (training of guards, explanation training for museum staff, etc.), restoration of ruins, landscape prediction, preservation of landscapes and cultural assets video, showrooms, new product development (built houses, movies, maze games and amusement parks) Etc.), and the contents of presentations and the like are considered as application examples.
[0060]
However, even if the contents are not listed here, as described above, parallel movement along the wall, movement to the viewing angle (predetermined viewpoint position and line-of-sight direction regardless of name), movement between viewing angles, It goes without saying that any virtual space image display technology including one or more operations such as movement between viewing angles in a predetermined order is included in the scope of the present invention. Therefore, a configuration in which the operations for performing these operations are modified to other operations (for example, a double click of the button a instead of a double click of the button d) is included in the scope of the present invention.
[0061]
Similarly, in the above-described embodiment, the case where the three projectors 71 to 73 and the screen 80 having the dimensions described above are used has been described. However, the present invention is not limited to this. Even in a configuration in which the range of 80 degrees is covered and three projectors are newly added for the upper screen, the present invention can be similarly implemented to obtain the same effect. That is, a configuration in which the size range of the screen and the number of projectors are appropriately changed are also included in the scope of the present invention. Similarly, a configuration using another display device such as a CRT or a liquid crystal display instead of the projector and the screen is also included in the scope of the present invention. In addition, the present invention can be implemented with various modifications without departing from the gist thereof.
[0062]
【The invention's effect】
As described above, according to the present invention, when viewing an object in a virtual space, it is possible to provide a video display device that can move the viewpoint in a direction different from the line-of-sight direction and improve the ease of operation..
Also smallInput device that is easy to operate with a mold and can realize functions suitable for three-dimensional motion controlDisplay device usingCan provide.
[Brief description of the drawings]
FIG. 1 is a schematic diagram showing an external appearance of a video display apparatus according to an embodiment of the present invention.
FIG. 2 is a schematic diagram showing a configuration of a video display device according to the embodiment;
FIG. 3 is a schematic diagram showing a configuration of a picture specifying table in the embodiment.
FIG. 4 is a schematic diagram for explaining the configuration of an ornamental angle table in the embodiment;
FIG. 5 is a schematic diagram showing a configuration of a picture arrangement table in the embodiment.
FIG. 6 is a schematic diagram showing a configuration of an appreciation order table in the embodiment;
FIG. 7 is a schematic diagram showing a virtual space in the embodiment;
FIG. 8 is a schematic diagram for explaining operations of basic functions in the embodiment;
FIG. 9 is a flowchart for explaining the parallel movement operation in the embodiment;
FIG. 10 is a schematic diagram for explaining a parallel movement operation in the embodiment;
FIG. 11 is a schematic diagram for explaining a parallel movement operation in the embodiment;
FIG. 12 is a schematic diagram for explaining a parallel movement operation in the embodiment;
FIG. 13 is a schematic diagram for explaining a calculation process of wall inclination in the embodiment;
FIG. 14 is a flowchart for explaining the movement operation to the viewing angle in the embodiment;
FIG. 15 is a schematic diagram for explaining the movement operation to the viewing angle in the embodiment;
FIG. 16 is a schematic diagram showing an example of a spline curve in the embodiment.
FIG. 17 is a schematic diagram showing an example of viewing in the embodiment
FIG. 18 is a flowchart for explaining a movement operation between pictures in the embodiment;
FIG. 19 is a schematic diagram for explaining a movement operation between pictures in the embodiment;
FIG. 20 is a flowchart for explaining a movement operation between pictures in the embodiment;
FIG. 21 is a schematic diagram for explaining a general virtual space;
[Explanation of symbols]
1 ... Camera
10 ... Input device
20: Input signal converter
30: Image generation calculation unit
31 ... Painting specific table
32. Ornamental angle table
33 ... Painting arrangement table
34 ... Viewing order table
35 ... Parallel movement calculation unit
36. Ornamental angle movement calculation unit
37. Painting movement calculation unit
41-43 ... Frame memory
51-53 ... D / A converter
60 ... Computer
71-73 ... Projector
80 ... Screen
K ... Direction key
U, D, L, R ... key
ad buttons
p1, p2, p3, p4, pi ... Painting
W ... wall
L1 to L4 ... Measurement points
Lm1-Lm4 ... line
M1-M4 ... Intersection
Ls ... Spline curve

Claims (3)

An image display device that displays an image in a visual field along a line-of-sight direction from a viewpoint position in a virtual space based on an input signal, and when there is a wall in the image, the parallel movement function and the wall When an input signal specifying the left / right / up / down translation direction is received , measurement points are set at the top / bottom / left / right of the viewpoint position, and the line is extended from each measurement point in parallel to the line of sight to find the intersection of each line and the wall. calculating the slope of a wall intersecting the line of sight direction as the viewing direction Te, based on the obtained inclination, the sight line direction is specified by horizontal and vertical parallel and said input signal to said wall in a state in which intersects the wall A video display device comprising: a parallel movement calculating means for realizing a parallel movement so as to move the viewpoint position in the horizontal movement direction left and right and up and down with respect to the wall. An input device used in the video display device according to claim 1, wherein a predetermined input command comprising a combination of a direction signal indicating a parallel movement direction in the horizontal and vertical directions with respect to the wall and a predetermined input signal is provided . , a video display apparatus characterized by comprising an input device having a function specifying unit for inputting a predetermined input signal.   The video display device according to claim 2, wherein the input device has a size that can be held by an operator with both hands, a direction key that can be operated with the left hand, and a button that can be operated with the right hand. An image display device characterized by comprising.

Images