JP6623362B2 - Display control device and program - Google Patents

Description

  The present invention relates to a display control device and a program.

  A head-mounted display (HMD) is mounted on a user's head and can display an image in a virtual space on a display arranged in front of the user's eyes. For example, in a game using the HMD, there is a game in which a game such as a controller mounted on a hand is used in addition to a display mounted on a head and used together. However, the user cannot confirm the hand because the field of view is covered by the HMD. For this reason, the user sometimes performs an erroneous operation when the finger is once separated from the controller. Among such HMDs, there is an HMD capable of detecting a motion such as a tilt of a head and performing a display / non-display operation of options (for example, Patent Document 1).

  Further, in recent years, there is a device that can be used as an HMD by attaching a smartphone or the like to an attachment, for example, as the performance of the smartphone or the like increases. In this case, by being worn on the head, an input device such as a touch panel provided in the smartphone cannot be used. Some of such HMDs realize operations on options displayed on the HMD by detecting head movement using a sensor such as a gyro built in a smartphone, for example.

Japanese Patent No. 57767386

  As described above, in the game using the HMD, there are cases where the convenience of the operation by the controller is not sufficient or the input device cannot be used. However, since the direction information of the HMD is exclusively used for the operation of the view direction of the view image, it is difficult to perform other operations. That is, in a game using the HMD, it is desired to diversify operations based on the direction information of the HMD.

  It is an object of some aspects of the present invention to provide a display control device and a program capable of diversifying operations using HMD direction information.

  Another object of another aspect of the present invention is to provide a display control device and a program that can achieve the effects described in the embodiments described below.

  In order to solve the above-described problem, one embodiment of the present invention is a display control device that displays a view image representing a view in a view direction from a virtual viewpoint in a virtual space as a stereoscopic image using binocular parallax. A view changing unit that changes the view direction based on own apparatus direction information related to the direction of the own apparatus, and the virtual viewpoint based on own apparatus rotation information related to rotation of the own apparatus about the view direction. A display control device, comprising: a viewpoint changing unit that moves; the viewpoint changing unit moves the virtual viewpoint in a direction based on the view direction.

  Further, one embodiment of the present invention provides a computer of a display control device that displays a view image representing a view in a view direction from a virtual viewpoint in a virtual space as a stereoscopic image using binocular parallax. Based on own device direction information, a view change step of changing the view direction, and based on own device rotation information about rotation of the own device about the view direction, the virtual viewpoint is set in a direction based on the view direction. This is a program for executing a moving viewpoint changing step.

FIG. 1 is a system configuration diagram illustrating an example of a configuration of an HMD system according to a first embodiment. FIG. 4 is an explanatory diagram illustrating an example of a definition of a direction of a virtual space according to the first embodiment. FIG. 4 is an explanatory diagram illustrating an example of a relationship between a viewing direction and a virtual viewpoint according to the first embodiment. FIG. 5 is an explanatory diagram illustrating an example of movement of a virtual viewpoint according to the first embodiment. FIG. 3 is a hardware configuration diagram illustrating an example of a hardware configuration of a terminal device according to the first embodiment. FIG. 2 is a functional block diagram illustrating an example of a functional configuration of the terminal device according to the first embodiment. FIG. 4 is an explanatory diagram illustrating an example of a view image including an image indicating a moving direction of a virtual viewpoint according to the first embodiment. FIG. 6 is an explanatory diagram illustrating an example of a view image including an image representing a moving amount of a virtual viewpoint and / or a moving speed of the virtual viewpoint according to the first embodiment. 5 is a flowchart illustrating an example of a view change process and a viewpoint moving process of a virtual viewpoint according to the first embodiment. It is a flow chart which shows an example of a field-of-view change processing concerning a modification of a 1st embodiment. It is a flow chart which shows an example of viewpoint movement processing of a virtual viewpoint concerning a modification of a 1st embodiment.

[First Embodiment]
Hereinafter, a first embodiment of the present invention will be described with reference to the drawings.

[Overview of Terminal Device 10]
FIG. 1 is a system configuration diagram illustrating an example of a configuration of an HMD (Head Mounted Display) system 1 according to the present embodiment.
The HMD system 1 is mounted on a user's head and can display a view image representing a view from a virtual viewpoint in a virtual space. The virtual viewpoint may be, for example, one used for generating a view image. For example, the HMD system 1 can display a stereoscopic image using binocular parallax between the right eye and the left eye. In addition, the HMD system 1 is equipped with a sensor that detects the movement and inclination (posture) of the HMD system 1 such as a gyro. The HMD system 1 detects a movement of the user's head, a change in inclination, and the like by using a sensor. In the following description, information indicating a movement or an inclination detected by a sensor may be referred to as sensor information. In the virtual space, for example, a horizontal plane field on which objects can be arranged is provided.

  The illustrated HMD system 1 includes an attachment 2. The terminal device 10 including the display unit 120 can be attached to the attachment 2. The HMD system 1 can use the terminal device 10 as a display control device of the HMD system 1. The terminal device 10 is attached to the attachment 2 so as to cover the front view of the user with the HDM system 1 attached to the user's head and to allow the user to visually recognize the display unit 120 of the terminal device 10. It is possible. The HDM system 1 includes a right-eye lens 3R and a left-eye lens 3L for visually recognizing the display unit 120 of the attached terminal device 10, and a strap 5 for attaching and fixing the HMD system 1 to a user's head. Prepare. By mounting the HMD system 1 on the head, the user can visually recognize a view image displayed on the display unit 120 of the terminal device 10 via the right-eye lens 3R and the left-eye lens 3L.

[Definition of virtual space]
FIG. 2 is an explanatory diagram illustrating an example of the definition of the direction of the virtual space according to the first embodiment.
In the present embodiment, the axis in the vertical direction (vertical direction) in which the user stands upright is defined as the Z axis. In the present embodiment, an axis orthogonal to the Z axis and in a direction connecting the user and the display unit 120 of the HMD system 1, that is, an axis in the field of view is set as the X axis. In the present embodiment, an axis orthogonal to the Z axis and the X axis is defined as a Y axis.

  Here, in the present embodiment, the rotation direction of rotation about the Z axis is the yaw direction (left-right direction), the rotation direction of rotation about the Y axis is the pitch direction (vertical direction), and the X axis is the axis. The rotation direction of the rotation described above is referred to as a roll direction. For example, each sensor detects the angular velocity or angular acceleration of each axis in the rotation direction (yaw direction, pitch direction, and roll direction). In the present embodiment, the yaw direction may be referred to as a left-right direction, and the pitch direction may be referred to as a vertical direction (upward, downward). Further, the distance in the X-axis direction from the virtual viewpoint may be referred to as the depth of field.

FIG. 3 is an explanatory diagram illustrating an example of a relationship between a viewing direction and a virtual viewpoint according to the first embodiment.
In FIG. 3, a virtual viewpoint K (virtual viewpoint of the user) in the virtual space is an intersection (origin) of the X-axis, Y-axis, and Z-axis, and the direction of the user's view is the X-axis direction. The range of the view image in the view direction from the virtual viewpoint (that is, the view) is defined by the yaw angle α (the inner angle between the broken lines a and b, and the broken lines c and d) centered on the view direction (X-axis direction). And the pitch angle β (the inner angle between the broken lines a and d and the inner angle between the broken lines b and c). Here, the yaw angle α and the pitch angle β are angles set in advance as the angle of view of the view image in the virtual space displayed on the HMD system 1. When the direction of the user's head changes in the pitch direction and / or the yaw direction, the view direction changes from the X-axis direction to the pitch direction and / or the yaw direction according to the change. On the other hand, when the direction of the user's head changes in the roll direction, the position of the virtual viewpoint moves in the view direction (X-axis direction) without changing the view direction.

  In the following, for the sake of simplicity, the view direction is assumed to be the normal direction of the display surface of the terminal device 10. However, using the eye tracking technique, the view direction is specified from the movement of the user's eyes. May be.

  Various objects are arranged in the virtual space as needed. For example, the plane L1 is a plane on which an object is arranged in the virtual space. An operation point object P, which is an object for making the gazing point corresponding to the viewing direction visible, is arranged on the plane L1. In other words, the operation point object P is an object representing the direction of the field of view. The operation point object P is substantially at the center of a range (view) surrounded by a rectangle having vertices at points a1, b1, c1, and d1 on dashed lines a, b, c, and d indicating the range in the view direction that forms the plane L1. (In the example shown, it is arranged at the intersection of the plane L1 and the X axis.) The position at which the operation point object P is arranged is not limited to the center of the range (view) surrounded by a rectangle having the vertices of the intersections a1, b1, c1, and d1 on the plane L1, but other positions on the plane L1. May be arranged.

  Here, when the direction of the head of the user wearing the HMD system 1 changes in the pitch direction and / or the yaw direction as described above, the view direction changes in the pitch direction and / or the yaw direction according to the change. . Therefore, the operation point object P moves according to the view direction so as to be displayed at a position in the view image corresponding to the view direction (for example, substantially at the center of the view image).

  When displaying a stereoscopic image using binocular parallax, there is a view direction corresponding to the virtual viewpoint for the right eye and a view direction corresponding to the virtual viewpoint for the left eye. The view images include a view image for each of the view directions for the right eye and the left eye. Each view image includes various objects. In the following description, for the sake of simplicity, the description will be made without distinguishing between the right eye and the left eye.

Here, the movement of the virtual viewpoint and the change of the view direction will be described. As described above, the direction of the field of view can be changed according to the rotation by rotating the direction of the head of the user wearing the HMD system 1 in the pitch direction and / or the yaw direction. That is, the view direction is changed according to the rotation direction and rotation amount (change amount) about the Z axis as the rotation axis or / and the rotation direction and rotation amount (change amount) about the Y axis as the rotation axis. .
On the other hand, the virtual viewpoint can be moved in the direction of the field of view according to the rotation by rotating the direction of the head of the user wearing the HMD system 1 in the roll direction. That is, the position of the virtual viewpoint moves in the X-axis direction according to the rotation direction and the rotation amount (change amount) with the X-axis as the rotation axis. This will be described in detail with reference to FIG.

FIG. 4 is an explanatory diagram illustrating an example of movement of the virtual viewpoint according to the first embodiment.
The virtual viewpoint moves by rotating the virtual viewpoint K illustrated in FIG. 3 around the viewing direction. For example, when the virtual viewpoint is rotated rightward from the initial position of the head of the user wearing the HMD system 1 (for example, rotated in the positive direction) using the X axis as the rotation axis, the virtual viewpoint becomes the virtual viewpoint K according to the amount of rotation. To the virtual viewpoint K1. Here, the rotation position of the user's head in the roll direction when the virtual viewpoint K is at the intersection of the X axis, Y axis, and Z axis (the position at 0 degrees where the user does not rotate the head in the roll direction) ) Is the initial position. At this time, when the X axis is set as the rotation axis and further rotated right, the virtual viewpoint moves from the virtual viewpoint K1 to the virtual viewpoint K2. In the movement of the virtual viewpoint, when the X axis is used as the rotation axis and the counterclockwise rotation (for example, rotation in the negative direction) is performed from the initial position, the virtual viewpoint moves from the virtual viewpoint K to the virtual viewpoint K3 according to the amount of rotation. As described above, the virtual viewpoint is moved according to the rotation direction and the rotation amount of the rotation with the viewing direction as the rotation axis.

  When the virtual viewpoint K is moved in any direction, the movement of the virtual viewpoint may be restricted in the opposite direction, or the virtual viewpoint K may be moved in any direction. , The movement of the virtual viewpoint in the reverse direction need not be restricted. The limitation here is, for example, making it impossible to move (change) the virtual viewpoint or making it difficult to move (change) the virtual viewpoint.

  In addition, the movement amount of the virtual viewpoint may be provided with an upper limit, for example, a predetermined maximum value, for example, 10 m in the virtual space, or may not be provided with the upper limit, or the virtual viewpoint may be operated by a user or the like. Any or all of the movement amount, the predetermined maximum value, and the presence or absence of the upper limit value may be settable.

  In addition, when the virtual viewpoint is moved in any direction by rotation in one roll direction, the movement of the virtual viewpoint in the opposite direction due to rotation in the other roll direction may be limited. . More specifically, for example, when the virtual viewpoint is rotated rightward by a predetermined amount from the initial position with the X axis as the rotation axis to move the virtual viewpoint from the virtual viewpoint K to the virtual viewpoint K1, a left rotation with the X axis as the rotation axis Occurs, the movement of the virtual viewpoint from the virtual viewpoint K1 in the direction of the virtual viewpoint K may be invalidated, and the virtual viewpoint may remain at the position of the virtual viewpoint K1.

  In addition, a threshold may be provided for the movement of the virtual viewpoint, and the virtual viewpoint may be moved in accordance with the detection of the rotation amount in any direction equal to or greater than the predetermined threshold.

  The movement of the virtual viewpoint is performed by controlling the moving speed of the virtual viewpoint in accordance with the detection of the rotation amount in the roll direction by the terminal device 10 or by controlling the moving speed of the virtual viewpoint in accordance with the detection of the rotation amount. May be. The moving speed of the virtual viewpoint may be a constant speed irrespective of the rotation amount (a change amount of the rotation), or may be different depending on the rotation amount. In this case, for example, when the rotation amount is large, the moving speed of the virtual viewpoint is made faster than when the rotation amount is small, and when the rotation amount is small, the moving speed of the virtual viewpoint is made slower than when the rotation amount is large. May be. In addition, a timer that can measure the time when rotation is detected is provided, and when the detection time is longer than a predetermined time, the moving speed of the virtual viewpoint is increased, and as the detection time is longer, the moving speed of the virtual viewpoint is increased. Or you may. In this case, the predetermined time may be provided in a plurality of stages, and a moving speed corresponding to each predetermined time may be set.

[Hardware configuration]
The terminal device 10 is a portable computer device that can be used as at least a part of the HMD system 1, such as a mobile phone such as a smartphone or a feature phone, a personal digital assistant (PDA), a tablet PC, and a home game. Machine, etc. can be applied. In the present embodiment, an example in which the terminal device 10 is a smartphone will be described. Note that the HMD system 1 may be a computer device integrally including a display, a control unit, and the like.

  In addition, the HMD system 1 only needs to include at least the display device and the sensor in the terminal device 10, and displays the view image generated by the information processing device (not illustrated) connected to the terminal device 10 by wire or wirelessly. A possible system may be used. That is, the terminal device 10 does not have to be a computer device integrally including the display device and the control unit. In this case, the information processing device (for example, a PC, a game machine body, or the like) does not need to be mounted on the head of the user as the HDM system 1. In other words, the terminal device 10 mounted on the user's head includes at least a display device and a sensor, is connected to the terminal device 10 by wire or wirelessly, and is connected to the terminal device by another hardware not mounted on the user's head. 10 may be controlled (for example, a process of changing a view image, a process of moving a virtual viewpoint, a process of generating a view image, and the like).

FIG. 5 is a hardware configuration diagram illustrating an example of a hardware configuration of the terminal device 10 according to the first embodiment.
The terminal device 10 includes, for example, a display device 12, a sensor 13, a storage device 15, a communication unit 16, and a CPU (Central Processing Unit) 17.

  The display device 12 is a display that displays information such as images and text, and includes, for example, a liquid crystal display panel, an organic EL (ElectroLuminescence) display panel, and the like. For example, the display device 12 uses a binocular parallax to provide a stereoscopic image (a right-eye image and a left-eye image) as a field-of-view image from a virtual viewpoint (the eyes of the user wearing the HMD system 1) in a virtual space. Is displayed. Further, the display device 12 displays various objects arranged in the virtual space together with the view image.

  The sensor 13 is a sensor that detects various types of sensor information. For example, the sensor 13 is a gyro sensor that detects an angle, an angular velocity, an angular acceleration, and the like of an object. The sensor 13 may be a sensor that detects the amount of change in the direction, or may be a sensor that detects the direction itself. Further, the sensor 13 is not limited to a gyro sensor, but may be an acceleration sensor, a tilt sensor, a geomagnetic sensor, or the like.

  The storage device 15 includes, for example, a hard disk drive (HDD), a solid state drive (SSD), an electrically erasable programmable read-only memory (ROM), a read-only memory (ROM), and a ROM (read-only memory). It stores virtual space data (image data), data of an object arranged in the virtual space, a program of a game using the virtual space, and the like.

  The communication unit 16 is, for example, a communication interface for connecting an information processing device (not shown) and the terminal device 10 by wire or wirelessly. Note that the communication unit 16 may function as a communication interface for connecting to the Internet network.

  The CPU 17 functions as a control center that controls each unit included in the terminal device 10. For example, the CPU 17 functions as a control unit that controls each unit of the terminal device 10 by executing various programs stored in the storage device 15.

  Each of the above-described components is communicably connected to each other via a bus (BUS). In addition, the terminal device 10 includes a hardware configuration such as a speaker, an audio output terminal, a camera, a GPS (Global Positioning System) receiving module, an operation button or a touch panel that accepts a user's operation input, a timer, and the like (all not shown). It may be configured.

  For example, the terminal device 10 executes a game program using the HMD system 1. In this game, the user wears the HMD system 1 and plays while changing the visual field range of the view image (game screen) displayed on the display device 12 by changing the direction of the head and the like.

  The terminal device 10 detects direction information on the direction of the terminal device 10 based on the detection result of the sensor 13. The terminal device 10 causes the display device 12 to display a view image (game screen) in the view direction based on the detection result. The direction of the terminal device 10 corresponds to the direction of the head of the user wearing the HMD system 1.

[Function configuration]
FIG. 6 is a functional block diagram illustrating an example of a functional configuration of the terminal device 10 according to the first embodiment.
The terminal device 10 includes a storage unit 150 as a functional configuration for writing and reading various data and programs from the storage device 15. Further, the terminal device 10 includes a display unit 120 as a functional configuration for controlling the display device 12. In addition, the terminal device 10 includes a sensor input unit 130 as a functional configuration for receiving a detection value of the sensor 13. In addition, the terminal device 10 includes a control unit 110 as a functional configuration realized by the CPU 17 executing a program stored in the storage device 15. The control unit 110 includes a detection unit 111, a view change unit 112, a viewpoint change unit 113, a direction image generation unit 115, a moving image generation unit 116, and a display control unit 117.

  The detection unit 111 detects the direction information of the terminal device 10 based on the detection result of the sensor input unit 130. The direction information is information indicating the direction of the terminal device 10 including the respective rotation directions and rotation amounts (change amounts) of the yaw direction, the pitch direction, and the roll direction.

  The view change unit 112 detects the view direction in the virtual space based on the direction information of the terminal device 10 detected by the detection unit 111. Further, the view change unit 112 changes the view direction based on the direction information of the terminal device 10 detected by the detection unit 111. Specifically, the view changing unit 112 changes the view direction in accordance with the yaw direction of rotation and the amount of rotation (inclination, change), the pitch direction of rotation and the pitch direction of rotation (inclination, change). I do.

  The viewpoint changing unit 113 detects the position of the virtual viewpoint in the virtual space based on the direction information of the terminal device 10 detected by the detecting unit 111. Further, the viewpoint changing unit 113 moves (changes) the position of the virtual viewpoint in the virtual space based on the direction information of the terminal device 10 detected by the detecting unit 111. Specifically, the viewpoint changing unit 113 moves the virtual viewpoint according to the rotation direction and the amount of rotation (also referred to as the amount of inclination, the amount of change, etc.) in the roll direction.

  The direction image generation unit 115 generates an image (direction image) representing the moving direction of the virtual viewpoint in the view image in the virtual space in the view image. Specifically, the direction image generation unit 115 generates a direction image (object) representing the moving direction of the virtual viewpoint, and arranges the direction image (object) in the virtual space. In other words, the direction image is arranged in the view image in the virtual space. An example of an image generated by the direction image generation unit 115 will be described later with reference to FIG. Note that the terminal device 10 may not include the direction image generation unit 115.

  The moving image generation unit 116 generates an image (moving image) representing the moving amount of the virtual viewpoint or the moving speed of the virtual viewpoint in the view image in the virtual space in the view image. Specifically, the moving image generation unit 116 generates an image (object) indicating the moving amount of the virtual viewpoint or the moving speed of the virtual viewpoint, and arranges the image (object) in the virtual space. In other words, the moving image is arranged in the view image in the virtual space. An example of an image generated by the moving image generation unit 116 will be described later with reference to FIG. Note that the terminal device 10 may not include the moving image generation unit 116.

  The display control unit 117 displays the view image in the view direction from the virtual viewpoint in the virtual space according to the view direction detected and changed by the view change unit 112 and the virtual viewpoint detected and moved by the viewpoint change unit 113. 120 is displayed. In addition, the display control unit 117 changes the view direction in the view direction from the virtual viewpoint in the virtual space according to the view direction detected and changed by the view change unit 112 and the virtual viewpoint detected and moved by the viewpoint change unit 113. The display unit 120 displays the direction image generated by the direction image generation unit 115 and the moving image generated by the moving image generation unit 116. The storage unit 150 stores the data of the view image in each direction in the virtual space as virtual space data. The display control unit 117 acquires a view image corresponding to the view direction from the virtual space data, and causes the display unit 120 to display the view image as the view image.

[Direction image]
FIG. 7 is an explanatory diagram illustrating an example of a view image including an image indicating the moving direction of the virtual viewpoint according to the first embodiment.
The view image V1 shown in FIG. 7 includes an operation point object P indicating the moving direction of the virtual viewpoint. For example, the operation point object P is displayed at the center of the view image V1. That is, the operation point object P is arranged in the view image V1. The operation point object P may be displayed on the display unit 120 when the user moves the position of the virtual viewpoint, for example.

  For example, when the terminal device 10 detects the inclination in the roll direction, the position of the virtual viewpoint moves from the near side in the virtual space of the view image V1 to the depth direction in the virtual space of the view image V1, that is, the direction of the operation point object P. I do. In other words, the operation point object P is an image indicating the moving direction of the virtual viewpoint, for example, the direction of the X axis described in FIG.

  In this way, by displaying the moving direction of the virtual viewpoint in the view image, the user can grasp in which direction the virtual viewpoint moves, so that the operability of the user can be improved. In addition, the user can adjust the view direction by tilting in the roll direction or the pitch direction while viewing the operation point object P representing the moving direction of the virtual viewpoint. Can operate.

[Moving image]
FIG. 8 is an explanatory diagram illustrating an example of a view image including an image representing the moving amount of the virtual viewpoint or the moving speed of the virtual viewpoint according to the first embodiment.
The view image V2 illustrated in FIG. 8 includes an image vol representing the moving amount of the virtual viewpoint or the moving speed of the virtual viewpoint.
For example, an image vol representing the moving amount of the virtual viewpoint or the moving speed of the virtual viewpoint is displayed at the center of the view image V2. For example, the image vol indicating the moving amount of the virtual viewpoint or the moving speed of the virtual viewpoint is an image indicating the moving amount of the virtual viewpoint moving and the current moving speed of the virtual viewpoint. . The view image V1 including the image vol representing the moving amount of the virtual viewpoint or the moving speed of the virtual viewpoint is displayed on the display unit 120 when the user moves the position of the virtual viewpoint, for example.

  The image vol representing the moving amount of the virtual viewpoint or the moving speed of the virtual viewpoint is displayed in, for example, a C-shaped shape, and is shifted from a start point (for example, 0) vol_s to an end point (for example, a maximum speed or a maximum movement amount) vol_e. 12 is an image showing how much the current value vol_n is.

  In this way, by displaying an image representing the moving amount of the virtual viewpoint or the moving speed of the virtual viewpoint in the view image, the moving amount of the virtual viewpoint and the moving speed of the virtual viewpoint can be determined. Can be grasped by the user. In addition, since the virtual viewpoint can be moved while viewing the image indicating the moving amount of the virtual viewpoint or the moving speed of the virtual viewpoint, the operability of the user can be improved.

[Operation of Terminal Device 10]
FIG. 9 is a flowchart illustrating an example of the view direction changing process and the virtual viewpoint moving process according to the first embodiment.
In step S200, the terminal device 10 detects direction information of the own device. After that, the terminal device 10 executes the process of step S202.
In steps S202 to S210, the terminal device 10 specifies the position of the virtual viewpoint in the virtual space based on the direction information.

In step S202, the terminal device 10 determines whether rotation about the X axis as a rotation axis is detected based on the direction information. When the rotation about the X axis as the rotation axis is detected (Step S202; YES), the terminal device 10 executes the process of Step S204.
On the other hand, when the rotation about the X axis as the rotation axis is not detected (Step S202; NO), the terminal device 10 executes the process of Step S214.

  In step S204, the terminal device 10 determines whether the rotation amount of the rotation about the X axis as the rotation axis is equal to or larger than a threshold. When the rotation amount of the rotation about the X axis as the rotation axis is equal to or larger than the threshold (step S204; YES), the terminal device 10 executes the processing of step S206. On the other hand, when the rotation amount of the rotation about the X axis as the rotation axis is less than the threshold value (Step S204; NO), the terminal device 10 executes the process of Step S214.

  In step S206, the terminal device 10 determines whether the rotation direction of the rotation about the X axis as the rotation axis is a positive direction. If the rotation direction of the rotation about the X axis is the positive direction (step S206; YES), the terminal device 10 executes the process of step S208. On the other hand, if the rotation direction of the rotation about the X axis as the rotation axis is not the positive direction (step S206; NO), that is, if the rotation direction is the negative direction, the terminal device 10 executes the process of step S210.

In step S208, the terminal device 10 moves the virtual viewpoint position in the positive direction (for example, ahead of the user's view direction) by the detected change amount. After that, the terminal device 10 executes the process of step S214.
In step S210, the terminal device 10 moves the virtual viewpoint position in the negative direction (for example, behind the user's view direction) by the detected change amount. After that, the terminal device 10 executes the process of step S214.

In step S214, the terminal device 10 determines whether rotation about the Z axis as a rotation axis is detected based on the direction information. When the rotation about the Z axis as the rotation axis is detected (Step S214; YES), the terminal device 10 executes the process of Step S218.
On the other hand, when the rotation about the Z axis as the rotation axis is not detected (Step S214; NO), the terminal device 10 executes the process of Step S224.

  In step S218, the terminal device 10 determines whether the rotation direction of the rotation about the Z axis as the rotation axis is a positive direction. When the rotation direction of the rotation about the Z axis as the rotation axis is the positive direction (Step S218; YES), the terminal device 10 executes the process of Step S220. On the other hand, when the rotation direction of the rotation about the Z axis as the rotation axis is not the positive direction (step S218; NO), that is, when the rotation direction is the negative direction, the terminal device 10 executes the process of step S222.

In step S220, the terminal device 10 moves the view direction in the positive direction (for example, the left direction) by the detected change amount. Thereafter, the terminal device 10 executes the process of step S224.
In step S222, the terminal device 10 moves the view direction in the negative direction (for example, the right direction) by the detected change amount. Thereafter, the terminal device 10 executes the process of step S224.

In step S224, the terminal device 10 determines whether rotation about the Y axis as a rotation axis is detected based on the direction information. When the rotation about the Y axis as the rotation axis is detected (Step S224; YES), the terminal device 10 executes the process of Step S228.
On the other hand, when the rotation about the Y axis as the rotation axis is not detected (Step S224; NO), the terminal device 10 executes the process of Step S234.

  In step S228, the terminal device 10 determines whether the rotation direction of the rotation about the Y axis as the rotation axis is a positive direction. If the rotation direction of the rotation about the Y axis as the rotation axis is the positive direction (Step S228; YES), the terminal device 10 executes the process of Step S230. On the other hand, when the rotation direction of the rotation about the Y axis as the rotation axis is not the positive direction (step S228; NO), that is, when the rotation direction is the negative direction, the terminal device 10 executes the process of step S232.

In step S230, the terminal device 10 moves the view direction in the positive direction (for example, upward) by the detected change amount. After that, the terminal device 10 executes the process of step S233.
In step S232, the terminal device 10 moves the view direction in the negative direction (for example, downward) by the detected change amount. After that, the terminal device 10 executes the process of step S233.

In step S233, the terminal device 10 sets the view direction determined in steps S214 to S232 as the movement direction of the virtual viewpoint. Thereafter, the terminal device 10 executes the process of step S234.
In step S234, the terminal device 10 generates a view image from the position of the virtual viewpoint based on the position of the virtual viewpoint specified in steps S202 to S210 and the view direction specified in steps S214 to S230. After that, the terminal device 10 executes the process of step S200.

  The comparison between the rotation amount and the threshold in step S204 may not be performed. In this case, the terminal device 10 may move the virtual viewpoint according to the detected amount of rotation, or change the direction of the field of view according to the detected amount of rotation.

In the present embodiment, when the virtual viewpoint is moved, the moving direction at the start of the movement of the virtual viewpoint may be maintained. For example, in step S204, when the virtual viewpoint is moving, the terminal device 10 maintains the view direction determined in step S233 until the movement of the position of the virtual viewpoint stops (for example, step S202: NO). Good. Note that the case where the virtual viewpoint is moving here means that, for example, in the previous step S204, the rotation amount of the rotation about the X axis as the rotation axis is equal to or larger than the threshold (step S204; YES). Good. Here, the previous step is each process from step S200 to step S234 executed before executing each process from step S200 to step S234.
After that, in step S204, while the rotation amount of the rotation about the X axis as the rotation axis is equal to or larger than the threshold (step S204; YES), the terminal device 10 skips the processing of step S233, that is, executes the processing of step S233. Instead, the process of step S234 is executed.

  By doing so, the moving direction of the virtual viewpoint that has started moving is maintained until the movement stops, so that the user can freely change the view direction without worrying about the moving direction of the virtual viewpoint. Can be.

  In the present embodiment, when the virtual viewpoint is moved, the moving direction of the virtual viewpoint may be changed together with the change of the view direction. For example, even during the movement of the virtual viewpoint, the terminal device 10 does not skip the process of step S233, that is, executes the process of step S233, and changes the virtual viewpoint every time the view direction is determined from step S214 to step S232. The moving direction may be updated.

  By doing so, the user can change the moving direction of the virtual viewpoint to a desired direction by changing the view direction even while the virtual viewpoint is moving.

In the above description, the case where the position of the virtual viewpoint is moved has been described. However, instead of moving the virtual viewpoint, the field of view may be changed. That is, instead of changing the position of the virtual viewpoint, processing such as zoom-in or zoom-out may be performed.
In the above description, the case where the moving image is displayed in the shape of a C ring is described. However, the moving image may be displayed numerically, or may be indicated by a symbol such as an arrow, the size of the symbol, the number of displayed symbols, or the like. It may be indicated by a character string or by vibration or sound.
In the above description, the case where the directional image is displayed as a point has been described. However, the directional image may be displayed using a cross mark, an icon, or the like, or an image indicating a range may be displayed. .

[Summary of First Embodiment]
(1) As described above, the display control device (the terminal device 10, the HMD system 1, and the like) according to the present embodiment converts the view direction from the virtual viewpoint in the virtual space as a stereoscopic image using binocular parallax. Display device (terminal device 10, HMD system 1, etc.) that displays a view image representing the view of the user, and own device direction information (for example, rotation (tilt) in the yaw direction, rotation in the pitch direction) related to the direction of the own device. (Tilt), etc., based on the view change unit 112 that changes the view direction, and own device rotation information (for example, rotation (tilt) in the roll direction) related to rotation of the own device about the view direction. And a viewpoint changing unit 113 that moves the virtual viewpoint. The viewpoint changing unit 113 moves the virtual viewpoint in a direction based on the view direction.

Accordingly, the terminal device 10 can change the direction of the field of view using the direction information, or move the virtual viewpoint using the rotation information of the terminal device 10 itself. In addition, since the terminal device 10 can move the virtual viewpoint to an arbitrary position in the view image and change the view direction, the operability can be improved. Therefore, the terminal device 10 can diversify the operation using the HDM direction information.
In addition, the terminal device 10 can move the virtual viewpoint to an arbitrary position in the view image instead of a predetermined object, so that the virtual space can be made to feel closer to the real environment.

  (2) In the display control device (terminal device 10) according to the present embodiment, the viewpoint changing unit 113 moves the virtual viewpoint based on the rotation around the viewing direction and the predetermined threshold.

  Thus, the terminal device 10 can prevent the virtual viewpoint from being moved by a movement not intended by the user. The motion not intended by the user is a motion that is not a motion intended to move the virtual viewpoint by the user, for example, a motion accompanying a living body motion such as breathing or pulsation. In addition, since the terminal device 10 can suppress the movement of the virtual viewpoint due to fine movement or the like, it is possible to prevent video sickness when the HDM system 1 is mounted.

  (3) In the display control device (terminal device 10) according to the present embodiment, a direction image generation that generates an image (for example, the direction image illustrated in FIG. 7) representing the direction based on the axis of rotation in the view image. It further includes a unit 115.

  Thereby, the terminal device 10 can make the user grasp which direction the moving direction of the virtual viewpoint is. In addition, by displaying the moving direction of the virtual viewpoint in the view image, the user can know in which direction the virtual viewpoint moves, so that the terminal device 10 can improve the operability of the user. it can. In addition, the user can adjust the view direction by tilting in the yaw direction or the pitch direction while viewing the moving direction of the virtual viewpoint, and thus can perform various operations on the view image only by moving the head. .

  (4) In the display control device (terminal device 10) according to the present embodiment, the viewpoint changing unit 113 moves the position of the virtual viewpoint based on the amount of change in rotation about the field of view.

  Thus, for example, when the user moves largely, the terminal device 10 can make the moving distance of the virtual viewpoint longer than when the user moves small. Further, for example, when the user operates small, the terminal device 10 can make the moving distance of the virtual viewpoint smaller than when the user largely operates. Thereby, the user can intuitively operate the movement of the virtual viewpoint according to the magnitude of the operation. Further, even when the virtual viewpoint is moved too much, or when the movement of the virtual viewpoint is insufficient, fine adjustment can be performed, so that various operations can be performed.

  (5) Further, in the display control device (terminal device 10) according to the present embodiment, the viewpoint changing unit 113 changes the moving speed of the virtual viewpoint based on the amount of change in rotation about the viewing direction.

  Thus, the terminal device 10 can move the virtual viewpoint faster when, for example, the user moves largely than when the user moves small. In addition, the terminal device 10 can, for example, move the virtual viewpoint later when the user moves smaller than when the user moves larger. Thereby, an intuitive operation can be performed according to the user's operation. Further, even if the movement of the virtual viewpoint is too fast or the movement of the virtual viewpoint is too slow, fine adjustment can be performed, so that various operations can be performed. In addition, when the moving distance of the virtual viewpoint is large, the virtual viewpoint can be moved quickly, so that the user operation can be diversified. Further, since the virtual viewpoint can be moved without an upper limit of the moving distance as compared with a case where the moving amount of the virtual viewpoint is changed based on the rotation amount of the rotation, the virtual viewpoint can be moved more freely in the virtual space.

  (6) In the display control device (terminal device 10) according to the present embodiment, a moving image generation unit that generates an image representing the moving amount of the virtual viewpoint and / or an image representing the moving speed of the virtual viewpoint in the view image. Is further provided.

  Accordingly, the terminal device 10 displays an image representing the moving amount of the virtual viewpoint or the moving speed of the virtual viewpoint in the view image, so that the moving amount of the virtual viewpoint or the moving speed of the virtual viewpoint is reduced. It is possible to make the user know how fast the moving speed is. In addition, since the user can move the virtual viewpoint while viewing the image indicating the moving amount of the virtual viewpoint or the moving speed of the virtual viewpoint, the operability of the user can be improved.

  (7) In the display control device (terminal device 10) according to the present embodiment, the viewpoint changing unit 113 determines whether the rotation around the viewing direction is a positive rotation or a negative rotation. Change the moving direction of the viewpoint.

  Thereby, the terminal device 10 can move the virtual viewpoint according to the rotation in the direction intended by the user. In addition, since the terminal device 10 moves the virtual viewpoint in a direction according to the user's operation, the user can perform a sensible operation. Further, even if the virtual viewpoint is moved too much in a certain direction, the virtual viewpoint can be moved in the opposite direction, so that the operability when moving the virtual viewpoint can be improved.

  (8) In the display control device (terminal device 10) according to the present embodiment, when the virtual viewpoint is being moved, the viewpoint changing unit 113 maintains the moving direction at the start of the movement of the virtual viewpoint.

  Thus, the moving direction of the virtual viewpoint that has started moving is maintained until the movement stops, so that the user can freely change the view direction without worrying about the moving direction of the virtual viewpoint. In addition, since the terminal device 10 can maintain the moving direction of the virtual viewpoint, the operability of the user when moving the virtual viewpoint can be improved.

  (9) In the display control device (terminal device 10) according to the present embodiment, when the virtual viewpoint is moved, the viewpoint changing unit 113 changes the moving direction of the virtual viewpoint together with the change of the view direction.

Thus, the user can change the moving direction of the virtual viewpoint to a desired direction by changing the view direction even while the virtual viewpoint is moving.
In addition, since the terminal device 10 can freely change the direction of the visual field together with the moving direction of the virtual viewpoint, the operability of the user can be improved.

[Modification]
Note that the terminal device 10 may have two modes (settings): a view direction change mode and a viewpoint movement mode. For example, the view direction change mode may be a mode in which the view direction of the view image can be changed, and the viewpoint moving mode may be a mode in which the position of the virtual viewpoint can be changed. In this case, for example, each mode can be switched by the user performing a predetermined operation. Further, in each mode, processing for changing the view image based on the sensor information may be performed. However, in each mode, even if the sensor information, that is, the movement and the inclination are the same, the change of the view image is different.
When configured to be switchable between the view direction change mode and the view direction change mode, the terminal device 10 may be configured as follows, for example.

  The display control unit 117 executes a view direction change process for providing a view direction change mode and a viewpoint moving process for providing a view point movement mode in displaying the view image. Which of the view direction changing process and the viewpoint moving process is to be executed may be specified by referring to a setting value of flag information indicating a mode, for example. This flag information may be stored in the storage unit 150.

In the view direction changing process, the display control unit 117 changes the view image displayed on the display unit 120 according to the change in the view direction by the view change unit 112.
For example, when the inclination of the terminal device 10 changes in the pitch direction in the real space, the display control unit 117 changes the view image in the virtual space in the pitch direction. Similarly, when the inclination of the terminal device 10 changes in the yaw direction in the real space, the display control unit 117 changes the view image in the virtual space in the yaw direction. On the other hand, the display control unit 117 does not change the position of the virtual viewpoint in the virtual space even when the inclination of the terminal device 10 changes in the roll direction in the real space. That is, in the view direction change control processing, the display control unit 117 restricts the movement of the position of the virtual viewpoint in the virtual space. Here, the view image when the tilt of the terminal device 10 changes in the roll direction is a view image in which the view image is also rotated according to the tilt in the roll direction. Specifically, when the inclination changes rightward by 5 degrees in the roll direction, the view image displayed on the display unit 120 is also rotated rightward by 5 degrees.
It should be noted that the field of view image does not have to be rotated according to the inclination in the roll direction even when the inclination changes in the roll direction.

In the viewpoint movement mode, the display control unit 117 changes the view image displayed on the display unit 120 in accordance with the movement of the virtual viewpoint by the viewpoint changing unit 113.
For example, when the tilt of the terminal device 10 changes in the roll direction in the real space, the display control unit 117 changes the view image from the position of the virtual viewpoint in the virtual space that has moved according to the change in the tilt in the roll direction. Let it. On the other hand, the display control unit 117 does not change the view direction in the virtual space even when the tilt of the terminal device 10 changes in the yaw direction or the pitch direction in the real space. That is, in the viewpoint moving process, the display control unit 117 restricts a change in the direction of the visual field in the virtual space. At this time, the view image may or may not be rotated according to the inclination in the roll direction.

FIG. 10 is a flowchart illustrating an example of a view change process according to a modified example of the first embodiment.
In step S100, the terminal device 10 detects the direction information of the own device. After that, the terminal device 10 executes the process of step S102.
In step S102, the terminal device 10 specifies the view direction in the virtual space based on the direction information. In addition, the terminal device 10 specifies the position of the virtual viewpoint in the virtual space based on the direction information. Thereafter, the terminal device 10 executes the process of step S104.
In step S104, the terminal device 10 generates a view image from the virtual viewpoint based on the position and the view direction of the virtual viewpoint specified in step S102. After that, the terminal device 10 executes the process of step S106.

  In step S106, the terminal device 10 determines whether to shift to the viewpoint movement mode. For example, the display control unit 117 determines whether to shift to the viewpoint movement mode according to whether or not a user operation related to mode switching has been received. Then, when the terminal device 10 receives the user operation (Step S106; YES), the terminal device 10 ends the view direction changing process illustrated in FIG. 10 and shifts to the viewpoint movement mode illustrated in FIG. That is, the terminal device 10 cancels the view direction change mode and starts the viewpoint moving process. If the terminal device 10 has not received a user operation (step S106; NO), the terminal device 10 repeats the process of step S100. That is, the terminal device 10 continues the view direction changing process without releasing the view direction change mode.

  In the process of step S106, the terminal device 10 changes the view direction change mode in response to, for example, detecting an operation of vibrating the terminal device with an acceleration sensor, or detecting an instruction operation by a user's voice with a microphone. May be canceled or the mode may be shifted to the viewpoint movement mode.

FIG. 11 is a flowchart illustrating an example of a viewpoint moving process of a virtual viewpoint according to a modification of the first embodiment.
In step S120, the terminal device 10 detects the direction information of the own device. After that, the terminal device 10 executes the process of step S122.
In step S122, the terminal device 10 specifies the view direction in the virtual space based on the direction information. In addition, the terminal device 10 specifies the position of the virtual viewpoint in the virtual space based on the direction information. Thereafter, the terminal device 10 executes the process of step S124.
In step S124, the terminal device 10 generates a view image from the virtual viewpoint based on the position and the view direction of the virtual viewpoint specified in step S122. Thereafter, the terminal device 10 executes the process of step S126.

  In step S126, the terminal device 10 determines whether to shift to the view direction change mode. For example, the display control unit 117 determines whether a user operation related to mode switching has been received. Then, when the terminal device 10 receives the user operation related to the mode switching (Step S126; YES), the terminal device 10 ends the viewpoint moving process illustrated in FIG. 11 and shifts to the view direction change mode illustrated in FIG. . That is, the terminal device 10 cancels the viewpoint movement mode and starts the view direction changing process. If the terminal device 10 has not received a user operation related to mode switching (step S126; NO), the terminal device 10 repeats the process of step S100. That is, the terminal device 10 continues the viewpoint moving process without releasing the viewpoint moving mode.

  In step S126, the terminal device 10 releases the viewpoint movement mode in response to, for example, detecting an operation of vibrating the terminal device using an acceleration sensor, or detecting an instruction operation by a user's voice using a microphone. Alternatively, the mode may be changed to the view direction change mode.

  Note that the transition to the view direction change mode is performed by inputting direction information for moving the virtual viewpoint in the viewpoint movement mode, for example, when a predetermined time has elapsed since rotation (tilt) in the roll direction is no longer detected, or The transition to the view direction change mode or the release of the viewpoint movement mode may be performed when the rotation (inclination) of the direction is equal to or less than a predetermined threshold value, or when a mode operation by a user operation is detected, or a combination thereof. .

  In the present embodiment, when the virtual viewpoint is moved in the viewpoint moving mode, or when each process of the viewpoint moving process is executed, the transition to the view direction changing mode, The processing may be restricted.

  As described above, the embodiments and the modified examples of the present invention have been described in detail with reference to the drawings. However, the specific configuration is not limited to the above-described embodiments and the modified examples, and a range not departing from the gist of the present invention. Design etc. are also included. For example, each configuration described in the above-described first embodiment can be combined with any modification or the like.

  Further, a program for realizing a part or all of the functions of the control unit 110 may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be read and executed by a computer system. May be performed by the control unit 110. Here, "to make the computer system read and execute the program recorded in the recording medium" includes installing the program in the computer system. The “computer system” here includes an OS and hardware such as peripheral devices. Further, the “computer system” may include a plurality of computer devices connected via a network including a communication line such as the Internet, a WAN, a LAN, and a dedicated line. The “computer-readable recording medium” refers to a portable medium such as a flexible disk, a magneto-optical disk, a ROM, and a CD-ROM, and a storage device such as a hard disk built in a computer system. Thus, the recording medium storing the program may be a non-transitory recording medium such as a CD-ROM. The recording medium also includes an internal or external recording medium accessible from the distribution server for distributing the program. The code of the program stored in the recording medium of the distribution server may be different from the code of the program in a format executable by the user terminal. That is, any format can be stored in the distribution server as long as it can be downloaded from the distribution server and installed in a form executable by the terminal device. The program may be divided into a plurality of programs, downloaded at different timings, and then combined at the user terminal, or a distribution server that distributes each of the divided programs may be different. Further, the “computer-readable recording medium” holds a program for a certain period of time, such as a volatile memory (RAM) in a computer system serving as a server or a client when the program is transmitted via a network. Shall be included. Further, the program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

[Appendix]
From the above description, the present invention can be grasped, for example, as follows. In order to facilitate understanding of the present invention, reference numerals in the accompanying drawings are added in parentheses for convenience, but the present invention is not limited to the illustrated embodiment.

  (Supplementary Note 1) The display control device (terminal device 10) according to one embodiment of the present invention displays a view image representing a view in a view direction from a virtual viewpoint in a virtual space as a stereoscopic image using binocular parallax. A display control device, a view change unit (view change unit 112, S220, S222, S230, S232) for changing the view direction based on own device direction information related to the own device; and the view of the own device. A viewpoint changing unit (viewpoint changing unit 113, S208, S210) for moving the virtual viewpoint based on own device rotation information about rotation about a direction, wherein the viewpoint changing unit (viewpoint changing unit 113) And moving the virtual viewpoint in a direction based on the view direction.

  According to the configuration of Supplementary Note 1, the display control device can change the direction of the field of view using the direction information or move the virtual viewpoint using the rotation information of the own device, thereby improving operability. Can be. Therefore, the display control device can diversify the operation using the HDM direction information.

  (Supplementary Note 2) Also, the viewpoint changing unit (viewpoint changing unit 113) moves the virtual viewpoint based on a rotation about the viewing direction as an axis and a predetermined threshold.

  According to the configuration of Supplementary Note 2, the display control device can prevent the virtual viewpoint from being moved by an unintended movement of the user by the predetermined threshold.

  (Supplementary Note 3) One embodiment of the present invention is the display control device (terminal device 10) according to Supplementary Note 1 or 2, wherein an image representing a direction based on the rotation axis is included in the view image. It further includes a direction image generation unit (direction image generation unit 115) for generating.

  According to the configuration of Supplementary Note 3, the display control device can indicate which direction the moving direction of the virtual viewpoint is.

  (Supplementary Note 4) One embodiment of the present invention is the display control device (the terminal device 10) according to any one of Supplementary Notes 1 to 3, wherein the viewpoint changing unit (the viewpoint changing unit 113) includes: The position of the virtual viewpoint is moved based on the amount of change in rotation about the viewing direction.

  According to the configuration of Supplementary Note 4, the display control device can move the virtual viewpoint in accordance with the amount of change in rotation about the direction of the field of view. In addition, the display control device can move the virtual viewpoint in accordance with the user's operation.

  (Supplementary Note 5) One embodiment of the present invention is the display control device (the terminal device 10) according to any one of Supplementary Notes 1 to 3, wherein the viewpoint changing unit (the viewpoint changing unit 113) includes: The moving speed of the virtual viewpoint is changed based on the amount of change in rotation about the viewing direction.

  According to the configuration of Supplementary Note 5, the display control device can change the moving speed of the virtual viewpoint in accordance with the amount of change in rotation about the field of view.

  (Supplementary Note 6) One embodiment of the present invention is the display control device (terminal device 10) according to any one of Supplementary Notes 1 to 5, wherein an image or / and / or a moving amount of the virtual viewpoint is displayed. The image processing apparatus further includes a moving image generating unit (moving image generating unit 116) that generates an image representing the moving speed of the virtual viewpoint in the view image.

  According to the configuration of Supplementary Note 6, the display control device can present the user with the current moving amount of the virtual viewpoint and / or the moving speed of the current virtual viewpoint.

  (Supplementary Note 7) One embodiment of the present invention is the display control device (terminal device 10) according to any one of Supplementary Notes 1 to 6, wherein the viewpoint change unit (viewpoint change unit 113) includes: The moving direction of the virtual viewpoint is changed according to whether the rotation about the viewing direction is a positive rotation or a negative rotation.

  According to the configuration of Supplementary Note 7, since the display control device can move the virtual viewpoint in the opposite direction even if the virtual viewpoint is moved too much in a certain direction, the operability when moving the virtual viewpoint is changed. Can be improved.

  (Supplementary Note 8) One embodiment of the present invention is the display control device (terminal device 10) according to any one of Supplementary Notes 1 to 7, wherein the viewpoint change unit (viewpoint change unit 113) includes: When the virtual viewpoint is moved, the moving direction at the start of the movement of the virtual viewpoint is maintained.

  According to the configuration of Supplementary Note 8, since the moving direction of the virtual viewpoint that has started moving is maintained until the movement stops, the user can freely change the view direction without worrying about the moving direction of the virtual viewpoint. be able to. Further, since the display control device can maintain the moving direction of the virtual viewpoint, the operability of the user when moving the virtual viewpoint can be improved.

  (Supplementary Note 9) One embodiment of the present invention is the display control device (terminal device 10) according to any one of Supplementary Notes 1 to 7, wherein the viewpoint change unit (viewpoint change unit 113) includes: When the virtual viewpoint is being moved, the moving direction of the virtual viewpoint is changed together with the change of the view direction.

According to the configuration of Supplementary Note 9, the user can change the moving direction of the virtual viewpoint to a desired direction by changing the viewing direction even while the virtual viewpoint is moving.
Further, the display control device can freely change the direction of the visual field together with the moving direction of the virtual viewpoint, so that the operability of the user can be improved.

  (Supplementary Note 10) The program according to an aspect of the present invention is a computer program of a display control device that displays a view image representing a view in a view direction from a virtual viewpoint in a virtual space as a stereoscopic image using binocular parallax. Based on own device direction information about the direction of the own device, a view changing step of changing the view direction, based on own device rotation information about rotation of the own device about the view direction, based on the view direction, A viewpoint changing step of moving the virtual viewpoint in a direction based on the virtual viewpoint.

  According to the configuration of Supplementary Note 10, since the direction of the field of view can be changed using the direction information and the virtual viewpoint can be moved using the rotation information of the own apparatus, the operability can be improved. Therefore, the operation using the HDM direction information can be diversified.

  Reference Signs List 10 terminal device, 12 display device, 13 sensor, 15 storage device, 16 communication unit, 110 control unit, 111 detection unit, 112 view change unit, 113 viewpoint change unit, 114 judgment unit 115, a direction image generation unit, 116, a moving image generation unit, 117, a display control unit, 120, a display unit, 130, a sensor input unit, 150, a storage unit

Claims (10)

A display control device that displays a view image representing a view in a view direction from a virtual viewpoint in a virtual space as a stereoscopic image using binocular parallax,
A view change unit that changes the view direction based on the own device direction information regarding the direction of the own device,
A viewpoint changing unit that moves the virtual viewpoint, based on own device rotation information related to rotation of the own device around the view direction;
With
The viewpoint changing unit moves the virtual viewpoint in a direction based on the view direction, and changes a moving speed of the virtual viewpoint based on an amount of change in rotation about the view direction.
Display control device. The viewpoint changing unit, when moving the virtual viewpoint, maintains a moving direction at the start of the movement of the virtual viewpoint,
The display control device according to claim 1 . A display control device that displays a view image representing a view in a view direction from a virtual viewpoint in a virtual space as a stereoscopic image using binocular parallax,
A view change unit that changes the view direction based on the own device direction information regarding the direction of the own device,
A viewpoint changing unit that moves the virtual viewpoint, based on own device rotation information related to rotation of the own device around the view direction;
With
The viewpoint changing unit moves the virtual viewpoint in a direction based on the view direction, and when moving the virtual viewpoint , changes the movement direction of the virtual viewpoint along with the change in the view direction.
Display control device. The viewpoint changing unit moves the virtual viewpoint based on a rotation about the viewing direction and a predetermined threshold.
The display control device according to any one of claims 1 to 3. An image representing a direction based on the axis of rotation, further comprising a direction image generating unit that generates in the view image,
The display control device according to any one of claims 1 to 4. The viewpoint changing unit moves a position of the virtual viewpoint based on a rotation change amount around the view direction,
The display control device according to any one of claims 1 to 5. A moving image generating unit that generates an image representing the moving amount of the virtual viewpoint and / or an image representing the moving speed of the virtual viewpoint in the view image;
The display control device according to any one of claims 1 to 6. The viewpoint changing unit changes the moving direction of the virtual viewpoint, depending on whether the rotation around the view direction is a positive rotation or a negative rotation.
The display control device according to any one of claims 1 to 7. As a stereoscopic image using binocular parallax, a computer of a display control device that displays a view image representing a view in a view direction from a virtual viewpoint in a virtual space,
A view change step of changing the view direction based on own apparatus direction information regarding the own apparatus direction,
A viewpoint changing step of moving the virtual viewpoint in a direction based on the view direction, based on the own device rotation information related to rotation of the own device around the view direction;
A speed changing step of changing a moving speed of the virtual viewpoint based on an amount of change in rotation about the view direction;
The program to execute. As a stereoscopic image using binocular parallax, a computer of a display control device that displays a view image representing a view in a view direction from a virtual viewpoint in a virtual space,
A view change step of changing the view direction based on own apparatus direction information regarding the own apparatus direction,
A viewpoint changing step of moving the virtual viewpoint in a direction based on the view direction, based on the own device rotation information related to rotation of the own device around the view direction;
When moving the virtual viewpoint, a direction changing step of changing the moving direction of the virtual viewpoint with the change of the view direction;
The program to execute.

Images