JP2018147309A - Display control device and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To make display of a virtual space utilizing binocular parallax easy to see.SOLUTION: A display control device comprises: a display control part that displays, on a display part, a view image showing a view from a virtual viewpoint in a virtual space as a stereoscopic image utilizing binocular parallax; an object arrangement part that arranges a first object in the virtual space and arranges a second object associated with the first object in association with the position of the first object; and an object changing part that enlarges/reduces the second object according to the distance between the virtual viewpoint and the second object.SELECTED DRAWING: Figure 3

Description

  The present invention relates to a display control device and a program.

  There is a head mounted display (HMD) that can be mounted on a user's head and can display an image in a virtual space on a display placed in front of the user's eyes (for example, Patent Document 1). For example, when stereoscopic display using binocular parallax is performed on the HMD, an object (character, item, etc.) is arranged in the virtual space, and the object is displayed with parallax according to the arrangement position. Become. The same applies to the display of text related to the placed object (for example, the character's dialogue or item description). As long as binocular parallax is used, what is displayed is placed in the virtual space. Will be.

Japanese Patent No. 5767386

  When displaying text or the like, it is preferable that the text is placed at an easy-to-see position and an easy-to-see distance, but it may not be freely arranged. For example, texts such as character lines and item descriptions arranged in the virtual space are arranged in the vicinity of the related characters and items, respectively. In particular, in stereoscopic display using binocular parallax, a sense of perspective can be strongly recognized, and therefore it is necessary to place text in the vicinity of a character or item in the depth direction from the virtual viewpoint. For this reason, the size of the text displayed varies depending on the distance between the virtual viewpoint and the character or item, and the text displayed far away may be too small to be readable. As described above, the text displayed in the virtual space may not always be easy to see.

  It is an object of some aspects of the present invention to provide a display control device and a program that can make display of a virtual space easy to see using binocular parallax.

  Another object of another aspect of the present invention is to provide a display control device and a program that can achieve the effects described in the embodiments described later.

  In order to solve the above-described problem, an aspect of the present invention provides a display control unit that displays a visual field image representing a visual field from a virtual viewpoint in a virtual space on a display unit as a stereoscopic image using binocular parallax. , An object placement unit for placing a first object in the virtual space and placing a second object associated with the first object in association with a position of the first object, the virtual viewpoint, and the second And an object changing unit that enlarges / reduces the second object according to a distance from the object.

  In addition, according to one embodiment of the present invention, as a stereoscopic image using binocular parallax, a display control unit that displays a visual field image representing a visual field from a virtual viewpoint in a virtual space on a display unit; An object placement unit that places one object and places a second object associated with the first object in association with the position of the first object, and a distance between the virtual viewpoint and the first object And an object changing unit that enlarges / reduces the second object.

  One embodiment of the present invention is a program for causing a computer to function as the display control device.

The figure which shows the usage example of HMD which concerns on 1st Embodiment. Explanatory drawing of the visual field in the virtual space which concerns on 1st Embodiment. Explanatory drawing explaining the expansion / contraction of the display object which concerns on embodiment. The figure which shows an example of the expansion / contraction of the display object (short distance) in a visual field image. The figure which shows an example of the expansion / contraction of the display object (far distance) in a visual field image. The figure which shows an example of arrangement | positioning relationship between a specific object and a display object. The figure which shows an example of the hardware constitutions of the HMD system which concerns on 1st Embodiment. The block diagram which shows an example of a function structure of the game device which concerns on 1st Embodiment. 5 is a flowchart illustrating an example of display object enlargement / reduction processing according to the first embodiment. 7 is a flowchart illustrating an example of display object scaling processing when the relative distance changes according to the first embodiment. 12 is a flowchart illustrating an example of display object enlargement / reduction processing according to the second embodiment. The flowchart which shows an example of the expansion / contraction process of a display object when the relative distance which concerns on 2nd Embodiment changes. Explanatory drawing explaining the arrangement | positioning change process of the display object which concerns on 3rd Embodiment. The figure which shows an example in the case of a some display object arranging in the up-down direction which concerns on 4th Embodiment. The figure which shows an example in case a some display object arranges in the left-right direction which concerns on 4th Embodiment. The figure which shows an example of the display object with a large horizontal width which concerns on 5th Embodiment.

Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[First embodiment]
A first embodiment of the present invention will be described.
In the present embodiment, a display in an HMD (Head Mounted Display) capable of stereoscopically viewing a 3D (three-dimensional) virtual space will be described as an example. For example, the HMD is worn on the user's head and a view image representing a view from a virtual viewpoint in a virtual space may be referred to as binocular parallax (hereinafter simply referred to as “parallax”) between the right eye and the left eye. ) Can be displayed as a stereoscopic image. The virtual viewpoint is a viewpoint corresponding to the position of the user's eyes in the virtual space. For example, when the user plays a game using the virtual space, the viewpoint of the user (player) or the user (player) character is shown. . A character is an object that can be displayed and represents, for example, a person, an animal, a monster, a robot, an object (for example, a vehicle) or the like appearing in a game. For example, the character becomes a user's operation target or moves based on the user's operation or game processing. Further, the HMD is equipped with a sensor for detecting the movement and tilt of the HMD such as a gyro sensor, detects a change in the head and tilt of the user's head, and the virtual space according to the change. The view image of is displayed. For example, the visual field image displayed on the HMD changes to a right visual field image in the virtual space when the user's head is directed rightward, and changes to an upward visual image in the virtual space when the user heads upward. It is possible to give the user an immersive feeling as if they were on the spot.

  FIG. 1 is a diagram illustrating a usage example of the HMD according to the present embodiment. This figure shows a state in which the HMD 10 is worn on the user's head. Here, the vertical direction in which the user stands upright is the Z axis, the axis is orthogonal to the Z axis, and the direction orthogonal to the display screen of the HMD 10 from the user is the X axis, and the axis is orthogonal to the Z axis and the X axis. Is the Y axis. In the display screen of the HMD 10, the vertical direction corresponds to the Z-axis direction, the horizontal direction corresponds to the Y-axis direction, and the depth direction corresponds to the X-axis direction.

  A change in the rotation direction about the Z axis is also called a change in the yaw direction (or left and right direction), and a change in the rotation direction about the Y axis is called a change in the pitch direction (or up and down direction). A change in the rotation direction about the X axis is also referred to as a change in the roll direction.

  FIG. 2 is an explanatory diagram of the field of view in the virtual space according to the present embodiment. In this figure, when the virtual viewpoint K is the intersection (origin) of the X axis, Y axis, and Z axis, and the view direction from the virtual viewpoint K (the center direction of the view) is the X axis direction, the view from the virtual viewpoint K The range of the field of view image (that is, the field of view) that represents the yaw angle α (the inner angle between the broken line a and the broken line b and the inner angle between the broken line c and the broken line d) and the pitch angle centered on the field of view direction (X-axis direction). This is a range determined by β (inner angle between the broken line a and the broken line d and inner angle between the broken line b and the broken line c). Here, the yaw angle α and the pitch angle β are angles set in advance as the angle of view of the visual field image of the virtual space displayed on the HMD system 1. For example, the field of view at the point x1 on the X axis is a quadrangle whose vertexes are intersections a1, b1, c1, and d1 of the surface L1 orthogonal to the X axis at the point x1 and the broken lines a, b, c, and d indicating the field of view. It will be enclosed.

  That is, the range inside the yaw angle α and the pitch angle β centered on the visual field direction (X-axis direction) is the visual field, and among the objects disposed in the virtual space, these are disposed in the visual field. The displayed object, background, etc. are stereoscopically displayed as a view field image. When the user's head changes in the pitch direction or the yaw direction, the visual field direction changes from the X-axis direction to the pitch direction or the yaw direction according to the change, and the visual field also changes in the pitch direction or the yaw direction. When the user's head changes in the roll direction, the view direction rotates in the roll direction while the view direction remains in the X-axis direction.

  The objects arranged in the virtual space are, for example, structures that constitute the virtual space, characters and items that appear in the virtual space, and the like. In the virtual space, an object including display information related to text (characters) (hereinafter also referred to as “display object”) is also arranged. The display information related to the text (characters) may be text information or image information representing the text. For example, the display object includes display information related to the text of an explanatory note such as a character, a structure, or an item, and display information related to a text indicating the content of the character's speech (utterance). The display object itself may be display information representing text.

  For example, if it is a display object of a character's dialogue, it is arranged in the vicinity of the character, and if it is a display object of an item description, it is arranged in the vicinity of the item. This is to make it easy to understand the relationship between the character and the dialogue of the character and the relationship between the item and the description of the item. If the display object of the character's dialogue is placed at different distances regardless of the distance between the virtual viewpoint and the character, the character that is the main subject of the dialogue becomes difficult to understand.

  Therefore, the farther the position where the character or item is located, the farther away from the virtual viewpoint, the farther away the display object is placed, and the closer the position where the character or item is located, the closer to the virtual viewpoint, the closer to the virtual viewpoint. It is desirable that the display objects are also arranged nearby. On the other hand, for a user, when the display object displayed in the view field image is small, the visibility is lowered, and the content of the dialogue and the content of the description may not be read. In addition, the visibility decreases even if the display object becomes too large. Therefore, in this embodiment, visibility is ensured by enlarging or reducing the display object in accordance with the position where the display object (that is, display of text or the like) is arranged.

  FIG. 3 is an explanatory diagram for explaining the scaling of the display object according to the present embodiment. In the figure, the display object H is arranged at a distance of 40 cm from the virtual viewpoint K in the left figure, and the display object H is arranged at a distance of 100 cm from the virtual viewpoint K in the right figure. The virtual viewpoint is a viewpoint corresponding to the position of the user's eye in the virtual space as described above, but may be the position of the left eye, the position of the right eye, or a position based on the distance between both eyes. Alternatively, the center of the left eye and the right eye may be used. Hereinafter, the virtual viewpoint is described as a viewpoint corresponding to the center position of the left eye and the right eye.

  The size of the display object H is changed according to the distance from the virtual viewpoint K (for example, in proportion), and the distance of 100 cm is enlarged with respect to the distance of 40 cm. In the example shown in this figure, when the line of sight from the virtual viewpoint K is centered on the display object H, a range of 15 degrees to the left and right is set as a range of a size that is easy to see the display object H. The display object H is scaled according to this range according to the distance from the virtual viewpoint K. Thus, if the display object H is distant, the display object is enlarged, and if the display object H is close, the display is reduced, and the display object H can be displayed in an easy-to-see size regardless of whether the display object is near or far. . The “apparent size” refers to the display size of the display object displayed on the display unit 11.

  Here, an example in which the range of 15 degrees on the left and right is set as a range of a size that is easy to see the display object H is shown, but is not limited to 15 degrees on the left and right, depending on the text amount of the display object, etc. It can be set arbitrarily. In addition, the change in scaling of the display object may change linearly according to the distance, or may change to a non-linear type. In addition, the change in scaling of the display object may change continuously or may change stepwise.

  As described above, in this embodiment, the enlargement / reduction process is performed to enlarge / reduce the display object based on the distance from the virtual viewpoint. The display object enlargement / reduction process is performed by a plurality of objects arranged in the virtual space. It is a display object associated with a specific object (specific object) among the objects. The specific object is a preset object, such as a character (person, friend, acquaintance, enemy character, etc.), an item (possession, product, weapon, etc.), a structure, or the like. The display object associated with the specific object is, for example, a character dialogue, an explanation of an item or a structure, and the like. That is, a display object that is associated with a specific object and that is disposed in association with the position of the specific object (for example, in the vicinity) is a target of the enlargement / reduction process.

  The specific object may be an object set in advance by a user operation. For example, the specific object may be an object locked on by a user operation, an object touched, or the like.

  4 and 5 are diagrams showing an example of the scaling of the display object in the actual view image, in which the view image for the left eye is arranged on the left side and the view image for the right eye is shown on the right side. In the example shown in FIG. 4, the specific object T (here, a character) is arranged at a distance of 70 cm from the virtual viewpoint, and the display object H associated with the specific object T is arranged at a distance of 40 cm from the virtual viewpoint. Has been. On the other hand, in the example shown in FIG. 5, the specific object T (here, the character) is disposed at a distance of 100 cm from the virtual viewpoint, and the display object H associated with the specific object T is at a distance of 70 cm from the virtual viewpoint. Is arranged.

  In FIGS. 4 and 5, since the distance from the virtual viewpoint of the specific object T is different, the size of the specific object T displayed in each view image is different. Specifically, the specific object T is displayed smaller because the distance from the virtual viewpoint is farther in FIG. 5 than in FIG. On the other hand, the display object H is scaled according to the distance from the virtual viewpoint. Specifically, the display object H is enlarged as the distance from the virtual viewpoint increases, and the display object H is reduced as the distance from the virtual viewpoint is shorter. Therefore, the size of the display object H displayed in the view field image is not changed between FIG. 4 and FIG.

  Note that the illustrated display object H is for explaining the comparison of the relative size of the display object H according to the distance, and the content of text actually displayed, the number of characters, the number of lines, the type, color, and size of the font. The position, angle, etc., can be arbitrarily set. Further, the display object H shown in the figure is arranged with reference to substantially the center of the field-of-view image. However, the display object H is not limited to this, and may be another position depending on the position of the specific object. The position may move in accordance with the movement of.

  In this way, the display object H is arranged in the vicinity in association with the distance from the virtual viewpoint of the specific object T, but the display size (apparent size) in the view field image is independent of the distance from the virtual viewpoint. does not change. Therefore, even if the display object H is near or far from the virtual viewpoint, the user can easily understand the relationship between the display object H and the specific object T, and the visibility of the display object H is ensured. The

  In the example shown in FIG. 4 and FIG. 5, an example in which the size (apparent size) of the display object H displayed in the view image does not change even when the distance from the virtual viewpoint is different is shown. It is not limited to an aspect that does not change, and there may be some change. For example, the display object H disposed at a distance of 70 cm may be enlarged as much as possible, rather than the display object H disposed at a distance of 40 cm from the virtual viewpoint. The visibility of the object H can be improved.

  Moreover, in the example shown in FIG.4 and FIG.5, the specific object T and the display object H are arrange | positioned 30 cm apart. This is to prevent the display object H from receiving interference even when the specific object T moves. Here, the arrangement relationship between the specific object T and the display object H will be described.

  FIG. 6 is a diagram illustrating an example of an arrangement relationship between a specific object and a display object in the virtual space. In the example shown in the figure, the virtual viewpoint K and the specific object T are arranged at a certain distance (for example, 30 cm) from the specific object T. Thereby, it can suppress that the specific object T and the display object H overlap with the movement of the specific object T, and become difficult to see.

  In the example shown in FIG. 6, an example is shown in which the display object H is arranged around the line connecting the virtual viewpoint K and the specific object T. However, the display object H is horizontally and vertically from the center. You may arrange | position in the position shifted to.

Hereinafter, the configuration of the HMD system according to the present embodiment will be described in detail.
[Configuration of HMD system]
FIG. 7 is a diagram illustrating an example of a hardware configuration of the HMD system according to the present embodiment. The illustrated HMD system 1 includes an HMD 10 and a game device 20 that causes the HMD 10 to display a game image.

  The HMD 10 includes a display unit 11, a sensor 12, a communication unit 13, and a CPU (Central Processing Unit) 14. The display unit 11 is a display that displays information such as images and text, and includes, for example, a liquid crystal display panel, an organic EL (ElectroLuminescence) display panel, and the like. For example, the display unit 11 uses a binocular parallax (a right-eye image and a left-eye image) as a view field image from a virtual viewpoint (a user's eye wearing an HMD) in the virtual space. Is displayed. The display unit 11 displays various objects arranged in the virtual space together with the view field image. The various objects include the specific object and the display object described above.

  The sensor 12 is a sensor that detects information related to the direction of the HMD 10. For example, the sensor 12 is a gyro sensor that detects the angle, angular velocity, angular acceleration, and the like of an object. The sensor 12 may be a sensor that detects a change in direction, or a sensor that detects the direction itself. For example, the sensor 12 is not limited to a gyro sensor, and may be an acceleration sensor, a tilt sensor, a geomagnetic sensor, or the like. The communication unit 13 communicates with the game apparatus 20 by wire or wireless. CPU14 functions as a control center which controls each part with which HMD10 is provided. For example, the CPU 14 acquires image data of a game image (for example, a view field image) transmitted from the game apparatus 20 via the communication unit 13 and causes the display unit 11 to display the image data. Further, the CPU 14 transmits information related to the direction of the HMD 10 to the game apparatus 20 based on the detection result of the sensor 12.

  Note that the hardware configurations of the HMD 10 described above are connected to each other via a bus so that they can communicate with each other.

  The game device 20 is a computer device that executes a game process of a game using a virtual space, and is a home game machine, a personal computer, an arcade game machine installed in a game center or the like, a mobile phone such as a smartphone or a feature phone. A personal digital assistant (PDA), a tablet PC, or the like can be applied. In the present embodiment, the game apparatus 20 will be described as a consumer game machine.

  The illustrated game device 20 includes an input unit 21, a speaker 22, a storage unit 23, a communication unit 24, and a CPU 25. The input unit 21 is an input device through which various instructions are input by a user operation. For example, the input unit 21 may be another input device such as a controller, a keyboard, a mouse, a touch pad, or a microphone in which various instructions are input by voice. The speaker 22 is an output device that outputs sound based on an audio signal. In addition, not only the speaker 22 but an audio output terminal that outputs an audio signal to an external speaker, a headphone, an earphone, or the like may be used. The speaker 22 may be provided on the HMD 10 side.

  The storage unit 23 includes, for example, HDD (Hard Disk Drive), SSD (Solid State Drive), EEPROM (Electrically Erasable Programmable Read-Only Memory), ROM (Read-Only Memory, etc.). It stores virtual space data (image data) of a virtual space where various objects are arranged, game programs and data using the virtual space, and the like. The communication unit 24 communicates with the HMD 10 by wire or wireless.

  The CPU 25 functions as a control center that controls each unit included in the game apparatus 20. For example, the CPU 25 executes a game process by executing a game program stored in the storage unit 23 and functions as a control unit that controls display of a game image to be displayed on the HMD 10.

  Note that the respective hardware configurations included in the above-described game device 20 are connected to each other via a bus so that they can communicate with each other.

[Function configuration]
FIG. 8 is a block diagram illustrating an example of a functional configuration of the game apparatus 20 according to the present embodiment. The game apparatus 20 includes a control unit 250 as a functional configuration realized by the CPU 25 executing a program stored in the storage unit 23. The control unit 250 includes a detection unit 251, an object placement unit 252, an object change unit 253, and a display control unit 254, and is at least one of display control devices that control display of a game image (for example, a view field image). It functions as a part. Here, a function related to the enlargement / reduction process of the display object in the field-of-view image displayed on the HMD 10 as a game image will be described.

  The detection unit 251 detects information related to the direction of the HMD 10 based on the detection result of the sensor 12 acquired from the HMD 10 via the communication unit 24. Further, the detection unit 251 detects the visual field direction from the virtual viewpoint in the virtual space based on the information regarding the direction of the HMD 10. For example, the detection unit 251 detects the viewing direction or the change in the viewing direction based on the information indicating the direction of the HMD 10 or the change in the direction. Note that the detection unit 251 may detect information related to the change speed of the visual field direction based on information related to the change speed of the direction of the HMD 10.

  The object placement unit 252 places various objects in the virtual space based on the virtual space data in the storage unit 23. For example, the object placement unit 252 places a specific object (for example, a character) in the virtual space, and displays a display object (for example, the text of the dialogue of the character) associated with the specific object at the position of the specific object. It arranges in association (for example, in the vicinity with a fixed interval). For example, when the specific object is moved, the object placement unit 252 also moves the display object associated with the specific object according to the movement of the specific object.

  The object changing unit 253 enlarges / reduces the display object according to the distance between the virtual viewpoint and the display object. Specifically, the object changing unit 253 enlarges the display object as the distance between the virtual viewpoint and the display object increases, and reduces the display object as the distance decreases. For example, the object changing unit 253 enlarges or reduces the display object so that the apparent size from the virtual viewpoint is the same regardless of whether the distance between the virtual viewpoint and the display object is long or short.

  For example, the object changing unit 253 enlarges / reduces the display object so as to be in the range of 15 degrees left and right when the line of sight from the virtual viewpoint is centered on the display object (see FIG. 3). Note that the ratio of enlargement / reduction when the object changing unit 253 enlarges / reduces the display object may be arbitrarily set. For example, the display object at a reference distance (for example, 50 cm from the virtual viewpoint) is set to 1 × An enlargement ratio and a reduction ratio may be set according to a difference from a reference distance.

  The object changing unit 253 may detect the distance between the virtual viewpoint and the display object based on the coordinate position of the virtual viewpoint and the coordinate position of the display object in the virtual space. You may detect based on the corresponding convergence angle.

  The display control unit 254 generates a view image (left-eye image, right-eye image) representing a view from the virtual viewpoint in the view space according to the detection result of the detection unit 251, and uses binocular parallax. A stereoscopic image is displayed on the display unit 11 of the HMD 10. For example, the display control unit 254 generates a visual field image so that a specific object and a display object arranged in the virtual space are displayed with a parallax corresponding to each arrangement position. In addition, the display control unit 254 causes the display unit 11 of the HMD 10 to display the visual field image by transmitting the generated image data of the visual field image to the HMD 10 via the communication unit 24. Hereinafter, the display control unit 254 transmits the view image via the communication unit 24 to display the view image on the display unit 11 of the HMD 10, and the display control unit 254 displays the view image on the display unit 11. Also described.

[Operation of display object scaling]
Next, the display object enlargement / reduction operation performed by the control unit 250 will be described.
FIG. 9 is a flowchart showing an example of the display object scaling process according to the present embodiment.

  First, the control unit 250 arranges a specific object at a predetermined position in the virtual space (step S100). Next, the control unit 250 detects the distance between the position where the display object associated with the specific object is arranged and the virtual viewpoint (step S102). Subsequently, the control unit 250 determines the size of the display object according to the detected distance. Specifically, the control unit 250 enlarges the display object as the detected distance is longer, and reduces the display object as it is closer (step S104). Then, the control unit 250 arranges the display object having the determined size in association with the specific object (step S106).

  Next, with reference to FIG. 10, the operation of the display object scaling process when the relative distance between the virtual viewpoint and the display object changes will be described. The case where the relative distance between the virtual viewpoint and the display object changes can occur when the virtual viewpoint moves, the specific object moves, or both.

  FIG. 10 is a flowchart illustrating an example of display object scaling processing when the relative distance changes according to the present embodiment. The controller 250 determines whether or not the relative distance between the virtual viewpoint and the specific object has changed (step S110). When it is determined that the relative distance has not changed (NO), the control unit 250 executes the process of step S110 again.

  On the other hand, when it is determined that the relative distance has changed (YES), the control unit 250 detects the distance between the virtual viewpoint and the display object (step S112). Then, the control unit 250 enlarges or reduces the display object according to the detected distance (step S114).

[Summary of First Embodiment]
As described above, the game apparatus 20 (an example of a display control apparatus) according to the present embodiment includes the object placement unit 252, the object change unit 253, and the display control unit 254. The display control unit 254 causes the display unit 11 to display a view field image representing a view from a virtual viewpoint in the virtual space as a stereoscopic image using binocular parallax. The object arrangement unit 252 arranges a specific object (an example of a first object) in the virtual space, and arranges a display object (an example of a second object) associated with the specific object in association with the position of the specific object. . The object changing unit 253 enlarges / reduces the display object according to the distance between the virtual viewpoint and the display object.

  Thereby, since the game device 20 changes the size of the display object according to the distance between the virtual viewpoint and the display object, the display object displayed in the view field image can be easily seen. For example, since the game apparatus 20 can display a display object farther from the virtual viewpoint and enlarge a display object closer to the virtual viewpoint, the game apparatus 20 can display the display object in a viewable image in an easy-to-see manner. That is, the game apparatus 20 can make the display of the virtual space using binocular parallax easy to see.

  For example, the display object (an example of the second object) includes display information related to text (characters). As a result, the game device 20 can display the text (characters) farther from the virtual viewpoint, and the text (characters) closer to the virtual viewpoint can be reduced and displayed. It can be displayed easily.

  The display object (an example of the second object) may be an object representing text (character). As a result, the game device 20 can display the text (characters) farther from the virtual viewpoint, and the text (characters) closer to the virtual viewpoint can be reduced and displayed. It can be displayed easily.

  In addition, the object placement unit 252 places the display object (an example of the second object) at a certain distance from the specific object (an example of the first object). Thereby, game device 20 can control that a specific object and a display object overlap and become difficult to see by movement of a specific object.

  In this embodiment, the display object (for example, text) is enlarged as the distance from the virtual viewpoint is increased, and an upper limit (for example, the maximum value of the size of the text) is set for the enlargement. May be. When the specific object is away from the virtual viewpoint by a certain distance or more, the balance between the size of the specific object and the display object is remarkably lost, so that the display may be uncomfortable. Therefore, by providing an upper limit for the enlargement of the display object, it is possible to suppress a state in which the balance between the size of the specific object and the display object is significantly lost.

[Second Embodiment]
Next, a second embodiment of the present invention will be described.
Since the basic configuration of the HMD system 1 according to the present embodiment is the same as the configurations illustrated in FIGS. 7 and 8, characteristic processing in the present embodiment will be described. In the first embodiment, the example in which the display object scaling process is executed according to the distance between the virtual viewpoint and the display object has been described. However, for example, since the display object is arranged in the vicinity of the specific object, the virtual viewpoint The distance between the display object and the display object corresponds to the distance between the virtual viewpoint and the specific object. Therefore, in the present embodiment, an example in which the display object scaling process is executed according to the distance between the virtual viewpoint and the specific object will be described. Note that the specific object is a specific object associated with a display object that executes the scaling process.

  For example, the object changing unit 253 enlarges or reduces the display object according to the distance between the virtual viewpoint and the specific object. Specifically, the object changing unit 253 enlarges the display object as the distance between the virtual viewpoint and the specific object increases, and reduces the display object as the distance decreases. For example, the object changing unit 253 enlarges or reduces the display object so that the apparent size from the virtual viewpoint is the same regardless of whether the distance between the virtual viewpoint and the specific object is long or short.

  FIG. 11 is a flowchart showing an example of display object scaling processing according to the present embodiment.

  First, the control unit 250 arranges a specific object at a predetermined position in the virtual space (step S200). Next, the control unit 250 detects the distance between the arranged specific object and the virtual viewpoint (step S202). And the control part 250 determines the magnitude | size of the display object linked | related with the specific object according to the detected distance. Specifically, the control unit 250 enlarges the display object as the detected distance is longer, and reduces the display object as it is closer (step S204). Then, the control unit 250 arranges the display object having the determined size in association with the specific object (step S206).

  Next, with reference to FIG. 12, the operation of the scaling process of the display object when the relative distance between the virtual viewpoint and the specific object changes will be described. The case where the relative distance between the virtual viewpoint and the specific object changes may occur when the virtual viewpoint moves, the specific object moves, or both.

  FIG. 12 is a flowchart illustrating an example of display object scaling processing when the relative distance changes according to the present embodiment. The controller 250 determines whether or not the relative distance between the virtual viewpoint and the specific object has changed (step S210). When it is determined that the relative distance has not changed (NO), the control unit 250 executes the process of step S210 again.

  On the other hand, when it is determined that the relative distance has changed (YES), the control unit 250 detects the distance between the virtual viewpoint and the specific object (step S212). Then, the control unit 250 enlarges or reduces the display object associated with the specific object according to the detected distance (step S214).

[Summary of Second Embodiment]
As described above, in the game device 20 (an example of a display control device) according to the present embodiment, the object changing unit 253 determines the specific according to the distance between the virtual viewpoint and the specific object (an example of the first object). A display object (an example of a second object) associated with the object is enlarged or reduced.

  Thereby, the game device 20 changes the size of the display object associated with the specific object according to the distance between the virtual viewpoint and the specific object, so that the display object displayed in the view field image can be easily seen. it can. For example, according to the distance between the virtual viewpoint and the specific object, the game device 20 can enlarge the display object associated with the specific object as the distance from the virtual viewpoint increases, and reduce the display object as the distance from the virtual viewpoint decreases. Therefore, the display object can be displayed in an easy-to-view manner in the view field image. That is, the game apparatus 20 can make the display of the virtual space using binocular parallax easy to see.

[Third Embodiment]
Next, a third embodiment of the present invention will be described.
Since the basic configuration of the HMD system 1 according to the present embodiment is the same as the configurations illustrated in FIGS. 7 and 8, characteristic processing in the present embodiment will be described. In the present embodiment, an arrangement change process for changing the arrangement position of a display object when the positional relationship other than the distance changes due to the movement of the virtual viewpoint or the specific object will be described.

  When the virtual viewpoint or the specific object moves in the virtual space, the object placement unit 252 according to the present embodiment displays the display object (second object) according to the positional relationship between the virtual viewpoint and the specific object (an example of the first object). For example) is determined. For example, when the virtual viewpoint or the specific object moves in the virtual space, the object arrangement unit 252 changes the arrangement position of the display object so that the display object is arranged between the virtual viewpoint and the specific object.

  FIG. 13 is an explanatory diagram illustrating the display object arrangement changing process according to the present embodiment. In this figure, as described with reference to FIG. 6, the case where the display object H is arranged at a certain distance (for example, 30 cm) from the specific object T is taken as an example. In the example shown in the figure, the arrangement position of the display object H when the virtual viewpoint K moves from the virtual viewpoint K1 to the virtual viewpoint K2 is shown. The arrangement is when the display object H1 is the virtual viewpoint K1, and the display object H2 is This is the arrangement at the virtual viewpoint K2.

  As shown in FIG. 13, at the virtual viewpoint K1, the display object H1 is arranged between the virtual viewpoint K1 and the specific object T. On the other hand, at the virtual viewpoint K2, the display object H2 is arranged between the virtual viewpoint K2 and the specific object T. That is, regardless of whether the specific object T is viewed from the virtual viewpoint K1 or the virtual viewpoint K2, the display object H is arranged between the specific object T and the virtual viewpoint K (K1, K2). Is done. The same applies when the specific object T moves. That is, even if the virtual viewpoint K or the specific object T moves in the virtual space, the display object H is placed at a certain distance (for example, 30 cm) around the outer periphery of the specific object T so that a position that is easy to see is always secured. Will move.

  As described above, when the virtual viewpoint or the specific object moves in the virtual space, the game apparatus 20 displays the display object (an example of the second object) according to the positional relationship between the virtual viewpoint and the specific object (an example of the first object). ) Is determined. Thus, the game apparatus 20 can always display the display object at a position that is easy to see even when the virtual viewpoint or the specific object moves.

[Fourth Embodiment]
Next, a fourth embodiment of the present invention will be described.
Since the basic configuration of the HMD system 1 according to the present embodiment is the same as the configurations illustrated in FIGS. 7 and 8, characteristic processing in the present embodiment will be described. In the present embodiment, an arrangement example in the case of arranging a plurality of display objects side by side and a shape of the display object will be described.

First, an arrangement example when arranging a plurality of display objects side by side will be described.
For example, when arranging a plurality of display objects side by side, each display object may be arranged at an equal distance from the virtual viewpoint. In short, the display object may be tilted in the rotation direction about the Y axis or the Z axis in accordance with the position of the display object so that the display object is arranged on the spherical surface with the virtual viewpoint as the center.

  When a plurality of display objects (an example of a second object) are associated with a specific object (an example of a first object), the object placement unit 252 according to the present embodiment places the plurality of display objects equidistant from the virtual viewpoint. To place. Further, the object placement unit 252 places the plurality of display objects in a direction facing the virtual viewpoint.

  FIG. 14 is a diagram illustrating an example where a plurality of display objects are arranged in the vertical direction (pitch direction). Here, four display objects HA (HA1, HA2, HA3, HA4) associated with the specific object T are arranged side by side in the vertical direction. The display objects HA1, HA2, HA3, and HA4 are tilted in the rotation direction around the Y axis as the vertical positions of the display objects HA1, HA2, HA3, and HA4 are shifted upward or downward with respect to the virtual viewpoint K, and the display objects HA1, HA2, and HA3. , HA4 are arranged at the same distance and facing the virtual viewpoint.

  FIG. 15 is a diagram illustrating an example in which a plurality of display objects are arranged in the left-right direction (yaw direction). Here, three display objects HB (HB1, HB2, HB3) associated with the specific object T are arranged side by side in the left-right direction. The display objects HB1, HB2, and HB3 are tilted in the rotation direction about the Z-axis as the horizontal positions of the display objects HB1, HB2, and HB3 are shifted to the left or right with respect to the virtual viewpoint K. Are arranged at the same distance from the virtual viewpoint.

  As described above, when a plurality of display objects (an example of the second object) are associated with the specific object (an example of the first object), the game apparatus 20 arranges the plurality of display objects at equal distances from the virtual viewpoint. To do. Further, the object placement unit 252 places the plurality of display objects in a direction facing the virtual viewpoint. Thereby, the game apparatus 20 can display the display object in an easy-to-see manner because the display object is arranged equidistantly from the user's viewpoint regardless of the arrangement position.

  Note that the above display object arrangement example is not limited to the case where a plurality of display objects are arranged side by side, but can be similarly applied to the case where one display object is arranged or the arrangement position of a display object is changed. For example, even when one display object is arranged, the object arrangement unit 252 may arrange the display object at an equal distance from the virtual viewpoint when the arrangement position is shifted in the vertical direction or the horizontal direction. Good.

  Next, the shape of the display object will be described. The display object may have a large horizontal width (height in the case of vertical writing) such as a long sentence. In that case, the end of the display object may be difficult to see. One of the causes is that the distance from the virtual viewpoint changes between the center and the edge of the display object. Therefore, when the display object becomes large, the object placement unit 252 displays the display object in a shape that follows a spherical shape centered on the virtual viewpoint so that there is no difference in the distance from the virtual viewpoint at the center and the edge of the display object. You may arrange.

  FIG. 16 is a diagram illustrating an example of a display object having a large horizontal width. The illustrated display object HC1 has a shape along a straight line F1 (a straight line parallel to the Y axis) in the left-right direction, and the distance from the virtual viewpoint K is different at the center and the end, which may be difficult to see. On the other hand, the display object HC2 is arranged in a shape having a plane including a line segment F2 in the left-right direction that is equidistant from the virtual viewpoint K (that is, a shape that follows a spherical shape centered on the virtual viewpoint K). The display object is easy to see.

  In the case of a display object having a large height, it has a shape having a surface including a line segment in the vertical direction that is equidistant from the virtual viewpoint K (ie, a shape along a spherical shape with the virtual viewpoint K as the center). Be placed.

  Thus, the object arrangement unit 252 arranges the display object (an example of the second object) in a shape having a plane including a line segment that is equidistant from the virtual viewpoint. Thereby, the game apparatus 20 can display the center part and the edge in an easy-to-see manner even for a display object having a large horizontal width (height in the case of vertical writing) such as a long sentence.

[Fifth Embodiment]
Next, a fifth embodiment of the present invention will be described.
Since the basic configuration of the HMD system 1 according to the present embodiment is the same as the configurations illustrated in FIGS. 7 and 8, characteristic processing in the present embodiment will be described. The display objects described in the first to fourth embodiments may be switched between display / non-display depending on the line-of-sight direction with respect to the specific object.

  Here, the line-of-sight direction is a direction indicating the point of the line of sight from the virtual viewpoint, and may be a direction from the virtual viewpoint to the center of the field of view or a direction from the virtual viewpoint to the vicinity of the center of the field of view. Moreover, when it has the function to detect a gaze direction (for example, eye tracking) by detecting the direction of a user's eyeball, you may use the gaze direction based on the detection result.

  For example, the object placement unit 252 switches whether or not a display object (an example of a second object) is displayed on the display unit 11 of the HMD 10 by the display control unit 254 based on the viewing direction from the virtual viewpoint. For example, the object placement unit 252 may display the display object only when the line-of-sight direction from the virtual viewpoint approaches the specific object within a preset distance. Thereby, the game device 20 hides the display object associated with the specific object that the user is not paying attention to, so that the display object associated with the specific object that the user pays attention to can be displayed easily. .

  In addition, when switching display / non-display of a display object, the object placement unit 252 may be a process of switching whether or not to place a display object, or a process of changing the transparency of a display object to be placed.

[Modification]
The embodiment of the present invention has been described in detail with reference to the drawings. However, the specific configuration is not limited to the above-described embodiment, and includes a design and the like within a scope not departing from the gist of the present invention. For example, the configurations described in the above first to fifth embodiments can be arbitrarily combined.

  Moreover, although the said embodiment demonstrated the example in which texts, such as a dialog and a description, are displayed on a display object, it is not restricted to a dialog and a description. In the above-described embodiment, an example in which the display object is a text display has been described. However, the display object is not limited to the text display, but a display including a mark, a symbol, a figure, a table, or the like associated with a specific character. There may be.

  In the above embodiment, the configuration example in which the HMD 10 can be mounted on the user's head has been described. However, the HMD 10 is not limited to a configuration having a shape that can be completely mounted on the head. For example, the HMD 10 is a device that allows a user to grasp a visual field image and various objects in a virtual space while holding the positional relationship between the user's eyes and the display unit 11 in a predetermined relationship by grasping in front of the eyes. For example, it may be a shape like binoculars).

  The HMD 10 may be used as an HMD by attaching a terminal device such as a smartphone to the attachment. In this case, the display unit and the sensor of the terminal device function as the display unit 11 and the sensor 12 of the HMD 10, and the CPU of the terminal device functions as the CPU 25 of the game device 20. That is, the detection unit 251, the object placement unit 252, the object change unit 253, the display control unit 254, and the virtual space data of the storage unit 23 of the game device 20 included in the control unit 250 of the game device 20 are the above-described terminals. The device is equipped.

  Moreover, although the said embodiment demonstrated to the example the game using virtual space, it is not restricted to this. For example, any application that uses a virtual space is not limited to a game. Further, the virtual space in which the object is arranged may be based on the real space. For example, when the user moves in the real space, a view scene corresponding to the user's viewpoint in the real space may be displayed as a view image while being captured in real time. In this case, the specific object may be added to the view image based on the real space, or may be recognized from the real object in the real space.

  Moreover, although the said embodiment demonstrated the example which changes a visual field direction according to the direction of HMD10, it is not restricted to this, A visual field may be fixed. Even when the field of view is fixed, the display object scaling process may be performed based on the distance between the virtual viewpoint and the specific object or the distance between the virtual viewpoint and the display object.

  Further, the program for realizing the function of the control unit 250 described above is recorded on a computer-readable recording medium, and the program recorded on the recording medium is read into the computer system and executed as the control unit 250. You may perform the process of. Here, “loading and executing a program recorded on a recording medium into a computer system” includes installing the program in the computer system. The “computer system” here includes an OS and hardware such as peripheral devices. Further, the “computer system” may include a plurality of computer devices connected via a network including a communication line such as the Internet, WAN, LAN, and dedicated line. The “computer-readable recording medium” refers to a storage device such as a flexible medium, a magneto-optical disk, a portable medium such as a ROM and a CD-ROM, and a hard disk incorporated in a computer system. As described above, the recording medium storing the program may be a non-transitory recording medium such as a CD-ROM. The recording medium also includes a recording medium provided inside or outside that is accessible from the distribution server in order to distribute the program. The code of the program stored in the recording medium of the distribution server may be different from the code of the program that can be executed by the control unit 250. That is, the format stored in the distribution server is not limited as long as it can be downloaded from the distribution server and installed in a form that can be executed by the control unit 250. Note that the program may be divided into a plurality of parts and downloaded at different timings and then combined in the control unit 250, or the distribution server that distributes each of the divided programs may be different. Furthermore, the “computer-readable recording medium” holds a program for a certain period of time, such as a volatile memory (RAM) inside a computer system that becomes a server or a client when the program is transmitted via a network. Including things. The program may be for realizing a part of the functions described above. Furthermore, what can implement | achieve the function mentioned above in combination with the program already recorded on the computer system, and what is called a difference file (difference program) may be sufficient.

  Also, some or all of the functions of the control unit 250 described above may be realized as an integrated circuit such as an LSI (Large Scale Integration). Each function described above may be individually made into a processor, or a part or all of them may be integrated into a processor. Further, the method of circuit integration is not limited to LSI, and may be realized by a dedicated circuit or a general-purpose processor. In addition, when an integrated circuit technology that replaces LSI appears due to the advancement of semiconductor technology, an integrated circuit based on the technology may be used.

[Appendix]
From the above description, the present invention is grasped as follows, for example. In order to facilitate understanding of the present invention, reference numerals in the accompanying drawings are appended in parentheses for convenience, but the present invention is not limited to the illustrated embodiment.

  (Additional remark 1) The display control apparatus (20) which concerns on 1 aspect of this invention shows the visual field image showing the visual field from the virtual viewpoint in virtual space to a display part (11) as a stereoscopic vision image using binocular parallax. A display control unit (254) to be displayed, a first object (for example, a specific object) is arranged in the virtual space, and a second object (for example, a display object) associated with the first object is An object placement unit (252, S100, S106, S200, S206) that is placed in association with the position of one object, and an object change unit that scales the second object according to the distance between the virtual viewpoint and the second object ( 253, S104, S114, S204, S214).

  According to the configuration of Supplementary Note 1, the display control device changes the size of the second object according to the distance between the virtual viewpoint and the second object (for example, the display object), and thus the second displayed in the view field image. You can make the object easier to see. For example, since the game apparatus 20 can display the second object farther away from the virtual viewpoint and enlarge the second object closer to the virtual viewpoint, and reduce and display the second object closer to the virtual viewpoint, the display object can be displayed in an easily viewable manner. That is, the display control apparatus can make it easy to see the display of the virtual space using binocular parallax.

  (Additional remark 2) Moreover, the display control apparatus (20) which concerns on 1 aspect of this invention displays the visual field image showing the visual field from the virtual viewpoint in virtual space as a stereoscopic vision image using binocular parallax. ) And a display control unit (254) to be displayed and a first object (for example, a specific object) in the virtual space, and a second object (for example, a display object) associated with the first object, Object placement unit (252, S100, S106, S200, S206) to be placed in association with the position of the first object, and object change for scaling the second object according to the distance between the virtual viewpoint and the first object (253, S104, S114, S204, S214).

  According to the configuration of the supplementary note 2, the display control device determines whether the second object (for example, the display object) associated with the first object corresponds to the distance between the virtual viewpoint and the first object (for example, the specific object). Since the size is changed, it is possible to make the second object displayed in the view field image easier to see. For example, since the display control apparatus can display the second object associated with the first object as it is farther from the virtual viewpoint and can be displayed as it is closer to the virtual viewpoint, the second object can be easily viewed in the view field image. Can be displayed. That is, the display control apparatus can make it easy to see the display of the virtual space using binocular parallax.

  (Additional remark 3) Moreover, 1 aspect of this invention is a display control apparatus of Additional remark 1 or Additional remark 2, Comprising: The said object arrangement | positioning part sets the said 2nd object at a fixed distance from the said 1st object. Deploy.

  According to the configuration of Supplementary Note 3, the display control device can suppress the first object and the second object (for example, the display object) from being overlapped with each other due to the movement of the first object (for example, the specific object).

  (Additional remark 4) Moreover, 1 aspect of this invention is a display control apparatus as described in any one of Additional remark 1 to Additional remark 3, Comprising: The said object arrangement | positioning part has a said 2nd object in the said 1st object. If they are associated, the plurality of second objects are arranged equidistant from the virtual viewpoint.

  According to the configuration of Supplementary Note 4, the display control device displays the second object in an easy-to-see manner because the second object (for example, the display object) is arranged equidistantly from the user's viewpoint regardless of the arrangement position. be able to.

  (Additional remark 5) Moreover, 1 aspect of this invention is a display control apparatus as described in any one of Additional remark 1 to Additional remark 3, Comprising: The said object arrangement | positioning part makes the said 2nd object equidistant from the said virtual viewpoint. It arrange | positions with the shape which has the surface containing the line segment which becomes.

  According to the configuration of Supplementary Note 5, the display control device is equally easy to see at the center and at the end even for a second object (eg, display object) having a large horizontal width (height in the case of vertical writing) such as a long sentence. Can be displayed.

  (Additional remark 6) Moreover, 1 aspect of this invention is a display control apparatus as described in any one of Additional remark 1 to Additional remark 5, Comprising: The said object arrangement | positioning part is based on the line-of-sight direction from the said virtual viewpoint. Whether the second object is displayed on the display unit by the display control unit is switched.

  According to the configuration of Supplementary Note 6, the display control device hides the second object (for example, the display object) associated with the first object (for example, the specific object) that the user is not paying attention to. It is possible to display the second object associated with the focused first object in an easy-to-see manner.

  (Additional remark 7) Moreover, 1 aspect of this invention is a display control apparatus as described in any one of Additional remark 1 to Additional remark 6, Comprising: The said object arrangement | positioning part is said virtual viewpoint or said 1st in said virtual space. When the object moves, the arrangement position of the second object is determined according to the positional relationship between the virtual viewpoint and the first object.

  According to the configuration of Supplementary Note 7, even when the virtual viewpoint or the first object (for example, the specific object) moves, the display control device always displays the second object (for example, the display object) at a position that is easy to see. You can make it.

  (Additional remark 8) Moreover, 1 aspect of this invention is a display control apparatus as described in any one of Additional remark 1 to Additional remark 7, Comprising: The display information regarding a character is contained in a said 2nd object.

  According to the configuration of Supplementary Note 8, the display control apparatus can display the text (characters) farther from the virtual viewpoint and the text (characters) closer to the virtual viewpoint can be reduced and displayed. Character) can be displayed easily.

  (Additional remark 9) Moreover, 1 aspect of this invention is a display control apparatus as described in any one of Additional remark 1 to Additional remark 7, Comprising: The said 2nd object is an object showing a character.

  According to the configuration of Supplementary Note 9, the display control apparatus can display the text (characters) farther from the virtual viewpoint, and the text (characters) closer to the virtual viewpoint can be reduced and displayed. Character) can be displayed easily.

  (Additional remark 10) Moreover, the program which concerns on 1 aspect of this invention is a program for functioning a computer as a display control apparatus as described in any one of Additional remark 1 to Additional remark 9.

  According to the configuration of the supplementary note 10, the program is configured according to the distance between the virtual viewpoint and the second object (for example, display object) or the distance between the first object (for example, the specific object) associated with the second object. Since the size of the second object is changed, the second object displayed in the view field image can be easily seen. For example, the program can display the display object in a viewable image in an easy-to-view manner because the second object farther from the virtual viewpoint can be enlarged and the second object closer to the virtual viewpoint can be reduced and displayed. That is, the display control apparatus can make it easy to see the display of the virtual space using binocular parallax.

  1 HMD system, 10 HMD, 11 display unit, 12 sensor, 13 communication unit, 14 CPU, 20 game device, 21 input unit, 22 speaker, 23 storage unit, 24 communication unit, 25 CPU, 250 control unit, 251 detection unit 252 Object placement unit 253 Object change unit 254 Display control unit

Claims (10)

A display control unit that displays a visual field image representing a visual field from a virtual viewpoint in a virtual space as a stereoscopic image using binocular parallax;
An object placement unit for placing a first object in the virtual space and placing a second object associated with the first object in association with a position of the first object;
An object changing unit that enlarges or reduces the second object according to a distance between the virtual viewpoint and the second object;
A display control device. A display control unit that displays a visual field image representing a visual field from a virtual viewpoint in a virtual space as a stereoscopic image using binocular parallax;
An object placement unit for placing a first object in the virtual space and placing a second object associated with the first object in association with a position of the first object;
An object changing unit that enlarges or reduces the second object according to a distance between the virtual viewpoint and the first object;
A display control device. The object placement unit
Arranging the second object at a certain distance from the first object;
The display control apparatus according to claim 1 or 2. The object placement unit
When a plurality of the second objects are associated with the first object, the plurality of the second objects are arranged equidistant from the virtual viewpoint.
The display control apparatus as described in any one of Claims 1-3. The object placement unit
Arranging the second object in a shape having a plane including a line segment that is equidistant from the virtual viewpoint;
The display control apparatus as described in any one of Claims 1-3. The object placement unit
Switching whether or not the second object is displayed on the display unit by the display control unit based on the line-of-sight direction from the virtual viewpoint;
The display control apparatus according to any one of claims 1 to 5. The object placement unit
When the virtual viewpoint or the first object moves in the virtual space, the arrangement position of the second object is determined according to a positional relationship between the virtual viewpoint and the first object;
The display control apparatus according to any one of claims 1 to 6. The second object includes display information related to characters.
The display control apparatus according to any one of claims 1 to 7. The second object is an object representing a character,
The display control apparatus according to any one of claims 1 to 7.   The program for functioning a computer as a display control apparatus as described in any one of Claims 1-9.

Images