JP2019012551A - Virtual image display program, virtual image display device, and virtual image display method - Google Patents

Abstract

To provide a virtual image display program, a virtual image display device, and a virtual image display method that can provide information while suppressing a loss of immersive feeling in a virtual space.SOLUTION: A game processing device 20 displays an image of a virtual space on a display 14 by using a sensor 12 for specifying an orientation of a head of a player, and the display 14 for displaying the image. A control unit 21 of the game processing device 20 displays the image of the virtual space on the display 14 according to the orientation of the head of the player, and outputs provision information if the orientation of the head of the player is out of a prescribed reference range when displaying the image of the virtual space.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a virtual image display program, a virtual image display device, and a virtual image display method for displaying an image of a virtual space on a display.

  A virtual reality game is known in which an image of a virtual space is displayed and played on a head mounted display (hereinafter referred to as an HMD) mounted on the player's head (see, for example, Patent Document 1). The HMD includes, for example, a gyro sensor and can detect the movement of the player's head. When the player moves the head, the HMD changes the image displayed on the display following the movement of the head. In this way, the game image follows the movement of the head, so that the player can concentrate more on the game. That is, it is possible to increase the sense of immersion in the game.

Japanese Patent Laid-Open No. 7-200162

  In the virtual reality game, as in other games, there are cases where information such as display of hints for the progress of the game and display of menu items is provided. However, when the execution button for providing information is displayed together with the image of the virtual space, the feeling of immersion in the virtual space is greatly impaired. Such a problem is not limited to a virtual reality game, but is generally common in a technique for displaying a virtual space image on a display.

  The present invention has been made in view of the above circumstances, and an object thereof is to provide information while suppressing loss of immersive feeling in a virtual space.

  A virtual image display program that solves the above-described problem is for specifying a position and orientation of a predetermined part of a player's body, a storage unit that records information provision conditions and provision information, a virtual image display unit that includes a control unit A virtual image display program for displaying a virtual space image on the display using a detection device for displaying the image and a display for displaying an image, wherein the control unit displays the virtual space image on the head of the player. A spatial image output unit to be displayed on the display according to the orientation of the unit, and a case where the movement range of the head of the player deviates from a prescribed reference range when an image of the virtual space is displayed on the display And a determination unit that determines that the information provision condition is satisfied, and an information provision unit that outputs the provision information when the information provision condition is satisfied.

  With respect to the virtual image display program, a predetermined motion of the player's head is recorded in the storage unit, and a motion of the player's head is recorded in the storage unit as the information providing condition The control unit preferably outputs the provision information when an action of the head of the player corresponds to the predetermined action.

  About the said virtual image display program, it is preferable that the said information provision part displays the said provision information on the object in the said virtual space.

  About the said virtual image display program, it is preferable that the said information provision part displays the said provision information in the moving direction of the mobile body which is the object in the said virtual space, and moves within the said virtual space.

  In the virtual image display program, it is preferable that the determination unit determines that the information provision condition is satisfied when a rotation angle in at least one direction is out of a reference range.

  With respect to the virtual image display program, the reference range defines a range of rotation angles along different directions, and the determination unit determines that the orientation of the player's head is within the specified range of rotation angles. It is preferable to determine that the information provision condition is satisfied when the information is out of a plurality of ranges.

A virtual image display device that solves the above problems uses a detection device for specifying the orientation of the player's head, a display that displays an image, and a storage unit that records information provision conditions and provision information. A virtual image display device for displaying an image of a virtual space on the display, wherein the space image output unit displays the image of the virtual space on the display according to the orientation of the head of the player; A determination unit that determines that the information providing condition is satisfied when the movement range of the head of the player is out of a specified reference range when an image of a space is displayed on the display; And an information providing unit that outputs the provision information when the condition is satisfied.
A virtual image display method that solves the above-described problem is to specify the position and orientation of a predetermined part of a player's body, a storage unit that records information provision conditions and provision information, a virtual image display unit that includes a control unit A virtual image display method for displaying an image of a virtual space on the display using a detection device for displaying the image and a display for displaying an image, wherein the control unit displays the image of the virtual space on the head of the player. The information is provided when the movement range of the player's head deviates from a prescribed reference range when the virtual space is displayed on the display according to the orientation of the unit and the virtual space image is displayed on the display. When it is determined that the condition is satisfied and the information provision condition is satisfied, the provision information is output.

  According to the present invention, it is possible to provide information while suppressing loss of immersive feeling.

Schematic explaining the configuration of the system of the first embodiment. The conceptual diagram which shows the game possible area | region of the virtual space of 1st Embodiment. The flowchart which shows the procedure of the game progress process of 1st Embodiment. The flowchart which shows the procedure of the information provision process of 1st-4th embodiment. The schematic diagram which shows the image displayed on the display of 1st Embodiment. The schematic diagram which is the image displayed on the display of 1st Embodiment, and shows the state by which the hint was displayed. It is an image displayed on the display of 2nd Embodiment, Comprising: (a) shows the state which is gazing at a target object, (b) is a figure which shows the state by which the hint was displayed.

(First embodiment)
Hereinafter, a first embodiment of a virtual image display program, a virtual image display device, and a virtual image display method will be described. In this embodiment, the virtual image display device is embodied as a game processing device that progresses a game while displaying an image of a virtual space. In this game, it is assumed that the player wears a head mounted display (HMD) on the head.

  With reference to FIG. 1, a configuration of a system including the HMD 10 and the game processing device 20 will be described. First, the configuration of the HMD 10 connected to the game processing device 20 will be described. The HMD 10 includes an HMD control unit 11, a sensor 12 as a detection device, and an input / output interface unit (I / F unit) 13. The HMD control unit 11 outputs various information to the game processing device 20 and inputs various information from the game processing device 20 via the input / output I / F unit 13. The sensor 12 corresponds to a detection device for specifying the position and orientation of the player's head. The sensor 12 includes, for example, at least one of a gyro sensor, an acceleration sensor, a geomagnetic sensor, and the like, and detects the movement of the player's head. As another embodiment, a sensor that directly detects the movement of the eyeball of the player, for example, a line-of-sight detection sensor that detects near-infrared rays in the iris and detects the reflected light may be used as the sensor 12. . Here, in this embodiment, the player's head corresponds to a predetermined part of the player's body of the present invention.

  The HMD 10 also includes a display 14 that displays an image and a speaker 15 that outputs sound. For example, the display 14 displays an image visually recognized by the left eye and an image visually recognized by the right eye with parallax. Thereby, the player can visually recognize a stereoscopic image having a sense of depth. The HMD control unit 11 displays an image corresponding to the image signal received from the game processing device 20 via the input / output I / F unit 13 on the display 14. The speaker 15 is a headphone or the like, and outputs sound effects, sounds explaining the progress of the game, and the like.

  Next, the configuration of the game processing device 20 will be described. The game processing device 20 includes a control unit 21, a storage unit 22, and an input / output unit 23. The control unit 21 includes hardware elements such as a CPU, a RAM, and a ROM. In addition, the control unit 21 includes a gaze position specifying unit 24, a game management unit 25, a spatial image output unit 26, and an information providing unit 27. In the present embodiment, the control unit 21 functions as a gaze position specifying unit 24, a game management unit 25, a spatial image output unit 26, and an information providing unit 27 by causing a hardware element to execute a virtual image display program.

The storage unit 22 stores virtual space image information 30, object information 31, provision condition information 32, gaze position information 33, gaze time information 34, and provision information 35.
The virtual space image information 30 is data for drawing a background of a virtual space or an image of an object. The object includes a target object that is a selectable object and an object that cannot be selected. The target object can be selected by the player gazing continuously for a predetermined time.

  The object information 31 is information indicating the attribute of the object. Specifically, the object information 31 includes the identifier of the object, the coordinates of the object in the virtual space, the type of the object, and the selection state of the object. The object type is information indicating whether the object is a target object or any other object. The selection state of the object is information indicating whether or not the object is selected when the object is the target object.

  The provision condition information 32 is information that defines an information provision condition that is a condition for providing information to a player. In the present embodiment, the provision condition information 32 is information that defines that the gaze position of the player is outside the game possible area set in the virtual space when the elapsed time from the start of the game is a certain time or more. An example will be described. The game possible area is an area where the player can select a target object by gazing and includes all target objects. For example, the provision condition information 32 includes the coordinate information of the game possible area. Further, when the information provision condition is satisfied, the player is provided with a hint regarding the progress of the game.

  The gaze position information 33 is information indicating the identified gaze position of the player in the coordinates of the virtual space. The gaze time information 34 is information indicating a time during which the player continues to gaze at the target object. The provided information 35 includes information indicating the content of hints for clearing the mission of the game.

  The gaze position specifying unit 24 inputs a detection signal of the sensor 12 from the HMD control unit 11 of the HMD 10 attached to the player via the input / output unit 23. In addition, the gaze position specifying unit 24 specifies the gaze position according to the input detection signal with the coordinates of the virtual space, and updates the gaze position information 33 based on the specified gaze position.

  The game management unit 25 compares the gaze position information 33 and the object information 31 to determine whether or not the gaze position is on the target object. When the game management unit 25 determines that the gaze position is on the target object, the game management unit 25 measures the time (gaze time) during which the player continues to gaze at the target object, and uses the gaze time information 34 based on the gaze time. Update. Further, the game management unit 25 determines whether or not the gaze time indicated by the gaze time information 34 has reached a predetermined time (for example, 3 seconds), and selects the target object when the gaze time information 34 has reached the predetermined time. Is determined to be complete.

  Further, the game management unit 25 determines whether or not the game mission is completed. For example, the game management unit 25 determines that the mission is cleared on the condition that there are a predetermined number of objects that have been selected within the time limit of the game. The game management unit 25 determines that the game is over when the elapsed time from the start of the game reaches the time limit without a predetermined number of target objects having been selected.

  Furthermore, the game management unit 25 determines whether or not the information provision condition is satisfied based on the provision condition information 32. In the present embodiment, the information providing condition is that the elapsed time from the start of the game exceeds a certain time and the gaze position of the player is outside the game possible area. The fixed time is set by, for example, a predetermined time that the remaining time until the time limit is small, or an average time required for the player to clear the mission. When the game management unit 25 determines that the information provision condition is satisfied, the game management unit 25 outputs an output request for the provision information 35 to the information provision unit 27.

  Further, the game management unit 25 extracts sound information such as sound effects and sound explaining the progress of the game from a sound information storage unit (not shown), and transmits the sound information to the HMD 10 via the input / output unit 23.

  The space image output unit 26 extracts the virtual space image information 30 in the visual field range centered on the coordinates indicated by the gaze position information 33, and transmits it to the HMD 10 as an image signal. The space image output unit 26 displays a character corresponding to the player in the virtual space. Further, when the game management unit 25 determines that the target object has been selected, the spatial image output unit 26 changes the display mode of the target object that has been selected.

  The information providing unit 27 reads the provision information 35 when the display request for the hint output from the game management unit 25 is input. Then, a display corresponding to the provision information 35 is output to the display 14 and displayed on the virtual space image.

Next, an object selection function by the game processing apparatus 20 will be described with reference to FIG.
The gaze position specifying unit 24 receives the detection signal of the sensor 12 from the HMD 10 and specifies the position and orientation of the head of the player 101 according to the detection signal. Specifically, the gaze position specifying unit 24 determines the position and orientation of the head, the X axis along the horizontal direction and the pitch θp indicating the rotation direction around the X axis, the Y axis along the vertical direction, and the Y axis. The yaw θy indicating the rotation direction around the axis, the Z axis along the depth direction, and the position of the roll θr indicating the rotation direction around the Z axis and the angle around each axis are calculated.

  The gaze position specifying unit 24 specifies the gaze position P1 of the player 101 in the virtual space based on the calculated position and orientation of the head. A known method can be used as the method for specifying the gaze position. For example, the gaze position specifying unit 24 virtually sets a straight line connecting the left eye position and the right eye position, extends in a direction orthogonal to the straight line, and passes through the middle point of the left eye position and the right eye position as the gaze direction D1. And Furthermore, the gaze position specifying unit 24 specifies the intersection of the line-of-sight direction D1 and the object 102 (or background) as the gaze position P1. Note that when the sensor 12 detects the movement of the eyeball or detects the reflected light from within the iris, the line-of-sight direction is specified based on the movement of the eyeball or the reflected light.

  Further, a game available area 105 is provided in the virtual space. The game possible area 105 is set around the character corresponding to the player. Since all the target objects 103 are included in the game possible area 105, the gaze position P1 is located in the game possible area 105 when the target object 103 is selected by gaze.

  The space image output unit 26 extracts the virtual space image information 30 in the visual field range centering on the gaze position, and transmits the virtual space image information 30 to the HMD control unit 11 as an image signal. The HMD control unit 11 outputs an image corresponding to the received virtual space image information 30 to the display 14.

(Game progress process)
Next, the game progress process will be described with reference to FIG. The end condition of this process is that either the mission clear condition is satisfied or the elapsed time from the start of the game has reached the time limit. This process is repeated until the end condition is satisfied. The elapsed time is measured by the game management unit 25 based on the system time using the CPU clock signal or the like until the game is over.

  When the game is started, the control unit 21 specifies the gaze position of the player (step S1). Specifically, the gaze position specifying unit 24 of the control unit 21 specifies the gaze position of the player by the above-described method, and updates the gaze position information 33 with the specified gaze position.

  The control unit 21 determines whether or not the selection of the target object is completed using the gaze position information 33 (Step S2). Specifically, the game management unit 25 of the control unit 21 reads the object information 31 and the gaze position information 33 of the target object from the storage unit 22, compares the coordinates of the target object with the gaze position, and sets the gaze position as the target. Determine if it exists on the object.

  When the gaze position exists on the target object, the game management unit 25 measures the gaze time using the system time and updates the gaze time information 34 with the measured gaze time. The game management unit 25 determines that the selection is complete when the gaze time reaches a predetermined time.

  When the gaze position is outside the target object without the gaze time reaching the predetermined time, the game management unit 25 determines that the selection of the target object has not been completed (in the case of “NO” in step S2). The gaze time is reset, and the process returns to step S1.

  When the game management unit 25 determines that the selection of the target object has been completed (in the case of “YES” in step S2), the game management unit 25 updates the selection state of the object information 31 to “selection complete”, and proceeds to step S3. At this time, the spatial image output unit 26 changes the display mode of the target object that has been selected.

  When the selection of the target object is completed, the control unit 21 determines whether or not the mission clear condition is satisfied (step S3). Specifically, the game management unit 25 of the control unit 21 refers to the selection status of the object information 31 and determines whether or not there are a predetermined number of objects that have been selected within the time limit of the game. .

  When the number of target objects for which selection has been completed is equal to or greater than a predetermined number, the control unit 21 determines that the mission clear condition is satisfied (in the case of “YES” in step S3). In this case, since the end condition of the game progress process is established, the game ends.

  When the number of target objects that have been selected is less than the predetermined number, the control unit 21 determines that the mission clear condition is not satisfied (in the case of “NO” in step S3), and returns to step S1. Specifically, when the game management unit 25 of the control unit 21 determines that the mission clear condition is not satisfied, the gaze position is specified in step S1.

(Information provision processing)
Next, with reference to FIG. 4, the processing procedure for the information provision processing will be described. In this embodiment, this process is a process executed in parallel with the game progress process.

  An end condition for this process is that either the mission clear condition is satisfied or that the elapsed time measured from the start of the game before reaching the mission reaches the time limit. This process is repeated until the end condition is satisfied.

  The control unit 21 of the game processing device 20 determines whether or not the information providing condition is satisfied (step S10). Specifically, the game management unit 25 of the control unit 21 determines whether or not the elapsed time has reached a certain time and the gaze position is outside the game available area.

  For this purpose, the game management unit 25 acquires the elapsed time and determines whether or not the elapsed time has reached a certain time. If it is determined that the elapsed time has reached a certain time, the game management unit 25 reads the gaze position information 33 and the provision condition information 32 from the storage unit 22 and determines whether or not the gaze position is outside the game possible area. . When it is determined that the gaze position is outside the game possible area, the game management unit 25 assumes that the information provision condition is satisfied.

  If it is determined that the information provision condition is satisfied (in the case of “YES” in step S10), the control unit 21 performs information provision (step S11). Specifically, the game management unit 25 of the control unit 21 outputs an information provision request to the information provision unit 27. In response to the information provision request, the information provision unit 27 reads the provision information 35 from the storage unit 22 and outputs it to the HMD 10.

On the other hand, when the information provision condition is not satisfied (in the case of “NO” in step S10), the control unit 21 repeats the determination whether the information provision condition is satisfied (step S10).
This information providing process may be linked with the game progress process. For example, when the selection of the target object is completed in the game progress process (in the case of “YES” in step S2) or when it is determined that the mission clear condition is satisfied (in the case of “YES” in step S3), the information You may reset the elapsed time measured in order to provide. Alternatively, based on the determination of the completion of selection of the target object in the information providing process (step S2), instead of the elapsed time from the start of the game, the time when no target object is selected from the start of the game is used and the time is constant The information providing condition may be that the time has been reached and the gaze position is outside the game possible area.

(Display image)
Next, an image displayed on the display 14 of the HMD 10 while the game is in progress will be described with reference to FIGS. 5 and 6. Note that the virtual space images shown in FIGS. 5 and 6 are schematically shown regardless of the visual field range of the HMD 10.

  As shown in FIG. 5, the display 14 of the HMD 10 displays an image based on the virtual space image information 30 and a virtual space image 110 centered on the gaze position. In the virtual space image 110, the target object 103 is displayed in the game possible area 105. Note that an object 106 other than the target object 103 may be displayed in the game available area 105.

  As shown in FIG. 6, when the gaze position is outside the game possible area 105, the information provision display 111 is output so as to be superimposed on the virtual space image 110 outside the game possible area 105. The information provision display 111 displays the contents of hints based on the provision information 35. Since the information provision display 111 is displayed so as to overlap the virtual space image 110 outside the game possible area, the information provision display 111 does not overlap the target object. For this reason, information can be provided so as not to prevent selection of the target object. Further, since the information providing display 111 is not displayed unless the elapsed time exceeds a certain time, it is possible to prevent the player from being bothered by frequent information provision.

  In FIG. 6, a moving body 112 that is a bird that moves outside the game possible area 105 is displayed so as to hold an information providing display 111 on which a hint is written. That is, the information providing display 111 moves according to the moving speed and moving direction of the moving body 112. The moving body 112 and the information providing display 111 are drawn as objects existing in the virtual space in a state where image attributes such as brightness and color tone are matched with the virtual space image. By holding the information providing display 111 on the object in the virtual space in this way, it is possible to provide information without impairing the immersive feeling in the virtual space.

  As described above, when the gaze position is outside the game possible area, it is determined that the target object has not been smoothly selected, and the information providing display 111 is displayed. For this reason, information can be provided at an appropriate timing for the player. In addition, by providing information based on the movement of the gaze position in this manner, an information provision execution button or the like can be omitted. For this reason, the loss of the immersive feeling to virtual space can be suppressed.

As described above, according to the first embodiment, the effects listed below can be obtained.
(1) In the first embodiment, since information provision is executed on the condition that the movement of the gaze position of the player matches the information provision condition, it is necessary to display an information provision execution button on the image in the virtual space. Absent. Therefore, it is possible to provide information while suppressing loss of immersive feeling in the virtual space.

  (2) In the first embodiment, the information provision is executed when the gaze position of the player is out of the game possible area including all the target objects. That is, for example, when the selection of the target object is interrupted, for example, when the player is at a loss about the progress of the game or the like, the information can be provided at an appropriate timing.

  (3) In the said 1st Embodiment, the hint was displayed on the object (moving body) which moves in virtual space. Since the player pays attention to what is moving, it is possible to make the player pay attention to the hint in a natural form.

(Second Embodiment)
Next, a second embodiment of the virtual image display program, the virtual image display device, and the virtual image display method will be described with reference to FIGS. 4 and 7. In addition, since 2nd Embodiment is the structure which changed a part of information provision process of 1st Embodiment, it attaches | subjects the same code | symbol about the same part, and abbreviate | omits the detailed description.

  In the present embodiment, the information providing condition is that the player stops watching without completing the selection of the target object, and that the watching position is outside the game possible area after stopping watching. Different from the embodiment.

  The information providing process will be described with reference to FIG. An end condition for this process is that either the mission clear condition is satisfied or that the elapsed time measured from the start of the game before reaching the mission reaches the time limit. This process is repeated until the end condition is satisfied.

  The control unit 21 of the game processing device 20 determines whether or not the information providing condition is satisfied (step S10). Specifically, the game management unit 25 of the control unit 21 reads the gaze position information 33 and the object information 31 from the storage unit 22 and determines whether or not the gaze position is on the target object. If the gaze position is other than the target object, the game management unit 25 determines that the information provision condition is not satisfied (in the case of “NO” in step S10), and repeats the determination in step S10.

  If it is determined that the player gazes at the target object, the game management unit 25 acquires the gaze time, and whether or not the gaze position is outside the game available area before the gaze time reaches a predetermined time for selecting the target object. Determine whether. If the gaze position is on the target object, the game management unit 25 determines that the information provision condition is not satisfied (in the case of “NO” in step S10), and repeats the determination in step S10.

On the other hand, the game management unit 25 provides information when the gaze position is outside the game possible area before the gaze time when the gaze of the target object reaches the predetermined time (step S11).
With reference to FIG. 7, an image displayed on the display 14 of the HMD 10 while the game is in progress will be described. Note that the virtual space image shown in FIG. 7 is schematically shown regardless of the visual field range of the HMD 10.

  As shown in FIG. 7A, when the player gazes at the target object 103 displayed in the virtual space image 110, the space image output unit 26 displays the gauge 120 over the target object 103. The gauge 120 displays the passage of time from the start of gaze until a predetermined time is reached.

As shown in FIG. 7B, when the gaze position of the target object 103 is outside the game possible area 105, the information providing display 111 is output.
In FIG. 7B, the information providing display 111 is displayed in the moving direction of the bird that is the moving body 112. The player is more likely to focus on the moving body 112 than the stationary object. Therefore, by displaying the information providing display 111 ahead of the moving direction of the moving body 112, the player can easily notice the information providing display 111. In addition, since the information providing display 111 is displayed in a stationary state, it is possible for the player to easily confirm the contents of the information providing display 111.

  As described above, in the present embodiment, as the information providing condition, a plurality of players that have stopped watching without completing the selection of the target object, and that the watching position is out of the game possible area after stopping watching. Is specified. Therefore, the situation of the player can be determined more accurately in consideration of a plurality of actions.

As described above, according to the second embodiment, in addition to the effects described in the first embodiment, the effects listed below can be obtained.
(4) In the second embodiment, the information providing condition is that the gaze position of the player has moved outside the game possible area outside the target object in a state where selection of the target object is not completed. Thereby, since information can be provided when the target object cannot be selected, the information can be provided at an appropriate timing.

  (5) In the second embodiment, the information provision display 111 is output in the moving direction of the moving body 112 that is an object in the virtual space and moves in the virtual space such as a bird. Thereby, information provision can be output without impairing the immersive feeling in the virtual space.

(Third embodiment)
Next, a third embodiment of the virtual image display program, the virtual image display device, and the virtual image display method will be described with reference to FIG. In addition, since 3rd Embodiment is the structure which changed a part of information provision process of 1st Embodiment, it attaches | subjects the same code | symbol about the same part, and abbreviate | omits the detailed description.

  In the present embodiment, before the information provision condition clears the mission, the range of movement of the predetermined part of the player's body is outside the range of movement of the predetermined part of the standard body when the target object is selected. This is different from the first embodiment. The predetermined part of the player's body is the head. The standard range of head movement when selecting the target object is defined in advance. In the present embodiment, the game available area may not be set.

  The range of movement of the head of the player indicates the range of movement of the head from when the game is started. In addition, the range of movement of the player's head is defined as, for example, a range of pitch θp, yaw θy, and roll θr indicating angle coordinates. The predefined range of head movement is recorded in the storage unit 22 in a state included in the provision condition information 32, for example.

  When the range of the movement of the player's head is narrower than the prescribed reference range, the range that the player is watching may be too narrow. On the other hand, if the range of movement of the player's head is wider than the specified reference range, the player has not cleared the mission even though the range being watched by the player is sufficiently wide. There is a possibility that the player does not know the operation method or the player cannot find the target object. As described above, when the range of the movement of the head of the player is too narrow or too wide, a hint about the progress of the game is provided to promote the mission clear.

  The information providing process will be described with reference to FIG. An end condition for this process is that either the mission clear condition is satisfied or that the elapsed time measured from the start of the game before reaching the mission reaches the time limit. This process is repeated until the end condition is satisfied.

  The control unit 21 of the game processing device 20 determines whether or not the information provision condition is satisfied (step S10). Specifically, the game management unit 25 of the control unit 21 calculates the range of movement of the player's head. In the present embodiment, it is assumed that a history of the movement of the player's head since the start of the game is accumulated. Further, the game management unit 25 reads the provision condition information 32 and determines whether or not the range of movement of the head of the player is outside the reference range included in the provision condition information 32. For example, it is assumed that the reference range included in the provision condition information 32 is a range that defines a range for each of the three rotation directions described above.

  When the range of movement of the player's head is outside the reference range with respect to at least one rotation direction, the game management unit 25 determines that the range of movement of the player's head is outside the reference range. .

  When it is determined that the information provision condition is not satisfied (in the case of “NO” in step S10), the control unit 21 repeats the determination regarding the information provision condition (step S10). Specifically, the game management unit 25 of the control unit 21 determines that the information providing condition is not satisfied when the range of movement of the player's head is outside the reference range in at least one rotation direction, The determination in step S10 is repeated.

  On the other hand, when the control unit 21 determines that the information provision condition is satisfied (in the case of “YES” in step S10), the information provision is executed (step S11). Specifically, when the range of the movement of the player's head is within the reference range for all rotation directions, the game management unit 25 determines that the information provision condition is satisfied and executes information provision .

As described above, according to the third embodiment, in addition to the effects described in the first embodiment, the effects listed below can be obtained.
(6) In the third embodiment, the information providing condition is that the range of the movement of the player's head deviates from the specified reference range. As a result, the information provision condition is satisfied when the gaze position of the player is too narrow or too wide, so that the information provision can be executed at an appropriate timing.

(Fourth embodiment)
Next, a fourth embodiment of the virtual image display program, the virtual image display device, and the virtual image display method will be described with reference to FIG. In addition, since 4th Embodiment is the structure which changed a part of information provision process of 1st Embodiment, it attaches | subjects the same code | symbol about the same part, and abbreviate | omits the detailed description.

  This embodiment is different from the first embodiment in that the movement of a predetermined part of the player's body corresponds to a prescribed predetermined action as the information providing condition. The predetermined part of the player's body is the head. In the present embodiment, the predetermined action is an unstable and unique movement that is different from the normal movement of the head of the player when selecting the target object, such as a state of calmness or a state of busyness.

  Here, the movement of the player's head is represented by the average of the moving speed of the player's head, the maximum or minimum value of the moving speed of the player's head, the number of times the moving direction is changed per unit time, and the like. The moving speed of the player's head is calculated from the position and orientation of the head specified by the control unit 21 of the game processing device 20. The provision condition information 32 defines a predetermined motion of the player's head. Specifically, the provision condition information 32 stipulates a specific head movement that is different from that in selecting a target object.

  The information providing process will be described with reference to FIG. Further, the termination condition of this process is that either the mission clear condition is satisfied, or that the elapsed time measured from the start of the game before reaching the mission reaches the time limit. This process is repeated until the end condition is satisfied.

  The control unit 21 of the game processing device 20 determines whether or not the information provision condition is satisfied (step S10). Specifically, the game management unit 25 of the control unit 21 uses the position and orientation of the player's head calculated according to the detection signal input from the sensor 12, for example, the average moving speed of the player's head, etc. The movement of the player's head is calculated. Then, the game management unit 25 reads the provision condition information 32 and determines whether or not the calculated movement of the player's head corresponds to a predetermined action on the player's head included in the provision condition information 32. .

  When it is determined that the information providing condition is not satisfied (in the case of “NO” in step S10), the control unit 21 repeats the determination regarding the information providing condition (step S10). Specifically, the game management unit 25 of the control unit 21 determines that the information provision condition is not satisfied when the calculated movement of the head of the player does not correspond to a predetermined action included in the provision condition information 32. The determination in step S10 is repeated.

  On the other hand, when it is determined that the information provision condition is satisfied (in the case of “YES” in step S10), the control unit 21 performs information provision (step S11). Specifically, the game management unit 25 of the control unit 21 determines that the information providing condition is satisfied when the calculated movement of the head of the player corresponds to a predetermined action included in the providing condition information 32. Execute information provision.

As described above, according to the fourth embodiment, in addition to the effects described in the first embodiment, the effects listed below can be obtained.
(7) In the fourth embodiment, the information providing condition is that the movement of the player's head corresponds to a predetermined action recorded in the storage unit 22. Thereby, since the information provision condition is established when the player is lost, the information provision can be executed at an appropriate timing.

In addition, each said embodiment can also be suitably changed and implemented as follows.
In each of the above embodiments, the game possible area is an area that includes all target objects, but may be an area that includes at least a predetermined number of target objects for mission clear.

  In each of the above embodiments, the object includes a selectable target object and a non-selectable object. However, all objects displayed in the virtual space may be selectable objects.

  In each of the above embodiments, the game mission clear condition is that a predetermined number of target objects have been selected within the time limit of the game, but other conditions may be used. For example, the timing for selecting the target object may coincide with a preset timing, or the same target object may be selected a predetermined number of times.

  In the first embodiment, the information provision display 111 is displayed as paper held by a bird that is a moving body, and this paper is also moved in accordance with the moving body. In addition, the information providing display 111 may be a moving body other than a bird, for example, a moving body that moves in a virtual space, such as a vehicle such as an airplane, a living thing such as a butterfly, and a fallen leaf. Moreover, the hint regarding the progress of a game may be written in those mobile bodies themselves, or those mobile bodies may hold the information provision display 111. Alternatively, paper that falls in the virtual space may be used as a moving body, and hints may be displayed on the paper.

  In the first embodiment, the information providing display 111 is not displayed unless the elapsed time exceeds a certain time. In addition to this, the information provision display 111 may be displayed simply when the gaze position is outside the game possible area.

  In the second embodiment, the information providing display 111 is displayed on the condition that the gaze position of the player is out of the game possible area in a state where the selection of the target object is not completed. In addition to this, the information providing display 111 may be displayed when the target object selection is not completed and the gaze position of the player is outside the target object even within the game possible area.

  In the third embodiment, the range of head movement is represented by three rotational directions, but may be represented by other variables. For example, the range of movement of the head is based on the position and orientation of the head when the player faces the horizontal direction, “90 ° on the left side, 90 ° on the right side”, “30 ° on the upper side, and on the lower side. It may be expressed as “30 °”.

  In the third embodiment, when the range of movement of the player's head is outside the reference range with respect to at least one rotation direction, it is determined that the range of movement of the head is outside the reference range. In addition to this, when the range of movement of the head of the player is out of the reference range in all rotation directions, it may be determined that the range of movement of the head is out of the reference range.

  In the third embodiment, the information provision condition is that the range of the head movement of the player is outside the standard range of head movement when selecting the target object. In the fourth embodiment, the information providing condition is that the movement of the player's head corresponds to the prescribed predetermined action. “Head movement” in these information provision conditions may be replaced with “gaze position”. That is, the information providing condition of the third embodiment may be such that the range of movement of the gaze position is outside the range of movement of the reference gaze position when selecting the target object. The information providing condition of the fourth embodiment may be such that the movement of the gaze position corresponds to a prescribed predetermined operation.

  In each of the above-described embodiments, hints relating to the game are displayed as information provision. However, other information may be provided. For example, information such as a menu item, a score, a character state, a remaining time during which the game can be continued, and a game progress stage may be provided.

  The information provision condition of the first embodiment or the information provision condition of the second embodiment is the information provision condition of the third embodiment, “the range in which the head movement is included before the mission is cleared. "Being out of the reference range" may be added. Alternatively, the information providing condition of the first embodiment or the information providing condition of the second embodiment is that the information providing condition of the fourth embodiment is “the movement of the head corresponds to a predetermined movement”. May be added. Alternatively, both the information provision condition of the third embodiment and the information provision condition of the fourth embodiment may be added to the information provision condition of the first embodiment or the information provision condition of the second embodiment. Even in this case, it is possible to provide information while suppressing loss of immersive feeling in the virtual space.

  In the above embodiments, information is provided by outputting an information provision display on the display 14. In addition to this, when the information provision condition is satisfied, the information provision may be performed by a voice about the hint content, a warning sound, or the like.

  The HMD control unit 11 may calculate the position and orientation of the head based on the detection signal of the sensor 12. As described above, it is also possible to give the HMD 10 a part of the functions of the game processing device 20 described in the above embodiments.

  In each of the above embodiments, the gaze position of the player is calculated based on the position and orientation of the player's head. For example, the gaze direction is calculated based on the position of the pupil, and the gaze position is specified from the gaze direction. You may do it. Further, for example, the gaze direction may be calculated based on the position and direction of the nose or the position and direction of the mouth, and the gaze position may be specified from the gaze direction. Note that the direction of the nose and mouth may be determined as a direction from the back of the head toward the nose or mouth, for example.

In each of the above embodiments, the virtual image display device is embodied as a game processing device, but the virtual image display device may be applied to a virtual reality system for other purposes. For example, the present invention may be applied to various simulations such as driving and vocational training, medical training, product monitoring, movie and music appreciation, and the like. Even if the virtual image display device is applied to a virtual reality system for uses other than games, information can be provided while suppressing loss of the immersive feeling of the player (user) in the virtual space.
Next, technical ideas that can be grasped from the above-described embodiment and other examples will be described below together with their effects.
[A] A virtual image display device including a storage unit and a control unit that record information provision conditions and provision information, a detection device for specifying the position and orientation of a predetermined part of the player's body, and an image are displayed A virtual image display program for displaying an image of a virtual space on the display using a display,
The control unit
A spatial image output unit that displays an image of the virtual space on the display in accordance with the position and orientation of a predetermined part of the player's body;
A virtual image display program that functions as an information providing unit that outputs the provided information when the information providing conditions regarding the position and orientation of a predetermined part of the player's body are satisfied.
[B] The virtual space includes a target object that can be selected by gaze of the player,
In the storage unit, an area including the target object is recorded,
The information providing condition includes that the gaze position specified from the position and orientation of the predetermined part of the player's body is out of the area,
The virtual image display program according to [a], wherein the control unit outputs the provision information when the gaze position of the player is out of the area.
[C] The virtual space includes a target object that can be selected by gaze of the player,
The information providing condition includes that the gaze position specified from the position and orientation of the predetermined part of the player's body has moved out of the target object without completing the selection of the target object,
The virtual image display program according to [a] or [b], wherein the control unit outputs the provision information when the gaze position of the player moves outside the target object in a state where selection of the target object is not completed. .
[D] In the storage unit, a reference range relating to a movement of a predetermined part of the player's body is recorded as the information providing condition,
The information providing condition includes that a movement of a predetermined part of the player's body deviates from the reference range,
The virtual image display program according to any one of [a] to [c], wherein the control unit outputs the provision information when a movement of a predetermined part of the body of the player is out of the reference range.
[E] A predetermined motion of a predetermined part of the player's body is recorded in the storage unit,
The information providing condition includes that a movement of a predetermined part of the body of the player corresponds to a predetermined action recorded in the storage unit,
The virtual image display program according to any one of [a] to [d], wherein the control unit outputs the provision information when a movement of a predetermined part of the player's body corresponds to the predetermined action. .
[F] The virtual image display program according to any one of [a] to [e], wherein the information providing unit displays the provided information on an object in the virtual space.
[G] In any one of [a] to [f], the information providing unit displays the provision information in a moving direction of an object in the virtual space that moves in the virtual space. The virtual image display program described.
[H] A virtual image display device for displaying an image of a virtual space on the display using a detection device for specifying the position and orientation of a predetermined part of the player's body and a display for displaying an image,
A storage unit that records information provision conditions and provision information;
A spatial image output unit that displays an image of the virtual space on the display in accordance with the position and orientation of a predetermined part of the player's body;
A virtual image display device comprising: an information providing unit configured to output the provision information when the information provision conditions regarding the movement of the position and orientation of a predetermined part of the player's body are satisfied.
[I] A virtual image display device including a storage unit and a control unit that record information provision conditions and provision information, a detection device for specifying the position and orientation of a predetermined part of the player's body, and an image are displayed. A virtual image display method for displaying an image of a virtual space on the display using a display,
The control unit is
An image of the virtual space is displayed on the display according to the position and orientation of a predetermined part of the player's body,
A virtual image display method characterized in that the provision information is output when the information provision conditions regarding the position and orientation of a predetermined part of the player's body are satisfied.

  DESCRIPTION OF SYMBOLS 10 ... HMD, 11 ... HMD control part, 12 ... Tracking sensor, 13 ... Input / output I / F part, 14 ... Display, 15 ... Speaker, 20 ... Game processing apparatus, 21 ... Control part, 22 ... Memory | storage part, 23 ... Input / output unit, 24 ... gaze position specifying unit, 25 ... game management unit, 26 ... spatial image output unit, 27 ... information providing unit, 30 ... virtual space image information, 31 ... object information, 32 ... provision condition information, 33 ... Gaze position information, 34... Gaze time information, 35.

Claims (8)

Using a storage unit that records information provision conditions and provision information, a virtual image display unit that includes a control unit, a detection device for specifying the orientation of the player's head, and a display that displays an image, A virtual image display program for displaying an image of a virtual space on the display,
The control unit
A spatial image output unit for displaying an image of the virtual space on the display according to the orientation of the head of the player;
A determination unit that determines that the information providing condition is satisfied when the orientation of the head of the player is out of a specified reference range when displaying an image of the virtual space on the display;
A virtual image display program that functions as an information providing unit that outputs the provision information when the information provision condition is satisfied. In the storage unit, a predetermined motion of the player's head is recorded,
The information providing condition includes that the action of the head of the player corresponds to a predetermined action recorded in the storage unit;
The virtual image display program according to claim 1, wherein the control unit outputs the provision information when an action of the head of the player corresponds to the predetermined action.   The virtual image display program according to claim 1, wherein the information providing unit displays the provision information on an object in the virtual space.   The virtual image display according to any one of claims 1 to 3, wherein the information providing unit displays the provision information in a moving direction of a moving body that is an object in the virtual space and moves in the virtual space. program.   The virtual image display program according to any one of claims 1 to 4, wherein the determination unit determines that the information provision condition is satisfied when a rotation angle in at least one direction is out of a reference range. . The reference range defines a range of rotation angles along different directions,
5. The determination unit according to claim 1, wherein the determination unit determines that the information providing condition is satisfied when a direction of the head of the player deviates from a plurality of ranges of the specified rotation angle range. The virtual image display program according to claim 1. An image of the virtual space is displayed on the display using a detection device for specifying the orientation of the head of the player, a display that displays an image, and a storage unit that records information provision conditions and provision information. A virtual image display device for
A spatial image output unit for displaying an image of the virtual space on the display according to the orientation of the head of the player;
A determination unit that determines that the information providing condition is satisfied when the orientation of the head of the player is out of a specified reference range when displaying an image of the virtual space on the display;
A virtual image display device comprising: an information providing unit that outputs the provision information when the information provision condition is satisfied. Using a storage unit that records information provision conditions and provision information, a virtual image display unit that includes a control unit, a detection device for specifying the orientation of the player's head, and a display that displays an image, A virtual image display method for displaying an image of a virtual space on the display,
The control unit is
An image of the virtual space is displayed on the display according to the orientation of the player's head,
When the image of the virtual space is displayed on the display and the orientation of the player's head is out of a specified reference range, it is determined that the information providing condition is satisfied,
The virtual image display method, wherein the provision information is output when the information provision condition is satisfied.

Images